2024-04-26T11:57:19.883 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T11:57:19.883 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/centos_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} --archive /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674200 --name teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi --owner scheduled_teuthology@teuthology -- /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674200/orig.config.yaml 2024-04-26T11:57:19.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T11:57:20.001 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674200 branch: reef description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/centos_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7674200' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: reef ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: zstd bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: dc093b5e41f728edab6e0330295fdf9156d31664 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: dc093b5e41f728edab6e0330295fdf9156d31664 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 7d2137f0a666c92a9411c1af5c33e4968be54da6 owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 1136 sha1: dc093b5e41f728edab6e0330295fdf9156d31664 sleep_before_teardown: 0 subset: 0/4 suite: powercycle suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 7d2137f0a666c92a9411c1af5c33e4968be54da6 targets: smithi052.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDBhB7e8aFLoBGs2RipZnsF9E5rXXABBtzKJavtKIcABoX/yme8YlQ74FzLwSMkqBV/39bn4k7iz1zBzW44gLgc= smithi143.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG99naOH0O9bv+Y8m80wcu1NDsqxWIDuyUtr3IcweYKEybQPp+zQQF46mWWuR3bWe27HuvL8RdkbUErcQ25SQHA= smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEtLAJM2hL3qYeNsGRhnV6ppUSpiF72a46DsPYQfad860otdeIohaqxJQbUJIpWPvhYGPA1+xohEQqGeRmIbMOQ= smithi164.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyEZicLkM3LaQk8biYWB6Iu24moSE0Hxh0lWbpQ9cAr0v8FcdhbXSK5bmDd0zgUeJfZxOTTeqWCMRnVVcEbV94= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsstress.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_22:32:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T11:57:20.002 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa; will attempt to use it 2024-04-26T11:57:20.002 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa/tasks 2024-04-26T11:57:20.003 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T11:57:20.006 INFO:teuthology.task.internal:Checking packages... 2024-04-26T11:57:20.033 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'dc093b5e41f728edab6e0330295fdf9156d31664' 2024-04-26T11:57:20.034 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T11:57:20.034 INFO:teuthology.packaging:ref: None 2024-04-26T11:57:20.034 INFO:teuthology.packaging:tag: None 2024-04-26T11:57:20.034 INFO:teuthology.packaging:branch: reef 2024-04-26T11:57:20.034 INFO:teuthology.packaging:sha1: dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:57:20.034 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-04-26T11:57:20.341 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1258.g7d2137f0 2024-04-26T11:57:20.342 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T11:57:20.348 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T11:57:20.348 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T11:57:20.355 INFO:teuthology.task.internal:Saving configuration 2024-04-26T11:57:20.368 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T11:57:20.374 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T11:57:20.398 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674200', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 11:52:06.467004', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDBhB7e8aFLoBGs2RipZnsF9E5rXXABBtzKJavtKIcABoX/yme8YlQ74FzLwSMkqBV/39bn4k7iz1zBzW44gLgc='} 2024-04-26T11:57:20.424 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674200', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 11:52:06.465349', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG99naOH0O9bv+Y8m80wcu1NDsqxWIDuyUtr3IcweYKEybQPp+zQQF46mWWuR3bWe27HuvL8RdkbUErcQ25SQHA='} 2024-04-26T11:57:20.448 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674200', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 11:52:06.468468', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEtLAJM2hL3qYeNsGRhnV6ppUSpiF72a46DsPYQfad860otdeIohaqxJQbUJIpWPvhYGPA1+xohEQqGeRmIbMOQ='} 2024-04-26T11:57:20.469 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674200', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 11:52:06.470033', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyEZicLkM3LaQk8biYWB6Iu24moSE0Hxh0lWbpQ9cAr0v8FcdhbXSK5bmDd0zgUeJfZxOTTeqWCMRnVVcEbV94='} 2024-04-26T11:57:20.470 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T11:57:20.476 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-04-26T11:57:20.476 INFO:teuthology.task.internal:roles: ubuntu@smithi143.front.sepia.ceph.com - ['osd.0'] 2024-04-26T11:57:20.476 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['osd.1'] 2024-04-26T11:57:20.476 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['osd.2'] 2024-04-26T11:57:20.476 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T11:57:20.617 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f218a39a0d0>, signals=[15]) 2024-04-26T11:57:20.618 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T11:57:20.624 INFO:teuthology.task.internal:Opening connections... 2024-04-26T11:57:20.624 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi052.front.sepia.ceph.com 2024-04-26T11:57:20.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:57:20.702 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T11:57:20.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:57:20.774 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2024-04-26T11:57:20.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:57:20.846 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi164.front.sepia.ceph.com 2024-04-26T11:57:20.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:57:20.920 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T11:57:20.928 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2024-04-26T11:57:20.946 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2024-04-26T11:57:20.946 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2024-04-26T11:57:21.004 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2024-04-26T11:57:21.004 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9" 2024-04-26T11:57:21.004 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2024-04-26T11:57:21.004 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2024-04-26T11:57:21.004 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9" 2024-04-26T11:57:21.005 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9" 2024-04-26T11:57:21.005 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T11:57:21.005 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2024-04-26T11:57:21.005 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon" 2024-04-26T11:57:21.005 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T11:57:21.005 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2024-04-26T11:57:21.005 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T11:57:21.005 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T11:57:21.005 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T11:57:21.006 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2024-04-26T11:57:21.030 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2024-04-26T11:57:21.048 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2024-04-26T11:57:21.049 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2024-04-26T11:57:21.106 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2024-04-26T11:57:21.106 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="9" 2024-04-26T11:57:21.106 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2024-04-26T11:57:21.106 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2024-04-26T11:57:21.106 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="9" 2024-04-26T11:57:21.106 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el9" 2024-04-26T11:57:21.106 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T11:57:21.106 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2024-04-26T11:57:21.106 INFO:teuthology.orchestra.run.smithi143.stdout:LOGO="fedora-logo-icon" 2024-04-26T11:57:21.106 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T11:57:21.106 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2024-04-26T11:57:21.106 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T11:57:21.107 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T11:57:21.107 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T11:57:21.107 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2024-04-26T11:57:21.129 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-04-26T11:57:21.147 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-04-26T11:57:21.147 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-04-26T11:57:21.205 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2024-04-26T11:57:21.205 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9" 2024-04-26T11:57:21.205 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2024-04-26T11:57:21.205 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2024-04-26T11:57:21.205 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9" 2024-04-26T11:57:21.205 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9" 2024-04-26T11:57:21.205 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T11:57:21.205 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2024-04-26T11:57:21.205 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon" 2024-04-26T11:57:21.205 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T11:57:21.206 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2024-04-26T11:57:21.206 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T11:57:21.206 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T11:57:21.206 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T11:57:21.206 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-04-26T11:57:21.229 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2024-04-26T11:57:21.247 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2024-04-26T11:57:21.248 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2024-04-26T11:57:21.305 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream" 2024-04-26T11:57:21.306 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="9" 2024-04-26T11:57:21.306 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2024-04-26T11:57:21.306 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2024-04-26T11:57:21.306 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="9" 2024-04-26T11:57:21.306 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el9" 2024-04-26T11:57:21.306 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T11:57:21.306 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2024-04-26T11:57:21.306 INFO:teuthology.orchestra.run.smithi164.stdout:LOGO="fedora-logo-icon" 2024-04-26T11:57:21.306 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T11:57:21.306 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2024-04-26T11:57:21.306 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T11:57:21.306 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T11:57:21.306 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T11:57:21.307 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2024-04-26T11:57:21.329 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T11:57:21.338 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T11:57:21.355 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T11:57:21.355 DEBUG:teuthology.orchestra.run.smithi052:> test '!' -e /home/ubuntu/cephtest 2024-04-26T11:57:21.357 DEBUG:teuthology.orchestra.run.smithi143:> test '!' -e /home/ubuntu/cephtest 2024-04-26T11:57:21.360 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2024-04-26T11:57:21.362 DEBUG:teuthology.orchestra.run.smithi164:> test '!' -e /home/ubuntu/cephtest 2024-04-26T11:57:21.379 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T11:57:21.385 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T11:57:21.385 DEBUG:teuthology.orchestra.run.smithi052:> test -z $(ls -A /var/lib/ceph) 2024-04-26T11:57:21.416 DEBUG:teuthology.orchestra.run.smithi143:> test -z $(ls -A /var/lib/ceph) 2024-04-26T11:57:21.418 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2024-04-26T11:57:21.420 DEBUG:teuthology.orchestra.run.smithi164:> test -z $(ls -A /var/lib/ceph) 2024-04-26T11:57:21.628 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T11:57:21.728 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T11:57:21.741 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-26T11:57:21.741 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-26T11:57:21.741 DEBUG:teuthology.orchestra.run.smithi052:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T11:57:21.742 DEBUG:teuthology.orchestra.run.smithi143:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T11:57:21.742 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T11:57:21.743 DEBUG:teuthology.orchestra.run.smithi164:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T11:57:21.760 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:57:21.760 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:57:21.761 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-04-26T11:57:21.761 DEBUG:teuthology.orchestra.run.smithi143:> uname -r 2024-04-26T11:57:21.762 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:57:21.762 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:57:21.763 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-04-26T11:57:21.763 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-04-26T11:57:21.817 INFO:teuthology.orchestra.run.smithi154.stdout:5.14.0-437.el9.x86_64 2024-04-26T11:57:21.818 INFO:teuthology.task.kernel:Running kernel on smithi154: 5.14.0-437.el9.x86_64 2024-04-26T11:57:21.818 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum install -y kernel 2024-04-26T11:57:21.819 INFO:teuthology.orchestra.run.smithi143.stdout:5.14.0-437.el9.x86_64 2024-04-26T11:57:21.819 INFO:teuthology.task.kernel:Running kernel on smithi143: 5.14.0-437.el9.x86_64 2024-04-26T11:57:21.819 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum install -y kernel 2024-04-26T11:57:21.820 INFO:teuthology.orchestra.run.smithi164.stdout:5.14.0-437.el9.x86_64 2024-04-26T11:57:21.820 INFO:teuthology.task.kernel:Running kernel on smithi164: 5.14.0-437.el9.x86_64 2024-04-26T11:57:21.820 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum install -y kernel 2024-04-26T11:57:21.821 INFO:teuthology.orchestra.run.smithi052.stdout:5.14.0-437.el9.x86_64 2024-04-26T11:57:21.822 INFO:teuthology.task.kernel:Running kernel on smithi052: 5.14.0-437.el9.x86_64 2024-04-26T11:57:21.822 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum install -y kernel 2024-04-26T11:57:23.942 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.0 MB 00:00 2024-04-26T11:57:24.193 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 9.3 MB/s | 8.0 MB 00:00 2024-04-26T11:57:24.280 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - BaseOS 9.2 MB/s | 8.0 MB 00:00 2024-04-26T11:57:24.327 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.0 MB 00:00 2024-04-26T11:57:25.768 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-04-26T11:57:26.114 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-04-26T11:57:26.227 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-04-26T11:57:26.495 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - AppStream 17 MB/s | 19 MB 00:01 2024-04-26T11:57:30.319 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - CRB 6.7 MB/s | 6.2 MB 00:00 2024-04-26T11:57:30.398 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - CRB 9.1 MB/s | 6.2 MB 00:00 2024-04-26T11:57:30.629 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-26T11:57:30.653 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 6.2 MB 00:00 2024-04-26T11:57:31.891 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 16 kB 00:00 2024-04-26T11:57:32.188 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 16 kB 00:00 2024-04-26T11:57:32.584 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 16 kB 00:00 2024-04-26T11:57:33.210 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 16 kB 00:01 2024-04-26T11:57:33.423 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-04-26T11:57:34.012 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-04-26T11:57:35.761 INFO:teuthology.orchestra.run.smithi143.stdout:Extra Packages for Enterprise Linux 8.6 MB/s | 21 MB 00:02 2024-04-26T11:57:35.878 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 6.6 MB/s | 21 MB 00:03 2024-04-26T11:57:38.397 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-04-26T11:57:39.167 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-26T11:57:40.270 INFO:teuthology.orchestra.run.smithi154.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-26T11:57:40.270 INFO:teuthology.orchestra.run.smithi154.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-26T11:57:40.362 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-04-26T11:57:40.363 INFO:teuthology.orchestra.run.smithi154.stdout:Nothing to do. 2024-04-26T11:57:40.363 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-04-26T11:57:40.488 DEBUG:teuthology.orchestra.run.smithi154:> echo no | sudo yum reinstall kernel || true 2024-04-26T11:57:40.878 INFO:teuthology.orchestra.run.smithi143.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-04-26T11:57:40.985 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:00:02 ago on Fri 26 Apr 2024 11:57:38 AM UTC. 2024-04-26T11:57:41.040 INFO:teuthology.orchestra.run.smithi164.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-26T11:57:41.041 INFO:teuthology.orchestra.run.smithi164.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-26T11:57:41.103 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-04-26T11:57:41.126 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-26T11:57:41.127 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-04-26T11:57:41.128 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-26T11:57:41.134 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-04-26T11:57:41.144 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-04-26T11:57:41.144 INFO:teuthology.orchestra.run.smithi154.stdout: Package Architecture Version Repository Size 2024-04-26T11:57:41.144 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-04-26T11:57:41.144 INFO:teuthology.orchestra.run.smithi154.stdout:Reinstalling: 2024-04-26T11:57:41.144 INFO:teuthology.orchestra.run.smithi154.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T11:57:41.144 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T11:57:41.144 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-04-26T11:57:41.144 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-04-26T11:57:41.145 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T11:57:41.145 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 255 k 2024-04-26T11:57:41.145 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 0 2024-04-26T11:57:41.145 INFO:teuthology.orchestra.run.smithi154.stderr:Operation aborted. 2024-04-26T11:57:41.213 INFO:teuthology.orchestra.run.smithi154.stdout:Is this ok [y/N]: 2024-04-26T11:57:41.214 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum reinstall -y kernel || true 2024-04-26T11:57:41.229 DEBUG:teuthology.orchestra.run.smithi164:> echo no | sudo yum reinstall kernel || true 2024-04-26T11:57:41.710 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 11:57:38 AM UTC. 2024-04-26T11:57:41.765 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:02 ago on Fri 26 Apr 2024 11:57:39 AM UTC. 2024-04-26T11:57:41.824 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-04-26T11:57:41.825 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-04-26T11:57:41.825 INFO:teuthology.orchestra.run.smithi154.stdout: Package Architecture Version Repository Size 2024-04-26T11:57:41.825 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-04-26T11:57:41.825 INFO:teuthology.orchestra.run.smithi154.stdout:Reinstalling: 2024-04-26T11:57:41.825 INFO:teuthology.orchestra.run.smithi154.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T11:57:41.825 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T11:57:41.825 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-04-26T11:57:41.825 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-04-26T11:57:41.825 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T11:57:41.826 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 255 k 2024-04-26T11:57:41.826 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 0 2024-04-26T11:57:41.826 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-04-26T11:57:41.889 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-26T11:57:41.899 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-26T11:57:41.900 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-04-26T11:57:41.900 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-26T11:57:41.900 INFO:teuthology.orchestra.run.smithi164.stdout:Reinstalling: 2024-04-26T11:57:41.900 INFO:teuthology.orchestra.run.smithi164.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T11:57:41.900 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T11:57:41.900 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-26T11:57:41.900 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-26T11:57:41.900 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T11:57:41.900 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 255 k 2024-04-26T11:57:41.900 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 0 2024-04-26T11:57:41.901 INFO:teuthology.orchestra.run.smithi164.stderr:Operation aborted. 2024-04-26T11:57:41.959 INFO:teuthology.orchestra.run.smithi164.stdout:Is this ok [y/N]: 2024-04-26T11:57:41.959 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum reinstall -y kernel || true 2024-04-26T11:57:42.249 INFO:teuthology.orchestra.run.smithi154.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.7 MB/s | 255 kB 00:00 2024-04-26T11:57:42.250 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-04-26T11:57:42.250 INFO:teuthology.orchestra.run.smithi154.stdout:Total 600 kB/s | 255 kB 00:00 2024-04-26T11:57:42.271 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-04-26T11:57:42.442 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-04-26T11:57:42.443 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-04-26T11:57:42.448 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-04-26T11:57:42.448 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-04-26T11:57:42.453 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 11:57:39 AM UTC. 2024-04-26T11:57:42.570 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-26T11:57:42.571 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-26T11:57:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-04-26T11:57:42.571 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-26T11:57:42.571 INFO:teuthology.orchestra.run.smithi164.stdout:Reinstalling: 2024-04-26T11:57:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T11:57:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T11:57:42.571 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-26T11:57:42.571 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-26T11:57:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T11:57:42.571 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 255 k 2024-04-26T11:57:42.572 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 0 2024-04-26T11:57:42.572 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-26T11:57:42.585 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-04-26T11:57:42.659 INFO:teuthology.orchestra.run.smithi154.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T11:57:42.660 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T11:57:42.759 INFO:teuthology.orchestra.run.smithi143.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-26T11:57:42.760 INFO:teuthology.orchestra.run.smithi143.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-26T11:57:42.851 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-04-26T11:57:42.852 INFO:teuthology.orchestra.run.smithi143.stdout:Nothing to do. 2024-04-26T11:57:42.852 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-04-26T11:57:42.853 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.8 MB/s | 255 kB 00:00 2024-04-26T11:57:42.853 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-26T11:57:42.853 INFO:teuthology.orchestra.run.smithi164.stdout:Total 903 kB/s | 255 kB 00:00 2024-04-26T11:57:42.876 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-26T11:57:42.962 DEBUG:teuthology.orchestra.run.smithi143:> echo no | sudo yum reinstall kernel || true 2024-04-26T11:57:43.056 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-26T11:57:43.056 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-26T11:57:43.061 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-26T11:57:43.061 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-26T11:57:43.067 INFO:teuthology.orchestra.run.smithi052.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-26T11:57:43.067 INFO:teuthology.orchestra.run.smithi052.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-26T11:57:43.170 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-04-26T11:57:43.172 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-04-26T11:57:43.172 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-04-26T11:57:43.186 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-26T11:57:43.262 INFO:teuthology.orchestra.run.smithi164.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T11:57:43.262 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T11:57:43.269 DEBUG:teuthology.orchestra.run.smithi052:> echo no | sudo yum reinstall kernel || true 2024-04-26T11:57:43.301 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T11:57:43.301 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T11:57:43.461 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 11:57:40 AM UTC. 2024-04-26T11:57:43.596 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-04-26T11:57:43.609 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-04-26T11:57:43.609 INFO:teuthology.orchestra.run.smithi143.stdout: Package Architecture Version Repository Size 2024-04-26T11:57:43.609 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-04-26T11:57:43.609 INFO:teuthology.orchestra.run.smithi143.stdout:Reinstalling: 2024-04-26T11:57:43.609 INFO:teuthology.orchestra.run.smithi143.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T11:57:43.609 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T11:57:43.609 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-04-26T11:57:43.609 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-04-26T11:57:43.609 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T11:57:43.610 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 255 k 2024-04-26T11:57:43.610 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 0 2024-04-26T11:57:43.610 INFO:teuthology.orchestra.run.smithi143.stderr:Operation aborted. 2024-04-26T11:57:43.674 INFO:teuthology.orchestra.run.smithi143.stdout:Is this ok [y/N]: 2024-04-26T11:57:43.674 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum reinstall -y kernel || true 2024-04-26T11:57:43.788 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:00:02 ago on Fri 26 Apr 2024 11:57:41 AM UTC. 2024-04-26T11:57:43.913 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-04-26T11:57:43.926 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-04-26T11:57:43.927 INFO:teuthology.orchestra.run.smithi052.stdout: Package Architecture Version Repository Size 2024-04-26T11:57:43.927 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-04-26T11:57:43.927 INFO:teuthology.orchestra.run.smithi052.stdout:Reinstalling: 2024-04-26T11:57:43.927 INFO:teuthology.orchestra.run.smithi052.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T11:57:43.927 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T11:57:43.927 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-04-26T11:57:43.927 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-04-26T11:57:43.927 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T11:57:43.927 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 255 k 2024-04-26T11:57:43.927 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 0 2024-04-26T11:57:43.928 INFO:teuthology.orchestra.run.smithi052.stderr:Operation aborted. 2024-04-26T11:57:43.964 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T11:57:43.964 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T11:57:43.978 INFO:teuthology.orchestra.run.smithi052.stdout:Is this ok [y/N]: 2024-04-26T11:57:43.978 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum reinstall -y kernel || true 2024-04-26T11:57:44.027 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T11:57:44.027 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T11:57:44.027 INFO:teuthology.orchestra.run.smithi154.stdout:Reinstalled: 2024-04-26T11:57:44.027 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-26T11:57:44.027 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T11:57:44.027 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-04-26T11:57:44.166 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:00:04 ago on Fri 26 Apr 2024 11:57:40 AM UTC. 2024-04-26T11:57:44.182 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T11:57:44.268 INFO:teuthology.orchestra.run.smithi154.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-26T11:57:44.268 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-26T11:57:44.268 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T11:57:44.269 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-04-26T11:57:44.269 DEBUG:teuthology.orchestra.run.smithi154:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T11:57:44.279 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-04-26T11:57:44.280 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-04-26T11:57:44.280 INFO:teuthology.orchestra.run.smithi143.stdout: Package Architecture Version Repository Size 2024-04-26T11:57:44.280 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-04-26T11:57:44.281 INFO:teuthology.orchestra.run.smithi143.stdout:Reinstalling: 2024-04-26T11:57:44.281 INFO:teuthology.orchestra.run.smithi143.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T11:57:44.281 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T11:57:44.281 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-04-26T11:57:44.281 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-04-26T11:57:44.281 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T11:57:44.281 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 255 k 2024-04-26T11:57:44.281 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 0 2024-04-26T11:57:44.281 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-04-26T11:57:44.306 INFO:teuthology.orchestra.run.smithi154.stdout:ttyS1 2024-04-26T11:57:44.328 DEBUG:teuthology.parallel:result is None 2024-04-26T11:57:44.489 INFO:teuthology.orchestra.run.smithi143.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.8 MB/s | 255 kB 00:00 2024-04-26T11:57:44.489 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-04-26T11:57:44.489 INFO:teuthology.orchestra.run.smithi143.stdout:Total 1.2 MB/s | 255 kB 00:00 2024-04-26T11:57:44.494 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 11:57:41 AM UTC. 2024-04-26T11:57:44.510 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-04-26T11:57:44.598 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T11:57:44.598 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T11:57:44.598 INFO:teuthology.orchestra.run.smithi164.stdout:Reinstalled: 2024-04-26T11:57:44.598 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-26T11:57:44.598 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T11:57:44.598 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-26T11:57:44.614 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-04-26T11:57:44.616 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-04-26T11:57:44.616 INFO:teuthology.orchestra.run.smithi052.stdout: Package Architecture Version Repository Size 2024-04-26T11:57:44.616 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-04-26T11:57:44.616 INFO:teuthology.orchestra.run.smithi052.stdout:Reinstalling: 2024-04-26T11:57:44.616 INFO:teuthology.orchestra.run.smithi052.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T11:57:44.616 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T11:57:44.616 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-04-26T11:57:44.616 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-04-26T11:57:44.616 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T11:57:44.617 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 255 k 2024-04-26T11:57:44.617 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 0 2024-04-26T11:57:44.617 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-04-26T11:57:44.675 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-04-26T11:57:44.675 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-04-26T11:57:44.680 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-04-26T11:57:44.680 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-04-26T11:57:44.798 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-04-26T11:57:44.806 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T11:57:44.852 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-26T11:57:44.853 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-26T11:57:44.853 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T11:57:44.853 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-04-26T11:57:44.853 DEBUG:teuthology.orchestra.run.smithi164:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T11:57:44.879 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.9 MB/s | 255 kB 00:00 2024-04-26T11:57:44.880 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-04-26T11:57:44.880 INFO:teuthology.orchestra.run.smithi052.stdout:Total 964 kB/s | 255 kB 00:00 2024-04-26T11:57:44.885 INFO:teuthology.orchestra.run.smithi164.stdout:ttyS1 2024-04-26T11:57:44.890 INFO:teuthology.orchestra.run.smithi143.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T11:57:44.890 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T11:57:44.900 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-04-26T11:57:44.904 DEBUG:teuthology.parallel:result is None 2024-04-26T11:57:45.105 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-04-26T11:57:45.105 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-04-26T11:57:45.110 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-04-26T11:57:45.110 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-04-26T11:57:45.274 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-04-26T11:57:45.339 INFO:teuthology.orchestra.run.smithi052.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T11:57:45.339 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T11:57:45.550 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T11:57:45.550 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T11:57:46.006 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T11:57:46.006 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T11:57:46.282 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T11:57:46.282 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T11:57:46.282 INFO:teuthology.orchestra.run.smithi143.stdout:Reinstalled: 2024-04-26T11:57:46.282 INFO:teuthology.orchestra.run.smithi143.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-26T11:57:46.282 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T11:57:46.282 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-04-26T11:57:46.460 DEBUG:teuthology.orchestra.run.smithi143:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T11:57:46.507 INFO:teuthology.orchestra.run.smithi143.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-26T11:57:46.507 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-26T11:57:46.507 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T11:57:46.507 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-04-26T11:57:46.507 DEBUG:teuthology.orchestra.run.smithi143:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T11:57:46.537 INFO:teuthology.orchestra.run.smithi143.stdout:ttyS1 2024-04-26T11:57:46.558 DEBUG:teuthology.parallel:result is None 2024-04-26T11:57:46.706 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T11:57:46.707 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T11:57:46.707 INFO:teuthology.orchestra.run.smithi052.stdout:Reinstalled: 2024-04-26T11:57:46.707 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-26T11:57:46.707 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T11:57:46.707 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-04-26T11:57:46.878 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T11:57:46.926 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-26T11:57:46.926 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-26T11:57:46.926 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T11:57:46.927 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-26T11:57:46.927 DEBUG:teuthology.orchestra.run.smithi052:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T11:57:46.955 INFO:teuthology.orchestra.run.smithi052.stdout:ttyS1 2024-04-26T11:57:46.972 DEBUG:teuthology.parallel:result is None 2024-04-26T11:57:46.972 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T11:57:46.981 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T11:57:46.981 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T11:57:47.017 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T11:57:47.019 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T11:57:47.022 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T11:57:47.040 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T11:57:47.047 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T11:57:47.053 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T11:57:47.053 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T11:57:47.072 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T11:57:47.075 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T11:57:47.081 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T11:57:47.217 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T11:57:47.224 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T11:57:47.224 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T11:57:47.226 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T11:57:47.229 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T11:57:47.232 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T11:57:47.257 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:57:47.262 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:57:47.266 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:57:47.272 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:57:47.272 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:57:47.282 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:57:47.283 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:57:47.293 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:57:47.294 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T11:57:47.303 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T11:57:47.303 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T11:57:47.310 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T11:57:47.316 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T11:57:47.327 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T11:57:47.354 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T11:57:47.363 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T11:57:47.364 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T11:57:47.376 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T11:57:47.380 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T11:57:47.395 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T11:57:47.412 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:57:47.477 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:57:47.531 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:57:47.614 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:57:47.652 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T11:57:47.652 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T11:57:47.716 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:57:47.756 DEBUG:teuthology.orchestra.run.smithi143:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:57:47.806 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:57:47.887 DEBUG:teuthology.orchestra.run.smithi143:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:57:47.927 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T11:57:47.927 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T11:57:47.990 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:57:48.036 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:57:48.089 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:57:48.173 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:57:48.214 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-26T11:57:48.214 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T11:57:48.280 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:57:48.325 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:57:48.387 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:57:48.430 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:57:48.471 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-26T11:57:48.471 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T11:57:48.537 DEBUG:teuthology.orchestra.run.smithi052:> sudo service rsyslog restart 2024-04-26T11:57:48.540 DEBUG:teuthology.orchestra.run.smithi143:> sudo service rsyslog restart 2024-04-26T11:57:48.542 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2024-04-26T11:57:48.544 DEBUG:teuthology.orchestra.run.smithi164:> sudo service rsyslog restart 2024-04-26T11:57:48.578 INFO:teuthology.orchestra.run.smithi143.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T11:57:48.579 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T11:57:48.586 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T11:57:48.613 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T11:57:48.988 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T11:57:48.996 INFO:teuthology.task.internal:Starting timer... 2024-04-26T11:57:48.996 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T11:57:49.094 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T11:57:49.103 DEBUG:teuthology.orchestra.run.smithi052:> sudo service auditd rotate 2024-04-26T11:57:49.145 INFO:teuthology.orchestra.run.smithi052.stdout:Rotating logs: 2024-04-26T11:57:49.147 DEBUG:teuthology.orchestra.run.smithi143:> sudo service auditd rotate 2024-04-26T11:57:49.197 INFO:teuthology.orchestra.run.smithi143.stdout:Rotating logs: 2024-04-26T11:57:49.199 DEBUG:teuthology.orchestra.run.smithi154:> sudo service auditd rotate 2024-04-26T11:57:49.261 INFO:teuthology.orchestra.run.smithi154.stdout:Rotating logs: 2024-04-26T11:57:49.262 DEBUG:teuthology.orchestra.run.smithi164:> sudo service auditd rotate 2024-04-26T11:57:49.333 INFO:teuthology.orchestra.run.smithi164.stdout:Rotating logs: 2024-04-26T11:57:49.336 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T11:57:49.336 DEBUG:teuthology.orchestra.run.smithi052:> /usr/sbin/getenforce 2024-04-26T11:57:49.363 INFO:teuthology.orchestra.run.smithi052.stdout:Permissive 2024-04-26T11:57:49.364 DEBUG:teuthology.orchestra.run.smithi143:> /usr/sbin/getenforce 2024-04-26T11:57:49.386 INFO:teuthology.orchestra.run.smithi143.stdout:Permissive 2024-04-26T11:57:49.387 DEBUG:teuthology.orchestra.run.smithi154:> /usr/sbin/getenforce 2024-04-26T11:57:49.411 INFO:teuthology.orchestra.run.smithi154.stdout:Permissive 2024-04-26T11:57:49.411 DEBUG:teuthology.orchestra.run.smithi164:> /usr/sbin/getenforce 2024-04-26T11:57:49.431 INFO:teuthology.orchestra.run.smithi164.stdout:Permissive 2024-04-26T11:57:49.431 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi052.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi143.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi154.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi164.front.sepia.ceph.com': 'permissive'} 2024-04-26T11:57:49.431 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T11:57:49.457 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:57:49.457 DEBUG:teuthology.orchestra.run.smithi143:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T11:57:49.481 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:57:49.481 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T11:57:49.507 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:57:49.507 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T11:57:49.531 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:57:49.532 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T11:57:49.532 DEBUG:teuthology.orchestra.run.smithi052:> sudo /usr/sbin/setenforce permissive 2024-04-26T11:57:49.558 DEBUG:teuthology.orchestra.run.smithi143:> sudo /usr/sbin/setenforce permissive 2024-04-26T11:57:49.589 DEBUG:teuthology.orchestra.run.smithi154:> sudo /usr/sbin/setenforce permissive 2024-04-26T11:57:49.630 DEBUG:teuthology.orchestra.run.smithi164:> sudo /usr/sbin/setenforce permissive 2024-04-26T11:57:49.655 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T11:57:49.664 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-26T11:57:49.672 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-26T11:57:49.843 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T11:57:49.863 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T11:57:49.864 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi052.front.sepia.ceph.com,smithi143.front.sepia.ceph.com,smithi154.front.sepia.ceph.com,smithi164.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T12:01:27.317 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi052.front.sepia.ceph.com'), Remote(name='ubuntu@smithi143.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com'), Remote(name='ubuntu@smithi164.front.sepia.ceph.com')] 2024-04-26T12:01:27.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-04-26T12:01:27.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:01:27.400 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-04-26T12:01:27.482 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-04-26T12:01:27.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-04-26T12:01:27.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:01:27.556 DEBUG:teuthology.orchestra.run.smithi143:> true 2024-04-26T12:01:27.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-04-26T12:01:27.637 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-04-26T12:01:27.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:01:27.712 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-04-26T12:01:27.795 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-04-26T12:01:27.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-26T12:01:27.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:01:27.871 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-04-26T12:01:27.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-26T12:01:27.961 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T12:01:27.972 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T12:01:27.972 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:01:27.973 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:01:27.975 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:01:27.975 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:01:27.978 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:01:27.978 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:01:27.980 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:01:27.980 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:01:28.004 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T12:01:28.007 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T12:01:28.011 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T12:01:28.017 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T12:01:28.023 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T12:01:28.026 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T12:01:28.032 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T12:01:28.039 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: ntpd: command not found 2024-04-26T12:01:28.046 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T12:01:28.048 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: ntpd: command not found 2024-04-26T12:01:28.050 INFO:teuthology.orchestra.run.smithi143.stdout:506 Cannot talk to daemon 2024-04-26T12:01:28.050 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: ntpd: command not found 2024-04-26T12:01:28.059 INFO:teuthology.orchestra.run.smithi052.stdout:506 Cannot talk to daemon 2024-04-26T12:01:28.061 INFO:teuthology.orchestra.run.smithi154.stdout:506 Cannot talk to daemon 2024-04-26T12:01:28.063 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T12:01:28.071 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: ntpd: command not found 2024-04-26T12:01:28.076 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T12:01:28.077 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T12:01:28.077 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T12:01:28.082 INFO:teuthology.orchestra.run.smithi164.stdout:506 Cannot talk to daemon 2024-04-26T12:01:28.088 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T12:01:28.089 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T12:01:28.097 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T12:01:28.110 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T12:01:28.130 INFO:teuthology.orchestra.run.smithi143.stderr:bash: line 1: ntpq: command not found 2024-04-26T12:01:28.133 INFO:teuthology.orchestra.run.smithi143.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:01:28.134 INFO:teuthology.orchestra.run.smithi143.stdout:=============================================================================== 2024-04-26T12:01:28.134 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:01:28.134 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:01:28.134 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:01:28.134 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:01:28.146 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-04-26T12:01:28.147 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-04-26T12:01:28.149 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:01:28.150 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-04-26T12:01:28.150 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:01:28.150 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:01:28.150 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:01:28.150 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:01:28.151 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:01:28.152 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-04-26T12:01:28.152 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:01:28.152 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:01:28.152 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:01:28.152 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:01:28.171 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-04-26T12:01:28.174 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:01:28.174 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-04-26T12:01:28.174 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:01:28.174 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:01:28.174 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:01:28.175 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:01:28.176 INFO:teuthology.run_tasks:Running task install... 2024-04-26T12:01:28.185 DEBUG:teuthology.task.install:project ceph 2024-04-26T12:01:28.185 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}} 2024-04-26T12:01:28.185 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'} 2024-04-26T12:01:28.185 INFO:teuthology.task.install:Using flavor: default 2024-04-26T12:01:28.192 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T12:01:28.192 INFO:teuthology.task.install:extra packages: [] 2024-04-26T12:01:28.193 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T12:01:28.193 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:01:28.196 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T12:01:28.196 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:01:28.197 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T12:01:28.197 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:01:28.198 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T12:01:28.199 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:01:28.358 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/ 2024-04-26T12:01:28.358 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T12:01:28.361 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/ 2024-04-26T12:01:28.361 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T12:01:28.431 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/ 2024-04-26T12:01:28.431 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T12:01:28.436 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/ 2024-04-26T12:01:28.436 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T12:01:28.561 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T12:01:28.561 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T12:01:28.561 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T12:01:28.589 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T12:01:28.589 DEBUG:teuthology.orchestra.run.smithi052:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T12:01:28.600 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T12:01:28.600 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T12:01:28.600 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T12:01:28.625 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T12:01:28.625 DEBUG:teuthology.orchestra.run.smithi143:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T12:01:28.657 DEBUG:teuthology.orchestra.run.smithi052:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T12:01:28.686 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T12:01:28.686 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-26T12:01:28.687 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T12:01:28.689 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T12:01:28.689 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-26T12:01:28.689 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T12:01:28.691 DEBUG:teuthology.orchestra.run.smithi143:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T12:01:28.712 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T12:01:28.712 DEBUG:teuthology.orchestra.run.smithi154:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T12:01:28.720 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T12:01:28.721 DEBUG:teuthology.orchestra.run.smithi164:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T12:01:28.732 DEBUG:teuthology.orchestra.run.smithi052:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T12:01:28.764 DEBUG:teuthology.orchestra.run.smithi143:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T12:01:28.778 DEBUG:teuthology.orchestra.run.smithi154:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T12:01:28.788 DEBUG:teuthology.orchestra.run.smithi164:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T12:01:28.796 INFO:teuthology.orchestra.run.smithi052.stdout:check_obsoletes = 1 2024-04-26T12:01:28.798 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum clean all 2024-04-26T12:01:28.827 INFO:teuthology.orchestra.run.smithi143.stdout:check_obsoletes = 1 2024-04-26T12:01:28.829 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum clean all 2024-04-26T12:01:28.851 DEBUG:teuthology.orchestra.run.smithi154:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T12:01:28.867 DEBUG:teuthology.orchestra.run.smithi164:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T12:01:28.913 INFO:teuthology.orchestra.run.smithi154.stdout:check_obsoletes = 1 2024-04-26T12:01:28.915 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum clean all 2024-04-26T12:01:28.933 INFO:teuthology.orchestra.run.smithi164.stdout:check_obsoletes = 1 2024-04-26T12:01:28.934 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum clean all 2024-04-26T12:01:29.033 INFO:teuthology.orchestra.run.smithi052.stdout:48 files removed 2024-04-26T12:01:29.052 INFO:teuthology.orchestra.run.smithi143.stdout:48 files removed 2024-04-26T12:01:29.060 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T12:01:29.079 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T12:01:29.140 INFO:teuthology.orchestra.run.smithi154.stdout:48 files removed 2024-04-26T12:01:29.163 INFO:teuthology.orchestra.run.smithi164.stdout:48 files removed 2024-04-26T12:01:29.167 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T12:01:29.189 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T12:01:29.867 INFO:teuthology.orchestra.run.smithi052.stdout:ceph packages for x86_64 145 kB/s | 77 kB 00:00 2024-04-26T12:01:29.905 INFO:teuthology.orchestra.run.smithi143.stdout:ceph packages for x86_64 135 kB/s | 77 kB 00:00 2024-04-26T12:01:30.049 INFO:teuthology.orchestra.run.smithi164.stdout:ceph packages for x86_64 129 kB/s | 77 kB 00:00 2024-04-26T12:01:30.107 INFO:teuthology.orchestra.run.smithi154.stdout:ceph packages for x86_64 114 kB/s | 77 kB 00:00 2024-04-26T12:01:30.434 INFO:teuthology.orchestra.run.smithi052.stdout:ceph noarch packages 22 kB/s | 11 kB 00:00 2024-04-26T12:01:30.514 INFO:teuthology.orchestra.run.smithi143.stdout:ceph noarch packages 20 kB/s | 11 kB 00:00 2024-04-26T12:01:30.574 INFO:teuthology.orchestra.run.smithi164.stdout:ceph noarch packages 24 kB/s | 11 kB 00:00 2024-04-26T12:01:30.733 INFO:teuthology.orchestra.run.smithi154.stdout:ceph noarch packages 20 kB/s | 11 kB 00:00 2024-04-26T12:01:31.018 INFO:teuthology.orchestra.run.smithi052.stdout:ceph source packages 3.4 kB/s | 1.9 kB 00:00 2024-04-26T12:01:31.023 INFO:teuthology.orchestra.run.smithi143.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2024-04-26T12:01:31.166 INFO:teuthology.orchestra.run.smithi164.stdout:ceph source packages 3.4 kB/s | 1.9 kB 00:00 2024-04-26T12:01:31.383 INFO:teuthology.orchestra.run.smithi154.stdout:ceph source packages 3.1 kB/s | 1.9 kB 00:00 2024-04-26T12:01:31.971 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 8.8 MB/s | 8.0 MB 00:00 2024-04-26T12:01:33.864 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-04-26T12:01:36.918 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - BaseOS 1.4 MB/s | 8.0 MB 00:05 2024-04-26T12:01:38.214 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 9.4 MB/s | 6.2 MB 00:00 2024-04-26T12:01:38.878 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-04-26T12:01:42.296 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 5.6 kB/s | 16 kB 00:02 2024-04-26T12:01:44.684 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 9.3 MB/s | 21 MB 00:02 2024-04-26T12:01:49.897 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-26T12:01:50.962 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - BaseOS 422 kB/s | 8.0 MB 00:19 2024-04-26T12:01:52.081 INFO:teuthology.orchestra.run.smithi052.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T12:01:52.082 INFO:teuthology.orchestra.run.smithi052.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T12:01:52.151 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-04-26T12:01:52.159 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================= 2024-04-26T12:01:52.159 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-04-26T12:01:52.159 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================= 2024-04-26T12:01:52.159 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-04-26T12:01:52.160 INFO:teuthology.orchestra.run.smithi052.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T12:01:52.160 INFO:teuthology.orchestra.run.smithi052.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 6.5 k 2024-04-26T12:01:52.160 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 5.1 M 2024-04-26T12:01:52.160 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 848 k 2024-04-26T12:01:52.161 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 142 k 2024-04-26T12:01:52.161 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 1.5 M 2024-04-26T12:01:52.161 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 138 k 2024-04-26T12:01:52.161 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 3.5 M 2024-04-26T12:01:52.161 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 7.4 M 2024-04-26T12:01:52.162 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 49 k 2024-04-26T12:01:52.162 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 7.7 M 2024-04-26T12:01:52.162 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 40 M 2024-04-26T12:01:52.162 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 264 k 2024-04-26T12:01:52.163 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 224 k 2024-04-26T12:01:52.163 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T12:01:52.163 INFO:teuthology.orchestra.run.smithi052.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T12:01:52.163 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T12:01:52.163 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 31 k 2024-04-26T12:01:52.164 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 710 k 2024-04-26T12:01:52.164 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 126 k 2024-04-26T12:01:52.164 INFO:teuthology.orchestra.run.smithi052.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T12:01:52.164 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T12:01:52.165 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T12:01:52.165 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 162 k 2024-04-26T12:01:52.165 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 320 k 2024-04-26T12:01:52.165 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 298 k 2024-04-26T12:01:52.165 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 99 k 2024-04-26T12:01:52.166 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 87 k 2024-04-26T12:01:52.166 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.0 M 2024-04-26T12:01:52.166 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 172 k 2024-04-26T12:01:52.166 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T12:01:52.167 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrading: 2024-04-26T12:01:52.167 INFO:teuthology.orchestra.run.smithi052.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.3 M 2024-04-26T12:01:52.168 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.0 M 2024-04-26T12:01:52.168 INFO:teuthology.orchestra.run.smithi052.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T12:01:52.168 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T12:01:52.169 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-04-26T12:01:52.169 INFO:teuthology.orchestra.run.smithi052.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T12:01:52.169 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T12:01:52.169 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 18 M 2024-04-26T12:01:52.169 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 24 k 2024-04-26T12:01:52.170 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 2.1 M 2024-04-26T12:01:52.170 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 246 k 2024-04-26T12:01:52.170 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 4.7 M 2024-04-26T12:01:52.170 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 17 M 2024-04-26T12:01:52.170 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 15 k 2024-04-26T12:01:52.171 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 25 k 2024-04-26T12:01:52.171 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T12:01:52.171 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T12:01:52.171 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T12:01:52.171 INFO:teuthology.orchestra.run.smithi052.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-04-26T12:01:52.171 INFO:teuthology.orchestra.run.smithi052.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T12:01:52.172 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T12:01:52.172 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T12:01:52.172 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T12:01:52.172 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 166 k 2024-04-26T12:01:52.172 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T12:01:52.172 INFO:teuthology.orchestra.run.smithi052.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T12:01:52.173 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T12:01:52.173 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T12:01:52.173 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T12:01:52.173 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 474 k 2024-04-26T12:01:52.173 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T12:01:52.173 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 4.5 M 2024-04-26T12:01:52.173 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T12:01:52.174 INFO:teuthology.orchestra.run.smithi052.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T12:01:52.174 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T12:01:52.174 INFO:teuthology.orchestra.run.smithi052.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T12:01:52.174 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T12:01:52.174 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T12:01:52.174 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T12:01:52.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T12:01:52.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T12:01:52.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T12:01:52.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 45 k 2024-04-26T12:01:52.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 129 k 2024-04-26T12:01:52.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T12:01:52.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T12:01:52.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T12:01:52.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T12:01:52.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T12:01:52.177 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T12:01:52.177 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T12:01:52.177 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T12:01:52.177 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T12:01:52.177 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T12:01:52.178 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T12:01:52.178 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T12:01:52.178 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T12:01:52.178 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T12:01:52.178 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T12:01:52.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T12:01:52.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T12:01:52.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T12:01:52.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T12:01:52.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T12:01:52.180 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T12:01:52.180 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T12:01:52.180 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T12:01:52.180 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T12:01:52.180 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T12:01:52.181 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T12:01:52.181 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T12:01:52.181 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T12:01:52.181 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T12:01:52.181 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T12:01:52.181 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T12:01:52.182 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T12:01:52.182 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T12:01:52.182 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T12:01:52.182 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T12:01:52.182 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T12:01:52.182 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T12:01:52.183 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T12:01:52.183 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T12:01:52.183 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T12:01:52.183 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T12:01:52.183 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T12:01:52.183 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T12:01:52.184 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T12:01:52.184 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T12:01:52.184 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T12:01:52.184 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T12:01:52.184 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T12:01:52.184 INFO:teuthology.orchestra.run.smithi052.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T12:01:52.185 INFO:teuthology.orchestra.run.smithi052.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T12:01:52.185 INFO:teuthology.orchestra.run.smithi052.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T12:01:52.185 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T12:01:52.186 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T12:01:52.186 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:01:52.186 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-04-26T12:01:52.186 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================= 2024-04-26T12:01:52.186 INFO:teuthology.orchestra.run.smithi052.stdout:Install 123 Packages 2024-04-26T12:01:52.186 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrade 4 Packages 2024-04-26T12:01:52.186 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:01:52.190 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 189 M 2024-04-26T12:01:52.190 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-04-26T12:02:42.502 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - BaseOS 116 kB/s | 8.0 MB 01:11 2024-04-26T12:02:47.670 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - CRB 97 kB/s | 6.2 MB 01:05 2024-04-26T12:02:49.278 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 16 kB 00:00 2024-04-26T12:02:52.368 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - AppStream 2.2 MB/s | 19 MB 00:08 2024-04-26T12:02:56.644 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 6.2 MB 00:00 2024-04-26T12:02:57.276 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - AppStream 299 kB/s | 19 MB 01:05 2024-04-26T12:02:57.984 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - Extras packages 80 kB/s | 16 kB 00:00 2024-04-26T12:02:58.643 INFO:teuthology.orchestra.run.smithi052.stdout:(1/127): ceph-18.2.2-1256.gdc093b5e.el9.x86_64. 34 kB/s | 6.5 kB 00:00 2024-04-26T12:02:58.918 INFO:teuthology.orchestra.run.smithi052.stdout:(2/127): ceph-fuse-18.2.2-1256.gdc093b5e.el9.x8 3.0 MB/s | 848 kB 00:00 2024-04-26T12:02:58.977 INFO:teuthology.orchestra.run.smithi052.stdout:(3/127): ceph-immutable-object-cache-18.2.2-125 2.4 MB/s | 142 kB 00:00 2024-04-26T12:02:59.052 INFO:teuthology.orchestra.run.smithi052.stdout:(4/127): ceph-base-18.2.2-1256.gdc093b5e.el9.x8 8.4 MB/s | 5.1 MB 00:00 2024-04-26T12:02:59.194 INFO:teuthology.orchestra.run.smithi052.stdout:(5/127): ceph-mgr-18.2.2-1256.gdc093b5e.el9.x86 10 MB/s | 1.5 MB 00:00 2024-04-26T12:02:59.361 INFO:teuthology.orchestra.run.smithi052.stdout:(6/127): ceph-mds-18.2.2-1256.gdc093b5e.el9.x86 5.4 MB/s | 2.1 MB 00:00 2024-04-26T12:02:59.586 INFO:teuthology.orchestra.run.smithi052.stdout:(7/127): ceph-mon-18.2.2-1256.gdc093b5e.el9.x86 12 MB/s | 4.7 MB 00:00 2024-04-26T12:02:59.963 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-26T12:03:00.253 INFO:teuthology.orchestra.run.smithi052.stdout:(8/127): ceph-radosgw-18.2.2-1256.gdc093b5e.el9 12 MB/s | 7.7 MB 00:00 2024-04-26T12:03:00.303 INFO:teuthology.orchestra.run.smithi052.stdout:(9/127): ceph-selinux-18.2.2-1256.gdc093b5e.el9 507 kB/s | 25 kB 00:00 2024-04-26T12:03:00.898 INFO:teuthology.orchestra.run.smithi052.stdout:(10/127): ceph-common-18.2.2-1256.gdc093b5e.el9 7.5 MB/s | 18 MB 00:02 2024-04-26T12:03:01.037 INFO:teuthology.orchestra.run.smithi052.stdout:(11/127): libcephfs-devel-18.2.2-1256.gdc093b5e 224 kB/s | 31 kB 00:00 2024-04-26T12:03:01.213 INFO:teuthology.orchestra.run.smithi052.stdout:(12/127): libcephfs2-18.2.2-1256.gdc093b5e.el9. 4.0 MB/s | 710 kB 00:00 2024-04-26T12:03:01.313 INFO:teuthology.orchestra.run.smithi052.stdout:(13/127): libcephsqlite-18.2.2-1256.gdc093b5e.e 1.6 MB/s | 166 kB 00:00 2024-04-26T12:03:01.354 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-04-26T12:03:01.405 INFO:teuthology.orchestra.run.smithi052.stdout:(14/127): librados-devel-18.2.2-1256.gdc093b5e. 1.4 MB/s | 126 kB 00:00 2024-04-26T12:03:01.522 INFO:teuthology.orchestra.run.smithi052.stdout:(15/127): libradosstriper1-18.2.2-1256.gdc093b5 4.0 MB/s | 474 kB 00:00 2024-04-26T12:03:01.747 INFO:teuthology.orchestra.run.smithi052.stdout:(16/127): ceph-osd-18.2.2-1256.gdc093b5e.el9.x8 6.9 MB/s | 17 MB 00:02 2024-04-26T12:03:01.805 INFO:teuthology.orchestra.run.smithi052.stdout:(17/127): python3-ceph-argparse-18.2.2-1256.gdc 775 kB/s | 45 kB 00:00 2024-04-26T12:03:01.889 INFO:teuthology.orchestra.run.smithi052.stdout:(18/127): python3-ceph-common-18.2.2-1256.gdc09 1.5 MB/s | 129 kB 00:00 2024-04-26T12:03:01.981 INFO:teuthology.orchestra.run.smithi052.stdout:(19/127): python3-cephfs-18.2.2-1256.gdc093b5e. 1.7 MB/s | 162 kB 00:00 2024-04-26T12:03:02.065 INFO:teuthology.orchestra.run.smithi052.stdout:(20/127): python3-rados-18.2.2-1256.gdc093b5e.e 3.8 MB/s | 320 kB 00:00 2024-04-26T12:03:02.132 INFO:teuthology.orchestra.run.smithi052.stdout:(21/127): librgw2-18.2.2-1256.gdc093b5e.el9.x86 7.3 MB/s | 4.5 MB 00:00 2024-04-26T12:03:02.157 INFO:teuthology.orchestra.run.smithi052.stdout:(22/127): python3-rbd-18.2.2-1256.gdc093b5e.el9 3.2 MB/s | 298 kB 00:00 2024-04-26T12:03:02.207 INFO:teuthology.orchestra.run.smithi052.stdout:(23/127): python3-rgw-18.2.2-1256.gdc093b5e.el9 1.3 MB/s | 99 kB 00:00 2024-04-26T12:03:02.263 INFO:teuthology.orchestra.run.smithi052.stdout:(24/127): rbd-fuse-18.2.2-1256.gdc093b5e.el9.x8 818 kB/s | 87 kB 00:00 2024-04-26T12:03:02.326 INFO:teuthology.orchestra.run.smithi052.stdout:(25/127): rbd-nbd-18.2.2-1256.gdc093b5e.el9.x86 2.7 MB/s | 172 kB 00:00 2024-04-26T12:03:02.402 INFO:teuthology.orchestra.run.smithi052.stdout:(26/127): ceph-grafana-dashboards-18.2.2-1256.g 326 kB/s | 24 kB 00:00 2024-04-26T12:03:02.485 INFO:teuthology.orchestra.run.smithi052.stdout:(27/127): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 1.6 MB/s | 138 kB 00:00 2024-04-26T12:03:02.578 INFO:teuthology.orchestra.run.smithi052.stdout:(28/127): rbd-mirror-18.2.2-1256.gdc093b5e.el9. 8.1 MB/s | 3.0 MB 00:00 2024-04-26T12:03:02.919 INFO:teuthology.orchestra.run.smithi052.stdout:(29/127): ceph-test-18.2.2-1256.gdc093b5e.el9.x 15 MB/s | 40 MB 00:02 2024-04-26T12:03:02.989 INFO:teuthology.orchestra.run.smithi052.stdout:(30/127): ceph-mgr-modules-core-18.2.2-1256.gdc 3.6 MB/s | 246 kB 00:00 2024-04-26T12:03:03.025 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 16 kB 00:00 2024-04-26T12:03:03.036 INFO:teuthology.orchestra.run.smithi052.stdout:(31/127): ceph-mgr-dashboard-18.2.2-1256.gdc093 6.4 MB/s | 3.5 MB 00:00 2024-04-26T12:03:03.053 INFO:teuthology.orchestra.run.smithi052.stdout:(32/127): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 738 kB/s | 49 kB 00:00 2024-04-26T12:03:03.079 INFO:teuthology.orchestra.run.smithi052.stdout:(33/127): ceph-prometheus-alerts-18.2.2-1256.gd 365 kB/s | 15 kB 00:00 2024-04-26T12:03:03.104 INFO:teuthology.orchestra.run.smithi052.stdout:(34/127): ceph-volume-18.2.2-1256.gdc093b5e.el9 5.1 MB/s | 264 kB 00:00 2024-04-26T12:03:03.171 INFO:teuthology.orchestra.run.smithi052.stdout:(35/127): cephadm-18.2.2-1256.gdc093b5e.el9.noa 2.4 MB/s | 224 kB 00:00 2024-04-26T12:03:03.229 INFO:teuthology.orchestra.run.smithi052.stdout:(36/127): fuse-2.9.9-15.el9.x86_64.rpm 641 kB/s | 80 kB 00:00 2024-04-26T12:03:03.313 INFO:teuthology.orchestra.run.smithi052.stdout:(37/127): ceph-mgr-diskprediction-local-18.2.2- 10 MB/s | 7.4 MB 00:00 2024-04-26T12:03:03.380 INFO:teuthology.orchestra.run.smithi052.stdout:(38/127): libgfortran-11.4.1-3.el9.x86_64.rpm 3.8 MB/s | 803 kB 00:00 2024-04-26T12:03:03.406 INFO:teuthology.orchestra.run.smithi052.stdout:(39/127): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-04-26T12:03:03.431 INFO:teuthology.orchestra.run.smithi052.stdout:(40/127): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-04-26T12:03:03.531 INFO:teuthology.orchestra.run.smithi052.stdout:(41/127): python3-cryptography-36.0.1-4.el9.x86 8.2 MB/s | 1.2 MB 00:00 2024-04-26T12:03:03.556 INFO:teuthology.orchestra.run.smithi052.stdout:(42/127): python3-ply-3.11-14.el9.noarch.rpm 856 kB/s | 106 kB 00:00 2024-04-26T12:03:03.581 INFO:teuthology.orchestra.run.smithi052.stdout:(43/127): python3-pycparser-2.20-6.el9.noarch.r 903 kB/s | 135 kB 00:00 2024-04-26T12:03:03.606 INFO:teuthology.orchestra.run.smithi052.stdout:(44/127): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-04-26T12:03:03.632 INFO:teuthology.orchestra.run.smithi052.stdout:(45/127): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-26T12:03:03.658 INFO:teuthology.orchestra.run.smithi052.stdout:(46/127): automake-1.16.2-8.el9.noarch.rpm 9.0 MB/s | 689 kB 00:00 2024-04-26T12:03:03.699 INFO:teuthology.orchestra.run.smithi052.stdout:(47/127): bison-3.7.4-5.el9.x86_64.rpm 10 MB/s | 943 kB 00:00 2024-04-26T12:03:03.724 INFO:teuthology.orchestra.run.smithi052.stdout:(48/127): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-04-26T12:03:03.749 INFO:teuthology.orchestra.run.smithi052.stdout:(49/127): elfutils-libelf-devel-0.190-2.el9.x86 234 kB/s | 21 kB 00:00 2024-04-26T12:03:03.775 INFO:teuthology.orchestra.run.smithi052.stdout:(50/127): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-04-26T12:03:03.792 INFO:teuthology.orchestra.run.smithi052.stdout:(51/127): flexiblas-3.0.4-8.el9.x86_64.rpm 793 kB/s | 33 kB 00:00 2024-04-26T12:03:03.817 INFO:teuthology.orchestra.run.smithi052.stdout:(52/127): flexiblas-openblas-openmp-3.0.4-8.el9 436 kB/s | 18 kB 00:00 2024-04-26T12:03:03.875 INFO:teuthology.orchestra.run.smithi052.stdout:(53/127): libaio-devel-0.3.111-13.el9.x86_64.rp 135 kB/s | 11 kB 00:00 2024-04-26T12:03:03.926 INFO:teuthology.orchestra.run.smithi052.stdout:(54/127): flexiblas-netlib-3.0.4-8.el9.x86_64.r 17 MB/s | 3.0 MB 00:00 2024-04-26T12:03:03.951 INFO:teuthology.orchestra.run.smithi052.stdout:(55/127): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-04-26T12:03:03.976 INFO:teuthology.orchestra.run.smithi052.stdout:(56/127): librabbitmq-0.11.0-7.el9.x86_64.rpm 455 kB/s | 45 kB 00:00 2024-04-26T12:03:04.018 INFO:teuthology.orchestra.run.smithi052.stdout:(57/127): libtool-2.4.6-45.el9.x86_64.rpm 8.5 MB/s | 582 kB 00:00 2024-04-26T12:03:04.043 INFO:teuthology.orchestra.run.smithi052.stdout:(58/127): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-04-26T12:03:04.069 INFO:teuthology.orchestra.run.smithi052.stdout:(59/127): libuuid-devel-2.37.4-18.el9.x86_64.rp 278 kB/s | 25 kB 00:00 2024-04-26T12:03:04.119 INFO:teuthology.orchestra.run.smithi052.stdout:(60/127): libzstd-devel-1.5.1-2.el9.x86_64.rpm 477 kB/s | 47 kB 00:00 2024-04-26T12:03:04.144 INFO:teuthology.orchestra.run.smithi052.stdout:(61/127): openblas-0.3.21-2.el9.x86_64.rpm 470 kB/s | 35 kB 00:00 2024-04-26T12:03:04.170 INFO:teuthology.orchestra.run.smithi052.stdout:(62/127): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-04-26T12:03:04.528 INFO:teuthology.orchestra.run.smithi052.stdout:(63/127): openblas-openmp-0.3.21-2.el9.x86_64.r 12 MB/s | 4.7 MB 00:00 2024-04-26T12:03:04.612 INFO:teuthology.orchestra.run.smithi052.stdout:(64/127): openssl-devel-3.2.1-1.el9.x86_64.rpm 9.5 MB/s | 4.4 MB 00:00 2024-04-26T12:03:04.721 INFO:teuthology.orchestra.run.smithi052.stdout:(65/127): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2024-04-26T12:03:04.745 INFO:teuthology.orchestra.run.smithi052.stdout:(66/127): python3-devel-3.9.18-3.el9.x86_64.rpm 1.1 MB/s | 244 kB 00:00 2024-04-26T12:03:04.771 INFO:teuthology.orchestra.run.smithi052.stdout:(67/127): python3-jinja2-2.11.3-5.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-04-26T12:03:04.796 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-26T12:03:04.796 INFO:teuthology.orchestra.run.smithi052.stdout:(68/127): python3-jsonpatch-1.21-16.el9.noarch. 345 kB/s | 26 kB 00:00 2024-04-26T12:03:04.821 INFO:teuthology.orchestra.run.smithi052.stdout:(69/127): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-04-26T12:03:04.850 INFO:teuthology.orchestra.run.smithi052.stdout:(70/127): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-04-26T12:03:04.872 INFO:teuthology.orchestra.run.smithi052.stdout:(71/127): python3-markupsafe-1.1.1-12.el9.x86_6 462 kB/s | 35 kB 00:00 2024-04-26T12:03:04.897 INFO:teuthology.orchestra.run.smithi052.stdout:(72/127): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-04-26T12:03:04.931 INFO:teuthology.orchestra.run.smithi052.stdout:(73/127): python3-oauthlib-3.1.1-5.el9.noarch.r 3.8 MB/s | 222 kB 00:00 2024-04-26T12:03:04.985 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-04-26T12:03:04.989 INFO:teuthology.orchestra.run.smithi052.stdout:(74/127): python3-packaging-20.9-5.el9.noarch.r 865 kB/s | 77 kB 00:00 2024-04-26T12:03:05.056 INFO:teuthology.orchestra.run.smithi052.stdout:(75/127): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 5.1 MB 00:00 2024-04-26T12:03:05.082 INFO:teuthology.orchestra.run.smithi052.stdout:(76/127): python3-prettytable-0.7.2-27.el9.noar 283 kB/s | 42 kB 00:00 2024-04-26T12:03:05.107 INFO:teuthology.orchestra.run.smithi052.stdout:(77/127): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-04-26T12:03:05.132 INFO:teuthology.orchestra.run.smithi052.stdout:(78/127): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-26T12:03:05.157 INFO:teuthology.orchestra.run.smithi052.stdout:(79/127): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-04-26T12:03:05.199 INFO:teuthology.orchestra.run.smithi052.stdout:(80/127): python3-requests-oauthlib-1.3.0-12.el 584 kB/s | 54 kB 00:00 2024-04-26T12:03:05.266 INFO:teuthology.orchestra.run.smithi052.stdout:(81/127): python3-toml-0.10.2-6.el9.noarch.rpm 661 kB/s | 42 kB 00:00 2024-04-26T12:03:05.291 INFO:teuthology.orchestra.run.smithi052.stdout:(82/127): socat-1.7.4.1-5.el9.x86_64.rpm 3.4 MB/s | 305 kB 00:00 2024-04-26T12:03:05.366 INFO:teuthology.orchestra.run.smithi052.stdout:(83/127): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 947 kB/s | 94 kB 00:00 2024-04-26T12:03:05.408 INFO:teuthology.orchestra.run.smithi052.stdout:(84/127): xmlstarlet-1.6.1-20.el9.x86_64.rpm 559 kB/s | 64 kB 00:00 2024-04-26T12:03:05.609 INFO:teuthology.orchestra.run.smithi052.stdout:(85/127): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-04-26T12:03:05.634 INFO:teuthology.orchestra.run.smithi052.stdout:(86/127): zlib-devel-1.2.11-41.el9.x86_64.rpm 169 kB/s | 45 kB 00:00 2024-04-26T12:03:05.717 INFO:teuthology.orchestra.run.smithi052.stdout:(87/127): fmt-8.1.1-5.el9.x86_64.rpm 362 kB/s | 111 kB 00:00 2024-04-26T12:03:05.793 INFO:teuthology.orchestra.run.smithi052.stdout:(88/127): libarrow-doc-9.0.0-11.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2024-04-26T12:03:05.860 INFO:teuthology.orchestra.run.smithi052.stdout:(89/127): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.2 MB/s | 309 kB 00:00 2024-04-26T12:03:05.893 INFO:teuthology.orchestra.run.smithi052.stdout:(90/127): liboath-2.6.7-2.el9.x86_64.rpm 484 kB/s | 49 kB 00:00 2024-04-26T12:03:05.919 INFO:teuthology.orchestra.run.smithi052.stdout:(91/127): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-04-26T12:03:06.036 INFO:teuthology.orchestra.run.smithi052.stdout:(92/127): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-04-26T12:03:06.061 INFO:teuthology.orchestra.run.smithi052.stdout:(93/127): python3-asyncssh-2.13.2-5.el9.noarch. 3.8 MB/s | 548 kB 00:00 2024-04-26T12:03:06.103 INFO:teuthology.orchestra.run.smithi052.stdout:(94/127): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 650 kB/s | 43 kB 00:00 2024-04-26T12:03:06.128 INFO:teuthology.orchestra.run.smithi052.stdout:(95/127): python3-cachetools-4.2.4-1.el9.noarch 481 kB/s | 32 kB 00:00 2024-04-26T12:03:06.153 INFO:teuthology.orchestra.run.smithi052.stdout:(96/127): python3-certifi-2021.10.8-2.el9.noarc 298 kB/s | 15 kB 00:00 2024-04-26T12:03:06.154 INFO:teuthology.orchestra.run.smithi143.stdout:Extra Packages for Enterprise Linux 1.3 MB/s | 21 MB 00:16 2024-04-26T12:03:06.229 INFO:teuthology.orchestra.run.smithi052.stdout:(97/127): python3-cherrypy-18.6.1-2.el9.noarch. 4.7 MB/s | 358 kB 00:00 2024-04-26T12:03:06.254 INFO:teuthology.orchestra.run.smithi052.stdout:(98/127): python3-cheroot-8.6.0-4.el9.noarch.rp 1.3 MB/s | 172 kB 00:00 2024-04-26T12:03:06.296 INFO:teuthology.orchestra.run.smithi052.stdout:(99/127): python3-google-auth-2.29.0-1.el9.noar 3.0 MB/s | 206 kB 00:00 2024-04-26T12:03:06.313 INFO:teuthology.orchestra.run.smithi052.stdout:(100/127): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2024-04-26T12:03:06.338 INFO:teuthology.orchestra.run.smithi052.stdout:(101/127): python3-jaraco-classes-3.2.1-5.el9.n 421 kB/s | 18 kB 00:00 2024-04-26T12:03:06.355 INFO:teuthology.orchestra.run.smithi052.stdout:(102/127): python3-jaraco-collections-3.0.0-8.e 554 kB/s | 23 kB 00:00 2024-04-26T12:03:06.397 INFO:teuthology.orchestra.run.smithi052.stdout:(103/127): parquet-libs-9.0.0-11.el9.x86_64.rpm 1.6 MB/s | 839 kB 00:00 2024-04-26T12:03:06.414 INFO:teuthology.orchestra.run.smithi052.stdout:(104/127): python3-jaraco-functools-3.5.0-2.el9 257 kB/s | 19 kB 00:00 2024-04-26T12:03:06.431 INFO:teuthology.orchestra.run.smithi052.stdout:(105/127): python3-jaraco-text-3.2.0-6.el9.noar 260 kB/s | 20 kB 00:00 2024-04-26T12:03:06.473 INFO:teuthology.orchestra.run.smithi052.stdout:(106/127): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-04-26T12:03:06.498 INFO:teuthology.orchestra.run.smithi052.stdout:(107/127): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-04-26T12:03:06.515 INFO:teuthology.orchestra.run.smithi052.stdout:(108/127): python3-natsort-7.1.1-5.el9.noarch.r 1.3 MB/s | 58 kB 00:00 2024-04-26T12:03:06.557 INFO:teuthology.orchestra.run.smithi052.stdout:(109/127): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2024-04-26T12:03:06.574 INFO:teuthology.orchestra.run.smithi052.stdout:(110/127): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-04-26T12:03:06.599 INFO:teuthology.orchestra.run.smithi052.stdout:(111/127): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-04-26T12:03:06.625 INFO:teuthology.orchestra.run.smithi052.stdout:(112/127): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-04-26T12:03:06.658 INFO:teuthology.orchestra.run.smithi052.stdout:(113/127): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-04-26T12:03:06.683 INFO:teuthology.orchestra.run.smithi052.stdout:(114/127): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-04-26T12:03:06.709 INFO:teuthology.orchestra.run.smithi052.stdout:(115/127): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-04-26T12:03:06.734 INFO:teuthology.orchestra.run.smithi052.stdout:(116/127): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-04-26T12:03:06.776 INFO:teuthology.orchestra.run.smithi052.stdout:(117/127): python3-kubernetes-26.1.0-2.el9.noar 2.7 MB/s | 1.0 MB 00:00 2024-04-26T12:03:06.793 INFO:teuthology.orchestra.run.smithi052.stdout:(118/127): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-04-26T12:03:06.818 INFO:teuthology.orchestra.run.smithi052.stdout:(119/127): python3-webob-1.8.7-6.el9.noarch.rpm 2.0 MB/s | 230 kB 00:00 2024-04-26T12:03:06.860 INFO:teuthology.orchestra.run.smithi052.stdout:(120/127): python3-zc-lockfile-2.0-10.el9.noarc 297 kB/s | 20 kB 00:00 2024-04-26T12:03:06.885 INFO:teuthology.orchestra.run.smithi052.stdout:(121/127): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-04-26T12:03:06.936 INFO:teuthology.orchestra.run.smithi052.stdout:(122/127): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-04-26T12:03:07.003 INFO:teuthology.orchestra.run.smithi052.stdout:(123/127): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-26T12:03:07.086 INFO:teuthology.orchestra.run.smithi052.stdout:(124/127): openssl-3.2.1-1.el9.x86_64.rpm 16 MB/s | 1.3 MB 00:00 2024-04-26T12:03:07.131 INFO:teuthology.orchestra.run.smithi164.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T12:03:07.132 INFO:teuthology.orchestra.run.smithi164.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T12:03:07.199 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-26T12:03:07.203 INFO:teuthology.orchestra.run.smithi052.stdout:(125/127): openssl-libs-3.2.1-1.el9.x86_64.rpm 21 MB/s | 2.4 MB 00:00 2024-04-26T12:03:07.206 INFO:teuthology.orchestra.run.smithi164.stdout:======================================================================================= 2024-04-26T12:03:07.206 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-04-26T12:03:07.207 INFO:teuthology.orchestra.run.smithi164.stdout:======================================================================================= 2024-04-26T12:03:07.207 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-26T12:03:07.207 INFO:teuthology.orchestra.run.smithi164.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T12:03:07.207 INFO:teuthology.orchestra.run.smithi164.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 6.5 k 2024-04-26T12:03:07.207 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 5.1 M 2024-04-26T12:03:07.207 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 848 k 2024-04-26T12:03:07.207 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 142 k 2024-04-26T12:03:07.207 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 1.5 M 2024-04-26T12:03:07.207 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 138 k 2024-04-26T12:03:07.207 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 3.5 M 2024-04-26T12:03:07.207 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 7.4 M 2024-04-26T12:03:07.207 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 49 k 2024-04-26T12:03:07.207 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 7.7 M 2024-04-26T12:03:07.208 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 40 M 2024-04-26T12:03:07.208 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 264 k 2024-04-26T12:03:07.208 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 224 k 2024-04-26T12:03:07.208 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T12:03:07.208 INFO:teuthology.orchestra.run.smithi164.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T12:03:07.208 INFO:teuthology.orchestra.run.smithi164.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T12:03:07.208 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 31 k 2024-04-26T12:03:07.208 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 710 k 2024-04-26T12:03:07.208 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 126 k 2024-04-26T12:03:07.208 INFO:teuthology.orchestra.run.smithi164.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T12:03:07.208 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T12:03:07.208 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T12:03:07.209 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 162 k 2024-04-26T12:03:07.209 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 320 k 2024-04-26T12:03:07.209 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 298 k 2024-04-26T12:03:07.209 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 99 k 2024-04-26T12:03:07.209 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 87 k 2024-04-26T12:03:07.209 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.0 M 2024-04-26T12:03:07.209 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 172 k 2024-04-26T12:03:07.209 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T12:03:07.209 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrading: 2024-04-26T12:03:07.209 INFO:teuthology.orchestra.run.smithi164.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.3 M 2024-04-26T12:03:07.209 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.0 M 2024-04-26T12:03:07.209 INFO:teuthology.orchestra.run.smithi164.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T12:03:07.209 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T12:03:07.209 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-04-26T12:03:07.210 INFO:teuthology.orchestra.run.smithi164.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T12:03:07.210 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T12:03:07.210 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 18 M 2024-04-26T12:03:07.210 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 24 k 2024-04-26T12:03:07.210 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 2.1 M 2024-04-26T12:03:07.210 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 246 k 2024-04-26T12:03:07.210 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 4.7 M 2024-04-26T12:03:07.210 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 17 M 2024-04-26T12:03:07.210 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 15 k 2024-04-26T12:03:07.210 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 25 k 2024-04-26T12:03:07.210 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T12:03:07.211 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T12:03:07.211 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T12:03:07.211 INFO:teuthology.orchestra.run.smithi164.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-04-26T12:03:07.211 INFO:teuthology.orchestra.run.smithi164.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T12:03:07.211 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T12:03:07.211 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T12:03:07.211 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T12:03:07.211 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 166 k 2024-04-26T12:03:07.211 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T12:03:07.211 INFO:teuthology.orchestra.run.smithi164.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T12:03:07.211 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T12:03:07.211 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T12:03:07.212 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T12:03:07.212 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 474 k 2024-04-26T12:03:07.212 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T12:03:07.212 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 4.5 M 2024-04-26T12:03:07.212 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T12:03:07.212 INFO:teuthology.orchestra.run.smithi164.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T12:03:07.212 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T12:03:07.212 INFO:teuthology.orchestra.run.smithi164.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T12:03:07.212 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T12:03:07.212 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T12:03:07.212 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T12:03:07.212 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T12:03:07.212 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T12:03:07.213 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T12:03:07.213 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 45 k 2024-04-26T12:03:07.213 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 129 k 2024-04-26T12:03:07.213 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T12:03:07.213 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T12:03:07.213 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T12:03:07.213 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T12:03:07.213 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T12:03:07.213 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T12:03:07.213 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T12:03:07.213 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T12:03:07.213 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T12:03:07.213 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T12:03:07.213 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T12:03:07.213 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T12:03:07.214 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T12:03:07.214 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T12:03:07.214 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T12:03:07.214 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T12:03:07.214 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T12:03:07.214 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T12:03:07.214 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T12:03:07.214 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T12:03:07.214 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T12:03:07.214 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T12:03:07.214 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T12:03:07.214 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T12:03:07.214 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T12:03:07.215 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T12:03:07.215 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T12:03:07.215 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T12:03:07.215 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T12:03:07.215 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T12:03:07.215 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T12:03:07.215 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T12:03:07.215 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T12:03:07.215 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T12:03:07.215 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T12:03:07.215 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T12:03:07.215 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T12:03:07.215 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T12:03:07.215 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T12:03:07.215 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T12:03:07.216 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T12:03:07.216 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T12:03:07.216 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T12:03:07.216 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T12:03:07.216 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T12:03:07.216 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T12:03:07.216 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T12:03:07.216 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T12:03:07.216 INFO:teuthology.orchestra.run.smithi164.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T12:03:07.216 INFO:teuthology.orchestra.run.smithi164.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T12:03:07.216 INFO:teuthology.orchestra.run.smithi164.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T12:03:07.216 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T12:03:07.216 INFO:teuthology.orchestra.run.smithi164.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T12:03:07.216 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:03:07.217 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-26T12:03:07.217 INFO:teuthology.orchestra.run.smithi164.stdout:======================================================================================= 2024-04-26T12:03:07.217 INFO:teuthology.orchestra.run.smithi164.stdout:Install 123 Packages 2024-04-26T12:03:07.217 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrade 4 Packages 2024-04-26T12:03:07.217 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:03:07.217 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 189 M 2024-04-26T12:03:07.217 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-26T12:03:07.310 INFO:teuthology.orchestra.run.smithi052.stdout:(126/127): librbd1-18.2.2-1256.gdc093b5e.el9.x8 8.0 MB/s | 3.0 MB 00:00 2024-04-26T12:03:07.362 INFO:teuthology.orchestra.run.smithi052.stdout:(127/127): librados2-18.2.2-1256.gdc093b5e.el9. 6.9 MB/s | 3.3 MB 00:00 2024-04-26T12:03:07.366 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:03:07.366 INFO:teuthology.orchestra.run.smithi052.stdout:Total 2.5 MB/s | 189 MB 01:15 2024-04-26T12:03:07.911 INFO:teuthology.orchestra.run.smithi164.stdout:(1/127): ceph-18.2.2-1256.gdc093b5e.el9.x86_64. 29 kB/s | 6.5 kB 00:00 2024-04-26T12:03:08.244 INFO:teuthology.orchestra.run.smithi164.stdout:(2/127): ceph-fuse-18.2.2-1256.gdc093b5e.el9.x8 2.5 MB/s | 848 kB 00:00 2024-04-26T12:03:08.275 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-04-26T12:03:08.336 INFO:teuthology.orchestra.run.smithi164.stdout:(3/127): ceph-immutable-object-cache-18.2.2-125 1.5 MB/s | 142 kB 00:00 2024-04-26T12:03:08.421 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-04-26T12:03:08.421 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-04-26T12:03:08.703 INFO:teuthology.orchestra.run.smithi164.stdout:(4/127): ceph-base-18.2.2-1256.gdc093b5e.el9.x8 5.0 MB/s | 5.1 MB 00:01 2024-04-26T12:03:08.862 INFO:teuthology.orchestra.run.smithi164.stdout:(5/127): ceph-mds-18.2.2-1256.gdc093b5e.el9.x86 4.0 MB/s | 2.1 MB 00:00 2024-04-26T12:03:09.079 INFO:teuthology.orchestra.run.smithi164.stdout:(6/127): ceph-common-18.2.2-1256.gdc093b5e.el9. 13 MB/s | 18 MB 00:01 2024-04-26T12:03:09.121 INFO:teuthology.orchestra.run.smithi164.stdout:(7/127): ceph-mgr-18.2.2-1256.gdc093b5e.el9.x86 3.5 MB/s | 1.5 MB 00:00 2024-04-26T12:03:09.654 INFO:teuthology.orchestra.run.smithi164.stdout:(8/127): ceph-mon-18.2.2-1256.gdc093b5e.el9.x86 5.9 MB/s | 4.7 MB 00:00 2024-04-26T12:03:09.746 INFO:teuthology.orchestra.run.smithi164.stdout:(9/127): ceph-selinux-18.2.2-1256.gdc093b5e.el9 275 kB/s | 25 kB 00:00 2024-04-26T12:03:09.943 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-04-26T12:03:10.049 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-04-26T12:03:10.049 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-04-26T12:03:10.221 INFO:teuthology.orchestra.run.smithi164.stdout:(10/127): ceph-osd-18.2.2-1256.gdc093b5e.el9.x8 14 MB/s | 17 MB 00:01 2024-04-26T12:03:10.288 INFO:teuthology.orchestra.run.smithi164.stdout:(11/127): libcephfs-devel-18.2.2-1256.gdc093b5e 467 kB/s | 31 kB 00:00 2024-04-26T12:03:10.372 INFO:teuthology.orchestra.run.smithi164.stdout:(12/127): libcephfs2-18.2.2-1256.gdc093b5e.el9. 8.3 MB/s | 710 kB 00:00 2024-04-26T12:03:10.472 INFO:teuthology.orchestra.run.smithi164.stdout:(13/127): ceph-radosgw-18.2.2-1256.gdc093b5e.el 5.7 MB/s | 7.7 MB 00:01 2024-04-26T12:03:10.497 INFO:teuthology.orchestra.run.smithi164.stdout:(14/127): libcephsqlite-18.2.2-1256.gdc093b5e.e 1.3 MB/s | 166 kB 00:00 2024-04-26T12:03:10.564 INFO:teuthology.orchestra.run.smithi164.stdout:(15/127): libradosstriper1-18.2.2-1256.gdc093b5 6.9 MB/s | 474 kB 00:00 2024-04-26T12:03:10.590 INFO:teuthology.orchestra.run.smithi164.stdout:(16/127): librados-devel-18.2.2-1256.gdc093b5e. 1.1 MB/s | 126 kB 00:00 2024-04-26T12:03:10.690 INFO:teuthology.orchestra.run.smithi164.stdout:(17/127): python3-ceph-argparse-18.2.2-1256.gdc 450 kB/s | 45 kB 00:00 2024-04-26T12:03:10.790 INFO:teuthology.orchestra.run.smithi164.stdout:(18/127): python3-ceph-common-18.2.2-1256.gdc09 1.3 MB/s | 129 kB 00:00 2024-04-26T12:03:10.890 INFO:teuthology.orchestra.run.smithi164.stdout:(19/127): python3-cephfs-18.2.2-1256.gdc093b5e. 1.6 MB/s | 162 kB 00:00 2024-04-26T12:03:10.982 INFO:teuthology.orchestra.run.smithi164.stdout:(20/127): librgw2-18.2.2-1256.gdc093b5e.el9.x86 11 MB/s | 4.5 MB 00:00 2024-04-26T12:03:11.007 INFO:teuthology.orchestra.run.smithi164.stdout:(21/127): python3-rados-18.2.2-1256.gdc093b5e.e 2.7 MB/s | 320 kB 00:00 2024-04-26T12:03:11.058 INFO:teuthology.orchestra.run.smithi164.stdout:(22/127): python3-rbd-18.2.2-1256.gdc093b5e.el9 3.9 MB/s | 298 kB 00:00 2024-04-26T12:03:11.091 INFO:teuthology.orchestra.run.smithi164.stdout:(23/127): python3-rgw-18.2.2-1256.gdc093b5e.el9 1.2 MB/s | 99 kB 00:00 2024-04-26T12:03:11.125 INFO:teuthology.orchestra.run.smithi164.stdout:(24/127): rbd-fuse-18.2.2-1256.gdc093b5e.el9.x8 1.3 MB/s | 87 kB 00:00 2024-04-26T12:03:11.200 INFO:teuthology.orchestra.run.smithi143.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-26T12:03:11.209 INFO:teuthology.orchestra.run.smithi164.stdout:(25/127): rbd-nbd-18.2.2-1256.gdc093b5e.el9.x86 2.0 MB/s | 172 kB 00:00 2024-04-26T12:03:11.284 INFO:teuthology.orchestra.run.smithi164.stdout:(26/127): ceph-grafana-dashboards-18.2.2-1256.g 326 kB/s | 24 kB 00:00 2024-04-26T12:03:11.376 INFO:teuthology.orchestra.run.smithi164.stdout:(27/127): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 1.5 MB/s | 138 kB 00:00 2024-04-26T12:03:11.835 INFO:teuthology.orchestra.run.smithi164.stdout:(28/127): rbd-mirror-18.2.2-1256.gdc093b5e.el9. 4.0 MB/s | 3.0 MB 00:00 2024-04-26T12:03:12.002 INFO:teuthology.orchestra.run.smithi164.stdout:(29/127): ceph-mgr-dashboard-18.2.2-1256.gdc093 5.6 MB/s | 3.5 MB 00:00 2024-04-26T12:03:12.038 INFO:teuthology.orchestra.run.smithi154.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T12:03:12.038 INFO:teuthology.orchestra.run.smithi154.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T12:03:12.103 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-04-26T12:03:12.111 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================= 2024-04-26T12:03:12.111 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2024-04-26T12:03:12.111 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================= 2024-04-26T12:03:12.111 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-04-26T12:03:12.111 INFO:teuthology.orchestra.run.smithi154.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T12:03:12.111 INFO:teuthology.orchestra.run.smithi154.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 6.5 k 2024-04-26T12:03:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 5.1 M 2024-04-26T12:03:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 848 k 2024-04-26T12:03:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 142 k 2024-04-26T12:03:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 1.5 M 2024-04-26T12:03:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 138 k 2024-04-26T12:03:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 3.5 M 2024-04-26T12:03:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 7.4 M 2024-04-26T12:03:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 49 k 2024-04-26T12:03:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 7.7 M 2024-04-26T12:03:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 40 M 2024-04-26T12:03:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 264 k 2024-04-26T12:03:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 224 k 2024-04-26T12:03:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T12:03:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T12:03:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T12:03:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 31 k 2024-04-26T12:03:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 710 k 2024-04-26T12:03:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 126 k 2024-04-26T12:03:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T12:03:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T12:03:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T12:03:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 162 k 2024-04-26T12:03:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 320 k 2024-04-26T12:03:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 298 k 2024-04-26T12:03:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 99 k 2024-04-26T12:03:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 87 k 2024-04-26T12:03:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.0 M 2024-04-26T12:03:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 172 k 2024-04-26T12:03:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T12:03:12.114 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrading: 2024-04-26T12:03:12.114 INFO:teuthology.orchestra.run.smithi154.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.3 M 2024-04-26T12:03:12.114 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.0 M 2024-04-26T12:03:12.114 INFO:teuthology.orchestra.run.smithi154.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T12:03:12.114 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T12:03:12.114 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-04-26T12:03:12.114 INFO:teuthology.orchestra.run.smithi154.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T12:03:12.114 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T12:03:12.114 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 18 M 2024-04-26T12:03:12.114 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 24 k 2024-04-26T12:03:12.114 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 2.1 M 2024-04-26T12:03:12.114 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 246 k 2024-04-26T12:03:12.114 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 4.7 M 2024-04-26T12:03:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 17 M 2024-04-26T12:03:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 15 k 2024-04-26T12:03:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 25 k 2024-04-26T12:03:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T12:03:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T12:03:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T12:03:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-04-26T12:03:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T12:03:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T12:03:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T12:03:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T12:03:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 166 k 2024-04-26T12:03:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T12:03:12.116 INFO:teuthology.orchestra.run.smithi154.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T12:03:12.116 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T12:03:12.116 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T12:03:12.116 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T12:03:12.116 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 474 k 2024-04-26T12:03:12.116 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T12:03:12.116 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 4.5 M 2024-04-26T12:03:12.116 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T12:03:12.116 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T12:03:12.116 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T12:03:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T12:03:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T12:03:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T12:03:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T12:03:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T12:03:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T12:03:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T12:03:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 45 k 2024-04-26T12:03:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 129 k 2024-04-26T12:03:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T12:03:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T12:03:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T12:03:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T12:03:12.118 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T12:03:12.118 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T12:03:12.118 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T12:03:12.118 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T12:03:12.118 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T12:03:12.118 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T12:03:12.118 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T12:03:12.118 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T12:03:12.118 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T12:03:12.118 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T12:03:12.118 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T12:03:12.118 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T12:03:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T12:03:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T12:03:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T12:03:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T12:03:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T12:03:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T12:03:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T12:03:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T12:03:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T12:03:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T12:03:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T12:03:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T12:03:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T12:03:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T12:03:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T12:03:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T12:03:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T12:03:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T12:03:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T12:03:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T12:03:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T12:03:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T12:03:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T12:03:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T12:03:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T12:03:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T12:03:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T12:03:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T12:03:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T12:03:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T12:03:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T12:03:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T12:03:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T12:03:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T12:03:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T12:03:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T12:03:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T12:03:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:03:12.121 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-04-26T12:03:12.121 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================= 2024-04-26T12:03:12.121 INFO:teuthology.orchestra.run.smithi154.stdout:Install 123 Packages 2024-04-26T12:03:12.121 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrade 4 Packages 2024-04-26T12:03:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:03:12.122 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 189 M 2024-04-26T12:03:12.122 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-04-26T12:03:12.402 INFO:teuthology.orchestra.run.smithi164.stdout:(30/127): ceph-test-18.2.2-1256.gdc093b5e.el9.x 15 MB/s | 40 MB 00:02 2024-04-26T12:03:12.427 INFO:teuthology.orchestra.run.smithi164.stdout:(31/127): ceph-mgr-modules-core-18.2.2-1256.gdc 578 kB/s | 246 kB 00:00 2024-04-26T12:03:12.461 INFO:teuthology.orchestra.run.smithi164.stdout:(32/127): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 846 kB/s | 49 kB 00:00 2024-04-26T12:03:12.486 INFO:teuthology.orchestra.run.smithi164.stdout:(33/127): ceph-prometheus-alerts-18.2.2-1256.gd 261 kB/s | 15 kB 00:00 2024-04-26T12:03:12.528 INFO:teuthology.orchestra.run.smithi164.stdout:(34/127): ceph-volume-18.2.2-1256.gdc093b5e.el9 3.9 MB/s | 264 kB 00:00 2024-04-26T12:03:12.597 INFO:teuthology.orchestra.run.smithi164.stdout:(35/127): cephadm-18.2.2-1256.gdc093b5e.el9.noa 2.0 MB/s | 224 kB 00:00 2024-04-26T12:03:12.647 INFO:teuthology.orchestra.run.smithi164.stdout:(36/127): fuse-2.9.9-15.el9.x86_64.rpm 677 kB/s | 80 kB 00:00 2024-04-26T12:03:12.706 INFO:teuthology.orchestra.run.smithi164.stdout:(37/127): libgfortran-11.4.1-3.el9.x86_64.rpm 7.3 MB/s | 803 kB 00:00 2024-04-26T12:03:12.731 INFO:teuthology.orchestra.run.smithi164.stdout:(38/127): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-04-26T12:03:12.748 INFO:teuthology.orchestra.run.smithi164.stdout:(39/127): python3-cffi-1.14.5-5.el9.x86_64.rpm 6.0 MB/s | 253 kB 00:00 2024-04-26T12:03:12.798 INFO:teuthology.orchestra.run.smithi164.stdout:(40/127): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-04-26T12:03:12.833 INFO:teuthology.orchestra.run.smithi164.stdout:(41/127): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2024-04-26T12:03:12.849 INFO:teuthology.orchestra.run.smithi164.stdout:(42/127): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-04-26T12:03:12.852 INFO:teuthology.orchestra.run.smithi154.stdout:(1/127): ceph-18.2.2-1256.gdc093b5e.el9.x86_64. 38 kB/s | 6.5 kB 00:00 2024-04-26T12:03:12.874 INFO:teuthology.orchestra.run.smithi164.stdout:(43/127): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-04-26T12:03:12.900 INFO:teuthology.orchestra.run.smithi164.stdout:(44/127): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-26T12:03:12.925 INFO:teuthology.orchestra.run.smithi164.stdout:(45/127): automake-1.16.2-8.el9.noarch.rpm 14 MB/s | 689 kB 00:00 2024-04-26T12:03:12.958 INFO:teuthology.orchestra.run.smithi164.stdout:(46/127): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 943 kB 00:00 2024-04-26T12:03:12.984 INFO:teuthology.orchestra.run.smithi164.stdout:(47/127): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-04-26T12:03:13.000 INFO:teuthology.orchestra.run.smithi164.stdout:(48/127): elfutils-libelf-devel-0.190-2.el9.x86 517 kB/s | 21 kB 00:00 2024-04-26T12:03:13.026 INFO:teuthology.orchestra.run.smithi164.stdout:(49/127): flex-2.6.4-9.el9.x86_64.rpm 7.3 MB/s | 313 kB 00:00 2024-04-26T12:03:13.043 INFO:teuthology.orchestra.run.smithi164.stdout:(50/127): flexiblas-3.0.4-8.el9.x86_64.rpm 791 kB/s | 33 kB 00:00 2024-04-26T12:03:13.053 INFO:teuthology.orchestra.run.smithi154.stdout:(2/127): ceph-fuse-18.2.2-1256.gdc093b5e.el9.x8 4.1 MB/s | 848 kB 00:00 2024-04-26T12:03:13.068 INFO:teuthology.orchestra.run.smithi164.stdout:(51/127): flexiblas-openblas-openmp-3.0.4-8.el9 753 kB/s | 18 kB 00:00 2024-04-26T12:03:13.112 INFO:teuthology.orchestra.run.smithi154.stdout:(3/127): ceph-immutable-object-cache-18.2.2-125 2.4 MB/s | 142 kB 00:00 2024-04-26T12:03:13.135 INFO:teuthology.orchestra.run.smithi164.stdout:(52/127): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2024-04-26T12:03:13.152 INFO:teuthology.orchestra.run.smithi164.stdout:(53/127): libaio-devel-0.3.111-13.el9.x86_64.rp 137 kB/s | 11 kB 00:00 2024-04-26T12:03:13.185 INFO:teuthology.orchestra.run.smithi164.stdout:(54/127): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-04-26T12:03:13.211 INFO:teuthology.orchestra.run.smithi164.stdout:(55/127): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-04-26T12:03:13.270 INFO:teuthology.orchestra.run.smithi164.stdout:(56/127): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 662 kB 00:00 2024-04-26T12:03:13.279 INFO:teuthology.orchestra.run.smithi143.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T12:03:13.280 INFO:teuthology.orchestra.run.smithi143.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T12:03:13.295 INFO:teuthology.orchestra.run.smithi164.stdout:(57/127): libtool-2.4.6-45.el9.x86_64.rpm 6.8 MB/s | 582 kB 00:00 2024-04-26T12:03:13.320 INFO:teuthology.orchestra.run.smithi164.stdout:(58/127): libuuid-devel-2.37.4-18.el9.x86_64.rp 518 kB/s | 25 kB 00:00 2024-04-26T12:03:13.344 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-04-26T12:03:13.351 INFO:teuthology.orchestra.run.smithi143.stdout:======================================================================================= 2024-04-26T12:03:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repository Size 2024-04-26T12:03:13.351 INFO:teuthology.orchestra.run.smithi143.stdout:======================================================================================= 2024-04-26T12:03:13.351 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-04-26T12:03:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T12:03:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 6.5 k 2024-04-26T12:03:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 5.1 M 2024-04-26T12:03:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 848 k 2024-04-26T12:03:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 142 k 2024-04-26T12:03:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 1.5 M 2024-04-26T12:03:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 138 k 2024-04-26T12:03:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 3.5 M 2024-04-26T12:03:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 7.4 M 2024-04-26T12:03:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 49 k 2024-04-26T12:03:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 7.7 M 2024-04-26T12:03:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 40 M 2024-04-26T12:03:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 264 k 2024-04-26T12:03:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 224 k 2024-04-26T12:03:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T12:03:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T12:03:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T12:03:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 31 k 2024-04-26T12:03:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 710 k 2024-04-26T12:03:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 126 k 2024-04-26T12:03:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T12:03:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T12:03:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T12:03:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 162 k 2024-04-26T12:03:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 320 k 2024-04-26T12:03:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 298 k 2024-04-26T12:03:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 99 k 2024-04-26T12:03:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 87 k 2024-04-26T12:03:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.0 M 2024-04-26T12:03:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 172 k 2024-04-26T12:03:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T12:03:13.354 INFO:teuthology.orchestra.run.smithi143.stdout:Upgrading: 2024-04-26T12:03:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.3 M 2024-04-26T12:03:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.0 M 2024-04-26T12:03:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T12:03:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T12:03:13.354 INFO:teuthology.orchestra.run.smithi143.stdout:Installing dependencies: 2024-04-26T12:03:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T12:03:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T12:03:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 18 M 2024-04-26T12:03:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 24 k 2024-04-26T12:03:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 2.1 M 2024-04-26T12:03:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 246 k 2024-04-26T12:03:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 4.7 M 2024-04-26T12:03:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 17 M 2024-04-26T12:03:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 15 k 2024-04-26T12:03:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 25 k 2024-04-26T12:03:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T12:03:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T12:03:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T12:03:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-04-26T12:03:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T12:03:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T12:03:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T12:03:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T12:03:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 166 k 2024-04-26T12:03:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T12:03:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T12:03:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T12:03:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T12:03:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T12:03:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 474 k 2024-04-26T12:03:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T12:03:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 4.5 M 2024-04-26T12:03:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T12:03:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T12:03:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T12:03:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T12:03:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T12:03:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T12:03:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T12:03:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T12:03:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T12:03:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T12:03:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 45 k 2024-04-26T12:03:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 129 k 2024-04-26T12:03:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T12:03:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T12:03:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T12:03:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T12:03:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T12:03:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T12:03:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T12:03:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T12:03:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T12:03:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T12:03:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T12:03:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T12:03:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T12:03:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T12:03:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T12:03:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T12:03:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T12:03:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T12:03:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T12:03:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T12:03:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T12:03:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T12:03:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T12:03:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T12:03:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T12:03:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T12:03:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T12:03:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T12:03:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T12:03:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T12:03:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T12:03:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T12:03:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T12:03:13.360 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T12:03:13.360 INFO:teuthology.orchestra.run.smithi143.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T12:03:13.360 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T12:03:13.360 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T12:03:13.360 INFO:teuthology.orchestra.run.smithi143.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T12:03:13.360 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T12:03:13.360 INFO:teuthology.orchestra.run.smithi143.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T12:03:13.360 INFO:teuthology.orchestra.run.smithi143.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T12:03:13.360 INFO:teuthology.orchestra.run.smithi143.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T12:03:13.360 INFO:teuthology.orchestra.run.smithi143.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T12:03:13.360 INFO:teuthology.orchestra.run.smithi143.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T12:03:13.360 INFO:teuthology.orchestra.run.smithi143.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T12:03:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T12:03:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T12:03:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T12:03:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T12:03:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T12:03:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T12:03:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T12:03:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T12:03:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:03:13.361 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-04-26T12:03:13.361 INFO:teuthology.orchestra.run.smithi143.stdout:======================================================================================= 2024-04-26T12:03:13.361 INFO:teuthology.orchestra.run.smithi143.stdout:Install 123 Packages 2024-04-26T12:03:13.361 INFO:teuthology.orchestra.run.smithi143.stdout:Upgrade 4 Packages 2024-04-26T12:03:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:03:13.362 INFO:teuthology.orchestra.run.smithi164.stdout:(59/127): libzstd-devel-1.5.1-2.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-04-26T12:03:13.363 INFO:teuthology.orchestra.run.smithi154.stdout:(4/127): ceph-mds-18.2.2-1256.gdc093b5e.el9.x86 8.7 MB/s | 2.1 MB 00:00 2024-04-26T12:03:13.363 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 189 M 2024-04-26T12:03:13.363 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-04-26T12:03:13.396 INFO:teuthology.orchestra.run.smithi164.stdout:(60/127): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-04-26T12:03:13.479 INFO:teuthology.orchestra.run.smithi164.stdout:(61/127): ceph-mgr-diskprediction-local-18.2.2- 4.5 MB/s | 7.4 MB 00:01 2024-04-26T12:03:13.504 INFO:teuthology.orchestra.run.smithi164.stdout:(62/127): openblas-0.3.21-2.el9.x86_64.rpm 234 kB/s | 35 kB 00:00 2024-04-26T12:03:13.529 INFO:teuthology.orchestra.run.smithi154.stdout:(5/127): ceph-mgr-18.2.2-1256.gdc093b5e.el9.x86 8.3 MB/s | 1.5 MB 00:00 2024-04-26T12:03:13.596 INFO:teuthology.orchestra.run.smithi164.stdout:(63/127): openblas-openmp-0.3.21-2.el9.x86_64.r 24 MB/s | 4.7 MB 00:00 2024-04-26T12:03:13.672 INFO:teuthology.orchestra.run.smithi164.stdout:(64/127): openssl-devel-3.2.1-1.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-04-26T12:03:13.789 INFO:teuthology.orchestra.run.smithi164.stdout:(65/127): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 6.0 MB 00:00 2024-04-26T12:03:13.814 INFO:teuthology.orchestra.run.smithi164.stdout:(66/127): python3-devel-3.9.18-3.el9.x86_64.rpm 1.1 MB/s | 244 kB 00:00 2024-04-26T12:03:13.839 INFO:teuthology.orchestra.run.smithi164.stdout:(67/127): python3-jinja2-2.11.3-5.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-04-26T12:03:13.865 INFO:teuthology.orchestra.run.smithi164.stdout:(68/127): python3-jsonpatch-1.21-16.el9.noarch. 345 kB/s | 26 kB 00:00 2024-04-26T12:03:13.890 INFO:teuthology.orchestra.run.smithi164.stdout:(69/127): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-04-26T12:03:13.915 INFO:teuthology.orchestra.run.smithi164.stdout:(70/127): python3-jsonpointer-2.0-4.el9.noarch. 255 kB/s | 19 kB 00:00 2024-04-26T12:03:13.940 INFO:teuthology.orchestra.run.smithi164.stdout:(71/127): python3-markupsafe-1.1.1-12.el9.x86_6 465 kB/s | 35 kB 00:00 2024-04-26T12:03:13.990 INFO:teuthology.orchestra.run.smithi164.stdout:(72/127): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.3 MB/s | 250 kB 00:00 2024-04-26T12:03:14.016 INFO:teuthology.orchestra.run.smithi164.stdout:(73/127): python3-oauthlib-3.1.1-5.el9.noarch.r 3.0 MB/s | 222 kB 00:00 2024-04-26T12:03:14.037 INFO:teuthology.orchestra.run.smithi154.stdout:(6/127): ceph-mon-18.2.2-1256.gdc093b5e.el9.x86 9.2 MB/s | 4.7 MB 00:00 2024-04-26T12:03:14.083 INFO:teuthology.orchestra.run.smithi164.stdout:(74/127): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 5.1 MB 00:00 2024-04-26T12:03:14.108 INFO:teuthology.orchestra.run.smithi164.stdout:(75/127): python3-packaging-20.9-5.el9.noarch.r 662 kB/s | 77 kB 00:00 2024-04-26T12:03:14.133 INFO:teuthology.orchestra.run.smithi164.stdout:(76/127): python3-prettytable-0.7.2-27.el9.noar 368 kB/s | 42 kB 00:00 2024-04-26T12:03:14.158 INFO:teuthology.orchestra.run.smithi164.stdout:(77/127): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-26T12:03:14.183 INFO:teuthology.orchestra.run.smithi164.stdout:(78/127): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-04-26T12:03:14.209 INFO:teuthology.orchestra.run.smithi164.stdout:(79/127): python3-pytz-2021.1-5.el9.noarch.rpm 677 kB/s | 51 kB 00:00 2024-04-26T12:03:14.212 INFO:teuthology.orchestra.run.smithi154.stdout:(7/127): ceph-common-18.2.2-1256.gdc093b5e.el9. 12 MB/s | 18 MB 00:01 2024-04-26T12:03:14.234 INFO:teuthology.orchestra.run.smithi164.stdout:(80/127): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-26T12:03:14.259 INFO:teuthology.orchestra.run.smithi164.stdout:(81/127): python3-toml-0.10.2-6.el9.noarch.rpm 835 kB/s | 42 kB 00:00 2024-04-26T12:03:14.293 INFO:teuthology.orchestra.run.smithi164.stdout:(82/127): socat-1.7.4.1-5.el9.x86_64.rpm 5.3 MB/s | 305 kB 00:00 2024-04-26T12:03:14.318 INFO:teuthology.orchestra.run.smithi164.stdout:(83/127): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.7 MB/s | 94 kB 00:00 2024-04-26T12:03:14.352 INFO:teuthology.orchestra.run.smithi164.stdout:(84/127): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-04-26T12:03:14.377 INFO:teuthology.orchestra.run.smithi164.stdout:(85/127): zlib-devel-1.2.11-41.el9.x86_64.rpm 811 kB/s | 45 kB 00:00 2024-04-26T12:03:14.569 INFO:teuthology.orchestra.run.smithi164.stdout:(86/127): python3-scipy-1.6.2-8.el9.x86_64.rpm 42 MB/s | 16 MB 00:00 2024-04-26T12:03:14.643 INFO:teuthology.orchestra.run.smithi143.stdout:(1/127): ceph-18.2.2-1256.gdc093b5e.el9.x86_64. 13 kB/s | 6.5 kB 00:00 2024-04-26T12:03:14.669 INFO:teuthology.orchestra.run.smithi164.stdout:(87/127): fmt-8.1.1-5.el9.x86_64.rpm 353 kB/s | 111 kB 00:00 2024-04-26T12:03:14.753 INFO:teuthology.orchestra.run.smithi164.stdout:(88/127): libarrow-doc-9.0.0-11.el9.noarch.rpm 312 kB/s | 26 kB 00:00 2024-04-26T12:03:14.778 INFO:teuthology.orchestra.run.smithi164.stdout:(89/127): gperftools-libs-2.9.1-2.el9.x86_64.rp 776 kB/s | 309 kB 00:00 2024-04-26T12:03:14.779 INFO:teuthology.orchestra.run.smithi154.stdout:(8/127): ceph-radosgw-18.2.2-1256.gdc093b5e.el9 14 MB/s | 7.7 MB 00:00 2024-04-26T12:03:14.838 INFO:teuthology.orchestra.run.smithi154.stdout:(9/127): ceph-selinux-18.2.2-1256.gdc093b5e.el9 433 kB/s | 25 kB 00:00 2024-04-26T12:03:14.861 INFO:teuthology.orchestra.run.smithi164.stdout:(90/127): liboath-2.6.7-2.el9.x86_64.rpm 447 kB/s | 49 kB 00:00 2024-04-26T12:03:14.887 INFO:teuthology.orchestra.run.smithi164.stdout:(91/127): libunwind-1.6.2-1.el9.x86_64.rpm 620 kB/s | 67 kB 00:00 2024-04-26T12:03:15.062 INFO:teuthology.orchestra.run.smithi164.stdout:(92/127): libarrow-9.0.0-11.el9.x86_64.rpm 9.0 MB/s | 4.4 MB 00:00 2024-04-26T12:03:15.112 INFO:teuthology.orchestra.run.smithi164.stdout:(93/127): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 876 kB/s | 43 kB 00:00 2024-04-26T12:03:15.137 INFO:teuthology.orchestra.run.smithi164.stdout:(94/127): python3-asyncssh-2.13.2-5.el9.noarch. 2.1 MB/s | 548 kB 00:00 2024-04-26T12:03:15.163 INFO:teuthology.orchestra.run.smithi164.stdout:(95/127): python3-cachetools-4.2.4-1.el9.noarch 639 kB/s | 32 kB 00:00 2024-04-26T12:03:15.171 INFO:teuthology.orchestra.run.smithi154.stdout:(10/127): ceph-base-18.2.2-1256.gdc093b5e.el9.x 2.0 MB/s | 5.1 MB 00:02 2024-04-26T12:03:15.188 INFO:teuthology.orchestra.run.smithi164.stdout:(96/127): python3-certifi-2021.10.8-2.el9.noarc 299 kB/s | 15 kB 00:00 2024-04-26T12:03:15.198 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-04-26T12:03:15.221 INFO:teuthology.orchestra.run.smithi164.stdout:(97/127): python3-cheroot-8.6.0-4.el9.noarch.rp 2.9 MB/s | 172 kB 00:00 2024-04-26T12:03:15.274 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/131 2024-04-26T12:03:15.280 INFO:teuthology.orchestra.run.smithi164.stdout:(98/127): python3-google-auth-2.29.0-1.el9.noar 3.4 MB/s | 206 kB 00:00 2024-04-26T12:03:15.288 INFO:teuthology.orchestra.run.smithi154.stdout:(11/127): libcephfs-devel-18.2.2-1256.gdc093b5e 266 kB/s | 31 kB 00:00 2024-04-26T12:03:15.306 INFO:teuthology.orchestra.run.smithi164.stdout:(99/127): parquet-libs-9.0.0-11.el9.x86_64.rpm 1.8 MB/s | 839 kB 00:00 2024-04-26T12:03:15.321 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/131 2024-04-26T12:03:15.326 INFO:teuthology.orchestra.run.smithi143.stdout:(2/127): ceph-fuse-18.2.2-1256.gdc093b5e.el9.x8 1.2 MB/s | 848 kB 00:00 2024-04-26T12:03:15.339 INFO:teuthology.orchestra.run.smithi164.stdout:(100/127): python3-jaraco-8.2.1-3.el9.noarch.rp 182 kB/s | 11 kB 00:00 2024-04-26T12:03:15.373 INFO:teuthology.orchestra.run.smithi164.stdout:(101/127): python3-cherrypy-18.6.1-2.el9.noarch 1.9 MB/s | 358 kB 00:00 2024-04-26T12:03:15.384 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/131 2024-04-26T12:03:15.398 INFO:teuthology.orchestra.run.smithi164.stdout:(102/127): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2024-04-26T12:03:15.424 INFO:teuthology.orchestra.run.smithi164.stdout:(103/127): python3-jaraco-collections-3.0.0-8.e 277 kB/s | 23 kB 00:00 2024-04-26T12:03:15.426 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/131 2024-04-26T12:03:15.449 INFO:teuthology.orchestra.run.smithi164.stdout:(104/127): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-04-26T12:03:15.452 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/131 2024-04-26T12:03:15.474 INFO:teuthology.orchestra.run.smithi164.stdout:(105/127): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-04-26T12:03:15.494 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/131 2024-04-26T12:03:15.516 INFO:teuthology.orchestra.run.smithi164.stdout:(106/127): python3-logutils-0.3.5-21.el9.noarch 694 kB/s | 46 kB 00:00 2024-04-26T12:03:15.541 INFO:teuthology.orchestra.run.smithi164.stdout:(107/127): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-04-26T12:03:15.552 INFO:teuthology.orchestra.run.smithi143.stdout:(3/127): ceph-immutable-object-cache-18.2.2-125 633 kB/s | 142 kB 00:00 2024-04-26T12:03:15.583 INFO:teuthology.orchestra.run.smithi164.stdout:(108/127): python3-natsort-7.1.1-5.el9.noarch.r 864 kB/s | 58 kB 00:00 2024-04-26T12:03:15.608 INFO:teuthology.orchestra.run.smithi164.stdout:(109/127): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-04-26T12:03:15.642 INFO:teuthology.orchestra.run.smithi164.stdout:(110/127): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-04-26T12:03:15.667 INFO:teuthology.orchestra.run.smithi164.stdout:(111/127): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-04-26T12:03:15.692 INFO:teuthology.orchestra.run.smithi164.stdout:(112/127): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-04-26T12:03:15.705 INFO:teuthology.orchestra.run.smithi154.stdout:(12/127): ceph-osd-18.2.2-1256.gdc093b5e.el9.x8 9.9 MB/s | 17 MB 00:01 2024-04-26T12:03:15.717 INFO:teuthology.orchestra.run.smithi164.stdout:(113/127): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-04-26T12:03:15.739 INFO:teuthology.orchestra.run.smithi154.stdout:(13/127): libcephfs2-18.2.2-1256.gdc093b5e.el9. 1.5 MB/s | 710 kB 00:00 2024-04-26T12:03:15.751 INFO:teuthology.orchestra.run.smithi164.stdout:(114/127): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-04-26T12:03:15.764 INFO:teuthology.orchestra.run.smithi154.stdout:(14/127): libcephsqlite-18.2.2-1256.gdc093b5e.e 2.8 MB/s | 166 kB 00:00 2024-04-26T12:03:15.785 INFO:teuthology.orchestra.run.smithi164.stdout:(115/127): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-04-26T12:03:15.806 INFO:teuthology.orchestra.run.smithi154.stdout:(15/127): librados-devel-18.2.2-1256.gdc093b5e. 1.8 MB/s | 126 kB 00:00 2024-04-26T12:03:15.810 INFO:teuthology.orchestra.run.smithi164.stdout:(116/127): python3-tempora-5.0.0-2.el9.noarch.r 388 kB/s | 36 kB 00:00 2024-04-26T12:03:15.836 INFO:teuthology.orchestra.run.smithi164.stdout:(117/127): python3-typing-extensions-4.4.0-2.el 610 kB/s | 51 kB 00:00 2024-04-26T12:03:15.840 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/131 2024-04-26T12:03:15.848 INFO:teuthology.orchestra.run.smithi154.stdout:(16/127): libradosstriper1-18.2.2-1256.gdc093b5 5.5 MB/s | 474 kB 00:00 2024-04-26T12:03:15.861 INFO:teuthology.orchestra.run.smithi164.stdout:(118/127): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-26T12:03:15.894 INFO:teuthology.orchestra.run.smithi164.stdout:(119/127): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-04-26T12:03:15.920 INFO:teuthology.orchestra.run.smithi164.stdout:(120/127): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-04-26T12:03:15.923 INFO:teuthology.orchestra.run.smithi154.stdout:(17/127): python3-ceph-argparse-18.2.2-1256.gdc 600 kB/s | 45 kB 00:00 2024-04-26T12:03:15.952 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T12:03:15.953 INFO:teuthology.orchestra.run.smithi164.stdout:(121/127): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-04-26T12:03:15.999 INFO:teuthology.orchestra.run.smithi154.stdout:(18/127): python3-ceph-common-18.2.2-1256.gdc09 1.7 MB/s | 129 kB 00:00 2024-04-26T12:03:16.003 INFO:teuthology.orchestra.run.smithi164.stdout:(122/127): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-04-26T12:03:16.045 INFO:teuthology.orchestra.run.smithi164.stdout:(123/127): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-04-26T12:03:16.073 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T12:03:16.074 INFO:teuthology.orchestra.run.smithi154.stdout:(19/127): python3-cephfs-18.2.2-1256.gdc093b5e. 2.1 MB/s | 162 kB 00:00 2024-04-26T12:03:16.103 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T12:03:16.104 INFO:teuthology.orchestra.run.smithi164.stdout:(124/127): openssl-3.2.1-1.el9.x86_64.rpm 23 MB/s | 1.3 MB 00:00 2024-04-26T12:03:16.158 INFO:teuthology.orchestra.run.smithi154.stdout:(20/127): python3-rados-18.2.2-1256.gdc093b5e.e 3.7 MB/s | 320 kB 00:00 2024-04-26T12:03:16.187 INFO:teuthology.orchestra.run.smithi164.stdout:(125/127): openssl-libs-3.2.1-1.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-04-26T12:03:16.195 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T12:03:16.235 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 10/131 2024-04-26T12:03:16.242 INFO:teuthology.orchestra.run.smithi154.stdout:(21/127): python3-rbd-18.2.2-1256.gdc093b5e.el9 3.5 MB/s | 298 kB 00:00 2024-04-26T12:03:16.262 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T12:03:16.317 INFO:teuthology.orchestra.run.smithi154.stdout:(22/127): python3-rgw-18.2.2-1256.gdc093b5e.el9 1.3 MB/s | 99 kB 00:00 2024-04-26T12:03:16.365 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T12:03:16.388 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 12/131 2024-04-26T12:03:16.392 INFO:teuthology.orchestra.run.smithi154.stdout:(23/127): rbd-fuse-18.2.2-1256.gdc093b5e.el9.x8 1.1 MB/s | 87 kB 00:00 2024-04-26T12:03:16.427 INFO:teuthology.orchestra.run.smithi143.stdout:(4/127): ceph-base-18.2.2-1256.gdc093b5e.el9.x8 2.2 MB/s | 5.1 MB 00:02 2024-04-26T12:03:16.517 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 12/131 2024-04-26T12:03:16.551 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 13/131 2024-04-26T12:03:16.586 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : liboath-2.6.7-2.el9.x86_64 14/131 2024-04-26T12:03:16.654 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/131 2024-04-26T12:03:16.694 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 16/131 2024-04-26T12:03:16.721 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 17/131 2024-04-26T12:03:16.771 INFO:teuthology.orchestra.run.smithi164.stdout:(126/127): librados2-18.2.2-1256.gdc093b5e.el9. 4.0 MB/s | 3.3 MB 00:00 2024-04-26T12:03:16.793 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/131 2024-04-26T12:03:16.828 INFO:teuthology.orchestra.run.smithi143.stdout:(5/127): ceph-mds-18.2.2-1256.gdc093b5e.el9.x86 1.6 MB/s | 2.1 MB 00:01 2024-04-26T12:03:16.844 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 19/131 2024-04-26T12:03:16.874 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/131 2024-04-26T12:03:16.893 INFO:teuthology.orchestra.run.smithi154.stdout:(24/127): rbd-mirror-18.2.2-1256.gdc093b5e.el9. 6.0 MB/s | 3.0 MB 00:00 2024-04-26T12:03:16.937 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 21/131 2024-04-26T12:03:16.943 INFO:teuthology.orchestra.run.smithi154.stdout:(25/127): rbd-nbd-18.2.2-1256.gdc093b5e.el9.x86 3.4 MB/s | 172 kB 00:00 2024-04-26T12:03:17.002 INFO:teuthology.orchestra.run.smithi154.stdout:(26/127): ceph-grafana-dashboards-18.2.2-1256.g 420 kB/s | 24 kB 00:00 2024-04-26T12:03:17.012 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 22/131 2024-04-26T12:03:17.045 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9. 23/131 2024-04-26T12:03:17.060 INFO:teuthology.orchestra.run.smithi154.stdout:(27/127): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 2.3 MB/s | 138 kB 00:00 2024-04-26T12:03:17.089 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 24/131 2024-04-26T12:03:17.161 INFO:teuthology.orchestra.run.smithi143.stdout:(6/127): ceph-mgr-18.2.2-1256.gdc093b5e.el9.x86 2.0 MB/s | 1.5 MB 00:00 2024-04-26T12:03:17.164 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_6 25/131 2024-04-26T12:03:17.300 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/131 2024-04-26T12:03:17.329 INFO:teuthology.orchestra.run.smithi164.stdout:(127/127): librbd1-18.2.2-1256.gdc093b5e.el9.x8 2.3 MB/s | 3.0 MB 00:01 2024-04-26T12:03:17.333 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:03:17.334 INFO:teuthology.orchestra.run.smithi164.stdout:Total 19 MB/s | 189 MB 00:10 2024-04-26T12:03:17.350 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 27/131 2024-04-26T12:03:17.519 INFO:teuthology.orchestra.run.smithi154.stdout:(28/127): ceph-mgr-dashboard-18.2.2-1256.gdc093 7.7 MB/s | 3.5 MB 00:00 2024-04-26T12:03:17.913 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rsa-4.9-2.el9.noarch 28/131 2024-04-26T12:03:17.996 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 29/131 2024-04-26T12:03:18.041 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 30/131 2024-04-26T12:03:18.079 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_6 31/131 2024-04-26T12:03:18.121 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 32/131 2024-04-26T12:03:18.199 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-26T12:03:18.292 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 33/131 2024-04-26T12:03:18.327 INFO:teuthology.orchestra.run.smithi154.stdout:(29/127): ceph-test-18.2.2-1256.gdc093b5e.el9.x 11 MB/s | 40 MB 00:03 2024-04-26T12:03:18.330 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-26T12:03:18.330 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-26T12:03:18.346 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 34/131 2024-04-26T12:03:18.419 INFO:teuthology.orchestra.run.smithi154.stdout:(30/127): librgw2-18.2.2-1256.gdc093b5e.el9.x86 1.7 MB/s | 4.5 MB 00:02 2024-04-26T12:03:18.445 INFO:teuthology.orchestra.run.smithi154.stdout:(31/127): ceph-mgr-modules-core-18.2.2-1256.gdc 2.1 MB/s | 246 kB 00:00 2024-04-26T12:03:18.457 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : re2-1:20211101-3.el9.x86_64 35/131 2024-04-26T12:03:18.491 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 36/131 2024-04-26T12:03:18.537 INFO:teuthology.orchestra.run.smithi154.stdout:(32/127): ceph-mgr-diskprediction-local-18.2.2- 7.3 MB/s | 7.4 MB 00:01 2024-04-26T12:03:18.546 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 37/131 2024-04-26T12:03:18.562 INFO:teuthology.orchestra.run.smithi154.stdout:(33/127): ceph-prometheus-alerts-18.2.2-1256.gd 131 kB/s | 15 kB 00:00 2024-04-26T12:03:18.587 INFO:teuthology.orchestra.run.smithi154.stdout:(34/127): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 294 kB/s | 49 kB 00:00 2024-04-26T12:03:18.612 INFO:teuthology.orchestra.run.smithi154.stdout:(35/127): ceph-volume-18.2.2-1256.gdc093b5e.el9 3.4 MB/s | 264 kB 00:00 2024-04-26T12:03:18.621 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 38/131 2024-04-26T12:03:18.636 INFO:teuthology.orchestra.run.smithi143.stdout:(7/127): ceph-mon-18.2.2-1256.gdc093b5e.el9.x86 2.6 MB/s | 4.7 MB 00:01 2024-04-26T12:03:18.658 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 39/131 2024-04-26T12:03:18.662 INFO:teuthology.orchestra.run.smithi154.stdout:(36/127): cephadm-18.2.2-1256.gdc093b5e.el9.noa 2.2 MB/s | 224 kB 00:00 2024-04-26T12:03:18.695 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 40/131 2024-04-26T12:03:18.730 INFO:teuthology.orchestra.run.smithi154.stdout:(37/127): fuse-2.9.9-15.el9.x86_64.rpm 566 kB/s | 80 kB 00:00 2024-04-26T12:03:18.742 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 41/131 2024-04-26T12:03:18.755 INFO:teuthology.orchestra.run.smithi154.stdout:(38/127): libquadmath-11.4.1-3.el9.x86_64.rpm 3.0 MB/s | 195 kB 00:00 2024-04-26T12:03:18.780 INFO:teuthology.orchestra.run.smithi154.stdout:(39/127): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-04-26T12:03:18.787 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 42/131 2024-04-26T12:03:18.822 INFO:teuthology.orchestra.run.smithi154.stdout:(40/127): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-04-26T12:03:18.829 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 43/131 2024-04-26T12:03:18.847 INFO:teuthology.orchestra.run.smithi154.stdout:(41/127): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-26T12:03:18.872 INFO:teuthology.orchestra.run.smithi154.stdout:(42/127): libgfortran-11.4.1-3.el9.x86_64.rpm 3.4 MB/s | 803 kB 00:00 2024-04-26T12:03:18.898 INFO:teuthology.orchestra.run.smithi154.stdout:(43/127): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-04-26T12:03:18.923 INFO:teuthology.orchestra.run.smithi154.stdout:(44/127): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-04-26T12:03:18.949 INFO:teuthology.orchestra.run.smithi154.stdout:(45/127): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-26T12:03:18.972 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 44/131 2024-04-26T12:03:18.982 INFO:teuthology.orchestra.run.smithi154.stdout:(46/127): automake-1.16.2-8.el9.noarch.rpm 8.1 MB/s | 689 kB 00:00 2024-04-26T12:03:19.014 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 45/131 2024-04-26T12:03:19.018 INFO:teuthology.orchestra.run.smithi154.stdout:(47/127): bison-3.7.4-5.el9.x86_64.rpm 10 MB/s | 943 kB 00:00 2024-04-26T12:03:19.043 INFO:teuthology.orchestra.run.smithi154.stdout:(48/127): elfutils-libelf-devel-0.190-2.el9.x86 366 kB/s | 21 kB 00:00 2024-04-26T12:03:19.056 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 46/131 2024-04-26T12:03:19.068 INFO:teuthology.orchestra.run.smithi154.stdout:(49/127): boost-program-options-1.75.0-8.el9.x8 1.2 MB/s | 107 kB 00:00 2024-04-26T12:03:19.093 INFO:teuthology.orchestra.run.smithi154.stdout:(50/127): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-04-26T12:03:19.119 INFO:teuthology.orchestra.run.smithi154.stdout:(51/127): flexiblas-3.0.4-8.el9.x86_64.rpm 439 kB/s | 33 kB 00:00 2024-04-26T12:03:19.144 INFO:teuthology.orchestra.run.smithi154.stdout:(52/127): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-04-26T12:03:19.161 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 47/131 2024-04-26T12:03:19.169 INFO:teuthology.orchestra.run.smithi154.stdout:(53/127): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-04-26T12:03:19.197 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 48/131 2024-04-26T12:03:19.220 INFO:teuthology.orchestra.run.smithi154.stdout:(54/127): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-04-26T12:03:19.237 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 49/131 2024-04-26T12:03:19.245 INFO:teuthology.orchestra.run.smithi154.stdout:(55/127): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-04-26T12:03:19.263 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 50/131 2024-04-26T12:03:19.270 INFO:teuthology.orchestra.run.smithi154.stdout:(56/127): librabbitmq-0.11.0-7.el9.x86_64.rpm 463 kB/s | 45 kB 00:00 2024-04-26T12:03:19.290 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 51/131 2024-04-26T12:03:19.303 INFO:teuthology.orchestra.run.smithi154.stdout:(57/127): libtool-2.4.6-45.el9.x86_64.rpm 9.8 MB/s | 582 kB 00:00 2024-04-26T12:03:19.323 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : fmt-8.1.1-5.el9.x86_64 52/131 2024-04-26T12:03:19.337 INFO:teuthology.orchestra.run.smithi154.stdout:(58/127): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-04-26T12:03:19.351 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 53/131 2024-04-26T12:03:19.377 INFO:teuthology.orchestra.run.smithi154.stdout:(59/127): libuuid-devel-2.37.4-18.el9.x86_64.rp 239 kB/s | 25 kB 00:00 2024-04-26T12:03:19.388 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 54/131 2024-04-26T12:03:19.404 INFO:teuthology.orchestra.run.smithi154.stdout:(60/127): libzstd-devel-1.5.1-2.el9.x86_64.rpm 474 kB/s | 47 kB 00:00 2024-04-26T12:03:19.418 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 55/131 2024-04-26T12:03:19.429 INFO:teuthology.orchestra.run.smithi154.stdout:(61/127): openblas-0.3.21-2.el9.x86_64.rpm 680 kB/s | 35 kB 00:00 2024-04-26T12:03:19.452 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 56/131 2024-04-26T12:03:19.455 INFO:teuthology.orchestra.run.smithi154.stdout:(62/127): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 292 kB 00:00 2024-04-26T12:03:19.486 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 57/131 2024-04-26T12:03:19.519 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 58/131 2024-04-26T12:03:19.554 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 59/131 2024-04-26T12:03:19.589 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 60/131 2024-04-26T12:03:19.622 INFO:teuthology.orchestra.run.smithi154.stdout:(63/127): python3-babel-2.9.1-2.el9.noarch.rpm 36 MB/s | 6.0 MB 00:00 2024-04-26T12:03:19.639 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 61/131 2024-04-26T12:03:19.697 INFO:teuthology.orchestra.run.smithi154.stdout:(64/127): openblas-openmp-0.3.21-2.el9.x86_64.r 16 MB/s | 4.7 MB 00:00 2024-04-26T12:03:19.746 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-packaging-20.9-5.el9.noarch 62/131 2024-04-26T12:03:19.764 INFO:teuthology.orchestra.run.smithi154.stdout:(65/127): openssl-devel-3.2.1-1.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-04-26T12:03:19.790 INFO:teuthology.orchestra.run.smithi154.stdout:(66/127): python3-devel-3.9.18-3.el9.x86_64.rpm 1.5 MB/s | 244 kB 00:00 2024-04-26T12:03:19.799 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 63/131 2024-04-26T12:03:19.814 INFO:teuthology.orchestra.run.smithi154.stdout:(67/127): python3-jinja2-2.11.3-5.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-04-26T12:03:19.820 INFO:teuthology.orchestra.run.smithi143.stdout:(8/127): ceph-osd-18.2.2-1256.gdc093b5e.el9.x86 6.2 MB/s | 17 MB 00:02 2024-04-26T12:03:19.839 INFO:teuthology.orchestra.run.smithi154.stdout:(68/127): python3-jsonpatch-1.21-16.el9.noarch. 515 kB/s | 26 kB 00:00 2024-04-26T12:03:19.843 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-26T12:03:19.844 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-26T12:03:19.865 INFO:teuthology.orchestra.run.smithi154.stdout:(69/127): python3-jsonpointer-2.0-4.el9.noarch. 255 kB/s | 19 kB 00:00 2024-04-26T12:03:19.878 INFO:teuthology.orchestra.run.smithi143.stdout:(9/127): ceph-selinux-18.2.2-1256.gdc093b5e.el9 432 kB/s | 25 kB 00:00 2024-04-26T12:03:19.890 INFO:teuthology.orchestra.run.smithi154.stdout:(70/127): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-04-26T12:03:19.916 INFO:teuthology.orchestra.run.smithi154.stdout:(71/127): python3-markupsafe-1.1.1-12.el9.x86_6 698 kB/s | 35 kB 00:00 2024-04-26T12:03:19.949 INFO:teuthology.orchestra.run.smithi154.stdout:(72/127): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.3 MB/s | 250 kB 00:00 2024-04-26T12:03:19.974 INFO:teuthology.orchestra.run.smithi154.stdout:(73/127): python3-oauthlib-3.1.1-5.el9.noarch.r 3.8 MB/s | 222 kB 00:00 2024-04-26T12:03:20.041 INFO:teuthology.orchestra.run.smithi154.stdout:(74/127): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 5.1 MB 00:00 2024-04-26T12:03:20.066 INFO:teuthology.orchestra.run.smithi154.stdout:(75/127): python3-packaging-20.9-5.el9.noarch.r 675 kB/s | 77 kB 00:00 2024-04-26T12:03:20.092 INFO:teuthology.orchestra.run.smithi154.stdout:(76/127): python3-prettytable-0.7.2-27.el9.noar 368 kB/s | 42 kB 00:00 2024-04-26T12:03:20.117 INFO:teuthology.orchestra.run.smithi154.stdout:(77/127): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-26T12:03:20.137 INFO:teuthology.orchestra.run.smithi143.stdout:(10/127): ceph-radosgw-18.2.2-1256.gdc093b5e.el 5.1 MB/s | 7.7 MB 00:01 2024-04-26T12:03:20.142 INFO:teuthology.orchestra.run.smithi154.stdout:(78/127): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-04-26T12:03:20.159 INFO:teuthology.orchestra.run.smithi154.stdout:(79/127): python3-pytz-2021.1-5.el9.noarch.rpm 760 kB/s | 51 kB 00:00 2024-04-26T12:03:20.187 INFO:teuthology.orchestra.run.smithi143.stdout:(11/127): libcephfs-devel-18.2.2-1256.gdc093b5e 625 kB/s | 31 kB 00:00 2024-04-26T12:03:20.209 INFO:teuthology.orchestra.run.smithi154.stdout:(80/127): python3-requests-oauthlib-1.3.0-12.el 800 kB/s | 54 kB 00:00 2024-04-26T12:03:20.329 INFO:teuthology.orchestra.run.smithi143.stdout:(12/127): libcephfs2-18.2.2-1256.gdc093b5e.el9. 4.9 MB/s | 710 kB 00:00 2024-04-26T12:03:20.405 INFO:teuthology.orchestra.run.smithi143.stdout:(13/127): libcephsqlite-18.2.2-1256.gdc093b5e.e 2.2 MB/s | 166 kB 00:00 2024-04-26T12:03:20.451 INFO:teuthology.orchestra.run.smithi154.stdout:(81/127): python3-toml-0.10.2-6.el9.noarch.rpm 143 kB/s | 42 kB 00:00 2024-04-26T12:03:20.463 INFO:teuthology.orchestra.run.smithi143.stdout:(14/127): librados-devel-18.2.2-1256.gdc093b5e. 2.1 MB/s | 126 kB 00:00 2024-04-26T12:03:20.560 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 64/131 2024-04-26T12:03:20.613 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 65/131 2024-04-26T12:03:20.646 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 66/131 2024-04-26T12:03:20.660 INFO:teuthology.orchestra.run.smithi154.stdout:(82/127): socat-1.7.4.1-5.el9.x86_64.rpm 677 kB/s | 305 kB 00:00 2024-04-26T12:03:20.680 INFO:teuthology.orchestra.run.smithi143.stdout:(15/127): ceph-common-18.2.2-1256.gdc093b5e.el9 2.8 MB/s | 18 MB 00:06 2024-04-26T12:03:20.706 INFO:teuthology.orchestra.run.smithi143.stdout:(16/127): libradosstriper1-18.2.2-1256.gdc093b5 1.9 MB/s | 474 kB 00:00 2024-04-26T12:03:20.747 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 67/131 2024-04-26T12:03:20.750 INFO:teuthology.orchestra.run.smithi143.stdout:(17/127): python3-ceph-argparse-18.2.2-1256.gdc 1.0 MB/s | 45 kB 00:00 2024-04-26T12:03:20.777 INFO:teuthology.orchestra.run.smithi154.stdout:(83/127): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 289 kB/s | 94 kB 00:00 2024-04-26T12:03:20.788 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 68/131 2024-04-26T12:03:20.801 INFO:teuthology.orchestra.run.smithi143.stdout:(18/127): python3-ceph-common-18.2.2-1256.gdc09 2.5 MB/s | 129 kB 00:00 2024-04-26T12:03:20.876 INFO:teuthology.orchestra.run.smithi143.stdout:(19/127): python3-cephfs-18.2.2-1256.gdc093b5e. 2.1 MB/s | 162 kB 00:00 2024-04-26T12:03:20.961 INFO:teuthology.orchestra.run.smithi154.stdout:(84/127): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-04-26T12:03:20.968 INFO:teuthology.orchestra.run.smithi143.stdout:(20/127): python3-rados-18.2.2-1256.gdc093b5e.e 3.4 MB/s | 320 kB 00:00 2024-04-26T12:03:20.973 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-0.3.21-2.el9.x86_64 69/131 2024-04-26T12:03:20.986 INFO:teuthology.orchestra.run.smithi154.stdout:(85/127): xmlstarlet-1.6.1-20.el9.x86_64.rpm 197 kB/s | 64 kB 00:00 2024-04-26T12:03:21.002 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 70/131 2024-04-26T12:03:21.011 INFO:teuthology.orchestra.run.smithi154.stdout:(86/127): zlib-devel-1.2.11-41.el9.x86_64.rpm 194 kB/s | 45 kB 00:00 2024-04-26T12:03:21.051 INFO:teuthology.orchestra.run.smithi143.stdout:(21/127): python3-rbd-18.2.2-1256.gdc093b5e.el9 3.5 MB/s | 298 kB 00:00 2024-04-26T12:03:21.082 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 71/131 2024-04-26T12:03:21.110 INFO:teuthology.orchestra.run.smithi143.stdout:(22/127): python3-rgw-18.2.2-1256.gdc093b5e.el9 1.7 MB/s | 99 kB 00:00 2024-04-26T12:03:21.169 INFO:teuthology.orchestra.run.smithi143.stdout:(23/127): rbd-fuse-18.2.2-1256.gdc093b5e.el9.x8 1.5 MB/s | 87 kB 00:00 2024-04-26T12:03:21.402 INFO:teuthology.orchestra.run.smithi143.stdout:(24/127): librgw2-18.2.2-1256.gdc093b5e.el9.x86 6.2 MB/s | 4.5 MB 00:00 2024-04-26T12:03:21.403 INFO:teuthology.orchestra.run.smithi154.stdout:(87/127): fmt-8.1.1-5.el9.x86_64.rpm 251 kB/s | 111 kB 00:00 2024-04-26T12:03:21.429 INFO:teuthology.orchestra.run.smithi154.stdout:(88/127): gperftools-libs-2.9.1-2.el9.x86_64.rp 741 kB/s | 309 kB 00:00 2024-04-26T12:03:21.452 INFO:teuthology.orchestra.run.smithi143.stdout:(25/127): rbd-nbd-18.2.2-1256.gdc093b5e.el9.x86 3.4 MB/s | 172 kB 00:00 2024-04-26T12:03:21.478 INFO:teuthology.orchestra.run.smithi154.stdout:(89/127): libarrow-doc-9.0.0-11.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2024-04-26T12:03:21.486 INFO:teuthology.orchestra.run.smithi143.stdout:(26/127): ceph-grafana-dashboards-18.2.2-1256.g 734 kB/s | 24 kB 00:00 2024-04-26T12:03:21.505 INFO:teuthology.orchestra.run.smithi154.stdout:(90/127): liboath-2.6.7-2.el9.x86_64.rpm 645 kB/s | 49 kB 00:00 2024-04-26T12:03:21.536 INFO:teuthology.orchestra.run.smithi143.stdout:(27/127): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 2.7 MB/s | 138 kB 00:00 2024-04-26T12:03:21.571 INFO:teuthology.orchestra.run.smithi154.stdout:(91/127): libunwind-1.6.2-1.el9.x86_64.rpm 732 kB/s | 67 kB 00:00 2024-04-26T12:03:21.687 INFO:teuthology.orchestra.run.smithi154.stdout:(92/127): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.5 MB/s | 839 kB 00:00 2024-04-26T12:03:21.720 INFO:teuthology.orchestra.run.smithi143.stdout:(28/127): rbd-mirror-18.2.2-1256.gdc093b5e.el9. 5.4 MB/s | 3.0 MB 00:00 2024-04-26T12:03:21.758 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 72/131 2024-04-26T12:03:21.763 INFO:teuthology.orchestra.run.smithi154.stdout:(93/127): libarrow-9.0.0-11.el9.x86_64.rpm 5.9 MB/s | 4.4 MB 00:00 2024-04-26T12:03:21.788 INFO:teuthology.orchestra.run.smithi154.stdout:(94/127): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 433 kB/s | 43 kB 00:00 2024-04-26T12:03:21.813 INFO:teuthology.orchestra.run.smithi154.stdout:(95/127): python3-asyncssh-2.13.2-5.el9.noarch. 2.2 MB/s | 548 kB 00:00 2024-04-26T12:03:21.838 INFO:teuthology.orchestra.run.smithi154.stdout:(96/127): python3-cachetools-4.2.4-1.el9.noarch 427 kB/s | 32 kB 00:00 2024-04-26T12:03:21.864 INFO:teuthology.orchestra.run.smithi154.stdout:(97/127): python3-certifi-2021.10.8-2.el9.noarc 199 kB/s | 15 kB 00:00 2024-04-26T12:03:21.871 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 73/131 2024-04-26T12:03:21.897 INFO:teuthology.orchestra.run.smithi154.stdout:(98/127): python3-cheroot-8.6.0-4.el9.noarch.rp 2.0 MB/s | 172 kB 00:00 2024-04-26T12:03:21.923 INFO:teuthology.orchestra.run.smithi154.stdout:(99/127): python3-cherrypy-18.6.1-2.el9.noarch. 4.2 MB/s | 358 kB 00:00 2024-04-26T12:03:21.948 INFO:teuthology.orchestra.run.smithi154.stdout:(100/127): python3-google-auth-2.29.0-1.el9.noa 2.4 MB/s | 206 kB 00:00 2024-04-26T12:03:21.973 INFO:teuthology.orchestra.run.smithi154.stdout:(101/127): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-04-26T12:03:21.998 INFO:teuthology.orchestra.run.smithi154.stdout:(102/127): python3-jaraco-classes-3.2.1-5.el9.n 234 kB/s | 18 kB 00:00 2024-04-26T12:03:22.024 INFO:teuthology.orchestra.run.smithi154.stdout:(103/127): python3-jaraco-collections-3.0.0-8.e 306 kB/s | 23 kB 00:00 2024-04-26T12:03:22.049 INFO:teuthology.orchestra.run.smithi154.stdout:(104/127): python3-jaraco-functools-3.5.0-2.el9 257 kB/s | 19 kB 00:00 2024-04-26T12:03:22.062 INFO:teuthology.orchestra.run.smithi143.stdout:(29/127): ceph-mgr-dashboard-18.2.2-1256.gdc093 6.7 MB/s | 3.5 MB 00:00 2024-04-26T12:03:22.074 INFO:teuthology.orchestra.run.smithi154.stdout:(105/127): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-04-26T12:03:22.125 INFO:teuthology.orchestra.run.smithi154.stdout:(106/127): python3-logutils-0.3.5-21.el9.noarch 616 kB/s | 46 kB 00:00 2024-04-26T12:03:22.130 INFO:teuthology.orchestra.run.smithi143.stdout:(30/127): ceph-mgr-modules-core-18.2.2-1256.gdc 3.6 MB/s | 246 kB 00:00 2024-04-26T12:03:22.150 INFO:teuthology.orchestra.run.smithi154.stdout:(107/127): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-04-26T12:03:22.188 INFO:teuthology.orchestra.run.smithi143.stdout:(31/127): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 844 kB/s | 49 kB 00:00 2024-04-26T12:03:22.192 INFO:teuthology.orchestra.run.smithi154.stdout:(108/127): python3-natsort-7.1.1-5.el9.noarch.r 865 kB/s | 58 kB 00:00 2024-04-26T12:03:22.226 INFO:teuthology.orchestra.run.smithi154.stdout:(109/127): python3-kubernetes-26.1.0-2.el9.noar 5.1 MB/s | 1.0 MB 00:00 2024-04-26T12:03:22.238 INFO:teuthology.orchestra.run.smithi143.stdout:(32/127): ceph-prometheus-alerts-18.2.2-1256.gd 308 kB/s | 15 kB 00:00 2024-04-26T12:03:22.251 INFO:teuthology.orchestra.run.smithi154.stdout:(110/127): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-04-26T12:03:22.276 INFO:teuthology.orchestra.run.smithi154.stdout:(111/127): python3-portend-3.1.0-2.el9.noarch.r 195 kB/s | 16 kB 00:00 2024-04-26T12:03:22.302 INFO:teuthology.orchestra.run.smithi154.stdout:(112/127): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-04-26T12:03:22.313 INFO:teuthology.orchestra.run.smithi143.stdout:(33/127): ceph-volume-18.2.2-1256.gdc093b5e.el9 3.4 MB/s | 264 kB 00:00 2024-04-26T12:03:22.327 INFO:teuthology.orchestra.run.smithi154.stdout:(113/127): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-04-26T12:03:22.352 INFO:teuthology.orchestra.run.smithi154.stdout:(114/127): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-26T12:03:22.377 INFO:teuthology.orchestra.run.smithi154.stdout:(115/127): python3-rsa-4.9-2.el9.noarch.rpm 783 kB/s | 59 kB 00:00 2024-04-26T12:03:22.389 INFO:teuthology.orchestra.run.smithi143.stdout:(34/127): cephadm-18.2.2-1256.gdc093b5e.el9.noa 2.9 MB/s | 224 kB 00:00 2024-04-26T12:03:22.403 INFO:teuthology.orchestra.run.smithi154.stdout:(116/127): python3-tempora-5.0.0-2.el9.noarch.r 474 kB/s | 36 kB 00:00 2024-04-26T12:03:22.428 INFO:teuthology.orchestra.run.smithi154.stdout:(117/127): python3-typing-extensions-4.4.0-2.el 677 kB/s | 51 kB 00:00 2024-04-26T12:03:22.453 INFO:teuthology.orchestra.run.smithi154.stdout:(118/127): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-26T12:03:22.478 INFO:teuthology.orchestra.run.smithi154.stdout:(119/127): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-26T12:03:22.489 INFO:teuthology.orchestra.run.smithi143.stdout:(35/127): fuse-2.9.9-15.el9.x86_64.rpm 803 kB/s | 80 kB 00:00 2024-04-26T12:03:22.504 INFO:teuthology.orchestra.run.smithi154.stdout:(120/127): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-04-26T12:03:22.521 INFO:teuthology.orchestra.run.smithi154.stdout:(121/127): python3-zc-lockfile-2.0-10.el9.noarc 297 kB/s | 20 kB 00:00 2024-04-26T12:03:22.554 INFO:teuthology.orchestra.run.smithi154.stdout:(122/127): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-04-26T12:03:22.564 INFO:teuthology.orchestra.run.smithi143.stdout:(36/127): libgfortran-11.4.1-3.el9.x86_64.rpm 10 MB/s | 803 kB 00:00 2024-04-26T12:03:22.598 INFO:teuthology.orchestra.run.smithi143.stdout:(37/127): libquadmath-11.4.1-3.el9.x86_64.rpm 5.8 MB/s | 195 kB 00:00 2024-04-26T12:03:22.605 INFO:teuthology.orchestra.run.smithi154.stdout:(123/127): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-04-26T12:03:22.632 INFO:teuthology.orchestra.run.smithi143.stdout:(38/127): python3-cffi-1.14.5-5.el9.x86_64.rpm 7.4 MB/s | 253 kB 00:00 2024-04-26T12:03:22.672 INFO:teuthology.orchestra.run.smithi154.stdout:(124/127): openssl-3.2.1-1.el9.x86_64.rpm 20 MB/s | 1.3 MB 00:00 2024-04-26T12:03:22.690 INFO:teuthology.orchestra.run.smithi143.stdout:(39/127): python3-cryptography-36.0.1-4.el9.x86 21 MB/s | 1.2 MB 00:00 2024-04-26T12:03:22.741 INFO:teuthology.orchestra.run.smithi143.stdout:(40/127): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-04-26T12:03:22.764 INFO:teuthology.orchestra.run.smithi154.stdout:(125/127): openssl-libs-3.2.1-1.el9.x86_64.rpm 26 MB/s | 2.4 MB 00:00 2024-04-26T12:03:22.774 INFO:teuthology.orchestra.run.smithi143.stdout:(41/127): python3-pycparser-2.20-6.el9.noarch.r 4.0 MB/s | 135 kB 00:00 2024-04-26T12:03:22.808 INFO:teuthology.orchestra.run.smithi143.stdout:(42/127): python3-requests-2.25.1-8.el9.noarch. 3.6 MB/s | 125 kB 00:00 2024-04-26T12:03:22.892 INFO:teuthology.orchestra.run.smithi143.stdout:(43/127): ceph-mgr-diskprediction-local-18.2.2- 6.3 MB/s | 7.4 MB 00:01 2024-04-26T12:03:22.917 INFO:teuthology.orchestra.run.smithi143.stdout:(44/127): python3-urllib3-1.26.5-5.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-04-26T12:03:22.922 INFO:teuthology.orchestra.run.smithi154.stdout:(126/127): librados2-18.2.2-1256.gdc093b5e.el9. 8.2 MB/s | 3.3 MB 00:00 2024-04-26T12:03:22.942 INFO:teuthology.orchestra.run.smithi143.stdout:(45/127): automake-1.16.2-8.el9.noarch.rpm 14 MB/s | 689 kB 00:00 2024-04-26T12:03:22.976 INFO:teuthology.orchestra.run.smithi143.stdout:(46/127): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 943 kB 00:00 2024-04-26T12:03:23.002 INFO:teuthology.orchestra.run.smithi143.stdout:(47/127): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-04-26T12:03:23.019 INFO:teuthology.orchestra.run.smithi143.stdout:(48/127): elfutils-libelf-devel-0.190-2.el9.x86 513 kB/s | 21 kB 00:00 2024-04-26T12:03:23.044 INFO:teuthology.orchestra.run.smithi143.stdout:(49/127): flex-2.6.4-9.el9.x86_64.rpm 7.3 MB/s | 313 kB 00:00 2024-04-26T12:03:23.061 INFO:teuthology.orchestra.run.smithi143.stdout:(50/127): flexiblas-3.0.4-8.el9.x86_64.rpm 796 kB/s | 33 kB 00:00 2024-04-26T12:03:23.128 INFO:teuthology.orchestra.run.smithi143.stdout:(51/127): flexiblas-netlib-3.0.4-8.el9.x86_64.r 36 MB/s | 3.0 MB 00:00 2024-04-26T12:03:23.145 INFO:teuthology.orchestra.run.smithi143.stdout:(52/127): flexiblas-openblas-openmp-3.0.4-8.el9 222 kB/s | 18 kB 00:00 2024-04-26T12:03:23.160 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/131 2024-04-26T12:03:23.162 INFO:teuthology.orchestra.run.smithi143.stdout:(53/127): libaio-devel-0.3.111-13.el9.x86_64.rp 334 kB/s | 11 kB 00:00 2024-04-26T12:03:23.187 INFO:teuthology.orchestra.run.smithi143.stdout:(54/127): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 160 kB 00:00 2024-04-26T12:03:23.204 INFO:teuthology.orchestra.run.smithi143.stdout:(55/127): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-04-26T12:03:23.229 INFO:teuthology.orchestra.run.smithi143.stdout:(56/127): librdkafka-1.6.1-102.el9.x86_64.rpm 15 MB/s | 662 kB 00:00 2024-04-26T12:03:23.240 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 75/131 2024-04-26T12:03:23.255 INFO:teuthology.orchestra.run.smithi143.stdout:(57/127): libtool-2.4.6-45.el9.x86_64.rpm 12 MB/s | 582 kB 00:00 2024-04-26T12:03:23.268 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 76/131 2024-04-26T12:03:23.280 INFO:teuthology.orchestra.run.smithi143.stdout:(58/127): libuuid-devel-2.37.4-18.el9.x86_64.rp 518 kB/s | 25 kB 00:00 2024-04-26T12:03:23.305 INFO:teuthology.orchestra.run.smithi143.stdout:(59/127): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-04-26T12:03:23.323 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 77/131 2024-04-26T12:03:23.339 INFO:teuthology.orchestra.run.smithi143.stdout:(60/127): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-04-26T12:03:23.364 INFO:teuthology.orchestra.run.smithi143.stdout:(61/127): openblas-0.3.21-2.el9.x86_64.rpm 609 kB/s | 35 kB 00:00 2024-04-26T12:03:23.456 INFO:teuthology.orchestra.run.smithi143.stdout:(62/127): openblas-openmp-0.3.21-2.el9.x86_64.r 41 MB/s | 4.7 MB 00:00 2024-04-26T12:03:23.532 INFO:teuthology.orchestra.run.smithi143.stdout:(63/127): openssl-devel-3.2.1-1.el9.x86_64.rpm 27 MB/s | 4.4 MB 00:00 2024-04-26T12:03:23.640 INFO:teuthology.orchestra.run.smithi143.stdout:(64/127): python3-babel-2.9.1-2.el9.noarch.rpm 33 MB/s | 6.0 MB 00:00 2024-04-26T12:03:23.641 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 78/131 2024-04-26T12:03:23.655 INFO:teuthology.orchestra.run.smithi154.stdout:(127/127): librbd1-18.2.2-1256.gdc093b5e.el9.x8 2.7 MB/s | 3.0 MB 00:01 2024-04-26T12:03:23.664 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:03:23.664 INFO:teuthology.orchestra.run.smithi154.stdout:Total 16 MB/s | 189 MB 00:11 2024-04-26T12:03:23.665 INFO:teuthology.orchestra.run.smithi143.stdout:(65/127): python3-devel-3.9.18-3.el9.x86_64.rpm 1.8 MB/s | 244 kB 00:00 2024-04-26T12:03:23.689 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 79/131 2024-04-26T12:03:23.691 INFO:teuthology.orchestra.run.smithi143.stdout:(66/127): python3-jinja2-2.11.3-5.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-04-26T12:03:23.716 INFO:teuthology.orchestra.run.smithi143.stdout:(67/127): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-04-26T12:03:23.767 INFO:teuthology.orchestra.run.smithi143.stdout:(68/127): python3-jsonpointer-2.0-4.el9.noarch. 253 kB/s | 19 kB 00:00 2024-04-26T12:03:23.779 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 79/131 2024-04-26T12:03:23.792 INFO:teuthology.orchestra.run.smithi143.stdout:(69/127): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-04-26T12:03:23.810 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 80/131 2024-04-26T12:03:23.817 INFO:teuthology.orchestra.run.smithi143.stdout:(70/127): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-04-26T12:03:23.846 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 81/131 2024-04-26T12:03:23.926 INFO:teuthology.orchestra.run.smithi143.stdout:(71/127): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 5.1 MB 00:00 2024-04-26T12:03:23.951 INFO:teuthology.orchestra.run.smithi143.stdout:(72/127): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.9 MB/s | 250 kB 00:00 2024-04-26T12:03:23.977 INFO:teuthology.orchestra.run.smithi143.stdout:(73/127): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-04-26T12:03:24.002 INFO:teuthology.orchestra.run.smithi143.stdout:(74/127): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-26T12:03:24.027 INFO:teuthology.orchestra.run.smithi143.stdout:(75/127): python3-prettytable-0.7.2-27.el9.noar 846 kB/s | 42 kB 00:00 2024-04-26T12:03:24.053 INFO:teuthology.orchestra.run.smithi143.stdout:(76/127): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-26T12:03:24.078 INFO:teuthology.orchestra.run.smithi143.stdout:(77/127): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-04-26T12:03:24.095 INFO:teuthology.orchestra.run.smithi143.stdout:(78/127): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-04-26T12:03:24.112 INFO:teuthology.orchestra.run.smithi143.stdout:(79/127): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-04-26T12:03:24.237 INFO:teuthology.orchestra.run.smithi143.stdout:(80/127): python3-toml-0.10.2-6.el9.noarch.rpm 337 kB/s | 42 kB 00:00 2024-04-26T12:03:24.271 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 82/131 2024-04-26T12:03:24.300 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 83/131 2024-04-26T12:03:24.354 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 83/131 2024-04-26T12:03:24.385 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 84/131 2024-04-26T12:03:24.421 INFO:teuthology.orchestra.run.smithi143.stdout:(81/127): python3-scipy-1.6.2-8.el9.x86_64.rpm 50 MB/s | 16 MB 00:00 2024-04-26T12:03:24.446 INFO:teuthology.orchestra.run.smithi143.stdout:(82/127): socat-1.7.4.1-5.el9.x86_64.rpm 1.4 MB/s | 305 kB 00:00 2024-04-26T12:03:24.472 INFO:teuthology.orchestra.run.smithi143.stdout:(83/127): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-04-26T12:03:24.488 INFO:teuthology.orchestra.run.smithi143.stdout:(84/127): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-04-26T12:03:24.505 INFO:teuthology.orchestra.run.smithi143.stdout:(85/127): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-04-26T12:03:24.521 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-04-26T12:03:24.653 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-04-26T12:03:24.653 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-04-26T12:03:24.850 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-26T12:03:24.941 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/131 2024-04-26T12:03:25.021 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/131 2024-04-26T12:03:25.074 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/131 2024-04-26T12:03:25.117 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/131 2024-04-26T12:03:25.139 INFO:teuthology.orchestra.run.smithi143.stdout:(86/127): ceph-test-18.2.2-1256.gdc093b5e.el9.x 7.5 MB/s | 40 MB 00:05 2024-04-26T12:03:25.142 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/131 2024-04-26T12:03:25.164 INFO:teuthology.orchestra.run.smithi143.stdout:(87/127): fmt-8.1.1-5.el9.x86_64.rpm 164 kB/s | 111 kB 00:00 2024-04-26T12:03:25.185 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/131 2024-04-26T12:03:25.298 INFO:teuthology.orchestra.run.smithi143.stdout:(88/127): gperftools-libs-2.9.1-2.el9.x86_64.rp 390 kB/s | 309 kB 00:00 2024-04-26T12:03:25.323 INFO:teuthology.orchestra.run.smithi143.stdout:(89/127): libarrow-doc-9.0.0-11.el9.noarch.rpm 164 kB/s | 26 kB 00:00 2024-04-26T12:03:25.382 INFO:teuthology.orchestra.run.smithi143.stdout:(90/127): liboath-2.6.7-2.el9.x86_64.rpm 581 kB/s | 49 kB 00:00 2024-04-26T12:03:25.457 INFO:teuthology.orchestra.run.smithi143.stdout:(91/127): libunwind-1.6.2-1.el9.x86_64.rpm 504 kB/s | 67 kB 00:00 2024-04-26T12:03:25.495 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/131 2024-04-26T12:03:25.582 INFO:teuthology.orchestra.run.smithi143.stdout:(92/127): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.1 MB/s | 839 kB 00:00 2024-04-26T12:03:25.593 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T12:03:25.674 INFO:teuthology.orchestra.run.smithi143.stdout:(93/127): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 474 kB/s | 43 kB 00:00 2024-04-26T12:03:25.711 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T12:03:25.736 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T12:03:25.775 INFO:teuthology.orchestra.run.smithi143.stdout:(94/127): libarrow-9.0.0-11.el9.x86_64.rpm 6.9 MB/s | 4.4 MB 00:00 2024-04-26T12:03:25.800 INFO:teuthology.orchestra.run.smithi143.stdout:(95/127): python3-cachetools-4.2.4-1.el9.noarch 256 kB/s | 32 kB 00:00 2024-04-26T12:03:25.826 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T12:03:25.834 INFO:teuthology.orchestra.run.smithi143.stdout:(96/127): python3-asyncssh-2.13.2-5.el9.noarch. 1.4 MB/s | 548 kB 00:00 2024-04-26T12:03:25.867 INFO:teuthology.orchestra.run.smithi143.stdout:(97/127): python3-certifi-2021.10.8-2.el9.noarc 162 kB/s | 15 kB 00:00 2024-04-26T12:03:25.876 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 10/131 2024-04-26T12:03:25.909 INFO:teuthology.orchestra.run.smithi143.stdout:(98/127): python3-cheroot-8.6.0-4.el9.noarch.rp 1.5 MB/s | 172 kB 00:00 2024-04-26T12:03:25.912 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T12:03:26.001 INFO:teuthology.orchestra.run.smithi143.stdout:(99/127): python3-google-auth-2.29.0-1.el9.noar 1.5 MB/s | 206 kB 00:00 2024-04-26T12:03:26.013 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T12:03:26.038 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 12/131 2024-04-26T12:03:26.052 INFO:teuthology.orchestra.run.smithi143.stdout:(100/127): python3-jaraco-8.2.1-3.el9.noarch.rp 75 kB/s | 11 kB 00:00 2024-04-26T12:03:26.077 INFO:teuthology.orchestra.run.smithi143.stdout:(101/127): python3-cherrypy-18.6.1-2.el9.noarch 1.4 MB/s | 358 kB 00:00 2024-04-26T12:03:26.102 INFO:teuthology.orchestra.run.smithi143.stdout:(102/127): python3-jaraco-classes-3.2.1-5.el9.n 176 kB/s | 18 kB 00:00 2024-04-26T12:03:26.152 INFO:teuthology.orchestra.run.smithi143.stdout:(103/127): python3-jaraco-collections-3.0.0-8.e 230 kB/s | 23 kB 00:00 2024-04-26T12:03:26.162 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 12/131 2024-04-26T12:03:26.166 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-04-26T12:03:26.166 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-04-26T12:03:26.178 INFO:teuthology.orchestra.run.smithi143.stdout:(104/127): python3-jaraco-functools-3.5.0-2.el9 193 kB/s | 19 kB 00:00 2024-04-26T12:03:26.203 INFO:teuthology.orchestra.run.smithi143.stdout:(105/127): python3-jaraco-text-3.2.0-6.el9.noar 195 kB/s | 20 kB 00:00 2024-04-26T12:03:26.209 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 13/131 2024-04-26T12:03:26.243 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : liboath-2.6.7-2.el9.x86_64 14/131 2024-04-26T12:03:26.287 INFO:teuthology.orchestra.run.smithi143.stdout:(106/127): python3-logutils-0.3.5-21.el9.noarch 426 kB/s | 46 kB 00:00 2024-04-26T12:03:26.308 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/131 2024-04-26T12:03:26.320 INFO:teuthology.orchestra.run.smithi143.stdout:(107/127): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-04-26T12:03:26.337 INFO:teuthology.orchestra.run.smithi143.stdout:(108/127): python3-more-itertools-8.12.0-2.el9. 589 kB/s | 79 kB 00:00 2024-04-26T12:03:26.342 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 16/131 2024-04-26T12:03:26.370 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 17/131 2024-04-26T12:03:26.387 INFO:teuthology.orchestra.run.smithi143.stdout:(109/127): python3-natsort-7.1.1-5.el9.noarch.r 573 kB/s | 58 kB 00:00 2024-04-26T12:03:26.421 INFO:teuthology.orchestra.run.smithi143.stdout:(110/127): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-04-26T12:03:26.438 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/131 2024-04-26T12:03:26.446 INFO:teuthology.orchestra.run.smithi143.stdout:(111/127): python3-portend-3.1.0-2.el9.noarch.r 150 kB/s | 16 kB 00:00 2024-04-26T12:03:26.472 INFO:teuthology.orchestra.run.smithi143.stdout:(112/127): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-04-26T12:03:26.492 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 19/131 2024-04-26T12:03:26.514 INFO:teuthology.orchestra.run.smithi143.stdout:(113/127): python3-repoze-lru-0.7-16.el9.noarch 333 kB/s | 31 kB 00:00 2024-04-26T12:03:26.518 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T12:03:26.523 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/131 2024-04-26T12:03:26.557 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T12:03:26.558 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 21/131 2024-04-26T12:03:26.564 INFO:teuthology.orchestra.run.smithi143.stdout:(114/127): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-04-26T12:03:26.581 INFO:teuthology.orchestra.run.smithi143.stdout:(115/127): python3-rsa-4.9-2.el9.noarch.rpm 543 kB/s | 59 kB 00:00 2024-04-26T12:03:26.623 INFO:teuthology.orchestra.run.smithi143.stdout:(116/127): python3-tempora-5.0.0-2.el9.noarch.r 328 kB/s | 36 kB 00:00 2024-04-26T12:03:26.632 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 22/131 2024-04-26T12:03:26.656 INFO:teuthology.orchestra.run.smithi143.stdout:(117/127): python3-typing-extensions-4.4.0-2.el 553 kB/s | 51 kB 00:00 2024-04-26T12:03:26.669 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9. 23/131 2024-04-26T12:03:26.713 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 24/131 2024-04-26T12:03:26.724 INFO:teuthology.orchestra.run.smithi143.stdout:(118/127): python3-websocket-client-1.2.3-2.el9 893 kB/s | 90 kB 00:00 2024-04-26T12:03:26.750 INFO:teuthology.orchestra.run.smithi143.stdout:(119/127): python3-webob-1.8.7-6.el9.noarch.rpm 1.3 MB/s | 230 kB 00:00 2024-04-26T12:03:26.774 INFO:teuthology.orchestra.run.smithi143.stdout:(120/127): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-04-26T12:03:26.786 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_6 25/131 2024-04-26T12:03:26.816 INFO:teuthology.orchestra.run.smithi143.stdout:(121/127): python3-zc-lockfile-2.0-10.el9.noarc 217 kB/s | 20 kB 00:00 2024-04-26T12:03:26.916 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/131 2024-04-26T12:03:26.950 INFO:teuthology.orchestra.run.smithi143.stdout:(122/127): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-04-26T12:03:26.963 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 27/131 2024-04-26T12:03:27.106 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T12:03:27.144 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 86/131 2024-04-26T12:03:27.209 INFO:teuthology.orchestra.run.smithi143.stdout:(123/127): re2-20211101-3.el9.x86_64.rpm 417 kB/s | 192 kB 00:00 2024-04-26T12:03:27.240 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 86/131 2024-04-26T12:03:27.240 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T12:03:27.240 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T12:03:27.240 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:03:27.267 INFO:teuthology.orchestra.run.smithi143.stdout:(124/127): openssl-3.2.1-1.el9.x86_64.rpm 23 MB/s | 1.3 MB 00:00 2024-04-26T12:03:27.279 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 87/131 2024-04-26T12:03:27.343 INFO:teuthology.orchestra.run.smithi143.stdout:(125/127): librados2-18.2.2-1256.gdc093b5e.el9. 6.3 MB/s | 3.3 MB 00:00 2024-04-26T12:03:27.393 INFO:teuthology.orchestra.run.smithi143.stdout:(126/127): openssl-libs-3.2.1-1.el9.x86_64.rpm 19 MB/s | 2.4 MB 00:00 2024-04-26T12:03:27.473 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rsa-4.9-2.el9.noarch 28/131 2024-04-26T12:03:27.518 INFO:teuthology.orchestra.run.smithi143.stdout:(127/127): librbd1-18.2.2-1256.gdc093b5e.el9.x8 5.3 MB/s | 3.0 MB 00:00 2024-04-26T12:03:27.522 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:03:27.522 INFO:teuthology.orchestra.run.smithi143.stdout:Total 13 MB/s | 189 MB 00:14 2024-04-26T12:03:27.550 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 29/131 2024-04-26T12:03:27.589 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 30/131 2024-04-26T12:03:27.627 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_6 31/131 2024-04-26T12:03:27.669 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 32/131 2024-04-26T12:03:27.825 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 33/131 2024-04-26T12:03:27.878 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 34/131 2024-04-26T12:03:27.984 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : re2-1:20211101-3.el9.x86_64 35/131 2024-04-26T12:03:28.031 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 36/131 2024-04-26T12:03:28.085 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 37/131 2024-04-26T12:03:28.158 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 38/131 2024-04-26T12:03:28.190 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 39/131 2024-04-26T12:03:28.226 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 40/131 2024-04-26T12:03:28.272 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 41/131 2024-04-26T12:03:28.318 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 42/131 2024-04-26T12:03:28.360 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 43/131 2024-04-26T12:03:28.371 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-04-26T12:03:28.494 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 44/131 2024-04-26T12:03:28.502 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-04-26T12:03:28.502 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-04-26T12:03:28.537 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 45/131 2024-04-26T12:03:28.578 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 46/131 2024-04-26T12:03:28.671 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 47/131 2024-04-26T12:03:28.704 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 48/131 2024-04-26T12:03:28.735 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 49/131 2024-04-26T12:03:28.761 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 50/131 2024-04-26T12:03:28.788 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 51/131 2024-04-26T12:03:28.821 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : fmt-8.1.1-5.el9.x86_64 52/131 2024-04-26T12:03:28.849 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 53/131 2024-04-26T12:03:28.886 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 54/131 2024-04-26T12:03:28.916 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 55/131 2024-04-26T12:03:28.950 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 56/131 2024-04-26T12:03:28.983 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 57/131 2024-04-26T12:03:29.025 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 58/131 2024-04-26T12:03:29.060 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 59/131 2024-04-26T12:03:29.094 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 60/131 2024-04-26T12:03:29.141 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 61/131 2024-04-26T12:03:29.247 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-packaging-20.9-5.el9.noarch 62/131 2024-04-26T12:03:29.296 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 63/131 2024-04-26T12:03:30.007 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 64/131 2024-04-26T12:03:30.015 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-04-26T12:03:30.015 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-04-26T12:03:30.051 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 65/131 2024-04-26T12:03:30.085 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 66/131 2024-04-26T12:03:30.181 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 67/131 2024-04-26T12:03:30.230 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 68/131 2024-04-26T12:03:30.404 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-0.3.21-2.el9.x86_64 69/131 2024-04-26T12:03:30.525 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 70/131 2024-04-26T12:03:30.603 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 71/131 2024-04-26T12:03:31.241 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 72/131 2024-04-26T12:03:31.257 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-04-26T12:03:31.355 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 73/131 2024-04-26T12:03:31.376 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/131 2024-04-26T12:03:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/131 2024-04-26T12:03:31.610 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/131 2024-04-26T12:03:31.643 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/131 2024-04-26T12:03:31.669 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/131 2024-04-26T12:03:31.712 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/131 2024-04-26T12:03:32.031 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/131 2024-04-26T12:03:32.145 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T12:03:32.246 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T12:03:32.273 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T12:03:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T12:03:32.411 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 10/131 2024-04-26T12:03:32.431 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T12:03:32.530 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T12:03:32.557 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 12/131 2024-04-26T12:03:32.581 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/131 2024-04-26T12:03:32.662 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 75/131 2024-04-26T12:03:32.681 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 12/131 2024-04-26T12:03:32.689 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 76/131 2024-04-26T12:03:32.719 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 13/131 2024-04-26T12:03:32.722 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 77/131 2024-04-26T12:03:32.754 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : liboath-2.6.7-2.el9.x86_64 14/131 2024-04-26T12:03:32.820 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/131 2024-04-26T12:03:32.853 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 16/131 2024-04-26T12:03:32.882 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 17/131 2024-04-26T12:03:32.949 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/131 2024-04-26T12:03:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 19/131 2024-04-26T12:03:33.022 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 78/131 2024-04-26T12:03:33.042 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/131 2024-04-26T12:03:33.060 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 79/131 2024-04-26T12:03:33.077 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 21/131 2024-04-26T12:03:33.142 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 79/131 2024-04-26T12:03:33.152 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 22/131 2024-04-26T12:03:33.173 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 80/131 2024-04-26T12:03:33.188 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9. 23/131 2024-04-26T12:03:33.209 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 81/131 2024-04-26T12:03:33.231 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 24/131 2024-04-26T12:03:33.306 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_6 25/131 2024-04-26T12:03:33.438 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/131 2024-04-26T12:03:33.500 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 27/131 2024-04-26T12:03:33.611 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 82/131 2024-04-26T12:03:33.646 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 83/131 2024-04-26T12:03:33.717 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 83/131 2024-04-26T12:03:33.748 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 84/131 2024-04-26T12:03:34.027 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rsa-4.9-2.el9.noarch 28/131 2024-04-26T12:03:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 29/131 2024-04-26T12:03:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 30/131 2024-04-26T12:03:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_6 31/131 2024-04-26T12:03:34.242 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 32/131 2024-04-26T12:03:34.404 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 33/131 2024-04-26T12:03:34.464 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 34/131 2024-04-26T12:03:34.571 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : re2-1:20211101-3.el9.x86_64 35/131 2024-04-26T12:03:34.609 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 36/131 2024-04-26T12:03:34.663 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 37/131 2024-04-26T12:03:34.737 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 38/131 2024-04-26T12:03:34.776 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 39/131 2024-04-26T12:03:34.813 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 40/131 2024-04-26T12:03:34.859 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 41/131 2024-04-26T12:03:34.904 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 42/131 2024-04-26T12:03:34.946 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 43/131 2024-04-26T12:03:35.044 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-04-26T12:03:35.084 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 44/131 2024-04-26T12:03:35.125 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 45/131 2024-04-26T12:03:35.130 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/131 2024-04-26T12:03:35.165 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 46/131 2024-04-26T12:03:35.168 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/131 2024-04-26T12:03:35.221 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/131 2024-04-26T12:03:35.259 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 47/131 2024-04-26T12:03:35.264 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/131 2024-04-26T12:03:35.290 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/131 2024-04-26T12:03:35.299 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 48/131 2024-04-26T12:03:35.334 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/131 2024-04-26T12:03:35.338 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 49/131 2024-04-26T12:03:35.364 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 50/131 2024-04-26T12:03:35.391 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 51/131 2024-04-26T12:03:35.424 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fmt-8.1.1-5.el9.x86_64 52/131 2024-04-26T12:03:35.453 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 53/131 2024-04-26T12:03:35.490 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 54/131 2024-04-26T12:03:35.520 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 55/131 2024-04-26T12:03:35.554 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 56/131 2024-04-26T12:03:35.588 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 57/131 2024-04-26T12:03:35.629 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 58/131 2024-04-26T12:03:35.663 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/131 2024-04-26T12:03:35.664 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 59/131 2024-04-26T12:03:35.699 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 60/131 2024-04-26T12:03:35.746 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 61/131 2024-04-26T12:03:35.783 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T12:03:35.848 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T12:03:35.853 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-packaging-20.9-5.el9.noarch 62/131 2024-04-26T12:03:35.887 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T12:03:35.903 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T12:03:35.909 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 63/131 2024-04-26T12:03:35.934 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T12:03:36.025 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T12:03:36.066 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 10/131 2024-04-26T12:03:36.094 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T12:03:36.196 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T12:03:36.220 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 12/131 2024-04-26T12:03:36.346 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 12/131 2024-04-26T12:03:36.383 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 13/131 2024-04-26T12:03:36.417 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : liboath-2.6.7-2.el9.x86_64 14/131 2024-04-26T12:03:36.442 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T12:03:36.483 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/131 2024-04-26T12:03:36.507 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 86/131 2024-04-26T12:03:36.517 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 16/131 2024-04-26T12:03:36.545 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 17/131 2024-04-26T12:03:36.594 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 86/131 2024-04-26T12:03:36.594 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T12:03:36.594 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T12:03:36.594 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:03:36.613 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/131 2024-04-26T12:03:36.625 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 87/131 2024-04-26T12:03:36.637 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 64/131 2024-04-26T12:03:36.675 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 19/131 2024-04-26T12:03:36.680 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 65/131 2024-04-26T12:03:36.706 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/131 2024-04-26T12:03:36.715 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 66/131 2024-04-26T12:03:36.742 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 21/131 2024-04-26T12:03:36.814 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 67/131 2024-04-26T12:03:36.817 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 22/131 2024-04-26T12:03:36.848 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 68/131 2024-04-26T12:03:36.852 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9. 23/131 2024-04-26T12:03:36.896 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 24/131 2024-04-26T12:03:36.969 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_6 25/131 2024-04-26T12:03:37.028 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-0.3.21-2.el9.x86_64 69/131 2024-04-26T12:03:37.080 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 70/131 2024-04-26T12:03:37.103 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/131 2024-04-26T12:03:37.158 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 71/131 2024-04-26T12:03:37.164 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 27/131 2024-04-26T12:03:37.691 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rsa-4.9-2.el9.noarch 28/131 2024-04-26T12:03:37.768 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 29/131 2024-04-26T12:03:37.801 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 72/131 2024-04-26T12:03:37.815 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 30/131 2024-04-26T12:03:37.853 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_6 31/131 2024-04-26T12:03:37.895 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 32/131 2024-04-26T12:03:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 73/131 2024-04-26T12:03:38.063 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 33/131 2024-04-26T12:03:38.121 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 34/131 2024-04-26T12:03:38.228 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : re2-1:20211101-3.el9.x86_64 35/131 2024-04-26T12:03:38.266 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 36/131 2024-04-26T12:03:38.321 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 37/131 2024-04-26T12:03:38.402 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 38/131 2024-04-26T12:03:38.433 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 39/131 2024-04-26T12:03:38.470 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 40/131 2024-04-26T12:03:38.517 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 41/131 2024-04-26T12:03:38.523 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 87/131 2024-04-26T12:03:38.523 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /sys 2024-04-26T12:03:38.523 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /proc 2024-04-26T12:03:38.523 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /mnt 2024-04-26T12:03:38.523 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /var/tmp 2024-04-26T12:03:38.523 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /home 2024-04-26T12:03:38.523 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /root 2024-04-26T12:03:38.524 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /tmp 2024-04-26T12:03:38.524 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:03:38.562 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 42/131 2024-04-26T12:03:38.621 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 43/131 2024-04-26T12:03:38.688 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 88/131 2024-04-26T12:03:38.704 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 88/131 2024-04-26T12:03:38.704 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:03:38.705 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T12:03:38.705 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:03:38.756 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 44/131 2024-04-26T12:03:38.798 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 45/131 2024-04-26T12:03:38.840 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 46/131 2024-04-26T12:03:38.934 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 47/131 2024-04-26T12:03:38.965 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 48/131 2024-04-26T12:03:39.005 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 49/131 2024-04-26T12:03:39.031 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 50/131 2024-04-26T12:03:39.057 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 51/131 2024-04-26T12:03:39.091 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : fmt-8.1.1-5.el9.x86_64 52/131 2024-04-26T12:03:39.119 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 53/131 2024-04-26T12:03:39.147 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/131 2024-04-26T12:03:39.156 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 54/131 2024-04-26T12:03:39.186 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 55/131 2024-04-26T12:03:39.221 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 56/131 2024-04-26T12:03:39.226 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 75/131 2024-04-26T12:03:39.253 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 76/131 2024-04-26T12:03:39.254 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 57/131 2024-04-26T12:03:39.287 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 77/131 2024-04-26T12:03:39.296 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 58/131 2024-04-26T12:03:39.330 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 59/131 2024-04-26T12:03:39.365 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 60/131 2024-04-26T12:03:39.413 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 61/131 2024-04-26T12:03:39.511 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-packaging-20.9-5.el9.noarch 62/131 2024-04-26T12:03:39.559 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 63/131 2024-04-26T12:03:39.588 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 78/131 2024-04-26T12:03:39.633 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 79/131 2024-04-26T12:03:39.722 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 79/131 2024-04-26T12:03:39.754 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 80/131 2024-04-26T12:03:39.791 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 81/131 2024-04-26T12:03:40.194 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 82/131 2024-04-26T12:03:40.216 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 89/131 2024-04-26T12:03:40.219 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 83/131 2024-04-26T12:03:40.242 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 89/131 2024-04-26T12:03:40.242 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:03:40.242 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T12:03:40.243 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T12:03:40.243 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T12:03:40.243 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:03:40.274 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 83/131 2024-04-26T12:03:40.279 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 64/131 2024-04-26T12:03:40.296 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 84/131 2024-04-26T12:03:40.323 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 65/131 2024-04-26T12:03:40.357 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 66/131 2024-04-26T12:03:40.456 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 67/131 2024-04-26T12:03:40.459 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 90/131 2024-04-26T12:03:40.482 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 90/131 2024-04-26T12:03:40.483 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:03:40.483 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T12:03:40.483 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T12:03:40.483 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T12:03:40.483 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:03:40.499 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 68/131 2024-04-26T12:03:40.669 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : openblas-0.3.21-2.el9.x86_64 69/131 2024-04-26T12:03:40.698 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 70/131 2024-04-26T12:03:40.775 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 71/131 2024-04-26T12:03:40.943 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 91/131 2024-04-26T12:03:40.967 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 91/131 2024-04-26T12:03:40.967 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:03:40.967 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T12:03:40.967 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T12:03:40.968 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T12:03:40.968 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:03:41.074 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : automake-1.16.2-8.el9.noarch 92/131 2024-04-26T12:03:41.131 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ply-3.11-14.el9.noarch 93/131 2024-04-26T12:03:41.187 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 94/131 2024-04-26T12:03:41.379 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 95/131 2024-04-26T12:03:41.418 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 72/131 2024-04-26T12:03:41.427 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 96/131 2024-04-26T12:03:41.507 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 97/131 2024-04-26T12:03:41.547 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 73/131 2024-04-26T12:03:41.606 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 98/131 2024-04-26T12:03:41.747 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 99/131 2024-04-26T12:03:41.786 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 100/131 2024-04-26T12:03:41.818 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/131 2024-04-26T12:03:41.845 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : fuse-2.9.9-15.el9.x86_64 102/131 2024-04-26T12:03:42.337 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 103/131 2024-04-26T12:03:42.370 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 103/131 2024-04-26T12:03:42.375 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T12:03:42.399 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 104/131 2024-04-26T12:03:42.410 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T12:03:42.466 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 105/131 2024-04-26T12:03:42.492 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 106/131 2024-04-26T12:03:42.777 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/131 2024-04-26T12:03:42.854 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 75/131 2024-04-26T12:03:42.881 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 76/131 2024-04-26T12:03:42.915 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 77/131 2024-04-26T12:03:42.926 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T12:03:42.963 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 86/131 2024-04-26T12:03:43.058 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 86/131 2024-04-26T12:03:43.059 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T12:03:43.059 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T12:03:43.059 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:03:43.089 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 87/131 2024-04-26T12:03:43.214 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 78/131 2024-04-26T12:03:43.253 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 79/131 2024-04-26T12:03:43.345 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 79/131 2024-04-26T12:03:43.374 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 80/131 2024-04-26T12:03:43.410 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 81/131 2024-04-26T12:03:43.588 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 106/131 2024-04-26T12:03:43.627 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 107/131 2024-04-26T12:03:43.812 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 82/131 2024-04-26T12:03:43.839 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 83/131 2024-04-26T12:03:43.902 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 83/131 2024-04-26T12:03:43.942 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 84/131 2024-04-26T12:03:44.650 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 107/131 2024-04-26T12:03:44.686 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 108/131 2024-04-26T12:03:44.794 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 108/131 2024-04-26T12:03:44.958 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 109/131 2024-04-26T12:03:44.997 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 110/131 2024-04-26T12:03:45.021 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 110/131 2024-04-26T12:03:45.021 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:03:45.021 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T12:03:45.021 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T12:03:45.021 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T12:03:45.021 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:03:45.072 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 111/131 2024-04-26T12:03:45.083 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 111/131 2024-04-26T12:03:45.181 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 112/131 2024-04-26T12:03:45.238 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 113/131 2024-04-26T12:03:45.987 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libtool-2.4.6-45.el9.x86_64 114/131 2024-04-26T12:03:46.024 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 115/131 2024-04-26T12:03:46.048 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 115/131 2024-04-26T12:03:46.049 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:03:46.049 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T12:03:46.049 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:03:46.049 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:03:46.049 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:03:46.078 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T12:03:46.092 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 116/131 2024-04-26T12:03:46.114 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T12:03:46.115 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 116/131 2024-04-26T12:03:46.115 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:03:46.115 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T12:03:46.115 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:03:46.425 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 117/131 2024-04-26T12:03:46.449 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 117/131 2024-04-26T12:03:46.450 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:03:46.450 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T12:03:46.450 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T12:03:46.450 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T12:03:46.450 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:03:46.634 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T12:03:46.677 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 86/131 2024-04-26T12:03:46.776 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 86/131 2024-04-26T12:03:46.776 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T12:03:46.776 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T12:03:46.777 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:03:46.811 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 87/131 2024-04-26T12:03:47.596 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 87/131 2024-04-26T12:03:47.596 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /sys 2024-04-26T12:03:47.596 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /proc 2024-04-26T12:03:47.597 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /mnt 2024-04-26T12:03:47.597 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /var/tmp 2024-04-26T12:03:47.597 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /home 2024-04-26T12:03:47.597 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /root 2024-04-26T12:03:47.597 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /tmp 2024-04-26T12:03:47.597 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:03:47.750 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 88/131 2024-04-26T12:03:47.765 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 88/131 2024-04-26T12:03:47.765 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:03:47.765 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T12:03:47.765 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:03:49.201 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 89/131 2024-04-26T12:03:49.226 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 89/131 2024-04-26T12:03:49.227 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:03:49.227 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T12:03:49.227 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T12:03:49.227 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T12:03:49.227 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:03:49.436 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 90/131 2024-04-26T12:03:49.459 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 90/131 2024-04-26T12:03:49.459 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:03:49.459 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T12:03:49.459 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T12:03:49.459 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T12:03:49.460 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:03:49.930 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 91/131 2024-04-26T12:03:49.952 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 91/131 2024-04-26T12:03:49.953 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:03:49.953 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T12:03:49.953 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T12:03:49.953 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T12:03:49.953 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:03:50.060 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : automake-1.16.2-8.el9.noarch 92/131 2024-04-26T12:03:50.117 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ply-3.11-14.el9.noarch 93/131 2024-04-26T12:03:50.172 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 94/131 2024-04-26T12:03:50.329 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 118/131 2024-04-26T12:03:50.365 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 95/131 2024-04-26T12:03:50.371 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 119/131 2024-04-26T12:03:50.413 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 96/131 2024-04-26T12:03:50.420 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 120/131 2024-04-26T12:03:50.452 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 121/131 2024-04-26T12:03:50.478 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 122/131 2024-04-26T12:03:50.482 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 97/131 2024-04-26T12:03:50.572 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 98/131 2024-04-26T12:03:50.711 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 99/131 2024-04-26T12:03:50.755 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 100/131 2024-04-26T12:03:50.796 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/131 2024-04-26T12:03:50.823 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : fuse-2.9.9-15.el9.x86_64 102/131 2024-04-26T12:03:51.219 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 103/131 2024-04-26T12:03:51.246 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 103/131 2024-04-26T12:03:51.275 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 104/131 2024-04-26T12:03:51.338 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 105/131 2024-04-26T12:03:51.361 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 106/131 2024-04-26T12:03:51.377 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_ 123/131 2024-04-26T12:03:51.470 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 124/131 2024-04-26T12:03:51.521 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 125/131 2024-04-26T12:03:51.605 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flex-2.6.4-9.el9.x86_64 126/131 2024-04-26T12:03:51.641 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : bison-3.7.4-5.el9.x86_64 127/131 2024-04-26T12:03:51.641 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 128/131 2024-04-26T12:03:51.725 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 128/131 2024-04-26T12:03:51.757 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 129/131 2024-04-26T12:03:51.758 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 130/131 2024-04-26T12:03:51.850 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 130/131 2024-04-26T12:03:51.916 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T12:03:52.390 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 106/131 2024-04-26T12:03:52.422 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 107/131 2024-04-26T12:03:53.396 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 107/131 2024-04-26T12:03:53.422 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 108/131 2024-04-26T12:03:53.523 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 108/131 2024-04-26T12:03:53.689 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 109/131 2024-04-26T12:03:53.716 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 110/131 2024-04-26T12:03:53.738 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 110/131 2024-04-26T12:03:53.738 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:03:53.738 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T12:03:53.738 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T12:03:53.739 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T12:03:53.739 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:03:53.783 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 111/131 2024-04-26T12:03:53.793 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 111/131 2024-04-26T12:03:53.888 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 112/131 2024-04-26T12:03:53.939 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 113/131 2024-04-26T12:03:54.185 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 87/131 2024-04-26T12:03:54.185 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /sys 2024-04-26T12:03:54.185 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /proc 2024-04-26T12:03:54.185 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /mnt 2024-04-26T12:03:54.185 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /var/tmp 2024-04-26T12:03:54.185 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /home 2024-04-26T12:03:54.185 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /root 2024-04-26T12:03:54.185 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /tmp 2024-04-26T12:03:54.185 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:03:54.343 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 88/131 2024-04-26T12:03:54.358 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 88/131 2024-04-26T12:03:54.358 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:03:54.358 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T12:03:54.358 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:03:54.643 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libtool-2.4.6-45.el9.x86_64 114/131 2024-04-26T12:03:54.668 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 115/131 2024-04-26T12:03:54.691 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 115/131 2024-04-26T12:03:54.691 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:03:54.691 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T12:03:54.691 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:03:54.691 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:03:54.691 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:03:54.736 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 116/131 2024-04-26T12:03:54.758 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 116/131 2024-04-26T12:03:54.758 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:03:54.758 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T12:03:54.758 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:03:55.045 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 117/131 2024-04-26T12:03:55.067 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 117/131 2024-04-26T12:03:55.067 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:03:55.067 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T12:03:55.067 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T12:03:55.067 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T12:03:55.068 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:03:55.829 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 89/131 2024-04-26T12:03:55.854 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 89/131 2024-04-26T12:03:55.855 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:03:55.855 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T12:03:55.855 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T12:03:55.855 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T12:03:55.855 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:03:56.055 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 90/131 2024-04-26T12:03:56.077 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 90/131 2024-04-26T12:03:56.077 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:03:56.077 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T12:03:56.077 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T12:03:56.077 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T12:03:56.077 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:03:56.522 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 91/131 2024-04-26T12:03:56.545 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 91/131 2024-04-26T12:03:56.545 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:03:56.545 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T12:03:56.545 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T12:03:56.545 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T12:03:56.545 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:03:56.652 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : automake-1.16.2-8.el9.noarch 92/131 2024-04-26T12:03:56.701 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ply-3.11-14.el9.noarch 93/131 2024-04-26T12:03:56.757 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 94/131 2024-04-26T12:03:56.898 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T12:03:56.898 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 1/131 2024-04-26T12:03:56.898 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 2/131 2024-04-26T12:03:56.899 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 3/131 2024-04-26T12:03:56.899 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 4/131 2024-04-26T12:03:56.899 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/131 2024-04-26T12:03:56.899 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 6/131 2024-04-26T12:03:56.900 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 7/131 2024-04-26T12:03:56.900 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T12:03:56.900 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T12:03:56.900 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 10/131 2024-04-26T12:03:56.900 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T12:03:56.900 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 12/131 2024-04-26T12:03:56.900 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_ 13/131 2024-04-26T12:03:56.900 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 14/131 2024-04-26T12:03:56.900 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 15/131 2024-04-26T12:03:56.900 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_6 16/131 2024-04-26T12:03:56.900 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 17/131 2024-04-26T12:03:56.900 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 18/131 2024-04-26T12:03:56.900 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/131 2024-04-26T12:03:56.901 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9. 20/131 2024-04-26T12:03:56.901 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_6 21/131 2024-04-26T12:03:56.901 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 22/131 2024-04-26T12:03:56.901 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 23/131 2024-04-26T12:03:56.901 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 24/131 2024-04-26T12:03:56.901 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 25/131 2024-04-26T12:03:56.901 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 26/131 2024-04-26T12:03:56.901 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 27/131 2024-04-26T12:03:56.901 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/131 2024-04-26T12:03:56.901 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 29/131 2024-04-26T12:03:56.901 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 30/131 2024-04-26T12:03:56.911 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/131 2024-04-26T12:03:56.911 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/131 2024-04-26T12:03:56.911 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 33/131 2024-04-26T12:03:56.911 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/131 2024-04-26T12:03:56.912 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 35/131 2024-04-26T12:03:56.912 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 36/131 2024-04-26T12:03:56.912 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/131 2024-04-26T12:03:56.912 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 38/131 2024-04-26T12:03:56.912 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 39/131 2024-04-26T12:03:56.912 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/131 2024-04-26T12:03:56.912 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/131 2024-04-26T12:03:56.912 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/131 2024-04-26T12:03:56.912 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/131 2024-04-26T12:03:56.912 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/131 2024-04-26T12:03:56.912 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 45/131 2024-04-26T12:03:56.912 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/131 2024-04-26T12:03:56.912 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/131 2024-04-26T12:03:56.913 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/131 2024-04-26T12:03:56.913 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 49/131 2024-04-26T12:03:56.913 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/131 2024-04-26T12:03:56.913 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/131 2024-04-26T12:03:56.913 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/131 2024-04-26T12:03:56.913 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/131 2024-04-26T12:03:56.913 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/131 2024-04-26T12:03:56.913 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/131 2024-04-26T12:03:56.913 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/131 2024-04-26T12:03:56.913 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/131 2024-04-26T12:03:56.913 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 58/131 2024-04-26T12:03:56.913 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 59/131 2024-04-26T12:03:56.913 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/131 2024-04-26T12:03:56.913 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/131 2024-04-26T12:03:56.914 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 62/131 2024-04-26T12:03:56.914 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 63/131 2024-04-26T12:03:56.914 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 64/131 2024-04-26T12:03:56.914 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/131 2024-04-26T12:03:56.914 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 66/131 2024-04-26T12:03:56.914 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/131 2024-04-26T12:03:56.914 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/131 2024-04-26T12:03:56.914 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/131 2024-04-26T12:03:56.914 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/131 2024-04-26T12:03:56.914 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/131 2024-04-26T12:03:56.914 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/131 2024-04-26T12:03:56.914 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/131 2024-04-26T12:03:56.914 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/131 2024-04-26T12:03:56.915 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/131 2024-04-26T12:03:56.915 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/131 2024-04-26T12:03:56.915 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 77/131 2024-04-26T12:03:56.915 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 78/131 2024-04-26T12:03:56.915 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 79/131 2024-04-26T12:03:56.915 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/131 2024-04-26T12:03:56.915 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 81/131 2024-04-26T12:03:56.915 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 82/131 2024-04-26T12:03:56.915 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 83/131 2024-04-26T12:03:56.915 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 84/131 2024-04-26T12:03:56.915 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/131 2024-04-26T12:03:56.915 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 86/131 2024-04-26T12:03:56.915 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 87/131 2024-04-26T12:03:56.916 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/131 2024-04-26T12:03:56.916 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 89/131 2024-04-26T12:03:56.916 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 90/131 2024-04-26T12:03:56.916 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 91/131 2024-04-26T12:03:56.916 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 92/131 2024-04-26T12:03:56.916 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 93/131 2024-04-26T12:03:56.916 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 94/131 2024-04-26T12:03:56.916 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 95/131 2024-04-26T12:03:56.916 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 96/131 2024-04-26T12:03:56.916 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 97/131 2024-04-26T12:03:56.916 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 98/131 2024-04-26T12:03:56.916 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 99/131 2024-04-26T12:03:56.916 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 100/131 2024-04-26T12:03:56.916 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 101/131 2024-04-26T12:03:56.917 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 102/131 2024-04-26T12:03:56.917 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 103/131 2024-04-26T12:03:56.917 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 104/131 2024-04-26T12:03:56.917 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 105/131 2024-04-26T12:03:56.917 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 106/131 2024-04-26T12:03:56.917 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 107/131 2024-04-26T12:03:56.917 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 108/131 2024-04-26T12:03:56.917 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 109/131 2024-04-26T12:03:56.917 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 110/131 2024-04-26T12:03:56.917 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 111/131 2024-04-26T12:03:56.917 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 112/131 2024-04-26T12:03:56.917 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 113/131 2024-04-26T12:03:56.917 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 114/131 2024-04-26T12:03:56.917 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 115/131 2024-04-26T12:03:56.917 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 116/131 2024-04-26T12:03:56.918 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 117/131 2024-04-26T12:03:56.918 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 118/131 2024-04-26T12:03:56.918 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 119/131 2024-04-26T12:03:56.918 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 120/131 2024-04-26T12:03:56.918 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 121/131 2024-04-26T12:03:56.918 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : re2-1:20211101-3.el9.x86_64 122/131 2024-04-26T12:03:56.918 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 123/131 2024-04-26T12:03:56.918 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 124/131 2024-04-26T12:03:56.918 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 125/131 2024-04-26T12:03:56.918 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 126/131 2024-04-26T12:03:56.918 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 127/131 2024-04-26T12:03:56.918 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 128/131 2024-04-26T12:03:56.918 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 129/131 2024-04-26T12:03:56.918 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 130/131 2024-04-26T12:03:56.941 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 95/131 2024-04-26T12:03:56.990 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 96/131 2024-04-26T12:03:57.059 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 97/131 2024-04-26T12:03:57.147 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 98/131 2024-04-26T12:03:57.277 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 99/131 2024-04-26T12:03:57.323 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 100/131 2024-04-26T12:03:57.355 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/131 2024-04-26T12:03:57.383 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fuse-2.9.9-15.el9.x86_64 102/131 2024-04-26T12:03:57.570 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 87/131 2024-04-26T12:03:57.570 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /sys 2024-04-26T12:03:57.570 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /proc 2024-04-26T12:03:57.570 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /mnt 2024-04-26T12:03:57.570 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /var/tmp 2024-04-26T12:03:57.570 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /home 2024-04-26T12:03:57.571 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /root 2024-04-26T12:03:57.571 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /tmp 2024-04-26T12:03:57.571 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:03:57.750 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 88/131 2024-04-26T12:03:57.764 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 88/131 2024-04-26T12:03:57.764 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:03:57.764 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T12:03:57.765 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:03:57.829 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 103/131 2024-04-26T12:03:57.857 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 103/131 2024-04-26T12:03:57.886 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 104/131 2024-04-26T12:03:57.950 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 105/131 2024-04-26T12:03:57.979 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 106/131 2024-04-26T12:03:58.731 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 118/131 2024-04-26T12:03:58.734 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T12:03:58.734 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:03:58.734 INFO:teuthology.orchestra.run.smithi052.stdout:Upgraded: 2024-04-26T12:03:58.735 INFO:teuthology.orchestra.run.smithi052.stdout: librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.735 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.735 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T12:03:58.735 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T12:03:58.735 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-04-26T12:03:58.735 INFO:teuthology.orchestra.run.smithi052.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T12:03:58.735 INFO:teuthology.orchestra.run.smithi052.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T12:03:58.735 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T12:03:58.735 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.735 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.735 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.735 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.735 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:03:58.735 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.735 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.736 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.736 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:03:58.736 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:03:58.736 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:03:58.736 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:03:58.736 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:03:58.736 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.736 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.736 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:03:58.736 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.736 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.736 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.736 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:03:58.736 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:03:58.737 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T12:03:58.737 INFO:teuthology.orchestra.run.smithi052.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T12:03:58.737 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T12:03:58.737 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T12:03:58.737 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T12:03:58.737 INFO:teuthology.orchestra.run.smithi052.stdout: fmt-8.1.1-5.el9.x86_64 2024-04-26T12:03:58.737 INFO:teuthology.orchestra.run.smithi052.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T12:03:58.737 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T12:03:58.737 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T12:03:58.737 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T12:03:58.737 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T12:03:58.737 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.737 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.737 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.738 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T12:03:58.738 INFO:teuthology.orchestra.run.smithi052.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T12:03:58.738 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T12:03:58.738 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T12:03:58.738 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T12:03:58.738 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.738 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.738 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T12:03:58.738 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.738 INFO:teuthology.orchestra.run.smithi052.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T12:03:58.738 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T12:03:58.738 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T12:03:58.738 INFO:teuthology.orchestra.run.smithi052.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T12:03:58.739 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T12:03:58.739 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T12:03:58.739 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T12:03:58.739 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T12:03:58.739 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T12:03:58.739 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T12:03:58.739 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T12:03:58.739 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T12:03:58.739 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T12:03:58.739 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.739 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.739 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.739 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T12:03:58.739 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T12:03:58.739 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T12:03:58.740 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T12:03:58.740 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T12:03:58.740 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T12:03:58.740 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T12:03:58.740 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T12:03:58.740 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T12:03:58.740 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T12:03:58.740 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T12:03:58.740 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T12:03:58.740 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T12:03:58.740 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T12:03:58.740 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T12:03:58.740 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T12:03:58.740 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T12:03:58.740 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T12:03:58.741 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T12:03:58.741 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T12:03:58.741 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T12:03:58.741 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T12:03:58.741 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T12:03:58.741 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T12:03:58.741 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T12:03:58.741 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T12:03:58.741 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T12:03:58.741 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T12:03:58.741 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T12:03:58.741 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T12:03:58.741 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T12:03:58.741 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T12:03:58.741 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T12:03:58.742 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T12:03:58.742 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.742 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.742 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T12:03:58.742 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T12:03:58.742 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T12:03:58.742 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.742 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T12:03:58.742 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T12:03:58.742 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T12:03:58.742 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T12:03:58.742 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T12:03:58.742 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T12:03:58.743 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T12:03:58.743 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T12:03:58.743 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T12:03:58.743 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T12:03:58.743 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T12:03:58.743 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.743 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.743 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:03:58.743 INFO:teuthology.orchestra.run.smithi052.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T12:03:58.743 INFO:teuthology.orchestra.run.smithi052.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T12:03:58.743 INFO:teuthology.orchestra.run.smithi052.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T12:03:58.743 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T12:03:58.743 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T12:03:58.744 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T12:03:58.744 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:03:58.744 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-04-26T12:03:58.773 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 119/131 2024-04-26T12:03:58.813 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 120/131 2024-04-26T12:03:58.845 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 121/131 2024-04-26T12:03:58.872 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 122/131 2024-04-26T12:03:59.012 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 106/131 2024-04-26T12:03:59.040 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 107/131 2024-04-26T12:03:59.157 DEBUG:teuthology.parallel:result is None 2024-04-26T12:03:59.228 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 89/131 2024-04-26T12:03:59.253 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 89/131 2024-04-26T12:03:59.254 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:03:59.254 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T12:03:59.254 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T12:03:59.254 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T12:03:59.254 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:03:59.462 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 90/131 2024-04-26T12:03:59.484 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 90/131 2024-04-26T12:03:59.484 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:03:59.484 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T12:03:59.484 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T12:03:59.484 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T12:03:59.485 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:03:59.707 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_ 123/131 2024-04-26T12:03:59.796 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 124/131 2024-04-26T12:03:59.837 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 125/131 2024-04-26T12:03:59.918 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flex-2.6.4-9.el9.x86_64 126/131 2024-04-26T12:03:59.921 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 91/131 2024-04-26T12:03:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 91/131 2024-04-26T12:03:59.943 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:03:59.943 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T12:03:59.943 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T12:03:59.943 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T12:03:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:03:59.951 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : bison-3.7.4-5.el9.x86_64 127/131 2024-04-26T12:03:59.951 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 128/131 2024-04-26T12:04:00.009 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 107/131 2024-04-26T12:04:00.032 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 108/131 2024-04-26T12:04:00.035 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 128/131 2024-04-26T12:04:00.051 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : automake-1.16.2-8.el9.noarch 92/131 2024-04-26T12:04:00.067 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 129/131 2024-04-26T12:04:00.068 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 130/131 2024-04-26T12:04:00.108 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-ply-3.11-14.el9.noarch 93/131 2024-04-26T12:04:00.133 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 108/131 2024-04-26T12:04:00.164 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 94/131 2024-04-26T12:04:00.167 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 130/131 2024-04-26T12:04:00.231 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T12:04:00.289 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 109/131 2024-04-26T12:04:00.326 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 110/131 2024-04-26T12:04:00.349 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 110/131 2024-04-26T12:04:00.349 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:04:00.350 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T12:04:00.350 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T12:04:00.350 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T12:04:00.350 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:00.350 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 95/131 2024-04-26T12:04:00.394 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 111/131 2024-04-26T12:04:00.397 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 96/131 2024-04-26T12:04:00.404 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 111/131 2024-04-26T12:04:00.467 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 97/131 2024-04-26T12:04:00.499 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 112/131 2024-04-26T12:04:00.550 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 113/131 2024-04-26T12:04:00.555 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 98/131 2024-04-26T12:04:00.695 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 99/131 2024-04-26T12:04:00.731 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 100/131 2024-04-26T12:04:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/131 2024-04-26T12:04:00.807 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : fuse-2.9.9-15.el9.x86_64 102/131 2024-04-26T12:04:01.255 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 103/131 2024-04-26T12:04:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libtool-2.4.6-45.el9.x86_64 114/131 2024-04-26T12:04:01.282 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 103/131 2024-04-26T12:04:01.288 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 115/131 2024-04-26T12:04:01.310 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 115/131 2024-04-26T12:04:01.310 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:04:01.310 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T12:04:01.310 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:04:01.310 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:04:01.310 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:01.311 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 104/131 2024-04-26T12:04:01.355 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 116/131 2024-04-26T12:04:01.374 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 105/131 2024-04-26T12:04:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 116/131 2024-04-26T12:04:01.377 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:04:01.377 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T12:04:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:01.405 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 106/131 2024-04-26T12:04:01.673 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 117/131 2024-04-26T12:04:01.694 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 117/131 2024-04-26T12:04:01.695 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:04:01.695 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T12:04:01.695 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T12:04:01.695 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T12:04:01.695 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:02.448 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 106/131 2024-04-26T12:04:02.482 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 107/131 2024-04-26T12:04:03.451 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 107/131 2024-04-26T12:04:03.474 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 108/131 2024-04-26T12:04:03.576 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 108/131 2024-04-26T12:04:03.732 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 109/131 2024-04-26T12:04:03.760 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 110/131 2024-04-26T12:04:03.783 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 110/131 2024-04-26T12:04:03.783 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:04:03.783 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T12:04:03.783 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T12:04:03.783 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T12:04:03.783 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:03.828 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 111/131 2024-04-26T12:04:03.839 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 111/131 2024-04-26T12:04:03.934 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 112/131 2024-04-26T12:04:03.984 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 113/131 2024-04-26T12:04:04.690 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libtool-2.4.6-45.el9.x86_64 114/131 2024-04-26T12:04:04.722 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 115/131 2024-04-26T12:04:04.744 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 115/131 2024-04-26T12:04:04.744 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:04:04.744 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T12:04:04.744 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:04:04.744 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:04:04.745 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:04.789 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 116/131 2024-04-26T12:04:04.811 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 116/131 2024-04-26T12:04:04.811 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:04:04.811 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T12:04:04.811 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:05.098 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 117/131 2024-04-26T12:04:05.120 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 117/131 2024-04-26T12:04:05.120 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:04:05.121 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T12:04:05.121 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T12:04:05.121 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T12:04:05.121 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T12:04:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 1/131 2024-04-26T12:04:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 2/131 2024-04-26T12:04:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 3/131 2024-04-26T12:04:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 4/131 2024-04-26T12:04:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/131 2024-04-26T12:04:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 6/131 2024-04-26T12:04:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 7/131 2024-04-26T12:04:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T12:04:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T12:04:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 10/131 2024-04-26T12:04:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T12:04:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 12/131 2024-04-26T12:04:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_ 13/131 2024-04-26T12:04:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 14/131 2024-04-26T12:04:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 15/131 2024-04-26T12:04:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_6 16/131 2024-04-26T12:04:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 17/131 2024-04-26T12:04:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 18/131 2024-04-26T12:04:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/131 2024-04-26T12:04:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9. 20/131 2024-04-26T12:04:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_6 21/131 2024-04-26T12:04:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 22/131 2024-04-26T12:04:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 23/131 2024-04-26T12:04:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 24/131 2024-04-26T12:04:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 25/131 2024-04-26T12:04:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 26/131 2024-04-26T12:04:05.133 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 27/131 2024-04-26T12:04:05.133 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/131 2024-04-26T12:04:05.133 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 29/131 2024-04-26T12:04:05.142 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 30/131 2024-04-26T12:04:05.142 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/131 2024-04-26T12:04:05.142 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/131 2024-04-26T12:04:05.142 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 33/131 2024-04-26T12:04:05.142 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/131 2024-04-26T12:04:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 35/131 2024-04-26T12:04:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 36/131 2024-04-26T12:04:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/131 2024-04-26T12:04:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 38/131 2024-04-26T12:04:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 39/131 2024-04-26T12:04:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/131 2024-04-26T12:04:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/131 2024-04-26T12:04:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/131 2024-04-26T12:04:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/131 2024-04-26T12:04:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/131 2024-04-26T12:04:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 45/131 2024-04-26T12:04:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/131 2024-04-26T12:04:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/131 2024-04-26T12:04:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/131 2024-04-26T12:04:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 49/131 2024-04-26T12:04:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/131 2024-04-26T12:04:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/131 2024-04-26T12:04:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/131 2024-04-26T12:04:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/131 2024-04-26T12:04:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/131 2024-04-26T12:04:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/131 2024-04-26T12:04:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/131 2024-04-26T12:04:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/131 2024-04-26T12:04:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 58/131 2024-04-26T12:04:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 59/131 2024-04-26T12:04:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/131 2024-04-26T12:04:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/131 2024-04-26T12:04:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 62/131 2024-04-26T12:04:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 63/131 2024-04-26T12:04:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 64/131 2024-04-26T12:04:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/131 2024-04-26T12:04:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 66/131 2024-04-26T12:04:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/131 2024-04-26T12:04:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/131 2024-04-26T12:04:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/131 2024-04-26T12:04:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/131 2024-04-26T12:04:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/131 2024-04-26T12:04:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/131 2024-04-26T12:04:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/131 2024-04-26T12:04:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/131 2024-04-26T12:04:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/131 2024-04-26T12:04:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/131 2024-04-26T12:04:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 77/131 2024-04-26T12:04:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 78/131 2024-04-26T12:04:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 79/131 2024-04-26T12:04:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/131 2024-04-26T12:04:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 81/131 2024-04-26T12:04:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 82/131 2024-04-26T12:04:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 83/131 2024-04-26T12:04:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 84/131 2024-04-26T12:04:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/131 2024-04-26T12:04:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 86/131 2024-04-26T12:04:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 87/131 2024-04-26T12:04:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/131 2024-04-26T12:04:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 89/131 2024-04-26T12:04:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 90/131 2024-04-26T12:04:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 91/131 2024-04-26T12:04:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 92/131 2024-04-26T12:04:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 93/131 2024-04-26T12:04:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 94/131 2024-04-26T12:04:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 95/131 2024-04-26T12:04:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 96/131 2024-04-26T12:04:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 97/131 2024-04-26T12:04:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 98/131 2024-04-26T12:04:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 99/131 2024-04-26T12:04:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 100/131 2024-04-26T12:04:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 101/131 2024-04-26T12:04:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 102/131 2024-04-26T12:04:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 103/131 2024-04-26T12:04:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 104/131 2024-04-26T12:04:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 105/131 2024-04-26T12:04:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 106/131 2024-04-26T12:04:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 107/131 2024-04-26T12:04:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 108/131 2024-04-26T12:04:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 109/131 2024-04-26T12:04:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 110/131 2024-04-26T12:04:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 111/131 2024-04-26T12:04:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 112/131 2024-04-26T12:04:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 113/131 2024-04-26T12:04:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 114/131 2024-04-26T12:04:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 115/131 2024-04-26T12:04:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 116/131 2024-04-26T12:04:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 117/131 2024-04-26T12:04:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 118/131 2024-04-26T12:04:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 119/131 2024-04-26T12:04:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 120/131 2024-04-26T12:04:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 121/131 2024-04-26T12:04:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : re2-1:20211101-3.el9.x86_64 122/131 2024-04-26T12:04:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 123/131 2024-04-26T12:04:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 124/131 2024-04-26T12:04:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 125/131 2024-04-26T12:04:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 126/131 2024-04-26T12:04:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 127/131 2024-04-26T12:04:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 128/131 2024-04-26T12:04:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 129/131 2024-04-26T12:04:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 130/131 2024-04-26T12:04:05.351 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 118/131 2024-04-26T12:04:05.403 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 119/131 2024-04-26T12:04:05.450 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 120/131 2024-04-26T12:04:05.482 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 121/131 2024-04-26T12:04:05.509 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 122/131 2024-04-26T12:04:06.364 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_ 123/131 2024-04-26T12:04:06.459 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 124/131 2024-04-26T12:04:06.501 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 125/131 2024-04-26T12:04:06.582 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flex-2.6.4-9.el9.x86_64 126/131 2024-04-26T12:04:06.614 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : bison-3.7.4-5.el9.x86_64 127/131 2024-04-26T12:04:06.614 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 128/131 2024-04-26T12:04:06.681 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 128/131 2024-04-26T12:04:06.714 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 129/131 2024-04-26T12:04:06.714 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 130/131 2024-04-26T12:04:06.791 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 130/131 2024-04-26T12:04:06.854 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T12:04:06.974 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T12:04:06.974 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:06.974 INFO:teuthology.orchestra.run.smithi164.stdout:Upgraded: 2024-04-26T12:04:06.974 INFO:teuthology.orchestra.run.smithi164.stdout: librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.974 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.974 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T12:04:06.974 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T12:04:06.974 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-26T12:04:06.974 INFO:teuthology.orchestra.run.smithi164.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T12:04:06.974 INFO:teuthology.orchestra.run.smithi164.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T12:04:06.974 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T12:04:06.975 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.975 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.975 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.975 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.975 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:06.975 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.975 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.975 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.975 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:06.975 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:06.975 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:06.975 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:06.975 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:06.975 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.976 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.976 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:06.976 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.976 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.976 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.976 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:06.976 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:06.976 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T12:04:06.976 INFO:teuthology.orchestra.run.smithi164.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T12:04:06.976 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T12:04:06.976 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T12:04:06.976 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T12:04:06.976 INFO:teuthology.orchestra.run.smithi164.stdout: fmt-8.1.1-5.el9.x86_64 2024-04-26T12:04:06.976 INFO:teuthology.orchestra.run.smithi164.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T12:04:06.977 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T12:04:06.977 INFO:teuthology.orchestra.run.smithi164.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T12:04:06.977 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T12:04:06.977 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T12:04:06.977 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.977 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.977 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.977 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T12:04:06.977 INFO:teuthology.orchestra.run.smithi164.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T12:04:06.977 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T12:04:06.977 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T12:04:06.977 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T12:04:06.977 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.978 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.978 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T12:04:06.978 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.978 INFO:teuthology.orchestra.run.smithi164.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T12:04:06.978 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T12:04:06.978 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T12:04:06.978 INFO:teuthology.orchestra.run.smithi164.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T12:04:06.978 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T12:04:06.978 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T12:04:06.978 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T12:04:06.978 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T12:04:06.978 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T12:04:06.978 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T12:04:06.978 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T12:04:06.979 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T12:04:06.979 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T12:04:06.979 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.979 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.979 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.979 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T12:04:06.979 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T12:04:06.979 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T12:04:06.979 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T12:04:06.979 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T12:04:06.979 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T12:04:06.979 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T12:04:06.979 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T12:04:06.980 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T12:04:06.980 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T12:04:06.980 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T12:04:06.980 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T12:04:06.980 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T12:04:06.980 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T12:04:06.980 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T12:04:06.980 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T12:04:06.980 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T12:04:06.980 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T12:04:06.980 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T12:04:06.980 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T12:04:06.980 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T12:04:06.980 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T12:04:06.981 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T12:04:06.981 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T12:04:06.981 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T12:04:06.981 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T12:04:06.981 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T12:04:06.981 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T12:04:06.981 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T12:04:06.981 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T12:04:06.981 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T12:04:06.981 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T12:04:06.981 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T12:04:06.981 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T12:04:06.981 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.981 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.981 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T12:04:06.982 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T12:04:06.982 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T12:04:06.982 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.982 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T12:04:06.982 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T12:04:06.982 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T12:04:06.982 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T12:04:06.983 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T12:04:06.983 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T12:04:06.983 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T12:04:06.983 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T12:04:06.983 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T12:04:06.983 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T12:04:06.983 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T12:04:06.984 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.984 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.984 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:06.984 INFO:teuthology.orchestra.run.smithi164.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T12:04:06.984 INFO:teuthology.orchestra.run.smithi164.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T12:04:06.984 INFO:teuthology.orchestra.run.smithi164.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T12:04:06.984 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T12:04:06.984 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T12:04:06.985 INFO:teuthology.orchestra.run.smithi164.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T12:04:06.985 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:06.985 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-26T12:04:07.364 DEBUG:teuthology.parallel:result is None 2024-04-26T12:04:08.786 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 118/131 2024-04-26T12:04:08.827 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 119/131 2024-04-26T12:04:08.876 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 120/131 2024-04-26T12:04:08.916 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 121/131 2024-04-26T12:04:08.943 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 122/131 2024-04-26T12:04:09.783 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_ 123/131 2024-04-26T12:04:09.886 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 124/131 2024-04-26T12:04:09.928 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 125/131 2024-04-26T12:04:10.009 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flex-2.6.4-9.el9.x86_64 126/131 2024-04-26T12:04:10.049 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : bison-3.7.4-5.el9.x86_64 127/131 2024-04-26T12:04:10.049 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 128/131 2024-04-26T12:04:10.133 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 128/131 2024-04-26T12:04:10.166 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 129/131 2024-04-26T12:04:10.166 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 130/131 2024-04-26T12:04:10.245 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 130/131 2024-04-26T12:04:10.314 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T12:04:11.858 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T12:04:11.858 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 1/131 2024-04-26T12:04:11.858 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 2/131 2024-04-26T12:04:11.858 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 3/131 2024-04-26T12:04:11.858 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 4/131 2024-04-26T12:04:11.859 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/131 2024-04-26T12:04:11.859 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 6/131 2024-04-26T12:04:11.859 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 7/131 2024-04-26T12:04:11.859 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T12:04:11.859 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T12:04:11.859 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 10/131 2024-04-26T12:04:11.859 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T12:04:11.859 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 12/131 2024-04-26T12:04:11.859 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_ 13/131 2024-04-26T12:04:11.859 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 14/131 2024-04-26T12:04:11.859 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 15/131 2024-04-26T12:04:11.859 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_6 16/131 2024-04-26T12:04:11.859 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 17/131 2024-04-26T12:04:11.859 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 18/131 2024-04-26T12:04:11.860 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/131 2024-04-26T12:04:11.860 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9. 20/131 2024-04-26T12:04:11.860 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_6 21/131 2024-04-26T12:04:11.860 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 22/131 2024-04-26T12:04:11.860 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 23/131 2024-04-26T12:04:11.860 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 24/131 2024-04-26T12:04:11.860 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 25/131 2024-04-26T12:04:11.860 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 26/131 2024-04-26T12:04:11.860 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 27/131 2024-04-26T12:04:11.860 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/131 2024-04-26T12:04:11.860 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 29/131 2024-04-26T12:04:11.860 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 30/131 2024-04-26T12:04:11.860 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/131 2024-04-26T12:04:11.860 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/131 2024-04-26T12:04:11.861 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 33/131 2024-04-26T12:04:11.861 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/131 2024-04-26T12:04:11.861 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 35/131 2024-04-26T12:04:11.861 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 36/131 2024-04-26T12:04:11.861 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/131 2024-04-26T12:04:11.861 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 38/131 2024-04-26T12:04:11.861 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 39/131 2024-04-26T12:04:11.861 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/131 2024-04-26T12:04:11.861 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/131 2024-04-26T12:04:11.861 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/131 2024-04-26T12:04:11.861 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/131 2024-04-26T12:04:11.861 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/131 2024-04-26T12:04:11.861 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 45/131 2024-04-26T12:04:11.862 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/131 2024-04-26T12:04:11.862 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/131 2024-04-26T12:04:11.862 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/131 2024-04-26T12:04:11.862 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 49/131 2024-04-26T12:04:11.862 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/131 2024-04-26T12:04:11.862 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/131 2024-04-26T12:04:11.862 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/131 2024-04-26T12:04:11.862 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/131 2024-04-26T12:04:11.862 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/131 2024-04-26T12:04:11.862 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/131 2024-04-26T12:04:11.862 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/131 2024-04-26T12:04:11.862 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/131 2024-04-26T12:04:11.862 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 58/131 2024-04-26T12:04:11.863 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 59/131 2024-04-26T12:04:11.863 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/131 2024-04-26T12:04:11.863 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/131 2024-04-26T12:04:11.863 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 62/131 2024-04-26T12:04:11.863 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 63/131 2024-04-26T12:04:11.863 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 64/131 2024-04-26T12:04:11.863 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/131 2024-04-26T12:04:11.863 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 66/131 2024-04-26T12:04:11.863 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/131 2024-04-26T12:04:11.863 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/131 2024-04-26T12:04:11.863 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/131 2024-04-26T12:04:11.863 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/131 2024-04-26T12:04:11.863 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/131 2024-04-26T12:04:11.863 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/131 2024-04-26T12:04:11.864 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/131 2024-04-26T12:04:11.864 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/131 2024-04-26T12:04:11.864 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/131 2024-04-26T12:04:11.864 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/131 2024-04-26T12:04:11.864 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 77/131 2024-04-26T12:04:11.864 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 78/131 2024-04-26T12:04:11.864 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 79/131 2024-04-26T12:04:11.864 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/131 2024-04-26T12:04:11.864 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 81/131 2024-04-26T12:04:11.864 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 82/131 2024-04-26T12:04:11.864 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 83/131 2024-04-26T12:04:11.864 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 84/131 2024-04-26T12:04:11.864 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/131 2024-04-26T12:04:11.864 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 86/131 2024-04-26T12:04:11.865 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 87/131 2024-04-26T12:04:11.865 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/131 2024-04-26T12:04:11.865 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 89/131 2024-04-26T12:04:11.865 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 90/131 2024-04-26T12:04:11.865 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 91/131 2024-04-26T12:04:11.865 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 92/131 2024-04-26T12:04:11.865 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 93/131 2024-04-26T12:04:11.865 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 94/131 2024-04-26T12:04:11.865 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 95/131 2024-04-26T12:04:11.865 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 96/131 2024-04-26T12:04:11.865 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 97/131 2024-04-26T12:04:11.865 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 98/131 2024-04-26T12:04:11.865 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 99/131 2024-04-26T12:04:11.865 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 100/131 2024-04-26T12:04:11.865 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 101/131 2024-04-26T12:04:11.866 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 102/131 2024-04-26T12:04:11.866 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 103/131 2024-04-26T12:04:11.866 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 104/131 2024-04-26T12:04:11.866 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 105/131 2024-04-26T12:04:11.866 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 106/131 2024-04-26T12:04:11.866 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 107/131 2024-04-26T12:04:11.866 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 108/131 2024-04-26T12:04:11.866 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 109/131 2024-04-26T12:04:11.866 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 110/131 2024-04-26T12:04:11.866 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 111/131 2024-04-26T12:04:11.866 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 112/131 2024-04-26T12:04:11.866 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 113/131 2024-04-26T12:04:11.866 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 114/131 2024-04-26T12:04:11.867 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 115/131 2024-04-26T12:04:11.867 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 116/131 2024-04-26T12:04:11.867 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 117/131 2024-04-26T12:04:11.867 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 118/131 2024-04-26T12:04:11.867 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 119/131 2024-04-26T12:04:11.867 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 120/131 2024-04-26T12:04:11.867 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 121/131 2024-04-26T12:04:11.867 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : re2-1:20211101-3.el9.x86_64 122/131 2024-04-26T12:04:11.867 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 123/131 2024-04-26T12:04:11.867 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 124/131 2024-04-26T12:04:11.867 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 125/131 2024-04-26T12:04:11.867 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 126/131 2024-04-26T12:04:11.867 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 127/131 2024-04-26T12:04:11.867 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 128/131 2024-04-26T12:04:11.868 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 129/131 2024-04-26T12:04:11.868 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 130/131 2024-04-26T12:04:13.722 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T12:04:13.722 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:13.722 INFO:teuthology.orchestra.run.smithi154.stdout:Upgraded: 2024-04-26T12:04:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T12:04:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T12:04:13.723 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-04-26T12:04:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T12:04:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T12:04:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T12:04:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T12:04:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T12:04:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T12:04:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T12:04:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T12:04:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: fmt-8.1.1-5.el9.x86_64 2024-04-26T12:04:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T12:04:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T12:04:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T12:04:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T12:04:13.726 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T12:04:13.726 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.726 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.726 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.726 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T12:04:13.726 INFO:teuthology.orchestra.run.smithi154.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T12:04:13.726 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T12:04:13.726 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T12:04:13.726 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T12:04:13.726 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T12:04:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T12:04:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T12:04:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T12:04:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T12:04:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T12:04:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T12:04:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T12:04:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T12:04:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T12:04:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T12:04:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T12:04:13.728 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T12:04:13.728 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T12:04:13.728 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.728 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.728 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.728 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T12:04:13.728 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T12:04:13.728 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T12:04:13.728 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T12:04:13.728 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T12:04:13.728 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T12:04:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T12:04:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T12:04:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T12:04:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T12:04:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T12:04:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T12:04:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T12:04:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T12:04:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T12:04:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T12:04:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T12:04:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T12:04:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T12:04:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T12:04:13.730 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T12:04:13.730 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T12:04:13.730 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T12:04:13.730 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T12:04:13.730 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T12:04:13.730 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T12:04:13.730 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T12:04:13.730 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T12:04:13.730 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T12:04:13.730 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T12:04:13.730 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T12:04:13.731 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T12:04:13.731 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T12:04:13.731 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T12:04:13.731 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.731 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.731 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T12:04:13.731 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T12:04:13.731 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T12:04:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T12:04:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T12:04:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T12:04:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T12:04:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T12:04:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T12:04:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T12:04:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T12:04:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T12:04:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T12:04:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T12:04:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.733 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:13.733 INFO:teuthology.orchestra.run.smithi154.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T12:04:13.733 INFO:teuthology.orchestra.run.smithi154.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T12:04:13.733 INFO:teuthology.orchestra.run.smithi154.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T12:04:13.733 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T12:04:13.733 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T12:04:13.733 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T12:04:13.733 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:13.733 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-04-26T12:04:14.119 DEBUG:teuthology.parallel:result is None 2024-04-26T12:04:15.458 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T12:04:15.458 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 1/131 2024-04-26T12:04:15.458 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 2/131 2024-04-26T12:04:15.458 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 3/131 2024-04-26T12:04:15.458 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 4/131 2024-04-26T12:04:15.458 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/131 2024-04-26T12:04:15.458 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 6/131 2024-04-26T12:04:15.459 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 7/131 2024-04-26T12:04:15.459 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T12:04:15.459 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T12:04:15.459 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 10/131 2024-04-26T12:04:15.459 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T12:04:15.459 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 12/131 2024-04-26T12:04:15.459 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_ 13/131 2024-04-26T12:04:15.459 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 14/131 2024-04-26T12:04:15.459 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 15/131 2024-04-26T12:04:15.459 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_6 16/131 2024-04-26T12:04:15.460 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 17/131 2024-04-26T12:04:15.460 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 18/131 2024-04-26T12:04:15.460 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/131 2024-04-26T12:04:15.460 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9. 20/131 2024-04-26T12:04:15.460 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_6 21/131 2024-04-26T12:04:15.460 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 22/131 2024-04-26T12:04:15.460 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 23/131 2024-04-26T12:04:15.460 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 24/131 2024-04-26T12:04:15.460 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 25/131 2024-04-26T12:04:15.460 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 26/131 2024-04-26T12:04:15.460 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 27/131 2024-04-26T12:04:15.470 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/131 2024-04-26T12:04:15.470 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 29/131 2024-04-26T12:04:15.470 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 30/131 2024-04-26T12:04:15.470 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/131 2024-04-26T12:04:15.471 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/131 2024-04-26T12:04:15.471 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 33/131 2024-04-26T12:04:15.471 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/131 2024-04-26T12:04:15.471 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 35/131 2024-04-26T12:04:15.471 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 36/131 2024-04-26T12:04:15.471 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/131 2024-04-26T12:04:15.471 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 38/131 2024-04-26T12:04:15.471 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 39/131 2024-04-26T12:04:15.471 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/131 2024-04-26T12:04:15.471 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/131 2024-04-26T12:04:15.471 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/131 2024-04-26T12:04:15.471 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/131 2024-04-26T12:04:15.471 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/131 2024-04-26T12:04:15.472 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 45/131 2024-04-26T12:04:15.472 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/131 2024-04-26T12:04:15.472 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/131 2024-04-26T12:04:15.472 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/131 2024-04-26T12:04:15.472 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 49/131 2024-04-26T12:04:15.472 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/131 2024-04-26T12:04:15.472 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/131 2024-04-26T12:04:15.472 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/131 2024-04-26T12:04:15.472 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/131 2024-04-26T12:04:15.472 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/131 2024-04-26T12:04:15.472 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/131 2024-04-26T12:04:15.472 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/131 2024-04-26T12:04:15.472 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/131 2024-04-26T12:04:15.473 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 58/131 2024-04-26T12:04:15.473 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 59/131 2024-04-26T12:04:15.473 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/131 2024-04-26T12:04:15.473 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/131 2024-04-26T12:04:15.473 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 62/131 2024-04-26T12:04:15.473 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 63/131 2024-04-26T12:04:15.473 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 64/131 2024-04-26T12:04:15.473 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/131 2024-04-26T12:04:15.473 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 66/131 2024-04-26T12:04:15.473 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/131 2024-04-26T12:04:15.473 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/131 2024-04-26T12:04:15.473 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/131 2024-04-26T12:04:15.473 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/131 2024-04-26T12:04:15.473 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/131 2024-04-26T12:04:15.474 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/131 2024-04-26T12:04:15.474 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/131 2024-04-26T12:04:15.474 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/131 2024-04-26T12:04:15.474 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/131 2024-04-26T12:04:15.474 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/131 2024-04-26T12:04:15.474 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 77/131 2024-04-26T12:04:15.474 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 78/131 2024-04-26T12:04:15.474 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 79/131 2024-04-26T12:04:15.474 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/131 2024-04-26T12:04:15.474 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 81/131 2024-04-26T12:04:15.474 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 82/131 2024-04-26T12:04:15.475 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 83/131 2024-04-26T12:04:15.475 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 84/131 2024-04-26T12:04:15.475 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/131 2024-04-26T12:04:15.475 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 86/131 2024-04-26T12:04:15.475 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 87/131 2024-04-26T12:04:15.475 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/131 2024-04-26T12:04:15.475 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 89/131 2024-04-26T12:04:15.475 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 90/131 2024-04-26T12:04:15.475 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 91/131 2024-04-26T12:04:15.475 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 92/131 2024-04-26T12:04:15.475 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 93/131 2024-04-26T12:04:15.475 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 94/131 2024-04-26T12:04:15.475 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 95/131 2024-04-26T12:04:15.476 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 96/131 2024-04-26T12:04:15.476 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 97/131 2024-04-26T12:04:15.476 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 98/131 2024-04-26T12:04:15.476 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 99/131 2024-04-26T12:04:15.476 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 100/131 2024-04-26T12:04:15.476 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 101/131 2024-04-26T12:04:15.476 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 102/131 2024-04-26T12:04:15.476 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 103/131 2024-04-26T12:04:15.476 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 104/131 2024-04-26T12:04:15.476 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 105/131 2024-04-26T12:04:15.476 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 106/131 2024-04-26T12:04:15.476 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 107/131 2024-04-26T12:04:15.476 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 108/131 2024-04-26T12:04:15.476 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 109/131 2024-04-26T12:04:15.477 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 110/131 2024-04-26T12:04:15.477 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 111/131 2024-04-26T12:04:15.477 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 112/131 2024-04-26T12:04:15.477 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 113/131 2024-04-26T12:04:15.477 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 114/131 2024-04-26T12:04:15.477 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 115/131 2024-04-26T12:04:15.477 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 116/131 2024-04-26T12:04:15.477 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 117/131 2024-04-26T12:04:15.477 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 118/131 2024-04-26T12:04:15.477 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 119/131 2024-04-26T12:04:15.477 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 120/131 2024-04-26T12:04:15.477 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 121/131 2024-04-26T12:04:15.477 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : re2-1:20211101-3.el9.x86_64 122/131 2024-04-26T12:04:15.477 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 123/131 2024-04-26T12:04:15.478 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 124/131 2024-04-26T12:04:15.478 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 125/131 2024-04-26T12:04:15.478 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 126/131 2024-04-26T12:04:15.478 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 127/131 2024-04-26T12:04:15.478 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 128/131 2024-04-26T12:04:15.478 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 129/131 2024-04-26T12:04:15.478 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 130/131 2024-04-26T12:04:17.393 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T12:04:17.393 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:17.393 INFO:teuthology.orchestra.run.smithi143.stdout:Upgraded: 2024-04-26T12:04:17.393 INFO:teuthology.orchestra.run.smithi143.stdout: librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.393 INFO:teuthology.orchestra.run.smithi143.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.393 INFO:teuthology.orchestra.run.smithi143.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T12:04:17.393 INFO:teuthology.orchestra.run.smithi143.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T12:04:17.393 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-04-26T12:04:17.393 INFO:teuthology.orchestra.run.smithi143.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T12:04:17.394 INFO:teuthology.orchestra.run.smithi143.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T12:04:17.394 INFO:teuthology.orchestra.run.smithi143.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T12:04:17.394 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.394 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.394 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.394 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.394 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:17.394 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.394 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.394 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.394 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:17.394 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:17.395 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:17.395 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:17.395 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:17.395 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.395 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.395 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:17.395 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.395 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.395 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.395 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:17.395 INFO:teuthology.orchestra.run.smithi143.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:04:17.395 INFO:teuthology.orchestra.run.smithi143.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T12:04:17.395 INFO:teuthology.orchestra.run.smithi143.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T12:04:17.396 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T12:04:17.396 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T12:04:17.396 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T12:04:17.396 INFO:teuthology.orchestra.run.smithi143.stdout: fmt-8.1.1-5.el9.x86_64 2024-04-26T12:04:17.396 INFO:teuthology.orchestra.run.smithi143.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T12:04:17.396 INFO:teuthology.orchestra.run.smithi143.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T12:04:17.396 INFO:teuthology.orchestra.run.smithi143.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T12:04:17.396 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T12:04:17.396 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T12:04:17.396 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.396 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.396 INFO:teuthology.orchestra.run.smithi143.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.396 INFO:teuthology.orchestra.run.smithi143.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T12:04:17.396 INFO:teuthology.orchestra.run.smithi143.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T12:04:17.397 INFO:teuthology.orchestra.run.smithi143.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T12:04:17.397 INFO:teuthology.orchestra.run.smithi143.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T12:04:17.397 INFO:teuthology.orchestra.run.smithi143.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T12:04:17.397 INFO:teuthology.orchestra.run.smithi143.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.397 INFO:teuthology.orchestra.run.smithi143.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.397 INFO:teuthology.orchestra.run.smithi143.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T12:04:17.397 INFO:teuthology.orchestra.run.smithi143.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.397 INFO:teuthology.orchestra.run.smithi143.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T12:04:17.397 INFO:teuthology.orchestra.run.smithi143.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T12:04:17.397 INFO:teuthology.orchestra.run.smithi143.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T12:04:17.397 INFO:teuthology.orchestra.run.smithi143.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T12:04:17.397 INFO:teuthology.orchestra.run.smithi143.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T12:04:17.397 INFO:teuthology.orchestra.run.smithi143.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T12:04:17.397 INFO:teuthology.orchestra.run.smithi143.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T12:04:17.398 INFO:teuthology.orchestra.run.smithi143.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T12:04:17.398 INFO:teuthology.orchestra.run.smithi143.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T12:04:17.398 INFO:teuthology.orchestra.run.smithi143.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T12:04:17.398 INFO:teuthology.orchestra.run.smithi143.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T12:04:17.398 INFO:teuthology.orchestra.run.smithi143.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T12:04:17.398 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T12:04:17.398 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.398 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.398 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.398 INFO:teuthology.orchestra.run.smithi143.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T12:04:17.398 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T12:04:17.398 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T12:04:17.398 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T12:04:17.398 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T12:04:17.399 INFO:teuthology.orchestra.run.smithi143.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T12:04:17.399 INFO:teuthology.orchestra.run.smithi143.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T12:04:17.399 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T12:04:17.399 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T12:04:17.399 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T12:04:17.399 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T12:04:17.399 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T12:04:17.399 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T12:04:17.399 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T12:04:17.399 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T12:04:17.399 INFO:teuthology.orchestra.run.smithi143.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T12:04:17.399 INFO:teuthology.orchestra.run.smithi143.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T12:04:17.399 INFO:teuthology.orchestra.run.smithi143.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T12:04:17.399 INFO:teuthology.orchestra.run.smithi143.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T12:04:17.400 INFO:teuthology.orchestra.run.smithi143.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T12:04:17.400 INFO:teuthology.orchestra.run.smithi143.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T12:04:17.400 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T12:04:17.400 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T12:04:17.400 INFO:teuthology.orchestra.run.smithi143.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T12:04:17.400 INFO:teuthology.orchestra.run.smithi143.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T12:04:17.400 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T12:04:17.400 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T12:04:17.400 INFO:teuthology.orchestra.run.smithi143.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T12:04:17.400 INFO:teuthology.orchestra.run.smithi143.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T12:04:17.400 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T12:04:17.400 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T12:04:17.400 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T12:04:17.401 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T12:04:17.401 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T12:04:17.401 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.401 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.401 INFO:teuthology.orchestra.run.smithi143.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T12:04:17.401 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T12:04:17.401 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T12:04:17.401 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.401 INFO:teuthology.orchestra.run.smithi143.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T12:04:17.401 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T12:04:17.401 INFO:teuthology.orchestra.run.smithi143.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T12:04:17.401 INFO:teuthology.orchestra.run.smithi143.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T12:04:17.401 INFO:teuthology.orchestra.run.smithi143.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T12:04:17.401 INFO:teuthology.orchestra.run.smithi143.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T12:04:17.402 INFO:teuthology.orchestra.run.smithi143.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T12:04:17.402 INFO:teuthology.orchestra.run.smithi143.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T12:04:17.402 INFO:teuthology.orchestra.run.smithi143.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T12:04:17.402 INFO:teuthology.orchestra.run.smithi143.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T12:04:17.402 INFO:teuthology.orchestra.run.smithi143.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T12:04:17.402 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.402 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.402 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:04:17.402 INFO:teuthology.orchestra.run.smithi143.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T12:04:17.402 INFO:teuthology.orchestra.run.smithi143.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T12:04:17.402 INFO:teuthology.orchestra.run.smithi143.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T12:04:17.402 INFO:teuthology.orchestra.run.smithi143.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T12:04:17.402 INFO:teuthology.orchestra.run.smithi143.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T12:04:17.403 INFO:teuthology.orchestra.run.smithi143.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T12:04:17.403 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:17.403 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-04-26T12:04:17.791 DEBUG:teuthology.parallel:result is None 2024-04-26T12:04:17.792 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:04:18.057 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T12:04:18.085 INFO:teuthology.orchestra.run.smithi052.stdout:18.2.2-1256.gdc093b5e.el9 2024-04-26T12:04:18.086 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el9 2024-04-26T12:04:18.086 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T12:04:18.088 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:04:18.309 DEBUG:teuthology.orchestra.run.smithi143:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T12:04:18.333 INFO:teuthology.orchestra.run.smithi143.stdout:18.2.2-1256.gdc093b5e.el9 2024-04-26T12:04:18.333 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el9 2024-04-26T12:04:18.333 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T12:04:18.335 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:04:18.567 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T12:04:18.593 INFO:teuthology.orchestra.run.smithi154.stdout:18.2.2-1256.gdc093b5e.el9 2024-04-26T12:04:18.593 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el9 2024-04-26T12:04:18.593 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T12:04:18.596 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:04:18.812 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T12:04:18.838 INFO:teuthology.orchestra.run.smithi164.stdout:18.2.2-1256.gdc093b5e.el9 2024-04-26T12:04:18.838 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el9 2024-04-26T12:04:18.838 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T12:04:18.840 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T12:04:18.840 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T12:04:18.841 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:04:18.873 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T12:04:18.873 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:04:18.899 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-26T12:04:18.899 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:04:18.931 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-26T12:04:18.931 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:04:18.963 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T12:04:18.963 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T12:04:18.963 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:04:18.991 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:04:19.060 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T12:04:19.060 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:04:19.085 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:04:19.148 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-26T12:04:19.148 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:04:19.177 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:04:19.247 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-26T12:04:19.247 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:04:19.276 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:04:19.343 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T12:04:19.344 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T12:04:19.344 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:04:19.373 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:04:19.440 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T12:04:19.441 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:04:19.464 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:04:19.528 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-26T12:04:19.528 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:04:19.556 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:04:19.623 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-26T12:04:19.624 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:04:19.651 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:04:19.718 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T12:04:19.718 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T12:04:19.718 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:04:19.748 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:04:19.817 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T12:04:19.817 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:04:19.841 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:04:19.906 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-26T12:04:19.907 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:04:19.935 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:04:20.003 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-26T12:04:20.003 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:04:20.032 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:04:20.100 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T12:04:20.192 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T12:04:20.192 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 777 /var/log/ceph 2024-04-26T12:04:20.195 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 777 /var/log/ceph 2024-04-26T12:04:20.197 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /var/log/ceph 2024-04-26T12:04:20.200 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 777 /var/log/ceph 2024-04-26T12:04:20.228 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T12:04:20.228 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:04:20.264 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:04:20.266 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:04:20.269 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:04:20.296 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T12:04:20.296 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:04:20.333 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:04:20.336 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:04:20.339 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:04:20.375 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T12:04:20.376 INFO:tasks.ceph:config {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T12:04:20.376 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674200', 'branch': 'reef', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/centos_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7674200', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 1136, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'sleep_before_teardown': 0, 'subset': '0/4', 'suite': 'powercycle', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6', 'targets': {'smithi052.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDBhB7e8aFLoBGs2RipZnsF9E5rXXABBtzKJavtKIcABoX/yme8YlQ74FzLwSMkqBV/39bn4k7iz1zBzW44gLgc=', 'smithi143.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG99naOH0O9bv+Y8m80wcu1NDsqxWIDuyUtr3IcweYKEybQPp+zQQF46mWWuR3bWe27HuvL8RdkbUErcQ25SQHA=', 'smithi154.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEtLAJM2hL3qYeNsGRhnV6ppUSpiF72a46DsPYQfad860otdeIohaqxJQbUJIpWPvhYGPA1+xohEQqGeRmIbMOQ=', 'smithi164.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyEZicLkM3LaQk8biYWB6Iu24moSE0Hxh0lWbpQ9cAr0v8FcdhbXSK5bmDd0zgUeJfZxOTTeqWCMRnVVcEbV94='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_22:32:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T12:04:20.376 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:04:20.401 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:04:20.403 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:04:20.405 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:04:20.423 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:04:20.458 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:04:20.460 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:04:20.463 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:04:20.490 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T12:04:20.490 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T12:04:20.537 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T12:04:20.537 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_1 2024-04-26T12:04:20.592 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T12:04:20.592 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:04:20.592 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 658 Links: 1 2024-04-26T12:04:20.592 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:04:20.593 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:04:20.593 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-04-26 12:04:10.670254540 +0000 2024-04-26T12:04:20.593 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-04-26 12:01:00.969334756 +0000 2024-04-26T12:04:20.593 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-04-26 12:01:00.969334756 +0000 2024-04-26T12:04:20.593 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-04-26 12:01:00.969334756 +0000 2024-04-26T12:04:20.593 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T12:04:20.655 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-04-26T12:04:20.655 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-04-26T12:04:20.655 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000192777 s, 2.7 MB/s 2024-04-26T12:04:20.656 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T12:04:20.711 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_2 2024-04-26T12:04:20.767 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T12:04:20.767 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:04:20.767 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 679 Links: 1 2024-04-26T12:04:20.767 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:04:20.767 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:04:20.768 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-04-26 12:04:10.670254540 +0000 2024-04-26T12:04:20.768 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-04-26 12:01:01.315324812 +0000 2024-04-26T12:04:20.768 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-04-26 12:01:01.315324812 +0000 2024-04-26T12:04:20.768 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-04-26 12:01:01.315324812 +0000 2024-04-26T12:04:20.768 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T12:04:20.829 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-04-26T12:04:20.829 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-04-26T12:04:20.829 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.00023773 s, 2.2 MB/s 2024-04-26T12:04:20.830 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T12:04:20.885 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_3 2024-04-26T12:04:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T12:04:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:04:20.942 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 696 Links: 1 2024-04-26T12:04:20.942 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:04:20.942 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:04:20.942 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-04-26 12:04:10.671254513 +0000 2024-04-26T12:04:20.942 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-04-26 12:01:01.675314465 +0000 2024-04-26T12:04:20.942 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-04-26 12:01:01.675314465 +0000 2024-04-26T12:04:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-04-26 12:01:01.675314465 +0000 2024-04-26T12:04:20.943 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T12:04:21.004 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-04-26T12:04:21.004 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-04-26T12:04:21.004 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.0001972 s, 2.6 MB/s 2024-04-26T12:04:21.006 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T12:04:21.062 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_4 2024-04-26T12:04:21.118 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T12:04:21.118 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:04:21.118 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 715 Links: 1 2024-04-26T12:04:21.118 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:04:21.119 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:04:21.119 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-04-26 12:04:10.671254513 +0000 2024-04-26T12:04:21.119 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-04-26 12:01:02.007304923 +0000 2024-04-26T12:04:21.119 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-04-26 12:01:02.007304923 +0000 2024-04-26T12:04:21.119 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-04-26 12:01:02.007304923 +0000 2024-04-26T12:04:21.119 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T12:04:21.179 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-04-26T12:04:21.180 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-04-26T12:04:21.180 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000189882 s, 2.7 MB/s 2024-04-26T12:04:21.181 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T12:04:21.236 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T12:04:21.236 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-26T12:04:21.236 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T12:04:21.255 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T12:04:21.255 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2024-04-26T12:04:21.312 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T12:04:21.313 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:04:21.313 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-26T12:04:21.313 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:04:21.313 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:04:21.313 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-04-26 12:04:07.195034405 +0000 2024-04-26T12:04:21.313 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-04-26 12:01:08.630389725 +0000 2024-04-26T12:04:21.313 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-04-26 12:01:08.630389725 +0000 2024-04-26T12:04:21.313 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-04-26 12:01:08.630389725 +0000 2024-04-26T12:04:21.313 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T12:04:21.379 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-04-26T12:04:21.379 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-04-26T12:04:21.379 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000277845 s, 1.8 MB/s 2024-04-26T12:04:21.380 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T12:04:21.438 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2024-04-26T12:04:21.494 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T12:04:21.494 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:04:21.494 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-26T12:04:21.495 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:04:21.495 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:04:21.495 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-04-26 12:04:07.196034379 +0000 2024-04-26T12:04:21.495 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-04-26 12:01:08.984379959 +0000 2024-04-26T12:04:21.495 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-04-26 12:01:08.984379959 +0000 2024-04-26T12:04:21.495 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-04-26 12:01:08.984379959 +0000 2024-04-26T12:04:21.495 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T12:04:21.558 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-04-26T12:04:21.558 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-04-26T12:04:21.558 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000242982 s, 2.1 MB/s 2024-04-26T12:04:21.559 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T12:04:21.617 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2024-04-26T12:04:21.673 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T12:04:21.673 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:04:21.673 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-26T12:04:21.673 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:04:21.673 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:04:21.673 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-04-26 12:04:07.196034379 +0000 2024-04-26T12:04:21.673 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-04-26 12:01:09.345370000 +0000 2024-04-26T12:04:21.673 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-04-26 12:01:09.345370000 +0000 2024-04-26T12:04:21.674 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-04-26 12:01:09.345370000 +0000 2024-04-26T12:04:21.674 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T12:04:21.736 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-04-26T12:04:21.737 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-04-26T12:04:21.737 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000228932 s, 2.2 MB/s 2024-04-26T12:04:21.738 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T12:04:21.794 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2024-04-26T12:04:21.850 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T12:04:21.850 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:04:21.850 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-26T12:04:21.850 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:04:21.850 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:04:21.850 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-04-26 12:04:07.196034379 +0000 2024-04-26T12:04:21.851 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-04-26 12:01:09.695360344 +0000 2024-04-26T12:04:21.851 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-04-26 12:01:09.695360344 +0000 2024-04-26T12:04:21.851 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-04-26 12:01:09.695360344 +0000 2024-04-26T12:04:21.851 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T12:04:21.912 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-04-26T12:04:21.912 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-04-26T12:04:21.912 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000213681 s, 2.4 MB/s 2024-04-26T12:04:21.913 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T12:04:21.971 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-26T12:04:21.972 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-26T12:04:21.972 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T12:04:21.997 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T12:04:21.998 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_1 2024-04-26T12:04:22.058 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T12:04:22.058 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:04:22.058 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-04-26T12:04:22.058 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:04:22.058 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:04:22.059 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-04-26 12:04:00.594015139 +0000 2024-04-26T12:04:22.059 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-04-26 12:01:00.977120251 +0000 2024-04-26T12:04:22.059 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-04-26 12:01:00.977120251 +0000 2024-04-26T12:04:22.059 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-04-26 12:01:00.977120251 +0000 2024-04-26T12:04:22.059 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T12:04:22.124 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-04-26T12:04:22.124 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-04-26T12:04:22.124 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000216259 s, 2.4 MB/s 2024-04-26T12:04:22.125 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T12:04:22.183 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_2 2024-04-26T12:04:22.239 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T12:04:22.240 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:04:22.240 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-26T12:04:22.240 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:04:22.240 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:04:22.240 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-04-26 12:04:00.594015139 +0000 2024-04-26T12:04:22.240 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-04-26 12:01:01.336113915 +0000 2024-04-26T12:04:22.240 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-04-26 12:01:01.336113915 +0000 2024-04-26T12:04:22.240 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-04-26 12:01:01.336113915 +0000 2024-04-26T12:04:22.240 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T12:04:22.305 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-04-26T12:04:22.305 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-04-26T12:04:22.305 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000187009 s, 2.7 MB/s 2024-04-26T12:04:22.306 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T12:04:22.363 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_3 2024-04-26T12:04:22.419 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T12:04:22.419 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:04:22.420 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-04-26T12:04:22.420 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:04:22.420 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:04:22.420 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-04-26 12:04:00.595015123 +0000 2024-04-26T12:04:22.420 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-04-26 12:01:01.668108056 +0000 2024-04-26T12:04:22.420 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-04-26 12:01:01.668108056 +0000 2024-04-26T12:04:22.420 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-04-26 12:01:01.668108056 +0000 2024-04-26T12:04:22.420 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T12:04:22.484 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-04-26T12:04:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-04-26T12:04:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000307772 s, 1.7 MB/s 2024-04-26T12:04:22.486 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T12:04:22.543 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_4 2024-04-26T12:04:22.599 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T12:04:22.599 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:04:22.599 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-26T12:04:22.599 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:04:22.599 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:04:22.599 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-04-26 12:04:00.595015123 +0000 2024-04-26T12:04:22.599 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-04-26 12:01:02.009102037 +0000 2024-04-26T12:04:22.599 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-04-26 12:01:02.009102037 +0000 2024-04-26T12:04:22.600 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-04-26 12:01:02.009102037 +0000 2024-04-26T12:04:22.600 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T12:04:22.663 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-04-26T12:04:22.663 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-04-26T12:04:22.663 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000171207 s, 3.0 MB/s 2024-04-26T12:04:22.664 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T12:04:22.721 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-26T12:04:22.721 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi143.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-26T12:04:22.721 INFO:tasks.ceph:Generating config... 2024-04-26T12:04:22.722 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T12:04:22.723 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T12:04:22.723 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T12:04:22.723 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T12:04:22.723 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T12:04:22.723 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T12:04:22.723 INFO:tasks.ceph:[osd] bluestore compression algorithm = zstd 2024-04-26T12:04:22.723 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-26T12:04:22.723 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T12:04:22.723 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-26T12:04:22.723 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-26T12:04:22.723 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T12:04:22.723 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T12:04:22.723 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-26T12:04:22.724 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T12:04:22.724 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T12:04:22.724 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T12:04:22.724 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-26T12:04:22.724 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T12:04:22.724 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-26T12:04:22.724 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T12:04:22.724 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T12:04:22.725 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T12:04:22.784 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T12:04:22.787 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T12:04:22.832 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:04:22.858 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.52'), ('mon.b', '[v2:172.21.15.52:3301,v1:172.21.15.52:6790]'), ('mon.c', '[v2:172.21.15.52:3302,v1:172.21.15.52:6791]')] 2024-04-26T12:04:22.858 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],[v2:172.21.15.52:3302,v1:172.21.15.52:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2024-04-26T12:04:22.859 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T12:04:22.859 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T12:04:22.914 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.52 --addv b '[v2:172.21.15.52:3301,v1:172.21.15.52:6790]' --addv c '[v2:172.21.15.52:3302,v1:172.21.15.52:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:04:23.002 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:04:23.002 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: generated fsid 5bc300ae-e948-4ce3-81bb-5abae8c06799 2024-04-26T12:04:23.002 INFO:teuthology.orchestra.run.smithi052.stdout:setting min_mon_release = pacific 2024-04-26T12:04:23.002 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 0 2024-04-26T12:04:23.002 INFO:teuthology.orchestra.run.smithi052.stdout:fsid 5bc300ae-e948-4ce3-81bb-5abae8c06799 2024-04-26T12:04:23.002 INFO:teuthology.orchestra.run.smithi052.stdout:last_changed 2024-04-26T12:04:23.001578+0000 2024-04-26T12:04:23.002 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-04-26T12:04:23.001578+0000 2024-04-26T12:04:23.002 INFO:teuthology.orchestra.run.smithi052.stdout:min_mon_release 16 (pacific) 2024-04-26T12:04:23.002 INFO:teuthology.orchestra.run.smithi052.stdout:election_strategy: 1 2024-04-26T12:04:23.002 INFO:teuthology.orchestra.run.smithi052.stdout:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2024-04-26T12:04:23.003 INFO:teuthology.orchestra.run.smithi052.stdout:1: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.b 2024-04-26T12:04:23.003 INFO:teuthology.orchestra.run.smithi052.stdout:2: [v2:172.21.15.52:3302/0,v1:172.21.15.52:6791/0] mon.c 2024-04-26T12:04:23.003 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T12:04:23.004 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T12:04:23.019 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5bc300ae-e948-4ce3-81bb-5abae8c06799... 2024-04-26T12:04:23.020 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:04:23.062 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:04:23.064 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:04:23.068 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:04:23.102 INFO:teuthology.orchestra.run.smithi052.stdout:[global] 2024-04-26T12:04:23.102 INFO:teuthology.orchestra.run.smithi052.stdout: chdir = "" 2024-04-26T12:04:23.102 INFO:teuthology.orchestra.run.smithi052.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:04:23.102 INFO:teuthology.orchestra.run.smithi052.stdout: auth supported = cephx 2024-04-26T12:04:23.102 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.102 INFO:teuthology.orchestra.run.smithi052.stdout: filestore xattr use omap = true 2024-04-26T12:04:23.102 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.102 INFO:teuthology.orchestra.run.smithi052.stdout: mon clock drift allowed = 1.000 2024-04-26T12:04:23.102 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.102 INFO:teuthology.orchestra.run.smithi052.stdout: osd crush chooseleaf type = 0 2024-04-26T12:04:23.103 INFO:teuthology.orchestra.run.smithi052.stdout: auth debug = true 2024-04-26T12:04:23.103 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.103 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on old message = true 2024-04-26T12:04:23.103 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on bug = true 2024-04-26T12:04:23.103 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.103 INFO:teuthology.orchestra.run.smithi052.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:04:23.103 INFO:teuthology.orchestra.run.smithi052.stdout: mon pg warn max object skew = 0 2024-04-26T12:04:23.103 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.103 INFO:teuthology.orchestra.run.smithi052.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:04:23.103 INFO:teuthology.orchestra.run.smithi052.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:04:23.103 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.103 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default size = 2 2024-04-26T12:04:23.103 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.103 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow primary affinity = true 2024-04-26T12:04:23.104 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow pg remap = true 2024-04-26T12:04:23.104 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:04:23.104 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:04:23.104 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on no sortbitwise = false 2024-04-26T12:04:23.104 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:04:23.104 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on too few osds = false 2024-04-26T12:04:23.104 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:04:23.104 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:04:23.104 INFO:teuthology.orchestra.run.smithi052.stdout: mon_allow_pool_size_one = true 2024-04-26T12:04:23.104 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.104 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:04:23.104 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.105 INFO:teuthology.orchestra.run.smithi052.stdout: osd default data pool replay window = 5 2024-04-26T12:04:23.105 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.105 INFO:teuthology.orchestra.run.smithi052.stdout: mon allow pool delete = true 2024-04-26T12:04:23.105 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.105 INFO:teuthology.orchestra.run.smithi052.stdout: mon cluster log file level = debug 2024-04-26T12:04:23.105 INFO:teuthology.orchestra.run.smithi052.stdout: debug asserts on shutdown = true 2024-04-26T12:04:23.105 INFO:teuthology.orchestra.run.smithi052.stdout: mon health detail to clog = false 2024-04-26T12:04:23.105 INFO:teuthology.orchestra.run.smithi052.stdout: mon host = "172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],[v2:172.21.15.52:3302,v1:172.21.15.52:6791]" 2024-04-26T12:04:23.105 INFO:teuthology.orchestra.run.smithi052.stdout: fsid = 5bc300ae-e948-4ce3-81bb-5abae8c06799 2024-04-26T12:04:23.105 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.105 INFO:teuthology.orchestra.run.smithi052.stdout:[osd] 2024-04-26T12:04:23.105 INFO:teuthology.orchestra.run.smithi052.stdout: osd journal size = 100 2024-04-26T12:04:23.105 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.105 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub load threshold = 5.0 2024-04-26T12:04:23.105 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub max interval = 600 2024-04-26T12:04:23.106 INFO:teuthology.orchestra.run.smithi052.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:04:23.106 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.106 INFO:teuthology.orchestra.run.smithi052.stdout: osd recover clone overlap = true 2024-04-26T12:04:23.106 INFO:teuthology.orchestra.run.smithi052.stdout: osd recovery max chunk = 1048576 2024-04-26T12:04:23.106 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.106 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug shutdown = true 2024-04-26T12:04:23.108 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug op order = true 2024-04-26T12:04:23.108 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug verify stray on activate = true 2024-04-26T12:04:23.108 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.108 INFO:teuthology.orchestra.run.smithi052.stdout: osd open classes on start = true 2024-04-26T12:04:23.108 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug pg log writeout = true 2024-04-26T12:04:23.108 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.108 INFO:teuthology.orchestra.run.smithi052.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:04:23.108 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.108 INFO:teuthology.orchestra.run.smithi052.stdout: osd map max advance = 10 2024-04-26T12:04:23.108 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.108 INFO:teuthology.orchestra.run.smithi052.stdout: journal zero on create = true 2024-04-26T12:04:23.109 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.109 INFO:teuthology.orchestra.run.smithi052.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:04:23.109 INFO:teuthology.orchestra.run.smithi052.stdout: filestore apply finisher threads = 3 2024-04-26T12:04:23.109 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.109 INFO:teuthology.orchestra.run.smithi052.stdout: bdev debug aio = true 2024-04-26T12:04:23.109 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug misdirected ops = true 2024-04-26T12:04:23.109 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore block size = 96636764160 2024-04-26T12:04:23.109 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore compression algorithm = zstd 2024-04-26T12:04:23.109 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore compression mode = aggressive 2024-04-26T12:04:23.109 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore fsck on mount = True 2024-04-26T12:04:23.109 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluefs = 1/20 2024-04-26T12:04:23.109 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluestore = 1/20 2024-04-26T12:04:23.109 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-04-26T12:04:23.109 INFO:teuthology.orchestra.run.smithi052.stdout: debug osd = 20 2024-04-26T12:04:23.109 INFO:teuthology.orchestra.run.smithi052.stdout: debug rocksdb = 4/10 2024-04-26T12:04:23.110 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:04:23.110 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd full ratio = 0.9 2024-04-26T12:04:23.110 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:04:23.110 INFO:teuthology.orchestra.run.smithi052.stdout: osd blocked scrub grace period = 3600 2024-04-26T12:04:23.110 INFO:teuthology.orchestra.run.smithi052.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:04:23.110 INFO:teuthology.orchestra.run.smithi052.stdout: osd max markdown count = 1000 2024-04-26T12:04:23.110 INFO:teuthology.orchestra.run.smithi052.stdout: osd objectstore = bluestore 2024-04-26T12:04:23.110 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.110 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr] 2024-04-26T12:04:23.110 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-04-26T12:04:23.110 INFO:teuthology.orchestra.run.smithi052.stdout: debug mgr = 20 2024-04-26T12:04:23.110 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-04-26T12:04:23.110 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-04-26T12:04:23.110 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:04:23.110 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:04:23.111 INFO:teuthology.orchestra.run.smithi052.stdout: mgr/telemetry/nag = false 2024-04-26T12:04:23.111 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.111 INFO:teuthology.orchestra.run.smithi052.stdout:[mon] 2024-04-26T12:04:23.111 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-04-26T12:04:23.111 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-04-26T12:04:23.111 INFO:teuthology.orchestra.run.smithi052.stdout: debug paxos = 20 2024-04-26T12:04:23.111 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-04-26T12:04:23.111 INFO:teuthology.orchestra.run.smithi052.stdout: mon data avail warn = 5 2024-04-26T12:04:23.111 INFO:teuthology.orchestra.run.smithi052.stdout: mon mgr mkfs grace = 240 2024-04-26T12:04:23.111 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:04:23.111 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd reporter subtree level = osd 2024-04-26T12:04:23.111 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd prime pg temp = true 2024-04-26T12:04:23.111 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:04:23.111 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.111 INFO:teuthology.orchestra.run.smithi052.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:04:23.111 INFO:teuthology.orchestra.run.smithi052.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:04:23.112 INFO:teuthology.orchestra.run.smithi052.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:04:23.112 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.112 INFO:teuthology.orchestra.run.smithi052.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:04:23.112 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:04:23.112 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:04:23.112 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.112 INFO:teuthology.orchestra.run.smithi052.stdout: # 1m isn't quite enough 2024-04-26T12:04:23.112 INFO:teuthology.orchestra.run.smithi052.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:04:23.112 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.112 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:04:23.112 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:23.112 INFO:teuthology.orchestra.run.smithi052.stdout:[client] 2024-04-26T12:04:23.112 INFO:teuthology.orchestra.run.smithi052.stdout: rgw cache enabled = true 2024-04-26T12:04:23.112 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable ops log = true 2024-04-26T12:04:23.112 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable usage log = true 2024-04-26T12:04:23.112 INFO:teuthology.orchestra.run.smithi052.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:04:23.113 INFO:teuthology.orchestra.run.smithi052.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:04:23.113 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.a] 2024-04-26T12:04:23.113 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.b] 2024-04-26T12:04:23.113 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.c] 2024-04-26T12:04:23.113 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2024-04-26T12:04:23.114 INFO:teuthology.orchestra.run.smithi164.stdout:[global] 2024-04-26T12:04:23.114 INFO:teuthology.orchestra.run.smithi164.stdout: chdir = "" 2024-04-26T12:04:23.114 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:04:23.114 INFO:teuthology.orchestra.run.smithi164.stdout: auth supported = cephx 2024-04-26T12:04:23.114 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.114 INFO:teuthology.orchestra.run.smithi164.stdout: filestore xattr use omap = true 2024-04-26T12:04:23.114 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.114 INFO:teuthology.orchestra.run.smithi164.stdout: mon clock drift allowed = 1.000 2024-04-26T12:04:23.114 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.114 INFO:teuthology.orchestra.run.smithi164.stdout: osd crush chooseleaf type = 0 2024-04-26T12:04:23.115 INFO:teuthology.orchestra.run.smithi164.stdout: auth debug = true 2024-04-26T12:04:23.115 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.115 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on old message = true 2024-04-26T12:04:23.115 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on bug = true 2024-04-26T12:04:23.115 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.115 INFO:teuthology.orchestra.run.smithi164.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:04:23.115 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn max object skew = 0 2024-04-26T12:04:23.115 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.115 INFO:teuthology.orchestra.run.smithi164.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:04:23.115 INFO:teuthology.orchestra.run.smithi164.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:04:23.115 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.115 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default size = 2 2024-04-26T12:04:23.115 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.115 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow primary affinity = true 2024-04-26T12:04:23.115 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow pg remap = true 2024-04-26T12:04:23.115 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:04:23.116 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:04:23.116 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on no sortbitwise = false 2024-04-26T12:04:23.116 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:04:23.116 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on too few osds = false 2024-04-26T12:04:23.116 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:04:23.116 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:04:23.116 INFO:teuthology.orchestra.run.smithi164.stdout: mon_allow_pool_size_one = true 2024-04-26T12:04:23.116 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.116 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:04:23.116 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.116 INFO:teuthology.orchestra.run.smithi164.stdout: osd default data pool replay window = 5 2024-04-26T12:04:23.116 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.116 INFO:teuthology.orchestra.run.smithi164.stdout: mon allow pool delete = true 2024-04-26T12:04:23.116 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.116 INFO:teuthology.orchestra.run.smithi164.stdout: mon cluster log file level = debug 2024-04-26T12:04:23.117 INFO:teuthology.orchestra.run.smithi164.stdout: debug asserts on shutdown = true 2024-04-26T12:04:23.117 INFO:teuthology.orchestra.run.smithi164.stdout: mon health detail to clog = false 2024-04-26T12:04:23.117 INFO:teuthology.orchestra.run.smithi164.stdout: mon host = "172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],[v2:172.21.15.52:3302,v1:172.21.15.52:6791]" 2024-04-26T12:04:23.117 INFO:teuthology.orchestra.run.smithi164.stdout: fsid = 5bc300ae-e948-4ce3-81bb-5abae8c06799 2024-04-26T12:04:23.117 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.117 INFO:teuthology.orchestra.run.smithi164.stdout:[osd] 2024-04-26T12:04:23.117 INFO:teuthology.orchestra.run.smithi164.stdout: osd journal size = 100 2024-04-26T12:04:23.117 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.117 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub load threshold = 5.0 2024-04-26T12:04:23.117 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub max interval = 600 2024-04-26T12:04:23.117 INFO:teuthology.orchestra.run.smithi164.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:04:23.117 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.117 INFO:teuthology.orchestra.run.smithi164.stdout: osd recover clone overlap = true 2024-04-26T12:04:23.117 INFO:teuthology.orchestra.run.smithi164.stdout: osd recovery max chunk = 1048576 2024-04-26T12:04:23.117 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.118 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug shutdown = true 2024-04-26T12:04:23.118 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug op order = true 2024-04-26T12:04:23.118 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify stray on activate = true 2024-04-26T12:04:23.118 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.118 INFO:teuthology.orchestra.run.smithi164.stdout: osd open classes on start = true 2024-04-26T12:04:23.118 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug pg log writeout = true 2024-04-26T12:04:23.118 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.118 INFO:teuthology.orchestra.run.smithi164.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:04:23.118 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.118 INFO:teuthology.orchestra.run.smithi164.stdout: osd map max advance = 10 2024-04-26T12:04:23.118 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.118 INFO:teuthology.orchestra.run.smithi164.stdout: journal zero on create = true 2024-04-26T12:04:23.118 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.118 INFO:teuthology.orchestra.run.smithi164.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:04:23.118 INFO:teuthology.orchestra.run.smithi164.stdout: filestore apply finisher threads = 3 2024-04-26T12:04:23.119 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.119 INFO:teuthology.orchestra.run.smithi164.stdout: bdev debug aio = true 2024-04-26T12:04:23.119 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug misdirected ops = true 2024-04-26T12:04:23.119 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore block size = 96636764160 2024-04-26T12:04:23.119 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore compression algorithm = zstd 2024-04-26T12:04:23.119 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore compression mode = aggressive 2024-04-26T12:04:23.119 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore fsck on mount = True 2024-04-26T12:04:23.119 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluefs = 1/20 2024-04-26T12:04:23.119 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluestore = 1/20 2024-04-26T12:04:23.119 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-04-26T12:04:23.119 INFO:teuthology.orchestra.run.smithi164.stdout: debug osd = 20 2024-04-26T12:04:23.119 INFO:teuthology.orchestra.run.smithi164.stdout: debug rocksdb = 4/10 2024-04-26T12:04:23.119 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:04:23.119 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd full ratio = 0.9 2024-04-26T12:04:23.119 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:04:23.119 INFO:teuthology.orchestra.run.smithi164.stdout: osd blocked scrub grace period = 3600 2024-04-26T12:04:23.120 INFO:teuthology.orchestra.run.smithi164.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:04:23.120 INFO:teuthology.orchestra.run.smithi164.stdout: osd max markdown count = 1000 2024-04-26T12:04:23.120 INFO:teuthology.orchestra.run.smithi164.stdout: osd objectstore = bluestore 2024-04-26T12:04:23.120 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.120 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr] 2024-04-26T12:04:23.120 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-04-26T12:04:23.120 INFO:teuthology.orchestra.run.smithi164.stdout: debug mgr = 20 2024-04-26T12:04:23.120 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-04-26T12:04:23.120 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-04-26T12:04:23.120 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:04:23.120 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:04:23.120 INFO:teuthology.orchestra.run.smithi164.stdout: mgr/telemetry/nag = false 2024-04-26T12:04:23.120 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.120 INFO:teuthology.orchestra.run.smithi164.stdout:[mon] 2024-04-26T12:04:23.120 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-04-26T12:04:23.121 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-04-26T12:04:23.121 INFO:teuthology.orchestra.run.smithi164.stdout: debug paxos = 20 2024-04-26T12:04:23.121 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-04-26T12:04:23.121 INFO:teuthology.orchestra.run.smithi164.stdout: mon data avail warn = 5 2024-04-26T12:04:23.121 INFO:teuthology.orchestra.run.smithi164.stdout: mon mgr mkfs grace = 240 2024-04-26T12:04:23.121 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:04:23.121 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd reporter subtree level = osd 2024-04-26T12:04:23.121 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd prime pg temp = true 2024-04-26T12:04:23.121 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:04:23.121 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.121 INFO:teuthology.orchestra.run.smithi164.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:04:23.121 INFO:teuthology.orchestra.run.smithi164.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:04:23.121 INFO:teuthology.orchestra.run.smithi164.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:04:23.121 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.121 INFO:teuthology.orchestra.run.smithi164.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:04:23.121 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:04:23.122 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:04:23.122 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.122 INFO:teuthology.orchestra.run.smithi164.stdout: # 1m isn't quite enough 2024-04-26T12:04:23.122 INFO:teuthology.orchestra.run.smithi164.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:04:23.122 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.122 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:04:23.122 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T12:04:23.122 INFO:teuthology.orchestra.run.smithi164.stdout:[client] 2024-04-26T12:04:23.122 INFO:teuthology.orchestra.run.smithi164.stdout: rgw cache enabled = true 2024-04-26T12:04:23.122 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable ops log = true 2024-04-26T12:04:23.122 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable usage log = true 2024-04-26T12:04:23.122 INFO:teuthology.orchestra.run.smithi164.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:04:23.122 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:04:23.122 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.a] 2024-04-26T12:04:23.122 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.b] 2024-04-26T12:04:23.123 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.c] 2024-04-26T12:04:23.123 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2024-04-26T12:04:23.123 INFO:teuthology.orchestra.run.smithi154.stdout:[global] 2024-04-26T12:04:23.123 INFO:teuthology.orchestra.run.smithi154.stdout: chdir = "" 2024-04-26T12:04:23.123 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:04:23.123 INFO:teuthology.orchestra.run.smithi154.stdout: auth supported = cephx 2024-04-26T12:04:23.123 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.123 INFO:teuthology.orchestra.run.smithi154.stdout: filestore xattr use omap = true 2024-04-26T12:04:23.123 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.123 INFO:teuthology.orchestra.run.smithi154.stdout: mon clock drift allowed = 1.000 2024-04-26T12:04:23.123 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.123 INFO:teuthology.orchestra.run.smithi154.stdout: osd crush chooseleaf type = 0 2024-04-26T12:04:23.123 INFO:teuthology.orchestra.run.smithi154.stdout: auth debug = true 2024-04-26T12:04:23.123 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.124 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on old message = true 2024-04-26T12:04:23.124 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on bug = true 2024-04-26T12:04:23.124 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.124 INFO:teuthology.orchestra.run.smithi154.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:04:23.124 INFO:teuthology.orchestra.run.smithi154.stdout: mon pg warn max object skew = 0 2024-04-26T12:04:23.124 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.124 INFO:teuthology.orchestra.run.smithi154.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:04:23.124 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:04:23.124 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.124 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default size = 2 2024-04-26T12:04:23.124 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.124 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow primary affinity = true 2024-04-26T12:04:23.124 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow pg remap = true 2024-04-26T12:04:23.124 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:04:23.124 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:04:23.125 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on no sortbitwise = false 2024-04-26T12:04:23.125 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:04:23.125 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on too few osds = false 2024-04-26T12:04:23.125 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:04:23.125 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:04:23.125 INFO:teuthology.orchestra.run.smithi154.stdout: mon_allow_pool_size_one = true 2024-04-26T12:04:23.125 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.125 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:04:23.125 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.125 INFO:teuthology.orchestra.run.smithi154.stdout: osd default data pool replay window = 5 2024-04-26T12:04:23.125 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.125 INFO:teuthology.orchestra.run.smithi154.stdout: mon allow pool delete = true 2024-04-26T12:04:23.125 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.125 INFO:teuthology.orchestra.run.smithi154.stdout: mon cluster log file level = debug 2024-04-26T12:04:23.125 INFO:teuthology.orchestra.run.smithi154.stdout: debug asserts on shutdown = true 2024-04-26T12:04:23.125 INFO:teuthology.orchestra.run.smithi154.stdout: mon health detail to clog = false 2024-04-26T12:04:23.126 INFO:teuthology.orchestra.run.smithi154.stdout: mon host = "172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],[v2:172.21.15.52:3302,v1:172.21.15.52:6791]" 2024-04-26T12:04:23.126 INFO:teuthology.orchestra.run.smithi154.stdout: fsid = 5bc300ae-e948-4ce3-81bb-5abae8c06799 2024-04-26T12:04:23.126 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.126 INFO:teuthology.orchestra.run.smithi154.stdout:[osd] 2024-04-26T12:04:23.126 INFO:teuthology.orchestra.run.smithi154.stdout: osd journal size = 100 2024-04-26T12:04:23.126 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.126 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub load threshold = 5.0 2024-04-26T12:04:23.126 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub max interval = 600 2024-04-26T12:04:23.126 INFO:teuthology.orchestra.run.smithi154.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:04:23.126 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.126 INFO:teuthology.orchestra.run.smithi154.stdout: osd recover clone overlap = true 2024-04-26T12:04:23.126 INFO:teuthology.orchestra.run.smithi154.stdout: osd recovery max chunk = 1048576 2024-04-26T12:04:23.126 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.126 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug shutdown = true 2024-04-26T12:04:23.126 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug op order = true 2024-04-26T12:04:23.127 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify stray on activate = true 2024-04-26T12:04:23.127 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.127 INFO:teuthology.orchestra.run.smithi154.stdout: osd open classes on start = true 2024-04-26T12:04:23.127 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug pg log writeout = true 2024-04-26T12:04:23.127 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.127 INFO:teuthology.orchestra.run.smithi154.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:04:23.127 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.127 INFO:teuthology.orchestra.run.smithi154.stdout: osd map max advance = 10 2024-04-26T12:04:23.127 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.127 INFO:teuthology.orchestra.run.smithi154.stdout: journal zero on create = true 2024-04-26T12:04:23.127 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.127 INFO:teuthology.orchestra.run.smithi154.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:04:23.127 INFO:teuthology.orchestra.run.smithi154.stdout: filestore apply finisher threads = 3 2024-04-26T12:04:23.127 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.127 INFO:teuthology.orchestra.run.smithi154.stdout: bdev debug aio = true 2024-04-26T12:04:23.128 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug misdirected ops = true 2024-04-26T12:04:23.128 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore block size = 96636764160 2024-04-26T12:04:23.128 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore compression algorithm = zstd 2024-04-26T12:04:23.128 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore compression mode = aggressive 2024-04-26T12:04:23.128 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore fsck on mount = True 2024-04-26T12:04:23.128 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluefs = 1/20 2024-04-26T12:04:23.128 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluestore = 1/20 2024-04-26T12:04:23.128 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-26T12:04:23.128 INFO:teuthology.orchestra.run.smithi154.stdout: debug osd = 20 2024-04-26T12:04:23.128 INFO:teuthology.orchestra.run.smithi154.stdout: debug rocksdb = 4/10 2024-04-26T12:04:23.128 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:04:23.128 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd full ratio = 0.9 2024-04-26T12:04:23.128 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:04:23.128 INFO:teuthology.orchestra.run.smithi154.stdout: osd blocked scrub grace period = 3600 2024-04-26T12:04:23.128 INFO:teuthology.orchestra.run.smithi154.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:04:23.129 INFO:teuthology.orchestra.run.smithi154.stdout: osd max markdown count = 1000 2024-04-26T12:04:23.129 INFO:teuthology.orchestra.run.smithi154.stdout: osd objectstore = bluestore 2024-04-26T12:04:23.129 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.129 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr] 2024-04-26T12:04:23.129 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-26T12:04:23.129 INFO:teuthology.orchestra.run.smithi154.stdout: debug mgr = 20 2024-04-26T12:04:23.129 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-04-26T12:04:23.129 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-04-26T12:04:23.129 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:04:23.129 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:04:23.129 INFO:teuthology.orchestra.run.smithi154.stdout: mgr/telemetry/nag = false 2024-04-26T12:04:23.129 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.129 INFO:teuthology.orchestra.run.smithi154.stdout:[mon] 2024-04-26T12:04:23.129 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-26T12:04:23.129 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-04-26T12:04:23.129 INFO:teuthology.orchestra.run.smithi154.stdout: debug paxos = 20 2024-04-26T12:04:23.130 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-04-26T12:04:23.130 INFO:teuthology.orchestra.run.smithi154.stdout: mon data avail warn = 5 2024-04-26T12:04:23.130 INFO:teuthology.orchestra.run.smithi154.stdout: mon mgr mkfs grace = 240 2024-04-26T12:04:23.130 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:04:23.130 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd reporter subtree level = osd 2024-04-26T12:04:23.130 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd prime pg temp = true 2024-04-26T12:04:23.130 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:04:23.130 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.130 INFO:teuthology.orchestra.run.smithi154.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:04:23.130 INFO:teuthology.orchestra.run.smithi154.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:04:23.130 INFO:teuthology.orchestra.run.smithi154.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:04:23.130 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.130 INFO:teuthology.orchestra.run.smithi154.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:04:23.130 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:04:23.130 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:04:23.131 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.131 INFO:teuthology.orchestra.run.smithi154.stdout: # 1m isn't quite enough 2024-04-26T12:04:23.131 INFO:teuthology.orchestra.run.smithi154.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:04:23.131 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.131 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:04:23.131 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T12:04:23.131 INFO:teuthology.orchestra.run.smithi154.stdout:[client] 2024-04-26T12:04:23.131 INFO:teuthology.orchestra.run.smithi154.stdout: rgw cache enabled = true 2024-04-26T12:04:23.131 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable ops log = true 2024-04-26T12:04:23.131 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable usage log = true 2024-04-26T12:04:23.131 INFO:teuthology.orchestra.run.smithi154.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:04:23.131 INFO:teuthology.orchestra.run.smithi154.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:04:23.131 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.a] 2024-04-26T12:04:23.131 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.b] 2024-04-26T12:04:23.131 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.c] 2024-04-26T12:04:23.131 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2024-04-26T12:04:23.132 INFO:teuthology.orchestra.run.smithi143.stdout:[global] 2024-04-26T12:04:23.132 INFO:teuthology.orchestra.run.smithi143.stdout: chdir = "" 2024-04-26T12:04:23.132 INFO:teuthology.orchestra.run.smithi143.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:04:23.132 INFO:teuthology.orchestra.run.smithi143.stdout: auth supported = cephx 2024-04-26T12:04:23.132 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.132 INFO:teuthology.orchestra.run.smithi143.stdout: filestore xattr use omap = true 2024-04-26T12:04:23.132 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.132 INFO:teuthology.orchestra.run.smithi143.stdout: mon clock drift allowed = 1.000 2024-04-26T12:04:23.132 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.132 INFO:teuthology.orchestra.run.smithi143.stdout: osd crush chooseleaf type = 0 2024-04-26T12:04:23.132 INFO:teuthology.orchestra.run.smithi143.stdout: auth debug = true 2024-04-26T12:04:23.132 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.132 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on old message = true 2024-04-26T12:04:23.133 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on bug = true 2024-04-26T12:04:23.133 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.133 INFO:teuthology.orchestra.run.smithi143.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:04:23.133 INFO:teuthology.orchestra.run.smithi143.stdout: mon pg warn max object skew = 0 2024-04-26T12:04:23.133 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.133 INFO:teuthology.orchestra.run.smithi143.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:04:23.133 INFO:teuthology.orchestra.run.smithi143.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:04:23.133 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.133 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default size = 2 2024-04-26T12:04:23.133 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.133 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow primary affinity = true 2024-04-26T12:04:23.133 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow pg remap = true 2024-04-26T12:04:23.133 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:04:23.133 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:04:23.133 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on no sortbitwise = false 2024-04-26T12:04:23.134 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:04:23.134 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on too few osds = false 2024-04-26T12:04:23.134 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:04:23.134 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:04:23.134 INFO:teuthology.orchestra.run.smithi143.stdout: mon_allow_pool_size_one = true 2024-04-26T12:04:23.134 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.134 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:04:23.134 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.134 INFO:teuthology.orchestra.run.smithi143.stdout: osd default data pool replay window = 5 2024-04-26T12:04:23.134 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.134 INFO:teuthology.orchestra.run.smithi143.stdout: mon allow pool delete = true 2024-04-26T12:04:23.134 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.134 INFO:teuthology.orchestra.run.smithi143.stdout: mon cluster log file level = debug 2024-04-26T12:04:23.134 INFO:teuthology.orchestra.run.smithi143.stdout: debug asserts on shutdown = true 2024-04-26T12:04:23.134 INFO:teuthology.orchestra.run.smithi143.stdout: mon health detail to clog = false 2024-04-26T12:04:23.135 INFO:teuthology.orchestra.run.smithi143.stdout: mon host = "172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],[v2:172.21.15.52:3302,v1:172.21.15.52:6791]" 2024-04-26T12:04:23.135 INFO:teuthology.orchestra.run.smithi143.stdout: fsid = 5bc300ae-e948-4ce3-81bb-5abae8c06799 2024-04-26T12:04:23.135 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.135 INFO:teuthology.orchestra.run.smithi143.stdout:[osd] 2024-04-26T12:04:23.135 INFO:teuthology.orchestra.run.smithi143.stdout: osd journal size = 100 2024-04-26T12:04:23.135 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.135 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub load threshold = 5.0 2024-04-26T12:04:23.135 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub max interval = 600 2024-04-26T12:04:23.135 INFO:teuthology.orchestra.run.smithi143.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:04:23.135 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.135 INFO:teuthology.orchestra.run.smithi143.stdout: osd recover clone overlap = true 2024-04-26T12:04:23.135 INFO:teuthology.orchestra.run.smithi143.stdout: osd recovery max chunk = 1048576 2024-04-26T12:04:23.135 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.135 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug shutdown = true 2024-04-26T12:04:23.135 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug op order = true 2024-04-26T12:04:23.135 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug verify stray on activate = true 2024-04-26T12:04:23.136 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.136 INFO:teuthology.orchestra.run.smithi143.stdout: osd open classes on start = true 2024-04-26T12:04:23.136 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug pg log writeout = true 2024-04-26T12:04:23.136 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.136 INFO:teuthology.orchestra.run.smithi143.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:04:23.136 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.136 INFO:teuthology.orchestra.run.smithi143.stdout: osd map max advance = 10 2024-04-26T12:04:23.136 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.136 INFO:teuthology.orchestra.run.smithi143.stdout: journal zero on create = true 2024-04-26T12:04:23.136 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.136 INFO:teuthology.orchestra.run.smithi143.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:04:23.136 INFO:teuthology.orchestra.run.smithi143.stdout: filestore apply finisher threads = 3 2024-04-26T12:04:23.136 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.136 INFO:teuthology.orchestra.run.smithi143.stdout: bdev debug aio = true 2024-04-26T12:04:23.136 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug misdirected ops = true 2024-04-26T12:04:23.137 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore block size = 96636764160 2024-04-26T12:04:23.137 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore compression algorithm = zstd 2024-04-26T12:04:23.137 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore compression mode = aggressive 2024-04-26T12:04:23.137 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore fsck on mount = True 2024-04-26T12:04:23.137 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluefs = 1/20 2024-04-26T12:04:23.137 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluestore = 1/20 2024-04-26T12:04:23.137 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-04-26T12:04:23.137 INFO:teuthology.orchestra.run.smithi143.stdout: debug osd = 20 2024-04-26T12:04:23.137 INFO:teuthology.orchestra.run.smithi143.stdout: debug rocksdb = 4/10 2024-04-26T12:04:23.137 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:04:23.137 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd full ratio = 0.9 2024-04-26T12:04:23.137 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:04:23.137 INFO:teuthology.orchestra.run.smithi143.stdout: osd blocked scrub grace period = 3600 2024-04-26T12:04:23.137 INFO:teuthology.orchestra.run.smithi143.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:04:23.137 INFO:teuthology.orchestra.run.smithi143.stdout: osd max markdown count = 1000 2024-04-26T12:04:23.138 INFO:teuthology.orchestra.run.smithi143.stdout: osd objectstore = bluestore 2024-04-26T12:04:23.138 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.138 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr] 2024-04-26T12:04:23.138 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-04-26T12:04:23.138 INFO:teuthology.orchestra.run.smithi143.stdout: debug mgr = 20 2024-04-26T12:04:23.138 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2024-04-26T12:04:23.138 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2024-04-26T12:04:23.138 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:04:23.138 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:04:23.138 INFO:teuthology.orchestra.run.smithi143.stdout: mgr/telemetry/nag = false 2024-04-26T12:04:23.138 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.138 INFO:teuthology.orchestra.run.smithi143.stdout:[mon] 2024-04-26T12:04:23.138 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-04-26T12:04:23.138 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2024-04-26T12:04:23.138 INFO:teuthology.orchestra.run.smithi143.stdout: debug paxos = 20 2024-04-26T12:04:23.139 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2024-04-26T12:04:23.139 INFO:teuthology.orchestra.run.smithi143.stdout: mon data avail warn = 5 2024-04-26T12:04:23.139 INFO:teuthology.orchestra.run.smithi143.stdout: mon mgr mkfs grace = 240 2024-04-26T12:04:23.139 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:04:23.139 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd reporter subtree level = osd 2024-04-26T12:04:23.139 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd prime pg temp = true 2024-04-26T12:04:23.139 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:04:23.139 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.139 INFO:teuthology.orchestra.run.smithi143.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:04:23.139 INFO:teuthology.orchestra.run.smithi143.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:04:23.139 INFO:teuthology.orchestra.run.smithi143.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:04:23.139 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.139 INFO:teuthology.orchestra.run.smithi143.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:04:23.139 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:04:23.139 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:04:23.139 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.140 INFO:teuthology.orchestra.run.smithi143.stdout: # 1m isn't quite enough 2024-04-26T12:04:23.140 INFO:teuthology.orchestra.run.smithi143.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:04:23.140 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.140 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:04:23.140 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T12:04:23.140 INFO:teuthology.orchestra.run.smithi143.stdout:[client] 2024-04-26T12:04:23.140 INFO:teuthology.orchestra.run.smithi143.stdout: rgw cache enabled = true 2024-04-26T12:04:23.140 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable ops log = true 2024-04-26T12:04:23.140 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable usage log = true 2024-04-26T12:04:23.140 INFO:teuthology.orchestra.run.smithi143.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:04:23.140 INFO:teuthology.orchestra.run.smithi143.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:04:23.140 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.a] 2024-04-26T12:04:23.140 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.b] 2024-04-26T12:04:23.140 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.c] 2024-04-26T12:04:23.140 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.a] 2024-04-26T12:04:23.143 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T12:04:23.143 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T12:04:23.234 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T12:04:23.234 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T12:04:23.234 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T12:04:23.250 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T12:04:23.250 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T12:04:23.306 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi052.front.sepia.ceph.com 2024-04-26T12:04:23.306 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T12:04:23.306 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:04:23.306 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:04:23.379 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T12:04:23.379 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:04:23.437 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T12:04:23.437 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T12:04:23.437 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:04:23.437 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:04:23.476 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T12:04:23.476 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:04:23.533 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi154.front.sepia.ceph.com 2024-04-26T12:04:23.533 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-26T12:04:23.534 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:04:23.534 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:04:23.573 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-26T12:04:23.573 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:04:23.630 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi164.front.sepia.ceph.com 2024-04-26T12:04:23.630 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-26T12:04:23.631 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:04:23.631 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:04:23.669 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-26T12:04:23.670 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:04:23.727 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T12:04:23.727 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T12:04:23.727 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T12:04:23.778 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T12:04:23.780 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T12:04:23.830 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T12:04:23.832 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T12:04:23.833 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T12:04:23.882 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T12:04:23.884 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T12:04:23.908 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T12:04:23.908 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T12:04:23.988 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T12:04:24.000 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T12:04:24.000 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi143.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-26T12:04:24.000 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T12:04:24.029 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T12:04:24.029 INFO:tasks.ceph:role: osd.0 2024-04-26T12:04:24.029 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T12:04:24.029 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T12:04:24.104 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:04:24.104 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:04:24.104 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:04:24.104 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T12:04:24.104 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:04:24.104 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:04:24.104 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:04:24.105 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T12:04:24.105 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:04:24.105 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:04:24.597 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2024-04-26T12:04:24.599 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2024-04-26T12:04:24.600 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T12:04:24.732 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T12:04:24.764 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:04:24.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T12:04:24.859+0000 7f81eba18640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T12:04:24.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T12:04:24.859+0000 7f81eba18640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T12:04:24.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T12:04:24.859+0000 7f81eba18640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T12:04:24.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T12:04:24.859+0000 7f81eba18640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T12:04:24.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T12:04:24.859+0000 7f81eba18640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T12:04:24.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T12:04:24.864+0000 7f81eba18640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T12:04:27.709 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T12:04:27.737 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T12:04:27.766 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-26T12:04:27.766 INFO:tasks.ceph:role: osd.1 2024-04-26T12:04:27.766 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com 2024-04-26T12:04:27.767 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T12:04:27.840 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:04:27.840 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:04:27.840 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:04:27.841 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T12:04:27.841 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:04:27.841 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:04:27.841 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:04:27.841 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T12:04:27.841 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:04:27.841 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:04:28.363 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-04-26T12:04:28.365 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-04-26T12:04:28.366 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-26T12:04:28.478 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T12:04:28.512 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:04:28.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-26T12:04:28.603+0000 7f42dc80c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T12:04:28.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-26T12:04:28.605+0000 7f42dc80c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T12:04:28.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-26T12:04:28.605+0000 7f42dc80c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T12:04:28.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-26T12:04:28.605+0000 7f42dc80c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T12:04:28.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-26T12:04:28.605+0000 7f42dc80c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T12:04:28.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-26T12:04:28.611+0000 7f42dc80c640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T12:04:31.482 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T12:04:31.508 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T12:04:31.536 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-26T12:04:31.536 INFO:tasks.ceph:role: osd.2 2024-04-26T12:04:31.536 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com 2024-04-26T12:04:31.536 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T12:04:31.611 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:04:31.611 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:04:31.612 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:04:31.612 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T12:04:31.612 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:04:31.612 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:04:31.612 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:04:31.612 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T12:04:31.612 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:04:31.612 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:04:32.119 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-04-26T12:04:32.121 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-04-26T12:04:32.121 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-26T12:04:32.246 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T12:04:32.278 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:04:32.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-26T12:04:32.377+0000 7fde31b44640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T12:04:32.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-26T12:04:32.378+0000 7fde31b44640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T12:04:32.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-26T12:04:32.378+0000 7fde31b44640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T12:04:32.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-26T12:04:32.378+0000 7fde31b44640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T12:04:32.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-26T12:04:32.378+0000 7fde31b44640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T12:04:32.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-26T12:04:32.385+0000 7fde31b44640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T12:04:35.236 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T12:04:35.265 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T12:04:35.265 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T12:04:35.265 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T12:04:35.295 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T12:04:35.295 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T12:04:35.364 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T12:04:35.364 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T12:04:35.431 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T12:04:35.431 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T12:04:35.460 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-26T12:04:35.460 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T12:04:35.489 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-26T12:04:35.489 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T12:04:35.518 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T12:04:35.518 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T12:04:35.535 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T12:04:35.535 DEBUG:teuthology.orchestra.run.smithi052:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T12:04:35.602 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.x] 2024-04-26T12:04:35.602 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBHmCtmZBBeLhAAIgMNTMwm0yPs/YNi5NuyNQ== 2024-04-26T12:04:35.602 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.y] 2024-04-26T12:04:35.602 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBHmCtm+sB4MRAA7tXJ3YkBa9VdMW1J07F3rw== 2024-04-26T12:04:35.602 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2024-04-26T12:04:35.602 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBHmCtmuGKRNBAAGS2XznuTkdKcfJEc/Pmdcg== 2024-04-26T12:04:35.602 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.0] 2024-04-26T12:04:35.602 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBImCtmEzFJMxAAa4QNs+OArRXA8NwupfCjfA== 2024-04-26T12:04:35.603 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.1] 2024-04-26T12:04:35.603 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBMmCtmveQOJBAAMv3GJSE+Aq3LFcr1jEf3fg== 2024-04-26T12:04:35.603 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.2] 2024-04-26T12:04:35.603 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBQmCtmEV6UFhAApKC/9hcOiBF6m/kIdLVkCg== 2024-04-26T12:04:35.603 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-04-26T12:04:35.603 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBHmCtmZ5DoOhAAEQ3vAGGZX8klPszXoHPx6A== 2024-04-26T12:04:35.604 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T12:04:35.700 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T12:04:35.752 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T12:04:35.805 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:04:35.855 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:04:35.905 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:04:35.955 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T12:04:36.007 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T12:04:36.008 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T12:04:36.032 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T12:04:36.126 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T12:04:36.154 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T12:04:36.218 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T12:04:36.312 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T12:04:36.336 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T12:04:36.400 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T12:04:36.494 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T12:04:36.518 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:04:36.573 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T12:04:36.574 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T12:04:36.574 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T12:04:36.616 INFO:tasks.ceph.mon.a:Started 2024-04-26T12:04:36.616 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T12:04:36.616 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T12:04:36.618 INFO:tasks.ceph.mon.b:Started 2024-04-26T12:04:36.618 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T12:04:36.619 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T12:04:36.620 INFO:tasks.ceph.mon.c:Started 2024-04-26T12:04:36.621 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T12:04:36.621 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T12:04:36.621 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T12:04:36.623 INFO:tasks.ceph.mgr.x:Started 2024-04-26T12:04:36.623 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T12:04:36.623 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T12:04:36.626 INFO:tasks.ceph.mgr.y:Started 2024-04-26T12:04:36.627 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T12:04:36.627 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T12:04:42.053 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:42.051+0000 7f6187419040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T12:04:42.340 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:42.338+0000 7f6187419040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:04:42.396 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:42.394+0000 7f6187419040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T12:04:42.639 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:42.637+0000 7f6187419040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T12:04:42.685 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:42.684+0000 7f6187419040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T12:04:42.798 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T12:04:42.797+0000 7fc40096d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T12:04:42.846 INFO:teuthology.orchestra.run.smithi052.stderr:adjusted tunables profile to default 2024-04-26T12:04:42.857 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T12:04:42.857 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T12:04:42.858 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T12:04:42.858 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T12:04:42.886 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-26T12:04:42.886 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T12:04:42.915 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-26T12:04:42.915 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T12:04:42.917 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T12:04:42.916+0000 7fc40096d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:04:42.943 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 638cfa85-e921-4403-9bcb-a7f4653cc3b2 0 2024-04-26T12:04:42.970 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T12:04:42.968+0000 7fc40096d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T12:04:43.172 INFO:teuthology.orchestra.run.smithi164.stdout:0 2024-04-26T12:04:43.183 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 2abc8d1e-ad72-4643-ad1e-3566e5113c44 1 2024-04-26T12:04:43.188 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T12:04:43.186+0000 7fc40096d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T12:04:43.234 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T12:04:43.232+0000 7fc40096d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T12:04:43.357 INFO:teuthology.orchestra.run.smithi164.stdout:1 2024-04-26T12:04:43.368 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new d2ebc562-cb9b-4089-a19b-1788b70b57dc 2 2024-04-26T12:04:43.455 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:43.453+0000 7f6187419040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T12:04:43.542 INFO:teuthology.orchestra.run.smithi164.stdout:2 2024-04-26T12:04:43.550 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:43.548+0000 7f6187419040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T12:04:43.554 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T12:04:43.555 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T12:04:43.557 INFO:tasks.ceph.osd.0:Started 2024-04-26T12:04:43.557 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T12:04:43.557 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T12:04:43.560 INFO:tasks.ceph.osd.1:Started 2024-04-26T12:04:43.560 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T12:04:43.560 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T12:04:43.562 INFO:tasks.ceph.osd.2:Started 2024-04-26T12:04:43.563 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:04:43.597 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:43.595+0000 7f6187419040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T12:04:43.737 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:43.737 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"fsid":"5bc300ae-e948-4ce3-81bb-5abae8c06799","created":"2024-04-26T12:04:41.919527+0000","modified":"2024-04-26T12:04:43.540390+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T12:04:43.540390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"638cfa85-e921-4403-9bcb-a7f4653cc3b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2abc8d1e-ad72-4643-ad1e-3566e5113c44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d2ebc562-cb9b-4089-a19b-1788b70b57dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:04:43.748 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T12:04:43.748 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T12:04:43.754 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T12:04:43.752+0000 7fc40096d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T12:04:43.778 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:43.776+0000 7f6187419040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T12:04:43.835 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:43.833+0000 7f6187419040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T12:04:43.844 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T12:04:43.842+0000 7fc40096d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T12:04:43.888 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T12:04:43.887+0000 7fc40096d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T12:04:43.890 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:43.889+0000 7f6187419040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T12:04:44.010 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:44.008+0000 7f6187419040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:04:44.050 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T12:04:44.062 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T12:04:44.061+0000 7fc40096d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T12:04:44.111 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T12:04:44.109+0000 7fc40096d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T12:04:44.154 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:04:44.152+0000 7f3dada25640 -1 Falling back to public interface 2024-04-26T12:04:44.154 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:04:44.153+0000 7fdf46edd640 -1 Falling back to public interface 2024-04-26T12:04:44.155 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:04:44.153+0000 7f87d2333640 -1 Falling back to public interface 2024-04-26T12:04:44.165 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T12:04:44.163+0000 7fc40096d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T12:04:44.213 INFO:teuthology.misc.health.smithi052.stdout: 2024-04-26T12:04:44.213 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":5,"fsid":"5bc300ae-e948-4ce3-81bb-5abae8c06799","created":"2024-04-26T12:04:41.919527+0000","modified":"2024-04-26T12:04:43.540390+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T12:04:43.540390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"638cfa85-e921-4403-9bcb-a7f4653cc3b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2abc8d1e-ad72-4643-ad1e-3566e5113c44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d2ebc562-cb9b-4089-a19b-1788b70b57dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:04:44.227 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-26T12:04:44.283 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T12:04:44.281+0000 7fc40096d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:04:44.423 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:44.421+0000 7f6187419040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T12:04:44.626 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T12:04:44.625+0000 7fc40096d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T12:04:44.696 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:44.694+0000 7f6187419040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T12:04:44.751 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:44.749+0000 7f6187419040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T12:04:44.849 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T12:04:44.847+0000 7fc40096d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T12:04:44.873 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:44.871+0000 7f6187419040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T12:04:44.901 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T12:04:44.900+0000 7fc40096d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T12:04:45.022 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T12:04:45.020+0000 7fc40096d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T12:04:45.166 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:45.164+0000 7f6187419040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T12:04:45.216 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:45.214+0000 7f6187419040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T12:04:45.305 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T12:04:45.303+0000 7fc40096d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T12:04:45.351 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T12:04:45.349+0000 7fc40096d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T12:04:45.381 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:45.380+0000 7f6187419040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T12:04:45.504 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T12:04:45.502+0000 7fc40096d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T12:04:45.527 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:45.525+0000 7f6187419040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T12:04:45.580 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:45.578+0000 7f6187419040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T12:04:45.646 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T12:04:45.644+0000 7fc40096d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T12:04:45.654 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:45.653+0000 7f6187419040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T12:04:45.697 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T12:04:45.695+0000 7fc40096d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T12:04:45.702 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:45.700+0000 7f6187419040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T12:04:45.754 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T12:04:45.752+0000 7fc40096d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T12:04:45.799 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T12:04:45.797+0000 7fc40096d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T12:04:46.202 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:46.200+0000 7f6187419040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T12:04:46.210 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T12:04:46.209+0000 7fc40096d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T12:04:46.324 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:46.322+0000 7f6187419040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T12:04:46.336 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T12:04:46.335+0000 7fc40096d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T12:04:47.340 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:47.338+0000 7f6127dc1640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T12:04:47.340 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T12:04:47.338+0000 7f6127dc1640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T12:04:47.570 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:04:47.569+0000 7f3dada25640 -1 osd.0 0 log_to_monitors true 2024-04-26T12:04:47.723 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:04:47.598+0000 7fdf46edd640 -1 osd.2 0 log_to_monitors true 2024-04-26T12:04:47.723 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:04:47.579+0000 7f87d2333640 -1 osd.1 0 log_to_monitors true 2024-04-26T12:04:50.072 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:04:50.071+0000 7f3da945d640 -1 osd.0 0 waiting for initial osdmap 2024-04-26T12:04:50.082 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:04:50.081+0000 7f3da127e640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:04:50.083 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:04:50.081+0000 7f87cead7640 -1 osd.1 0 waiting for initial osdmap 2024-04-26T12:04:50.100 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:04:50.099+0000 7f87c60e1640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:04:50.101 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:04:50.099+0000 7fdf42e6a640 -1 osd.2 0 waiting for initial osdmap 2024-04-26T12:04:50.118 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:04:50.117+0000 7fdf3ac8b640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:04:50.530 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T12:04:50.831 INFO:teuthology.misc.health.smithi052.stdout: 2024-04-26T12:04:50.832 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":7,"fsid":"5bc300ae-e948-4ce3-81bb-5abae8c06799","created":"2024-04-26T12:04:41.919527+0000","modified":"2024-04-26T12:04:49.337125+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T12:04:43.540390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"638cfa85-e921-4403-9bcb-a7f4653cc3b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2abc8d1e-ad72-4643-ad1e-3566e5113c44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d2ebc562-cb9b-4089-a19b-1788b70b57dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:04:50.843 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-26T12:04:57.145 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T12:04:57.442 INFO:teuthology.misc.health.smithi052.stdout: 2024-04-26T12:04:57.442 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":11,"fsid":"5bc300ae-e948-4ce3-81bb-5abae8c06799","created":"2024-04-26T12:04:41.919527+0000","modified":"2024-04-26T12:04:54.386165+0000","last_up_change":"2024-04-26T12:04:51.084680+0000","last_in_change":"2024-04-26T12:04:43.540390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:04:52.376506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"638cfa85-e921-4403-9bcb-a7f4653cc3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":28597},{"type":"v1","addr":"172.21.15.143:6801","nonce":28597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":28597},{"type":"v1","addr":"172.21.15.143:6803","nonce":28597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":28597},{"type":"v1","addr":"172.21.15.143:6807","nonce":28597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":28597},{"type":"v1","addr":"172.21.15.143:6805","nonce":28597}]},"public_addr":"172.21.15.143:6801/28597","cluster_addr":"172.21.15.143:6803/28597","heartbeat_back_addr":"172.21.15.143:6807/28597","heartbeat_front_addr":"172.21.15.143:6805/28597","state":["exists","up"]},{"osd":1,"uuid":"2abc8d1e-ad72-4643-ad1e-3566e5113c44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":28560},{"type":"v1","addr":"172.21.15.154:6801","nonce":28560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":28560},{"type":"v1","addr":"172.21.15.154:6803","nonce":28560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":28560},{"type":"v1","addr":"172.21.15.154:6807","nonce":28560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":28560},{"type":"v1","addr":"172.21.15.154:6805","nonce":28560}]},"public_addr":"172.21.15.154:6801/28560","cluster_addr":"172.21.15.154:6803/28560","heartbeat_back_addr":"172.21.15.154:6807/28560","heartbeat_front_addr":"172.21.15.154:6805/28560","state":["exists","up"]},{"osd":2,"uuid":"d2ebc562-cb9b-4089-a19b-1788b70b57dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":28709},{"type":"v1","addr":"172.21.15.164:6801","nonce":28709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":28709},{"type":"v1","addr":"172.21.15.164:6803","nonce":28709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":28709},{"type":"v1","addr":"172.21.15.164:6807","nonce":28709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":28709},{"type":"v1","addr":"172.21.15.164:6805","nonce":28709}]},"public_addr":"172.21.15.164:6801/28709","cluster_addr":"172.21.15.164:6803/28709","heartbeat_back_addr":"172.21.15.164:6807/28709","heartbeat_front_addr":"172.21.15.164:6805/28709","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.573478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.624482+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.615449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:04:57.453 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-04-26T12:04:57.454 INFO:tasks.ceph:Creating RBD pool 2024-04-26T12:04:57.454 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-26T12:04:58.402 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'rbd' created 2024-04-26T12:04:58.416 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-26T12:04:59.402 INFO:teuthology.orchestra.run.smithi052.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-26T12:04:59.419 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T12:04:59.420 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T12:04:59.420 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T12:04:59.422 INFO:tasks.ceph.mds.a:Started 2024-04-26T12:04:59.422 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T12:04:59.423 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:04:59.503 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-04-26T12:04:59.725 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:04:59.725 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":13,"fsid":"5bc300ae-e948-4ce3-81bb-5abae8c06799","created":"2024-04-26T12:04:41.919527+0000","modified":"2024-04-26T12:04:59.397956+0000","last_up_change":"2024-04-26T12:04:51.084680+0000","last_in_change":"2024-04-26T12:04:43.540390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:04:52.376506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:04:57.775333+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"638cfa85-e921-4403-9bcb-a7f4653cc3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":28597},{"type":"v1","addr":"172.21.15.143:6801","nonce":28597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":28597},{"type":"v1","addr":"172.21.15.143:6803","nonce":28597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":28597},{"type":"v1","addr":"172.21.15.143:6807","nonce":28597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":28597},{"type":"v1","addr":"172.21.15.143:6805","nonce":28597}]},"public_addr":"172.21.15.143:6801/28597","cluster_addr":"172.21.15.143:6803/28597","heartbeat_back_addr":"172.21.15.143:6807/28597","heartbeat_front_addr":"172.21.15.143:6805/28597","state":["exists","up"]},{"osd":1,"uuid":"2abc8d1e-ad72-4643-ad1e-3566e5113c44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":28560},{"type":"v1","addr":"172.21.15.154:6801","nonce":28560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":28560},{"type":"v1","addr":"172.21.15.154:6803","nonce":28560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":28560},{"type":"v1","addr":"172.21.15.154:6807","nonce":28560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":28560},{"type":"v1","addr":"172.21.15.154:6805","nonce":28560}]},"public_addr":"172.21.15.154:6801/28560","cluster_addr":"172.21.15.154:6803/28560","heartbeat_back_addr":"172.21.15.154:6807/28560","heartbeat_front_addr":"172.21.15.154:6805/28560","state":["exists","up"]},{"osd":2,"uuid":"d2ebc562-cb9b-4089-a19b-1788b70b57dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":28709},{"type":"v1","addr":"172.21.15.164:6801","nonce":28709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":28709},{"type":"v1","addr":"172.21.15.164:6803","nonce":28709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":28709},{"type":"v1","addr":"172.21.15.164:6807","nonce":28709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":28709},{"type":"v1","addr":"172.21.15.164:6805","nonce":28709}]},"public_addr":"172.21.15.164:6801/28709","cluster_addr":"172.21.15.164:6803/28709","heartbeat_back_addr":"172.21.15.164:6807/28709","heartbeat_front_addr":"172.21.15.164:6805/28709","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.573478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.624482+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.615449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:04:59.737 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:04:52.376506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:04:57.775333+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T12:04:59.738 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:05:00.029 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-04-26T12:05:00.042 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:05:00.333 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2024-04-26T12:05:00.345 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:05:00.674 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:00.674 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14144,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6803/2910214683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2910214683},{"type":"v1","addr":"172.21.15.52:6803","nonce":2910214683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-04-26T12:05:00.674 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 2 2024-04-26T12:05:00.686 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:05:00.978 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:00.979 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":14,"fsid":"5bc300ae-e948-4ce3-81bb-5abae8c06799","created":"2024-04-26T12:04:41.919527+0000","modified":"2024-04-26T12:05:00.403207+0000","last_up_change":"2024-04-26T12:04:51.084680+0000","last_in_change":"2024-04-26T12:04:43.540390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:04:52.376506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:04:57.775333+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"638cfa85-e921-4403-9bcb-a7f4653cc3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":28597},{"type":"v1","addr":"172.21.15.143:6801","nonce":28597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":28597},{"type":"v1","addr":"172.21.15.143:6803","nonce":28597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":28597},{"type":"v1","addr":"172.21.15.143:6807","nonce":28597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":28597},{"type":"v1","addr":"172.21.15.143:6805","nonce":28597}]},"public_addr":"172.21.15.143:6801/28597","cluster_addr":"172.21.15.143:6803/28597","heartbeat_back_addr":"172.21.15.143:6807/28597","heartbeat_front_addr":"172.21.15.143:6805/28597","state":["exists","up"]},{"osd":1,"uuid":"2abc8d1e-ad72-4643-ad1e-3566e5113c44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":28560},{"type":"v1","addr":"172.21.15.154:6801","nonce":28560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":28560},{"type":"v1","addr":"172.21.15.154:6803","nonce":28560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":28560},{"type":"v1","addr":"172.21.15.154:6807","nonce":28560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":28560},{"type":"v1","addr":"172.21.15.154:6805","nonce":28560}]},"public_addr":"172.21.15.154:6801/28560","cluster_addr":"172.21.15.154:6803/28560","heartbeat_back_addr":"172.21.15.154:6807/28560","heartbeat_front_addr":"172.21.15.154:6805/28560","state":["exists","up"]},{"osd":2,"uuid":"d2ebc562-cb9b-4089-a19b-1788b70b57dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":28709},{"type":"v1","addr":"172.21.15.164:6801","nonce":28709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":28709},{"type":"v1","addr":"172.21.15.164:6803","nonce":28709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":28709},{"type":"v1","addr":"172.21.15.164:6807","nonce":28709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":28709},{"type":"v1","addr":"172.21.15.164:6805","nonce":28709}]},"public_addr":"172.21.15.164:6801/28709","cluster_addr":"172.21.15.164:6803/28709","heartbeat_back_addr":"172.21.15.164:6807/28709","heartbeat_front_addr":"172.21.15.164:6805/28709","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.573478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.624482+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.615449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:05:00.991 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:04:52.376506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:04:57.775333+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T12:05:00.991 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:05:01.283 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-04-26T12:05:01.295 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:05:01.586 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2024-04-26T12:05:01.599 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T12:05:01.891 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:01.891 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2024-04-26T12:05:01.891 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:01.891 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2024-04-26T12:05:01.891 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2024-04-26T12:05:01.891 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:01.891 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:01.891 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 2, 2024-04-26T12:05:01.891 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "rbd" 2024-04-26T12:05:01.891 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:01.891 INFO:teuthology.orchestra.run.smithi052.stdout:] 2024-04-26T12:05:01.903 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T12:05:01.903 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T12:05:02.415 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2024-04-26T12:05:02.429 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T12:05:03.419 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2024-04-26T12:05:03.437 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T12:05:03.779 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 3 and data pool 4 2024-04-26T12:05:03.793 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:05:04.089 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:04.089 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":17,"fsid":"5bc300ae-e948-4ce3-81bb-5abae8c06799","created":"2024-04-26T12:04:41.919527+0000","modified":"2024-04-26T12:05:03.774411+0000","last_up_change":"2024-04-26T12:04:51.084680+0000","last_in_change":"2024-04-26T12:04:43.540390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:04:52.376506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:04:57.775333+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:05:02.226064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:05:02.758806+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"638cfa85-e921-4403-9bcb-a7f4653cc3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":28597},{"type":"v1","addr":"172.21.15.143:6801","nonce":28597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":28597},{"type":"v1","addr":"172.21.15.143:6803","nonce":28597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":28597},{"type":"v1","addr":"172.21.15.143:6807","nonce":28597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":28597},{"type":"v1","addr":"172.21.15.143:6805","nonce":28597}]},"public_addr":"172.21.15.143:6801/28597","cluster_addr":"172.21.15.143:6803/28597","heartbeat_back_addr":"172.21.15.143:6807/28597","heartbeat_front_addr":"172.21.15.143:6805/28597","state":["exists","up"]},{"osd":1,"uuid":"2abc8d1e-ad72-4643-ad1e-3566e5113c44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":28560},{"type":"v1","addr":"172.21.15.154:6801","nonce":28560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":28560},{"type":"v1","addr":"172.21.15.154:6803","nonce":28560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":28560},{"type":"v1","addr":"172.21.15.154:6807","nonce":28560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":28560},{"type":"v1","addr":"172.21.15.154:6805","nonce":28560}]},"public_addr":"172.21.15.154:6801/28560","cluster_addr":"172.21.15.154:6803/28560","heartbeat_back_addr":"172.21.15.154:6807/28560","heartbeat_front_addr":"172.21.15.154:6805/28560","state":["exists","up"]},{"osd":2,"uuid":"d2ebc562-cb9b-4089-a19b-1788b70b57dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":28709},{"type":"v1","addr":"172.21.15.164:6801","nonce":28709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":28709},{"type":"v1","addr":"172.21.15.164:6803","nonce":28709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":28709},{"type":"v1","addr":"172.21.15.164:6807","nonce":28709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":28709},{"type":"v1","addr":"172.21.15.164:6805","nonce":28709}]},"public_addr":"172.21.15.164:6801/28709","cluster_addr":"172.21.15.164:6803/28709","heartbeat_back_addr":"172.21.15.164:6807/28709","heartbeat_front_addr":"172.21.15.164:6805/28709","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.573478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.624482+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.615449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:05:04.102 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:05:04.393 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:04.394 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":17,"fsid":"5bc300ae-e948-4ce3-81bb-5abae8c06799","created":"2024-04-26T12:04:41.919527+0000","modified":"2024-04-26T12:05:03.774411+0000","last_up_change":"2024-04-26T12:04:51.084680+0000","last_in_change":"2024-04-26T12:04:43.540390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:04:52.376506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:04:57.775333+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:05:02.226064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:05:02.758806+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"638cfa85-e921-4403-9bcb-a7f4653cc3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":28597},{"type":"v1","addr":"172.21.15.143:6801","nonce":28597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":28597},{"type":"v1","addr":"172.21.15.143:6803","nonce":28597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":28597},{"type":"v1","addr":"172.21.15.143:6807","nonce":28597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":28597},{"type":"v1","addr":"172.21.15.143:6805","nonce":28597}]},"public_addr":"172.21.15.143:6801/28597","cluster_addr":"172.21.15.143:6803/28597","heartbeat_back_addr":"172.21.15.143:6807/28597","heartbeat_front_addr":"172.21.15.143:6805/28597","state":["exists","up"]},{"osd":1,"uuid":"2abc8d1e-ad72-4643-ad1e-3566e5113c44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":28560},{"type":"v1","addr":"172.21.15.154:6801","nonce":28560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":28560},{"type":"v1","addr":"172.21.15.154:6803","nonce":28560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":28560},{"type":"v1","addr":"172.21.15.154:6807","nonce":28560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":28560},{"type":"v1","addr":"172.21.15.154:6805","nonce":28560}]},"public_addr":"172.21.15.154:6801/28560","cluster_addr":"172.21.15.154:6803/28560","heartbeat_back_addr":"172.21.15.154:6807/28560","heartbeat_front_addr":"172.21.15.154:6805/28560","state":["exists","up"]},{"osd":2,"uuid":"d2ebc562-cb9b-4089-a19b-1788b70b57dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":28709},{"type":"v1","addr":"172.21.15.164:6801","nonce":28709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":28709},{"type":"v1","addr":"172.21.15.164:6803","nonce":28709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":28709},{"type":"v1","addr":"172.21.15.164:6807","nonce":28709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":28709},{"type":"v1","addr":"172.21.15.164:6805","nonce":28709}]},"public_addr":"172.21.15.164:6801/28709","cluster_addr":"172.21.15.164:6803/28709","heartbeat_back_addr":"172.21.15.164:6807/28709","heartbeat_front_addr":"172.21.15.164:6805/28709","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.573478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.624482+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.615449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:05:04.406 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T12:05:04.795 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T12:05:04.795 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T12:05:05.798 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T12:05:05.798 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:05:06.132 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:06.133 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:05:03.774692+0000","modified":"2024-04-26T12:05:05.779112+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14144},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14144":{"gid":14144,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6803/2910214683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2910214683},{"type":"v1","addr":"172.21.15.52:6803","nonce":2910214683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:05:06.133 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 5 2024-04-26T12:05:06.145 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:05:06.438 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:06.438 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":18,"fsid":"5bc300ae-e948-4ce3-81bb-5abae8c06799","created":"2024-04-26T12:04:41.919527+0000","modified":"2024-04-26T12:05:04.776193+0000","last_up_change":"2024-04-26T12:04:51.084680+0000","last_in_change":"2024-04-26T12:04:43.540390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:04:52.376506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:04:57.775333+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:05:02.226064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:05:02.758806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"638cfa85-e921-4403-9bcb-a7f4653cc3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":28597},{"type":"v1","addr":"172.21.15.143:6801","nonce":28597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":28597},{"type":"v1","addr":"172.21.15.143:6803","nonce":28597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":28597},{"type":"v1","addr":"172.21.15.143:6807","nonce":28597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":28597},{"type":"v1","addr":"172.21.15.143:6805","nonce":28597}]},"public_addr":"172.21.15.143:6801/28597","cluster_addr":"172.21.15.143:6803/28597","heartbeat_back_addr":"172.21.15.143:6807/28597","heartbeat_front_addr":"172.21.15.143:6805/28597","state":["exists","up"]},{"osd":1,"uuid":"2abc8d1e-ad72-4643-ad1e-3566e5113c44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":28560},{"type":"v1","addr":"172.21.15.154:6801","nonce":28560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":28560},{"type":"v1","addr":"172.21.15.154:6803","nonce":28560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":28560},{"type":"v1","addr":"172.21.15.154:6807","nonce":28560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":28560},{"type":"v1","addr":"172.21.15.154:6805","nonce":28560}]},"public_addr":"172.21.15.154:6801/28560","cluster_addr":"172.21.15.154:6803/28560","heartbeat_back_addr":"172.21.15.154:6807/28560","heartbeat_front_addr":"172.21.15.154:6805/28560","state":["exists","up"]},{"osd":2,"uuid":"d2ebc562-cb9b-4089-a19b-1788b70b57dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":28709},{"type":"v1","addr":"172.21.15.164:6801","nonce":28709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":28709},{"type":"v1","addr":"172.21.15.164:6803","nonce":28709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":28709},{"type":"v1","addr":"172.21.15.164:6807","nonce":28709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":28709},{"type":"v1","addr":"172.21.15.164:6805","nonce":28709}]},"public_addr":"172.21.15.164:6801/28709","cluster_addr":"172.21.15.164:6803/28709","heartbeat_back_addr":"172.21.15.164:6807/28709","heartbeat_front_addr":"172.21.15.164:6805/28709","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.573478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.624482+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.615449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:05:06.450 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T12:05:06.450 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:05:06.747 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:06.749 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:05:06.757 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-26T12:05:06.333030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81540,"kb_used_data":464,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033980,"statfs":{"total":289910292480,"available":289826795520,"internally_reserved":0,"allocated":475136,"data_stored":1287369,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000611"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":209,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-26T12:04:59.401154+0000","last_change":"2024-04-26T12:04:53.388840+0000","last_active":"2024-04-26T12:04:59.401154+0000","last_peered":"2024-04-26T12:04:59.401154+0000","last_clean":"2024-04-26T12:04:59.401154+0000","last_became_active":"2024-04-26T12:04:53.388568+0000","last_became_peered":"2024-04-26T12:04:53.388568+0000","last_unstale":"2024-04-26T12:04:59.401154+0000","last_undegraded":"2024-04-26T12:04:59.401154+0000","last_fullsized":"2024-04-26T12:04:59.401154+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_clean_scrub_stamp":"2024-04-26T12:04:52.376986+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:04.970330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408637+0000","last_change":"2024-04-26T12:04:59.403711+0000","last_active":"2024-04-26T12:05:00.408637+0000","last_peered":"2024-04-26T12:05:00.408637+0000","last_clean":"2024-04-26T12:05:00.408637+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:05:00.408637+0000","last_undegraded":"2024-04-26T12:05:00.408637+0000","last_fullsized":"2024-04-26T12:05:00.408637+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:45.779614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408626+0000","last_change":"2024-04-26T12:04:59.405437+0000","last_active":"2024-04-26T12:05:00.408626+0000","last_peered":"2024-04-26T12:05:00.408626+0000","last_clean":"2024-04-26T12:05:00.408626+0000","last_became_active":"2024-04-26T12:04:59.405193+0000","last_became_peered":"2024-04-26T12:04:59.405193+0000","last_unstale":"2024-04-26T12:05:00.408626+0000","last_undegraded":"2024-04-26T12:05:00.408626+0000","last_fullsized":"2024-04-26T12:05:00.408626+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:20.977569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408517+0000","last_change":"2024-04-26T12:04:59.405617+0000","last_active":"2024-04-26T12:05:00.408517+0000","last_peered":"2024-04-26T12:05:00.408517+0000","last_clean":"2024-04-26T12:05:00.408517+0000","last_became_active":"2024-04-26T12:04:59.405328+0000","last_became_peered":"2024-04-26T12:04:59.405328+0000","last_unstale":"2024-04-26T12:05:00.408517+0000","last_undegraded":"2024-04-26T12:05:00.408517+0000","last_fullsized":"2024-04-26T12:05:00.408517+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:39.317039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408652+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:05:00.408652+0000","last_peered":"2024-04-26T12:05:00.408652+0000","last_clean":"2024-04-26T12:05:00.408652+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:05:00.408652+0000","last_undegraded":"2024-04-26T12:05:00.408652+0000","last_fullsized":"2024-04-26T12:05:00.408652+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:12.939539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408519+0000","last_change":"2024-04-26T12:04:59.405766+0000","last_active":"2024-04-26T12:05:00.408519+0000","last_peered":"2024-04-26T12:05:00.408519+0000","last_clean":"2024-04-26T12:05:00.408519+0000","last_became_active":"2024-04-26T12:04:59.405406+0000","last_became_peered":"2024-04-26T12:04:59.405406+0000","last_unstale":"2024-04-26T12:05:00.408519+0000","last_undegraded":"2024-04-26T12:05:00.408519+0000","last_fullsized":"2024-04-26T12:05:00.408519+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:13.860871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-26T12:04:59.410237+0000","last_change":"2024-04-26T12:04:59.405294+0000","last_active":"2024-04-26T12:04:59.410237+0000","last_peered":"2024-04-26T12:04:59.410237+0000","last_clean":"2024-04-26T12:04:59.410237+0000","last_became_active":"2024-04-26T12:04:59.405044+0000","last_became_peered":"2024-04-26T12:04:59.405044+0000","last_unstale":"2024-04-26T12:04:59.410237+0000","last_undegraded":"2024-04-26T12:04:59.410237+0000","last_fullsized":"2024-04-26T12:04:59.410237+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:47.042833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408520+0000","last_change":"2024-04-26T12:04:59.405667+0000","last_active":"2024-04-26T12:05:00.408520+0000","last_peered":"2024-04-26T12:05:00.408520+0000","last_clean":"2024-04-26T12:05:00.408520+0000","last_became_active":"2024-04-26T12:04:59.405328+0000","last_became_peered":"2024-04-26T12:04:59.405328+0000","last_unstale":"2024-04-26T12:05:00.408520+0000","last_undegraded":"2024-04-26T12:05:00.408520+0000","last_fullsized":"2024-04-26T12:05:00.408520+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:20.977569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408619+0000","last_change":"2024-04-26T12:04:59.408078+0000","last_active":"2024-04-26T12:05:00.408619+0000","last_peered":"2024-04-26T12:05:00.408619+0000","last_clean":"2024-04-26T12:05:00.408619+0000","last_became_active":"2024-04-26T12:04:59.407804+0000","last_became_peered":"2024-04-26T12:04:59.407804+0000","last_unstale":"2024-04-26T12:05:00.408619+0000","last_undegraded":"2024-04-26T12:05:00.408619+0000","last_fullsized":"2024-04-26T12:05:00.408619+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:56.449518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":180224,"data_stored":627145,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":623447,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":122880,"data_stored":36777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:05:06.764 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:05:07.097 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:07.098 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:05:07.108 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-26T12:05:06.333030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81540,"kb_used_data":464,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033980,"statfs":{"total":289910292480,"available":289826795520,"internally_reserved":0,"allocated":475136,"data_stored":1287369,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000611"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":209,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-26T12:04:59.401154+0000","last_change":"2024-04-26T12:04:53.388840+0000","last_active":"2024-04-26T12:04:59.401154+0000","last_peered":"2024-04-26T12:04:59.401154+0000","last_clean":"2024-04-26T12:04:59.401154+0000","last_became_active":"2024-04-26T12:04:53.388568+0000","last_became_peered":"2024-04-26T12:04:53.388568+0000","last_unstale":"2024-04-26T12:04:59.401154+0000","last_undegraded":"2024-04-26T12:04:59.401154+0000","last_fullsized":"2024-04-26T12:04:59.401154+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_clean_scrub_stamp":"2024-04-26T12:04:52.376986+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:04.970330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408637+0000","last_change":"2024-04-26T12:04:59.403711+0000","last_active":"2024-04-26T12:05:00.408637+0000","last_peered":"2024-04-26T12:05:00.408637+0000","last_clean":"2024-04-26T12:05:00.408637+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:05:00.408637+0000","last_undegraded":"2024-04-26T12:05:00.408637+0000","last_fullsized":"2024-04-26T12:05:00.408637+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:45.779614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408626+0000","last_change":"2024-04-26T12:04:59.405437+0000","last_active":"2024-04-26T12:05:00.408626+0000","last_peered":"2024-04-26T12:05:00.408626+0000","last_clean":"2024-04-26T12:05:00.408626+0000","last_became_active":"2024-04-26T12:04:59.405193+0000","last_became_peered":"2024-04-26T12:04:59.405193+0000","last_unstale":"2024-04-26T12:05:00.408626+0000","last_undegraded":"2024-04-26T12:05:00.408626+0000","last_fullsized":"2024-04-26T12:05:00.408626+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:20.977569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408517+0000","last_change":"2024-04-26T12:04:59.405617+0000","last_active":"2024-04-26T12:05:00.408517+0000","last_peered":"2024-04-26T12:05:00.408517+0000","last_clean":"2024-04-26T12:05:00.408517+0000","last_became_active":"2024-04-26T12:04:59.405328+0000","last_became_peered":"2024-04-26T12:04:59.405328+0000","last_unstale":"2024-04-26T12:05:00.408517+0000","last_undegraded":"2024-04-26T12:05:00.408517+0000","last_fullsized":"2024-04-26T12:05:00.408517+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:39.317039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408652+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:05:00.408652+0000","last_peered":"2024-04-26T12:05:00.408652+0000","last_clean":"2024-04-26T12:05:00.408652+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:05:00.408652+0000","last_undegraded":"2024-04-26T12:05:00.408652+0000","last_fullsized":"2024-04-26T12:05:00.408652+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:12.939539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408519+0000","last_change":"2024-04-26T12:04:59.405766+0000","last_active":"2024-04-26T12:05:00.408519+0000","last_peered":"2024-04-26T12:05:00.408519+0000","last_clean":"2024-04-26T12:05:00.408519+0000","last_became_active":"2024-04-26T12:04:59.405406+0000","last_became_peered":"2024-04-26T12:04:59.405406+0000","last_unstale":"2024-04-26T12:05:00.408519+0000","last_undegraded":"2024-04-26T12:05:00.408519+0000","last_fullsized":"2024-04-26T12:05:00.408519+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:13.860871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-26T12:04:59.410237+0000","last_change":"2024-04-26T12:04:59.405294+0000","last_active":"2024-04-26T12:04:59.410237+0000","last_peered":"2024-04-26T12:04:59.410237+0000","last_clean":"2024-04-26T12:04:59.410237+0000","last_became_active":"2024-04-26T12:04:59.405044+0000","last_became_peered":"2024-04-26T12:04:59.405044+0000","last_unstale":"2024-04-26T12:04:59.410237+0000","last_undegraded":"2024-04-26T12:04:59.410237+0000","last_fullsized":"2024-04-26T12:04:59.410237+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:47.042833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408520+0000","last_change":"2024-04-26T12:04:59.405667+0000","last_active":"2024-04-26T12:05:00.408520+0000","last_peered":"2024-04-26T12:05:00.408520+0000","last_clean":"2024-04-26T12:05:00.408520+0000","last_became_active":"2024-04-26T12:04:59.405328+0000","last_became_peered":"2024-04-26T12:04:59.405328+0000","last_unstale":"2024-04-26T12:05:00.408520+0000","last_undegraded":"2024-04-26T12:05:00.408520+0000","last_fullsized":"2024-04-26T12:05:00.408520+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:20.977569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408619+0000","last_change":"2024-04-26T12:04:59.408078+0000","last_active":"2024-04-26T12:05:00.408619+0000","last_peered":"2024-04-26T12:05:00.408619+0000","last_clean":"2024-04-26T12:05:00.408619+0000","last_became_active":"2024-04-26T12:04:59.407804+0000","last_became_peered":"2024-04-26T12:04:59.407804+0000","last_unstale":"2024-04-26T12:05:00.408619+0000","last_undegraded":"2024-04-26T12:05:00.408619+0000","last_fullsized":"2024-04-26T12:05:00.408619+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:56.449518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":180224,"data_stored":627145,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":623447,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":122880,"data_stored":36777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:05:07.111 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:05:07.448 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:07.450 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:05:07.459 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-26T12:05:06.333030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81540,"kb_used_data":464,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033980,"statfs":{"total":289910292480,"available":289826795520,"internally_reserved":0,"allocated":475136,"data_stored":1287369,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000611"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":209,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-26T12:04:59.401154+0000","last_change":"2024-04-26T12:04:53.388840+0000","last_active":"2024-04-26T12:04:59.401154+0000","last_peered":"2024-04-26T12:04:59.401154+0000","last_clean":"2024-04-26T12:04:59.401154+0000","last_became_active":"2024-04-26T12:04:53.388568+0000","last_became_peered":"2024-04-26T12:04:53.388568+0000","last_unstale":"2024-04-26T12:04:59.401154+0000","last_undegraded":"2024-04-26T12:04:59.401154+0000","last_fullsized":"2024-04-26T12:04:59.401154+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_clean_scrub_stamp":"2024-04-26T12:04:52.376986+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:04.970330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408637+0000","last_change":"2024-04-26T12:04:59.403711+0000","last_active":"2024-04-26T12:05:00.408637+0000","last_peered":"2024-04-26T12:05:00.408637+0000","last_clean":"2024-04-26T12:05:00.408637+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:05:00.408637+0000","last_undegraded":"2024-04-26T12:05:00.408637+0000","last_fullsized":"2024-04-26T12:05:00.408637+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:45.779614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408626+0000","last_change":"2024-04-26T12:04:59.405437+0000","last_active":"2024-04-26T12:05:00.408626+0000","last_peered":"2024-04-26T12:05:00.408626+0000","last_clean":"2024-04-26T12:05:00.408626+0000","last_became_active":"2024-04-26T12:04:59.405193+0000","last_became_peered":"2024-04-26T12:04:59.405193+0000","last_unstale":"2024-04-26T12:05:00.408626+0000","last_undegraded":"2024-04-26T12:05:00.408626+0000","last_fullsized":"2024-04-26T12:05:00.408626+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:20.977569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408517+0000","last_change":"2024-04-26T12:04:59.405617+0000","last_active":"2024-04-26T12:05:00.408517+0000","last_peered":"2024-04-26T12:05:00.408517+0000","last_clean":"2024-04-26T12:05:00.408517+0000","last_became_active":"2024-04-26T12:04:59.405328+0000","last_became_peered":"2024-04-26T12:04:59.405328+0000","last_unstale":"2024-04-26T12:05:00.408517+0000","last_undegraded":"2024-04-26T12:05:00.408517+0000","last_fullsized":"2024-04-26T12:05:00.408517+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:39.317039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408652+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:05:00.408652+0000","last_peered":"2024-04-26T12:05:00.408652+0000","last_clean":"2024-04-26T12:05:00.408652+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:05:00.408652+0000","last_undegraded":"2024-04-26T12:05:00.408652+0000","last_fullsized":"2024-04-26T12:05:00.408652+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:12.939539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408519+0000","last_change":"2024-04-26T12:04:59.405766+0000","last_active":"2024-04-26T12:05:00.408519+0000","last_peered":"2024-04-26T12:05:00.408519+0000","last_clean":"2024-04-26T12:05:00.408519+0000","last_became_active":"2024-04-26T12:04:59.405406+0000","last_became_peered":"2024-04-26T12:04:59.405406+0000","last_unstale":"2024-04-26T12:05:00.408519+0000","last_undegraded":"2024-04-26T12:05:00.408519+0000","last_fullsized":"2024-04-26T12:05:00.408519+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:13.860871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-26T12:04:59.410237+0000","last_change":"2024-04-26T12:04:59.405294+0000","last_active":"2024-04-26T12:04:59.410237+0000","last_peered":"2024-04-26T12:04:59.410237+0000","last_clean":"2024-04-26T12:04:59.410237+0000","last_became_active":"2024-04-26T12:04:59.405044+0000","last_became_peered":"2024-04-26T12:04:59.405044+0000","last_unstale":"2024-04-26T12:04:59.410237+0000","last_undegraded":"2024-04-26T12:04:59.410237+0000","last_fullsized":"2024-04-26T12:04:59.410237+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:47.042833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408520+0000","last_change":"2024-04-26T12:04:59.405667+0000","last_active":"2024-04-26T12:05:00.408520+0000","last_peered":"2024-04-26T12:05:00.408520+0000","last_clean":"2024-04-26T12:05:00.408520+0000","last_became_active":"2024-04-26T12:04:59.405328+0000","last_became_peered":"2024-04-26T12:04:59.405328+0000","last_unstale":"2024-04-26T12:05:00.408520+0000","last_undegraded":"2024-04-26T12:05:00.408520+0000","last_fullsized":"2024-04-26T12:05:00.408520+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:20.977569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408619+0000","last_change":"2024-04-26T12:04:59.408078+0000","last_active":"2024-04-26T12:05:00.408619+0000","last_peered":"2024-04-26T12:05:00.408619+0000","last_clean":"2024-04-26T12:05:00.408619+0000","last_became_active":"2024-04-26T12:04:59.407804+0000","last_became_peered":"2024-04-26T12:04:59.407804+0000","last_unstale":"2024-04-26T12:05:00.408619+0000","last_undegraded":"2024-04-26T12:05:00.408619+0000","last_fullsized":"2024-04-26T12:05:00.408619+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:56.449518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":180224,"data_stored":627145,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":623447,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":122880,"data_stored":36777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:05:07.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2024-04-26T12:05:07.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2024-04-26T12:05:07.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2024-04-26T12:05:07.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2024-04-26T12:05:07.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2024-04-26T12:05:07.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2024-04-26T12:05:07.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2024-04-26T12:05:07.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2024-04-26T12:05:07.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2024-04-26T12:05:07.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2024-04-26T12:05:07.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2024-04-26T12:05:07.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2024-04-26T12:05:07.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2024-04-26T12:05:07.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2024-04-26T12:05:07.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2024-04-26T12:05:07.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2024-04-26T12:05:07.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2024-04-26T12:05:07.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2024-04-26T12:05:07.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2024-04-26T12:05:07.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2024-04-26T12:05:07.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2024-04-26T12:05:07.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2024-04-26T12:05:07.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2024-04-26T12:05:07.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2024-04-26T12:05:07.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2024-04-26T12:05:07.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2024-04-26T12:05:07.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2024-04-26T12:05:07.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2024-04-26T12:05:07.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2024-04-26T12:05:07.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2024-04-26T12:05:07.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2024-04-26T12:05:07.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2024-04-26T12:05:07.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-04-26T12:05:07.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-04-26T12:05:07.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-04-26T12:05:07.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-04-26T12:05:07.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-04-26T12:05:07.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-04-26T12:05:07.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-04-26T12:05:07.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-04-26T12:05:07.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-04-26T12:05:07.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-04-26T12:05:07.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-04-26T12:05:07.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-04-26T12:05:07.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-04-26T12:05:07.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-04-26T12:05:07.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-04-26T12:05:07.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-04-26T12:05:07.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-04-26T12:05:07.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-04-26T12:05:07.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-04-26T12:05:07.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-04-26T12:05:07.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-04-26T12:05:07.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-04-26T12:05:07.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-04-26T12:05:07.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-04-26T12:05:07.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-04-26T12:05:07.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-04-26T12:05:07.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-04-26T12:05:07.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-04-26T12:05:07.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-04-26T12:05:07.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-04-26T12:05:07.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-04-26T12:05:07.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-04-26T12:05:07.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-04-26T12:05:07.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-04-26T12:05:07.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-04-26T12:05:07.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-04-26T12:05:07.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-04-26T12:05:07.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-04-26T12:05:07.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-04-26T12:05:07.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-04-26T12:05:07.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-04-26T12:05:07.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-04-26T12:05:07.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-04-26T12:05:07.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-04-26T12:05:07.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-04-26T12:05:07.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-04-26T12:05:07.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-04-26T12:05:07.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-04-26T12:05:07.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-04-26T12:05:07.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-04-26T12:05:07.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-04-26T12:05:07.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-04-26T12:05:07.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-04-26T12:05:07.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-04-26T12:05:07.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-04-26T12:05:07.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-04-26T12:05:07.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-04-26T12:05:07.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-04-26T12:05:07.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-04-26T12:05:07.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-04-26T12:05:07.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-04-26T12:05:07.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-04-26T12:05:07.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-04-26T12:05:07.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:03.412630+0000', 'last_change': '2024-04-26T12:05:03.412630+0000', 'last_active': '2024-04-26T12:05:03.412630+0000', 'last_peered': '2024-04-26T12:05:03.412630+0000', 'last_clean': '2024-04-26T12:05:03.412630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:03.412630+0000', 'last_undegraded': '2024-04-26T12:05:03.412630+0000', 'last_fullsized': '2024-04-26T12:05:03.412630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:03.412630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-04-26T12:05:07.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:05:02.408974+0000', 'last_change': '2024-04-26T12:05:02.408974+0000', 'last_active': '2024-04-26T12:05:02.408974+0000', 'last_peered': '2024-04-26T12:05:02.408974+0000', 'last_clean': '2024-04-26T12:05:02.408974+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:05:02.408974+0000', 'last_undegraded': '2024-04-26T12:05:02.408974+0000', 'last_fullsized': '2024-04-26T12:05:02.408974+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'last_clean_scrub_stamp': '2024-04-26T12:05:02.408974+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:05:07.488 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T12:05:07.866 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:07.866 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"5bc300ae-e948-4ce3-81bb-5abae8c06799","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":24,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":18,"num_osds":3,"num_up_osds":3,"osd_up_since":1714133091,"num_in_osds":3,"osd_in_since":1714133083,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":83496960,"bytes_avail":289826795520,"bytes_total":289910292480,"unknown_pgs_ratio":0.91428571939468384},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":14144}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-26T12:04:41.920542+0000","services":{}},"progress_events":{}} 2024-04-26T12:05:07.879 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-26T12:05:07.879 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:05:08.174 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:08.175 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:05:08.184 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-26T12:05:06.333030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81540,"kb_used_data":464,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033980,"statfs":{"total":289910292480,"available":289826795520,"internally_reserved":0,"allocated":475136,"data_stored":1287369,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000611"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":209,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-26T12:04:59.401154+0000","last_change":"2024-04-26T12:04:53.388840+0000","last_active":"2024-04-26T12:04:59.401154+0000","last_peered":"2024-04-26T12:04:59.401154+0000","last_clean":"2024-04-26T12:04:59.401154+0000","last_became_active":"2024-04-26T12:04:53.388568+0000","last_became_peered":"2024-04-26T12:04:53.388568+0000","last_unstale":"2024-04-26T12:04:59.401154+0000","last_undegraded":"2024-04-26T12:04:59.401154+0000","last_fullsized":"2024-04-26T12:04:59.401154+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_clean_scrub_stamp":"2024-04-26T12:04:52.376986+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:04.970330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408637+0000","last_change":"2024-04-26T12:04:59.403711+0000","last_active":"2024-04-26T12:05:00.408637+0000","last_peered":"2024-04-26T12:05:00.408637+0000","last_clean":"2024-04-26T12:05:00.408637+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:05:00.408637+0000","last_undegraded":"2024-04-26T12:05:00.408637+0000","last_fullsized":"2024-04-26T12:05:00.408637+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:45.779614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408626+0000","last_change":"2024-04-26T12:04:59.405437+0000","last_active":"2024-04-26T12:05:00.408626+0000","last_peered":"2024-04-26T12:05:00.408626+0000","last_clean":"2024-04-26T12:05:00.408626+0000","last_became_active":"2024-04-26T12:04:59.405193+0000","last_became_peered":"2024-04-26T12:04:59.405193+0000","last_unstale":"2024-04-26T12:05:00.408626+0000","last_undegraded":"2024-04-26T12:05:00.408626+0000","last_fullsized":"2024-04-26T12:05:00.408626+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:20.977569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408517+0000","last_change":"2024-04-26T12:04:59.405617+0000","last_active":"2024-04-26T12:05:00.408517+0000","last_peered":"2024-04-26T12:05:00.408517+0000","last_clean":"2024-04-26T12:05:00.408517+0000","last_became_active":"2024-04-26T12:04:59.405328+0000","last_became_peered":"2024-04-26T12:04:59.405328+0000","last_unstale":"2024-04-26T12:05:00.408517+0000","last_undegraded":"2024-04-26T12:05:00.408517+0000","last_fullsized":"2024-04-26T12:05:00.408517+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:39.317039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408652+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:05:00.408652+0000","last_peered":"2024-04-26T12:05:00.408652+0000","last_clean":"2024-04-26T12:05:00.408652+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:05:00.408652+0000","last_undegraded":"2024-04-26T12:05:00.408652+0000","last_fullsized":"2024-04-26T12:05:00.408652+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:12.939539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408519+0000","last_change":"2024-04-26T12:04:59.405766+0000","last_active":"2024-04-26T12:05:00.408519+0000","last_peered":"2024-04-26T12:05:00.408519+0000","last_clean":"2024-04-26T12:05:00.408519+0000","last_became_active":"2024-04-26T12:04:59.405406+0000","last_became_peered":"2024-04-26T12:04:59.405406+0000","last_unstale":"2024-04-26T12:05:00.408519+0000","last_undegraded":"2024-04-26T12:05:00.408519+0000","last_fullsized":"2024-04-26T12:05:00.408519+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:13.860871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-26T12:04:59.410237+0000","last_change":"2024-04-26T12:04:59.405294+0000","last_active":"2024-04-26T12:04:59.410237+0000","last_peered":"2024-04-26T12:04:59.410237+0000","last_clean":"2024-04-26T12:04:59.410237+0000","last_became_active":"2024-04-26T12:04:59.405044+0000","last_became_peered":"2024-04-26T12:04:59.405044+0000","last_unstale":"2024-04-26T12:04:59.410237+0000","last_undegraded":"2024-04-26T12:04:59.410237+0000","last_fullsized":"2024-04-26T12:04:59.410237+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:47.042833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408520+0000","last_change":"2024-04-26T12:04:59.405667+0000","last_active":"2024-04-26T12:05:00.408520+0000","last_peered":"2024-04-26T12:05:00.408520+0000","last_clean":"2024-04-26T12:05:00.408520+0000","last_became_active":"2024-04-26T12:04:59.405328+0000","last_became_peered":"2024-04-26T12:04:59.405328+0000","last_unstale":"2024-04-26T12:05:00.408520+0000","last_undegraded":"2024-04-26T12:05:00.408520+0000","last_fullsized":"2024-04-26T12:05:00.408520+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:20.977569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:05:00.408619+0000","last_change":"2024-04-26T12:04:59.408078+0000","last_active":"2024-04-26T12:05:00.408619+0000","last_peered":"2024-04-26T12:05:00.408619+0000","last_clean":"2024-04-26T12:05:00.408619+0000","last_became_active":"2024-04-26T12:04:59.407804+0000","last_became_peered":"2024-04-26T12:04:59.407804+0000","last_unstale":"2024-04-26T12:05:00.408619+0000","last_undegraded":"2024-04-26T12:05:00.408619+0000","last_fullsized":"2024-04-26T12:05:00.408619+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:56.449518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:03.412630+0000","last_change":"2024-04-26T12:05:03.412630+0000","last_active":"2024-04-26T12:05:03.412630+0000","last_peered":"2024-04-26T12:05:03.412630+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:03.412630+0000","last_undegraded":"2024-04-26T12:05:03.412630+0000","last_fullsized":"2024-04-26T12:05:03.412630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:05:02.408974+0000","last_change":"2024-04-26T12:05:02.408974+0000","last_active":"2024-04-26T12:05:02.408974+0000","last_peered":"2024-04-26T12:05:02.408974+0000","last_clean":"2024-04-26T12:05:02.408974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:05:02.408974+0000","last_undegraded":"2024-04-26T12:05:02.408974+0000","last_fullsized":"2024-04-26T12:05:02.408974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":180224,"data_stored":627145,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":623447,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":122880,"data_stored":36777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:05:09.511 INFO:tasks.ceph.mds.a.smithi052.stderr:2024-04-26T12:05:09.511+0000 7fee6388d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T12:05:11.189 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:05:11.498 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:11.500 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:05:11.509 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-26T12:05:10.333812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":85796,"kb_used_data":632,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283029724,"statfs":{"total":289910292480,"available":289822437376,"internally_reserved":0,"allocated":647168,"data_stored":1350688,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.918163"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782815+0000","last_change":"2024-04-26T12:05:03.796038+0000","last_active":"2024-04-26T12:05:04.782815+0000","last_peered":"2024-04-26T12:05:04.782815+0000","last_clean":"2024-04-26T12:05:04.782815+0000","last_became_active":"2024-04-26T12:05:03.795539+0000","last_became_peered":"2024-04-26T12:05:03.795539+0000","last_unstale":"2024-04-26T12:05:04.782815+0000","last_undegraded":"2024-04-26T12:05:04.782815+0000","last_fullsized":"2024-04-26T12:05:04.782815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782477+0000","last_change":"2024-04-26T12:05:03.795955+0000","last_active":"2024-04-26T12:05:04.782477+0000","last_peered":"2024-04-26T12:05:04.782477+0000","last_clean":"2024-04-26T12:05:04.782477+0000","last_became_active":"2024-04-26T12:05:03.795303+0000","last_became_peered":"2024-04-26T12:05:03.795303+0000","last_unstale":"2024-04-26T12:05:04.782477+0000","last_undegraded":"2024-04-26T12:05:04.782477+0000","last_fullsized":"2024-04-26T12:05:04.782477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781972+0000","last_change":"2024-04-26T12:05:03.797557+0000","last_active":"2024-04-26T12:05:04.781972+0000","last_peered":"2024-04-26T12:05:04.781972+0000","last_clean":"2024-04-26T12:05:04.781972+0000","last_became_active":"2024-04-26T12:05:03.797122+0000","last_became_peered":"2024-04-26T12:05:03.797122+0000","last_unstale":"2024-04-26T12:05:04.781972+0000","last_undegraded":"2024-04-26T12:05:04.781972+0000","last_fullsized":"2024-04-26T12:05:04.781972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782137+0000","last_change":"2024-04-26T12:05:03.791234+0000","last_active":"2024-04-26T12:05:04.782137+0000","last_peered":"2024-04-26T12:05:04.782137+0000","last_clean":"2024-04-26T12:05:04.782137+0000","last_became_active":"2024-04-26T12:05:03.790717+0000","last_became_peered":"2024-04-26T12:05:03.790717+0000","last_unstale":"2024-04-26T12:05:04.782137+0000","last_undegraded":"2024-04-26T12:05:04.782137+0000","last_fullsized":"2024-04-26T12:05:04.782137+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:52.358881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782240+0000","last_change":"2024-04-26T12:05:03.792885+0000","last_active":"2024-04-26T12:05:04.782240+0000","last_peered":"2024-04-26T12:05:04.782240+0000","last_clean":"2024-04-26T12:05:04.782240+0000","last_became_active":"2024-04-26T12:05:03.792354+0000","last_became_peered":"2024-04-26T12:05:03.792354+0000","last_unstale":"2024-04-26T12:05:04.782240+0000","last_undegraded":"2024-04-26T12:05:04.782240+0000","last_fullsized":"2024-04-26T12:05:04.782240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781573+0000","last_change":"2024-04-26T12:05:03.791560+0000","last_active":"2024-04-26T12:05:04.781573+0000","last_peered":"2024-04-26T12:05:04.781573+0000","last_clean":"2024-04-26T12:05:04.781573+0000","last_became_active":"2024-04-26T12:05:03.790578+0000","last_became_peered":"2024-04-26T12:05:03.790578+0000","last_unstale":"2024-04-26T12:05:04.781573+0000","last_undegraded":"2024-04-26T12:05:04.781573+0000","last_fullsized":"2024-04-26T12:05:04.781573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781892+0000","last_change":"2024-04-26T12:05:03.791215+0000","last_active":"2024-04-26T12:05:04.781892+0000","last_peered":"2024-04-26T12:05:04.781892+0000","last_clean":"2024-04-26T12:05:04.781892+0000","last_became_active":"2024-04-26T12:05:03.790615+0000","last_became_peered":"2024-04-26T12:05:03.790615+0000","last_unstale":"2024-04-26T12:05:04.781892+0000","last_undegraded":"2024-04-26T12:05:04.781892+0000","last_fullsized":"2024-04-26T12:05:04.781892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:55.388027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781429+0000","last_change":"2024-04-26T12:05:03.785861+0000","last_active":"2024-04-26T12:05:04.781429+0000","last_peered":"2024-04-26T12:05:04.781429+0000","last_clean":"2024-04-26T12:05:04.781429+0000","last_became_active":"2024-04-26T12:05:03.785382+0000","last_became_peered":"2024-04-26T12:05:03.785382+0000","last_unstale":"2024-04-26T12:05:04.781429+0000","last_undegraded":"2024-04-26T12:05:04.781429+0000","last_fullsized":"2024-04-26T12:05:04.781429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:51.870183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204307+0000","last_change":"2024-04-26T12:05:03.797218+0000","last_active":"2024-04-26T12:05:05.204307+0000","last_peered":"2024-04-26T12:05:05.204307+0000","last_clean":"2024-04-26T12:05:05.204307+0000","last_became_active":"2024-04-26T12:05:03.796902+0000","last_became_peered":"2024-04-26T12:05:03.796902+0000","last_unstale":"2024-04-26T12:05:05.204307+0000","last_undegraded":"2024-04-26T12:05:05.204307+0000","last_fullsized":"2024-04-26T12:05:05.204307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:27.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782312+0000","last_change":"2024-04-26T12:05:03.795919+0000","last_active":"2024-04-26T12:05:04.782312+0000","last_peered":"2024-04-26T12:05:04.782312+0000","last_clean":"2024-04-26T12:05:04.782312+0000","last_became_active":"2024-04-26T12:05:03.795268+0000","last_became_peered":"2024-04-26T12:05:03.795268+0000","last_unstale":"2024-04-26T12:05:04.782312+0000","last_undegraded":"2024-04-26T12:05:04.782312+0000","last_fullsized":"2024-04-26T12:05:04.782312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782161+0000","last_change":"2024-04-26T12:05:03.791046+0000","last_active":"2024-04-26T12:05:04.782161+0000","last_peered":"2024-04-26T12:05:04.782161+0000","last_clean":"2024-04-26T12:05:04.782161+0000","last_became_active":"2024-04-26T12:05:03.790662+0000","last_became_peered":"2024-04-26T12:05:03.790662+0000","last_unstale":"2024-04-26T12:05:04.782161+0000","last_undegraded":"2024-04-26T12:05:04.782161+0000","last_fullsized":"2024-04-26T12:05:04.782161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:35.458663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782010+0000","last_change":"2024-04-26T12:05:03.795250+0000","last_active":"2024-04-26T12:05:04.782010+0000","last_peered":"2024-04-26T12:05:04.782010+0000","last_clean":"2024-04-26T12:05:04.782010+0000","last_became_active":"2024-04-26T12:05:03.794632+0000","last_became_peered":"2024-04-26T12:05:03.794632+0000","last_unstale":"2024-04-26T12:05:04.782010+0000","last_undegraded":"2024-04-26T12:05:04.782010+0000","last_fullsized":"2024-04-26T12:05:04.782010+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:59.873501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782077+0000","last_change":"2024-04-26T12:05:03.794090+0000","last_active":"2024-04-26T12:05:04.782077+0000","last_peered":"2024-04-26T12:05:04.782077+0000","last_clean":"2024-04-26T12:05:04.782077+0000","last_became_active":"2024-04-26T12:05:03.793681+0000","last_became_peered":"2024-04-26T12:05:03.793681+0000","last_unstale":"2024-04-26T12:05:04.782077+0000","last_undegraded":"2024-04-26T12:05:04.782077+0000","last_fullsized":"2024-04-26T12:05:04.782077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781643+0000","last_change":"2024-04-26T12:05:03.795539+0000","last_active":"2024-04-26T12:05:04.781643+0000","last_peered":"2024-04-26T12:05:04.781643+0000","last_clean":"2024-04-26T12:05:04.781643+0000","last_became_active":"2024-04-26T12:05:03.795281+0000","last_became_peered":"2024-04-26T12:05:03.795281+0000","last_unstale":"2024-04-26T12:05:04.781643+0000","last_undegraded":"2024-04-26T12:05:04.781643+0000","last_fullsized":"2024-04-26T12:05:04.781643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:27.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781992+0000","last_change":"2024-04-26T12:05:03.793487+0000","last_active":"2024-04-26T12:05:04.781992+0000","last_peered":"2024-04-26T12:05:04.781992+0000","last_clean":"2024-04-26T12:05:04.781992+0000","last_became_active":"2024-04-26T12:05:03.793242+0000","last_became_peered":"2024-04-26T12:05:03.793242+0000","last_unstale":"2024-04-26T12:05:04.781992+0000","last_undegraded":"2024-04-26T12:05:04.781992+0000","last_fullsized":"2024-04-26T12:05:04.781992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:53.331006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781585+0000","last_change":"2024-04-26T12:05:03.786360+0000","last_active":"2024-04-26T12:05:04.781585+0000","last_peered":"2024-04-26T12:05:04.781585+0000","last_clean":"2024-04-26T12:05:04.781585+0000","last_became_active":"2024-04-26T12:05:03.785991+0000","last_became_peered":"2024-04-26T12:05:03.785991+0000","last_unstale":"2024-04-26T12:05:04.781585+0000","last_undegraded":"2024-04-26T12:05:04.781585+0000","last_fullsized":"2024-04-26T12:05:04.781585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:17.702068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204616+0000","last_change":"2024-04-26T12:05:03.797390+0000","last_active":"2024-04-26T12:05:05.204616+0000","last_peered":"2024-04-26T12:05:05.204616+0000","last_clean":"2024-04-26T12:05:05.204616+0000","last_became_active":"2024-04-26T12:05:03.796969+0000","last_became_peered":"2024-04-26T12:05:03.796969+0000","last_unstale":"2024-04-26T12:05:05.204616+0000","last_undegraded":"2024-04-26T12:05:05.204616+0000","last_fullsized":"2024-04-26T12:05:05.204616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:57.461628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782513+0000","last_change":"2024-04-26T12:05:03.794013+0000","last_active":"2024-04-26T12:05:04.782513+0000","last_peered":"2024-04-26T12:05:04.782513+0000","last_clean":"2024-04-26T12:05:04.782513+0000","last_became_active":"2024-04-26T12:05:03.793512+0000","last_became_peered":"2024-04-26T12:05:03.793512+0000","last_unstale":"2024-04-26T12:05:04.782513+0000","last_undegraded":"2024-04-26T12:05:04.782513+0000","last_fullsized":"2024-04-26T12:05:04.782513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204175+0000","last_change":"2024-04-26T12:05:03.798195+0000","last_active":"2024-04-26T12:05:05.204175+0000","last_peered":"2024-04-26T12:05:05.204175+0000","last_clean":"2024-04-26T12:05:05.204175+0000","last_became_active":"2024-04-26T12:05:03.797935+0000","last_became_peered":"2024-04-26T12:05:03.797935+0000","last_unstale":"2024-04-26T12:05:05.204175+0000","last_undegraded":"2024-04-26T12:05:05.204175+0000","last_fullsized":"2024-04-26T12:05:05.204175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:58.872589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782280+0000","last_change":"2024-04-26T12:05:03.792219+0000","last_active":"2024-04-26T12:05:04.782280+0000","last_peered":"2024-04-26T12:05:04.782280+0000","last_clean":"2024-04-26T12:05:04.782280+0000","last_became_active":"2024-04-26T12:05:03.791061+0000","last_became_peered":"2024-04-26T12:05:03.791061+0000","last_unstale":"2024-04-26T12:05:04.782280+0000","last_undegraded":"2024-04-26T12:05:04.782280+0000","last_fullsized":"2024-04-26T12:05:04.782280+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782402+0000","last_change":"2024-04-26T12:05:03.792073+0000","last_active":"2024-04-26T12:05:04.782402+0000","last_peered":"2024-04-26T12:05:04.782402+0000","last_clean":"2024-04-26T12:05:04.782402+0000","last_became_active":"2024-04-26T12:05:03.791693+0000","last_became_peered":"2024-04-26T12:05:03.791693+0000","last_unstale":"2024-04-26T12:05:04.782402+0000","last_undegraded":"2024-04-26T12:05:04.782402+0000","last_fullsized":"2024-04-26T12:05:04.782402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781784+0000","last_change":"2024-04-26T12:05:03.794027+0000","last_active":"2024-04-26T12:05:04.781784+0000","last_peered":"2024-04-26T12:05:04.781784+0000","last_clean":"2024-04-26T12:05:04.781784+0000","last_became_active":"2024-04-26T12:05:03.793660+0000","last_became_peered":"2024-04-26T12:05:03.793660+0000","last_unstale":"2024-04-26T12:05:04.781784+0000","last_undegraded":"2024-04-26T12:05:04.781784+0000","last_fullsized":"2024-04-26T12:05:04.781784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:53.331006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203565+0000","last_change":"2024-04-26T12:05:03.788658+0000","last_active":"2024-04-26T12:05:05.203565+0000","last_peered":"2024-04-26T12:05:05.203565+0000","last_clean":"2024-04-26T12:05:05.203565+0000","last_became_active":"2024-04-26T12:05:03.788050+0000","last_became_peered":"2024-04-26T12:05:03.788050+0000","last_unstale":"2024-04-26T12:05:05.203565+0000","last_undegraded":"2024-04-26T12:05:05.203565+0000","last_fullsized":"2024-04-26T12:05:05.203565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781648+0000","last_change":"2024-04-26T12:05:03.793554+0000","last_active":"2024-04-26T12:05:04.781648+0000","last_peered":"2024-04-26T12:05:04.781648+0000","last_clean":"2024-04-26T12:05:04.781648+0000","last_became_active":"2024-04-26T12:05:03.792588+0000","last_became_peered":"2024-04-26T12:05:03.792588+0000","last_unstale":"2024-04-26T12:05:04.781648+0000","last_undegraded":"2024-04-26T12:05:04.781648+0000","last_fullsized":"2024-04-26T12:05:04.781648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782854+0000","last_change":"2024-04-26T12:05:03.795510+0000","last_active":"2024-04-26T12:05:04.782854+0000","last_peered":"2024-04-26T12:05:04.782854+0000","last_clean":"2024-04-26T12:05:04.782854+0000","last_became_active":"2024-04-26T12:05:03.794639+0000","last_became_peered":"2024-04-26T12:05:03.794639+0000","last_unstale":"2024-04-26T12:05:04.782854+0000","last_undegraded":"2024-04-26T12:05:04.782854+0000","last_fullsized":"2024-04-26T12:05:04.782854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:57.461628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204465+0000","last_change":"2024-04-26T12:05:03.787909+0000","last_active":"2024-04-26T12:05:05.204465+0000","last_peered":"2024-04-26T12:05:05.204465+0000","last_clean":"2024-04-26T12:05:05.204465+0000","last_became_active":"2024-04-26T12:05:03.787562+0000","last_became_peered":"2024-04-26T12:05:03.787562+0000","last_unstale":"2024-04-26T12:05:05.204465+0000","last_undegraded":"2024-04-26T12:05:05.204465+0000","last_fullsized":"2024-04-26T12:05:05.204465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782352+0000","last_change":"2024-04-26T12:05:03.796836+0000","last_active":"2024-04-26T12:05:04.782352+0000","last_peered":"2024-04-26T12:05:04.782352+0000","last_clean":"2024-04-26T12:05:04.782352+0000","last_became_active":"2024-04-26T12:05:03.796524+0000","last_became_peered":"2024-04-26T12:05:03.796524+0000","last_unstale":"2024-04-26T12:05:04.782352+0000","last_undegraded":"2024-04-26T12:05:04.782352+0000","last_fullsized":"2024-04-26T12:05:04.782352+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782420+0000","last_change":"2024-04-26T12:05:03.792400+0000","last_active":"2024-04-26T12:05:04.782420+0000","last_peered":"2024-04-26T12:05:04.782420+0000","last_clean":"2024-04-26T12:05:04.782420+0000","last_became_active":"2024-04-26T12:05:03.792079+0000","last_became_peered":"2024-04-26T12:05:03.792079+0000","last_unstale":"2024-04-26T12:05:04.782420+0000","last_undegraded":"2024-04-26T12:05:04.782420+0000","last_fullsized":"2024-04-26T12:05:04.782420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:24.434355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204245+0000","last_change":"2024-04-26T12:05:03.797172+0000","last_active":"2024-04-26T12:05:05.204245+0000","last_peered":"2024-04-26T12:05:05.204245+0000","last_clean":"2024-04-26T12:05:05.204245+0000","last_became_active":"2024-04-26T12:05:03.796879+0000","last_became_peered":"2024-04-26T12:05:03.796879+0000","last_unstale":"2024-04-26T12:05:05.204245+0000","last_undegraded":"2024-04-26T12:05:05.204245+0000","last_fullsized":"2024-04-26T12:05:05.204245+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:24.434355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781949+0000","last_change":"2024-04-26T12:05:03.793269+0000","last_active":"2024-04-26T12:05:04.781949+0000","last_peered":"2024-04-26T12:05:04.781949+0000","last_clean":"2024-04-26T12:05:04.781949+0000","last_became_active":"2024-04-26T12:05:03.792698+0000","last_became_peered":"2024-04-26T12:05:03.792698+0000","last_unstale":"2024-04-26T12:05:04.781949+0000","last_undegraded":"2024-04-26T12:05:04.781949+0000","last_fullsized":"2024-04-26T12:05:04.781949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:58.579861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203630+0000","last_change":"2024-04-26T12:05:03.796871+0000","last_active":"2024-04-26T12:05:05.203630+0000","last_peered":"2024-04-26T12:05:05.203630+0000","last_clean":"2024-04-26T12:05:05.203630+0000","last_became_active":"2024-04-26T12:05:03.796546+0000","last_became_peered":"2024-04-26T12:05:03.796546+0000","last_unstale":"2024-04-26T12:05:05.203630+0000","last_undegraded":"2024-04-26T12:05:05.203630+0000","last_fullsized":"2024-04-26T12:05:05.203630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:53.331006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781676+0000","last_change":"2024-04-26T12:05:03.791605+0000","last_active":"2024-04-26T12:05:04.781676+0000","last_peered":"2024-04-26T12:05:04.781676+0000","last_clean":"2024-04-26T12:05:04.781676+0000","last_became_active":"2024-04-26T12:05:03.791251+0000","last_became_peered":"2024-04-26T12:05:03.791251+0000","last_unstale":"2024-04-26T12:05:04.781676+0000","last_undegraded":"2024-04-26T12:05:04.781676+0000","last_fullsized":"2024-04-26T12:05:04.781676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:27.239868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782339+0000","last_change":"2024-04-26T12:05:03.793791+0000","last_active":"2024-04-26T12:05:04.782339+0000","last_peered":"2024-04-26T12:05:04.782339+0000","last_clean":"2024-04-26T12:05:04.782339+0000","last_became_active":"2024-04-26T12:05:03.793468+0000","last_became_peered":"2024-04-26T12:05:03.793468+0000","last_unstale":"2024-04-26T12:05:04.782339+0000","last_undegraded":"2024-04-26T12:05:04.782339+0000","last_fullsized":"2024-04-26T12:05:04.782339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:01.289069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782440+0000","last_change":"2024-04-26T12:05:03.430021+0000","last_active":"2024-04-26T12:05:04.782440+0000","last_peered":"2024-04-26T12:05:04.782440+0000","last_clean":"2024-04-26T12:05:04.782440+0000","last_became_active":"2024-04-26T12:05:03.429695+0000","last_became_peered":"2024-04-26T12:05:03.429695+0000","last_unstale":"2024-04-26T12:05:04.782440+0000","last_undegraded":"2024-04-26T12:05:04.782440+0000","last_fullsized":"2024-04-26T12:05:04.782440+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782505+0000","last_change":"2024-04-26T12:05:03.796189+0000","last_active":"2024-04-26T12:05:04.782505+0000","last_peered":"2024-04-26T12:05:04.782505+0000","last_clean":"2024-04-26T12:05:04.782505+0000","last_became_active":"2024-04-26T12:05:03.795438+0000","last_became_peered":"2024-04-26T12:05:03.795438+0000","last_unstale":"2024-04-26T12:05:04.782505+0000","last_undegraded":"2024-04-26T12:05:04.782505+0000","last_fullsized":"2024-04-26T12:05:04.782505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:22.814807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203969+0000","last_change":"2024-04-26T12:05:03.428605+0000","last_active":"2024-04-26T12:05:05.203969+0000","last_peered":"2024-04-26T12:05:05.203969+0000","last_clean":"2024-04-26T12:05:05.203969+0000","last_became_active":"2024-04-26T12:05:03.428098+0000","last_became_peered":"2024-04-26T12:05:03.428098+0000","last_unstale":"2024-04-26T12:05:05.203969+0000","last_undegraded":"2024-04-26T12:05:05.203969+0000","last_fullsized":"2024-04-26T12:05:05.203969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204596+0000","last_change":"2024-04-26T12:05:03.788568+0000","last_active":"2024-04-26T12:05:05.204596+0000","last_peered":"2024-04-26T12:05:05.204596+0000","last_clean":"2024-04-26T12:05:05.204596+0000","last_became_active":"2024-04-26T12:05:03.788039+0000","last_became_peered":"2024-04-26T12:05:03.788039+0000","last_unstale":"2024-04-26T12:05:05.204596+0000","last_undegraded":"2024-04-26T12:05:05.204596+0000","last_fullsized":"2024-04-26T12:05:05.204596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781927+0000","last_change":"2024-04-26T12:05:03.422773+0000","last_active":"2024-04-26T12:05:04.781927+0000","last_peered":"2024-04-26T12:05:04.781927+0000","last_clean":"2024-04-26T12:05:04.781927+0000","last_became_active":"2024-04-26T12:05:03.422412+0000","last_became_peered":"2024-04-26T12:05:03.422412+0000","last_unstale":"2024-04-26T12:05:04.781927+0000","last_undegraded":"2024-04-26T12:05:04.781927+0000","last_fullsized":"2024-04-26T12:05:04.781927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:06.758253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204353+0000","last_change":"2024-04-26T12:05:03.788505+0000","last_active":"2024-04-26T12:05:05.204353+0000","last_peered":"2024-04-26T12:05:05.204353+0000","last_clean":"2024-04-26T12:05:05.204353+0000","last_became_active":"2024-04-26T12:05:03.788184+0000","last_became_peered":"2024-04-26T12:05:03.788184+0000","last_unstale":"2024-04-26T12:05:05.204353+0000","last_undegraded":"2024-04-26T12:05:05.204353+0000","last_fullsized":"2024-04-26T12:05:05.204353+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781717+0000","last_change":"2024-04-26T12:05:03.425495+0000","last_active":"2024-04-26T12:05:04.781717+0000","last_peered":"2024-04-26T12:05:04.781717+0000","last_clean":"2024-04-26T12:05:04.781717+0000","last_became_active":"2024-04-26T12:05:03.424963+0000","last_became_peered":"2024-04-26T12:05:03.424963+0000","last_unstale":"2024-04-26T12:05:04.781717+0000","last_undegraded":"2024-04-26T12:05:04.781717+0000","last_fullsized":"2024-04-26T12:05:04.781717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:55.660897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782532+0000","last_change":"2024-04-26T12:05:03.426142+0000","last_active":"2024-04-26T12:05:04.782532+0000","last_peered":"2024-04-26T12:05:04.782532+0000","last_clean":"2024-04-26T12:05:04.782532+0000","last_became_active":"2024-04-26T12:05:03.425699+0000","last_became_peered":"2024-04-26T12:05:03.425699+0000","last_unstale":"2024-04-26T12:05:04.782532+0000","last_undegraded":"2024-04-26T12:05:04.782532+0000","last_fullsized":"2024-04-26T12:05:04.782532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:41.279426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781647+0000","last_change":"2024-04-26T12:05:03.794778+0000","last_active":"2024-04-26T12:05:04.781647+0000","last_peered":"2024-04-26T12:05:04.781647+0000","last_clean":"2024-04-26T12:05:04.781647+0000","last_became_active":"2024-04-26T12:05:03.794192+0000","last_became_peered":"2024-04-26T12:05:03.794192+0000","last_unstale":"2024-04-26T12:05:04.781647+0000","last_undegraded":"2024-04-26T12:05:04.781647+0000","last_fullsized":"2024-04-26T12:05:04.781647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:16.372597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782585+0000","last_change":"2024-04-26T12:05:03.426530+0000","last_active":"2024-04-26T12:05:04.782585+0000","last_peered":"2024-04-26T12:05:04.782585+0000","last_clean":"2024-04-26T12:05:04.782585+0000","last_became_active":"2024-04-26T12:05:03.426113+0000","last_became_peered":"2024-04-26T12:05:03.426113+0000","last_unstale":"2024-04-26T12:05:04.782585+0000","last_undegraded":"2024-04-26T12:05:04.782585+0000","last_fullsized":"2024-04-26T12:05:04.782585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:21.029311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781810+0000","last_change":"2024-04-26T12:05:03.793000+0000","last_active":"2024-04-26T12:05:04.781810+0000","last_peered":"2024-04-26T12:05:04.781810+0000","last_clean":"2024-04-26T12:05:04.781810+0000","last_became_active":"2024-04-26T12:05:03.792480+0000","last_became_peered":"2024-04-26T12:05:03.792480+0000","last_unstale":"2024-04-26T12:05:04.781810+0000","last_undegraded":"2024-04-26T12:05:04.781810+0000","last_fullsized":"2024-04-26T12:05:04.781810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782682+0000","last_change":"2024-04-26T12:05:03.426039+0000","last_active":"2024-04-26T12:05:04.782682+0000","last_peered":"2024-04-26T12:05:04.782682+0000","last_clean":"2024-04-26T12:05:04.782682+0000","last_became_active":"2024-04-26T12:05:03.425666+0000","last_became_peered":"2024-04-26T12:05:03.425666+0000","last_unstale":"2024-04-26T12:05:04.782682+0000","last_undegraded":"2024-04-26T12:05:04.782682+0000","last_fullsized":"2024-04-26T12:05:04.782682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:00.998013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781698+0000","last_change":"2024-04-26T12:05:03.791809+0000","last_active":"2024-04-26T12:05:04.781698+0000","last_peered":"2024-04-26T12:05:04.781698+0000","last_clean":"2024-04-26T12:05:04.781698+0000","last_became_active":"2024-04-26T12:05:03.791272+0000","last_became_peered":"2024-04-26T12:05:03.791272+0000","last_unstale":"2024-04-26T12:05:04.781698+0000","last_undegraded":"2024-04-26T12:05:04.781698+0000","last_fullsized":"2024-04-26T12:05:04.781698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782611+0000","last_change":"2024-04-26T12:05:03.430224+0000","last_active":"2024-04-26T12:05:04.782611+0000","last_peered":"2024-04-26T12:05:04.782611+0000","last_clean":"2024-04-26T12:05:04.782611+0000","last_became_active":"2024-04-26T12:05:03.429291+0000","last_became_peered":"2024-04-26T12:05:03.429291+0000","last_unstale":"2024-04-26T12:05:04.782611+0000","last_undegraded":"2024-04-26T12:05:04.782611+0000","last_fullsized":"2024-04-26T12:05:04.782611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204057+0000","last_change":"2024-04-26T12:05:03.788174+0000","last_active":"2024-04-26T12:05:05.204057+0000","last_peered":"2024-04-26T12:05:05.204057+0000","last_clean":"2024-04-26T12:05:05.204057+0000","last_became_active":"2024-04-26T12:05:03.787772+0000","last_became_peered":"2024-04-26T12:05:03.787772+0000","last_unstale":"2024-04-26T12:05:05.204057+0000","last_undegraded":"2024-04-26T12:05:05.204057+0000","last_fullsized":"2024-04-26T12:05:05.204057+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204340+0000","last_change":"2024-04-26T12:05:03.431162+0000","last_active":"2024-04-26T12:05:05.204340+0000","last_peered":"2024-04-26T12:05:05.204340+0000","last_clean":"2024-04-26T12:05:05.204340+0000","last_became_active":"2024-04-26T12:05:03.430855+0000","last_became_peered":"2024-04-26T12:05:03.430855+0000","last_unstale":"2024-04-26T12:05:05.204340+0000","last_undegraded":"2024-04-26T12:05:05.204340+0000","last_fullsized":"2024-04-26T12:05:05.204340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:41.279426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782386+0000","last_change":"2024-04-26T12:05:03.792357+0000","last_active":"2024-04-26T12:05:04.782386+0000","last_peered":"2024-04-26T12:05:04.782386+0000","last_clean":"2024-04-26T12:05:04.782386+0000","last_became_active":"2024-04-26T12:05:03.792119+0000","last_became_peered":"2024-04-26T12:05:03.792119+0000","last_unstale":"2024-04-26T12:05:04.782386+0000","last_undegraded":"2024-04-26T12:05:04.782386+0000","last_fullsized":"2024-04-26T12:05:04.782386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781879+0000","last_change":"2024-04-26T12:05:03.429811+0000","last_active":"2024-04-26T12:05:04.781879+0000","last_peered":"2024-04-26T12:05:04.781879+0000","last_clean":"2024-04-26T12:05:04.781879+0000","last_became_active":"2024-04-26T12:05:03.429469+0000","last_became_peered":"2024-04-26T12:05:03.429469+0000","last_unstale":"2024-04-26T12:05:04.781879+0000","last_undegraded":"2024-04-26T12:05:04.781879+0000","last_fullsized":"2024-04-26T12:05:04.781879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782424+0000","last_change":"2024-04-26T12:05:03.795646+0000","last_active":"2024-04-26T12:05:04.782424+0000","last_peered":"2024-04-26T12:05:04.782424+0000","last_clean":"2024-04-26T12:05:04.782424+0000","last_became_active":"2024-04-26T12:05:03.795354+0000","last_became_peered":"2024-04-26T12:05:03.795354+0000","last_unstale":"2024-04-26T12:05:04.782424+0000","last_undegraded":"2024-04-26T12:05:04.782424+0000","last_fullsized":"2024-04-26T12:05:04.782424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:22.814807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782060+0000","last_change":"2024-04-26T12:05:03.427908+0000","last_active":"2024-04-26T12:05:04.782060+0000","last_peered":"2024-04-26T12:05:04.782060+0000","last_clean":"2024-04-26T12:05:04.782060+0000","last_became_active":"2024-04-26T12:05:03.426718+0000","last_became_peered":"2024-04-26T12:05:03.426718+0000","last_unstale":"2024-04-26T12:05:04.782060+0000","last_undegraded":"2024-04-26T12:05:04.782060+0000","last_fullsized":"2024-04-26T12:05:04.782060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:40.538058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782365+0000","last_change":"2024-04-26T12:05:03.797113+0000","last_active":"2024-04-26T12:05:04.782365+0000","last_peered":"2024-04-26T12:05:04.782365+0000","last_clean":"2024-04-26T12:05:04.782365+0000","last_became_active":"2024-04-26T12:05:03.796739+0000","last_became_peered":"2024-04-26T12:05:03.796739+0000","last_unstale":"2024-04-26T12:05:04.782365+0000","last_undegraded":"2024-04-26T12:05:04.782365+0000","last_fullsized":"2024-04-26T12:05:04.782365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:59.873501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781849+0000","last_change":"2024-04-26T12:05:03.428262+0000","last_active":"2024-04-26T12:05:04.781849+0000","last_peered":"2024-04-26T12:05:04.781849+0000","last_clean":"2024-04-26T12:05:04.781849+0000","last_became_active":"2024-04-26T12:05:03.426588+0000","last_became_peered":"2024-04-26T12:05:03.426588+0000","last_unstale":"2024-04-26T12:05:04.781849+0000","last_undegraded":"2024-04-26T12:05:04.781849+0000","last_fullsized":"2024-04-26T12:05:04.781849+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:42.674797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204403+0000","last_change":"2024-04-26T12:05:03.797633+0000","last_active":"2024-04-26T12:05:05.204403+0000","last_peered":"2024-04-26T12:05:05.204403+0000","last_clean":"2024-04-26T12:05:05.204403+0000","last_became_active":"2024-04-26T12:05:03.797338+0000","last_became_peered":"2024-04-26T12:05:03.797338+0000","last_unstale":"2024-04-26T12:05:05.204403+0000","last_undegraded":"2024-04-26T12:05:05.204403+0000","last_fullsized":"2024-04-26T12:05:05.204403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:22.814807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.782901+0000","last_change":"2024-04-26T12:04:53.388840+0000","last_active":"2024-04-26T12:05:03.782901+0000","last_peered":"2024-04-26T12:05:03.782901+0000","last_clean":"2024-04-26T12:05:03.782901+0000","last_became_active":"2024-04-26T12:04:53.388568+0000","last_became_peered":"2024-04-26T12:04:53.388568+0000","last_unstale":"2024-04-26T12:05:03.782901+0000","last_undegraded":"2024-04-26T12:05:03.782901+0000","last_fullsized":"2024-04-26T12:05:03.782901+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_clean_scrub_stamp":"2024-04-26T12:04:52.376986+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:04.970330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.781157+0000","last_change":"2024-04-26T12:04:59.403711+0000","last_active":"2024-04-26T12:05:03.781157+0000","last_peered":"2024-04-26T12:05:03.781157+0000","last_clean":"2024-04-26T12:05:03.781157+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:05:03.781157+0000","last_undegraded":"2024-04-26T12:05:03.781157+0000","last_fullsized":"2024-04-26T12:05:03.781157+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:45.779614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204217+0000","last_change":"2024-04-26T12:05:03.429674+0000","last_active":"2024-04-26T12:05:05.204217+0000","last_peered":"2024-04-26T12:05:05.204217+0000","last_clean":"2024-04-26T12:05:05.204217+0000","last_became_active":"2024-04-26T12:05:03.429266+0000","last_became_peered":"2024-04-26T12:05:03.429266+0000","last_unstale":"2024-04-26T12:05:05.204217+0000","last_undegraded":"2024-04-26T12:05:05.204217+0000","last_fullsized":"2024-04-26T12:05:05.204217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:55.660897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782655+0000","last_change":"2024-04-26T12:05:03.797640+0000","last_active":"2024-04-26T12:05:04.782655+0000","last_peered":"2024-04-26T12:05:04.782655+0000","last_clean":"2024-04-26T12:05:04.782655+0000","last_became_active":"2024-04-26T12:05:03.797302+0000","last_became_peered":"2024-04-26T12:05:03.797302+0000","last_unstale":"2024-04-26T12:05:04.782655+0000","last_undegraded":"2024-04-26T12:05:04.782655+0000","last_fullsized":"2024-04-26T12:05:04.782655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:16.372597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.781404+0000","last_change":"2024-04-26T12:04:59.405437+0000","last_active":"2024-04-26T12:05:03.781404+0000","last_peered":"2024-04-26T12:05:03.781404+0000","last_clean":"2024-04-26T12:05:03.781404+0000","last_became_active":"2024-04-26T12:04:59.405193+0000","last_became_peered":"2024-04-26T12:04:59.405193+0000","last_unstale":"2024-04-26T12:05:03.781404+0000","last_undegraded":"2024-04-26T12:05:03.781404+0000","last_fullsized":"2024-04-26T12:05:03.781404+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:20.977569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203835+0000","last_change":"2024-04-26T12:05:03.428547+0000","last_active":"2024-04-26T12:05:05.203835+0000","last_peered":"2024-04-26T12:05:05.203835+0000","last_clean":"2024-04-26T12:05:05.203835+0000","last_became_active":"2024-04-26T12:05:03.427985+0000","last_became_peered":"2024-04-26T12:05:03.427985+0000","last_unstale":"2024-04-26T12:05:05.203835+0000","last_undegraded":"2024-04-26T12:05:05.203835+0000","last_fullsized":"2024-04-26T12:05:05.203835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:19.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782574+0000","last_change":"2024-04-26T12:05:03.793800+0000","last_active":"2024-04-26T12:05:04.782574+0000","last_peered":"2024-04-26T12:05:04.782574+0000","last_clean":"2024-04-26T12:05:04.782574+0000","last_became_active":"2024-04-26T12:05:03.792932+0000","last_became_peered":"2024-04-26T12:05:03.792932+0000","last_unstale":"2024-04-26T12:05:04.782574+0000","last_undegraded":"2024-04-26T12:05:04.782574+0000","last_fullsized":"2024-04-26T12:05:04.782574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.780048+0000","last_change":"2024-04-26T12:04:59.405617+0000","last_active":"2024-04-26T12:05:03.780048+0000","last_peered":"2024-04-26T12:05:03.780048+0000","last_clean":"2024-04-26T12:05:03.780048+0000","last_became_active":"2024-04-26T12:04:59.405328+0000","last_became_peered":"2024-04-26T12:04:59.405328+0000","last_unstale":"2024-04-26T12:05:03.780048+0000","last_undegraded":"2024-04-26T12:05:03.780048+0000","last_fullsized":"2024-04-26T12:05:03.780048+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:39.317039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782519+0000","last_change":"2024-04-26T12:05:03.424576+0000","last_active":"2024-04-26T12:05:04.782519+0000","last_peered":"2024-04-26T12:05:04.782519+0000","last_clean":"2024-04-26T12:05:04.782519+0000","last_became_active":"2024-04-26T12:05:03.424289+0000","last_became_peered":"2024-04-26T12:05:03.424289+0000","last_unstale":"2024-04-26T12:05:04.782519+0000","last_undegraded":"2024-04-26T12:05:04.782519+0000","last_fullsized":"2024-04-26T12:05:04.782519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:10.759772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204460+0000","last_change":"2024-04-26T12:05:03.798238+0000","last_active":"2024-04-26T12:05:05.204460+0000","last_peered":"2024-04-26T12:05:05.204460+0000","last_clean":"2024-04-26T12:05:05.204460+0000","last_became_active":"2024-04-26T12:05:03.797924+0000","last_became_peered":"2024-04-26T12:05:03.797924+0000","last_unstale":"2024-04-26T12:05:05.204460+0000","last_undegraded":"2024-04-26T12:05:05.204460+0000","last_fullsized":"2024-04-26T12:05:05.204460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:01.289069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.781616+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:05:03.781616+0000","last_peered":"2024-04-26T12:05:03.781616+0000","last_clean":"2024-04-26T12:05:03.781616+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:05:03.781616+0000","last_undegraded":"2024-04-26T12:05:03.781616+0000","last_fullsized":"2024-04-26T12:05:03.781616+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:12.939539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782535+0000","last_change":"2024-04-26T12:05:03.430140+0000","last_active":"2024-04-26T12:05:04.782535+0000","last_peered":"2024-04-26T12:05:04.782535+0000","last_clean":"2024-04-26T12:05:04.782535+0000","last_became_active":"2024-04-26T12:05:03.429838+0000","last_became_peered":"2024-04-26T12:05:03.429838+0000","last_unstale":"2024-04-26T12:05:04.782535+0000","last_undegraded":"2024-04-26T12:05:04.782535+0000","last_fullsized":"2024-04-26T12:05:04.782535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204416+0000","last_change":"2024-04-26T12:05:03.796731+0000","last_active":"2024-04-26T12:05:05.204416+0000","last_peered":"2024-04-26T12:05:05.204416+0000","last_clean":"2024-04-26T12:05:05.204416+0000","last_became_active":"2024-04-26T12:05:03.796432+0000","last_became_peered":"2024-04-26T12:05:03.796432+0000","last_unstale":"2024-04-26T12:05:05.204416+0000","last_undegraded":"2024-04-26T12:05:05.204416+0000","last_fullsized":"2024-04-26T12:05:05.204416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:58.579861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782707+0000","last_change":"2024-04-26T12:05:03.429673+0000","last_active":"2024-04-26T12:05:04.782707+0000","last_peered":"2024-04-26T12:05:04.782707+0000","last_clean":"2024-04-26T12:05:04.782707+0000","last_became_active":"2024-04-26T12:05:03.429146+0000","last_became_peered":"2024-04-26T12:05:03.429146+0000","last_unstale":"2024-04-26T12:05:04.782707+0000","last_undegraded":"2024-04-26T12:05:04.782707+0000","last_fullsized":"2024-04-26T12:05:04.782707+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.779759+0000","last_change":"2024-04-26T12:04:59.405766+0000","last_active":"2024-04-26T12:05:03.779759+0000","last_peered":"2024-04-26T12:05:03.779759+0000","last_clean":"2024-04-26T12:05:03.779759+0000","last_became_active":"2024-04-26T12:04:59.405406+0000","last_became_peered":"2024-04-26T12:04:59.405406+0000","last_unstale":"2024-04-26T12:05:03.779759+0000","last_undegraded":"2024-04-26T12:05:03.779759+0000","last_fullsized":"2024-04-26T12:05:03.779759+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:13.860871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782006+0000","last_change":"2024-04-26T12:05:03.792534+0000","last_active":"2024-04-26T12:05:04.782006+0000","last_peered":"2024-04-26T12:05:04.782006+0000","last_clean":"2024-04-26T12:05:04.782006+0000","last_became_active":"2024-04-26T12:05:03.792160+0000","last_became_peered":"2024-04-26T12:05:03.792160+0000","last_unstale":"2024-04-26T12:05:04.782006+0000","last_undegraded":"2024-04-26T12:05:04.782006+0000","last_fullsized":"2024-04-26T12:05:04.782006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:41.930005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204484+0000","last_change":"2024-04-26T12:05:03.429642+0000","last_active":"2024-04-26T12:05:05.204484+0000","last_peered":"2024-04-26T12:05:05.204484+0000","last_clean":"2024-04-26T12:05:05.204484+0000","last_became_active":"2024-04-26T12:05:03.429197+0000","last_became_peered":"2024-04-26T12:05:03.429197+0000","last_unstale":"2024-04-26T12:05:05.204484+0000","last_undegraded":"2024-04-26T12:05:05.204484+0000","last_fullsized":"2024-04-26T12:05:05.204484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:40.538058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.788889+0000","last_change":"2024-04-26T12:04:59.405294+0000","last_active":"2024-04-26T12:05:03.788889+0000","last_peered":"2024-04-26T12:05:03.788889+0000","last_clean":"2024-04-26T12:05:03.788889+0000","last_became_active":"2024-04-26T12:04:59.405044+0000","last_became_peered":"2024-04-26T12:04:59.405044+0000","last_unstale":"2024-04-26T12:05:03.788889+0000","last_undegraded":"2024-04-26T12:05:03.788889+0000","last_fullsized":"2024-04-26T12:05:03.788889+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:47.042833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782238+0000","last_change":"2024-04-26T12:05:03.793408+0000","last_active":"2024-04-26T12:05:04.782238+0000","last_peered":"2024-04-26T12:05:04.782238+0000","last_clean":"2024-04-26T12:05:04.782238+0000","last_became_active":"2024-04-26T12:05:03.793019+0000","last_became_peered":"2024-04-26T12:05:03.793019+0000","last_unstale":"2024-04-26T12:05:04.782238+0000","last_undegraded":"2024-04-26T12:05:04.782238+0000","last_fullsized":"2024-04-26T12:05:04.782238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:25.062114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204650+0000","last_change":"2024-04-26T12:05:03.430008+0000","last_active":"2024-04-26T12:05:05.204650+0000","last_peered":"2024-04-26T12:05:05.204650+0000","last_clean":"2024-04-26T12:05:05.204650+0000","last_became_active":"2024-04-26T12:05:03.429362+0000","last_became_peered":"2024-04-26T12:05:03.429362+0000","last_unstale":"2024-04-26T12:05:05.204650+0000","last_undegraded":"2024-04-26T12:05:05.204650+0000","last_fullsized":"2024-04-26T12:05:05.204650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.780359+0000","last_change":"2024-04-26T12:04:59.405667+0000","last_active":"2024-04-26T12:05:03.780359+0000","last_peered":"2024-04-26T12:05:03.780359+0000","last_clean":"2024-04-26T12:05:03.780359+0000","last_became_active":"2024-04-26T12:04:59.405328+0000","last_became_peered":"2024-04-26T12:04:59.405328+0000","last_unstale":"2024-04-26T12:05:03.780359+0000","last_undegraded":"2024-04-26T12:05:03.780359+0000","last_fullsized":"2024-04-26T12:05:03.780359+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:20.977569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203759+0000","last_change":"2024-04-26T12:05:03.789623+0000","last_active":"2024-04-26T12:05:05.203759+0000","last_peered":"2024-04-26T12:05:05.203759+0000","last_clean":"2024-04-26T12:05:05.203759+0000","last_became_active":"2024-04-26T12:05:03.789390+0000","last_became_peered":"2024-04-26T12:05:03.789390+0000","last_unstale":"2024-04-26T12:05:05.203759+0000","last_undegraded":"2024-04-26T12:05:05.203759+0000","last_fullsized":"2024-04-26T12:05:05.203759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204603+0000","last_change":"2024-04-26T12:05:03.429222+0000","last_active":"2024-04-26T12:05:05.204603+0000","last_peered":"2024-04-26T12:05:05.204603+0000","last_clean":"2024-04-26T12:05:05.204603+0000","last_became_active":"2024-04-26T12:05:03.428803+0000","last_became_peered":"2024-04-26T12:05:03.428803+0000","last_unstale":"2024-04-26T12:05:05.204603+0000","last_undegraded":"2024-04-26T12:05:05.204603+0000","last_fullsized":"2024-04-26T12:05:05.204603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:31.305644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.779178+0000","last_change":"2024-04-26T12:04:59.408078+0000","last_active":"2024-04-26T12:05:03.779178+0000","last_peered":"2024-04-26T12:05:03.779178+0000","last_clean":"2024-04-26T12:05:03.779178+0000","last_became_active":"2024-04-26T12:04:59.407804+0000","last_became_peered":"2024-04-26T12:04:59.407804+0000","last_unstale":"2024-04-26T12:05:03.779178+0000","last_undegraded":"2024-04-26T12:05:03.779178+0000","last_fullsized":"2024-04-26T12:05:03.779178+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:56.449518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782185+0000","last_change":"2024-04-26T12:05:03.792547+0000","last_active":"2024-04-26T12:05:04.782185+0000","last_peered":"2024-04-26T12:05:04.782185+0000","last_clean":"2024-04-26T12:05:04.782185+0000","last_became_active":"2024-04-26T12:05:03.792078+0000","last_became_peered":"2024-04-26T12:05:03.792078+0000","last_unstale":"2024-04-26T12:05:04.782185+0000","last_undegraded":"2024-04-26T12:05:04.782185+0000","last_fullsized":"2024-04-26T12:05:04.782185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:45.563923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782159+0000","last_change":"2024-04-26T12:05:03.795500+0000","last_active":"2024-04-26T12:05:04.782159+0000","last_peered":"2024-04-26T12:05:04.782159+0000","last_clean":"2024-04-26T12:05:04.782159+0000","last_became_active":"2024-04-26T12:05:03.795173+0000","last_became_peered":"2024-04-26T12:05:03.795173+0000","last_unstale":"2024-04-26T12:05:04.782159+0000","last_undegraded":"2024-04-26T12:05:04.782159+0000","last_fullsized":"2024-04-26T12:05:04.782159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:01.289069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782556+0000","last_change":"2024-04-26T12:05:03.426261+0000","last_active":"2024-04-26T12:05:04.782556+0000","last_peered":"2024-04-26T12:05:04.782556+0000","last_clean":"2024-04-26T12:05:04.782556+0000","last_became_active":"2024-04-26T12:05:03.425897+0000","last_became_peered":"2024-04-26T12:05:03.425897+0000","last_unstale":"2024-04-26T12:05:04.782556+0000","last_undegraded":"2024-04-26T12:05:04.782556+0000","last_fullsized":"2024-04-26T12:05:04.782556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:31.305644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203851+0000","last_change":"2024-04-26T12:05:03.795443+0000","last_active":"2024-04-26T12:05:05.203851+0000","last_peered":"2024-04-26T12:05:05.203851+0000","last_clean":"2024-04-26T12:05:05.203851+0000","last_became_active":"2024-04-26T12:05:03.795190+0000","last_became_peered":"2024-04-26T12:05:03.795190+0000","last_unstale":"2024-04-26T12:05:05.203851+0000","last_undegraded":"2024-04-26T12:05:05.203851+0000","last_fullsized":"2024-04-26T12:05:05.203851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:59.873501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782685+0000","last_change":"2024-04-26T12:05:03.425106+0000","last_active":"2024-04-26T12:05:04.782685+0000","last_peered":"2024-04-26T12:05:04.782685+0000","last_clean":"2024-04-26T12:05:04.782685+0000","last_became_active":"2024-04-26T12:05:03.424753+0000","last_became_peered":"2024-04-26T12:05:03.424753+0000","last_unstale":"2024-04-26T12:05:04.782685+0000","last_undegraded":"2024-04-26T12:05:04.782685+0000","last_fullsized":"2024-04-26T12:05:04.782685+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:10.741652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782591+0000","last_change":"2024-04-26T12:05:03.429257+0000","last_active":"2024-04-26T12:05:04.782591+0000","last_peered":"2024-04-26T12:05:04.782591+0000","last_clean":"2024-04-26T12:05:04.782591+0000","last_became_active":"2024-04-26T12:05:03.428921+0000","last_became_peered":"2024-04-26T12:05:03.428921+0000","last_unstale":"2024-04-26T12:05:04.782591+0000","last_undegraded":"2024-04-26T12:05:04.782591+0000","last_fullsized":"2024-04-26T12:05:04.782591+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:49.774845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203669+0000","last_change":"2024-04-26T12:05:03.788141+0000","last_active":"2024-04-26T12:05:05.203669+0000","last_peered":"2024-04-26T12:05:05.203669+0000","last_clean":"2024-04-26T12:05:05.203669+0000","last_became_active":"2024-04-26T12:05:03.787533+0000","last_became_peered":"2024-04-26T12:05:03.787533+0000","last_unstale":"2024-04-26T12:05:05.203669+0000","last_undegraded":"2024-04-26T12:05:05.203669+0000","last_fullsized":"2024-04-26T12:05:05.203669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204552+0000","last_change":"2024-04-26T12:05:03.428971+0000","last_active":"2024-04-26T12:05:05.204552+0000","last_peered":"2024-04-26T12:05:05.204552+0000","last_clean":"2024-04-26T12:05:05.204552+0000","last_became_active":"2024-04-26T12:05:03.428445+0000","last_became_peered":"2024-04-26T12:05:03.428445+0000","last_unstale":"2024-04-26T12:05:05.204552+0000","last_undegraded":"2024-04-26T12:05:05.204552+0000","last_fullsized":"2024-04-26T12:05:05.204552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203649+0000","last_change":"2024-04-26T12:05:03.795318+0000","last_active":"2024-04-26T12:05:05.203649+0000","last_peered":"2024-04-26T12:05:05.203649+0000","last_clean":"2024-04-26T12:05:05.203649+0000","last_became_active":"2024-04-26T12:05:03.795053+0000","last_became_peered":"2024-04-26T12:05:03.795053+0000","last_unstale":"2024-04-26T12:05:05.203649+0000","last_undegraded":"2024-04-26T12:05:05.203649+0000","last_fullsized":"2024-04-26T12:05:05.203649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:16.372597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782875+0000","last_change":"2024-04-26T12:05:03.795109+0000","last_active":"2024-04-26T12:05:04.782875+0000","last_peered":"2024-04-26T12:05:04.782875+0000","last_clean":"2024-04-26T12:05:04.782875+0000","last_became_active":"2024-04-26T12:05:03.794392+0000","last_became_peered":"2024-04-26T12:05:03.794392+0000","last_unstale":"2024-04-26T12:05:04.782875+0000","last_undegraded":"2024-04-26T12:05:04.782875+0000","last_fullsized":"2024-04-26T12:05:04.782875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:05.327938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203799+0000","last_change":"2024-04-26T12:05:03.429889+0000","last_active":"2024-04-26T12:05:05.203799+0000","last_peered":"2024-04-26T12:05:05.203799+0000","last_clean":"2024-04-26T12:05:05.203799+0000","last_became_active":"2024-04-26T12:05:03.429370+0000","last_became_peered":"2024-04-26T12:05:03.429370+0000","last_unstale":"2024-04-26T12:05:05.203799+0000","last_undegraded":"2024-04-26T12:05:05.203799+0000","last_fullsized":"2024-04-26T12:05:05.203799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:26.791180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204344+0000","last_change":"2024-04-26T12:05:03.788754+0000","last_active":"2024-04-26T12:05:05.204344+0000","last_peered":"2024-04-26T12:05:05.204344+0000","last_clean":"2024-04-26T12:05:05.204344+0000","last_became_active":"2024-04-26T12:05:03.788311+0000","last_became_peered":"2024-04-26T12:05:03.788311+0000","last_unstale":"2024-04-26T12:05:05.204344+0000","last_undegraded":"2024-04-26T12:05:05.204344+0000","last_fullsized":"2024-04-26T12:05:05.204344+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203763+0000","last_change":"2024-04-26T12:05:03.428810+0000","last_active":"2024-04-26T12:05:05.203763+0000","last_peered":"2024-04-26T12:05:05.203763+0000","last_clean":"2024-04-26T12:05:05.203763+0000","last_became_active":"2024-04-26T12:05:03.428191+0000","last_became_peered":"2024-04-26T12:05:03.428191+0000","last_unstale":"2024-04-26T12:05:05.203763+0000","last_undegraded":"2024-04-26T12:05:05.203763+0000","last_fullsized":"2024-04-26T12:05:05.203763+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782302+0000","last_change":"2024-04-26T12:05:03.796880+0000","last_active":"2024-04-26T12:05:04.782302+0000","last_peered":"2024-04-26T12:05:04.782302+0000","last_clean":"2024-04-26T12:05:04.782302+0000","last_became_active":"2024-04-26T12:05:03.796419+0000","last_became_peered":"2024-04-26T12:05:03.796419+0000","last_unstale":"2024-04-26T12:05:04.782302+0000","last_undegraded":"2024-04-26T12:05:04.782302+0000","last_fullsized":"2024-04-26T12:05:04.782302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:58.872589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782079+0000","last_change":"2024-04-26T12:05:03.428084+0000","last_active":"2024-04-26T12:05:04.782079+0000","last_peered":"2024-04-26T12:05:04.782079+0000","last_clean":"2024-04-26T12:05:04.782079+0000","last_became_active":"2024-04-26T12:05:03.426982+0000","last_became_peered":"2024-04-26T12:05:03.426982+0000","last_unstale":"2024-04-26T12:05:04.782079+0000","last_undegraded":"2024-04-26T12:05:04.782079+0000","last_fullsized":"2024-04-26T12:05:04.782079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:19.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782315+0000","last_change":"2024-04-26T12:05:03.793470+0000","last_active":"2024-04-26T12:05:04.782315+0000","last_peered":"2024-04-26T12:05:04.782315+0000","last_clean":"2024-04-26T12:05:04.782315+0000","last_became_active":"2024-04-26T12:05:03.792869+0000","last_became_peered":"2024-04-26T12:05:03.792869+0000","last_unstale":"2024-04-26T12:05:04.782315+0000","last_undegraded":"2024-04-26T12:05:04.782315+0000","last_fullsized":"2024-04-26T12:05:04.782315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:27.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782341+0000","last_change":"2024-04-26T12:05:03.426947+0000","last_active":"2024-04-26T12:05:04.782341+0000","last_peered":"2024-04-26T12:05:04.782341+0000","last_clean":"2024-04-26T12:05:04.782341+0000","last_became_active":"2024-04-26T12:05:03.426211+0000","last_became_peered":"2024-04-26T12:05:03.426211+0000","last_unstale":"2024-04-26T12:05:04.782341+0000","last_undegraded":"2024-04-26T12:05:04.782341+0000","last_fullsized":"2024-04-26T12:05:04.782341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:11.959244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782101+0000","last_change":"2024-04-26T12:05:03.791986+0000","last_active":"2024-04-26T12:05:04.782101+0000","last_peered":"2024-04-26T12:05:04.782101+0000","last_clean":"2024-04-26T12:05:04.782101+0000","last_became_active":"2024-04-26T12:05:03.790823+0000","last_became_peered":"2024-04-26T12:05:03.790823+0000","last_unstale":"2024-04-26T12:05:04.782101+0000","last_undegraded":"2024-04-26T12:05:04.782101+0000","last_fullsized":"2024-04-26T12:05:04.782101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782508+0000","last_change":"2024-04-26T12:05:03.429469+0000","last_active":"2024-04-26T12:05:04.782508+0000","last_peered":"2024-04-26T12:05:04.782508+0000","last_clean":"2024-04-26T12:05:04.782508+0000","last_became_active":"2024-04-26T12:05:03.429015+0000","last_became_peered":"2024-04-26T12:05:03.429015+0000","last_unstale":"2024-04-26T12:05:04.782508+0000","last_undegraded":"2024-04-26T12:05:04.782508+0000","last_fullsized":"2024-04-26T12:05:04.782508+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781940+0000","last_change":"2024-04-26T12:05:03.791929+0000","last_active":"2024-04-26T12:05:04.781940+0000","last_peered":"2024-04-26T12:05:04.781940+0000","last_clean":"2024-04-26T12:05:04.781940+0000","last_became_active":"2024-04-26T12:05:03.791540+0000","last_became_peered":"2024-04-26T12:05:03.791540+0000","last_unstale":"2024-04-26T12:05:04.781940+0000","last_undegraded":"2024-04-26T12:05:04.781940+0000","last_fullsized":"2024-04-26T12:05:04.781940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782585+0000","last_change":"2024-04-26T12:05:03.426210+0000","last_active":"2024-04-26T12:05:04.782585+0000","last_peered":"2024-04-26T12:05:04.782585+0000","last_clean":"2024-04-26T12:05:04.782585+0000","last_became_active":"2024-04-26T12:05:03.425782+0000","last_became_peered":"2024-04-26T12:05:03.425782+0000","last_unstale":"2024-04-26T12:05:04.782585+0000","last_undegraded":"2024-04-26T12:05:04.782585+0000","last_fullsized":"2024-04-26T12:05:04.782585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:26.791180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782217+0000","last_change":"2024-04-26T12:05:03.795264+0000","last_active":"2024-04-26T12:05:04.782217+0000","last_peered":"2024-04-26T12:05:04.782217+0000","last_clean":"2024-04-26T12:05:04.782217+0000","last_became_active":"2024-04-26T12:05:03.794448+0000","last_became_peered":"2024-04-26T12:05:03.794448+0000","last_unstale":"2024-04-26T12:05:04.782217+0000","last_undegraded":"2024-04-26T12:05:04.782217+0000","last_fullsized":"2024-04-26T12:05:04.782217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204547+0000","last_change":"2024-04-26T12:05:03.429872+0000","last_active":"2024-04-26T12:05:05.204547+0000","last_peered":"2024-04-26T12:05:05.204547+0000","last_clean":"2024-04-26T12:05:05.204547+0000","last_became_active":"2024-04-26T12:05:03.429401+0000","last_became_peered":"2024-04-26T12:05:03.429401+0000","last_unstale":"2024-04-26T12:05:05.204547+0000","last_undegraded":"2024-04-26T12:05:05.204547+0000","last_fullsized":"2024-04-26T12:05:05.204547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781880+0000","last_change":"2024-04-26T12:05:03.791827+0000","last_active":"2024-04-26T12:05:04.781880+0000","last_peered":"2024-04-26T12:05:04.781880+0000","last_clean":"2024-04-26T12:05:04.781880+0000","last_became_active":"2024-04-26T12:05:03.791442+0000","last_became_peered":"2024-04-26T12:05:03.791442+0000","last_unstale":"2024-04-26T12:05:04.781880+0000","last_undegraded":"2024-04-26T12:05:04.781880+0000","last_fullsized":"2024-04-26T12:05:04.781880+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204474+0000","last_change":"2024-04-26T12:05:03.430659+0000","last_active":"2024-04-26T12:05:05.204474+0000","last_peered":"2024-04-26T12:05:05.204474+0000","last_clean":"2024-04-26T12:05:05.204474+0000","last_became_active":"2024-04-26T12:05:03.430164+0000","last_became_peered":"2024-04-26T12:05:03.430164+0000","last_unstale":"2024-04-26T12:05:05.204474+0000","last_undegraded":"2024-04-26T12:05:05.204474+0000","last_fullsized":"2024-04-26T12:05:05.204474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":245760,"data_stored":647806,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":647190,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":55692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:05:11.513 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T12:05:11.513 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T12:05:11.513 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T12:05:11.514 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T12:05:11.514 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T12:05:11.898 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:11.909 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":27940},{"type":"v1","addr":"172.21.15.52:6801","nonce":27940}]},"active_addr":"172.21.15.52:6801/27940","active_change":"2024-04-26T12:04:46.324976+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4110,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":865009550}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":3555698539}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":2728468328}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":3729013752}]}]} 2024-04-26T12:05:11.912 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T12:05:11.912 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T12:05:11.912 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:05:12.205 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:12.205 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":18,"fsid":"5bc300ae-e948-4ce3-81bb-5abae8c06799","created":"2024-04-26T12:04:41.919527+0000","modified":"2024-04-26T12:05:04.776193+0000","last_up_change":"2024-04-26T12:04:51.084680+0000","last_in_change":"2024-04-26T12:04:43.540390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:04:52.376506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:04:57.775333+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:05:02.226064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:05:02.758806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"638cfa85-e921-4403-9bcb-a7f4653cc3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":28597},{"type":"v1","addr":"172.21.15.143:6801","nonce":28597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":28597},{"type":"v1","addr":"172.21.15.143:6803","nonce":28597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":28597},{"type":"v1","addr":"172.21.15.143:6807","nonce":28597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":28597},{"type":"v1","addr":"172.21.15.143:6805","nonce":28597}]},"public_addr":"172.21.15.143:6801/28597","cluster_addr":"172.21.15.143:6803/28597","heartbeat_back_addr":"172.21.15.143:6807/28597","heartbeat_front_addr":"172.21.15.143:6805/28597","state":["exists","up"]},{"osd":1,"uuid":"2abc8d1e-ad72-4643-ad1e-3566e5113c44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":28560},{"type":"v1","addr":"172.21.15.154:6801","nonce":28560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":28560},{"type":"v1","addr":"172.21.15.154:6803","nonce":28560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":28560},{"type":"v1","addr":"172.21.15.154:6807","nonce":28560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":28560},{"type":"v1","addr":"172.21.15.154:6805","nonce":28560}]},"public_addr":"172.21.15.154:6801/28560","cluster_addr":"172.21.15.154:6803/28560","heartbeat_back_addr":"172.21.15.154:6807/28560","heartbeat_front_addr":"172.21.15.154:6805/28560","state":["exists","up"]},{"osd":2,"uuid":"d2ebc562-cb9b-4089-a19b-1788b70b57dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":28709},{"type":"v1","addr":"172.21.15.164:6801","nonce":28709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":28709},{"type":"v1","addr":"172.21.15.164:6803","nonce":28709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":28709},{"type":"v1","addr":"172.21.15.164:6807","nonce":28709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":28709},{"type":"v1","addr":"172.21.15.164:6805","nonce":28709}]},"public_addr":"172.21.15.164:6801/28709","cluster_addr":"172.21.15.164:6803/28709","heartbeat_back_addr":"172.21.15.164:6807/28709","heartbeat_front_addr":"172.21.15.164:6805/28709","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.573478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.624482+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.615449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:05:12.217 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T12:05:12.217 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:05:12.513 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:12.514 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":18,"fsid":"5bc300ae-e948-4ce3-81bb-5abae8c06799","created":"2024-04-26T12:04:41.919527+0000","modified":"2024-04-26T12:05:04.776193+0000","last_up_change":"2024-04-26T12:04:51.084680+0000","last_in_change":"2024-04-26T12:04:43.540390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:04:52.376506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:04:57.775333+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:05:02.226064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:05:02.758806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"638cfa85-e921-4403-9bcb-a7f4653cc3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":28597},{"type":"v1","addr":"172.21.15.143:6801","nonce":28597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":28597},{"type":"v1","addr":"172.21.15.143:6803","nonce":28597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":28597},{"type":"v1","addr":"172.21.15.143:6807","nonce":28597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":28597},{"type":"v1","addr":"172.21.15.143:6805","nonce":28597}]},"public_addr":"172.21.15.143:6801/28597","cluster_addr":"172.21.15.143:6803/28597","heartbeat_back_addr":"172.21.15.143:6807/28597","heartbeat_front_addr":"172.21.15.143:6805/28597","state":["exists","up"]},{"osd":1,"uuid":"2abc8d1e-ad72-4643-ad1e-3566e5113c44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":28560},{"type":"v1","addr":"172.21.15.154:6801","nonce":28560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":28560},{"type":"v1","addr":"172.21.15.154:6803","nonce":28560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":28560},{"type":"v1","addr":"172.21.15.154:6807","nonce":28560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":28560},{"type":"v1","addr":"172.21.15.154:6805","nonce":28560}]},"public_addr":"172.21.15.154:6801/28560","cluster_addr":"172.21.15.154:6803/28560","heartbeat_back_addr":"172.21.15.154:6807/28560","heartbeat_front_addr":"172.21.15.154:6805/28560","state":["exists","up"]},{"osd":2,"uuid":"d2ebc562-cb9b-4089-a19b-1788b70b57dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":28709},{"type":"v1","addr":"172.21.15.164:6801","nonce":28709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":28709},{"type":"v1","addr":"172.21.15.164:6803","nonce":28709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":28709},{"type":"v1","addr":"172.21.15.164:6807","nonce":28709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":28709},{"type":"v1","addr":"172.21.15.164:6805","nonce":28709}]},"public_addr":"172.21.15.164:6801/28709","cluster_addr":"172.21.15.164:6803/28709","heartbeat_back_addr":"172.21.15.164:6807/28709","heartbeat_front_addr":"172.21.15.164:6805/28709","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.573478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.624482+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.615449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:05:12.527 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T12:05:12.528 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T12:05:12.528 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T12:05:12.669 INFO:teuthology.orchestra.run.smithi052.stdout:34359738376 2024-04-26T12:05:12.670 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:05:12.671 INFO:teuthology.orchestra.run.smithi052.stdout:34359738375 2024-04-26T12:05:12.671 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:05:12.672 INFO:teuthology.orchestra.run.smithi052.stdout:34359738376 2024-04-26T12:05:12.672 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:05:13.016 INFO:teuthology.orchestra.run.smithi052.stdout:34359738374 2024-04-26T12:05:13.017 INFO:teuthology.orchestra.run.smithi052.stdout:34359738375 2024-04-26T12:05:13.018 INFO:teuthology.orchestra.run.smithi052.stdout:34359738375 2024-04-26T12:05:13.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.1 2024-04-26T12:05:13.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738375 for osd.0 2024-04-26T12:05:13.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738375 for osd.2 2024-04-26T12:05:14.032 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:05:14.033 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:05:14.034 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:05:14.348 INFO:teuthology.orchestra.run.smithi052.stdout:34359738374 2024-04-26T12:05:14.348 INFO:teuthology.orchestra.run.smithi052.stdout:34359738375 2024-04-26T12:05:14.352 INFO:teuthology.orchestra.run.smithi052.stdout:34359738375 2024-04-26T12:05:14.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.1 2024-04-26T12:05:14.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738375 for osd.2 2024-04-26T12:05:14.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738375 for osd.0 2024-04-26T12:05:15.365 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:05:15.365 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:05:15.367 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:05:15.680 INFO:teuthology.orchestra.run.smithi052.stdout:34359738376 2024-04-26T12:05:15.683 INFO:teuthology.orchestra.run.smithi052.stdout:34359738376 2024-04-26T12:05:15.687 INFO:teuthology.orchestra.run.smithi052.stdout:34359738375 2024-04-26T12:05:15.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738376 for osd.0 2024-04-26T12:05:15.696 DEBUG:teuthology.parallel:result is None 2024-04-26T12:05:15.698 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738376 for osd.2 2024-04-26T12:05:15.698 DEBUG:teuthology.parallel:result is None 2024-04-26T12:05:15.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.1 2024-04-26T12:05:15.701 DEBUG:teuthology.parallel:result is None 2024-04-26T12:05:15.701 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T12:05:15.701 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:05:16.039 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:16.040 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:05:16.049 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-04-26T12:05:14.334535+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":85796,"kb_used_data":632,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283029724,"statfs":{"total":289910292480,"available":289822437376,"internally_reserved":0,"allocated":647168,"data_stored":1350688,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001807"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782815+0000","last_change":"2024-04-26T12:05:03.796038+0000","last_active":"2024-04-26T12:05:04.782815+0000","last_peered":"2024-04-26T12:05:04.782815+0000","last_clean":"2024-04-26T12:05:04.782815+0000","last_became_active":"2024-04-26T12:05:03.795539+0000","last_became_peered":"2024-04-26T12:05:03.795539+0000","last_unstale":"2024-04-26T12:05:04.782815+0000","last_undegraded":"2024-04-26T12:05:04.782815+0000","last_fullsized":"2024-04-26T12:05:04.782815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782477+0000","last_change":"2024-04-26T12:05:03.795955+0000","last_active":"2024-04-26T12:05:04.782477+0000","last_peered":"2024-04-26T12:05:04.782477+0000","last_clean":"2024-04-26T12:05:04.782477+0000","last_became_active":"2024-04-26T12:05:03.795303+0000","last_became_peered":"2024-04-26T12:05:03.795303+0000","last_unstale":"2024-04-26T12:05:04.782477+0000","last_undegraded":"2024-04-26T12:05:04.782477+0000","last_fullsized":"2024-04-26T12:05:04.782477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781972+0000","last_change":"2024-04-26T12:05:03.797557+0000","last_active":"2024-04-26T12:05:04.781972+0000","last_peered":"2024-04-26T12:05:04.781972+0000","last_clean":"2024-04-26T12:05:04.781972+0000","last_became_active":"2024-04-26T12:05:03.797122+0000","last_became_peered":"2024-04-26T12:05:03.797122+0000","last_unstale":"2024-04-26T12:05:04.781972+0000","last_undegraded":"2024-04-26T12:05:04.781972+0000","last_fullsized":"2024-04-26T12:05:04.781972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782137+0000","last_change":"2024-04-26T12:05:03.791234+0000","last_active":"2024-04-26T12:05:04.782137+0000","last_peered":"2024-04-26T12:05:04.782137+0000","last_clean":"2024-04-26T12:05:04.782137+0000","last_became_active":"2024-04-26T12:05:03.790717+0000","last_became_peered":"2024-04-26T12:05:03.790717+0000","last_unstale":"2024-04-26T12:05:04.782137+0000","last_undegraded":"2024-04-26T12:05:04.782137+0000","last_fullsized":"2024-04-26T12:05:04.782137+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:52.358881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782240+0000","last_change":"2024-04-26T12:05:03.792885+0000","last_active":"2024-04-26T12:05:04.782240+0000","last_peered":"2024-04-26T12:05:04.782240+0000","last_clean":"2024-04-26T12:05:04.782240+0000","last_became_active":"2024-04-26T12:05:03.792354+0000","last_became_peered":"2024-04-26T12:05:03.792354+0000","last_unstale":"2024-04-26T12:05:04.782240+0000","last_undegraded":"2024-04-26T12:05:04.782240+0000","last_fullsized":"2024-04-26T12:05:04.782240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781573+0000","last_change":"2024-04-26T12:05:03.791560+0000","last_active":"2024-04-26T12:05:04.781573+0000","last_peered":"2024-04-26T12:05:04.781573+0000","last_clean":"2024-04-26T12:05:04.781573+0000","last_became_active":"2024-04-26T12:05:03.790578+0000","last_became_peered":"2024-04-26T12:05:03.790578+0000","last_unstale":"2024-04-26T12:05:04.781573+0000","last_undegraded":"2024-04-26T12:05:04.781573+0000","last_fullsized":"2024-04-26T12:05:04.781573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781892+0000","last_change":"2024-04-26T12:05:03.791215+0000","last_active":"2024-04-26T12:05:04.781892+0000","last_peered":"2024-04-26T12:05:04.781892+0000","last_clean":"2024-04-26T12:05:04.781892+0000","last_became_active":"2024-04-26T12:05:03.790615+0000","last_became_peered":"2024-04-26T12:05:03.790615+0000","last_unstale":"2024-04-26T12:05:04.781892+0000","last_undegraded":"2024-04-26T12:05:04.781892+0000","last_fullsized":"2024-04-26T12:05:04.781892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:55.388027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781429+0000","last_change":"2024-04-26T12:05:03.785861+0000","last_active":"2024-04-26T12:05:04.781429+0000","last_peered":"2024-04-26T12:05:04.781429+0000","last_clean":"2024-04-26T12:05:04.781429+0000","last_became_active":"2024-04-26T12:05:03.785382+0000","last_became_peered":"2024-04-26T12:05:03.785382+0000","last_unstale":"2024-04-26T12:05:04.781429+0000","last_undegraded":"2024-04-26T12:05:04.781429+0000","last_fullsized":"2024-04-26T12:05:04.781429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:51.870183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204307+0000","last_change":"2024-04-26T12:05:03.797218+0000","last_active":"2024-04-26T12:05:05.204307+0000","last_peered":"2024-04-26T12:05:05.204307+0000","last_clean":"2024-04-26T12:05:05.204307+0000","last_became_active":"2024-04-26T12:05:03.796902+0000","last_became_peered":"2024-04-26T12:05:03.796902+0000","last_unstale":"2024-04-26T12:05:05.204307+0000","last_undegraded":"2024-04-26T12:05:05.204307+0000","last_fullsized":"2024-04-26T12:05:05.204307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:27.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782312+0000","last_change":"2024-04-26T12:05:03.795919+0000","last_active":"2024-04-26T12:05:04.782312+0000","last_peered":"2024-04-26T12:05:04.782312+0000","last_clean":"2024-04-26T12:05:04.782312+0000","last_became_active":"2024-04-26T12:05:03.795268+0000","last_became_peered":"2024-04-26T12:05:03.795268+0000","last_unstale":"2024-04-26T12:05:04.782312+0000","last_undegraded":"2024-04-26T12:05:04.782312+0000","last_fullsized":"2024-04-26T12:05:04.782312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782161+0000","last_change":"2024-04-26T12:05:03.791046+0000","last_active":"2024-04-26T12:05:04.782161+0000","last_peered":"2024-04-26T12:05:04.782161+0000","last_clean":"2024-04-26T12:05:04.782161+0000","last_became_active":"2024-04-26T12:05:03.790662+0000","last_became_peered":"2024-04-26T12:05:03.790662+0000","last_unstale":"2024-04-26T12:05:04.782161+0000","last_undegraded":"2024-04-26T12:05:04.782161+0000","last_fullsized":"2024-04-26T12:05:04.782161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:35.458663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782010+0000","last_change":"2024-04-26T12:05:03.795250+0000","last_active":"2024-04-26T12:05:04.782010+0000","last_peered":"2024-04-26T12:05:04.782010+0000","last_clean":"2024-04-26T12:05:04.782010+0000","last_became_active":"2024-04-26T12:05:03.794632+0000","last_became_peered":"2024-04-26T12:05:03.794632+0000","last_unstale":"2024-04-26T12:05:04.782010+0000","last_undegraded":"2024-04-26T12:05:04.782010+0000","last_fullsized":"2024-04-26T12:05:04.782010+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:59.873501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782077+0000","last_change":"2024-04-26T12:05:03.794090+0000","last_active":"2024-04-26T12:05:04.782077+0000","last_peered":"2024-04-26T12:05:04.782077+0000","last_clean":"2024-04-26T12:05:04.782077+0000","last_became_active":"2024-04-26T12:05:03.793681+0000","last_became_peered":"2024-04-26T12:05:03.793681+0000","last_unstale":"2024-04-26T12:05:04.782077+0000","last_undegraded":"2024-04-26T12:05:04.782077+0000","last_fullsized":"2024-04-26T12:05:04.782077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781643+0000","last_change":"2024-04-26T12:05:03.795539+0000","last_active":"2024-04-26T12:05:04.781643+0000","last_peered":"2024-04-26T12:05:04.781643+0000","last_clean":"2024-04-26T12:05:04.781643+0000","last_became_active":"2024-04-26T12:05:03.795281+0000","last_became_peered":"2024-04-26T12:05:03.795281+0000","last_unstale":"2024-04-26T12:05:04.781643+0000","last_undegraded":"2024-04-26T12:05:04.781643+0000","last_fullsized":"2024-04-26T12:05:04.781643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:27.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781992+0000","last_change":"2024-04-26T12:05:03.793487+0000","last_active":"2024-04-26T12:05:04.781992+0000","last_peered":"2024-04-26T12:05:04.781992+0000","last_clean":"2024-04-26T12:05:04.781992+0000","last_became_active":"2024-04-26T12:05:03.793242+0000","last_became_peered":"2024-04-26T12:05:03.793242+0000","last_unstale":"2024-04-26T12:05:04.781992+0000","last_undegraded":"2024-04-26T12:05:04.781992+0000","last_fullsized":"2024-04-26T12:05:04.781992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:53.331006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781585+0000","last_change":"2024-04-26T12:05:03.786360+0000","last_active":"2024-04-26T12:05:04.781585+0000","last_peered":"2024-04-26T12:05:04.781585+0000","last_clean":"2024-04-26T12:05:04.781585+0000","last_became_active":"2024-04-26T12:05:03.785991+0000","last_became_peered":"2024-04-26T12:05:03.785991+0000","last_unstale":"2024-04-26T12:05:04.781585+0000","last_undegraded":"2024-04-26T12:05:04.781585+0000","last_fullsized":"2024-04-26T12:05:04.781585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:17.702068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204616+0000","last_change":"2024-04-26T12:05:03.797390+0000","last_active":"2024-04-26T12:05:05.204616+0000","last_peered":"2024-04-26T12:05:05.204616+0000","last_clean":"2024-04-26T12:05:05.204616+0000","last_became_active":"2024-04-26T12:05:03.796969+0000","last_became_peered":"2024-04-26T12:05:03.796969+0000","last_unstale":"2024-04-26T12:05:05.204616+0000","last_undegraded":"2024-04-26T12:05:05.204616+0000","last_fullsized":"2024-04-26T12:05:05.204616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:57.461628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782513+0000","last_change":"2024-04-26T12:05:03.794013+0000","last_active":"2024-04-26T12:05:04.782513+0000","last_peered":"2024-04-26T12:05:04.782513+0000","last_clean":"2024-04-26T12:05:04.782513+0000","last_became_active":"2024-04-26T12:05:03.793512+0000","last_became_peered":"2024-04-26T12:05:03.793512+0000","last_unstale":"2024-04-26T12:05:04.782513+0000","last_undegraded":"2024-04-26T12:05:04.782513+0000","last_fullsized":"2024-04-26T12:05:04.782513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204175+0000","last_change":"2024-04-26T12:05:03.798195+0000","last_active":"2024-04-26T12:05:05.204175+0000","last_peered":"2024-04-26T12:05:05.204175+0000","last_clean":"2024-04-26T12:05:05.204175+0000","last_became_active":"2024-04-26T12:05:03.797935+0000","last_became_peered":"2024-04-26T12:05:03.797935+0000","last_unstale":"2024-04-26T12:05:05.204175+0000","last_undegraded":"2024-04-26T12:05:05.204175+0000","last_fullsized":"2024-04-26T12:05:05.204175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:58.872589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782280+0000","last_change":"2024-04-26T12:05:03.792219+0000","last_active":"2024-04-26T12:05:04.782280+0000","last_peered":"2024-04-26T12:05:04.782280+0000","last_clean":"2024-04-26T12:05:04.782280+0000","last_became_active":"2024-04-26T12:05:03.791061+0000","last_became_peered":"2024-04-26T12:05:03.791061+0000","last_unstale":"2024-04-26T12:05:04.782280+0000","last_undegraded":"2024-04-26T12:05:04.782280+0000","last_fullsized":"2024-04-26T12:05:04.782280+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782402+0000","last_change":"2024-04-26T12:05:03.792073+0000","last_active":"2024-04-26T12:05:04.782402+0000","last_peered":"2024-04-26T12:05:04.782402+0000","last_clean":"2024-04-26T12:05:04.782402+0000","last_became_active":"2024-04-26T12:05:03.791693+0000","last_became_peered":"2024-04-26T12:05:03.791693+0000","last_unstale":"2024-04-26T12:05:04.782402+0000","last_undegraded":"2024-04-26T12:05:04.782402+0000","last_fullsized":"2024-04-26T12:05:04.782402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781784+0000","last_change":"2024-04-26T12:05:03.794027+0000","last_active":"2024-04-26T12:05:04.781784+0000","last_peered":"2024-04-26T12:05:04.781784+0000","last_clean":"2024-04-26T12:05:04.781784+0000","last_became_active":"2024-04-26T12:05:03.793660+0000","last_became_peered":"2024-04-26T12:05:03.793660+0000","last_unstale":"2024-04-26T12:05:04.781784+0000","last_undegraded":"2024-04-26T12:05:04.781784+0000","last_fullsized":"2024-04-26T12:05:04.781784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:53.331006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203565+0000","last_change":"2024-04-26T12:05:03.788658+0000","last_active":"2024-04-26T12:05:05.203565+0000","last_peered":"2024-04-26T12:05:05.203565+0000","last_clean":"2024-04-26T12:05:05.203565+0000","last_became_active":"2024-04-26T12:05:03.788050+0000","last_became_peered":"2024-04-26T12:05:03.788050+0000","last_unstale":"2024-04-26T12:05:05.203565+0000","last_undegraded":"2024-04-26T12:05:05.203565+0000","last_fullsized":"2024-04-26T12:05:05.203565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781648+0000","last_change":"2024-04-26T12:05:03.793554+0000","last_active":"2024-04-26T12:05:04.781648+0000","last_peered":"2024-04-26T12:05:04.781648+0000","last_clean":"2024-04-26T12:05:04.781648+0000","last_became_active":"2024-04-26T12:05:03.792588+0000","last_became_peered":"2024-04-26T12:05:03.792588+0000","last_unstale":"2024-04-26T12:05:04.781648+0000","last_undegraded":"2024-04-26T12:05:04.781648+0000","last_fullsized":"2024-04-26T12:05:04.781648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782854+0000","last_change":"2024-04-26T12:05:03.795510+0000","last_active":"2024-04-26T12:05:04.782854+0000","last_peered":"2024-04-26T12:05:04.782854+0000","last_clean":"2024-04-26T12:05:04.782854+0000","last_became_active":"2024-04-26T12:05:03.794639+0000","last_became_peered":"2024-04-26T12:05:03.794639+0000","last_unstale":"2024-04-26T12:05:04.782854+0000","last_undegraded":"2024-04-26T12:05:04.782854+0000","last_fullsized":"2024-04-26T12:05:04.782854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:57.461628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204465+0000","last_change":"2024-04-26T12:05:03.787909+0000","last_active":"2024-04-26T12:05:05.204465+0000","last_peered":"2024-04-26T12:05:05.204465+0000","last_clean":"2024-04-26T12:05:05.204465+0000","last_became_active":"2024-04-26T12:05:03.787562+0000","last_became_peered":"2024-04-26T12:05:03.787562+0000","last_unstale":"2024-04-26T12:05:05.204465+0000","last_undegraded":"2024-04-26T12:05:05.204465+0000","last_fullsized":"2024-04-26T12:05:05.204465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782352+0000","last_change":"2024-04-26T12:05:03.796836+0000","last_active":"2024-04-26T12:05:04.782352+0000","last_peered":"2024-04-26T12:05:04.782352+0000","last_clean":"2024-04-26T12:05:04.782352+0000","last_became_active":"2024-04-26T12:05:03.796524+0000","last_became_peered":"2024-04-26T12:05:03.796524+0000","last_unstale":"2024-04-26T12:05:04.782352+0000","last_undegraded":"2024-04-26T12:05:04.782352+0000","last_fullsized":"2024-04-26T12:05:04.782352+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782420+0000","last_change":"2024-04-26T12:05:03.792400+0000","last_active":"2024-04-26T12:05:04.782420+0000","last_peered":"2024-04-26T12:05:04.782420+0000","last_clean":"2024-04-26T12:05:04.782420+0000","last_became_active":"2024-04-26T12:05:03.792079+0000","last_became_peered":"2024-04-26T12:05:03.792079+0000","last_unstale":"2024-04-26T12:05:04.782420+0000","last_undegraded":"2024-04-26T12:05:04.782420+0000","last_fullsized":"2024-04-26T12:05:04.782420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:24.434355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204245+0000","last_change":"2024-04-26T12:05:03.797172+0000","last_active":"2024-04-26T12:05:05.204245+0000","last_peered":"2024-04-26T12:05:05.204245+0000","last_clean":"2024-04-26T12:05:05.204245+0000","last_became_active":"2024-04-26T12:05:03.796879+0000","last_became_peered":"2024-04-26T12:05:03.796879+0000","last_unstale":"2024-04-26T12:05:05.204245+0000","last_undegraded":"2024-04-26T12:05:05.204245+0000","last_fullsized":"2024-04-26T12:05:05.204245+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:24.434355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781949+0000","last_change":"2024-04-26T12:05:03.793269+0000","last_active":"2024-04-26T12:05:04.781949+0000","last_peered":"2024-04-26T12:05:04.781949+0000","last_clean":"2024-04-26T12:05:04.781949+0000","last_became_active":"2024-04-26T12:05:03.792698+0000","last_became_peered":"2024-04-26T12:05:03.792698+0000","last_unstale":"2024-04-26T12:05:04.781949+0000","last_undegraded":"2024-04-26T12:05:04.781949+0000","last_fullsized":"2024-04-26T12:05:04.781949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:58.579861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203630+0000","last_change":"2024-04-26T12:05:03.796871+0000","last_active":"2024-04-26T12:05:05.203630+0000","last_peered":"2024-04-26T12:05:05.203630+0000","last_clean":"2024-04-26T12:05:05.203630+0000","last_became_active":"2024-04-26T12:05:03.796546+0000","last_became_peered":"2024-04-26T12:05:03.796546+0000","last_unstale":"2024-04-26T12:05:05.203630+0000","last_undegraded":"2024-04-26T12:05:05.203630+0000","last_fullsized":"2024-04-26T12:05:05.203630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:53.331006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781676+0000","last_change":"2024-04-26T12:05:03.791605+0000","last_active":"2024-04-26T12:05:04.781676+0000","last_peered":"2024-04-26T12:05:04.781676+0000","last_clean":"2024-04-26T12:05:04.781676+0000","last_became_active":"2024-04-26T12:05:03.791251+0000","last_became_peered":"2024-04-26T12:05:03.791251+0000","last_unstale":"2024-04-26T12:05:04.781676+0000","last_undegraded":"2024-04-26T12:05:04.781676+0000","last_fullsized":"2024-04-26T12:05:04.781676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:27.239868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782339+0000","last_change":"2024-04-26T12:05:03.793791+0000","last_active":"2024-04-26T12:05:04.782339+0000","last_peered":"2024-04-26T12:05:04.782339+0000","last_clean":"2024-04-26T12:05:04.782339+0000","last_became_active":"2024-04-26T12:05:03.793468+0000","last_became_peered":"2024-04-26T12:05:03.793468+0000","last_unstale":"2024-04-26T12:05:04.782339+0000","last_undegraded":"2024-04-26T12:05:04.782339+0000","last_fullsized":"2024-04-26T12:05:04.782339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:01.289069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782440+0000","last_change":"2024-04-26T12:05:03.430021+0000","last_active":"2024-04-26T12:05:04.782440+0000","last_peered":"2024-04-26T12:05:04.782440+0000","last_clean":"2024-04-26T12:05:04.782440+0000","last_became_active":"2024-04-26T12:05:03.429695+0000","last_became_peered":"2024-04-26T12:05:03.429695+0000","last_unstale":"2024-04-26T12:05:04.782440+0000","last_undegraded":"2024-04-26T12:05:04.782440+0000","last_fullsized":"2024-04-26T12:05:04.782440+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782505+0000","last_change":"2024-04-26T12:05:03.796189+0000","last_active":"2024-04-26T12:05:04.782505+0000","last_peered":"2024-04-26T12:05:04.782505+0000","last_clean":"2024-04-26T12:05:04.782505+0000","last_became_active":"2024-04-26T12:05:03.795438+0000","last_became_peered":"2024-04-26T12:05:03.795438+0000","last_unstale":"2024-04-26T12:05:04.782505+0000","last_undegraded":"2024-04-26T12:05:04.782505+0000","last_fullsized":"2024-04-26T12:05:04.782505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:22.814807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203969+0000","last_change":"2024-04-26T12:05:03.428605+0000","last_active":"2024-04-26T12:05:05.203969+0000","last_peered":"2024-04-26T12:05:05.203969+0000","last_clean":"2024-04-26T12:05:05.203969+0000","last_became_active":"2024-04-26T12:05:03.428098+0000","last_became_peered":"2024-04-26T12:05:03.428098+0000","last_unstale":"2024-04-26T12:05:05.203969+0000","last_undegraded":"2024-04-26T12:05:05.203969+0000","last_fullsized":"2024-04-26T12:05:05.203969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204596+0000","last_change":"2024-04-26T12:05:03.788568+0000","last_active":"2024-04-26T12:05:05.204596+0000","last_peered":"2024-04-26T12:05:05.204596+0000","last_clean":"2024-04-26T12:05:05.204596+0000","last_became_active":"2024-04-26T12:05:03.788039+0000","last_became_peered":"2024-04-26T12:05:03.788039+0000","last_unstale":"2024-04-26T12:05:05.204596+0000","last_undegraded":"2024-04-26T12:05:05.204596+0000","last_fullsized":"2024-04-26T12:05:05.204596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781927+0000","last_change":"2024-04-26T12:05:03.422773+0000","last_active":"2024-04-26T12:05:04.781927+0000","last_peered":"2024-04-26T12:05:04.781927+0000","last_clean":"2024-04-26T12:05:04.781927+0000","last_became_active":"2024-04-26T12:05:03.422412+0000","last_became_peered":"2024-04-26T12:05:03.422412+0000","last_unstale":"2024-04-26T12:05:04.781927+0000","last_undegraded":"2024-04-26T12:05:04.781927+0000","last_fullsized":"2024-04-26T12:05:04.781927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:06.758253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204353+0000","last_change":"2024-04-26T12:05:03.788505+0000","last_active":"2024-04-26T12:05:05.204353+0000","last_peered":"2024-04-26T12:05:05.204353+0000","last_clean":"2024-04-26T12:05:05.204353+0000","last_became_active":"2024-04-26T12:05:03.788184+0000","last_became_peered":"2024-04-26T12:05:03.788184+0000","last_unstale":"2024-04-26T12:05:05.204353+0000","last_undegraded":"2024-04-26T12:05:05.204353+0000","last_fullsized":"2024-04-26T12:05:05.204353+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781717+0000","last_change":"2024-04-26T12:05:03.425495+0000","last_active":"2024-04-26T12:05:04.781717+0000","last_peered":"2024-04-26T12:05:04.781717+0000","last_clean":"2024-04-26T12:05:04.781717+0000","last_became_active":"2024-04-26T12:05:03.424963+0000","last_became_peered":"2024-04-26T12:05:03.424963+0000","last_unstale":"2024-04-26T12:05:04.781717+0000","last_undegraded":"2024-04-26T12:05:04.781717+0000","last_fullsized":"2024-04-26T12:05:04.781717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:55.660897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782532+0000","last_change":"2024-04-26T12:05:03.426142+0000","last_active":"2024-04-26T12:05:04.782532+0000","last_peered":"2024-04-26T12:05:04.782532+0000","last_clean":"2024-04-26T12:05:04.782532+0000","last_became_active":"2024-04-26T12:05:03.425699+0000","last_became_peered":"2024-04-26T12:05:03.425699+0000","last_unstale":"2024-04-26T12:05:04.782532+0000","last_undegraded":"2024-04-26T12:05:04.782532+0000","last_fullsized":"2024-04-26T12:05:04.782532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:41.279426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781647+0000","last_change":"2024-04-26T12:05:03.794778+0000","last_active":"2024-04-26T12:05:04.781647+0000","last_peered":"2024-04-26T12:05:04.781647+0000","last_clean":"2024-04-26T12:05:04.781647+0000","last_became_active":"2024-04-26T12:05:03.794192+0000","last_became_peered":"2024-04-26T12:05:03.794192+0000","last_unstale":"2024-04-26T12:05:04.781647+0000","last_undegraded":"2024-04-26T12:05:04.781647+0000","last_fullsized":"2024-04-26T12:05:04.781647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:16.372597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782585+0000","last_change":"2024-04-26T12:05:03.426530+0000","last_active":"2024-04-26T12:05:04.782585+0000","last_peered":"2024-04-26T12:05:04.782585+0000","last_clean":"2024-04-26T12:05:04.782585+0000","last_became_active":"2024-04-26T12:05:03.426113+0000","last_became_peered":"2024-04-26T12:05:03.426113+0000","last_unstale":"2024-04-26T12:05:04.782585+0000","last_undegraded":"2024-04-26T12:05:04.782585+0000","last_fullsized":"2024-04-26T12:05:04.782585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:21.029311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781810+0000","last_change":"2024-04-26T12:05:03.793000+0000","last_active":"2024-04-26T12:05:04.781810+0000","last_peered":"2024-04-26T12:05:04.781810+0000","last_clean":"2024-04-26T12:05:04.781810+0000","last_became_active":"2024-04-26T12:05:03.792480+0000","last_became_peered":"2024-04-26T12:05:03.792480+0000","last_unstale":"2024-04-26T12:05:04.781810+0000","last_undegraded":"2024-04-26T12:05:04.781810+0000","last_fullsized":"2024-04-26T12:05:04.781810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782682+0000","last_change":"2024-04-26T12:05:03.426039+0000","last_active":"2024-04-26T12:05:04.782682+0000","last_peered":"2024-04-26T12:05:04.782682+0000","last_clean":"2024-04-26T12:05:04.782682+0000","last_became_active":"2024-04-26T12:05:03.425666+0000","last_became_peered":"2024-04-26T12:05:03.425666+0000","last_unstale":"2024-04-26T12:05:04.782682+0000","last_undegraded":"2024-04-26T12:05:04.782682+0000","last_fullsized":"2024-04-26T12:05:04.782682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:00.998013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781698+0000","last_change":"2024-04-26T12:05:03.791809+0000","last_active":"2024-04-26T12:05:04.781698+0000","last_peered":"2024-04-26T12:05:04.781698+0000","last_clean":"2024-04-26T12:05:04.781698+0000","last_became_active":"2024-04-26T12:05:03.791272+0000","last_became_peered":"2024-04-26T12:05:03.791272+0000","last_unstale":"2024-04-26T12:05:04.781698+0000","last_undegraded":"2024-04-26T12:05:04.781698+0000","last_fullsized":"2024-04-26T12:05:04.781698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782611+0000","last_change":"2024-04-26T12:05:03.430224+0000","last_active":"2024-04-26T12:05:04.782611+0000","last_peered":"2024-04-26T12:05:04.782611+0000","last_clean":"2024-04-26T12:05:04.782611+0000","last_became_active":"2024-04-26T12:05:03.429291+0000","last_became_peered":"2024-04-26T12:05:03.429291+0000","last_unstale":"2024-04-26T12:05:04.782611+0000","last_undegraded":"2024-04-26T12:05:04.782611+0000","last_fullsized":"2024-04-26T12:05:04.782611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204057+0000","last_change":"2024-04-26T12:05:03.788174+0000","last_active":"2024-04-26T12:05:05.204057+0000","last_peered":"2024-04-26T12:05:05.204057+0000","last_clean":"2024-04-26T12:05:05.204057+0000","last_became_active":"2024-04-26T12:05:03.787772+0000","last_became_peered":"2024-04-26T12:05:03.787772+0000","last_unstale":"2024-04-26T12:05:05.204057+0000","last_undegraded":"2024-04-26T12:05:05.204057+0000","last_fullsized":"2024-04-26T12:05:05.204057+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204340+0000","last_change":"2024-04-26T12:05:03.431162+0000","last_active":"2024-04-26T12:05:05.204340+0000","last_peered":"2024-04-26T12:05:05.204340+0000","last_clean":"2024-04-26T12:05:05.204340+0000","last_became_active":"2024-04-26T12:05:03.430855+0000","last_became_peered":"2024-04-26T12:05:03.430855+0000","last_unstale":"2024-04-26T12:05:05.204340+0000","last_undegraded":"2024-04-26T12:05:05.204340+0000","last_fullsized":"2024-04-26T12:05:05.204340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:41.279426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782386+0000","last_change":"2024-04-26T12:05:03.792357+0000","last_active":"2024-04-26T12:05:04.782386+0000","last_peered":"2024-04-26T12:05:04.782386+0000","last_clean":"2024-04-26T12:05:04.782386+0000","last_became_active":"2024-04-26T12:05:03.792119+0000","last_became_peered":"2024-04-26T12:05:03.792119+0000","last_unstale":"2024-04-26T12:05:04.782386+0000","last_undegraded":"2024-04-26T12:05:04.782386+0000","last_fullsized":"2024-04-26T12:05:04.782386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781879+0000","last_change":"2024-04-26T12:05:03.429811+0000","last_active":"2024-04-26T12:05:04.781879+0000","last_peered":"2024-04-26T12:05:04.781879+0000","last_clean":"2024-04-26T12:05:04.781879+0000","last_became_active":"2024-04-26T12:05:03.429469+0000","last_became_peered":"2024-04-26T12:05:03.429469+0000","last_unstale":"2024-04-26T12:05:04.781879+0000","last_undegraded":"2024-04-26T12:05:04.781879+0000","last_fullsized":"2024-04-26T12:05:04.781879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782424+0000","last_change":"2024-04-26T12:05:03.795646+0000","last_active":"2024-04-26T12:05:04.782424+0000","last_peered":"2024-04-26T12:05:04.782424+0000","last_clean":"2024-04-26T12:05:04.782424+0000","last_became_active":"2024-04-26T12:05:03.795354+0000","last_became_peered":"2024-04-26T12:05:03.795354+0000","last_unstale":"2024-04-26T12:05:04.782424+0000","last_undegraded":"2024-04-26T12:05:04.782424+0000","last_fullsized":"2024-04-26T12:05:04.782424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:22.814807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782060+0000","last_change":"2024-04-26T12:05:03.427908+0000","last_active":"2024-04-26T12:05:04.782060+0000","last_peered":"2024-04-26T12:05:04.782060+0000","last_clean":"2024-04-26T12:05:04.782060+0000","last_became_active":"2024-04-26T12:05:03.426718+0000","last_became_peered":"2024-04-26T12:05:03.426718+0000","last_unstale":"2024-04-26T12:05:04.782060+0000","last_undegraded":"2024-04-26T12:05:04.782060+0000","last_fullsized":"2024-04-26T12:05:04.782060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:40.538058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782365+0000","last_change":"2024-04-26T12:05:03.797113+0000","last_active":"2024-04-26T12:05:04.782365+0000","last_peered":"2024-04-26T12:05:04.782365+0000","last_clean":"2024-04-26T12:05:04.782365+0000","last_became_active":"2024-04-26T12:05:03.796739+0000","last_became_peered":"2024-04-26T12:05:03.796739+0000","last_unstale":"2024-04-26T12:05:04.782365+0000","last_undegraded":"2024-04-26T12:05:04.782365+0000","last_fullsized":"2024-04-26T12:05:04.782365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:59.873501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781849+0000","last_change":"2024-04-26T12:05:03.428262+0000","last_active":"2024-04-26T12:05:04.781849+0000","last_peered":"2024-04-26T12:05:04.781849+0000","last_clean":"2024-04-26T12:05:04.781849+0000","last_became_active":"2024-04-26T12:05:03.426588+0000","last_became_peered":"2024-04-26T12:05:03.426588+0000","last_unstale":"2024-04-26T12:05:04.781849+0000","last_undegraded":"2024-04-26T12:05:04.781849+0000","last_fullsized":"2024-04-26T12:05:04.781849+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:42.674797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204403+0000","last_change":"2024-04-26T12:05:03.797633+0000","last_active":"2024-04-26T12:05:05.204403+0000","last_peered":"2024-04-26T12:05:05.204403+0000","last_clean":"2024-04-26T12:05:05.204403+0000","last_became_active":"2024-04-26T12:05:03.797338+0000","last_became_peered":"2024-04-26T12:05:03.797338+0000","last_unstale":"2024-04-26T12:05:05.204403+0000","last_undegraded":"2024-04-26T12:05:05.204403+0000","last_fullsized":"2024-04-26T12:05:05.204403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:22.814807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.782901+0000","last_change":"2024-04-26T12:04:53.388840+0000","last_active":"2024-04-26T12:05:03.782901+0000","last_peered":"2024-04-26T12:05:03.782901+0000","last_clean":"2024-04-26T12:05:03.782901+0000","last_became_active":"2024-04-26T12:04:53.388568+0000","last_became_peered":"2024-04-26T12:04:53.388568+0000","last_unstale":"2024-04-26T12:05:03.782901+0000","last_undegraded":"2024-04-26T12:05:03.782901+0000","last_fullsized":"2024-04-26T12:05:03.782901+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_clean_scrub_stamp":"2024-04-26T12:04:52.376986+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:04.970330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.781157+0000","last_change":"2024-04-26T12:04:59.403711+0000","last_active":"2024-04-26T12:05:03.781157+0000","last_peered":"2024-04-26T12:05:03.781157+0000","last_clean":"2024-04-26T12:05:03.781157+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:05:03.781157+0000","last_undegraded":"2024-04-26T12:05:03.781157+0000","last_fullsized":"2024-04-26T12:05:03.781157+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:45.779614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204217+0000","last_change":"2024-04-26T12:05:03.429674+0000","last_active":"2024-04-26T12:05:05.204217+0000","last_peered":"2024-04-26T12:05:05.204217+0000","last_clean":"2024-04-26T12:05:05.204217+0000","last_became_active":"2024-04-26T12:05:03.429266+0000","last_became_peered":"2024-04-26T12:05:03.429266+0000","last_unstale":"2024-04-26T12:05:05.204217+0000","last_undegraded":"2024-04-26T12:05:05.204217+0000","last_fullsized":"2024-04-26T12:05:05.204217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:55.660897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782655+0000","last_change":"2024-04-26T12:05:03.797640+0000","last_active":"2024-04-26T12:05:04.782655+0000","last_peered":"2024-04-26T12:05:04.782655+0000","last_clean":"2024-04-26T12:05:04.782655+0000","last_became_active":"2024-04-26T12:05:03.797302+0000","last_became_peered":"2024-04-26T12:05:03.797302+0000","last_unstale":"2024-04-26T12:05:04.782655+0000","last_undegraded":"2024-04-26T12:05:04.782655+0000","last_fullsized":"2024-04-26T12:05:04.782655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:16.372597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.781404+0000","last_change":"2024-04-26T12:04:59.405437+0000","last_active":"2024-04-26T12:05:03.781404+0000","last_peered":"2024-04-26T12:05:03.781404+0000","last_clean":"2024-04-26T12:05:03.781404+0000","last_became_active":"2024-04-26T12:04:59.405193+0000","last_became_peered":"2024-04-26T12:04:59.405193+0000","last_unstale":"2024-04-26T12:05:03.781404+0000","last_undegraded":"2024-04-26T12:05:03.781404+0000","last_fullsized":"2024-04-26T12:05:03.781404+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:20.977569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203835+0000","last_change":"2024-04-26T12:05:03.428547+0000","last_active":"2024-04-26T12:05:05.203835+0000","last_peered":"2024-04-26T12:05:05.203835+0000","last_clean":"2024-04-26T12:05:05.203835+0000","last_became_active":"2024-04-26T12:05:03.427985+0000","last_became_peered":"2024-04-26T12:05:03.427985+0000","last_unstale":"2024-04-26T12:05:05.203835+0000","last_undegraded":"2024-04-26T12:05:05.203835+0000","last_fullsized":"2024-04-26T12:05:05.203835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:19.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782574+0000","last_change":"2024-04-26T12:05:03.793800+0000","last_active":"2024-04-26T12:05:04.782574+0000","last_peered":"2024-04-26T12:05:04.782574+0000","last_clean":"2024-04-26T12:05:04.782574+0000","last_became_active":"2024-04-26T12:05:03.792932+0000","last_became_peered":"2024-04-26T12:05:03.792932+0000","last_unstale":"2024-04-26T12:05:04.782574+0000","last_undegraded":"2024-04-26T12:05:04.782574+0000","last_fullsized":"2024-04-26T12:05:04.782574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.780048+0000","last_change":"2024-04-26T12:04:59.405617+0000","last_active":"2024-04-26T12:05:03.780048+0000","last_peered":"2024-04-26T12:05:03.780048+0000","last_clean":"2024-04-26T12:05:03.780048+0000","last_became_active":"2024-04-26T12:04:59.405328+0000","last_became_peered":"2024-04-26T12:04:59.405328+0000","last_unstale":"2024-04-26T12:05:03.780048+0000","last_undegraded":"2024-04-26T12:05:03.780048+0000","last_fullsized":"2024-04-26T12:05:03.780048+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:39.317039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782519+0000","last_change":"2024-04-26T12:05:03.424576+0000","last_active":"2024-04-26T12:05:04.782519+0000","last_peered":"2024-04-26T12:05:04.782519+0000","last_clean":"2024-04-26T12:05:04.782519+0000","last_became_active":"2024-04-26T12:05:03.424289+0000","last_became_peered":"2024-04-26T12:05:03.424289+0000","last_unstale":"2024-04-26T12:05:04.782519+0000","last_undegraded":"2024-04-26T12:05:04.782519+0000","last_fullsized":"2024-04-26T12:05:04.782519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:10.759772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204460+0000","last_change":"2024-04-26T12:05:03.798238+0000","last_active":"2024-04-26T12:05:05.204460+0000","last_peered":"2024-04-26T12:05:05.204460+0000","last_clean":"2024-04-26T12:05:05.204460+0000","last_became_active":"2024-04-26T12:05:03.797924+0000","last_became_peered":"2024-04-26T12:05:03.797924+0000","last_unstale":"2024-04-26T12:05:05.204460+0000","last_undegraded":"2024-04-26T12:05:05.204460+0000","last_fullsized":"2024-04-26T12:05:05.204460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:01.289069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.781616+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:05:03.781616+0000","last_peered":"2024-04-26T12:05:03.781616+0000","last_clean":"2024-04-26T12:05:03.781616+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:05:03.781616+0000","last_undegraded":"2024-04-26T12:05:03.781616+0000","last_fullsized":"2024-04-26T12:05:03.781616+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:12.939539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782535+0000","last_change":"2024-04-26T12:05:03.430140+0000","last_active":"2024-04-26T12:05:04.782535+0000","last_peered":"2024-04-26T12:05:04.782535+0000","last_clean":"2024-04-26T12:05:04.782535+0000","last_became_active":"2024-04-26T12:05:03.429838+0000","last_became_peered":"2024-04-26T12:05:03.429838+0000","last_unstale":"2024-04-26T12:05:04.782535+0000","last_undegraded":"2024-04-26T12:05:04.782535+0000","last_fullsized":"2024-04-26T12:05:04.782535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204416+0000","last_change":"2024-04-26T12:05:03.796731+0000","last_active":"2024-04-26T12:05:05.204416+0000","last_peered":"2024-04-26T12:05:05.204416+0000","last_clean":"2024-04-26T12:05:05.204416+0000","last_became_active":"2024-04-26T12:05:03.796432+0000","last_became_peered":"2024-04-26T12:05:03.796432+0000","last_unstale":"2024-04-26T12:05:05.204416+0000","last_undegraded":"2024-04-26T12:05:05.204416+0000","last_fullsized":"2024-04-26T12:05:05.204416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:58.579861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782707+0000","last_change":"2024-04-26T12:05:03.429673+0000","last_active":"2024-04-26T12:05:04.782707+0000","last_peered":"2024-04-26T12:05:04.782707+0000","last_clean":"2024-04-26T12:05:04.782707+0000","last_became_active":"2024-04-26T12:05:03.429146+0000","last_became_peered":"2024-04-26T12:05:03.429146+0000","last_unstale":"2024-04-26T12:05:04.782707+0000","last_undegraded":"2024-04-26T12:05:04.782707+0000","last_fullsized":"2024-04-26T12:05:04.782707+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.779759+0000","last_change":"2024-04-26T12:04:59.405766+0000","last_active":"2024-04-26T12:05:03.779759+0000","last_peered":"2024-04-26T12:05:03.779759+0000","last_clean":"2024-04-26T12:05:03.779759+0000","last_became_active":"2024-04-26T12:04:59.405406+0000","last_became_peered":"2024-04-26T12:04:59.405406+0000","last_unstale":"2024-04-26T12:05:03.779759+0000","last_undegraded":"2024-04-26T12:05:03.779759+0000","last_fullsized":"2024-04-26T12:05:03.779759+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:13.860871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782006+0000","last_change":"2024-04-26T12:05:03.792534+0000","last_active":"2024-04-26T12:05:04.782006+0000","last_peered":"2024-04-26T12:05:04.782006+0000","last_clean":"2024-04-26T12:05:04.782006+0000","last_became_active":"2024-04-26T12:05:03.792160+0000","last_became_peered":"2024-04-26T12:05:03.792160+0000","last_unstale":"2024-04-26T12:05:04.782006+0000","last_undegraded":"2024-04-26T12:05:04.782006+0000","last_fullsized":"2024-04-26T12:05:04.782006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:41.930005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204484+0000","last_change":"2024-04-26T12:05:03.429642+0000","last_active":"2024-04-26T12:05:05.204484+0000","last_peered":"2024-04-26T12:05:05.204484+0000","last_clean":"2024-04-26T12:05:05.204484+0000","last_became_active":"2024-04-26T12:05:03.429197+0000","last_became_peered":"2024-04-26T12:05:03.429197+0000","last_unstale":"2024-04-26T12:05:05.204484+0000","last_undegraded":"2024-04-26T12:05:05.204484+0000","last_fullsized":"2024-04-26T12:05:05.204484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:40.538058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.788889+0000","last_change":"2024-04-26T12:04:59.405294+0000","last_active":"2024-04-26T12:05:03.788889+0000","last_peered":"2024-04-26T12:05:03.788889+0000","last_clean":"2024-04-26T12:05:03.788889+0000","last_became_active":"2024-04-26T12:04:59.405044+0000","last_became_peered":"2024-04-26T12:04:59.405044+0000","last_unstale":"2024-04-26T12:05:03.788889+0000","last_undegraded":"2024-04-26T12:05:03.788889+0000","last_fullsized":"2024-04-26T12:05:03.788889+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:47.042833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782238+0000","last_change":"2024-04-26T12:05:03.793408+0000","last_active":"2024-04-26T12:05:04.782238+0000","last_peered":"2024-04-26T12:05:04.782238+0000","last_clean":"2024-04-26T12:05:04.782238+0000","last_became_active":"2024-04-26T12:05:03.793019+0000","last_became_peered":"2024-04-26T12:05:03.793019+0000","last_unstale":"2024-04-26T12:05:04.782238+0000","last_undegraded":"2024-04-26T12:05:04.782238+0000","last_fullsized":"2024-04-26T12:05:04.782238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:25.062114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204650+0000","last_change":"2024-04-26T12:05:03.430008+0000","last_active":"2024-04-26T12:05:05.204650+0000","last_peered":"2024-04-26T12:05:05.204650+0000","last_clean":"2024-04-26T12:05:05.204650+0000","last_became_active":"2024-04-26T12:05:03.429362+0000","last_became_peered":"2024-04-26T12:05:03.429362+0000","last_unstale":"2024-04-26T12:05:05.204650+0000","last_undegraded":"2024-04-26T12:05:05.204650+0000","last_fullsized":"2024-04-26T12:05:05.204650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.780359+0000","last_change":"2024-04-26T12:04:59.405667+0000","last_active":"2024-04-26T12:05:03.780359+0000","last_peered":"2024-04-26T12:05:03.780359+0000","last_clean":"2024-04-26T12:05:03.780359+0000","last_became_active":"2024-04-26T12:04:59.405328+0000","last_became_peered":"2024-04-26T12:04:59.405328+0000","last_unstale":"2024-04-26T12:05:03.780359+0000","last_undegraded":"2024-04-26T12:05:03.780359+0000","last_fullsized":"2024-04-26T12:05:03.780359+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:20.977569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203759+0000","last_change":"2024-04-26T12:05:03.789623+0000","last_active":"2024-04-26T12:05:05.203759+0000","last_peered":"2024-04-26T12:05:05.203759+0000","last_clean":"2024-04-26T12:05:05.203759+0000","last_became_active":"2024-04-26T12:05:03.789390+0000","last_became_peered":"2024-04-26T12:05:03.789390+0000","last_unstale":"2024-04-26T12:05:05.203759+0000","last_undegraded":"2024-04-26T12:05:05.203759+0000","last_fullsized":"2024-04-26T12:05:05.203759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348623+0000","last_change":"2024-04-26T12:05:03.429222+0000","last_active":"2024-04-26T12:05:06.348623+0000","last_peered":"2024-04-26T12:05:06.348623+0000","last_clean":"2024-04-26T12:05:06.348623+0000","last_became_active":"2024-04-26T12:05:03.428803+0000","last_became_peered":"2024-04-26T12:05:03.428803+0000","last_unstale":"2024-04-26T12:05:06.348623+0000","last_undegraded":"2024-04-26T12:05:06.348623+0000","last_fullsized":"2024-04-26T12:05:06.348623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:31.305644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.779178+0000","last_change":"2024-04-26T12:04:59.408078+0000","last_active":"2024-04-26T12:05:03.779178+0000","last_peered":"2024-04-26T12:05:03.779178+0000","last_clean":"2024-04-26T12:05:03.779178+0000","last_became_active":"2024-04-26T12:04:59.407804+0000","last_became_peered":"2024-04-26T12:04:59.407804+0000","last_unstale":"2024-04-26T12:05:03.779178+0000","last_undegraded":"2024-04-26T12:05:03.779178+0000","last_fullsized":"2024-04-26T12:05:03.779178+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:56.449518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782185+0000","last_change":"2024-04-26T12:05:03.792547+0000","last_active":"2024-04-26T12:05:04.782185+0000","last_peered":"2024-04-26T12:05:04.782185+0000","last_clean":"2024-04-26T12:05:04.782185+0000","last_became_active":"2024-04-26T12:05:03.792078+0000","last_became_peered":"2024-04-26T12:05:03.792078+0000","last_unstale":"2024-04-26T12:05:04.782185+0000","last_undegraded":"2024-04-26T12:05:04.782185+0000","last_fullsized":"2024-04-26T12:05:04.782185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:45.563923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782159+0000","last_change":"2024-04-26T12:05:03.795500+0000","last_active":"2024-04-26T12:05:04.782159+0000","last_peered":"2024-04-26T12:05:04.782159+0000","last_clean":"2024-04-26T12:05:04.782159+0000","last_became_active":"2024-04-26T12:05:03.795173+0000","last_became_peered":"2024-04-26T12:05:03.795173+0000","last_unstale":"2024-04-26T12:05:04.782159+0000","last_undegraded":"2024-04-26T12:05:04.782159+0000","last_fullsized":"2024-04-26T12:05:04.782159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:01.289069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782556+0000","last_change":"2024-04-26T12:05:03.426261+0000","last_active":"2024-04-26T12:05:04.782556+0000","last_peered":"2024-04-26T12:05:04.782556+0000","last_clean":"2024-04-26T12:05:04.782556+0000","last_became_active":"2024-04-26T12:05:03.425897+0000","last_became_peered":"2024-04-26T12:05:03.425897+0000","last_unstale":"2024-04-26T12:05:04.782556+0000","last_undegraded":"2024-04-26T12:05:04.782556+0000","last_fullsized":"2024-04-26T12:05:04.782556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:31.305644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203851+0000","last_change":"2024-04-26T12:05:03.795443+0000","last_active":"2024-04-26T12:05:05.203851+0000","last_peered":"2024-04-26T12:05:05.203851+0000","last_clean":"2024-04-26T12:05:05.203851+0000","last_became_active":"2024-04-26T12:05:03.795190+0000","last_became_peered":"2024-04-26T12:05:03.795190+0000","last_unstale":"2024-04-26T12:05:05.203851+0000","last_undegraded":"2024-04-26T12:05:05.203851+0000","last_fullsized":"2024-04-26T12:05:05.203851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:59.873501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782685+0000","last_change":"2024-04-26T12:05:03.425106+0000","last_active":"2024-04-26T12:05:04.782685+0000","last_peered":"2024-04-26T12:05:04.782685+0000","last_clean":"2024-04-26T12:05:04.782685+0000","last_became_active":"2024-04-26T12:05:03.424753+0000","last_became_peered":"2024-04-26T12:05:03.424753+0000","last_unstale":"2024-04-26T12:05:04.782685+0000","last_undegraded":"2024-04-26T12:05:04.782685+0000","last_fullsized":"2024-04-26T12:05:04.782685+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:10.741652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782591+0000","last_change":"2024-04-26T12:05:03.429257+0000","last_active":"2024-04-26T12:05:04.782591+0000","last_peered":"2024-04-26T12:05:04.782591+0000","last_clean":"2024-04-26T12:05:04.782591+0000","last_became_active":"2024-04-26T12:05:03.428921+0000","last_became_peered":"2024-04-26T12:05:03.428921+0000","last_unstale":"2024-04-26T12:05:04.782591+0000","last_undegraded":"2024-04-26T12:05:04.782591+0000","last_fullsized":"2024-04-26T12:05:04.782591+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:49.774845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203669+0000","last_change":"2024-04-26T12:05:03.788141+0000","last_active":"2024-04-26T12:05:05.203669+0000","last_peered":"2024-04-26T12:05:05.203669+0000","last_clean":"2024-04-26T12:05:05.203669+0000","last_became_active":"2024-04-26T12:05:03.787533+0000","last_became_peered":"2024-04-26T12:05:03.787533+0000","last_unstale":"2024-04-26T12:05:05.203669+0000","last_undegraded":"2024-04-26T12:05:05.203669+0000","last_fullsized":"2024-04-26T12:05:05.203669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204552+0000","last_change":"2024-04-26T12:05:03.428971+0000","last_active":"2024-04-26T12:05:05.204552+0000","last_peered":"2024-04-26T12:05:05.204552+0000","last_clean":"2024-04-26T12:05:05.204552+0000","last_became_active":"2024-04-26T12:05:03.428445+0000","last_became_peered":"2024-04-26T12:05:03.428445+0000","last_unstale":"2024-04-26T12:05:05.204552+0000","last_undegraded":"2024-04-26T12:05:05.204552+0000","last_fullsized":"2024-04-26T12:05:05.204552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203649+0000","last_change":"2024-04-26T12:05:03.795318+0000","last_active":"2024-04-26T12:05:05.203649+0000","last_peered":"2024-04-26T12:05:05.203649+0000","last_clean":"2024-04-26T12:05:05.203649+0000","last_became_active":"2024-04-26T12:05:03.795053+0000","last_became_peered":"2024-04-26T12:05:03.795053+0000","last_unstale":"2024-04-26T12:05:05.203649+0000","last_undegraded":"2024-04-26T12:05:05.203649+0000","last_fullsized":"2024-04-26T12:05:05.203649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:16.372597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782875+0000","last_change":"2024-04-26T12:05:03.795109+0000","last_active":"2024-04-26T12:05:04.782875+0000","last_peered":"2024-04-26T12:05:04.782875+0000","last_clean":"2024-04-26T12:05:04.782875+0000","last_became_active":"2024-04-26T12:05:03.794392+0000","last_became_peered":"2024-04-26T12:05:03.794392+0000","last_unstale":"2024-04-26T12:05:04.782875+0000","last_undegraded":"2024-04-26T12:05:04.782875+0000","last_fullsized":"2024-04-26T12:05:04.782875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:05.327938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203799+0000","last_change":"2024-04-26T12:05:03.429889+0000","last_active":"2024-04-26T12:05:05.203799+0000","last_peered":"2024-04-26T12:05:05.203799+0000","last_clean":"2024-04-26T12:05:05.203799+0000","last_became_active":"2024-04-26T12:05:03.429370+0000","last_became_peered":"2024-04-26T12:05:03.429370+0000","last_unstale":"2024-04-26T12:05:05.203799+0000","last_undegraded":"2024-04-26T12:05:05.203799+0000","last_fullsized":"2024-04-26T12:05:05.203799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:26.791180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204344+0000","last_change":"2024-04-26T12:05:03.788754+0000","last_active":"2024-04-26T12:05:05.204344+0000","last_peered":"2024-04-26T12:05:05.204344+0000","last_clean":"2024-04-26T12:05:05.204344+0000","last_became_active":"2024-04-26T12:05:03.788311+0000","last_became_peered":"2024-04-26T12:05:03.788311+0000","last_unstale":"2024-04-26T12:05:05.204344+0000","last_undegraded":"2024-04-26T12:05:05.204344+0000","last_fullsized":"2024-04-26T12:05:05.204344+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203763+0000","last_change":"2024-04-26T12:05:03.428810+0000","last_active":"2024-04-26T12:05:05.203763+0000","last_peered":"2024-04-26T12:05:05.203763+0000","last_clean":"2024-04-26T12:05:05.203763+0000","last_became_active":"2024-04-26T12:05:03.428191+0000","last_became_peered":"2024-04-26T12:05:03.428191+0000","last_unstale":"2024-04-26T12:05:05.203763+0000","last_undegraded":"2024-04-26T12:05:05.203763+0000","last_fullsized":"2024-04-26T12:05:05.203763+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782302+0000","last_change":"2024-04-26T12:05:03.796880+0000","last_active":"2024-04-26T12:05:04.782302+0000","last_peered":"2024-04-26T12:05:04.782302+0000","last_clean":"2024-04-26T12:05:04.782302+0000","last_became_active":"2024-04-26T12:05:03.796419+0000","last_became_peered":"2024-04-26T12:05:03.796419+0000","last_unstale":"2024-04-26T12:05:04.782302+0000","last_undegraded":"2024-04-26T12:05:04.782302+0000","last_fullsized":"2024-04-26T12:05:04.782302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:58.872589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782079+0000","last_change":"2024-04-26T12:05:03.428084+0000","last_active":"2024-04-26T12:05:04.782079+0000","last_peered":"2024-04-26T12:05:04.782079+0000","last_clean":"2024-04-26T12:05:04.782079+0000","last_became_active":"2024-04-26T12:05:03.426982+0000","last_became_peered":"2024-04-26T12:05:03.426982+0000","last_unstale":"2024-04-26T12:05:04.782079+0000","last_undegraded":"2024-04-26T12:05:04.782079+0000","last_fullsized":"2024-04-26T12:05:04.782079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:19.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782315+0000","last_change":"2024-04-26T12:05:03.793470+0000","last_active":"2024-04-26T12:05:04.782315+0000","last_peered":"2024-04-26T12:05:04.782315+0000","last_clean":"2024-04-26T12:05:04.782315+0000","last_became_active":"2024-04-26T12:05:03.792869+0000","last_became_peered":"2024-04-26T12:05:03.792869+0000","last_unstale":"2024-04-26T12:05:04.782315+0000","last_undegraded":"2024-04-26T12:05:04.782315+0000","last_fullsized":"2024-04-26T12:05:04.782315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:27.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782341+0000","last_change":"2024-04-26T12:05:03.426947+0000","last_active":"2024-04-26T12:05:04.782341+0000","last_peered":"2024-04-26T12:05:04.782341+0000","last_clean":"2024-04-26T12:05:04.782341+0000","last_became_active":"2024-04-26T12:05:03.426211+0000","last_became_peered":"2024-04-26T12:05:03.426211+0000","last_unstale":"2024-04-26T12:05:04.782341+0000","last_undegraded":"2024-04-26T12:05:04.782341+0000","last_fullsized":"2024-04-26T12:05:04.782341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:11.959244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782101+0000","last_change":"2024-04-26T12:05:03.791986+0000","last_active":"2024-04-26T12:05:04.782101+0000","last_peered":"2024-04-26T12:05:04.782101+0000","last_clean":"2024-04-26T12:05:04.782101+0000","last_became_active":"2024-04-26T12:05:03.790823+0000","last_became_peered":"2024-04-26T12:05:03.790823+0000","last_unstale":"2024-04-26T12:05:04.782101+0000","last_undegraded":"2024-04-26T12:05:04.782101+0000","last_fullsized":"2024-04-26T12:05:04.782101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782508+0000","last_change":"2024-04-26T12:05:03.429469+0000","last_active":"2024-04-26T12:05:04.782508+0000","last_peered":"2024-04-26T12:05:04.782508+0000","last_clean":"2024-04-26T12:05:04.782508+0000","last_became_active":"2024-04-26T12:05:03.429015+0000","last_became_peered":"2024-04-26T12:05:03.429015+0000","last_unstale":"2024-04-26T12:05:04.782508+0000","last_undegraded":"2024-04-26T12:05:04.782508+0000","last_fullsized":"2024-04-26T12:05:04.782508+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781940+0000","last_change":"2024-04-26T12:05:03.791929+0000","last_active":"2024-04-26T12:05:04.781940+0000","last_peered":"2024-04-26T12:05:04.781940+0000","last_clean":"2024-04-26T12:05:04.781940+0000","last_became_active":"2024-04-26T12:05:03.791540+0000","last_became_peered":"2024-04-26T12:05:03.791540+0000","last_unstale":"2024-04-26T12:05:04.781940+0000","last_undegraded":"2024-04-26T12:05:04.781940+0000","last_fullsized":"2024-04-26T12:05:04.781940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782585+0000","last_change":"2024-04-26T12:05:03.426210+0000","last_active":"2024-04-26T12:05:04.782585+0000","last_peered":"2024-04-26T12:05:04.782585+0000","last_clean":"2024-04-26T12:05:04.782585+0000","last_became_active":"2024-04-26T12:05:03.425782+0000","last_became_peered":"2024-04-26T12:05:03.425782+0000","last_unstale":"2024-04-26T12:05:04.782585+0000","last_undegraded":"2024-04-26T12:05:04.782585+0000","last_fullsized":"2024-04-26T12:05:04.782585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:26.791180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782217+0000","last_change":"2024-04-26T12:05:03.795264+0000","last_active":"2024-04-26T12:05:04.782217+0000","last_peered":"2024-04-26T12:05:04.782217+0000","last_clean":"2024-04-26T12:05:04.782217+0000","last_became_active":"2024-04-26T12:05:03.794448+0000","last_became_peered":"2024-04-26T12:05:03.794448+0000","last_unstale":"2024-04-26T12:05:04.782217+0000","last_undegraded":"2024-04-26T12:05:04.782217+0000","last_fullsized":"2024-04-26T12:05:04.782217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204547+0000","last_change":"2024-04-26T12:05:03.429872+0000","last_active":"2024-04-26T12:05:05.204547+0000","last_peered":"2024-04-26T12:05:05.204547+0000","last_clean":"2024-04-26T12:05:05.204547+0000","last_became_active":"2024-04-26T12:05:03.429401+0000","last_became_peered":"2024-04-26T12:05:03.429401+0000","last_unstale":"2024-04-26T12:05:05.204547+0000","last_undegraded":"2024-04-26T12:05:05.204547+0000","last_fullsized":"2024-04-26T12:05:05.204547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781880+0000","last_change":"2024-04-26T12:05:03.791827+0000","last_active":"2024-04-26T12:05:04.781880+0000","last_peered":"2024-04-26T12:05:04.781880+0000","last_clean":"2024-04-26T12:05:04.781880+0000","last_became_active":"2024-04-26T12:05:03.791442+0000","last_became_peered":"2024-04-26T12:05:03.791442+0000","last_unstale":"2024-04-26T12:05:04.781880+0000","last_undegraded":"2024-04-26T12:05:04.781880+0000","last_fullsized":"2024-04-26T12:05:04.781880+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204474+0000","last_change":"2024-04-26T12:05:03.430659+0000","last_active":"2024-04-26T12:05:05.204474+0000","last_peered":"2024-04-26T12:05:05.204474+0000","last_clean":"2024-04-26T12:05:05.204474+0000","last_became_active":"2024-04-26T12:05:03.430164+0000","last_became_peered":"2024-04-26T12:05:03.430164+0000","last_unstale":"2024-04-26T12:05:05.204474+0000","last_undegraded":"2024-04-26T12:05:05.204474+0000","last_fullsized":"2024-04-26T12:05:05.204474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":245760,"data_stored":647806,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":647190,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":55692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:05:16.057 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:05:16.386 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:16.388 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:05:16.397 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-04-26T12:05:16.335092+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":85796,"kb_used_data":632,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283029724,"statfs":{"total":289910292480,"available":289822437376,"internally_reserved":0,"allocated":647168,"data_stored":1350688,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.555374"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782815+0000","last_change":"2024-04-26T12:05:03.796038+0000","last_active":"2024-04-26T12:05:04.782815+0000","last_peered":"2024-04-26T12:05:04.782815+0000","last_clean":"2024-04-26T12:05:04.782815+0000","last_became_active":"2024-04-26T12:05:03.795539+0000","last_became_peered":"2024-04-26T12:05:03.795539+0000","last_unstale":"2024-04-26T12:05:04.782815+0000","last_undegraded":"2024-04-26T12:05:04.782815+0000","last_fullsized":"2024-04-26T12:05:04.782815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782477+0000","last_change":"2024-04-26T12:05:03.795955+0000","last_active":"2024-04-26T12:05:04.782477+0000","last_peered":"2024-04-26T12:05:04.782477+0000","last_clean":"2024-04-26T12:05:04.782477+0000","last_became_active":"2024-04-26T12:05:03.795303+0000","last_became_peered":"2024-04-26T12:05:03.795303+0000","last_unstale":"2024-04-26T12:05:04.782477+0000","last_undegraded":"2024-04-26T12:05:04.782477+0000","last_fullsized":"2024-04-26T12:05:04.782477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781972+0000","last_change":"2024-04-26T12:05:03.797557+0000","last_active":"2024-04-26T12:05:04.781972+0000","last_peered":"2024-04-26T12:05:04.781972+0000","last_clean":"2024-04-26T12:05:04.781972+0000","last_became_active":"2024-04-26T12:05:03.797122+0000","last_became_peered":"2024-04-26T12:05:03.797122+0000","last_unstale":"2024-04-26T12:05:04.781972+0000","last_undegraded":"2024-04-26T12:05:04.781972+0000","last_fullsized":"2024-04-26T12:05:04.781972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782137+0000","last_change":"2024-04-26T12:05:03.791234+0000","last_active":"2024-04-26T12:05:04.782137+0000","last_peered":"2024-04-26T12:05:04.782137+0000","last_clean":"2024-04-26T12:05:04.782137+0000","last_became_active":"2024-04-26T12:05:03.790717+0000","last_became_peered":"2024-04-26T12:05:03.790717+0000","last_unstale":"2024-04-26T12:05:04.782137+0000","last_undegraded":"2024-04-26T12:05:04.782137+0000","last_fullsized":"2024-04-26T12:05:04.782137+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:52.358881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782240+0000","last_change":"2024-04-26T12:05:03.792885+0000","last_active":"2024-04-26T12:05:04.782240+0000","last_peered":"2024-04-26T12:05:04.782240+0000","last_clean":"2024-04-26T12:05:04.782240+0000","last_became_active":"2024-04-26T12:05:03.792354+0000","last_became_peered":"2024-04-26T12:05:03.792354+0000","last_unstale":"2024-04-26T12:05:04.782240+0000","last_undegraded":"2024-04-26T12:05:04.782240+0000","last_fullsized":"2024-04-26T12:05:04.782240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781573+0000","last_change":"2024-04-26T12:05:03.791560+0000","last_active":"2024-04-26T12:05:04.781573+0000","last_peered":"2024-04-26T12:05:04.781573+0000","last_clean":"2024-04-26T12:05:04.781573+0000","last_became_active":"2024-04-26T12:05:03.790578+0000","last_became_peered":"2024-04-26T12:05:03.790578+0000","last_unstale":"2024-04-26T12:05:04.781573+0000","last_undegraded":"2024-04-26T12:05:04.781573+0000","last_fullsized":"2024-04-26T12:05:04.781573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781892+0000","last_change":"2024-04-26T12:05:03.791215+0000","last_active":"2024-04-26T12:05:04.781892+0000","last_peered":"2024-04-26T12:05:04.781892+0000","last_clean":"2024-04-26T12:05:04.781892+0000","last_became_active":"2024-04-26T12:05:03.790615+0000","last_became_peered":"2024-04-26T12:05:03.790615+0000","last_unstale":"2024-04-26T12:05:04.781892+0000","last_undegraded":"2024-04-26T12:05:04.781892+0000","last_fullsized":"2024-04-26T12:05:04.781892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:55.388027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781429+0000","last_change":"2024-04-26T12:05:03.785861+0000","last_active":"2024-04-26T12:05:04.781429+0000","last_peered":"2024-04-26T12:05:04.781429+0000","last_clean":"2024-04-26T12:05:04.781429+0000","last_became_active":"2024-04-26T12:05:03.785382+0000","last_became_peered":"2024-04-26T12:05:03.785382+0000","last_unstale":"2024-04-26T12:05:04.781429+0000","last_undegraded":"2024-04-26T12:05:04.781429+0000","last_fullsized":"2024-04-26T12:05:04.781429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:51.870183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204307+0000","last_change":"2024-04-26T12:05:03.797218+0000","last_active":"2024-04-26T12:05:05.204307+0000","last_peered":"2024-04-26T12:05:05.204307+0000","last_clean":"2024-04-26T12:05:05.204307+0000","last_became_active":"2024-04-26T12:05:03.796902+0000","last_became_peered":"2024-04-26T12:05:03.796902+0000","last_unstale":"2024-04-26T12:05:05.204307+0000","last_undegraded":"2024-04-26T12:05:05.204307+0000","last_fullsized":"2024-04-26T12:05:05.204307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:27.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782312+0000","last_change":"2024-04-26T12:05:03.795919+0000","last_active":"2024-04-26T12:05:04.782312+0000","last_peered":"2024-04-26T12:05:04.782312+0000","last_clean":"2024-04-26T12:05:04.782312+0000","last_became_active":"2024-04-26T12:05:03.795268+0000","last_became_peered":"2024-04-26T12:05:03.795268+0000","last_unstale":"2024-04-26T12:05:04.782312+0000","last_undegraded":"2024-04-26T12:05:04.782312+0000","last_fullsized":"2024-04-26T12:05:04.782312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782161+0000","last_change":"2024-04-26T12:05:03.791046+0000","last_active":"2024-04-26T12:05:04.782161+0000","last_peered":"2024-04-26T12:05:04.782161+0000","last_clean":"2024-04-26T12:05:04.782161+0000","last_became_active":"2024-04-26T12:05:03.790662+0000","last_became_peered":"2024-04-26T12:05:03.790662+0000","last_unstale":"2024-04-26T12:05:04.782161+0000","last_undegraded":"2024-04-26T12:05:04.782161+0000","last_fullsized":"2024-04-26T12:05:04.782161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:35.458663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782010+0000","last_change":"2024-04-26T12:05:03.795250+0000","last_active":"2024-04-26T12:05:04.782010+0000","last_peered":"2024-04-26T12:05:04.782010+0000","last_clean":"2024-04-26T12:05:04.782010+0000","last_became_active":"2024-04-26T12:05:03.794632+0000","last_became_peered":"2024-04-26T12:05:03.794632+0000","last_unstale":"2024-04-26T12:05:04.782010+0000","last_undegraded":"2024-04-26T12:05:04.782010+0000","last_fullsized":"2024-04-26T12:05:04.782010+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:59.873501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782077+0000","last_change":"2024-04-26T12:05:03.794090+0000","last_active":"2024-04-26T12:05:04.782077+0000","last_peered":"2024-04-26T12:05:04.782077+0000","last_clean":"2024-04-26T12:05:04.782077+0000","last_became_active":"2024-04-26T12:05:03.793681+0000","last_became_peered":"2024-04-26T12:05:03.793681+0000","last_unstale":"2024-04-26T12:05:04.782077+0000","last_undegraded":"2024-04-26T12:05:04.782077+0000","last_fullsized":"2024-04-26T12:05:04.782077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781643+0000","last_change":"2024-04-26T12:05:03.795539+0000","last_active":"2024-04-26T12:05:04.781643+0000","last_peered":"2024-04-26T12:05:04.781643+0000","last_clean":"2024-04-26T12:05:04.781643+0000","last_became_active":"2024-04-26T12:05:03.795281+0000","last_became_peered":"2024-04-26T12:05:03.795281+0000","last_unstale":"2024-04-26T12:05:04.781643+0000","last_undegraded":"2024-04-26T12:05:04.781643+0000","last_fullsized":"2024-04-26T12:05:04.781643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:27.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781992+0000","last_change":"2024-04-26T12:05:03.793487+0000","last_active":"2024-04-26T12:05:04.781992+0000","last_peered":"2024-04-26T12:05:04.781992+0000","last_clean":"2024-04-26T12:05:04.781992+0000","last_became_active":"2024-04-26T12:05:03.793242+0000","last_became_peered":"2024-04-26T12:05:03.793242+0000","last_unstale":"2024-04-26T12:05:04.781992+0000","last_undegraded":"2024-04-26T12:05:04.781992+0000","last_fullsized":"2024-04-26T12:05:04.781992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:53.331006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781585+0000","last_change":"2024-04-26T12:05:03.786360+0000","last_active":"2024-04-26T12:05:04.781585+0000","last_peered":"2024-04-26T12:05:04.781585+0000","last_clean":"2024-04-26T12:05:04.781585+0000","last_became_active":"2024-04-26T12:05:03.785991+0000","last_became_peered":"2024-04-26T12:05:03.785991+0000","last_unstale":"2024-04-26T12:05:04.781585+0000","last_undegraded":"2024-04-26T12:05:04.781585+0000","last_fullsized":"2024-04-26T12:05:04.781585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:17.702068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204616+0000","last_change":"2024-04-26T12:05:03.797390+0000","last_active":"2024-04-26T12:05:05.204616+0000","last_peered":"2024-04-26T12:05:05.204616+0000","last_clean":"2024-04-26T12:05:05.204616+0000","last_became_active":"2024-04-26T12:05:03.796969+0000","last_became_peered":"2024-04-26T12:05:03.796969+0000","last_unstale":"2024-04-26T12:05:05.204616+0000","last_undegraded":"2024-04-26T12:05:05.204616+0000","last_fullsized":"2024-04-26T12:05:05.204616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:57.461628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782513+0000","last_change":"2024-04-26T12:05:03.794013+0000","last_active":"2024-04-26T12:05:04.782513+0000","last_peered":"2024-04-26T12:05:04.782513+0000","last_clean":"2024-04-26T12:05:04.782513+0000","last_became_active":"2024-04-26T12:05:03.793512+0000","last_became_peered":"2024-04-26T12:05:03.793512+0000","last_unstale":"2024-04-26T12:05:04.782513+0000","last_undegraded":"2024-04-26T12:05:04.782513+0000","last_fullsized":"2024-04-26T12:05:04.782513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204175+0000","last_change":"2024-04-26T12:05:03.798195+0000","last_active":"2024-04-26T12:05:05.204175+0000","last_peered":"2024-04-26T12:05:05.204175+0000","last_clean":"2024-04-26T12:05:05.204175+0000","last_became_active":"2024-04-26T12:05:03.797935+0000","last_became_peered":"2024-04-26T12:05:03.797935+0000","last_unstale":"2024-04-26T12:05:05.204175+0000","last_undegraded":"2024-04-26T12:05:05.204175+0000","last_fullsized":"2024-04-26T12:05:05.204175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:58.872589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782280+0000","last_change":"2024-04-26T12:05:03.792219+0000","last_active":"2024-04-26T12:05:04.782280+0000","last_peered":"2024-04-26T12:05:04.782280+0000","last_clean":"2024-04-26T12:05:04.782280+0000","last_became_active":"2024-04-26T12:05:03.791061+0000","last_became_peered":"2024-04-26T12:05:03.791061+0000","last_unstale":"2024-04-26T12:05:04.782280+0000","last_undegraded":"2024-04-26T12:05:04.782280+0000","last_fullsized":"2024-04-26T12:05:04.782280+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782402+0000","last_change":"2024-04-26T12:05:03.792073+0000","last_active":"2024-04-26T12:05:04.782402+0000","last_peered":"2024-04-26T12:05:04.782402+0000","last_clean":"2024-04-26T12:05:04.782402+0000","last_became_active":"2024-04-26T12:05:03.791693+0000","last_became_peered":"2024-04-26T12:05:03.791693+0000","last_unstale":"2024-04-26T12:05:04.782402+0000","last_undegraded":"2024-04-26T12:05:04.782402+0000","last_fullsized":"2024-04-26T12:05:04.782402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781784+0000","last_change":"2024-04-26T12:05:03.794027+0000","last_active":"2024-04-26T12:05:04.781784+0000","last_peered":"2024-04-26T12:05:04.781784+0000","last_clean":"2024-04-26T12:05:04.781784+0000","last_became_active":"2024-04-26T12:05:03.793660+0000","last_became_peered":"2024-04-26T12:05:03.793660+0000","last_unstale":"2024-04-26T12:05:04.781784+0000","last_undegraded":"2024-04-26T12:05:04.781784+0000","last_fullsized":"2024-04-26T12:05:04.781784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:53.331006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203565+0000","last_change":"2024-04-26T12:05:03.788658+0000","last_active":"2024-04-26T12:05:05.203565+0000","last_peered":"2024-04-26T12:05:05.203565+0000","last_clean":"2024-04-26T12:05:05.203565+0000","last_became_active":"2024-04-26T12:05:03.788050+0000","last_became_peered":"2024-04-26T12:05:03.788050+0000","last_unstale":"2024-04-26T12:05:05.203565+0000","last_undegraded":"2024-04-26T12:05:05.203565+0000","last_fullsized":"2024-04-26T12:05:05.203565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781648+0000","last_change":"2024-04-26T12:05:03.793554+0000","last_active":"2024-04-26T12:05:04.781648+0000","last_peered":"2024-04-26T12:05:04.781648+0000","last_clean":"2024-04-26T12:05:04.781648+0000","last_became_active":"2024-04-26T12:05:03.792588+0000","last_became_peered":"2024-04-26T12:05:03.792588+0000","last_unstale":"2024-04-26T12:05:04.781648+0000","last_undegraded":"2024-04-26T12:05:04.781648+0000","last_fullsized":"2024-04-26T12:05:04.781648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782854+0000","last_change":"2024-04-26T12:05:03.795510+0000","last_active":"2024-04-26T12:05:04.782854+0000","last_peered":"2024-04-26T12:05:04.782854+0000","last_clean":"2024-04-26T12:05:04.782854+0000","last_became_active":"2024-04-26T12:05:03.794639+0000","last_became_peered":"2024-04-26T12:05:03.794639+0000","last_unstale":"2024-04-26T12:05:04.782854+0000","last_undegraded":"2024-04-26T12:05:04.782854+0000","last_fullsized":"2024-04-26T12:05:04.782854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:57.461628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204465+0000","last_change":"2024-04-26T12:05:03.787909+0000","last_active":"2024-04-26T12:05:05.204465+0000","last_peered":"2024-04-26T12:05:05.204465+0000","last_clean":"2024-04-26T12:05:05.204465+0000","last_became_active":"2024-04-26T12:05:03.787562+0000","last_became_peered":"2024-04-26T12:05:03.787562+0000","last_unstale":"2024-04-26T12:05:05.204465+0000","last_undegraded":"2024-04-26T12:05:05.204465+0000","last_fullsized":"2024-04-26T12:05:05.204465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782352+0000","last_change":"2024-04-26T12:05:03.796836+0000","last_active":"2024-04-26T12:05:04.782352+0000","last_peered":"2024-04-26T12:05:04.782352+0000","last_clean":"2024-04-26T12:05:04.782352+0000","last_became_active":"2024-04-26T12:05:03.796524+0000","last_became_peered":"2024-04-26T12:05:03.796524+0000","last_unstale":"2024-04-26T12:05:04.782352+0000","last_undegraded":"2024-04-26T12:05:04.782352+0000","last_fullsized":"2024-04-26T12:05:04.782352+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782420+0000","last_change":"2024-04-26T12:05:03.792400+0000","last_active":"2024-04-26T12:05:04.782420+0000","last_peered":"2024-04-26T12:05:04.782420+0000","last_clean":"2024-04-26T12:05:04.782420+0000","last_became_active":"2024-04-26T12:05:03.792079+0000","last_became_peered":"2024-04-26T12:05:03.792079+0000","last_unstale":"2024-04-26T12:05:04.782420+0000","last_undegraded":"2024-04-26T12:05:04.782420+0000","last_fullsized":"2024-04-26T12:05:04.782420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:24.434355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204245+0000","last_change":"2024-04-26T12:05:03.797172+0000","last_active":"2024-04-26T12:05:05.204245+0000","last_peered":"2024-04-26T12:05:05.204245+0000","last_clean":"2024-04-26T12:05:05.204245+0000","last_became_active":"2024-04-26T12:05:03.796879+0000","last_became_peered":"2024-04-26T12:05:03.796879+0000","last_unstale":"2024-04-26T12:05:05.204245+0000","last_undegraded":"2024-04-26T12:05:05.204245+0000","last_fullsized":"2024-04-26T12:05:05.204245+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:24.434355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781949+0000","last_change":"2024-04-26T12:05:03.793269+0000","last_active":"2024-04-26T12:05:04.781949+0000","last_peered":"2024-04-26T12:05:04.781949+0000","last_clean":"2024-04-26T12:05:04.781949+0000","last_became_active":"2024-04-26T12:05:03.792698+0000","last_became_peered":"2024-04-26T12:05:03.792698+0000","last_unstale":"2024-04-26T12:05:04.781949+0000","last_undegraded":"2024-04-26T12:05:04.781949+0000","last_fullsized":"2024-04-26T12:05:04.781949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:58.579861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203630+0000","last_change":"2024-04-26T12:05:03.796871+0000","last_active":"2024-04-26T12:05:05.203630+0000","last_peered":"2024-04-26T12:05:05.203630+0000","last_clean":"2024-04-26T12:05:05.203630+0000","last_became_active":"2024-04-26T12:05:03.796546+0000","last_became_peered":"2024-04-26T12:05:03.796546+0000","last_unstale":"2024-04-26T12:05:05.203630+0000","last_undegraded":"2024-04-26T12:05:05.203630+0000","last_fullsized":"2024-04-26T12:05:05.203630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:53.331006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781676+0000","last_change":"2024-04-26T12:05:03.791605+0000","last_active":"2024-04-26T12:05:04.781676+0000","last_peered":"2024-04-26T12:05:04.781676+0000","last_clean":"2024-04-26T12:05:04.781676+0000","last_became_active":"2024-04-26T12:05:03.791251+0000","last_became_peered":"2024-04-26T12:05:03.791251+0000","last_unstale":"2024-04-26T12:05:04.781676+0000","last_undegraded":"2024-04-26T12:05:04.781676+0000","last_fullsized":"2024-04-26T12:05:04.781676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:27.239868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782339+0000","last_change":"2024-04-26T12:05:03.793791+0000","last_active":"2024-04-26T12:05:04.782339+0000","last_peered":"2024-04-26T12:05:04.782339+0000","last_clean":"2024-04-26T12:05:04.782339+0000","last_became_active":"2024-04-26T12:05:03.793468+0000","last_became_peered":"2024-04-26T12:05:03.793468+0000","last_unstale":"2024-04-26T12:05:04.782339+0000","last_undegraded":"2024-04-26T12:05:04.782339+0000","last_fullsized":"2024-04-26T12:05:04.782339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:01.289069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782440+0000","last_change":"2024-04-26T12:05:03.430021+0000","last_active":"2024-04-26T12:05:04.782440+0000","last_peered":"2024-04-26T12:05:04.782440+0000","last_clean":"2024-04-26T12:05:04.782440+0000","last_became_active":"2024-04-26T12:05:03.429695+0000","last_became_peered":"2024-04-26T12:05:03.429695+0000","last_unstale":"2024-04-26T12:05:04.782440+0000","last_undegraded":"2024-04-26T12:05:04.782440+0000","last_fullsized":"2024-04-26T12:05:04.782440+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782505+0000","last_change":"2024-04-26T12:05:03.796189+0000","last_active":"2024-04-26T12:05:04.782505+0000","last_peered":"2024-04-26T12:05:04.782505+0000","last_clean":"2024-04-26T12:05:04.782505+0000","last_became_active":"2024-04-26T12:05:03.795438+0000","last_became_peered":"2024-04-26T12:05:03.795438+0000","last_unstale":"2024-04-26T12:05:04.782505+0000","last_undegraded":"2024-04-26T12:05:04.782505+0000","last_fullsized":"2024-04-26T12:05:04.782505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:22.814807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203969+0000","last_change":"2024-04-26T12:05:03.428605+0000","last_active":"2024-04-26T12:05:05.203969+0000","last_peered":"2024-04-26T12:05:05.203969+0000","last_clean":"2024-04-26T12:05:05.203969+0000","last_became_active":"2024-04-26T12:05:03.428098+0000","last_became_peered":"2024-04-26T12:05:03.428098+0000","last_unstale":"2024-04-26T12:05:05.203969+0000","last_undegraded":"2024-04-26T12:05:05.203969+0000","last_fullsized":"2024-04-26T12:05:05.203969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204596+0000","last_change":"2024-04-26T12:05:03.788568+0000","last_active":"2024-04-26T12:05:05.204596+0000","last_peered":"2024-04-26T12:05:05.204596+0000","last_clean":"2024-04-26T12:05:05.204596+0000","last_became_active":"2024-04-26T12:05:03.788039+0000","last_became_peered":"2024-04-26T12:05:03.788039+0000","last_unstale":"2024-04-26T12:05:05.204596+0000","last_undegraded":"2024-04-26T12:05:05.204596+0000","last_fullsized":"2024-04-26T12:05:05.204596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781927+0000","last_change":"2024-04-26T12:05:03.422773+0000","last_active":"2024-04-26T12:05:04.781927+0000","last_peered":"2024-04-26T12:05:04.781927+0000","last_clean":"2024-04-26T12:05:04.781927+0000","last_became_active":"2024-04-26T12:05:03.422412+0000","last_became_peered":"2024-04-26T12:05:03.422412+0000","last_unstale":"2024-04-26T12:05:04.781927+0000","last_undegraded":"2024-04-26T12:05:04.781927+0000","last_fullsized":"2024-04-26T12:05:04.781927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:06.758253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204353+0000","last_change":"2024-04-26T12:05:03.788505+0000","last_active":"2024-04-26T12:05:05.204353+0000","last_peered":"2024-04-26T12:05:05.204353+0000","last_clean":"2024-04-26T12:05:05.204353+0000","last_became_active":"2024-04-26T12:05:03.788184+0000","last_became_peered":"2024-04-26T12:05:03.788184+0000","last_unstale":"2024-04-26T12:05:05.204353+0000","last_undegraded":"2024-04-26T12:05:05.204353+0000","last_fullsized":"2024-04-26T12:05:05.204353+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781717+0000","last_change":"2024-04-26T12:05:03.425495+0000","last_active":"2024-04-26T12:05:04.781717+0000","last_peered":"2024-04-26T12:05:04.781717+0000","last_clean":"2024-04-26T12:05:04.781717+0000","last_became_active":"2024-04-26T12:05:03.424963+0000","last_became_peered":"2024-04-26T12:05:03.424963+0000","last_unstale":"2024-04-26T12:05:04.781717+0000","last_undegraded":"2024-04-26T12:05:04.781717+0000","last_fullsized":"2024-04-26T12:05:04.781717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:55.660897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782532+0000","last_change":"2024-04-26T12:05:03.426142+0000","last_active":"2024-04-26T12:05:04.782532+0000","last_peered":"2024-04-26T12:05:04.782532+0000","last_clean":"2024-04-26T12:05:04.782532+0000","last_became_active":"2024-04-26T12:05:03.425699+0000","last_became_peered":"2024-04-26T12:05:03.425699+0000","last_unstale":"2024-04-26T12:05:04.782532+0000","last_undegraded":"2024-04-26T12:05:04.782532+0000","last_fullsized":"2024-04-26T12:05:04.782532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:41.279426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781647+0000","last_change":"2024-04-26T12:05:03.794778+0000","last_active":"2024-04-26T12:05:04.781647+0000","last_peered":"2024-04-26T12:05:04.781647+0000","last_clean":"2024-04-26T12:05:04.781647+0000","last_became_active":"2024-04-26T12:05:03.794192+0000","last_became_peered":"2024-04-26T12:05:03.794192+0000","last_unstale":"2024-04-26T12:05:04.781647+0000","last_undegraded":"2024-04-26T12:05:04.781647+0000","last_fullsized":"2024-04-26T12:05:04.781647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:16.372597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782585+0000","last_change":"2024-04-26T12:05:03.426530+0000","last_active":"2024-04-26T12:05:04.782585+0000","last_peered":"2024-04-26T12:05:04.782585+0000","last_clean":"2024-04-26T12:05:04.782585+0000","last_became_active":"2024-04-26T12:05:03.426113+0000","last_became_peered":"2024-04-26T12:05:03.426113+0000","last_unstale":"2024-04-26T12:05:04.782585+0000","last_undegraded":"2024-04-26T12:05:04.782585+0000","last_fullsized":"2024-04-26T12:05:04.782585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:21.029311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781810+0000","last_change":"2024-04-26T12:05:03.793000+0000","last_active":"2024-04-26T12:05:04.781810+0000","last_peered":"2024-04-26T12:05:04.781810+0000","last_clean":"2024-04-26T12:05:04.781810+0000","last_became_active":"2024-04-26T12:05:03.792480+0000","last_became_peered":"2024-04-26T12:05:03.792480+0000","last_unstale":"2024-04-26T12:05:04.781810+0000","last_undegraded":"2024-04-26T12:05:04.781810+0000","last_fullsized":"2024-04-26T12:05:04.781810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782682+0000","last_change":"2024-04-26T12:05:03.426039+0000","last_active":"2024-04-26T12:05:04.782682+0000","last_peered":"2024-04-26T12:05:04.782682+0000","last_clean":"2024-04-26T12:05:04.782682+0000","last_became_active":"2024-04-26T12:05:03.425666+0000","last_became_peered":"2024-04-26T12:05:03.425666+0000","last_unstale":"2024-04-26T12:05:04.782682+0000","last_undegraded":"2024-04-26T12:05:04.782682+0000","last_fullsized":"2024-04-26T12:05:04.782682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:00.998013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781698+0000","last_change":"2024-04-26T12:05:03.791809+0000","last_active":"2024-04-26T12:05:04.781698+0000","last_peered":"2024-04-26T12:05:04.781698+0000","last_clean":"2024-04-26T12:05:04.781698+0000","last_became_active":"2024-04-26T12:05:03.791272+0000","last_became_peered":"2024-04-26T12:05:03.791272+0000","last_unstale":"2024-04-26T12:05:04.781698+0000","last_undegraded":"2024-04-26T12:05:04.781698+0000","last_fullsized":"2024-04-26T12:05:04.781698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782611+0000","last_change":"2024-04-26T12:05:03.430224+0000","last_active":"2024-04-26T12:05:04.782611+0000","last_peered":"2024-04-26T12:05:04.782611+0000","last_clean":"2024-04-26T12:05:04.782611+0000","last_became_active":"2024-04-26T12:05:03.429291+0000","last_became_peered":"2024-04-26T12:05:03.429291+0000","last_unstale":"2024-04-26T12:05:04.782611+0000","last_undegraded":"2024-04-26T12:05:04.782611+0000","last_fullsized":"2024-04-26T12:05:04.782611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204057+0000","last_change":"2024-04-26T12:05:03.788174+0000","last_active":"2024-04-26T12:05:05.204057+0000","last_peered":"2024-04-26T12:05:05.204057+0000","last_clean":"2024-04-26T12:05:05.204057+0000","last_became_active":"2024-04-26T12:05:03.787772+0000","last_became_peered":"2024-04-26T12:05:03.787772+0000","last_unstale":"2024-04-26T12:05:05.204057+0000","last_undegraded":"2024-04-26T12:05:05.204057+0000","last_fullsized":"2024-04-26T12:05:05.204057+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204340+0000","last_change":"2024-04-26T12:05:03.431162+0000","last_active":"2024-04-26T12:05:05.204340+0000","last_peered":"2024-04-26T12:05:05.204340+0000","last_clean":"2024-04-26T12:05:05.204340+0000","last_became_active":"2024-04-26T12:05:03.430855+0000","last_became_peered":"2024-04-26T12:05:03.430855+0000","last_unstale":"2024-04-26T12:05:05.204340+0000","last_undegraded":"2024-04-26T12:05:05.204340+0000","last_fullsized":"2024-04-26T12:05:05.204340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:41.279426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782386+0000","last_change":"2024-04-26T12:05:03.792357+0000","last_active":"2024-04-26T12:05:04.782386+0000","last_peered":"2024-04-26T12:05:04.782386+0000","last_clean":"2024-04-26T12:05:04.782386+0000","last_became_active":"2024-04-26T12:05:03.792119+0000","last_became_peered":"2024-04-26T12:05:03.792119+0000","last_unstale":"2024-04-26T12:05:04.782386+0000","last_undegraded":"2024-04-26T12:05:04.782386+0000","last_fullsized":"2024-04-26T12:05:04.782386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781879+0000","last_change":"2024-04-26T12:05:03.429811+0000","last_active":"2024-04-26T12:05:04.781879+0000","last_peered":"2024-04-26T12:05:04.781879+0000","last_clean":"2024-04-26T12:05:04.781879+0000","last_became_active":"2024-04-26T12:05:03.429469+0000","last_became_peered":"2024-04-26T12:05:03.429469+0000","last_unstale":"2024-04-26T12:05:04.781879+0000","last_undegraded":"2024-04-26T12:05:04.781879+0000","last_fullsized":"2024-04-26T12:05:04.781879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782424+0000","last_change":"2024-04-26T12:05:03.795646+0000","last_active":"2024-04-26T12:05:04.782424+0000","last_peered":"2024-04-26T12:05:04.782424+0000","last_clean":"2024-04-26T12:05:04.782424+0000","last_became_active":"2024-04-26T12:05:03.795354+0000","last_became_peered":"2024-04-26T12:05:03.795354+0000","last_unstale":"2024-04-26T12:05:04.782424+0000","last_undegraded":"2024-04-26T12:05:04.782424+0000","last_fullsized":"2024-04-26T12:05:04.782424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:22.814807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782060+0000","last_change":"2024-04-26T12:05:03.427908+0000","last_active":"2024-04-26T12:05:04.782060+0000","last_peered":"2024-04-26T12:05:04.782060+0000","last_clean":"2024-04-26T12:05:04.782060+0000","last_became_active":"2024-04-26T12:05:03.426718+0000","last_became_peered":"2024-04-26T12:05:03.426718+0000","last_unstale":"2024-04-26T12:05:04.782060+0000","last_undegraded":"2024-04-26T12:05:04.782060+0000","last_fullsized":"2024-04-26T12:05:04.782060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:40.538058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782365+0000","last_change":"2024-04-26T12:05:03.797113+0000","last_active":"2024-04-26T12:05:04.782365+0000","last_peered":"2024-04-26T12:05:04.782365+0000","last_clean":"2024-04-26T12:05:04.782365+0000","last_became_active":"2024-04-26T12:05:03.796739+0000","last_became_peered":"2024-04-26T12:05:03.796739+0000","last_unstale":"2024-04-26T12:05:04.782365+0000","last_undegraded":"2024-04-26T12:05:04.782365+0000","last_fullsized":"2024-04-26T12:05:04.782365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:59.873501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781849+0000","last_change":"2024-04-26T12:05:03.428262+0000","last_active":"2024-04-26T12:05:04.781849+0000","last_peered":"2024-04-26T12:05:04.781849+0000","last_clean":"2024-04-26T12:05:04.781849+0000","last_became_active":"2024-04-26T12:05:03.426588+0000","last_became_peered":"2024-04-26T12:05:03.426588+0000","last_unstale":"2024-04-26T12:05:04.781849+0000","last_undegraded":"2024-04-26T12:05:04.781849+0000","last_fullsized":"2024-04-26T12:05:04.781849+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:42.674797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204403+0000","last_change":"2024-04-26T12:05:03.797633+0000","last_active":"2024-04-26T12:05:05.204403+0000","last_peered":"2024-04-26T12:05:05.204403+0000","last_clean":"2024-04-26T12:05:05.204403+0000","last_became_active":"2024-04-26T12:05:03.797338+0000","last_became_peered":"2024-04-26T12:05:03.797338+0000","last_unstale":"2024-04-26T12:05:05.204403+0000","last_undegraded":"2024-04-26T12:05:05.204403+0000","last_fullsized":"2024-04-26T12:05:05.204403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:22.814807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.782901+0000","last_change":"2024-04-26T12:04:53.388840+0000","last_active":"2024-04-26T12:05:03.782901+0000","last_peered":"2024-04-26T12:05:03.782901+0000","last_clean":"2024-04-26T12:05:03.782901+0000","last_became_active":"2024-04-26T12:04:53.388568+0000","last_became_peered":"2024-04-26T12:04:53.388568+0000","last_unstale":"2024-04-26T12:05:03.782901+0000","last_undegraded":"2024-04-26T12:05:03.782901+0000","last_fullsized":"2024-04-26T12:05:03.782901+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_clean_scrub_stamp":"2024-04-26T12:04:52.376986+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:04.970330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.781157+0000","last_change":"2024-04-26T12:04:59.403711+0000","last_active":"2024-04-26T12:05:03.781157+0000","last_peered":"2024-04-26T12:05:03.781157+0000","last_clean":"2024-04-26T12:05:03.781157+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:05:03.781157+0000","last_undegraded":"2024-04-26T12:05:03.781157+0000","last_fullsized":"2024-04-26T12:05:03.781157+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:45.779614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204217+0000","last_change":"2024-04-26T12:05:03.429674+0000","last_active":"2024-04-26T12:05:05.204217+0000","last_peered":"2024-04-26T12:05:05.204217+0000","last_clean":"2024-04-26T12:05:05.204217+0000","last_became_active":"2024-04-26T12:05:03.429266+0000","last_became_peered":"2024-04-26T12:05:03.429266+0000","last_unstale":"2024-04-26T12:05:05.204217+0000","last_undegraded":"2024-04-26T12:05:05.204217+0000","last_fullsized":"2024-04-26T12:05:05.204217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:55.660897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782655+0000","last_change":"2024-04-26T12:05:03.797640+0000","last_active":"2024-04-26T12:05:04.782655+0000","last_peered":"2024-04-26T12:05:04.782655+0000","last_clean":"2024-04-26T12:05:04.782655+0000","last_became_active":"2024-04-26T12:05:03.797302+0000","last_became_peered":"2024-04-26T12:05:03.797302+0000","last_unstale":"2024-04-26T12:05:04.782655+0000","last_undegraded":"2024-04-26T12:05:04.782655+0000","last_fullsized":"2024-04-26T12:05:04.782655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:16.372597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.781404+0000","last_change":"2024-04-26T12:04:59.405437+0000","last_active":"2024-04-26T12:05:03.781404+0000","last_peered":"2024-04-26T12:05:03.781404+0000","last_clean":"2024-04-26T12:05:03.781404+0000","last_became_active":"2024-04-26T12:04:59.405193+0000","last_became_peered":"2024-04-26T12:04:59.405193+0000","last_unstale":"2024-04-26T12:05:03.781404+0000","last_undegraded":"2024-04-26T12:05:03.781404+0000","last_fullsized":"2024-04-26T12:05:03.781404+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:20.977569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203835+0000","last_change":"2024-04-26T12:05:03.428547+0000","last_active":"2024-04-26T12:05:05.203835+0000","last_peered":"2024-04-26T12:05:05.203835+0000","last_clean":"2024-04-26T12:05:05.203835+0000","last_became_active":"2024-04-26T12:05:03.427985+0000","last_became_peered":"2024-04-26T12:05:03.427985+0000","last_unstale":"2024-04-26T12:05:05.203835+0000","last_undegraded":"2024-04-26T12:05:05.203835+0000","last_fullsized":"2024-04-26T12:05:05.203835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:19.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782574+0000","last_change":"2024-04-26T12:05:03.793800+0000","last_active":"2024-04-26T12:05:04.782574+0000","last_peered":"2024-04-26T12:05:04.782574+0000","last_clean":"2024-04-26T12:05:04.782574+0000","last_became_active":"2024-04-26T12:05:03.792932+0000","last_became_peered":"2024-04-26T12:05:03.792932+0000","last_unstale":"2024-04-26T12:05:04.782574+0000","last_undegraded":"2024-04-26T12:05:04.782574+0000","last_fullsized":"2024-04-26T12:05:04.782574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.780048+0000","last_change":"2024-04-26T12:04:59.405617+0000","last_active":"2024-04-26T12:05:03.780048+0000","last_peered":"2024-04-26T12:05:03.780048+0000","last_clean":"2024-04-26T12:05:03.780048+0000","last_became_active":"2024-04-26T12:04:59.405328+0000","last_became_peered":"2024-04-26T12:04:59.405328+0000","last_unstale":"2024-04-26T12:05:03.780048+0000","last_undegraded":"2024-04-26T12:05:03.780048+0000","last_fullsized":"2024-04-26T12:05:03.780048+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:39.317039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782519+0000","last_change":"2024-04-26T12:05:03.424576+0000","last_active":"2024-04-26T12:05:04.782519+0000","last_peered":"2024-04-26T12:05:04.782519+0000","last_clean":"2024-04-26T12:05:04.782519+0000","last_became_active":"2024-04-26T12:05:03.424289+0000","last_became_peered":"2024-04-26T12:05:03.424289+0000","last_unstale":"2024-04-26T12:05:04.782519+0000","last_undegraded":"2024-04-26T12:05:04.782519+0000","last_fullsized":"2024-04-26T12:05:04.782519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:10.759772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204460+0000","last_change":"2024-04-26T12:05:03.798238+0000","last_active":"2024-04-26T12:05:05.204460+0000","last_peered":"2024-04-26T12:05:05.204460+0000","last_clean":"2024-04-26T12:05:05.204460+0000","last_became_active":"2024-04-26T12:05:03.797924+0000","last_became_peered":"2024-04-26T12:05:03.797924+0000","last_unstale":"2024-04-26T12:05:05.204460+0000","last_undegraded":"2024-04-26T12:05:05.204460+0000","last_fullsized":"2024-04-26T12:05:05.204460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:01.289069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.781616+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:05:03.781616+0000","last_peered":"2024-04-26T12:05:03.781616+0000","last_clean":"2024-04-26T12:05:03.781616+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:05:03.781616+0000","last_undegraded":"2024-04-26T12:05:03.781616+0000","last_fullsized":"2024-04-26T12:05:03.781616+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:12.939539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782535+0000","last_change":"2024-04-26T12:05:03.430140+0000","last_active":"2024-04-26T12:05:04.782535+0000","last_peered":"2024-04-26T12:05:04.782535+0000","last_clean":"2024-04-26T12:05:04.782535+0000","last_became_active":"2024-04-26T12:05:03.429838+0000","last_became_peered":"2024-04-26T12:05:03.429838+0000","last_unstale":"2024-04-26T12:05:04.782535+0000","last_undegraded":"2024-04-26T12:05:04.782535+0000","last_fullsized":"2024-04-26T12:05:04.782535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204416+0000","last_change":"2024-04-26T12:05:03.796731+0000","last_active":"2024-04-26T12:05:05.204416+0000","last_peered":"2024-04-26T12:05:05.204416+0000","last_clean":"2024-04-26T12:05:05.204416+0000","last_became_active":"2024-04-26T12:05:03.796432+0000","last_became_peered":"2024-04-26T12:05:03.796432+0000","last_unstale":"2024-04-26T12:05:05.204416+0000","last_undegraded":"2024-04-26T12:05:05.204416+0000","last_fullsized":"2024-04-26T12:05:05.204416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:58.579861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782707+0000","last_change":"2024-04-26T12:05:03.429673+0000","last_active":"2024-04-26T12:05:04.782707+0000","last_peered":"2024-04-26T12:05:04.782707+0000","last_clean":"2024-04-26T12:05:04.782707+0000","last_became_active":"2024-04-26T12:05:03.429146+0000","last_became_peered":"2024-04-26T12:05:03.429146+0000","last_unstale":"2024-04-26T12:05:04.782707+0000","last_undegraded":"2024-04-26T12:05:04.782707+0000","last_fullsized":"2024-04-26T12:05:04.782707+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.779759+0000","last_change":"2024-04-26T12:04:59.405766+0000","last_active":"2024-04-26T12:05:03.779759+0000","last_peered":"2024-04-26T12:05:03.779759+0000","last_clean":"2024-04-26T12:05:03.779759+0000","last_became_active":"2024-04-26T12:04:59.405406+0000","last_became_peered":"2024-04-26T12:04:59.405406+0000","last_unstale":"2024-04-26T12:05:03.779759+0000","last_undegraded":"2024-04-26T12:05:03.779759+0000","last_fullsized":"2024-04-26T12:05:03.779759+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:13.860871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782006+0000","last_change":"2024-04-26T12:05:03.792534+0000","last_active":"2024-04-26T12:05:04.782006+0000","last_peered":"2024-04-26T12:05:04.782006+0000","last_clean":"2024-04-26T12:05:04.782006+0000","last_became_active":"2024-04-26T12:05:03.792160+0000","last_became_peered":"2024-04-26T12:05:03.792160+0000","last_unstale":"2024-04-26T12:05:04.782006+0000","last_undegraded":"2024-04-26T12:05:04.782006+0000","last_fullsized":"2024-04-26T12:05:04.782006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:41.930005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204484+0000","last_change":"2024-04-26T12:05:03.429642+0000","last_active":"2024-04-26T12:05:05.204484+0000","last_peered":"2024-04-26T12:05:05.204484+0000","last_clean":"2024-04-26T12:05:05.204484+0000","last_became_active":"2024-04-26T12:05:03.429197+0000","last_became_peered":"2024-04-26T12:05:03.429197+0000","last_unstale":"2024-04-26T12:05:05.204484+0000","last_undegraded":"2024-04-26T12:05:05.204484+0000","last_fullsized":"2024-04-26T12:05:05.204484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:40.538058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.788889+0000","last_change":"2024-04-26T12:04:59.405294+0000","last_active":"2024-04-26T12:05:03.788889+0000","last_peered":"2024-04-26T12:05:03.788889+0000","last_clean":"2024-04-26T12:05:03.788889+0000","last_became_active":"2024-04-26T12:04:59.405044+0000","last_became_peered":"2024-04-26T12:04:59.405044+0000","last_unstale":"2024-04-26T12:05:03.788889+0000","last_undegraded":"2024-04-26T12:05:03.788889+0000","last_fullsized":"2024-04-26T12:05:03.788889+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:47.042833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782238+0000","last_change":"2024-04-26T12:05:03.793408+0000","last_active":"2024-04-26T12:05:04.782238+0000","last_peered":"2024-04-26T12:05:04.782238+0000","last_clean":"2024-04-26T12:05:04.782238+0000","last_became_active":"2024-04-26T12:05:03.793019+0000","last_became_peered":"2024-04-26T12:05:03.793019+0000","last_unstale":"2024-04-26T12:05:04.782238+0000","last_undegraded":"2024-04-26T12:05:04.782238+0000","last_fullsized":"2024-04-26T12:05:04.782238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:25.062114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204650+0000","last_change":"2024-04-26T12:05:03.430008+0000","last_active":"2024-04-26T12:05:05.204650+0000","last_peered":"2024-04-26T12:05:05.204650+0000","last_clean":"2024-04-26T12:05:05.204650+0000","last_became_active":"2024-04-26T12:05:03.429362+0000","last_became_peered":"2024-04-26T12:05:03.429362+0000","last_unstale":"2024-04-26T12:05:05.204650+0000","last_undegraded":"2024-04-26T12:05:05.204650+0000","last_fullsized":"2024-04-26T12:05:05.204650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.780359+0000","last_change":"2024-04-26T12:04:59.405667+0000","last_active":"2024-04-26T12:05:03.780359+0000","last_peered":"2024-04-26T12:05:03.780359+0000","last_clean":"2024-04-26T12:05:03.780359+0000","last_became_active":"2024-04-26T12:04:59.405328+0000","last_became_peered":"2024-04-26T12:04:59.405328+0000","last_unstale":"2024-04-26T12:05:03.780359+0000","last_undegraded":"2024-04-26T12:05:03.780359+0000","last_fullsized":"2024-04-26T12:05:03.780359+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:20.977569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203759+0000","last_change":"2024-04-26T12:05:03.789623+0000","last_active":"2024-04-26T12:05:05.203759+0000","last_peered":"2024-04-26T12:05:05.203759+0000","last_clean":"2024-04-26T12:05:05.203759+0000","last_became_active":"2024-04-26T12:05:03.789390+0000","last_became_peered":"2024-04-26T12:05:03.789390+0000","last_unstale":"2024-04-26T12:05:05.203759+0000","last_undegraded":"2024-04-26T12:05:05.203759+0000","last_fullsized":"2024-04-26T12:05:05.203759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348623+0000","last_change":"2024-04-26T12:05:03.429222+0000","last_active":"2024-04-26T12:05:06.348623+0000","last_peered":"2024-04-26T12:05:06.348623+0000","last_clean":"2024-04-26T12:05:06.348623+0000","last_became_active":"2024-04-26T12:05:03.428803+0000","last_became_peered":"2024-04-26T12:05:03.428803+0000","last_unstale":"2024-04-26T12:05:06.348623+0000","last_undegraded":"2024-04-26T12:05:06.348623+0000","last_fullsized":"2024-04-26T12:05:06.348623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:31.305644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.779178+0000","last_change":"2024-04-26T12:04:59.408078+0000","last_active":"2024-04-26T12:05:03.779178+0000","last_peered":"2024-04-26T12:05:03.779178+0000","last_clean":"2024-04-26T12:05:03.779178+0000","last_became_active":"2024-04-26T12:04:59.407804+0000","last_became_peered":"2024-04-26T12:04:59.407804+0000","last_unstale":"2024-04-26T12:05:03.779178+0000","last_undegraded":"2024-04-26T12:05:03.779178+0000","last_fullsized":"2024-04-26T12:05:03.779178+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:56.449518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782185+0000","last_change":"2024-04-26T12:05:03.792547+0000","last_active":"2024-04-26T12:05:04.782185+0000","last_peered":"2024-04-26T12:05:04.782185+0000","last_clean":"2024-04-26T12:05:04.782185+0000","last_became_active":"2024-04-26T12:05:03.792078+0000","last_became_peered":"2024-04-26T12:05:03.792078+0000","last_unstale":"2024-04-26T12:05:04.782185+0000","last_undegraded":"2024-04-26T12:05:04.782185+0000","last_fullsized":"2024-04-26T12:05:04.782185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:45.563923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782159+0000","last_change":"2024-04-26T12:05:03.795500+0000","last_active":"2024-04-26T12:05:04.782159+0000","last_peered":"2024-04-26T12:05:04.782159+0000","last_clean":"2024-04-26T12:05:04.782159+0000","last_became_active":"2024-04-26T12:05:03.795173+0000","last_became_peered":"2024-04-26T12:05:03.795173+0000","last_unstale":"2024-04-26T12:05:04.782159+0000","last_undegraded":"2024-04-26T12:05:04.782159+0000","last_fullsized":"2024-04-26T12:05:04.782159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:01.289069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782556+0000","last_change":"2024-04-26T12:05:03.426261+0000","last_active":"2024-04-26T12:05:04.782556+0000","last_peered":"2024-04-26T12:05:04.782556+0000","last_clean":"2024-04-26T12:05:04.782556+0000","last_became_active":"2024-04-26T12:05:03.425897+0000","last_became_peered":"2024-04-26T12:05:03.425897+0000","last_unstale":"2024-04-26T12:05:04.782556+0000","last_undegraded":"2024-04-26T12:05:04.782556+0000","last_fullsized":"2024-04-26T12:05:04.782556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:31.305644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203851+0000","last_change":"2024-04-26T12:05:03.795443+0000","last_active":"2024-04-26T12:05:05.203851+0000","last_peered":"2024-04-26T12:05:05.203851+0000","last_clean":"2024-04-26T12:05:05.203851+0000","last_became_active":"2024-04-26T12:05:03.795190+0000","last_became_peered":"2024-04-26T12:05:03.795190+0000","last_unstale":"2024-04-26T12:05:05.203851+0000","last_undegraded":"2024-04-26T12:05:05.203851+0000","last_fullsized":"2024-04-26T12:05:05.203851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:59.873501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782685+0000","last_change":"2024-04-26T12:05:03.425106+0000","last_active":"2024-04-26T12:05:04.782685+0000","last_peered":"2024-04-26T12:05:04.782685+0000","last_clean":"2024-04-26T12:05:04.782685+0000","last_became_active":"2024-04-26T12:05:03.424753+0000","last_became_peered":"2024-04-26T12:05:03.424753+0000","last_unstale":"2024-04-26T12:05:04.782685+0000","last_undegraded":"2024-04-26T12:05:04.782685+0000","last_fullsized":"2024-04-26T12:05:04.782685+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:10.741652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782591+0000","last_change":"2024-04-26T12:05:03.429257+0000","last_active":"2024-04-26T12:05:04.782591+0000","last_peered":"2024-04-26T12:05:04.782591+0000","last_clean":"2024-04-26T12:05:04.782591+0000","last_became_active":"2024-04-26T12:05:03.428921+0000","last_became_peered":"2024-04-26T12:05:03.428921+0000","last_unstale":"2024-04-26T12:05:04.782591+0000","last_undegraded":"2024-04-26T12:05:04.782591+0000","last_fullsized":"2024-04-26T12:05:04.782591+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:49.774845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203669+0000","last_change":"2024-04-26T12:05:03.788141+0000","last_active":"2024-04-26T12:05:05.203669+0000","last_peered":"2024-04-26T12:05:05.203669+0000","last_clean":"2024-04-26T12:05:05.203669+0000","last_became_active":"2024-04-26T12:05:03.787533+0000","last_became_peered":"2024-04-26T12:05:03.787533+0000","last_unstale":"2024-04-26T12:05:05.203669+0000","last_undegraded":"2024-04-26T12:05:05.203669+0000","last_fullsized":"2024-04-26T12:05:05.203669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204552+0000","last_change":"2024-04-26T12:05:03.428971+0000","last_active":"2024-04-26T12:05:05.204552+0000","last_peered":"2024-04-26T12:05:05.204552+0000","last_clean":"2024-04-26T12:05:05.204552+0000","last_became_active":"2024-04-26T12:05:03.428445+0000","last_became_peered":"2024-04-26T12:05:03.428445+0000","last_unstale":"2024-04-26T12:05:05.204552+0000","last_undegraded":"2024-04-26T12:05:05.204552+0000","last_fullsized":"2024-04-26T12:05:05.204552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203649+0000","last_change":"2024-04-26T12:05:03.795318+0000","last_active":"2024-04-26T12:05:05.203649+0000","last_peered":"2024-04-26T12:05:05.203649+0000","last_clean":"2024-04-26T12:05:05.203649+0000","last_became_active":"2024-04-26T12:05:03.795053+0000","last_became_peered":"2024-04-26T12:05:03.795053+0000","last_unstale":"2024-04-26T12:05:05.203649+0000","last_undegraded":"2024-04-26T12:05:05.203649+0000","last_fullsized":"2024-04-26T12:05:05.203649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:16.372597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782875+0000","last_change":"2024-04-26T12:05:03.795109+0000","last_active":"2024-04-26T12:05:04.782875+0000","last_peered":"2024-04-26T12:05:04.782875+0000","last_clean":"2024-04-26T12:05:04.782875+0000","last_became_active":"2024-04-26T12:05:03.794392+0000","last_became_peered":"2024-04-26T12:05:03.794392+0000","last_unstale":"2024-04-26T12:05:04.782875+0000","last_undegraded":"2024-04-26T12:05:04.782875+0000","last_fullsized":"2024-04-26T12:05:04.782875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:05.327938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203799+0000","last_change":"2024-04-26T12:05:03.429889+0000","last_active":"2024-04-26T12:05:05.203799+0000","last_peered":"2024-04-26T12:05:05.203799+0000","last_clean":"2024-04-26T12:05:05.203799+0000","last_became_active":"2024-04-26T12:05:03.429370+0000","last_became_peered":"2024-04-26T12:05:03.429370+0000","last_unstale":"2024-04-26T12:05:05.203799+0000","last_undegraded":"2024-04-26T12:05:05.203799+0000","last_fullsized":"2024-04-26T12:05:05.203799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:26.791180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204344+0000","last_change":"2024-04-26T12:05:03.788754+0000","last_active":"2024-04-26T12:05:05.204344+0000","last_peered":"2024-04-26T12:05:05.204344+0000","last_clean":"2024-04-26T12:05:05.204344+0000","last_became_active":"2024-04-26T12:05:03.788311+0000","last_became_peered":"2024-04-26T12:05:03.788311+0000","last_unstale":"2024-04-26T12:05:05.204344+0000","last_undegraded":"2024-04-26T12:05:05.204344+0000","last_fullsized":"2024-04-26T12:05:05.204344+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203763+0000","last_change":"2024-04-26T12:05:03.428810+0000","last_active":"2024-04-26T12:05:05.203763+0000","last_peered":"2024-04-26T12:05:05.203763+0000","last_clean":"2024-04-26T12:05:05.203763+0000","last_became_active":"2024-04-26T12:05:03.428191+0000","last_became_peered":"2024-04-26T12:05:03.428191+0000","last_unstale":"2024-04-26T12:05:05.203763+0000","last_undegraded":"2024-04-26T12:05:05.203763+0000","last_fullsized":"2024-04-26T12:05:05.203763+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782302+0000","last_change":"2024-04-26T12:05:03.796880+0000","last_active":"2024-04-26T12:05:04.782302+0000","last_peered":"2024-04-26T12:05:04.782302+0000","last_clean":"2024-04-26T12:05:04.782302+0000","last_became_active":"2024-04-26T12:05:03.796419+0000","last_became_peered":"2024-04-26T12:05:03.796419+0000","last_unstale":"2024-04-26T12:05:04.782302+0000","last_undegraded":"2024-04-26T12:05:04.782302+0000","last_fullsized":"2024-04-26T12:05:04.782302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:58.872589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782079+0000","last_change":"2024-04-26T12:05:03.428084+0000","last_active":"2024-04-26T12:05:04.782079+0000","last_peered":"2024-04-26T12:05:04.782079+0000","last_clean":"2024-04-26T12:05:04.782079+0000","last_became_active":"2024-04-26T12:05:03.426982+0000","last_became_peered":"2024-04-26T12:05:03.426982+0000","last_unstale":"2024-04-26T12:05:04.782079+0000","last_undegraded":"2024-04-26T12:05:04.782079+0000","last_fullsized":"2024-04-26T12:05:04.782079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:19.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782315+0000","last_change":"2024-04-26T12:05:03.793470+0000","last_active":"2024-04-26T12:05:04.782315+0000","last_peered":"2024-04-26T12:05:04.782315+0000","last_clean":"2024-04-26T12:05:04.782315+0000","last_became_active":"2024-04-26T12:05:03.792869+0000","last_became_peered":"2024-04-26T12:05:03.792869+0000","last_unstale":"2024-04-26T12:05:04.782315+0000","last_undegraded":"2024-04-26T12:05:04.782315+0000","last_fullsized":"2024-04-26T12:05:04.782315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:27.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782341+0000","last_change":"2024-04-26T12:05:03.426947+0000","last_active":"2024-04-26T12:05:04.782341+0000","last_peered":"2024-04-26T12:05:04.782341+0000","last_clean":"2024-04-26T12:05:04.782341+0000","last_became_active":"2024-04-26T12:05:03.426211+0000","last_became_peered":"2024-04-26T12:05:03.426211+0000","last_unstale":"2024-04-26T12:05:04.782341+0000","last_undegraded":"2024-04-26T12:05:04.782341+0000","last_fullsized":"2024-04-26T12:05:04.782341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:11.959244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782101+0000","last_change":"2024-04-26T12:05:03.791986+0000","last_active":"2024-04-26T12:05:04.782101+0000","last_peered":"2024-04-26T12:05:04.782101+0000","last_clean":"2024-04-26T12:05:04.782101+0000","last_became_active":"2024-04-26T12:05:03.790823+0000","last_became_peered":"2024-04-26T12:05:03.790823+0000","last_unstale":"2024-04-26T12:05:04.782101+0000","last_undegraded":"2024-04-26T12:05:04.782101+0000","last_fullsized":"2024-04-26T12:05:04.782101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782508+0000","last_change":"2024-04-26T12:05:03.429469+0000","last_active":"2024-04-26T12:05:04.782508+0000","last_peered":"2024-04-26T12:05:04.782508+0000","last_clean":"2024-04-26T12:05:04.782508+0000","last_became_active":"2024-04-26T12:05:03.429015+0000","last_became_peered":"2024-04-26T12:05:03.429015+0000","last_unstale":"2024-04-26T12:05:04.782508+0000","last_undegraded":"2024-04-26T12:05:04.782508+0000","last_fullsized":"2024-04-26T12:05:04.782508+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781940+0000","last_change":"2024-04-26T12:05:03.791929+0000","last_active":"2024-04-26T12:05:04.781940+0000","last_peered":"2024-04-26T12:05:04.781940+0000","last_clean":"2024-04-26T12:05:04.781940+0000","last_became_active":"2024-04-26T12:05:03.791540+0000","last_became_peered":"2024-04-26T12:05:03.791540+0000","last_unstale":"2024-04-26T12:05:04.781940+0000","last_undegraded":"2024-04-26T12:05:04.781940+0000","last_fullsized":"2024-04-26T12:05:04.781940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782585+0000","last_change":"2024-04-26T12:05:03.426210+0000","last_active":"2024-04-26T12:05:04.782585+0000","last_peered":"2024-04-26T12:05:04.782585+0000","last_clean":"2024-04-26T12:05:04.782585+0000","last_became_active":"2024-04-26T12:05:03.425782+0000","last_became_peered":"2024-04-26T12:05:03.425782+0000","last_unstale":"2024-04-26T12:05:04.782585+0000","last_undegraded":"2024-04-26T12:05:04.782585+0000","last_fullsized":"2024-04-26T12:05:04.782585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:26.791180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782217+0000","last_change":"2024-04-26T12:05:03.795264+0000","last_active":"2024-04-26T12:05:04.782217+0000","last_peered":"2024-04-26T12:05:04.782217+0000","last_clean":"2024-04-26T12:05:04.782217+0000","last_became_active":"2024-04-26T12:05:03.794448+0000","last_became_peered":"2024-04-26T12:05:03.794448+0000","last_unstale":"2024-04-26T12:05:04.782217+0000","last_undegraded":"2024-04-26T12:05:04.782217+0000","last_fullsized":"2024-04-26T12:05:04.782217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204547+0000","last_change":"2024-04-26T12:05:03.429872+0000","last_active":"2024-04-26T12:05:05.204547+0000","last_peered":"2024-04-26T12:05:05.204547+0000","last_clean":"2024-04-26T12:05:05.204547+0000","last_became_active":"2024-04-26T12:05:03.429401+0000","last_became_peered":"2024-04-26T12:05:03.429401+0000","last_unstale":"2024-04-26T12:05:05.204547+0000","last_undegraded":"2024-04-26T12:05:05.204547+0000","last_fullsized":"2024-04-26T12:05:05.204547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781880+0000","last_change":"2024-04-26T12:05:03.791827+0000","last_active":"2024-04-26T12:05:04.781880+0000","last_peered":"2024-04-26T12:05:04.781880+0000","last_clean":"2024-04-26T12:05:04.781880+0000","last_became_active":"2024-04-26T12:05:03.791442+0000","last_became_peered":"2024-04-26T12:05:03.791442+0000","last_unstale":"2024-04-26T12:05:04.781880+0000","last_undegraded":"2024-04-26T12:05:04.781880+0000","last_fullsized":"2024-04-26T12:05:04.781880+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204474+0000","last_change":"2024-04-26T12:05:03.430659+0000","last_active":"2024-04-26T12:05:05.204474+0000","last_peered":"2024-04-26T12:05:05.204474+0000","last_clean":"2024-04-26T12:05:05.204474+0000","last_became_active":"2024-04-26T12:05:03.430164+0000","last_became_peered":"2024-04-26T12:05:03.430164+0000","last_unstale":"2024-04-26T12:05:05.204474+0000","last_undegraded":"2024-04-26T12:05:05.204474+0000","last_fullsized":"2024-04-26T12:05:05.204474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":245760,"data_stored":647806,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":647190,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":55692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:05:16.402 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T12:05:16.402 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T12:05:16.402 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T12:05:16.402 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T12:05:16.764 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:16.764 INFO:teuthology.orchestra.run.smithi052.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T12:05:16.777 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T12:05:16.777 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:05:17.075 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:17.075 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":18,"fsid":"5bc300ae-e948-4ce3-81bb-5abae8c06799","created":"2024-04-26T12:04:41.919527+0000","modified":"2024-04-26T12:05:04.776193+0000","last_up_change":"2024-04-26T12:04:51.084680+0000","last_in_change":"2024-04-26T12:04:43.540390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:04:52.376506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:04:57.775333+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:05:02.226064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:05:02.758806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"638cfa85-e921-4403-9bcb-a7f4653cc3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":28597},{"type":"v1","addr":"172.21.15.143:6801","nonce":28597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":28597},{"type":"v1","addr":"172.21.15.143:6803","nonce":28597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":28597},{"type":"v1","addr":"172.21.15.143:6807","nonce":28597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":28597},{"type":"v1","addr":"172.21.15.143:6805","nonce":28597}]},"public_addr":"172.21.15.143:6801/28597","cluster_addr":"172.21.15.143:6803/28597","heartbeat_back_addr":"172.21.15.143:6807/28597","heartbeat_front_addr":"172.21.15.143:6805/28597","state":["exists","up"]},{"osd":1,"uuid":"2abc8d1e-ad72-4643-ad1e-3566e5113c44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":28560},{"type":"v1","addr":"172.21.15.154:6801","nonce":28560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":28560},{"type":"v1","addr":"172.21.15.154:6803","nonce":28560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":28560},{"type":"v1","addr":"172.21.15.154:6807","nonce":28560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":28560},{"type":"v1","addr":"172.21.15.154:6805","nonce":28560}]},"public_addr":"172.21.15.154:6801/28560","cluster_addr":"172.21.15.154:6803/28560","heartbeat_back_addr":"172.21.15.154:6807/28560","heartbeat_front_addr":"172.21.15.154:6805/28560","state":["exists","up"]},{"osd":2,"uuid":"d2ebc562-cb9b-4089-a19b-1788b70b57dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":28709},{"type":"v1","addr":"172.21.15.164:6801","nonce":28709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":28709},{"type":"v1","addr":"172.21.15.164:6803","nonce":28709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":28709},{"type":"v1","addr":"172.21.15.164:6807","nonce":28709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":28709},{"type":"v1","addr":"172.21.15.164:6805","nonce":28709}]},"public_addr":"172.21.15.164:6801/28709","cluster_addr":"172.21.15.164:6803/28709","heartbeat_back_addr":"172.21.15.164:6807/28709","heartbeat_front_addr":"172.21.15.164:6805/28709","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.573478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.624482+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.615449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:05:17.084 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:04:52.376506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:04:57.775333+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:05:02.226064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:05:02.758806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T12:05:17.084 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:05:17.380 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-04-26T12:05:17.393 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:05:17.689 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2024-04-26T12:05:17.700 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T12:05:17.998 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-04-26T12:05:18.011 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T12:05:18.306 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2024-04-26T12:05:18.317 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:05:18.644 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:18.644 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:05:03.774692+0000","modified":"2024-04-26T12:05:05.779112+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14144},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14144":{"gid":14144,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6803/2910214683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2910214683},{"type":"v1","addr":"172.21.15.52:6803","nonce":2910214683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:05:18.645 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 5 2024-04-26T12:05:18.657 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:05:18.951 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:18.951 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":18,"fsid":"5bc300ae-e948-4ce3-81bb-5abae8c06799","created":"2024-04-26T12:04:41.919527+0000","modified":"2024-04-26T12:05:04.776193+0000","last_up_change":"2024-04-26T12:04:51.084680+0000","last_in_change":"2024-04-26T12:04:43.540390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:04:52.376506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:04:57.775333+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:05:02.226064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:05:02.758806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"638cfa85-e921-4403-9bcb-a7f4653cc3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":28597},{"type":"v1","addr":"172.21.15.143:6801","nonce":28597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":28597},{"type":"v1","addr":"172.21.15.143:6803","nonce":28597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":28597},{"type":"v1","addr":"172.21.15.143:6807","nonce":28597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":28597},{"type":"v1","addr":"172.21.15.143:6805","nonce":28597}]},"public_addr":"172.21.15.143:6801/28597","cluster_addr":"172.21.15.143:6803/28597","heartbeat_back_addr":"172.21.15.143:6807/28597","heartbeat_front_addr":"172.21.15.143:6805/28597","state":["exists","up"]},{"osd":1,"uuid":"2abc8d1e-ad72-4643-ad1e-3566e5113c44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":28560},{"type":"v1","addr":"172.21.15.154:6801","nonce":28560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":28560},{"type":"v1","addr":"172.21.15.154:6803","nonce":28560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":28560},{"type":"v1","addr":"172.21.15.154:6807","nonce":28560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":28560},{"type":"v1","addr":"172.21.15.154:6805","nonce":28560}]},"public_addr":"172.21.15.154:6801/28560","cluster_addr":"172.21.15.154:6803/28560","heartbeat_back_addr":"172.21.15.154:6807/28560","heartbeat_front_addr":"172.21.15.154:6805/28560","state":["exists","up"]},{"osd":2,"uuid":"d2ebc562-cb9b-4089-a19b-1788b70b57dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":28709},{"type":"v1","addr":"172.21.15.164:6801","nonce":28709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":28709},{"type":"v1","addr":"172.21.15.164:6803","nonce":28709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":28709},{"type":"v1","addr":"172.21.15.164:6807","nonce":28709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":28709},{"type":"v1","addr":"172.21.15.164:6805","nonce":28709}]},"public_addr":"172.21.15.164:6801/28709","cluster_addr":"172.21.15.164:6803/28709","heartbeat_back_addr":"172.21.15.164:6807/28709","heartbeat_front_addr":"172.21.15.164:6805/28709","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.573478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.624482+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.615449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:05:18.963 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:04:52.376506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:04:57.775333+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:05:02.226064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:05:02.758806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T12:05:18.964 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:05:19.254 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-04-26T12:05:19.266 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:05:19.560 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2024-04-26T12:05:19.573 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T12:05:19.868 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-04-26T12:05:19.881 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T12:05:20.173 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2024-04-26T12:05:20.186 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:05:20.516 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:20.516 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:05:03.774692+0000","modified":"2024-04-26T12:05:05.779112+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14144},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14144":{"gid":14144,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6803/2910214683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2910214683},{"type":"v1","addr":"172.21.15.52:6803","nonce":2910214683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:05:20.517 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 5 2024-04-26T12:05:20.529 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:05:20.825 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:20.825 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":18,"fsid":"5bc300ae-e948-4ce3-81bb-5abae8c06799","created":"2024-04-26T12:04:41.919527+0000","modified":"2024-04-26T12:05:04.776193+0000","last_up_change":"2024-04-26T12:04:51.084680+0000","last_in_change":"2024-04-26T12:04:43.540390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:04:52.376506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:04:57.775333+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:05:02.226064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:05:02.758806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"638cfa85-e921-4403-9bcb-a7f4653cc3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":28597},{"type":"v1","addr":"172.21.15.143:6801","nonce":28597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":28597},{"type":"v1","addr":"172.21.15.143:6803","nonce":28597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":28597},{"type":"v1","addr":"172.21.15.143:6807","nonce":28597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":28597},{"type":"v1","addr":"172.21.15.143:6805","nonce":28597}]},"public_addr":"172.21.15.143:6801/28597","cluster_addr":"172.21.15.143:6803/28597","heartbeat_back_addr":"172.21.15.143:6807/28597","heartbeat_front_addr":"172.21.15.143:6805/28597","state":["exists","up"]},{"osd":1,"uuid":"2abc8d1e-ad72-4643-ad1e-3566e5113c44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":28560},{"type":"v1","addr":"172.21.15.154:6801","nonce":28560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":28560},{"type":"v1","addr":"172.21.15.154:6803","nonce":28560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":28560},{"type":"v1","addr":"172.21.15.154:6807","nonce":28560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":28560},{"type":"v1","addr":"172.21.15.154:6805","nonce":28560}]},"public_addr":"172.21.15.154:6801/28560","cluster_addr":"172.21.15.154:6803/28560","heartbeat_back_addr":"172.21.15.154:6807/28560","heartbeat_front_addr":"172.21.15.154:6805/28560","state":["exists","up"]},{"osd":2,"uuid":"d2ebc562-cb9b-4089-a19b-1788b70b57dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":28709},{"type":"v1","addr":"172.21.15.164:6801","nonce":28709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":28709},{"type":"v1","addr":"172.21.15.164:6803","nonce":28709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":28709},{"type":"v1","addr":"172.21.15.164:6807","nonce":28709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":28709},{"type":"v1","addr":"172.21.15.164:6805","nonce":28709}]},"public_addr":"172.21.15.164:6801/28709","cluster_addr":"172.21.15.164:6803/28709","heartbeat_back_addr":"172.21.15.164:6807/28709","heartbeat_front_addr":"172.21.15.164:6805/28709","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.573478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.624482+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.615449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:05:20.838 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:05:21.166 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:21.166 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:05:03.774692+0000","modified":"2024-04-26T12:05:05.779112+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14144},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14144":{"gid":14144,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6803/2910214683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2910214683},{"type":"v1","addr":"172.21.15.52:6803","nonce":2910214683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:05:21.167 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 5 2024-04-26T12:05:21.279 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T12:05:03.774692+0000', 'modified': '2024-04-26T12:05:05.779112+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 14144}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14144': {'gid': 14144, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.52:6803/2910214683', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6802', 'nonce': 2910214683}, {'type': 'v1', 'addr': '172.21.15.52:6803', 'nonce': 2910214683}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-26T12:05:21.279 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T12:05:21.279 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T12:05:21.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-26T12:05:21.391+0000 7fa6abfff640 0 client.14444 ms_handle_reset on v2:172.21.15.52:6802/2910214683 2024-04-26T12:05:21.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-26T12:05:21.411+0000 7fa6abfff640 0 client.4501 ms_handle_reset on v2:172.21.15.52:6802/2910214683 2024-04-26T12:05:21.412 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-26T12:05:21.412 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "5bc300ae-e948-4ce3-81bb-5abae8c06799", 2024-04-26T12:05:21.412 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-04-26T12:05:21.412 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 14144, 2024-04-26T12:05:21.412 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-04-26T12:05:21.413 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-04-26T12:05:21.413 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-04-26T12:05:21.413 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 17.635219571, 2024-04-26T12:05:21.413 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 5, 2024-04-26T12:05:21.413 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 18, 2024-04-26T12:05:21.413 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 18, 2024-04-26T12:05:21.413 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 21.908532989000001 2024-04-26T12:05:21.413 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-26T12:05:21.423 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-26T12:05:21.437 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-26T12:05:21.437 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6'}} 2024-04-26T12:05:21.437 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-26T12:05:21.437 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-04-26T12:05:21.438 DEBUG:teuthology.orchestra.run.smithi052:> sync 2024-04-26T12:05:21.677 DEBUG:teuthology.orchestra.run.smithi143:> sync 2024-04-26T12:05:21.814 DEBUG:teuthology.orchestra.run.smithi154:> sync 2024-04-26T12:05:21.886 DEBUG:teuthology.orchestra.run.smithi164:> sync 2024-04-26T12:05:21.953 DEBUG:tasks.thrashosds:checking console status of smithi052 2024-04-26T12:05:21.953 DEBUG:teuthology.orchestra.console.smithi052:Waiting for login prompt 2024-04-26T12:05:21.953 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi052 2024-04-26T12:05:22.040 DEBUG:teuthology.orchestra.console.smithi052:expect before: [Enter `^Ec?' for help] 2024-04-26T12:05:22.040 DEBUG:teuthology.orchestra.console.smithi052:expect after: smithi052 login: 2024-04-26T12:05:22.094 DEBUG:teuthology.orchestra.console.smithi052:console disconnect output: [Enter `^Ec?' for help] smithi052 login: [disconnect] 2024-04-26T12:05:22.195 DEBUG:tasks.thrashosds:checking console status of smithi143 2024-04-26T12:05:22.195 DEBUG:teuthology.orchestra.console.smithi143:Waiting for login prompt 2024-04-26T12:05:22.195 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi143 2024-04-26T12:05:22.285 DEBUG:teuthology.orchestra.console.smithi143:expect before: [Enter `^Ec?' for help] 2024-04-26T12:05:22.285 DEBUG:teuthology.orchestra.console.smithi143:expect after: smithi143 login: 2024-04-26T12:05:22.337 DEBUG:teuthology.orchestra.console.smithi143:console disconnect output: [Enter `^Ec?' for help] smithi143 login: [disconnect] 2024-04-26T12:05:22.438 DEBUG:tasks.thrashosds:checking console status of smithi154 2024-04-26T12:05:22.438 DEBUG:teuthology.orchestra.console.smithi154:Waiting for login prompt 2024-04-26T12:05:22.439 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi154 2024-04-26T12:05:22.530 DEBUG:teuthology.orchestra.console.smithi154:expect before: [Enter `^Ec?' for help] 2024-04-26T12:05:22.530 DEBUG:teuthology.orchestra.console.smithi154:expect after: smithi154 login: 2024-04-26T12:05:22.582 DEBUG:teuthology.orchestra.console.smithi154:console disconnect output: [Enter `^Ec?' for help] smithi154 login: [disconnect] 2024-04-26T12:05:22.683 DEBUG:tasks.thrashosds:checking console status of smithi164 2024-04-26T12:05:22.684 DEBUG:teuthology.orchestra.console.smithi164:Waiting for login prompt 2024-04-26T12:05:22.684 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi164 2024-04-26T12:05:22.828 DEBUG:teuthology.orchestra.console.smithi164:expect before: [Enter `^Ec?' for help] 2024-04-26T12:05:22.828 DEBUG:teuthology.orchestra.console.smithi164:expect after: smithi164 login: 2024-04-26T12:05:22.882 DEBUG:teuthology.orchestra.console.smithi164:console disconnect output: [Enter `^Ec?' for help] smithi164 login: [disconnect] 2024-04-26T12:05:22.984 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-26T12:05:23.314 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-26T12:05:23.315 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T12:05:23.315 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:05:23.611 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:23.614 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:05:23.623 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-04-26T12:05:22.336138+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":85796,"kb_used_data":632,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283029724,"statfs":{"total":289910292480,"available":289822437376,"internally_reserved":0,"allocated":647168,"data_stored":1350688,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002326"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782815+0000","last_change":"2024-04-26T12:05:03.796038+0000","last_active":"2024-04-26T12:05:04.782815+0000","last_peered":"2024-04-26T12:05:04.782815+0000","last_clean":"2024-04-26T12:05:04.782815+0000","last_became_active":"2024-04-26T12:05:03.795539+0000","last_became_peered":"2024-04-26T12:05:03.795539+0000","last_unstale":"2024-04-26T12:05:04.782815+0000","last_undegraded":"2024-04-26T12:05:04.782815+0000","last_fullsized":"2024-04-26T12:05:04.782815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782477+0000","last_change":"2024-04-26T12:05:03.795955+0000","last_active":"2024-04-26T12:05:04.782477+0000","last_peered":"2024-04-26T12:05:04.782477+0000","last_clean":"2024-04-26T12:05:04.782477+0000","last_became_active":"2024-04-26T12:05:03.795303+0000","last_became_peered":"2024-04-26T12:05:03.795303+0000","last_unstale":"2024-04-26T12:05:04.782477+0000","last_undegraded":"2024-04-26T12:05:04.782477+0000","last_fullsized":"2024-04-26T12:05:04.782477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781972+0000","last_change":"2024-04-26T12:05:03.797557+0000","last_active":"2024-04-26T12:05:04.781972+0000","last_peered":"2024-04-26T12:05:04.781972+0000","last_clean":"2024-04-26T12:05:04.781972+0000","last_became_active":"2024-04-26T12:05:03.797122+0000","last_became_peered":"2024-04-26T12:05:03.797122+0000","last_unstale":"2024-04-26T12:05:04.781972+0000","last_undegraded":"2024-04-26T12:05:04.781972+0000","last_fullsized":"2024-04-26T12:05:04.781972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782137+0000","last_change":"2024-04-26T12:05:03.791234+0000","last_active":"2024-04-26T12:05:04.782137+0000","last_peered":"2024-04-26T12:05:04.782137+0000","last_clean":"2024-04-26T12:05:04.782137+0000","last_became_active":"2024-04-26T12:05:03.790717+0000","last_became_peered":"2024-04-26T12:05:03.790717+0000","last_unstale":"2024-04-26T12:05:04.782137+0000","last_undegraded":"2024-04-26T12:05:04.782137+0000","last_fullsized":"2024-04-26T12:05:04.782137+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:52.358881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782240+0000","last_change":"2024-04-26T12:05:03.792885+0000","last_active":"2024-04-26T12:05:04.782240+0000","last_peered":"2024-04-26T12:05:04.782240+0000","last_clean":"2024-04-26T12:05:04.782240+0000","last_became_active":"2024-04-26T12:05:03.792354+0000","last_became_peered":"2024-04-26T12:05:03.792354+0000","last_unstale":"2024-04-26T12:05:04.782240+0000","last_undegraded":"2024-04-26T12:05:04.782240+0000","last_fullsized":"2024-04-26T12:05:04.782240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781573+0000","last_change":"2024-04-26T12:05:03.791560+0000","last_active":"2024-04-26T12:05:04.781573+0000","last_peered":"2024-04-26T12:05:04.781573+0000","last_clean":"2024-04-26T12:05:04.781573+0000","last_became_active":"2024-04-26T12:05:03.790578+0000","last_became_peered":"2024-04-26T12:05:03.790578+0000","last_unstale":"2024-04-26T12:05:04.781573+0000","last_undegraded":"2024-04-26T12:05:04.781573+0000","last_fullsized":"2024-04-26T12:05:04.781573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781892+0000","last_change":"2024-04-26T12:05:03.791215+0000","last_active":"2024-04-26T12:05:04.781892+0000","last_peered":"2024-04-26T12:05:04.781892+0000","last_clean":"2024-04-26T12:05:04.781892+0000","last_became_active":"2024-04-26T12:05:03.790615+0000","last_became_peered":"2024-04-26T12:05:03.790615+0000","last_unstale":"2024-04-26T12:05:04.781892+0000","last_undegraded":"2024-04-26T12:05:04.781892+0000","last_fullsized":"2024-04-26T12:05:04.781892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:55.388027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781429+0000","last_change":"2024-04-26T12:05:03.785861+0000","last_active":"2024-04-26T12:05:04.781429+0000","last_peered":"2024-04-26T12:05:04.781429+0000","last_clean":"2024-04-26T12:05:04.781429+0000","last_became_active":"2024-04-26T12:05:03.785382+0000","last_became_peered":"2024-04-26T12:05:03.785382+0000","last_unstale":"2024-04-26T12:05:04.781429+0000","last_undegraded":"2024-04-26T12:05:04.781429+0000","last_fullsized":"2024-04-26T12:05:04.781429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:51.870183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204307+0000","last_change":"2024-04-26T12:05:03.797218+0000","last_active":"2024-04-26T12:05:05.204307+0000","last_peered":"2024-04-26T12:05:05.204307+0000","last_clean":"2024-04-26T12:05:05.204307+0000","last_became_active":"2024-04-26T12:05:03.796902+0000","last_became_peered":"2024-04-26T12:05:03.796902+0000","last_unstale":"2024-04-26T12:05:05.204307+0000","last_undegraded":"2024-04-26T12:05:05.204307+0000","last_fullsized":"2024-04-26T12:05:05.204307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:27.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782312+0000","last_change":"2024-04-26T12:05:03.795919+0000","last_active":"2024-04-26T12:05:04.782312+0000","last_peered":"2024-04-26T12:05:04.782312+0000","last_clean":"2024-04-26T12:05:04.782312+0000","last_became_active":"2024-04-26T12:05:03.795268+0000","last_became_peered":"2024-04-26T12:05:03.795268+0000","last_unstale":"2024-04-26T12:05:04.782312+0000","last_undegraded":"2024-04-26T12:05:04.782312+0000","last_fullsized":"2024-04-26T12:05:04.782312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782161+0000","last_change":"2024-04-26T12:05:03.791046+0000","last_active":"2024-04-26T12:05:04.782161+0000","last_peered":"2024-04-26T12:05:04.782161+0000","last_clean":"2024-04-26T12:05:04.782161+0000","last_became_active":"2024-04-26T12:05:03.790662+0000","last_became_peered":"2024-04-26T12:05:03.790662+0000","last_unstale":"2024-04-26T12:05:04.782161+0000","last_undegraded":"2024-04-26T12:05:04.782161+0000","last_fullsized":"2024-04-26T12:05:04.782161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:35.458663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782010+0000","last_change":"2024-04-26T12:05:03.795250+0000","last_active":"2024-04-26T12:05:04.782010+0000","last_peered":"2024-04-26T12:05:04.782010+0000","last_clean":"2024-04-26T12:05:04.782010+0000","last_became_active":"2024-04-26T12:05:03.794632+0000","last_became_peered":"2024-04-26T12:05:03.794632+0000","last_unstale":"2024-04-26T12:05:04.782010+0000","last_undegraded":"2024-04-26T12:05:04.782010+0000","last_fullsized":"2024-04-26T12:05:04.782010+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:59.873501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782077+0000","last_change":"2024-04-26T12:05:03.794090+0000","last_active":"2024-04-26T12:05:04.782077+0000","last_peered":"2024-04-26T12:05:04.782077+0000","last_clean":"2024-04-26T12:05:04.782077+0000","last_became_active":"2024-04-26T12:05:03.793681+0000","last_became_peered":"2024-04-26T12:05:03.793681+0000","last_unstale":"2024-04-26T12:05:04.782077+0000","last_undegraded":"2024-04-26T12:05:04.782077+0000","last_fullsized":"2024-04-26T12:05:04.782077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781643+0000","last_change":"2024-04-26T12:05:03.795539+0000","last_active":"2024-04-26T12:05:04.781643+0000","last_peered":"2024-04-26T12:05:04.781643+0000","last_clean":"2024-04-26T12:05:04.781643+0000","last_became_active":"2024-04-26T12:05:03.795281+0000","last_became_peered":"2024-04-26T12:05:03.795281+0000","last_unstale":"2024-04-26T12:05:04.781643+0000","last_undegraded":"2024-04-26T12:05:04.781643+0000","last_fullsized":"2024-04-26T12:05:04.781643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:27.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781992+0000","last_change":"2024-04-26T12:05:03.793487+0000","last_active":"2024-04-26T12:05:04.781992+0000","last_peered":"2024-04-26T12:05:04.781992+0000","last_clean":"2024-04-26T12:05:04.781992+0000","last_became_active":"2024-04-26T12:05:03.793242+0000","last_became_peered":"2024-04-26T12:05:03.793242+0000","last_unstale":"2024-04-26T12:05:04.781992+0000","last_undegraded":"2024-04-26T12:05:04.781992+0000","last_fullsized":"2024-04-26T12:05:04.781992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:53.331006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781585+0000","last_change":"2024-04-26T12:05:03.786360+0000","last_active":"2024-04-26T12:05:04.781585+0000","last_peered":"2024-04-26T12:05:04.781585+0000","last_clean":"2024-04-26T12:05:04.781585+0000","last_became_active":"2024-04-26T12:05:03.785991+0000","last_became_peered":"2024-04-26T12:05:03.785991+0000","last_unstale":"2024-04-26T12:05:04.781585+0000","last_undegraded":"2024-04-26T12:05:04.781585+0000","last_fullsized":"2024-04-26T12:05:04.781585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:17.702068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204616+0000","last_change":"2024-04-26T12:05:03.797390+0000","last_active":"2024-04-26T12:05:05.204616+0000","last_peered":"2024-04-26T12:05:05.204616+0000","last_clean":"2024-04-26T12:05:05.204616+0000","last_became_active":"2024-04-26T12:05:03.796969+0000","last_became_peered":"2024-04-26T12:05:03.796969+0000","last_unstale":"2024-04-26T12:05:05.204616+0000","last_undegraded":"2024-04-26T12:05:05.204616+0000","last_fullsized":"2024-04-26T12:05:05.204616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:57.461628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782513+0000","last_change":"2024-04-26T12:05:03.794013+0000","last_active":"2024-04-26T12:05:04.782513+0000","last_peered":"2024-04-26T12:05:04.782513+0000","last_clean":"2024-04-26T12:05:04.782513+0000","last_became_active":"2024-04-26T12:05:03.793512+0000","last_became_peered":"2024-04-26T12:05:03.793512+0000","last_unstale":"2024-04-26T12:05:04.782513+0000","last_undegraded":"2024-04-26T12:05:04.782513+0000","last_fullsized":"2024-04-26T12:05:04.782513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204175+0000","last_change":"2024-04-26T12:05:03.798195+0000","last_active":"2024-04-26T12:05:05.204175+0000","last_peered":"2024-04-26T12:05:05.204175+0000","last_clean":"2024-04-26T12:05:05.204175+0000","last_became_active":"2024-04-26T12:05:03.797935+0000","last_became_peered":"2024-04-26T12:05:03.797935+0000","last_unstale":"2024-04-26T12:05:05.204175+0000","last_undegraded":"2024-04-26T12:05:05.204175+0000","last_fullsized":"2024-04-26T12:05:05.204175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:58.872589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782280+0000","last_change":"2024-04-26T12:05:03.792219+0000","last_active":"2024-04-26T12:05:04.782280+0000","last_peered":"2024-04-26T12:05:04.782280+0000","last_clean":"2024-04-26T12:05:04.782280+0000","last_became_active":"2024-04-26T12:05:03.791061+0000","last_became_peered":"2024-04-26T12:05:03.791061+0000","last_unstale":"2024-04-26T12:05:04.782280+0000","last_undegraded":"2024-04-26T12:05:04.782280+0000","last_fullsized":"2024-04-26T12:05:04.782280+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782402+0000","last_change":"2024-04-26T12:05:03.792073+0000","last_active":"2024-04-26T12:05:04.782402+0000","last_peered":"2024-04-26T12:05:04.782402+0000","last_clean":"2024-04-26T12:05:04.782402+0000","last_became_active":"2024-04-26T12:05:03.791693+0000","last_became_peered":"2024-04-26T12:05:03.791693+0000","last_unstale":"2024-04-26T12:05:04.782402+0000","last_undegraded":"2024-04-26T12:05:04.782402+0000","last_fullsized":"2024-04-26T12:05:04.782402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781784+0000","last_change":"2024-04-26T12:05:03.794027+0000","last_active":"2024-04-26T12:05:04.781784+0000","last_peered":"2024-04-26T12:05:04.781784+0000","last_clean":"2024-04-26T12:05:04.781784+0000","last_became_active":"2024-04-26T12:05:03.793660+0000","last_became_peered":"2024-04-26T12:05:03.793660+0000","last_unstale":"2024-04-26T12:05:04.781784+0000","last_undegraded":"2024-04-26T12:05:04.781784+0000","last_fullsized":"2024-04-26T12:05:04.781784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:53.331006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203565+0000","last_change":"2024-04-26T12:05:03.788658+0000","last_active":"2024-04-26T12:05:05.203565+0000","last_peered":"2024-04-26T12:05:05.203565+0000","last_clean":"2024-04-26T12:05:05.203565+0000","last_became_active":"2024-04-26T12:05:03.788050+0000","last_became_peered":"2024-04-26T12:05:03.788050+0000","last_unstale":"2024-04-26T12:05:05.203565+0000","last_undegraded":"2024-04-26T12:05:05.203565+0000","last_fullsized":"2024-04-26T12:05:05.203565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781648+0000","last_change":"2024-04-26T12:05:03.793554+0000","last_active":"2024-04-26T12:05:04.781648+0000","last_peered":"2024-04-26T12:05:04.781648+0000","last_clean":"2024-04-26T12:05:04.781648+0000","last_became_active":"2024-04-26T12:05:03.792588+0000","last_became_peered":"2024-04-26T12:05:03.792588+0000","last_unstale":"2024-04-26T12:05:04.781648+0000","last_undegraded":"2024-04-26T12:05:04.781648+0000","last_fullsized":"2024-04-26T12:05:04.781648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782854+0000","last_change":"2024-04-26T12:05:03.795510+0000","last_active":"2024-04-26T12:05:04.782854+0000","last_peered":"2024-04-26T12:05:04.782854+0000","last_clean":"2024-04-26T12:05:04.782854+0000","last_became_active":"2024-04-26T12:05:03.794639+0000","last_became_peered":"2024-04-26T12:05:03.794639+0000","last_unstale":"2024-04-26T12:05:04.782854+0000","last_undegraded":"2024-04-26T12:05:04.782854+0000","last_fullsized":"2024-04-26T12:05:04.782854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:57.461628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204465+0000","last_change":"2024-04-26T12:05:03.787909+0000","last_active":"2024-04-26T12:05:05.204465+0000","last_peered":"2024-04-26T12:05:05.204465+0000","last_clean":"2024-04-26T12:05:05.204465+0000","last_became_active":"2024-04-26T12:05:03.787562+0000","last_became_peered":"2024-04-26T12:05:03.787562+0000","last_unstale":"2024-04-26T12:05:05.204465+0000","last_undegraded":"2024-04-26T12:05:05.204465+0000","last_fullsized":"2024-04-26T12:05:05.204465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782352+0000","last_change":"2024-04-26T12:05:03.796836+0000","last_active":"2024-04-26T12:05:04.782352+0000","last_peered":"2024-04-26T12:05:04.782352+0000","last_clean":"2024-04-26T12:05:04.782352+0000","last_became_active":"2024-04-26T12:05:03.796524+0000","last_became_peered":"2024-04-26T12:05:03.796524+0000","last_unstale":"2024-04-26T12:05:04.782352+0000","last_undegraded":"2024-04-26T12:05:04.782352+0000","last_fullsized":"2024-04-26T12:05:04.782352+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782420+0000","last_change":"2024-04-26T12:05:03.792400+0000","last_active":"2024-04-26T12:05:04.782420+0000","last_peered":"2024-04-26T12:05:04.782420+0000","last_clean":"2024-04-26T12:05:04.782420+0000","last_became_active":"2024-04-26T12:05:03.792079+0000","last_became_peered":"2024-04-26T12:05:03.792079+0000","last_unstale":"2024-04-26T12:05:04.782420+0000","last_undegraded":"2024-04-26T12:05:04.782420+0000","last_fullsized":"2024-04-26T12:05:04.782420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:24.434355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204245+0000","last_change":"2024-04-26T12:05:03.797172+0000","last_active":"2024-04-26T12:05:05.204245+0000","last_peered":"2024-04-26T12:05:05.204245+0000","last_clean":"2024-04-26T12:05:05.204245+0000","last_became_active":"2024-04-26T12:05:03.796879+0000","last_became_peered":"2024-04-26T12:05:03.796879+0000","last_unstale":"2024-04-26T12:05:05.204245+0000","last_undegraded":"2024-04-26T12:05:05.204245+0000","last_fullsized":"2024-04-26T12:05:05.204245+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:24.434355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781949+0000","last_change":"2024-04-26T12:05:03.793269+0000","last_active":"2024-04-26T12:05:04.781949+0000","last_peered":"2024-04-26T12:05:04.781949+0000","last_clean":"2024-04-26T12:05:04.781949+0000","last_became_active":"2024-04-26T12:05:03.792698+0000","last_became_peered":"2024-04-26T12:05:03.792698+0000","last_unstale":"2024-04-26T12:05:04.781949+0000","last_undegraded":"2024-04-26T12:05:04.781949+0000","last_fullsized":"2024-04-26T12:05:04.781949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:58.579861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203630+0000","last_change":"2024-04-26T12:05:03.796871+0000","last_active":"2024-04-26T12:05:05.203630+0000","last_peered":"2024-04-26T12:05:05.203630+0000","last_clean":"2024-04-26T12:05:05.203630+0000","last_became_active":"2024-04-26T12:05:03.796546+0000","last_became_peered":"2024-04-26T12:05:03.796546+0000","last_unstale":"2024-04-26T12:05:05.203630+0000","last_undegraded":"2024-04-26T12:05:05.203630+0000","last_fullsized":"2024-04-26T12:05:05.203630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:53.331006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781676+0000","last_change":"2024-04-26T12:05:03.791605+0000","last_active":"2024-04-26T12:05:04.781676+0000","last_peered":"2024-04-26T12:05:04.781676+0000","last_clean":"2024-04-26T12:05:04.781676+0000","last_became_active":"2024-04-26T12:05:03.791251+0000","last_became_peered":"2024-04-26T12:05:03.791251+0000","last_unstale":"2024-04-26T12:05:04.781676+0000","last_undegraded":"2024-04-26T12:05:04.781676+0000","last_fullsized":"2024-04-26T12:05:04.781676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:27.239868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782339+0000","last_change":"2024-04-26T12:05:03.793791+0000","last_active":"2024-04-26T12:05:04.782339+0000","last_peered":"2024-04-26T12:05:04.782339+0000","last_clean":"2024-04-26T12:05:04.782339+0000","last_became_active":"2024-04-26T12:05:03.793468+0000","last_became_peered":"2024-04-26T12:05:03.793468+0000","last_unstale":"2024-04-26T12:05:04.782339+0000","last_undegraded":"2024-04-26T12:05:04.782339+0000","last_fullsized":"2024-04-26T12:05:04.782339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:01.289069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782440+0000","last_change":"2024-04-26T12:05:03.430021+0000","last_active":"2024-04-26T12:05:04.782440+0000","last_peered":"2024-04-26T12:05:04.782440+0000","last_clean":"2024-04-26T12:05:04.782440+0000","last_became_active":"2024-04-26T12:05:03.429695+0000","last_became_peered":"2024-04-26T12:05:03.429695+0000","last_unstale":"2024-04-26T12:05:04.782440+0000","last_undegraded":"2024-04-26T12:05:04.782440+0000","last_fullsized":"2024-04-26T12:05:04.782440+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782505+0000","last_change":"2024-04-26T12:05:03.796189+0000","last_active":"2024-04-26T12:05:04.782505+0000","last_peered":"2024-04-26T12:05:04.782505+0000","last_clean":"2024-04-26T12:05:04.782505+0000","last_became_active":"2024-04-26T12:05:03.795438+0000","last_became_peered":"2024-04-26T12:05:03.795438+0000","last_unstale":"2024-04-26T12:05:04.782505+0000","last_undegraded":"2024-04-26T12:05:04.782505+0000","last_fullsized":"2024-04-26T12:05:04.782505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:22.814807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203969+0000","last_change":"2024-04-26T12:05:03.428605+0000","last_active":"2024-04-26T12:05:05.203969+0000","last_peered":"2024-04-26T12:05:05.203969+0000","last_clean":"2024-04-26T12:05:05.203969+0000","last_became_active":"2024-04-26T12:05:03.428098+0000","last_became_peered":"2024-04-26T12:05:03.428098+0000","last_unstale":"2024-04-26T12:05:05.203969+0000","last_undegraded":"2024-04-26T12:05:05.203969+0000","last_fullsized":"2024-04-26T12:05:05.203969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204596+0000","last_change":"2024-04-26T12:05:03.788568+0000","last_active":"2024-04-26T12:05:05.204596+0000","last_peered":"2024-04-26T12:05:05.204596+0000","last_clean":"2024-04-26T12:05:05.204596+0000","last_became_active":"2024-04-26T12:05:03.788039+0000","last_became_peered":"2024-04-26T12:05:03.788039+0000","last_unstale":"2024-04-26T12:05:05.204596+0000","last_undegraded":"2024-04-26T12:05:05.204596+0000","last_fullsized":"2024-04-26T12:05:05.204596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781927+0000","last_change":"2024-04-26T12:05:03.422773+0000","last_active":"2024-04-26T12:05:04.781927+0000","last_peered":"2024-04-26T12:05:04.781927+0000","last_clean":"2024-04-26T12:05:04.781927+0000","last_became_active":"2024-04-26T12:05:03.422412+0000","last_became_peered":"2024-04-26T12:05:03.422412+0000","last_unstale":"2024-04-26T12:05:04.781927+0000","last_undegraded":"2024-04-26T12:05:04.781927+0000","last_fullsized":"2024-04-26T12:05:04.781927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:06.758253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204353+0000","last_change":"2024-04-26T12:05:03.788505+0000","last_active":"2024-04-26T12:05:05.204353+0000","last_peered":"2024-04-26T12:05:05.204353+0000","last_clean":"2024-04-26T12:05:05.204353+0000","last_became_active":"2024-04-26T12:05:03.788184+0000","last_became_peered":"2024-04-26T12:05:03.788184+0000","last_unstale":"2024-04-26T12:05:05.204353+0000","last_undegraded":"2024-04-26T12:05:05.204353+0000","last_fullsized":"2024-04-26T12:05:05.204353+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781717+0000","last_change":"2024-04-26T12:05:03.425495+0000","last_active":"2024-04-26T12:05:04.781717+0000","last_peered":"2024-04-26T12:05:04.781717+0000","last_clean":"2024-04-26T12:05:04.781717+0000","last_became_active":"2024-04-26T12:05:03.424963+0000","last_became_peered":"2024-04-26T12:05:03.424963+0000","last_unstale":"2024-04-26T12:05:04.781717+0000","last_undegraded":"2024-04-26T12:05:04.781717+0000","last_fullsized":"2024-04-26T12:05:04.781717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:55.660897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782532+0000","last_change":"2024-04-26T12:05:03.426142+0000","last_active":"2024-04-26T12:05:04.782532+0000","last_peered":"2024-04-26T12:05:04.782532+0000","last_clean":"2024-04-26T12:05:04.782532+0000","last_became_active":"2024-04-26T12:05:03.425699+0000","last_became_peered":"2024-04-26T12:05:03.425699+0000","last_unstale":"2024-04-26T12:05:04.782532+0000","last_undegraded":"2024-04-26T12:05:04.782532+0000","last_fullsized":"2024-04-26T12:05:04.782532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:41.279426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781647+0000","last_change":"2024-04-26T12:05:03.794778+0000","last_active":"2024-04-26T12:05:04.781647+0000","last_peered":"2024-04-26T12:05:04.781647+0000","last_clean":"2024-04-26T12:05:04.781647+0000","last_became_active":"2024-04-26T12:05:03.794192+0000","last_became_peered":"2024-04-26T12:05:03.794192+0000","last_unstale":"2024-04-26T12:05:04.781647+0000","last_undegraded":"2024-04-26T12:05:04.781647+0000","last_fullsized":"2024-04-26T12:05:04.781647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:16.372597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782585+0000","last_change":"2024-04-26T12:05:03.426530+0000","last_active":"2024-04-26T12:05:04.782585+0000","last_peered":"2024-04-26T12:05:04.782585+0000","last_clean":"2024-04-26T12:05:04.782585+0000","last_became_active":"2024-04-26T12:05:03.426113+0000","last_became_peered":"2024-04-26T12:05:03.426113+0000","last_unstale":"2024-04-26T12:05:04.782585+0000","last_undegraded":"2024-04-26T12:05:04.782585+0000","last_fullsized":"2024-04-26T12:05:04.782585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:21.029311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781810+0000","last_change":"2024-04-26T12:05:03.793000+0000","last_active":"2024-04-26T12:05:04.781810+0000","last_peered":"2024-04-26T12:05:04.781810+0000","last_clean":"2024-04-26T12:05:04.781810+0000","last_became_active":"2024-04-26T12:05:03.792480+0000","last_became_peered":"2024-04-26T12:05:03.792480+0000","last_unstale":"2024-04-26T12:05:04.781810+0000","last_undegraded":"2024-04-26T12:05:04.781810+0000","last_fullsized":"2024-04-26T12:05:04.781810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782682+0000","last_change":"2024-04-26T12:05:03.426039+0000","last_active":"2024-04-26T12:05:04.782682+0000","last_peered":"2024-04-26T12:05:04.782682+0000","last_clean":"2024-04-26T12:05:04.782682+0000","last_became_active":"2024-04-26T12:05:03.425666+0000","last_became_peered":"2024-04-26T12:05:03.425666+0000","last_unstale":"2024-04-26T12:05:04.782682+0000","last_undegraded":"2024-04-26T12:05:04.782682+0000","last_fullsized":"2024-04-26T12:05:04.782682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:00.998013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781698+0000","last_change":"2024-04-26T12:05:03.791809+0000","last_active":"2024-04-26T12:05:04.781698+0000","last_peered":"2024-04-26T12:05:04.781698+0000","last_clean":"2024-04-26T12:05:04.781698+0000","last_became_active":"2024-04-26T12:05:03.791272+0000","last_became_peered":"2024-04-26T12:05:03.791272+0000","last_unstale":"2024-04-26T12:05:04.781698+0000","last_undegraded":"2024-04-26T12:05:04.781698+0000","last_fullsized":"2024-04-26T12:05:04.781698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782611+0000","last_change":"2024-04-26T12:05:03.430224+0000","last_active":"2024-04-26T12:05:04.782611+0000","last_peered":"2024-04-26T12:05:04.782611+0000","last_clean":"2024-04-26T12:05:04.782611+0000","last_became_active":"2024-04-26T12:05:03.429291+0000","last_became_peered":"2024-04-26T12:05:03.429291+0000","last_unstale":"2024-04-26T12:05:04.782611+0000","last_undegraded":"2024-04-26T12:05:04.782611+0000","last_fullsized":"2024-04-26T12:05:04.782611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204057+0000","last_change":"2024-04-26T12:05:03.788174+0000","last_active":"2024-04-26T12:05:05.204057+0000","last_peered":"2024-04-26T12:05:05.204057+0000","last_clean":"2024-04-26T12:05:05.204057+0000","last_became_active":"2024-04-26T12:05:03.787772+0000","last_became_peered":"2024-04-26T12:05:03.787772+0000","last_unstale":"2024-04-26T12:05:05.204057+0000","last_undegraded":"2024-04-26T12:05:05.204057+0000","last_fullsized":"2024-04-26T12:05:05.204057+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204340+0000","last_change":"2024-04-26T12:05:03.431162+0000","last_active":"2024-04-26T12:05:05.204340+0000","last_peered":"2024-04-26T12:05:05.204340+0000","last_clean":"2024-04-26T12:05:05.204340+0000","last_became_active":"2024-04-26T12:05:03.430855+0000","last_became_peered":"2024-04-26T12:05:03.430855+0000","last_unstale":"2024-04-26T12:05:05.204340+0000","last_undegraded":"2024-04-26T12:05:05.204340+0000","last_fullsized":"2024-04-26T12:05:05.204340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:41.279426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782386+0000","last_change":"2024-04-26T12:05:03.792357+0000","last_active":"2024-04-26T12:05:04.782386+0000","last_peered":"2024-04-26T12:05:04.782386+0000","last_clean":"2024-04-26T12:05:04.782386+0000","last_became_active":"2024-04-26T12:05:03.792119+0000","last_became_peered":"2024-04-26T12:05:03.792119+0000","last_unstale":"2024-04-26T12:05:04.782386+0000","last_undegraded":"2024-04-26T12:05:04.782386+0000","last_fullsized":"2024-04-26T12:05:04.782386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781879+0000","last_change":"2024-04-26T12:05:03.429811+0000","last_active":"2024-04-26T12:05:04.781879+0000","last_peered":"2024-04-26T12:05:04.781879+0000","last_clean":"2024-04-26T12:05:04.781879+0000","last_became_active":"2024-04-26T12:05:03.429469+0000","last_became_peered":"2024-04-26T12:05:03.429469+0000","last_unstale":"2024-04-26T12:05:04.781879+0000","last_undegraded":"2024-04-26T12:05:04.781879+0000","last_fullsized":"2024-04-26T12:05:04.781879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782424+0000","last_change":"2024-04-26T12:05:03.795646+0000","last_active":"2024-04-26T12:05:04.782424+0000","last_peered":"2024-04-26T12:05:04.782424+0000","last_clean":"2024-04-26T12:05:04.782424+0000","last_became_active":"2024-04-26T12:05:03.795354+0000","last_became_peered":"2024-04-26T12:05:03.795354+0000","last_unstale":"2024-04-26T12:05:04.782424+0000","last_undegraded":"2024-04-26T12:05:04.782424+0000","last_fullsized":"2024-04-26T12:05:04.782424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:22.814807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782060+0000","last_change":"2024-04-26T12:05:03.427908+0000","last_active":"2024-04-26T12:05:04.782060+0000","last_peered":"2024-04-26T12:05:04.782060+0000","last_clean":"2024-04-26T12:05:04.782060+0000","last_became_active":"2024-04-26T12:05:03.426718+0000","last_became_peered":"2024-04-26T12:05:03.426718+0000","last_unstale":"2024-04-26T12:05:04.782060+0000","last_undegraded":"2024-04-26T12:05:04.782060+0000","last_fullsized":"2024-04-26T12:05:04.782060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:40.538058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782365+0000","last_change":"2024-04-26T12:05:03.797113+0000","last_active":"2024-04-26T12:05:04.782365+0000","last_peered":"2024-04-26T12:05:04.782365+0000","last_clean":"2024-04-26T12:05:04.782365+0000","last_became_active":"2024-04-26T12:05:03.796739+0000","last_became_peered":"2024-04-26T12:05:03.796739+0000","last_unstale":"2024-04-26T12:05:04.782365+0000","last_undegraded":"2024-04-26T12:05:04.782365+0000","last_fullsized":"2024-04-26T12:05:04.782365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:59.873501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781849+0000","last_change":"2024-04-26T12:05:03.428262+0000","last_active":"2024-04-26T12:05:04.781849+0000","last_peered":"2024-04-26T12:05:04.781849+0000","last_clean":"2024-04-26T12:05:04.781849+0000","last_became_active":"2024-04-26T12:05:03.426588+0000","last_became_peered":"2024-04-26T12:05:03.426588+0000","last_unstale":"2024-04-26T12:05:04.781849+0000","last_undegraded":"2024-04-26T12:05:04.781849+0000","last_fullsized":"2024-04-26T12:05:04.781849+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:42.674797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204403+0000","last_change":"2024-04-26T12:05:03.797633+0000","last_active":"2024-04-26T12:05:05.204403+0000","last_peered":"2024-04-26T12:05:05.204403+0000","last_clean":"2024-04-26T12:05:05.204403+0000","last_became_active":"2024-04-26T12:05:03.797338+0000","last_became_peered":"2024-04-26T12:05:03.797338+0000","last_unstale":"2024-04-26T12:05:05.204403+0000","last_undegraded":"2024-04-26T12:05:05.204403+0000","last_fullsized":"2024-04-26T12:05:05.204403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:22.814807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.782901+0000","last_change":"2024-04-26T12:04:53.388840+0000","last_active":"2024-04-26T12:05:03.782901+0000","last_peered":"2024-04-26T12:05:03.782901+0000","last_clean":"2024-04-26T12:05:03.782901+0000","last_became_active":"2024-04-26T12:04:53.388568+0000","last_became_peered":"2024-04-26T12:04:53.388568+0000","last_unstale":"2024-04-26T12:05:03.782901+0000","last_undegraded":"2024-04-26T12:05:03.782901+0000","last_fullsized":"2024-04-26T12:05:03.782901+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_clean_scrub_stamp":"2024-04-26T12:04:52.376986+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:04.970330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.781157+0000","last_change":"2024-04-26T12:04:59.403711+0000","last_active":"2024-04-26T12:05:03.781157+0000","last_peered":"2024-04-26T12:05:03.781157+0000","last_clean":"2024-04-26T12:05:03.781157+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:05:03.781157+0000","last_undegraded":"2024-04-26T12:05:03.781157+0000","last_fullsized":"2024-04-26T12:05:03.781157+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:45.779614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204217+0000","last_change":"2024-04-26T12:05:03.429674+0000","last_active":"2024-04-26T12:05:05.204217+0000","last_peered":"2024-04-26T12:05:05.204217+0000","last_clean":"2024-04-26T12:05:05.204217+0000","last_became_active":"2024-04-26T12:05:03.429266+0000","last_became_peered":"2024-04-26T12:05:03.429266+0000","last_unstale":"2024-04-26T12:05:05.204217+0000","last_undegraded":"2024-04-26T12:05:05.204217+0000","last_fullsized":"2024-04-26T12:05:05.204217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:55.660897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782655+0000","last_change":"2024-04-26T12:05:03.797640+0000","last_active":"2024-04-26T12:05:04.782655+0000","last_peered":"2024-04-26T12:05:04.782655+0000","last_clean":"2024-04-26T12:05:04.782655+0000","last_became_active":"2024-04-26T12:05:03.797302+0000","last_became_peered":"2024-04-26T12:05:03.797302+0000","last_unstale":"2024-04-26T12:05:04.782655+0000","last_undegraded":"2024-04-26T12:05:04.782655+0000","last_fullsized":"2024-04-26T12:05:04.782655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:16.372597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.781404+0000","last_change":"2024-04-26T12:04:59.405437+0000","last_active":"2024-04-26T12:05:03.781404+0000","last_peered":"2024-04-26T12:05:03.781404+0000","last_clean":"2024-04-26T12:05:03.781404+0000","last_became_active":"2024-04-26T12:04:59.405193+0000","last_became_peered":"2024-04-26T12:04:59.405193+0000","last_unstale":"2024-04-26T12:05:03.781404+0000","last_undegraded":"2024-04-26T12:05:03.781404+0000","last_fullsized":"2024-04-26T12:05:03.781404+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:20.977569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203835+0000","last_change":"2024-04-26T12:05:03.428547+0000","last_active":"2024-04-26T12:05:05.203835+0000","last_peered":"2024-04-26T12:05:05.203835+0000","last_clean":"2024-04-26T12:05:05.203835+0000","last_became_active":"2024-04-26T12:05:03.427985+0000","last_became_peered":"2024-04-26T12:05:03.427985+0000","last_unstale":"2024-04-26T12:05:05.203835+0000","last_undegraded":"2024-04-26T12:05:05.203835+0000","last_fullsized":"2024-04-26T12:05:05.203835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:19.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782574+0000","last_change":"2024-04-26T12:05:03.793800+0000","last_active":"2024-04-26T12:05:04.782574+0000","last_peered":"2024-04-26T12:05:04.782574+0000","last_clean":"2024-04-26T12:05:04.782574+0000","last_became_active":"2024-04-26T12:05:03.792932+0000","last_became_peered":"2024-04-26T12:05:03.792932+0000","last_unstale":"2024-04-26T12:05:04.782574+0000","last_undegraded":"2024-04-26T12:05:04.782574+0000","last_fullsized":"2024-04-26T12:05:04.782574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.780048+0000","last_change":"2024-04-26T12:04:59.405617+0000","last_active":"2024-04-26T12:05:03.780048+0000","last_peered":"2024-04-26T12:05:03.780048+0000","last_clean":"2024-04-26T12:05:03.780048+0000","last_became_active":"2024-04-26T12:04:59.405328+0000","last_became_peered":"2024-04-26T12:04:59.405328+0000","last_unstale":"2024-04-26T12:05:03.780048+0000","last_undegraded":"2024-04-26T12:05:03.780048+0000","last_fullsized":"2024-04-26T12:05:03.780048+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:39.317039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782519+0000","last_change":"2024-04-26T12:05:03.424576+0000","last_active":"2024-04-26T12:05:04.782519+0000","last_peered":"2024-04-26T12:05:04.782519+0000","last_clean":"2024-04-26T12:05:04.782519+0000","last_became_active":"2024-04-26T12:05:03.424289+0000","last_became_peered":"2024-04-26T12:05:03.424289+0000","last_unstale":"2024-04-26T12:05:04.782519+0000","last_undegraded":"2024-04-26T12:05:04.782519+0000","last_fullsized":"2024-04-26T12:05:04.782519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:10.759772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204460+0000","last_change":"2024-04-26T12:05:03.798238+0000","last_active":"2024-04-26T12:05:05.204460+0000","last_peered":"2024-04-26T12:05:05.204460+0000","last_clean":"2024-04-26T12:05:05.204460+0000","last_became_active":"2024-04-26T12:05:03.797924+0000","last_became_peered":"2024-04-26T12:05:03.797924+0000","last_unstale":"2024-04-26T12:05:05.204460+0000","last_undegraded":"2024-04-26T12:05:05.204460+0000","last_fullsized":"2024-04-26T12:05:05.204460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:01.289069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.781616+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:05:03.781616+0000","last_peered":"2024-04-26T12:05:03.781616+0000","last_clean":"2024-04-26T12:05:03.781616+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:05:03.781616+0000","last_undegraded":"2024-04-26T12:05:03.781616+0000","last_fullsized":"2024-04-26T12:05:03.781616+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:12.939539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782535+0000","last_change":"2024-04-26T12:05:03.430140+0000","last_active":"2024-04-26T12:05:04.782535+0000","last_peered":"2024-04-26T12:05:04.782535+0000","last_clean":"2024-04-26T12:05:04.782535+0000","last_became_active":"2024-04-26T12:05:03.429838+0000","last_became_peered":"2024-04-26T12:05:03.429838+0000","last_unstale":"2024-04-26T12:05:04.782535+0000","last_undegraded":"2024-04-26T12:05:04.782535+0000","last_fullsized":"2024-04-26T12:05:04.782535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204416+0000","last_change":"2024-04-26T12:05:03.796731+0000","last_active":"2024-04-26T12:05:05.204416+0000","last_peered":"2024-04-26T12:05:05.204416+0000","last_clean":"2024-04-26T12:05:05.204416+0000","last_became_active":"2024-04-26T12:05:03.796432+0000","last_became_peered":"2024-04-26T12:05:03.796432+0000","last_unstale":"2024-04-26T12:05:05.204416+0000","last_undegraded":"2024-04-26T12:05:05.204416+0000","last_fullsized":"2024-04-26T12:05:05.204416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:58.579861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782707+0000","last_change":"2024-04-26T12:05:03.429673+0000","last_active":"2024-04-26T12:05:04.782707+0000","last_peered":"2024-04-26T12:05:04.782707+0000","last_clean":"2024-04-26T12:05:04.782707+0000","last_became_active":"2024-04-26T12:05:03.429146+0000","last_became_peered":"2024-04-26T12:05:03.429146+0000","last_unstale":"2024-04-26T12:05:04.782707+0000","last_undegraded":"2024-04-26T12:05:04.782707+0000","last_fullsized":"2024-04-26T12:05:04.782707+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.779759+0000","last_change":"2024-04-26T12:04:59.405766+0000","last_active":"2024-04-26T12:05:03.779759+0000","last_peered":"2024-04-26T12:05:03.779759+0000","last_clean":"2024-04-26T12:05:03.779759+0000","last_became_active":"2024-04-26T12:04:59.405406+0000","last_became_peered":"2024-04-26T12:04:59.405406+0000","last_unstale":"2024-04-26T12:05:03.779759+0000","last_undegraded":"2024-04-26T12:05:03.779759+0000","last_fullsized":"2024-04-26T12:05:03.779759+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:13.860871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782006+0000","last_change":"2024-04-26T12:05:03.792534+0000","last_active":"2024-04-26T12:05:04.782006+0000","last_peered":"2024-04-26T12:05:04.782006+0000","last_clean":"2024-04-26T12:05:04.782006+0000","last_became_active":"2024-04-26T12:05:03.792160+0000","last_became_peered":"2024-04-26T12:05:03.792160+0000","last_unstale":"2024-04-26T12:05:04.782006+0000","last_undegraded":"2024-04-26T12:05:04.782006+0000","last_fullsized":"2024-04-26T12:05:04.782006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:41.930005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204484+0000","last_change":"2024-04-26T12:05:03.429642+0000","last_active":"2024-04-26T12:05:05.204484+0000","last_peered":"2024-04-26T12:05:05.204484+0000","last_clean":"2024-04-26T12:05:05.204484+0000","last_became_active":"2024-04-26T12:05:03.429197+0000","last_became_peered":"2024-04-26T12:05:03.429197+0000","last_unstale":"2024-04-26T12:05:05.204484+0000","last_undegraded":"2024-04-26T12:05:05.204484+0000","last_fullsized":"2024-04-26T12:05:05.204484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:40.538058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.788889+0000","last_change":"2024-04-26T12:04:59.405294+0000","last_active":"2024-04-26T12:05:03.788889+0000","last_peered":"2024-04-26T12:05:03.788889+0000","last_clean":"2024-04-26T12:05:03.788889+0000","last_became_active":"2024-04-26T12:04:59.405044+0000","last_became_peered":"2024-04-26T12:04:59.405044+0000","last_unstale":"2024-04-26T12:05:03.788889+0000","last_undegraded":"2024-04-26T12:05:03.788889+0000","last_fullsized":"2024-04-26T12:05:03.788889+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:47.042833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782238+0000","last_change":"2024-04-26T12:05:03.793408+0000","last_active":"2024-04-26T12:05:04.782238+0000","last_peered":"2024-04-26T12:05:04.782238+0000","last_clean":"2024-04-26T12:05:04.782238+0000","last_became_active":"2024-04-26T12:05:03.793019+0000","last_became_peered":"2024-04-26T12:05:03.793019+0000","last_unstale":"2024-04-26T12:05:04.782238+0000","last_undegraded":"2024-04-26T12:05:04.782238+0000","last_fullsized":"2024-04-26T12:05:04.782238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:25.062114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204650+0000","last_change":"2024-04-26T12:05:03.430008+0000","last_active":"2024-04-26T12:05:05.204650+0000","last_peered":"2024-04-26T12:05:05.204650+0000","last_clean":"2024-04-26T12:05:05.204650+0000","last_became_active":"2024-04-26T12:05:03.429362+0000","last_became_peered":"2024-04-26T12:05:03.429362+0000","last_unstale":"2024-04-26T12:05:05.204650+0000","last_undegraded":"2024-04-26T12:05:05.204650+0000","last_fullsized":"2024-04-26T12:05:05.204650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.780359+0000","last_change":"2024-04-26T12:04:59.405667+0000","last_active":"2024-04-26T12:05:03.780359+0000","last_peered":"2024-04-26T12:05:03.780359+0000","last_clean":"2024-04-26T12:05:03.780359+0000","last_became_active":"2024-04-26T12:04:59.405328+0000","last_became_peered":"2024-04-26T12:04:59.405328+0000","last_unstale":"2024-04-26T12:05:03.780359+0000","last_undegraded":"2024-04-26T12:05:03.780359+0000","last_fullsized":"2024-04-26T12:05:03.780359+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:20.977569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203759+0000","last_change":"2024-04-26T12:05:03.789623+0000","last_active":"2024-04-26T12:05:05.203759+0000","last_peered":"2024-04-26T12:05:05.203759+0000","last_clean":"2024-04-26T12:05:05.203759+0000","last_became_active":"2024-04-26T12:05:03.789390+0000","last_became_peered":"2024-04-26T12:05:03.789390+0000","last_unstale":"2024-04-26T12:05:05.203759+0000","last_undegraded":"2024-04-26T12:05:05.203759+0000","last_fullsized":"2024-04-26T12:05:05.203759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348623+0000","last_change":"2024-04-26T12:05:03.429222+0000","last_active":"2024-04-26T12:05:06.348623+0000","last_peered":"2024-04-26T12:05:06.348623+0000","last_clean":"2024-04-26T12:05:06.348623+0000","last_became_active":"2024-04-26T12:05:03.428803+0000","last_became_peered":"2024-04-26T12:05:03.428803+0000","last_unstale":"2024-04-26T12:05:06.348623+0000","last_undegraded":"2024-04-26T12:05:06.348623+0000","last_fullsized":"2024-04-26T12:05:06.348623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:31.305644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.779178+0000","last_change":"2024-04-26T12:04:59.408078+0000","last_active":"2024-04-26T12:05:03.779178+0000","last_peered":"2024-04-26T12:05:03.779178+0000","last_clean":"2024-04-26T12:05:03.779178+0000","last_became_active":"2024-04-26T12:04:59.407804+0000","last_became_peered":"2024-04-26T12:04:59.407804+0000","last_unstale":"2024-04-26T12:05:03.779178+0000","last_undegraded":"2024-04-26T12:05:03.779178+0000","last_fullsized":"2024-04-26T12:05:03.779178+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:56.449518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782185+0000","last_change":"2024-04-26T12:05:03.792547+0000","last_active":"2024-04-26T12:05:04.782185+0000","last_peered":"2024-04-26T12:05:04.782185+0000","last_clean":"2024-04-26T12:05:04.782185+0000","last_became_active":"2024-04-26T12:05:03.792078+0000","last_became_peered":"2024-04-26T12:05:03.792078+0000","last_unstale":"2024-04-26T12:05:04.782185+0000","last_undegraded":"2024-04-26T12:05:04.782185+0000","last_fullsized":"2024-04-26T12:05:04.782185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:45.563923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782159+0000","last_change":"2024-04-26T12:05:03.795500+0000","last_active":"2024-04-26T12:05:04.782159+0000","last_peered":"2024-04-26T12:05:04.782159+0000","last_clean":"2024-04-26T12:05:04.782159+0000","last_became_active":"2024-04-26T12:05:03.795173+0000","last_became_peered":"2024-04-26T12:05:03.795173+0000","last_unstale":"2024-04-26T12:05:04.782159+0000","last_undegraded":"2024-04-26T12:05:04.782159+0000","last_fullsized":"2024-04-26T12:05:04.782159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:01.289069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782556+0000","last_change":"2024-04-26T12:05:03.426261+0000","last_active":"2024-04-26T12:05:04.782556+0000","last_peered":"2024-04-26T12:05:04.782556+0000","last_clean":"2024-04-26T12:05:04.782556+0000","last_became_active":"2024-04-26T12:05:03.425897+0000","last_became_peered":"2024-04-26T12:05:03.425897+0000","last_unstale":"2024-04-26T12:05:04.782556+0000","last_undegraded":"2024-04-26T12:05:04.782556+0000","last_fullsized":"2024-04-26T12:05:04.782556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:31.305644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203851+0000","last_change":"2024-04-26T12:05:03.795443+0000","last_active":"2024-04-26T12:05:05.203851+0000","last_peered":"2024-04-26T12:05:05.203851+0000","last_clean":"2024-04-26T12:05:05.203851+0000","last_became_active":"2024-04-26T12:05:03.795190+0000","last_became_peered":"2024-04-26T12:05:03.795190+0000","last_unstale":"2024-04-26T12:05:05.203851+0000","last_undegraded":"2024-04-26T12:05:05.203851+0000","last_fullsized":"2024-04-26T12:05:05.203851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:59.873501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782685+0000","last_change":"2024-04-26T12:05:03.425106+0000","last_active":"2024-04-26T12:05:04.782685+0000","last_peered":"2024-04-26T12:05:04.782685+0000","last_clean":"2024-04-26T12:05:04.782685+0000","last_became_active":"2024-04-26T12:05:03.424753+0000","last_became_peered":"2024-04-26T12:05:03.424753+0000","last_unstale":"2024-04-26T12:05:04.782685+0000","last_undegraded":"2024-04-26T12:05:04.782685+0000","last_fullsized":"2024-04-26T12:05:04.782685+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:10.741652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782591+0000","last_change":"2024-04-26T12:05:03.429257+0000","last_active":"2024-04-26T12:05:04.782591+0000","last_peered":"2024-04-26T12:05:04.782591+0000","last_clean":"2024-04-26T12:05:04.782591+0000","last_became_active":"2024-04-26T12:05:03.428921+0000","last_became_peered":"2024-04-26T12:05:03.428921+0000","last_unstale":"2024-04-26T12:05:04.782591+0000","last_undegraded":"2024-04-26T12:05:04.782591+0000","last_fullsized":"2024-04-26T12:05:04.782591+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:49.774845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203669+0000","last_change":"2024-04-26T12:05:03.788141+0000","last_active":"2024-04-26T12:05:05.203669+0000","last_peered":"2024-04-26T12:05:05.203669+0000","last_clean":"2024-04-26T12:05:05.203669+0000","last_became_active":"2024-04-26T12:05:03.787533+0000","last_became_peered":"2024-04-26T12:05:03.787533+0000","last_unstale":"2024-04-26T12:05:05.203669+0000","last_undegraded":"2024-04-26T12:05:05.203669+0000","last_fullsized":"2024-04-26T12:05:05.203669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204552+0000","last_change":"2024-04-26T12:05:03.428971+0000","last_active":"2024-04-26T12:05:05.204552+0000","last_peered":"2024-04-26T12:05:05.204552+0000","last_clean":"2024-04-26T12:05:05.204552+0000","last_became_active":"2024-04-26T12:05:03.428445+0000","last_became_peered":"2024-04-26T12:05:03.428445+0000","last_unstale":"2024-04-26T12:05:05.204552+0000","last_undegraded":"2024-04-26T12:05:05.204552+0000","last_fullsized":"2024-04-26T12:05:05.204552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203649+0000","last_change":"2024-04-26T12:05:03.795318+0000","last_active":"2024-04-26T12:05:05.203649+0000","last_peered":"2024-04-26T12:05:05.203649+0000","last_clean":"2024-04-26T12:05:05.203649+0000","last_became_active":"2024-04-26T12:05:03.795053+0000","last_became_peered":"2024-04-26T12:05:03.795053+0000","last_unstale":"2024-04-26T12:05:05.203649+0000","last_undegraded":"2024-04-26T12:05:05.203649+0000","last_fullsized":"2024-04-26T12:05:05.203649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:16.372597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782875+0000","last_change":"2024-04-26T12:05:03.795109+0000","last_active":"2024-04-26T12:05:04.782875+0000","last_peered":"2024-04-26T12:05:04.782875+0000","last_clean":"2024-04-26T12:05:04.782875+0000","last_became_active":"2024-04-26T12:05:03.794392+0000","last_became_peered":"2024-04-26T12:05:03.794392+0000","last_unstale":"2024-04-26T12:05:04.782875+0000","last_undegraded":"2024-04-26T12:05:04.782875+0000","last_fullsized":"2024-04-26T12:05:04.782875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:05.327938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203799+0000","last_change":"2024-04-26T12:05:03.429889+0000","last_active":"2024-04-26T12:05:05.203799+0000","last_peered":"2024-04-26T12:05:05.203799+0000","last_clean":"2024-04-26T12:05:05.203799+0000","last_became_active":"2024-04-26T12:05:03.429370+0000","last_became_peered":"2024-04-26T12:05:03.429370+0000","last_unstale":"2024-04-26T12:05:05.203799+0000","last_undegraded":"2024-04-26T12:05:05.203799+0000","last_fullsized":"2024-04-26T12:05:05.203799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:26.791180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204344+0000","last_change":"2024-04-26T12:05:03.788754+0000","last_active":"2024-04-26T12:05:05.204344+0000","last_peered":"2024-04-26T12:05:05.204344+0000","last_clean":"2024-04-26T12:05:05.204344+0000","last_became_active":"2024-04-26T12:05:03.788311+0000","last_became_peered":"2024-04-26T12:05:03.788311+0000","last_unstale":"2024-04-26T12:05:05.204344+0000","last_undegraded":"2024-04-26T12:05:05.204344+0000","last_fullsized":"2024-04-26T12:05:05.204344+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203763+0000","last_change":"2024-04-26T12:05:03.428810+0000","last_active":"2024-04-26T12:05:05.203763+0000","last_peered":"2024-04-26T12:05:05.203763+0000","last_clean":"2024-04-26T12:05:05.203763+0000","last_became_active":"2024-04-26T12:05:03.428191+0000","last_became_peered":"2024-04-26T12:05:03.428191+0000","last_unstale":"2024-04-26T12:05:05.203763+0000","last_undegraded":"2024-04-26T12:05:05.203763+0000","last_fullsized":"2024-04-26T12:05:05.203763+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782302+0000","last_change":"2024-04-26T12:05:03.796880+0000","last_active":"2024-04-26T12:05:04.782302+0000","last_peered":"2024-04-26T12:05:04.782302+0000","last_clean":"2024-04-26T12:05:04.782302+0000","last_became_active":"2024-04-26T12:05:03.796419+0000","last_became_peered":"2024-04-26T12:05:03.796419+0000","last_unstale":"2024-04-26T12:05:04.782302+0000","last_undegraded":"2024-04-26T12:05:04.782302+0000","last_fullsized":"2024-04-26T12:05:04.782302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:58.872589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782079+0000","last_change":"2024-04-26T12:05:03.428084+0000","last_active":"2024-04-26T12:05:04.782079+0000","last_peered":"2024-04-26T12:05:04.782079+0000","last_clean":"2024-04-26T12:05:04.782079+0000","last_became_active":"2024-04-26T12:05:03.426982+0000","last_became_peered":"2024-04-26T12:05:03.426982+0000","last_unstale":"2024-04-26T12:05:04.782079+0000","last_undegraded":"2024-04-26T12:05:04.782079+0000","last_fullsized":"2024-04-26T12:05:04.782079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:19.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782315+0000","last_change":"2024-04-26T12:05:03.793470+0000","last_active":"2024-04-26T12:05:04.782315+0000","last_peered":"2024-04-26T12:05:04.782315+0000","last_clean":"2024-04-26T12:05:04.782315+0000","last_became_active":"2024-04-26T12:05:03.792869+0000","last_became_peered":"2024-04-26T12:05:03.792869+0000","last_unstale":"2024-04-26T12:05:04.782315+0000","last_undegraded":"2024-04-26T12:05:04.782315+0000","last_fullsized":"2024-04-26T12:05:04.782315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:27.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782341+0000","last_change":"2024-04-26T12:05:03.426947+0000","last_active":"2024-04-26T12:05:04.782341+0000","last_peered":"2024-04-26T12:05:04.782341+0000","last_clean":"2024-04-26T12:05:04.782341+0000","last_became_active":"2024-04-26T12:05:03.426211+0000","last_became_peered":"2024-04-26T12:05:03.426211+0000","last_unstale":"2024-04-26T12:05:04.782341+0000","last_undegraded":"2024-04-26T12:05:04.782341+0000","last_fullsized":"2024-04-26T12:05:04.782341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:11.959244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782101+0000","last_change":"2024-04-26T12:05:03.791986+0000","last_active":"2024-04-26T12:05:04.782101+0000","last_peered":"2024-04-26T12:05:04.782101+0000","last_clean":"2024-04-26T12:05:04.782101+0000","last_became_active":"2024-04-26T12:05:03.790823+0000","last_became_peered":"2024-04-26T12:05:03.790823+0000","last_unstale":"2024-04-26T12:05:04.782101+0000","last_undegraded":"2024-04-26T12:05:04.782101+0000","last_fullsized":"2024-04-26T12:05:04.782101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782508+0000","last_change":"2024-04-26T12:05:03.429469+0000","last_active":"2024-04-26T12:05:04.782508+0000","last_peered":"2024-04-26T12:05:04.782508+0000","last_clean":"2024-04-26T12:05:04.782508+0000","last_became_active":"2024-04-26T12:05:03.429015+0000","last_became_peered":"2024-04-26T12:05:03.429015+0000","last_unstale":"2024-04-26T12:05:04.782508+0000","last_undegraded":"2024-04-26T12:05:04.782508+0000","last_fullsized":"2024-04-26T12:05:04.782508+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781940+0000","last_change":"2024-04-26T12:05:03.791929+0000","last_active":"2024-04-26T12:05:04.781940+0000","last_peered":"2024-04-26T12:05:04.781940+0000","last_clean":"2024-04-26T12:05:04.781940+0000","last_became_active":"2024-04-26T12:05:03.791540+0000","last_became_peered":"2024-04-26T12:05:03.791540+0000","last_unstale":"2024-04-26T12:05:04.781940+0000","last_undegraded":"2024-04-26T12:05:04.781940+0000","last_fullsized":"2024-04-26T12:05:04.781940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782585+0000","last_change":"2024-04-26T12:05:03.426210+0000","last_active":"2024-04-26T12:05:04.782585+0000","last_peered":"2024-04-26T12:05:04.782585+0000","last_clean":"2024-04-26T12:05:04.782585+0000","last_became_active":"2024-04-26T12:05:03.425782+0000","last_became_peered":"2024-04-26T12:05:03.425782+0000","last_unstale":"2024-04-26T12:05:04.782585+0000","last_undegraded":"2024-04-26T12:05:04.782585+0000","last_fullsized":"2024-04-26T12:05:04.782585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:26.791180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782217+0000","last_change":"2024-04-26T12:05:03.795264+0000","last_active":"2024-04-26T12:05:04.782217+0000","last_peered":"2024-04-26T12:05:04.782217+0000","last_clean":"2024-04-26T12:05:04.782217+0000","last_became_active":"2024-04-26T12:05:03.794448+0000","last_became_peered":"2024-04-26T12:05:03.794448+0000","last_unstale":"2024-04-26T12:05:04.782217+0000","last_undegraded":"2024-04-26T12:05:04.782217+0000","last_fullsized":"2024-04-26T12:05:04.782217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204547+0000","last_change":"2024-04-26T12:05:03.429872+0000","last_active":"2024-04-26T12:05:05.204547+0000","last_peered":"2024-04-26T12:05:05.204547+0000","last_clean":"2024-04-26T12:05:05.204547+0000","last_became_active":"2024-04-26T12:05:03.429401+0000","last_became_peered":"2024-04-26T12:05:03.429401+0000","last_unstale":"2024-04-26T12:05:05.204547+0000","last_undegraded":"2024-04-26T12:05:05.204547+0000","last_fullsized":"2024-04-26T12:05:05.204547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781880+0000","last_change":"2024-04-26T12:05:03.791827+0000","last_active":"2024-04-26T12:05:04.781880+0000","last_peered":"2024-04-26T12:05:04.781880+0000","last_clean":"2024-04-26T12:05:04.781880+0000","last_became_active":"2024-04-26T12:05:03.791442+0000","last_became_peered":"2024-04-26T12:05:03.791442+0000","last_unstale":"2024-04-26T12:05:04.781880+0000","last_undegraded":"2024-04-26T12:05:04.781880+0000","last_fullsized":"2024-04-26T12:05:04.781880+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204474+0000","last_change":"2024-04-26T12:05:03.430659+0000","last_active":"2024-04-26T12:05:05.204474+0000","last_peered":"2024-04-26T12:05:05.204474+0000","last_clean":"2024-04-26T12:05:05.204474+0000","last_became_active":"2024-04-26T12:05:03.430164+0000","last_became_peered":"2024-04-26T12:05:03.430164+0000","last_unstale":"2024-04-26T12:05:05.204474+0000","last_undegraded":"2024-04-26T12:05:05.204474+0000","last_fullsized":"2024-04-26T12:05:05.204474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":245760,"data_stored":647806,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":647190,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738378,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":55692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:05:23.628 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:05:23.959 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:23.961 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:05:23.969 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-04-26T12:05:22.336138+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":85796,"kb_used_data":632,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283029724,"statfs":{"total":289910292480,"available":289822437376,"internally_reserved":0,"allocated":647168,"data_stored":1350688,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002326"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782815+0000","last_change":"2024-04-26T12:05:03.796038+0000","last_active":"2024-04-26T12:05:04.782815+0000","last_peered":"2024-04-26T12:05:04.782815+0000","last_clean":"2024-04-26T12:05:04.782815+0000","last_became_active":"2024-04-26T12:05:03.795539+0000","last_became_peered":"2024-04-26T12:05:03.795539+0000","last_unstale":"2024-04-26T12:05:04.782815+0000","last_undegraded":"2024-04-26T12:05:04.782815+0000","last_fullsized":"2024-04-26T12:05:04.782815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782477+0000","last_change":"2024-04-26T12:05:03.795955+0000","last_active":"2024-04-26T12:05:04.782477+0000","last_peered":"2024-04-26T12:05:04.782477+0000","last_clean":"2024-04-26T12:05:04.782477+0000","last_became_active":"2024-04-26T12:05:03.795303+0000","last_became_peered":"2024-04-26T12:05:03.795303+0000","last_unstale":"2024-04-26T12:05:04.782477+0000","last_undegraded":"2024-04-26T12:05:04.782477+0000","last_fullsized":"2024-04-26T12:05:04.782477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781972+0000","last_change":"2024-04-26T12:05:03.797557+0000","last_active":"2024-04-26T12:05:04.781972+0000","last_peered":"2024-04-26T12:05:04.781972+0000","last_clean":"2024-04-26T12:05:04.781972+0000","last_became_active":"2024-04-26T12:05:03.797122+0000","last_became_peered":"2024-04-26T12:05:03.797122+0000","last_unstale":"2024-04-26T12:05:04.781972+0000","last_undegraded":"2024-04-26T12:05:04.781972+0000","last_fullsized":"2024-04-26T12:05:04.781972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782137+0000","last_change":"2024-04-26T12:05:03.791234+0000","last_active":"2024-04-26T12:05:04.782137+0000","last_peered":"2024-04-26T12:05:04.782137+0000","last_clean":"2024-04-26T12:05:04.782137+0000","last_became_active":"2024-04-26T12:05:03.790717+0000","last_became_peered":"2024-04-26T12:05:03.790717+0000","last_unstale":"2024-04-26T12:05:04.782137+0000","last_undegraded":"2024-04-26T12:05:04.782137+0000","last_fullsized":"2024-04-26T12:05:04.782137+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:52.358881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782240+0000","last_change":"2024-04-26T12:05:03.792885+0000","last_active":"2024-04-26T12:05:04.782240+0000","last_peered":"2024-04-26T12:05:04.782240+0000","last_clean":"2024-04-26T12:05:04.782240+0000","last_became_active":"2024-04-26T12:05:03.792354+0000","last_became_peered":"2024-04-26T12:05:03.792354+0000","last_unstale":"2024-04-26T12:05:04.782240+0000","last_undegraded":"2024-04-26T12:05:04.782240+0000","last_fullsized":"2024-04-26T12:05:04.782240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781573+0000","last_change":"2024-04-26T12:05:03.791560+0000","last_active":"2024-04-26T12:05:04.781573+0000","last_peered":"2024-04-26T12:05:04.781573+0000","last_clean":"2024-04-26T12:05:04.781573+0000","last_became_active":"2024-04-26T12:05:03.790578+0000","last_became_peered":"2024-04-26T12:05:03.790578+0000","last_unstale":"2024-04-26T12:05:04.781573+0000","last_undegraded":"2024-04-26T12:05:04.781573+0000","last_fullsized":"2024-04-26T12:05:04.781573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781892+0000","last_change":"2024-04-26T12:05:03.791215+0000","last_active":"2024-04-26T12:05:04.781892+0000","last_peered":"2024-04-26T12:05:04.781892+0000","last_clean":"2024-04-26T12:05:04.781892+0000","last_became_active":"2024-04-26T12:05:03.790615+0000","last_became_peered":"2024-04-26T12:05:03.790615+0000","last_unstale":"2024-04-26T12:05:04.781892+0000","last_undegraded":"2024-04-26T12:05:04.781892+0000","last_fullsized":"2024-04-26T12:05:04.781892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:55.388027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781429+0000","last_change":"2024-04-26T12:05:03.785861+0000","last_active":"2024-04-26T12:05:04.781429+0000","last_peered":"2024-04-26T12:05:04.781429+0000","last_clean":"2024-04-26T12:05:04.781429+0000","last_became_active":"2024-04-26T12:05:03.785382+0000","last_became_peered":"2024-04-26T12:05:03.785382+0000","last_unstale":"2024-04-26T12:05:04.781429+0000","last_undegraded":"2024-04-26T12:05:04.781429+0000","last_fullsized":"2024-04-26T12:05:04.781429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:51.870183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204307+0000","last_change":"2024-04-26T12:05:03.797218+0000","last_active":"2024-04-26T12:05:05.204307+0000","last_peered":"2024-04-26T12:05:05.204307+0000","last_clean":"2024-04-26T12:05:05.204307+0000","last_became_active":"2024-04-26T12:05:03.796902+0000","last_became_peered":"2024-04-26T12:05:03.796902+0000","last_unstale":"2024-04-26T12:05:05.204307+0000","last_undegraded":"2024-04-26T12:05:05.204307+0000","last_fullsized":"2024-04-26T12:05:05.204307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:27.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782312+0000","last_change":"2024-04-26T12:05:03.795919+0000","last_active":"2024-04-26T12:05:04.782312+0000","last_peered":"2024-04-26T12:05:04.782312+0000","last_clean":"2024-04-26T12:05:04.782312+0000","last_became_active":"2024-04-26T12:05:03.795268+0000","last_became_peered":"2024-04-26T12:05:03.795268+0000","last_unstale":"2024-04-26T12:05:04.782312+0000","last_undegraded":"2024-04-26T12:05:04.782312+0000","last_fullsized":"2024-04-26T12:05:04.782312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782161+0000","last_change":"2024-04-26T12:05:03.791046+0000","last_active":"2024-04-26T12:05:04.782161+0000","last_peered":"2024-04-26T12:05:04.782161+0000","last_clean":"2024-04-26T12:05:04.782161+0000","last_became_active":"2024-04-26T12:05:03.790662+0000","last_became_peered":"2024-04-26T12:05:03.790662+0000","last_unstale":"2024-04-26T12:05:04.782161+0000","last_undegraded":"2024-04-26T12:05:04.782161+0000","last_fullsized":"2024-04-26T12:05:04.782161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:35.458663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782010+0000","last_change":"2024-04-26T12:05:03.795250+0000","last_active":"2024-04-26T12:05:04.782010+0000","last_peered":"2024-04-26T12:05:04.782010+0000","last_clean":"2024-04-26T12:05:04.782010+0000","last_became_active":"2024-04-26T12:05:03.794632+0000","last_became_peered":"2024-04-26T12:05:03.794632+0000","last_unstale":"2024-04-26T12:05:04.782010+0000","last_undegraded":"2024-04-26T12:05:04.782010+0000","last_fullsized":"2024-04-26T12:05:04.782010+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:59.873501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782077+0000","last_change":"2024-04-26T12:05:03.794090+0000","last_active":"2024-04-26T12:05:04.782077+0000","last_peered":"2024-04-26T12:05:04.782077+0000","last_clean":"2024-04-26T12:05:04.782077+0000","last_became_active":"2024-04-26T12:05:03.793681+0000","last_became_peered":"2024-04-26T12:05:03.793681+0000","last_unstale":"2024-04-26T12:05:04.782077+0000","last_undegraded":"2024-04-26T12:05:04.782077+0000","last_fullsized":"2024-04-26T12:05:04.782077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781643+0000","last_change":"2024-04-26T12:05:03.795539+0000","last_active":"2024-04-26T12:05:04.781643+0000","last_peered":"2024-04-26T12:05:04.781643+0000","last_clean":"2024-04-26T12:05:04.781643+0000","last_became_active":"2024-04-26T12:05:03.795281+0000","last_became_peered":"2024-04-26T12:05:03.795281+0000","last_unstale":"2024-04-26T12:05:04.781643+0000","last_undegraded":"2024-04-26T12:05:04.781643+0000","last_fullsized":"2024-04-26T12:05:04.781643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:27.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781992+0000","last_change":"2024-04-26T12:05:03.793487+0000","last_active":"2024-04-26T12:05:04.781992+0000","last_peered":"2024-04-26T12:05:04.781992+0000","last_clean":"2024-04-26T12:05:04.781992+0000","last_became_active":"2024-04-26T12:05:03.793242+0000","last_became_peered":"2024-04-26T12:05:03.793242+0000","last_unstale":"2024-04-26T12:05:04.781992+0000","last_undegraded":"2024-04-26T12:05:04.781992+0000","last_fullsized":"2024-04-26T12:05:04.781992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:53.331006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781585+0000","last_change":"2024-04-26T12:05:03.786360+0000","last_active":"2024-04-26T12:05:04.781585+0000","last_peered":"2024-04-26T12:05:04.781585+0000","last_clean":"2024-04-26T12:05:04.781585+0000","last_became_active":"2024-04-26T12:05:03.785991+0000","last_became_peered":"2024-04-26T12:05:03.785991+0000","last_unstale":"2024-04-26T12:05:04.781585+0000","last_undegraded":"2024-04-26T12:05:04.781585+0000","last_fullsized":"2024-04-26T12:05:04.781585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:17.702068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204616+0000","last_change":"2024-04-26T12:05:03.797390+0000","last_active":"2024-04-26T12:05:05.204616+0000","last_peered":"2024-04-26T12:05:05.204616+0000","last_clean":"2024-04-26T12:05:05.204616+0000","last_became_active":"2024-04-26T12:05:03.796969+0000","last_became_peered":"2024-04-26T12:05:03.796969+0000","last_unstale":"2024-04-26T12:05:05.204616+0000","last_undegraded":"2024-04-26T12:05:05.204616+0000","last_fullsized":"2024-04-26T12:05:05.204616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:57.461628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782513+0000","last_change":"2024-04-26T12:05:03.794013+0000","last_active":"2024-04-26T12:05:04.782513+0000","last_peered":"2024-04-26T12:05:04.782513+0000","last_clean":"2024-04-26T12:05:04.782513+0000","last_became_active":"2024-04-26T12:05:03.793512+0000","last_became_peered":"2024-04-26T12:05:03.793512+0000","last_unstale":"2024-04-26T12:05:04.782513+0000","last_undegraded":"2024-04-26T12:05:04.782513+0000","last_fullsized":"2024-04-26T12:05:04.782513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204175+0000","last_change":"2024-04-26T12:05:03.798195+0000","last_active":"2024-04-26T12:05:05.204175+0000","last_peered":"2024-04-26T12:05:05.204175+0000","last_clean":"2024-04-26T12:05:05.204175+0000","last_became_active":"2024-04-26T12:05:03.797935+0000","last_became_peered":"2024-04-26T12:05:03.797935+0000","last_unstale":"2024-04-26T12:05:05.204175+0000","last_undegraded":"2024-04-26T12:05:05.204175+0000","last_fullsized":"2024-04-26T12:05:05.204175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:58.872589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782280+0000","last_change":"2024-04-26T12:05:03.792219+0000","last_active":"2024-04-26T12:05:04.782280+0000","last_peered":"2024-04-26T12:05:04.782280+0000","last_clean":"2024-04-26T12:05:04.782280+0000","last_became_active":"2024-04-26T12:05:03.791061+0000","last_became_peered":"2024-04-26T12:05:03.791061+0000","last_unstale":"2024-04-26T12:05:04.782280+0000","last_undegraded":"2024-04-26T12:05:04.782280+0000","last_fullsized":"2024-04-26T12:05:04.782280+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782402+0000","last_change":"2024-04-26T12:05:03.792073+0000","last_active":"2024-04-26T12:05:04.782402+0000","last_peered":"2024-04-26T12:05:04.782402+0000","last_clean":"2024-04-26T12:05:04.782402+0000","last_became_active":"2024-04-26T12:05:03.791693+0000","last_became_peered":"2024-04-26T12:05:03.791693+0000","last_unstale":"2024-04-26T12:05:04.782402+0000","last_undegraded":"2024-04-26T12:05:04.782402+0000","last_fullsized":"2024-04-26T12:05:04.782402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781784+0000","last_change":"2024-04-26T12:05:03.794027+0000","last_active":"2024-04-26T12:05:04.781784+0000","last_peered":"2024-04-26T12:05:04.781784+0000","last_clean":"2024-04-26T12:05:04.781784+0000","last_became_active":"2024-04-26T12:05:03.793660+0000","last_became_peered":"2024-04-26T12:05:03.793660+0000","last_unstale":"2024-04-26T12:05:04.781784+0000","last_undegraded":"2024-04-26T12:05:04.781784+0000","last_fullsized":"2024-04-26T12:05:04.781784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:53.331006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203565+0000","last_change":"2024-04-26T12:05:03.788658+0000","last_active":"2024-04-26T12:05:05.203565+0000","last_peered":"2024-04-26T12:05:05.203565+0000","last_clean":"2024-04-26T12:05:05.203565+0000","last_became_active":"2024-04-26T12:05:03.788050+0000","last_became_peered":"2024-04-26T12:05:03.788050+0000","last_unstale":"2024-04-26T12:05:05.203565+0000","last_undegraded":"2024-04-26T12:05:05.203565+0000","last_fullsized":"2024-04-26T12:05:05.203565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781648+0000","last_change":"2024-04-26T12:05:03.793554+0000","last_active":"2024-04-26T12:05:04.781648+0000","last_peered":"2024-04-26T12:05:04.781648+0000","last_clean":"2024-04-26T12:05:04.781648+0000","last_became_active":"2024-04-26T12:05:03.792588+0000","last_became_peered":"2024-04-26T12:05:03.792588+0000","last_unstale":"2024-04-26T12:05:04.781648+0000","last_undegraded":"2024-04-26T12:05:04.781648+0000","last_fullsized":"2024-04-26T12:05:04.781648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782854+0000","last_change":"2024-04-26T12:05:03.795510+0000","last_active":"2024-04-26T12:05:04.782854+0000","last_peered":"2024-04-26T12:05:04.782854+0000","last_clean":"2024-04-26T12:05:04.782854+0000","last_became_active":"2024-04-26T12:05:03.794639+0000","last_became_peered":"2024-04-26T12:05:03.794639+0000","last_unstale":"2024-04-26T12:05:04.782854+0000","last_undegraded":"2024-04-26T12:05:04.782854+0000","last_fullsized":"2024-04-26T12:05:04.782854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:57.461628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204465+0000","last_change":"2024-04-26T12:05:03.787909+0000","last_active":"2024-04-26T12:05:05.204465+0000","last_peered":"2024-04-26T12:05:05.204465+0000","last_clean":"2024-04-26T12:05:05.204465+0000","last_became_active":"2024-04-26T12:05:03.787562+0000","last_became_peered":"2024-04-26T12:05:03.787562+0000","last_unstale":"2024-04-26T12:05:05.204465+0000","last_undegraded":"2024-04-26T12:05:05.204465+0000","last_fullsized":"2024-04-26T12:05:05.204465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782352+0000","last_change":"2024-04-26T12:05:03.796836+0000","last_active":"2024-04-26T12:05:04.782352+0000","last_peered":"2024-04-26T12:05:04.782352+0000","last_clean":"2024-04-26T12:05:04.782352+0000","last_became_active":"2024-04-26T12:05:03.796524+0000","last_became_peered":"2024-04-26T12:05:03.796524+0000","last_unstale":"2024-04-26T12:05:04.782352+0000","last_undegraded":"2024-04-26T12:05:04.782352+0000","last_fullsized":"2024-04-26T12:05:04.782352+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782420+0000","last_change":"2024-04-26T12:05:03.792400+0000","last_active":"2024-04-26T12:05:04.782420+0000","last_peered":"2024-04-26T12:05:04.782420+0000","last_clean":"2024-04-26T12:05:04.782420+0000","last_became_active":"2024-04-26T12:05:03.792079+0000","last_became_peered":"2024-04-26T12:05:03.792079+0000","last_unstale":"2024-04-26T12:05:04.782420+0000","last_undegraded":"2024-04-26T12:05:04.782420+0000","last_fullsized":"2024-04-26T12:05:04.782420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:24.434355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204245+0000","last_change":"2024-04-26T12:05:03.797172+0000","last_active":"2024-04-26T12:05:05.204245+0000","last_peered":"2024-04-26T12:05:05.204245+0000","last_clean":"2024-04-26T12:05:05.204245+0000","last_became_active":"2024-04-26T12:05:03.796879+0000","last_became_peered":"2024-04-26T12:05:03.796879+0000","last_unstale":"2024-04-26T12:05:05.204245+0000","last_undegraded":"2024-04-26T12:05:05.204245+0000","last_fullsized":"2024-04-26T12:05:05.204245+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:24.434355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781949+0000","last_change":"2024-04-26T12:05:03.793269+0000","last_active":"2024-04-26T12:05:04.781949+0000","last_peered":"2024-04-26T12:05:04.781949+0000","last_clean":"2024-04-26T12:05:04.781949+0000","last_became_active":"2024-04-26T12:05:03.792698+0000","last_became_peered":"2024-04-26T12:05:03.792698+0000","last_unstale":"2024-04-26T12:05:04.781949+0000","last_undegraded":"2024-04-26T12:05:04.781949+0000","last_fullsized":"2024-04-26T12:05:04.781949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:58.579861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203630+0000","last_change":"2024-04-26T12:05:03.796871+0000","last_active":"2024-04-26T12:05:05.203630+0000","last_peered":"2024-04-26T12:05:05.203630+0000","last_clean":"2024-04-26T12:05:05.203630+0000","last_became_active":"2024-04-26T12:05:03.796546+0000","last_became_peered":"2024-04-26T12:05:03.796546+0000","last_unstale":"2024-04-26T12:05:05.203630+0000","last_undegraded":"2024-04-26T12:05:05.203630+0000","last_fullsized":"2024-04-26T12:05:05.203630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:53.331006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781676+0000","last_change":"2024-04-26T12:05:03.791605+0000","last_active":"2024-04-26T12:05:04.781676+0000","last_peered":"2024-04-26T12:05:04.781676+0000","last_clean":"2024-04-26T12:05:04.781676+0000","last_became_active":"2024-04-26T12:05:03.791251+0000","last_became_peered":"2024-04-26T12:05:03.791251+0000","last_unstale":"2024-04-26T12:05:04.781676+0000","last_undegraded":"2024-04-26T12:05:04.781676+0000","last_fullsized":"2024-04-26T12:05:04.781676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:27.239868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782339+0000","last_change":"2024-04-26T12:05:03.793791+0000","last_active":"2024-04-26T12:05:04.782339+0000","last_peered":"2024-04-26T12:05:04.782339+0000","last_clean":"2024-04-26T12:05:04.782339+0000","last_became_active":"2024-04-26T12:05:03.793468+0000","last_became_peered":"2024-04-26T12:05:03.793468+0000","last_unstale":"2024-04-26T12:05:04.782339+0000","last_undegraded":"2024-04-26T12:05:04.782339+0000","last_fullsized":"2024-04-26T12:05:04.782339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:01.289069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782440+0000","last_change":"2024-04-26T12:05:03.430021+0000","last_active":"2024-04-26T12:05:04.782440+0000","last_peered":"2024-04-26T12:05:04.782440+0000","last_clean":"2024-04-26T12:05:04.782440+0000","last_became_active":"2024-04-26T12:05:03.429695+0000","last_became_peered":"2024-04-26T12:05:03.429695+0000","last_unstale":"2024-04-26T12:05:04.782440+0000","last_undegraded":"2024-04-26T12:05:04.782440+0000","last_fullsized":"2024-04-26T12:05:04.782440+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782505+0000","last_change":"2024-04-26T12:05:03.796189+0000","last_active":"2024-04-26T12:05:04.782505+0000","last_peered":"2024-04-26T12:05:04.782505+0000","last_clean":"2024-04-26T12:05:04.782505+0000","last_became_active":"2024-04-26T12:05:03.795438+0000","last_became_peered":"2024-04-26T12:05:03.795438+0000","last_unstale":"2024-04-26T12:05:04.782505+0000","last_undegraded":"2024-04-26T12:05:04.782505+0000","last_fullsized":"2024-04-26T12:05:04.782505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:22.814807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203969+0000","last_change":"2024-04-26T12:05:03.428605+0000","last_active":"2024-04-26T12:05:05.203969+0000","last_peered":"2024-04-26T12:05:05.203969+0000","last_clean":"2024-04-26T12:05:05.203969+0000","last_became_active":"2024-04-26T12:05:03.428098+0000","last_became_peered":"2024-04-26T12:05:03.428098+0000","last_unstale":"2024-04-26T12:05:05.203969+0000","last_undegraded":"2024-04-26T12:05:05.203969+0000","last_fullsized":"2024-04-26T12:05:05.203969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204596+0000","last_change":"2024-04-26T12:05:03.788568+0000","last_active":"2024-04-26T12:05:05.204596+0000","last_peered":"2024-04-26T12:05:05.204596+0000","last_clean":"2024-04-26T12:05:05.204596+0000","last_became_active":"2024-04-26T12:05:03.788039+0000","last_became_peered":"2024-04-26T12:05:03.788039+0000","last_unstale":"2024-04-26T12:05:05.204596+0000","last_undegraded":"2024-04-26T12:05:05.204596+0000","last_fullsized":"2024-04-26T12:05:05.204596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781927+0000","last_change":"2024-04-26T12:05:03.422773+0000","last_active":"2024-04-26T12:05:04.781927+0000","last_peered":"2024-04-26T12:05:04.781927+0000","last_clean":"2024-04-26T12:05:04.781927+0000","last_became_active":"2024-04-26T12:05:03.422412+0000","last_became_peered":"2024-04-26T12:05:03.422412+0000","last_unstale":"2024-04-26T12:05:04.781927+0000","last_undegraded":"2024-04-26T12:05:04.781927+0000","last_fullsized":"2024-04-26T12:05:04.781927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:06.758253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204353+0000","last_change":"2024-04-26T12:05:03.788505+0000","last_active":"2024-04-26T12:05:05.204353+0000","last_peered":"2024-04-26T12:05:05.204353+0000","last_clean":"2024-04-26T12:05:05.204353+0000","last_became_active":"2024-04-26T12:05:03.788184+0000","last_became_peered":"2024-04-26T12:05:03.788184+0000","last_unstale":"2024-04-26T12:05:05.204353+0000","last_undegraded":"2024-04-26T12:05:05.204353+0000","last_fullsized":"2024-04-26T12:05:05.204353+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781717+0000","last_change":"2024-04-26T12:05:03.425495+0000","last_active":"2024-04-26T12:05:04.781717+0000","last_peered":"2024-04-26T12:05:04.781717+0000","last_clean":"2024-04-26T12:05:04.781717+0000","last_became_active":"2024-04-26T12:05:03.424963+0000","last_became_peered":"2024-04-26T12:05:03.424963+0000","last_unstale":"2024-04-26T12:05:04.781717+0000","last_undegraded":"2024-04-26T12:05:04.781717+0000","last_fullsized":"2024-04-26T12:05:04.781717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:55.660897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782532+0000","last_change":"2024-04-26T12:05:03.426142+0000","last_active":"2024-04-26T12:05:04.782532+0000","last_peered":"2024-04-26T12:05:04.782532+0000","last_clean":"2024-04-26T12:05:04.782532+0000","last_became_active":"2024-04-26T12:05:03.425699+0000","last_became_peered":"2024-04-26T12:05:03.425699+0000","last_unstale":"2024-04-26T12:05:04.782532+0000","last_undegraded":"2024-04-26T12:05:04.782532+0000","last_fullsized":"2024-04-26T12:05:04.782532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:41.279426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781647+0000","last_change":"2024-04-26T12:05:03.794778+0000","last_active":"2024-04-26T12:05:04.781647+0000","last_peered":"2024-04-26T12:05:04.781647+0000","last_clean":"2024-04-26T12:05:04.781647+0000","last_became_active":"2024-04-26T12:05:03.794192+0000","last_became_peered":"2024-04-26T12:05:03.794192+0000","last_unstale":"2024-04-26T12:05:04.781647+0000","last_undegraded":"2024-04-26T12:05:04.781647+0000","last_fullsized":"2024-04-26T12:05:04.781647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:16.372597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782585+0000","last_change":"2024-04-26T12:05:03.426530+0000","last_active":"2024-04-26T12:05:04.782585+0000","last_peered":"2024-04-26T12:05:04.782585+0000","last_clean":"2024-04-26T12:05:04.782585+0000","last_became_active":"2024-04-26T12:05:03.426113+0000","last_became_peered":"2024-04-26T12:05:03.426113+0000","last_unstale":"2024-04-26T12:05:04.782585+0000","last_undegraded":"2024-04-26T12:05:04.782585+0000","last_fullsized":"2024-04-26T12:05:04.782585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:21.029311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781810+0000","last_change":"2024-04-26T12:05:03.793000+0000","last_active":"2024-04-26T12:05:04.781810+0000","last_peered":"2024-04-26T12:05:04.781810+0000","last_clean":"2024-04-26T12:05:04.781810+0000","last_became_active":"2024-04-26T12:05:03.792480+0000","last_became_peered":"2024-04-26T12:05:03.792480+0000","last_unstale":"2024-04-26T12:05:04.781810+0000","last_undegraded":"2024-04-26T12:05:04.781810+0000","last_fullsized":"2024-04-26T12:05:04.781810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782682+0000","last_change":"2024-04-26T12:05:03.426039+0000","last_active":"2024-04-26T12:05:04.782682+0000","last_peered":"2024-04-26T12:05:04.782682+0000","last_clean":"2024-04-26T12:05:04.782682+0000","last_became_active":"2024-04-26T12:05:03.425666+0000","last_became_peered":"2024-04-26T12:05:03.425666+0000","last_unstale":"2024-04-26T12:05:04.782682+0000","last_undegraded":"2024-04-26T12:05:04.782682+0000","last_fullsized":"2024-04-26T12:05:04.782682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:00.998013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781698+0000","last_change":"2024-04-26T12:05:03.791809+0000","last_active":"2024-04-26T12:05:04.781698+0000","last_peered":"2024-04-26T12:05:04.781698+0000","last_clean":"2024-04-26T12:05:04.781698+0000","last_became_active":"2024-04-26T12:05:03.791272+0000","last_became_peered":"2024-04-26T12:05:03.791272+0000","last_unstale":"2024-04-26T12:05:04.781698+0000","last_undegraded":"2024-04-26T12:05:04.781698+0000","last_fullsized":"2024-04-26T12:05:04.781698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782611+0000","last_change":"2024-04-26T12:05:03.430224+0000","last_active":"2024-04-26T12:05:04.782611+0000","last_peered":"2024-04-26T12:05:04.782611+0000","last_clean":"2024-04-26T12:05:04.782611+0000","last_became_active":"2024-04-26T12:05:03.429291+0000","last_became_peered":"2024-04-26T12:05:03.429291+0000","last_unstale":"2024-04-26T12:05:04.782611+0000","last_undegraded":"2024-04-26T12:05:04.782611+0000","last_fullsized":"2024-04-26T12:05:04.782611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204057+0000","last_change":"2024-04-26T12:05:03.788174+0000","last_active":"2024-04-26T12:05:05.204057+0000","last_peered":"2024-04-26T12:05:05.204057+0000","last_clean":"2024-04-26T12:05:05.204057+0000","last_became_active":"2024-04-26T12:05:03.787772+0000","last_became_peered":"2024-04-26T12:05:03.787772+0000","last_unstale":"2024-04-26T12:05:05.204057+0000","last_undegraded":"2024-04-26T12:05:05.204057+0000","last_fullsized":"2024-04-26T12:05:05.204057+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204340+0000","last_change":"2024-04-26T12:05:03.431162+0000","last_active":"2024-04-26T12:05:05.204340+0000","last_peered":"2024-04-26T12:05:05.204340+0000","last_clean":"2024-04-26T12:05:05.204340+0000","last_became_active":"2024-04-26T12:05:03.430855+0000","last_became_peered":"2024-04-26T12:05:03.430855+0000","last_unstale":"2024-04-26T12:05:05.204340+0000","last_undegraded":"2024-04-26T12:05:05.204340+0000","last_fullsized":"2024-04-26T12:05:05.204340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:41.279426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782386+0000","last_change":"2024-04-26T12:05:03.792357+0000","last_active":"2024-04-26T12:05:04.782386+0000","last_peered":"2024-04-26T12:05:04.782386+0000","last_clean":"2024-04-26T12:05:04.782386+0000","last_became_active":"2024-04-26T12:05:03.792119+0000","last_became_peered":"2024-04-26T12:05:03.792119+0000","last_unstale":"2024-04-26T12:05:04.782386+0000","last_undegraded":"2024-04-26T12:05:04.782386+0000","last_fullsized":"2024-04-26T12:05:04.782386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781879+0000","last_change":"2024-04-26T12:05:03.429811+0000","last_active":"2024-04-26T12:05:04.781879+0000","last_peered":"2024-04-26T12:05:04.781879+0000","last_clean":"2024-04-26T12:05:04.781879+0000","last_became_active":"2024-04-26T12:05:03.429469+0000","last_became_peered":"2024-04-26T12:05:03.429469+0000","last_unstale":"2024-04-26T12:05:04.781879+0000","last_undegraded":"2024-04-26T12:05:04.781879+0000","last_fullsized":"2024-04-26T12:05:04.781879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782424+0000","last_change":"2024-04-26T12:05:03.795646+0000","last_active":"2024-04-26T12:05:04.782424+0000","last_peered":"2024-04-26T12:05:04.782424+0000","last_clean":"2024-04-26T12:05:04.782424+0000","last_became_active":"2024-04-26T12:05:03.795354+0000","last_became_peered":"2024-04-26T12:05:03.795354+0000","last_unstale":"2024-04-26T12:05:04.782424+0000","last_undegraded":"2024-04-26T12:05:04.782424+0000","last_fullsized":"2024-04-26T12:05:04.782424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:22.814807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782060+0000","last_change":"2024-04-26T12:05:03.427908+0000","last_active":"2024-04-26T12:05:04.782060+0000","last_peered":"2024-04-26T12:05:04.782060+0000","last_clean":"2024-04-26T12:05:04.782060+0000","last_became_active":"2024-04-26T12:05:03.426718+0000","last_became_peered":"2024-04-26T12:05:03.426718+0000","last_unstale":"2024-04-26T12:05:04.782060+0000","last_undegraded":"2024-04-26T12:05:04.782060+0000","last_fullsized":"2024-04-26T12:05:04.782060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:40.538058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782365+0000","last_change":"2024-04-26T12:05:03.797113+0000","last_active":"2024-04-26T12:05:04.782365+0000","last_peered":"2024-04-26T12:05:04.782365+0000","last_clean":"2024-04-26T12:05:04.782365+0000","last_became_active":"2024-04-26T12:05:03.796739+0000","last_became_peered":"2024-04-26T12:05:03.796739+0000","last_unstale":"2024-04-26T12:05:04.782365+0000","last_undegraded":"2024-04-26T12:05:04.782365+0000","last_fullsized":"2024-04-26T12:05:04.782365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:59.873501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781849+0000","last_change":"2024-04-26T12:05:03.428262+0000","last_active":"2024-04-26T12:05:04.781849+0000","last_peered":"2024-04-26T12:05:04.781849+0000","last_clean":"2024-04-26T12:05:04.781849+0000","last_became_active":"2024-04-26T12:05:03.426588+0000","last_became_peered":"2024-04-26T12:05:03.426588+0000","last_unstale":"2024-04-26T12:05:04.781849+0000","last_undegraded":"2024-04-26T12:05:04.781849+0000","last_fullsized":"2024-04-26T12:05:04.781849+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:42.674797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204403+0000","last_change":"2024-04-26T12:05:03.797633+0000","last_active":"2024-04-26T12:05:05.204403+0000","last_peered":"2024-04-26T12:05:05.204403+0000","last_clean":"2024-04-26T12:05:05.204403+0000","last_became_active":"2024-04-26T12:05:03.797338+0000","last_became_peered":"2024-04-26T12:05:03.797338+0000","last_unstale":"2024-04-26T12:05:05.204403+0000","last_undegraded":"2024-04-26T12:05:05.204403+0000","last_fullsized":"2024-04-26T12:05:05.204403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:22.814807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.782901+0000","last_change":"2024-04-26T12:04:53.388840+0000","last_active":"2024-04-26T12:05:03.782901+0000","last_peered":"2024-04-26T12:05:03.782901+0000","last_clean":"2024-04-26T12:05:03.782901+0000","last_became_active":"2024-04-26T12:04:53.388568+0000","last_became_peered":"2024-04-26T12:04:53.388568+0000","last_unstale":"2024-04-26T12:05:03.782901+0000","last_undegraded":"2024-04-26T12:05:03.782901+0000","last_fullsized":"2024-04-26T12:05:03.782901+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_clean_scrub_stamp":"2024-04-26T12:04:52.376986+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:04.970330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.781157+0000","last_change":"2024-04-26T12:04:59.403711+0000","last_active":"2024-04-26T12:05:03.781157+0000","last_peered":"2024-04-26T12:05:03.781157+0000","last_clean":"2024-04-26T12:05:03.781157+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:05:03.781157+0000","last_undegraded":"2024-04-26T12:05:03.781157+0000","last_fullsized":"2024-04-26T12:05:03.781157+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:45.779614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204217+0000","last_change":"2024-04-26T12:05:03.429674+0000","last_active":"2024-04-26T12:05:05.204217+0000","last_peered":"2024-04-26T12:05:05.204217+0000","last_clean":"2024-04-26T12:05:05.204217+0000","last_became_active":"2024-04-26T12:05:03.429266+0000","last_became_peered":"2024-04-26T12:05:03.429266+0000","last_unstale":"2024-04-26T12:05:05.204217+0000","last_undegraded":"2024-04-26T12:05:05.204217+0000","last_fullsized":"2024-04-26T12:05:05.204217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:55.660897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782655+0000","last_change":"2024-04-26T12:05:03.797640+0000","last_active":"2024-04-26T12:05:04.782655+0000","last_peered":"2024-04-26T12:05:04.782655+0000","last_clean":"2024-04-26T12:05:04.782655+0000","last_became_active":"2024-04-26T12:05:03.797302+0000","last_became_peered":"2024-04-26T12:05:03.797302+0000","last_unstale":"2024-04-26T12:05:04.782655+0000","last_undegraded":"2024-04-26T12:05:04.782655+0000","last_fullsized":"2024-04-26T12:05:04.782655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:16.372597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.781404+0000","last_change":"2024-04-26T12:04:59.405437+0000","last_active":"2024-04-26T12:05:03.781404+0000","last_peered":"2024-04-26T12:05:03.781404+0000","last_clean":"2024-04-26T12:05:03.781404+0000","last_became_active":"2024-04-26T12:04:59.405193+0000","last_became_peered":"2024-04-26T12:04:59.405193+0000","last_unstale":"2024-04-26T12:05:03.781404+0000","last_undegraded":"2024-04-26T12:05:03.781404+0000","last_fullsized":"2024-04-26T12:05:03.781404+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:20.977569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203835+0000","last_change":"2024-04-26T12:05:03.428547+0000","last_active":"2024-04-26T12:05:05.203835+0000","last_peered":"2024-04-26T12:05:05.203835+0000","last_clean":"2024-04-26T12:05:05.203835+0000","last_became_active":"2024-04-26T12:05:03.427985+0000","last_became_peered":"2024-04-26T12:05:03.427985+0000","last_unstale":"2024-04-26T12:05:05.203835+0000","last_undegraded":"2024-04-26T12:05:05.203835+0000","last_fullsized":"2024-04-26T12:05:05.203835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:19.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782574+0000","last_change":"2024-04-26T12:05:03.793800+0000","last_active":"2024-04-26T12:05:04.782574+0000","last_peered":"2024-04-26T12:05:04.782574+0000","last_clean":"2024-04-26T12:05:04.782574+0000","last_became_active":"2024-04-26T12:05:03.792932+0000","last_became_peered":"2024-04-26T12:05:03.792932+0000","last_unstale":"2024-04-26T12:05:04.782574+0000","last_undegraded":"2024-04-26T12:05:04.782574+0000","last_fullsized":"2024-04-26T12:05:04.782574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.780048+0000","last_change":"2024-04-26T12:04:59.405617+0000","last_active":"2024-04-26T12:05:03.780048+0000","last_peered":"2024-04-26T12:05:03.780048+0000","last_clean":"2024-04-26T12:05:03.780048+0000","last_became_active":"2024-04-26T12:04:59.405328+0000","last_became_peered":"2024-04-26T12:04:59.405328+0000","last_unstale":"2024-04-26T12:05:03.780048+0000","last_undegraded":"2024-04-26T12:05:03.780048+0000","last_fullsized":"2024-04-26T12:05:03.780048+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:39.317039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782519+0000","last_change":"2024-04-26T12:05:03.424576+0000","last_active":"2024-04-26T12:05:04.782519+0000","last_peered":"2024-04-26T12:05:04.782519+0000","last_clean":"2024-04-26T12:05:04.782519+0000","last_became_active":"2024-04-26T12:05:03.424289+0000","last_became_peered":"2024-04-26T12:05:03.424289+0000","last_unstale":"2024-04-26T12:05:04.782519+0000","last_undegraded":"2024-04-26T12:05:04.782519+0000","last_fullsized":"2024-04-26T12:05:04.782519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:10.759772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204460+0000","last_change":"2024-04-26T12:05:03.798238+0000","last_active":"2024-04-26T12:05:05.204460+0000","last_peered":"2024-04-26T12:05:05.204460+0000","last_clean":"2024-04-26T12:05:05.204460+0000","last_became_active":"2024-04-26T12:05:03.797924+0000","last_became_peered":"2024-04-26T12:05:03.797924+0000","last_unstale":"2024-04-26T12:05:05.204460+0000","last_undegraded":"2024-04-26T12:05:05.204460+0000","last_fullsized":"2024-04-26T12:05:05.204460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:01.289069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.781616+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:05:03.781616+0000","last_peered":"2024-04-26T12:05:03.781616+0000","last_clean":"2024-04-26T12:05:03.781616+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:05:03.781616+0000","last_undegraded":"2024-04-26T12:05:03.781616+0000","last_fullsized":"2024-04-26T12:05:03.781616+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:12.939539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782535+0000","last_change":"2024-04-26T12:05:03.430140+0000","last_active":"2024-04-26T12:05:04.782535+0000","last_peered":"2024-04-26T12:05:04.782535+0000","last_clean":"2024-04-26T12:05:04.782535+0000","last_became_active":"2024-04-26T12:05:03.429838+0000","last_became_peered":"2024-04-26T12:05:03.429838+0000","last_unstale":"2024-04-26T12:05:04.782535+0000","last_undegraded":"2024-04-26T12:05:04.782535+0000","last_fullsized":"2024-04-26T12:05:04.782535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204416+0000","last_change":"2024-04-26T12:05:03.796731+0000","last_active":"2024-04-26T12:05:05.204416+0000","last_peered":"2024-04-26T12:05:05.204416+0000","last_clean":"2024-04-26T12:05:05.204416+0000","last_became_active":"2024-04-26T12:05:03.796432+0000","last_became_peered":"2024-04-26T12:05:03.796432+0000","last_unstale":"2024-04-26T12:05:05.204416+0000","last_undegraded":"2024-04-26T12:05:05.204416+0000","last_fullsized":"2024-04-26T12:05:05.204416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:58.579861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782707+0000","last_change":"2024-04-26T12:05:03.429673+0000","last_active":"2024-04-26T12:05:04.782707+0000","last_peered":"2024-04-26T12:05:04.782707+0000","last_clean":"2024-04-26T12:05:04.782707+0000","last_became_active":"2024-04-26T12:05:03.429146+0000","last_became_peered":"2024-04-26T12:05:03.429146+0000","last_unstale":"2024-04-26T12:05:04.782707+0000","last_undegraded":"2024-04-26T12:05:04.782707+0000","last_fullsized":"2024-04-26T12:05:04.782707+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.779759+0000","last_change":"2024-04-26T12:04:59.405766+0000","last_active":"2024-04-26T12:05:03.779759+0000","last_peered":"2024-04-26T12:05:03.779759+0000","last_clean":"2024-04-26T12:05:03.779759+0000","last_became_active":"2024-04-26T12:04:59.405406+0000","last_became_peered":"2024-04-26T12:04:59.405406+0000","last_unstale":"2024-04-26T12:05:03.779759+0000","last_undegraded":"2024-04-26T12:05:03.779759+0000","last_fullsized":"2024-04-26T12:05:03.779759+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:13.860871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782006+0000","last_change":"2024-04-26T12:05:03.792534+0000","last_active":"2024-04-26T12:05:04.782006+0000","last_peered":"2024-04-26T12:05:04.782006+0000","last_clean":"2024-04-26T12:05:04.782006+0000","last_became_active":"2024-04-26T12:05:03.792160+0000","last_became_peered":"2024-04-26T12:05:03.792160+0000","last_unstale":"2024-04-26T12:05:04.782006+0000","last_undegraded":"2024-04-26T12:05:04.782006+0000","last_fullsized":"2024-04-26T12:05:04.782006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:41.930005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204484+0000","last_change":"2024-04-26T12:05:03.429642+0000","last_active":"2024-04-26T12:05:05.204484+0000","last_peered":"2024-04-26T12:05:05.204484+0000","last_clean":"2024-04-26T12:05:05.204484+0000","last_became_active":"2024-04-26T12:05:03.429197+0000","last_became_peered":"2024-04-26T12:05:03.429197+0000","last_unstale":"2024-04-26T12:05:05.204484+0000","last_undegraded":"2024-04-26T12:05:05.204484+0000","last_fullsized":"2024-04-26T12:05:05.204484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:40.538058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.788889+0000","last_change":"2024-04-26T12:04:59.405294+0000","last_active":"2024-04-26T12:05:03.788889+0000","last_peered":"2024-04-26T12:05:03.788889+0000","last_clean":"2024-04-26T12:05:03.788889+0000","last_became_active":"2024-04-26T12:04:59.405044+0000","last_became_peered":"2024-04-26T12:04:59.405044+0000","last_unstale":"2024-04-26T12:05:03.788889+0000","last_undegraded":"2024-04-26T12:05:03.788889+0000","last_fullsized":"2024-04-26T12:05:03.788889+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:47.042833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782238+0000","last_change":"2024-04-26T12:05:03.793408+0000","last_active":"2024-04-26T12:05:04.782238+0000","last_peered":"2024-04-26T12:05:04.782238+0000","last_clean":"2024-04-26T12:05:04.782238+0000","last_became_active":"2024-04-26T12:05:03.793019+0000","last_became_peered":"2024-04-26T12:05:03.793019+0000","last_unstale":"2024-04-26T12:05:04.782238+0000","last_undegraded":"2024-04-26T12:05:04.782238+0000","last_fullsized":"2024-04-26T12:05:04.782238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:25.062114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204650+0000","last_change":"2024-04-26T12:05:03.430008+0000","last_active":"2024-04-26T12:05:05.204650+0000","last_peered":"2024-04-26T12:05:05.204650+0000","last_clean":"2024-04-26T12:05:05.204650+0000","last_became_active":"2024-04-26T12:05:03.429362+0000","last_became_peered":"2024-04-26T12:05:03.429362+0000","last_unstale":"2024-04-26T12:05:05.204650+0000","last_undegraded":"2024-04-26T12:05:05.204650+0000","last_fullsized":"2024-04-26T12:05:05.204650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.780359+0000","last_change":"2024-04-26T12:04:59.405667+0000","last_active":"2024-04-26T12:05:03.780359+0000","last_peered":"2024-04-26T12:05:03.780359+0000","last_clean":"2024-04-26T12:05:03.780359+0000","last_became_active":"2024-04-26T12:04:59.405328+0000","last_became_peered":"2024-04-26T12:04:59.405328+0000","last_unstale":"2024-04-26T12:05:03.780359+0000","last_undegraded":"2024-04-26T12:05:03.780359+0000","last_fullsized":"2024-04-26T12:05:03.780359+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:20.977569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203759+0000","last_change":"2024-04-26T12:05:03.789623+0000","last_active":"2024-04-26T12:05:05.203759+0000","last_peered":"2024-04-26T12:05:05.203759+0000","last_clean":"2024-04-26T12:05:05.203759+0000","last_became_active":"2024-04-26T12:05:03.789390+0000","last_became_peered":"2024-04-26T12:05:03.789390+0000","last_unstale":"2024-04-26T12:05:05.203759+0000","last_undegraded":"2024-04-26T12:05:05.203759+0000","last_fullsized":"2024-04-26T12:05:05.203759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348623+0000","last_change":"2024-04-26T12:05:03.429222+0000","last_active":"2024-04-26T12:05:06.348623+0000","last_peered":"2024-04-26T12:05:06.348623+0000","last_clean":"2024-04-26T12:05:06.348623+0000","last_became_active":"2024-04-26T12:05:03.428803+0000","last_became_peered":"2024-04-26T12:05:03.428803+0000","last_unstale":"2024-04-26T12:05:06.348623+0000","last_undegraded":"2024-04-26T12:05:06.348623+0000","last_fullsized":"2024-04-26T12:05:06.348623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:31.305644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:05:03.779178+0000","last_change":"2024-04-26T12:04:59.408078+0000","last_active":"2024-04-26T12:05:03.779178+0000","last_peered":"2024-04-26T12:05:03.779178+0000","last_clean":"2024-04-26T12:05:03.779178+0000","last_became_active":"2024-04-26T12:04:59.407804+0000","last_became_peered":"2024-04-26T12:04:59.407804+0000","last_unstale":"2024-04-26T12:05:03.779178+0000","last_undegraded":"2024-04-26T12:05:03.779178+0000","last_fullsized":"2024-04-26T12:05:03.779178+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:56.449518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782185+0000","last_change":"2024-04-26T12:05:03.792547+0000","last_active":"2024-04-26T12:05:04.782185+0000","last_peered":"2024-04-26T12:05:04.782185+0000","last_clean":"2024-04-26T12:05:04.782185+0000","last_became_active":"2024-04-26T12:05:03.792078+0000","last_became_peered":"2024-04-26T12:05:03.792078+0000","last_unstale":"2024-04-26T12:05:04.782185+0000","last_undegraded":"2024-04-26T12:05:04.782185+0000","last_fullsized":"2024-04-26T12:05:04.782185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:45.563923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782159+0000","last_change":"2024-04-26T12:05:03.795500+0000","last_active":"2024-04-26T12:05:04.782159+0000","last_peered":"2024-04-26T12:05:04.782159+0000","last_clean":"2024-04-26T12:05:04.782159+0000","last_became_active":"2024-04-26T12:05:03.795173+0000","last_became_peered":"2024-04-26T12:05:03.795173+0000","last_unstale":"2024-04-26T12:05:04.782159+0000","last_undegraded":"2024-04-26T12:05:04.782159+0000","last_fullsized":"2024-04-26T12:05:04.782159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:01.289069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782556+0000","last_change":"2024-04-26T12:05:03.426261+0000","last_active":"2024-04-26T12:05:04.782556+0000","last_peered":"2024-04-26T12:05:04.782556+0000","last_clean":"2024-04-26T12:05:04.782556+0000","last_became_active":"2024-04-26T12:05:03.425897+0000","last_became_peered":"2024-04-26T12:05:03.425897+0000","last_unstale":"2024-04-26T12:05:04.782556+0000","last_undegraded":"2024-04-26T12:05:04.782556+0000","last_fullsized":"2024-04-26T12:05:04.782556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:31.305644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203851+0000","last_change":"2024-04-26T12:05:03.795443+0000","last_active":"2024-04-26T12:05:05.203851+0000","last_peered":"2024-04-26T12:05:05.203851+0000","last_clean":"2024-04-26T12:05:05.203851+0000","last_became_active":"2024-04-26T12:05:03.795190+0000","last_became_peered":"2024-04-26T12:05:03.795190+0000","last_unstale":"2024-04-26T12:05:05.203851+0000","last_undegraded":"2024-04-26T12:05:05.203851+0000","last_fullsized":"2024-04-26T12:05:05.203851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:59.873501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782685+0000","last_change":"2024-04-26T12:05:03.425106+0000","last_active":"2024-04-26T12:05:04.782685+0000","last_peered":"2024-04-26T12:05:04.782685+0000","last_clean":"2024-04-26T12:05:04.782685+0000","last_became_active":"2024-04-26T12:05:03.424753+0000","last_became_peered":"2024-04-26T12:05:03.424753+0000","last_unstale":"2024-04-26T12:05:04.782685+0000","last_undegraded":"2024-04-26T12:05:04.782685+0000","last_fullsized":"2024-04-26T12:05:04.782685+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:10.741652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782591+0000","last_change":"2024-04-26T12:05:03.429257+0000","last_active":"2024-04-26T12:05:04.782591+0000","last_peered":"2024-04-26T12:05:04.782591+0000","last_clean":"2024-04-26T12:05:04.782591+0000","last_became_active":"2024-04-26T12:05:03.428921+0000","last_became_peered":"2024-04-26T12:05:03.428921+0000","last_unstale":"2024-04-26T12:05:04.782591+0000","last_undegraded":"2024-04-26T12:05:04.782591+0000","last_fullsized":"2024-04-26T12:05:04.782591+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:49.774845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203669+0000","last_change":"2024-04-26T12:05:03.788141+0000","last_active":"2024-04-26T12:05:05.203669+0000","last_peered":"2024-04-26T12:05:05.203669+0000","last_clean":"2024-04-26T12:05:05.203669+0000","last_became_active":"2024-04-26T12:05:03.787533+0000","last_became_peered":"2024-04-26T12:05:03.787533+0000","last_unstale":"2024-04-26T12:05:05.203669+0000","last_undegraded":"2024-04-26T12:05:05.203669+0000","last_fullsized":"2024-04-26T12:05:05.203669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204552+0000","last_change":"2024-04-26T12:05:03.428971+0000","last_active":"2024-04-26T12:05:05.204552+0000","last_peered":"2024-04-26T12:05:05.204552+0000","last_clean":"2024-04-26T12:05:05.204552+0000","last_became_active":"2024-04-26T12:05:03.428445+0000","last_became_peered":"2024-04-26T12:05:03.428445+0000","last_unstale":"2024-04-26T12:05:05.204552+0000","last_undegraded":"2024-04-26T12:05:05.204552+0000","last_fullsized":"2024-04-26T12:05:05.204552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203649+0000","last_change":"2024-04-26T12:05:03.795318+0000","last_active":"2024-04-26T12:05:05.203649+0000","last_peered":"2024-04-26T12:05:05.203649+0000","last_clean":"2024-04-26T12:05:05.203649+0000","last_became_active":"2024-04-26T12:05:03.795053+0000","last_became_peered":"2024-04-26T12:05:03.795053+0000","last_unstale":"2024-04-26T12:05:05.203649+0000","last_undegraded":"2024-04-26T12:05:05.203649+0000","last_fullsized":"2024-04-26T12:05:05.203649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:16.372597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782875+0000","last_change":"2024-04-26T12:05:03.795109+0000","last_active":"2024-04-26T12:05:04.782875+0000","last_peered":"2024-04-26T12:05:04.782875+0000","last_clean":"2024-04-26T12:05:04.782875+0000","last_became_active":"2024-04-26T12:05:03.794392+0000","last_became_peered":"2024-04-26T12:05:03.794392+0000","last_unstale":"2024-04-26T12:05:04.782875+0000","last_undegraded":"2024-04-26T12:05:04.782875+0000","last_fullsized":"2024-04-26T12:05:04.782875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:05.327938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203799+0000","last_change":"2024-04-26T12:05:03.429889+0000","last_active":"2024-04-26T12:05:05.203799+0000","last_peered":"2024-04-26T12:05:05.203799+0000","last_clean":"2024-04-26T12:05:05.203799+0000","last_became_active":"2024-04-26T12:05:03.429370+0000","last_became_peered":"2024-04-26T12:05:03.429370+0000","last_unstale":"2024-04-26T12:05:05.203799+0000","last_undegraded":"2024-04-26T12:05:05.203799+0000","last_fullsized":"2024-04-26T12:05:05.203799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:26.791180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204344+0000","last_change":"2024-04-26T12:05:03.788754+0000","last_active":"2024-04-26T12:05:05.204344+0000","last_peered":"2024-04-26T12:05:05.204344+0000","last_clean":"2024-04-26T12:05:05.204344+0000","last_became_active":"2024-04-26T12:05:03.788311+0000","last_became_peered":"2024-04-26T12:05:03.788311+0000","last_unstale":"2024-04-26T12:05:05.204344+0000","last_undegraded":"2024-04-26T12:05:05.204344+0000","last_fullsized":"2024-04-26T12:05:05.204344+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203763+0000","last_change":"2024-04-26T12:05:03.428810+0000","last_active":"2024-04-26T12:05:05.203763+0000","last_peered":"2024-04-26T12:05:05.203763+0000","last_clean":"2024-04-26T12:05:05.203763+0000","last_became_active":"2024-04-26T12:05:03.428191+0000","last_became_peered":"2024-04-26T12:05:03.428191+0000","last_unstale":"2024-04-26T12:05:05.203763+0000","last_undegraded":"2024-04-26T12:05:05.203763+0000","last_fullsized":"2024-04-26T12:05:05.203763+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782302+0000","last_change":"2024-04-26T12:05:03.796880+0000","last_active":"2024-04-26T12:05:04.782302+0000","last_peered":"2024-04-26T12:05:04.782302+0000","last_clean":"2024-04-26T12:05:04.782302+0000","last_became_active":"2024-04-26T12:05:03.796419+0000","last_became_peered":"2024-04-26T12:05:03.796419+0000","last_unstale":"2024-04-26T12:05:04.782302+0000","last_undegraded":"2024-04-26T12:05:04.782302+0000","last_fullsized":"2024-04-26T12:05:04.782302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:58.872589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782079+0000","last_change":"2024-04-26T12:05:03.428084+0000","last_active":"2024-04-26T12:05:04.782079+0000","last_peered":"2024-04-26T12:05:04.782079+0000","last_clean":"2024-04-26T12:05:04.782079+0000","last_became_active":"2024-04-26T12:05:03.426982+0000","last_became_peered":"2024-04-26T12:05:03.426982+0000","last_unstale":"2024-04-26T12:05:04.782079+0000","last_undegraded":"2024-04-26T12:05:04.782079+0000","last_fullsized":"2024-04-26T12:05:04.782079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:19.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782315+0000","last_change":"2024-04-26T12:05:03.793470+0000","last_active":"2024-04-26T12:05:04.782315+0000","last_peered":"2024-04-26T12:05:04.782315+0000","last_clean":"2024-04-26T12:05:04.782315+0000","last_became_active":"2024-04-26T12:05:03.792869+0000","last_became_peered":"2024-04-26T12:05:03.792869+0000","last_unstale":"2024-04-26T12:05:04.782315+0000","last_undegraded":"2024-04-26T12:05:04.782315+0000","last_fullsized":"2024-04-26T12:05:04.782315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:27.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782341+0000","last_change":"2024-04-26T12:05:03.426947+0000","last_active":"2024-04-26T12:05:04.782341+0000","last_peered":"2024-04-26T12:05:04.782341+0000","last_clean":"2024-04-26T12:05:04.782341+0000","last_became_active":"2024-04-26T12:05:03.426211+0000","last_became_peered":"2024-04-26T12:05:03.426211+0000","last_unstale":"2024-04-26T12:05:04.782341+0000","last_undegraded":"2024-04-26T12:05:04.782341+0000","last_fullsized":"2024-04-26T12:05:04.782341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:11.959244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782101+0000","last_change":"2024-04-26T12:05:03.791986+0000","last_active":"2024-04-26T12:05:04.782101+0000","last_peered":"2024-04-26T12:05:04.782101+0000","last_clean":"2024-04-26T12:05:04.782101+0000","last_became_active":"2024-04-26T12:05:03.790823+0000","last_became_peered":"2024-04-26T12:05:03.790823+0000","last_unstale":"2024-04-26T12:05:04.782101+0000","last_undegraded":"2024-04-26T12:05:04.782101+0000","last_fullsized":"2024-04-26T12:05:04.782101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782508+0000","last_change":"2024-04-26T12:05:03.429469+0000","last_active":"2024-04-26T12:05:04.782508+0000","last_peered":"2024-04-26T12:05:04.782508+0000","last_clean":"2024-04-26T12:05:04.782508+0000","last_became_active":"2024-04-26T12:05:03.429015+0000","last_became_peered":"2024-04-26T12:05:03.429015+0000","last_unstale":"2024-04-26T12:05:04.782508+0000","last_undegraded":"2024-04-26T12:05:04.782508+0000","last_fullsized":"2024-04-26T12:05:04.782508+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781940+0000","last_change":"2024-04-26T12:05:03.791929+0000","last_active":"2024-04-26T12:05:04.781940+0000","last_peered":"2024-04-26T12:05:04.781940+0000","last_clean":"2024-04-26T12:05:04.781940+0000","last_became_active":"2024-04-26T12:05:03.791540+0000","last_became_peered":"2024-04-26T12:05:03.791540+0000","last_unstale":"2024-04-26T12:05:04.781940+0000","last_undegraded":"2024-04-26T12:05:04.781940+0000","last_fullsized":"2024-04-26T12:05:04.781940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782585+0000","last_change":"2024-04-26T12:05:03.426210+0000","last_active":"2024-04-26T12:05:04.782585+0000","last_peered":"2024-04-26T12:05:04.782585+0000","last_clean":"2024-04-26T12:05:04.782585+0000","last_became_active":"2024-04-26T12:05:03.425782+0000","last_became_peered":"2024-04-26T12:05:03.425782+0000","last_unstale":"2024-04-26T12:05:04.782585+0000","last_undegraded":"2024-04-26T12:05:04.782585+0000","last_fullsized":"2024-04-26T12:05:04.782585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:26.791180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782217+0000","last_change":"2024-04-26T12:05:03.795264+0000","last_active":"2024-04-26T12:05:04.782217+0000","last_peered":"2024-04-26T12:05:04.782217+0000","last_clean":"2024-04-26T12:05:04.782217+0000","last_became_active":"2024-04-26T12:05:03.794448+0000","last_became_peered":"2024-04-26T12:05:03.794448+0000","last_unstale":"2024-04-26T12:05:04.782217+0000","last_undegraded":"2024-04-26T12:05:04.782217+0000","last_fullsized":"2024-04-26T12:05:04.782217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204547+0000","last_change":"2024-04-26T12:05:03.429872+0000","last_active":"2024-04-26T12:05:05.204547+0000","last_peered":"2024-04-26T12:05:05.204547+0000","last_clean":"2024-04-26T12:05:05.204547+0000","last_became_active":"2024-04-26T12:05:03.429401+0000","last_became_peered":"2024-04-26T12:05:03.429401+0000","last_unstale":"2024-04-26T12:05:05.204547+0000","last_undegraded":"2024-04-26T12:05:05.204547+0000","last_fullsized":"2024-04-26T12:05:05.204547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781880+0000","last_change":"2024-04-26T12:05:03.791827+0000","last_active":"2024-04-26T12:05:04.781880+0000","last_peered":"2024-04-26T12:05:04.781880+0000","last_clean":"2024-04-26T12:05:04.781880+0000","last_became_active":"2024-04-26T12:05:03.791442+0000","last_became_peered":"2024-04-26T12:05:03.791442+0000","last_unstale":"2024-04-26T12:05:04.781880+0000","last_undegraded":"2024-04-26T12:05:04.781880+0000","last_fullsized":"2024-04-26T12:05:04.781880+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204474+0000","last_change":"2024-04-26T12:05:03.430659+0000","last_active":"2024-04-26T12:05:05.204474+0000","last_peered":"2024-04-26T12:05:05.204474+0000","last_clean":"2024-04-26T12:05:05.204474+0000","last_became_active":"2024-04-26T12:05:03.430164+0000","last_became_peered":"2024-04-26T12:05:03.430164+0000","last_unstale":"2024-04-26T12:05:05.204474+0000","last_undegraded":"2024-04-26T12:05:05.204474+0000","last_fullsized":"2024-04-26T12:05:05.204474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":245760,"data_stored":647806,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":647190,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738378,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":55692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:05:23.974 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T12:05:23.974 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-26T12:05:24.299 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 18 2024-04-26T12:05:24.299 INFO:teuthology.orchestra.run.smithi052.stdout:fsid 5bc300ae-e948-4ce3-81bb-5abae8c06799 2024-04-26T12:05:24.299 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-04-26T12:04:41.919527+0000 2024-04-26T12:05:24.299 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-04-26T12:05:04.776193+0000 2024-04-26T12:05:24.299 INFO:teuthology.orchestra.run.smithi052.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-26T12:05:24.299 INFO:teuthology.orchestra.run.smithi052.stdout:crush_version 4 2024-04-26T12:05:24.299 INFO:teuthology.orchestra.run.smithi052.stdout:full_ratio 0.95 2024-04-26T12:05:24.299 INFO:teuthology.orchestra.run.smithi052.stdout:backfillfull_ratio 0.9 2024-04-26T12:05:24.299 INFO:teuthology.orchestra.run.smithi052.stdout:nearfull_ratio 0.85 2024-04-26T12:05:24.299 INFO:teuthology.orchestra.run.smithi052.stdout:require_min_compat_client luminous 2024-04-26T12:05:24.299 INFO:teuthology.orchestra.run.smithi052.stdout:min_compat_client jewel 2024-04-26T12:05:24.300 INFO:teuthology.orchestra.run.smithi052.stdout:require_osd_release reef 2024-04-26T12:05:24.300 INFO:teuthology.orchestra.run.smithi052.stdout:stretch_mode_enabled false 2024-04-26T12:05:24.300 INFO:teuthology.orchestra.run.smithi052.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-04-26T12:05:24.300 INFO:teuthology.orchestra.run.smithi052.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 14 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2024-04-26T12:05:24.300 INFO:teuthology.orchestra.run.smithi052.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-04-26T12:05:24.300 INFO:teuthology.orchestra.run.smithi052.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-04-26T12:05:24.300 INFO:teuthology.orchestra.run.smithi052.stdout:max_osd 3 2024-04-26T12:05:24.300 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.143:6800/28597,v1:172.21.15.143:6801/28597] [v2:172.21.15.143:6802/28597,v1:172.21.15.143:6803/28597] exists,up 638cfa85-e921-4403-9bcb-a7f4653cc3b2 2024-04-26T12:05:24.300 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6800/28560,v1:172.21.15.154:6801/28560] [v2:172.21.15.154:6802/28560,v1:172.21.15.154:6803/28560] exists,up 2abc8d1e-ad72-4643-ad1e-3566e5113c44 2024-04-26T12:05:24.300 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.164:6800/28709,v1:172.21.15.164:6801/28709] [v2:172.21.15.164:6802/28709,v1:172.21.15.164:6803/28709] exists,up d2ebc562-cb9b-4089-a19b-1788b70b57dc 2024-04-26T12:05:24.311 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.143:6800/28597,v1:172.21.15.143:6801/28597] [v2:172.21.15.143:6802/28597,v1:172.21.15.143:6803/28597] exists,up 638cfa85-e921-4403-9bcb-a7f4653cc3b2', 'osd.1 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6800/28560,v1:172.21.15.154:6801/28560] [v2:172.21.15.154:6802/28560,v1:172.21.15.154:6803/28560] exists,up 2abc8d1e-ad72-4643-ad1e-3566e5113c44', 'osd.2 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.164:6800/28709,v1:172.21.15.164:6801/28709] [v2:172.21.15.164:6802/28709,v1:172.21.15.164:6803/28709] exists,up d2ebc562-cb9b-4089-a19b-1788b70b57dc'] 2024-04-26T12:05:24.312 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-26T12:05:24.413 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-26T12:05:24.413 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "mon.a", 2024-04-26T12:05:24.413 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster": "ceph", 2024-04-26T12:05:24.413 INFO:teuthology.orchestra.run.smithi052.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-26T12:05:24.413 INFO:teuthology.orchestra.run.smithi052.stdout: "admin_socket_mode": "", 2024-04-26T12:05:24.413 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-26T12:05:24.413 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_client_required": "cephx, none", 2024-04-26T12:05:24.413 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_cluster_required": "cephx", 2024-04-26T12:05:24.413 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_debug": "true", 2024-04-26T12:05:24.413 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-26T12:05:24.413 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-26T12:05:24.414 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_service_required": "cephx", 2024-04-26T12:05:24.414 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-26T12:05:24.414 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_supported": "cephx", 2024-04-26T12:05:24.414 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_aio": "true", 2024-04-26T12:05:24.414 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-26T12:05:24.414 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_aio_poll_ms": "250", 2024-04-26T12:05:24.414 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_aio_reap_max": "16", 2024-04-26T12:05:24.414 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_async_discard": "false", 2024-04-26T12:05:24.414 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_block_size": "4096", 2024-04-26T12:05:24.414 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_debug_aio": "false", 2024-04-26T12:05:24.414 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-26T12:05:24.414 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-26T12:05:24.414 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_debug_inflight_ios": "false", 2024-04-26T12:05:24.414 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_enable_discard": "false", 2024-04-26T12:05:24.415 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_flock_retry": "3", 2024-04-26T12:05:24.415 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-26T12:05:24.415 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_inject_crash": "0", 2024-04-26T12:05:24.415 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-26T12:05:24.415 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_ioring": "false", 2024-04-26T12:05:24.415 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_ioring_hipri": "false", 2024-04-26T12:05:24.415 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-26T12:05:24.415 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-26T12:05:24.415 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-26T12:05:24.415 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-26T12:05:24.415 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_type": "", 2024-04-26T12:05:24.415 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_alloc_size": "1048576", 2024-04-26T12:05:24.415 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_allocator": "hybrid", 2024-04-26T12:05:24.415 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_buffered_io": "true", 2024-04-26T12:05:24.416 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_check_for_zeros": "false", 2024-04-26T12:05:24.416 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-26T12:05:24.416 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-26T12:05:24.416 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_compact_log_sync": "false", 2024-04-26T12:05:24.416 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-26T12:05:24.416 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-26T12:05:24.416 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-26T12:05:24.416 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-26T12:05:24.416 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_max_log_runway": "4194304", 2024-04-26T12:05:24.416 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_max_prefetch": "1048576", 2024-04-26T12:05:24.416 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_min_flush_size": "524288", 2024-04-26T12:05:24.416 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_min_log_runway": "1048576", 2024-04-26T12:05:24.416 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_replay_recovery": "false", 2024-04-26T12:05:24.416 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-26T12:05:24.417 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-26T12:05:24.417 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_sync_write": "false", 2024-04-26T12:05:24.417 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-26T12:05:24.417 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-26T12:05:24.417 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-26T12:05:24.417 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_allocation_from_file": "true", 2024-04-26T12:05:24.417 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_allocator": "hybrid", 2024-04-26T12:05:24.417 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-26T12:05:24.417 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-26T12:05:24.417 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-26T12:05:24.417 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-26T12:05:24.417 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-26T12:05:24.417 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-26T12:05:24.418 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-26T12:05:24.418 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_create": "true", 2024-04-26T12:05:24.418 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_db_create": "false", 2024-04-26T12:05:24.418 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_db_path": "", 2024-04-26T12:05:24.418 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_db_size": "0", 2024-04-26T12:05:24.418 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_path": "", 2024-04-26T12:05:24.418 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_preallocate_file": "false", 2024-04-26T12:05:24.418 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_size": "107374182400", 2024-04-26T12:05:24.418 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_wal_create": "false", 2024-04-26T12:05:24.418 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_wal_path": "", 2024-04-26T12:05:24.418 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_wal_size": "100663296", 2024-04-26T12:05:24.418 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bluefs": "true", 2024-04-26T12:05:24.418 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-26T12:05:24.418 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-26T12:05:24.419 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-26T12:05:24.419 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-26T12:05:24.419 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T12:05:24.419 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T12:05:24.419 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-26T12:05:24.419 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T12:05:24.419 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_autotune": "true", 2024-04-26T12:05:24.419 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-26T12:05:24.419 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-26T12:05:24.419 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-26T12:05:24.419 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-26T12:05:24.419 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_size": "0", 2024-04-26T12:05:24.419 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-26T12:05:24.419 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-26T12:05:24.419 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-26T12:05:24.420 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-26T12:05:24.420 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_type": "2q", 2024-04-26T12:05:24.420 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-26T12:05:24.420 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_clone_cow": "true", 2024-04-26T12:05:24.420 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-26T12:05:24.420 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-26T12:05:24.420 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-26T12:05:24.420 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-26T12:05:24.420 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-26T12:05:24.420 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-26T12:05:24.420 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-26T12:05:24.420 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_mode": "none", 2024-04-26T12:05:24.420 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-26T12:05:24.420 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_csum_type": "crc32c", 2024-04-26T12:05:24.420 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-26T12:05:24.421 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_freelist": "false", 2024-04-26T12:05:24.421 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-26T12:05:24.421 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-26T12:05:24.421 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_inject_bug21040": "false", 2024-04-26T12:05:24.421 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-26T12:05:24.421 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-26T12:05:24.421 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-26T12:05:24.421 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-26T12:05:24.421 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-26T12:05:24.421 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-26T12:05:24.421 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-26T12:05:24.421 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-26T12:05:24.421 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-26T12:05:24.421 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-26T12:05:24.422 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-26T12:05:24.422 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_small_allocations": "0", 2024-04-26T12:05:24.422 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-26T12:05:24.422 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_default_buffered_read": "true", 2024-04-26T12:05:24.422 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_default_buffered_write": "false", 2024-04-26T12:05:24.422 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-26T12:05:24.422 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-26T12:05:24.422 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-26T12:05:24.422 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-26T12:05:24.422 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-26T12:05:24.422 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-26T12:05:24.422 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-26T12:05:24.422 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-26T12:05:24.422 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fail_eio": "false", 2024-04-26T12:05:24.422 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-26T12:05:24.423 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-26T12:05:24.423 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-26T12:05:24.423 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-26T12:05:24.423 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-26T12:05:24.423 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-26T12:05:24.423 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_on_mount": "false", 2024-04-26T12:05:24.423 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-26T12:05:24.423 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_on_umount": "false", 2024-04-26T12:05:24.423 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-26T12:05:24.423 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-26T12:05:24.423 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-26T12:05:24.423 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-26T12:05:24.423 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-26T12:05:24.423 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-26T12:05:24.424 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-26T12:05:24.424 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-26T12:05:24.424 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_ignore_data_csum": "false", 2024-04-26T12:05:24.424 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-26T12:05:24.424 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-26T12:05:24.424 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-26T12:05:24.424 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-26T12:05:24.424 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_log_op_age": "5.000000", 2024-04-26T12:05:24.424 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_max_alloc_size": "0", 2024-04-26T12:05:24.424 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_max_blob_size": "0", 2024-04-26T12:05:24.424 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-26T12:05:24.424 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-26T12:05:24.424 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-26T12:05:24.424 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_max_deferred_txc": "32", 2024-04-26T12:05:24.424 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_min_alloc_size": "0", 2024-04-26T12:05:24.425 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-26T12:05:24.425 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-26T12:05:24.425 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_nid_prealloc": "1024", 2024-04-26T12:05:24.425 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-26T12:05:24.425 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-26T12:05:24.425 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-26T12:05:24.425 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-26T12:05:24.425 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_retry_disk_reads": "3", 2024-04-26T12:05:24.425 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_rocksdb_cf": "true", 2024-04-26T12:05:24.425 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-26T12:05:24.425 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-26T12:05:24.425 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-26T12:05:24.425 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-26T12:05:24.425 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-26T12:05:24.426 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-26T12:05:24.426 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_spdk_mem": "512", 2024-04-26T12:05:24.426 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-26T12:05:24.426 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-26T12:05:24.426 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-26T12:05:24.426 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-26T12:05:24.426 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-26T12:05:24.426 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-26T12:05:24.426 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-26T12:05:24.426 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_tracing": "false", 2024-04-26T12:05:24.426 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-26T12:05:24.426 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-26T12:05:24.426 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-26T12:05:24.426 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-26T12:05:24.427 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-26T12:05:24.427 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-26T12:05:24.427 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-26T12:05:24.427 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-26T12:05:24.427 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-26T12:05:24.427 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_zero_block_detection": "false", 2024-04-26T12:05:24.427 INFO:teuthology.orchestra.run.smithi052.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-26T12:05:24.427 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-26T12:05:24.427 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-26T12:05:24.428 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-26T12:05:24.428 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-26T12:05:24.428 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-26T12:05:24.428 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-26T12:05:24.428 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-26T12:05:24.428 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-26T12:05:24.428 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-26T12:05:24.428 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-26T12:05:24.428 INFO:teuthology.orchestra.run.smithi052.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-26T12:05:24.428 INFO:teuthology.orchestra.run.smithi052.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-26T12:05:24.428 INFO:teuthology.orchestra.run.smithi052.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-26T12:05:24.428 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_cluster_require_signatures": "false", 2024-04-26T12:05:24.429 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_cluster_require_version": "2", 2024-04-26T12:05:24.429 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_require_signatures": "false", 2024-04-26T12:05:24.429 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_require_version": "2", 2024-04-26T12:05:24.429 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_service_require_signatures": "false", 2024-04-26T12:05:24.429 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_service_require_version": "2", 2024-04-26T12:05:24.429 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_sign_messages": "true", 2024-04-26T12:05:24.429 INFO:teuthology.orchestra.run.smithi052.stdout: "chdir": "", 2024-04-26T12:05:24.429 INFO:teuthology.orchestra.run.smithi052.stdout: "client_acl_type": "", 2024-04-26T12:05:24.429 INFO:teuthology.orchestra.run.smithi052.stdout: "client_asio_thread_count": "2", 2024-04-26T12:05:24.429 INFO:teuthology.orchestra.run.smithi052.stdout: "client_cache_mid": "0.750000", 2024-04-26T12:05:24.429 INFO:teuthology.orchestra.run.smithi052.stdout: "client_cache_size": "16384", 2024-04-26T12:05:24.429 INFO:teuthology.orchestra.run.smithi052.stdout: "client_caps_release_delay": "5", 2024-04-26T12:05:24.429 INFO:teuthology.orchestra.run.smithi052.stdout: "client_check_pool_perm": "true", 2024-04-26T12:05:24.429 INFO:teuthology.orchestra.run.smithi052.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-26T12:05:24.430 INFO:teuthology.orchestra.run.smithi052.stdout: "client_debug_force_sync_read": "false", 2024-04-26T12:05:24.430 INFO:teuthology.orchestra.run.smithi052.stdout: "client_debug_getattr_caps": "false", 2024-04-26T12:05:24.430 INFO:teuthology.orchestra.run.smithi052.stdout: "client_debug_inject_tick_delay": "0", 2024-04-26T12:05:24.430 INFO:teuthology.orchestra.run.smithi052.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-26T12:05:24.430 INFO:teuthology.orchestra.run.smithi052.stdout: "client_die_on_failed_remount": "false", 2024-04-26T12:05:24.430 INFO:teuthology.orchestra.run.smithi052.stdout: "client_dirsize_rbytes": "true", 2024-04-26T12:05:24.430 INFO:teuthology.orchestra.run.smithi052.stdout: "client_force_lazyio": "false", 2024-04-26T12:05:24.430 INFO:teuthology.orchestra.run.smithi052.stdout: "client_fs": "", 2024-04-26T12:05:24.430 INFO:teuthology.orchestra.run.smithi052.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-26T12:05:24.430 INFO:teuthology.orchestra.run.smithi052.stdout: "client_inject_release_failure": "false", 2024-04-26T12:05:24.430 INFO:teuthology.orchestra.run.smithi052.stdout: "client_max_inline_size": "4096", 2024-04-26T12:05:24.430 INFO:teuthology.orchestra.run.smithi052.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-26T12:05:24.430 INFO:teuthology.orchestra.run.smithi052.stdout: "client_mds_namespace": "", 2024-04-26T12:05:24.430 INFO:teuthology.orchestra.run.smithi052.stdout: "client_metadata": "", 2024-04-26T12:05:24.431 INFO:teuthology.orchestra.run.smithi052.stdout: "client_mount_gid": "-1", 2024-04-26T12:05:24.431 INFO:teuthology.orchestra.run.smithi052.stdout: "client_mount_timeout": "300", 2024-04-26T12:05:24.431 INFO:teuthology.orchestra.run.smithi052.stdout: "client_mount_uid": "-1", 2024-04-26T12:05:24.431 INFO:teuthology.orchestra.run.smithi052.stdout: "client_mountpoint": "/", 2024-04-26T12:05:24.431 INFO:teuthology.orchestra.run.smithi052.stdout: "client_notify_timeout": "10", 2024-04-26T12:05:24.431 INFO:teuthology.orchestra.run.smithi052.stdout: "client_oc": "true", 2024-04-26T12:05:24.431 INFO:teuthology.orchestra.run.smithi052.stdout: "client_oc_max_dirty": "104857600", 2024-04-26T12:05:24.431 INFO:teuthology.orchestra.run.smithi052.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-26T12:05:24.431 INFO:teuthology.orchestra.run.smithi052.stdout: "client_oc_max_objects": "1000", 2024-04-26T12:05:24.431 INFO:teuthology.orchestra.run.smithi052.stdout: "client_oc_size": "209715200", 2024-04-26T12:05:24.431 INFO:teuthology.orchestra.run.smithi052.stdout: "client_oc_target_dirty": "8388608", 2024-04-26T12:05:24.431 INFO:teuthology.orchestra.run.smithi052.stdout: "client_permissions": "true", 2024-04-26T12:05:24.431 INFO:teuthology.orchestra.run.smithi052.stdout: "client_quota": "true", 2024-04-26T12:05:24.431 INFO:teuthology.orchestra.run.smithi052.stdout: "client_quota_df": "true", 2024-04-26T12:05:24.431 INFO:teuthology.orchestra.run.smithi052.stdout: "client_readahead_max_bytes": "0", 2024-04-26T12:05:24.432 INFO:teuthology.orchestra.run.smithi052.stdout: "client_readahead_max_periods": "4", 2024-04-26T12:05:24.432 INFO:teuthology.orchestra.run.smithi052.stdout: "client_readahead_min": "131072", 2024-04-26T12:05:24.432 INFO:teuthology.orchestra.run.smithi052.stdout: "client_reconnect_stale": "false", 2024-04-26T12:05:24.432 INFO:teuthology.orchestra.run.smithi052.stdout: "client_shutdown_timeout": "30", 2024-04-26T12:05:24.432 INFO:teuthology.orchestra.run.smithi052.stdout: "client_snapdir": ".snap", 2024-04-26T12:05:24.432 INFO:teuthology.orchestra.run.smithi052.stdout: "client_tick_interval": "1", 2024-04-26T12:05:24.432 INFO:teuthology.orchestra.run.smithi052.stdout: "client_trace": "", 2024-04-26T12:05:24.432 INFO:teuthology.orchestra.run.smithi052.stdout: "client_try_dentry_invalidate": "false", 2024-04-26T12:05:24.432 INFO:teuthology.orchestra.run.smithi052.stdout: "client_use_faked_inos": "false", 2024-04-26T12:05:24.432 INFO:teuthology.orchestra.run.smithi052.stdout: "client_use_random_mds": "false", 2024-04-26T12:05:24.432 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_graylog": "false", 2024-04-26T12:05:24.432 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-26T12:05:24.432 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_graylog_port": "12201", 2024-04-26T12:05:24.432 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_monitors": "default=true", 2024-04-26T12:05:24.432 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_syslog": "false", 2024-04-26T12:05:24.433 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-26T12:05:24.433 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_syslog_level": "info", 2024-04-26T12:05:24.433 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "-", 2024-04-26T12:05:24.433 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_network": "", 2024-04-26T12:05:24.433 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_network_interface": "", 2024-04-26T12:05:24.433 INFO:teuthology.orchestra.run.smithi052.stdout: "compressor_zlib_isal": "false", 2024-04-26T12:05:24.433 INFO:teuthology.orchestra.run.smithi052.stdout: "compressor_zlib_level": "5", 2024-04-26T12:05:24.433 INFO:teuthology.orchestra.run.smithi052.stdout: "compressor_zlib_winsize": "-15", 2024-04-26T12:05:24.433 INFO:teuthology.orchestra.run.smithi052.stdout: "compressor_zstd_level": "1", 2024-04-26T12:05:24.433 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-26T12:05:24.433 INFO:teuthology.orchestra.run.smithi052.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-26T12:05:24.433 INFO:teuthology.orchestra.run.smithi052.stdout: "crimson_alien_op_num_threads": "6", 2024-04-26T12:05:24.433 INFO:teuthology.orchestra.run.smithi052.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-26T12:05:24.433 INFO:teuthology.orchestra.run.smithi052.stdout: "crimson_osd_obc_lru_size": "10", 2024-04-26T12:05:24.433 INFO:teuthology.orchestra.run.smithi052.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-26T12:05:24.434 INFO:teuthology.orchestra.run.smithi052.stdout: "crimson_seastar_smp": "1", 2024-04-26T12:05:24.434 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_location": "", 2024-04-26T12:05:24.434 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_location_hook": "", 2024-04-26T12:05:24.434 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_location_hook_timeout": "10", 2024-04-26T12:05:24.434 INFO:teuthology.orchestra.run.smithi052.stdout: "daemonize": "false", 2024-04-26T12:05:24.434 INFO:teuthology.orchestra.run.smithi052.stdout: "daos_pool": "tank", 2024-04-26T12:05:24.434 INFO:teuthology.orchestra.run.smithi052.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-26T12:05:24.434 INFO:teuthology.orchestra.run.smithi052.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-26T12:05:24.434 INFO:teuthology.orchestra.run.smithi052.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-26T12:05:24.434 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_alienstore": "0/5", 2024-04-26T12:05:24.434 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_allow_any_pool_priority": "false", 2024-04-26T12:05:24.434 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_asok": "1/5", 2024-04-26T12:05:24.434 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_asok_assert_abort": "false", 2024-04-26T12:05:24.434 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_asserts_on_shutdown": "true", 2024-04-26T12:05:24.434 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_auth": "20/20", 2024-04-26T12:05:24.435 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_bdev": "1/3", 2024-04-26T12:05:24.435 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_bluefs": "1/5", 2024-04-26T12:05:24.435 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_bluestore": "1/5", 2024-04-26T12:05:24.435 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_buffer": "0/1", 2024-04-26T12:05:24.435 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_ceph_exporter": "1/5", 2024-04-26T12:05:24.435 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_cephfs_mirror": "0/5", 2024-04-26T12:05:24.435 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_cephsqlite": "0/5", 2024-04-26T12:05:24.435 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_client": "0/5", 2024-04-26T12:05:24.435 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_compressor": "1/5", 2024-04-26T12:05:24.436 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_context": "0/1", 2024-04-26T12:05:24.436 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_crush": "1/1", 2024-04-26T12:05:24.436 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_crypto": "1/5", 2024-04-26T12:05:24.436 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_cyanstore": "0/5", 2024-04-26T12:05:24.436 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_deliberately_leak_memory": "false", 2024-04-26T12:05:24.436 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_disable_randomized_ping": "false", 2024-04-26T12:05:24.436 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_dpdk": "1/5", 2024-04-26T12:05:24.436 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_eventtrace": "1/5", 2024-04-26T12:05:24.436 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_filer": "0/1", 2024-04-26T12:05:24.436 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_filestore": "1/3", 2024-04-26T12:05:24.436 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_finisher": "1/1", 2024-04-26T12:05:24.436 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_fuse": "1/5", 2024-04-26T12:05:24.436 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_heartbeat_testing_span": "0", 2024-04-26T12:05:24.437 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_heartbeatmap": "1/5", 2024-04-26T12:05:24.437 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-26T12:05:24.437 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_javaclient": "1/5", 2024-04-26T12:05:24.437 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_journal": "1/3", 2024-04-26T12:05:24.437 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_journaler": "0/5", 2024-04-26T12:05:24.437 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_kstore": "1/5", 2024-04-26T12:05:24.437 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_leveldb": "4/5", 2024-04-26T12:05:24.437 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_lockdep": "0/1", 2024-04-26T12:05:24.437 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mclock": "1/5", 2024-04-26T12:05:24.438 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds": "1/5", 2024-04-26T12:05:24.438 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds_balancer": "1/5", 2024-04-26T12:05:24.438 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds_locker": "1/5", 2024-04-26T12:05:24.438 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds_log": "1/5", 2024-04-26T12:05:24.438 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds_log_expire": "1/5", 2024-04-26T12:05:24.438 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds_migrator": "1/5", 2024-04-26T12:05:24.438 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_memstore": "1/5", 2024-04-26T12:05:24.438 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mgr": "2/5", 2024-04-26T12:05:24.438 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mgrc": "1/5", 2024-04-26T12:05:24.438 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mon": "20/20", 2024-04-26T12:05:24.438 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_monc": "0/10", 2024-04-26T12:05:24.439 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_ms": "1/1", 2024-04-26T12:05:24.439 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_none": "0/5", 2024-04-26T12:05:24.439 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_objclass": "0/5", 2024-04-26T12:05:24.439 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_objectcacher": "0/5", 2024-04-26T12:05:24.439 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_objecter": "0/1", 2024-04-26T12:05:24.439 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_optracker": "0/5", 2024-04-26T12:05:24.439 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_osd": "1/5", 2024-04-26T12:05:24.439 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_paxos": "20/20", 2024-04-26T12:05:24.439 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_perfcounter": "1/5", 2024-04-26T12:05:24.439 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_prioritycache": "1/5", 2024-04-26T12:05:24.439 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rados": "0/5", 2024-04-26T12:05:24.439 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rbd": "0/5", 2024-04-26T12:05:24.439 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rbd_mirror": "0/5", 2024-04-26T12:05:24.439 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rbd_pwl": "0/5", 2024-04-26T12:05:24.439 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rbd_replay": "0/5", 2024-04-26T12:05:24.440 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_refs": "0/0", 2024-04-26T12:05:24.440 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_reserver": "1/1", 2024-04-26T12:05:24.440 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw": "1/5", 2024-04-26T12:05:24.440 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw_access": "1/5", 2024-04-26T12:05:24.440 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw_datacache": "1/5", 2024-04-26T12:05:24.440 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw_dbstore": "1/5", 2024-04-26T12:05:24.440 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw_flight": "1/5", 2024-04-26T12:05:24.440 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw_sync": "1/5", 2024-04-26T12:05:24.440 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rocksdb": "4/5", 2024-04-26T12:05:24.440 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore": "0/5", 2024-04-26T12:05:24.441 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_backref": "0/5", 2024-04-26T12:05:24.441 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_cache": "0/5", 2024-04-26T12:05:24.441 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_cleaner": "0/5", 2024-04-26T12:05:24.441 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_device": "0/5", 2024-04-26T12:05:24.441 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_epm": "0/5", 2024-04-26T12:05:24.441 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-26T12:05:24.441 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_journal": "0/5", 2024-04-26T12:05:24.441 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_lba": "0/5", 2024-04-26T12:05:24.441 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_odata": "0/5", 2024-04-26T12:05:24.441 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_omap": "0/5", 2024-04-26T12:05:24.441 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_onode": "0/5", 2024-04-26T12:05:24.441 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_t": "0/5", 2024-04-26T12:05:24.441 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_tm": "0/5", 2024-04-26T12:05:24.441 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_striper": "0/1", 2024-04-26T12:05:24.441 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_test": "0/5", 2024-04-26T12:05:24.442 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_throttle": "1/1", 2024-04-26T12:05:24.442 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_timer": "0/1", 2024-04-26T12:05:24.442 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_tp": "0/5", 2024-04-26T12:05:24.442 INFO:teuthology.orchestra.run.smithi052.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-26T12:05:24.442 INFO:teuthology.orchestra.run.smithi052.stdout: "device_failure_prediction_mode": "none", 2024-04-26T12:05:24.442 INFO:teuthology.orchestra.run.smithi052.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-26T12:05:24.442 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-04-26T12:05:24.442 INFO:teuthology.orchestra.run.smithi052.stdout: "err_to_graylog": "false", 2024-04-26T12:05:24.442 INFO:teuthology.orchestra.run.smithi052.stdout: "err_to_journald": "false", 2024-04-26T12:05:24.442 INFO:teuthology.orchestra.run.smithi052.stdout: "err_to_stderr": "true", 2024-04-26T12:05:24.442 INFO:teuthology.orchestra.run.smithi052.stdout: "err_to_syslog": "false", 2024-04-26T12:05:24.442 INFO:teuthology.orchestra.run.smithi052.stdout: "event_tracing": "false", 2024-04-26T12:05:24.442 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_addr": "0.0.0.0", 2024-04-26T12:05:24.442 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_http_port": "9926", 2024-04-26T12:05:24.446 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_prio_limit": "5", 2024-04-26T12:05:24.446 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-26T12:05:24.446 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_sort_metrics": "true", 2024-04-26T12:05:24.446 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_stats_period": "5", 2024-04-26T12:05:24.446 INFO:teuthology.orchestra.run.smithi052.stdout: "fake_statfs_for_testing": "0", 2024-04-26T12:05:24.446 INFO:teuthology.orchestra.run.smithi052.stdout: "fatal_signal_handlers": "true", 2024-04-26T12:05:24.446 INFO:teuthology.orchestra.run.smithi052.stdout: "filer_max_purge_ops": "10", 2024-04-26T12:05:24.446 INFO:teuthology.orchestra.run.smithi052.stdout: "filer_max_truncate_ops": "128", 2024-04-26T12:05:24.446 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_apply_finisher_threads": "1", 2024-04-26T12:05:24.447 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_blackhole": "false", 2024-04-26T12:05:24.447 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_btrfs_clone_range": "true", 2024-04-26T12:05:24.447 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_btrfs_snap": "true", 2024-04-26T12:05:24.447 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_caller_concurrency": "10", 2024-04-26T12:05:24.447 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_collect_device_partition_information": "true", 2024-04-26T12:05:24.447 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_commit_timeout": "600.000000", 2024-04-26T12:05:24.447 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_debug_inject_read_err": "false", 2024-04-26T12:05:24.447 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_debug_omap_check": "false", 2024-04-26T12:05:24.447 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_debug_random_read_err": "0.000000", 2024-04-26T12:05:24.447 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_debug_verify_split": "false", 2024-04-26T12:05:24.447 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_dump_file": "", 2024-04-26T12:05:24.447 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-26T12:05:24.447 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-26T12:05:24.447 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fadvise": "true", 2024-04-26T12:05:24.447 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fail_eio": "true", 2024-04-26T12:05:24.448 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fd_cache_shards": "16", 2024-04-26T12:05:24.448 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fd_cache_size": "128", 2024-04-26T12:05:24.448 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fiemap": "false", 2024-04-26T12:05:24.448 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fiemap_threshold": "4096", 2024-04-26T12:05:24.448 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-26T12:05:24.448 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-26T12:05:24.448 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_inject_stall": "0", 2024-04-26T12:05:24.448 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_journal_parallel": "false", 2024-04-26T12:05:24.448 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_journal_trailing": "false", 2024-04-26T12:05:24.448 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_journal_writeahead": "false", 2024-04-26T12:05:24.448 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_kill_at": "0", 2024-04-26T12:05:24.448 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-26T12:05:24.448 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-26T12:05:24.448 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-26T12:05:24.448 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-26T12:05:24.449 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-26T12:05:24.449 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattrs": "0", 2024-04-26T12:05:24.449 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-26T12:05:24.449 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-26T12:05:24.449 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-26T12:05:24.449 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-26T12:05:24.449 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_xattr_value_size": "0", 2024-04-26T12:05:24.449 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-26T12:05:24.449 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-26T12:05:24.449 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-26T12:05:24.449 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_merge_threshold": "-10", 2024-04-26T12:05:24.449 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-26T12:05:24.449 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_odsync_write": "false", 2024-04-26T12:05:24.449 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_omap_backend": "rocksdb", 2024-04-26T12:05:24.449 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_omap_backend_path": "", 2024-04-26T12:05:24.450 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-26T12:05:24.450 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-26T12:05:24.450 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-26T12:05:24.450 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_op_thread_timeout": "60", 2024-04-26T12:05:24.450 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_op_threads": "2", 2024-04-26T12:05:24.450 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_punch_hole": "false", 2024-04-26T12:05:24.450 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-26T12:05:24.450 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-26T12:05:24.450 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-26T12:05:24.450 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-26T12:05:24.450 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-26T12:05:24.450 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-26T12:05:24.450 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-26T12:05:24.450 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-26T12:05:24.451 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-26T12:05:24.451 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_max_ops": "50", 2024-04-26T12:05:24.451 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-26T12:05:24.451 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_seek_data_hole": "false", 2024-04-26T12:05:24.451 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_sloppy_crc": "false", 2024-04-26T12:05:24.451 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-26T12:05:24.451 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_splice": "false", 2024-04-26T12:05:24.451 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_split_multiple": "2", 2024-04-26T12:05:24.451 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_split_rand_factor": "20", 2024-04-26T12:05:24.451 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_update_to": "1000", 2024-04-26T12:05:24.451 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-26T12:05:24.451 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-26T12:05:24.451 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-26T12:05:24.451 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-26T12:05:24.452 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-26T12:05:24.452 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-26T12:05:24.452 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_enable": "true", 2024-04-26T12:05:24.452 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-26T12:05:24.452 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-26T12:05:24.452 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-26T12:05:24.452 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-26T12:05:24.452 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-26T12:05:24.452 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-26T12:05:24.452 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_xfs_extsize": "false", 2024-04-26T12:05:24.452 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_zfs_snap": "false", 2024-04-26T12:05:24.452 INFO:teuthology.orchestra.run.smithi052.stdout: "fio_dir": "/tmp/fio", 2024-04-26T12:05:24.452 INFO:teuthology.orchestra.run.smithi052.stdout: "fsid": "5bc300ae-e948-4ce3-81bb-5abae8c06799", 2024-04-26T12:05:24.452 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_allow_other": "true", 2024-04-26T12:05:24.452 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_atomic_o_trunc": "true", 2024-04-26T12:05:24.453 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_big_writes": "true", 2024-04-26T12:05:24.453 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_debug": "false", 2024-04-26T12:05:24.453 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_default_permissions": "false", 2024-04-26T12:05:24.453 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_disable_pagecache": "false", 2024-04-26T12:05:24.453 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_max_write": "0", 2024-04-26T12:05:24.453 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_multithreaded": "true", 2024-04-26T12:05:24.453 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_require_active_mds": "true", 2024-04-26T12:05:24.453 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_set_user_groups": "true", 2024-04-26T12:05:24.453 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_splice_move": "true", 2024-04-26T12:05:24.453 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_splice_read": "true", 2024-04-26T12:05:24.453 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_splice_write": "true", 2024-04-26T12:05:24.453 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-26T12:05:24.453 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_use_invalidate_cb": "true", 2024-04-26T12:05:24.453 INFO:teuthology.orchestra.run.smithi052.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-26T12:05:24.453 INFO:teuthology.orchestra.run.smithi052.stdout: "gss_target_name": "ceph", 2024-04-26T12:05:24.454 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_file": "", 2024-04-26T12:05:24.454 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_inject_failure": "0", 2024-04-26T12:05:24.454 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_interval": "5", 2024-04-26T12:05:24.454 INFO:teuthology.orchestra.run.smithi052.stdout: "host": "smithi052", 2024-04-26T12:05:24.454 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-26T12:05:24.454 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-26T12:05:24.454 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-26T12:05:24.454 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-26T12:05:24.454 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-26T12:05:24.454 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-26T12:05:24.454 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-26T12:05:24.454 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-26T12:05:24.454 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-26T12:05:24.454 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-26T12:05:24.454 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-26T12:05:24.455 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-26T12:05:24.455 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-26T12:05:24.455 INFO:teuthology.orchestra.run.smithi052.stdout: "inject_early_sigterm": "false", 2024-04-26T12:05:24.455 INFO:teuthology.orchestra.run.smithi052.stdout: "jaeger_agent_port": "6799", 2024-04-26T12:05:24.455 INFO:teuthology.orchestra.run.smithi052.stdout: "jaeger_tracing_enable": "false", 2024-04-26T12:05:24.455 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_aio": "true", 2024-04-26T12:05:24.455 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_align_min_size": "65536", 2024-04-26T12:05:24.455 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_block_align": "true", 2024-04-26T12:05:24.455 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_block_size": "4096", 2024-04-26T12:05:24.455 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_dio": "true", 2024-04-26T12:05:24.455 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_discard": "false", 2024-04-26T12:05:24.455 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_force_aio": "false", 2024-04-26T12:05:24.455 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_ignore_corruption": "false", 2024-04-26T12:05:24.455 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_max_write_bytes": "10485760", 2024-04-26T12:05:24.455 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_max_write_entries": "100", 2024-04-26T12:05:24.456 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_replay_from": "0", 2024-04-26T12:05:24.456 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-26T12:05:24.456 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-26T12:05:24.456 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-26T12:05:24.456 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-26T12:05:24.456 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_write_header_frequency": "0", 2024-04-26T12:05:24.456 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_zero_on_create": "false", 2024-04-26T12:05:24.456 INFO:teuthology.orchestra.run.smithi052.stdout: "journaler_prefetch_periods": "10", 2024-04-26T12:05:24.456 INFO:teuthology.orchestra.run.smithi052.stdout: "journaler_prezero_periods": "5", 2024-04-26T12:05:24.456 INFO:teuthology.orchestra.run.smithi052.stdout: "journaler_write_head_interval": "15", 2024-04-26T12:05:24.456 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "", 2024-04-26T12:05:24.456 INFO:teuthology.orchestra.run.smithi052.stdout: "keyfile": "", 2024-04-26T12:05:24.456 INFO:teuthology.orchestra.run.smithi052.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-26T12:05:24.456 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_backend": "rocksdb", 2024-04-26T12:05:24.456 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_default_stripe_size": "65536", 2024-04-26T12:05:24.457 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_fsck_on_mount": "false", 2024-04-26T12:05:24.457 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-26T12:05:24.457 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_max_bytes": "67108864", 2024-04-26T12:05:24.457 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_max_ops": "512", 2024-04-26T12:05:24.457 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_nid_prealloc": "1024", 2024-04-26T12:05:24.457 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_onode_map_size": "1024", 2024-04-26T12:05:24.457 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-26T12:05:24.457 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_sync_submit_transaction": "false", 2024-04-26T12:05:24.457 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_sync_transaction": "false", 2024-04-26T12:05:24.457 INFO:teuthology.orchestra.run.smithi052.stdout: "leveldb_block_size": "65536", 2024-04-26T12:05:24.457 INFO:teuthology.orchestra.run.smithi052.stdout: "leveldb_bloom_size": "0", 2024-04-26T12:05:24.457 INFO:teuthology.orchestra.run.smithi052.stdout: "leveldb_cache_size": "536870912", 2024-04-26T12:05:24.457 INFO:teuthology.orchestra.run.smithi052.stdout: "leveldb_compact_on_mount": "false", 2024-04-26T12:05:24.457 INFO:teuthology.orchestra.run.smithi052.stdout: "leveldb_compression": "false", 2024-04-26T12:05:24.457 INFO:teuthology.orchestra.run.smithi052.stdout: "leveldb_log": "", 2024-04-26T12:05:24.457 INFO:teuthology.orchestra.run.smithi052.stdout: "leveldb_log_to_ceph_log": "true", 2024-04-26T12:05:24.458 INFO:teuthology.orchestra.run.smithi052.stdout: "leveldb_max_open_files": "0", 2024-04-26T12:05:24.458 INFO:teuthology.orchestra.run.smithi052.stdout: "leveldb_paranoid": "false", 2024-04-26T12:05:24.458 INFO:teuthology.orchestra.run.smithi052.stdout: "leveldb_write_buffer_size": "33554432", 2024-04-26T12:05:24.458 INFO:teuthology.orchestra.run.smithi052.stdout: "librados_thread_count": "2", 2024-04-26T12:05:24.458 INFO:teuthology.orchestra.run.smithi052.stdout: "lockdep": "false", 2024-04-26T12:05:24.458 INFO:teuthology.orchestra.run.smithi052.stdout: "lockdep_force_backtrace": "false", 2024-04-26T12:05:24.458 INFO:teuthology.orchestra.run.smithi052.stdout: "log_coarse_timestamps": "true", 2024-04-26T12:05:24.458 INFO:teuthology.orchestra.run.smithi052.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-26T12:05:24.458 INFO:teuthology.orchestra.run.smithi052.stdout: "log_flush_on_exit": "false", 2024-04-26T12:05:24.458 INFO:teuthology.orchestra.run.smithi052.stdout: "log_graylog_host": "127.0.0.1", 2024-04-26T12:05:24.458 INFO:teuthology.orchestra.run.smithi052.stdout: "log_graylog_port": "12201", 2024-04-26T12:05:24.458 INFO:teuthology.orchestra.run.smithi052.stdout: "log_max_new": "1000", 2024-04-26T12:05:24.459 INFO:teuthology.orchestra.run.smithi052.stdout: "log_max_recent": "10000", 2024-04-26T12:05:24.459 INFO:teuthology.orchestra.run.smithi052.stdout: "log_stderr_prefix": "", 2024-04-26T12:05:24.459 INFO:teuthology.orchestra.run.smithi052.stdout: "log_stop_at_utilization": "0.970000", 2024-04-26T12:05:24.459 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": "true", 2024-04-26T12:05:24.459 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_graylog": "false", 2024-04-26T12:05:24.459 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_journald": "false", 2024-04-26T12:05:24.459 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_stderr": "false", 2024-04-26T12:05:24.459 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_syslog": "false", 2024-04-26T12:05:24.459 INFO:teuthology.orchestra.run.smithi052.stdout: "max_rotating_auth_attempts": "10", 2024-04-26T12:05:24.459 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-26T12:05:24.459 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_action_on_write_error": "1", 2024-04-26T12:05:24.459 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_alternate_name_max": "8192", 2024-04-26T12:05:24.459 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_asio_thread_count": "2", 2024-04-26T12:05:24.459 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_export_pin": "true", 2024-04-26T12:05:24.459 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_fragment_dirs": "true", 2024-04-26T12:05:24.460 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-26T12:05:24.460 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_fragment_interval": "5", 2024-04-26T12:05:24.460 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-26T12:05:24.460 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-26T12:05:24.460 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_interval": "10", 2024-04-26T12:05:24.460 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_max": "-1", 2024-04-26T12:05:24.460 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_max_until": "-1", 2024-04-26T12:05:24.460 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_merge_size": "50", 2024-04-26T12:05:24.460 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_midchunk": "0.300000", 2024-04-26T12:05:24.460 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-26T12:05:24.460 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_min_start": "0.200000", 2024-04-26T12:05:24.460 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_minchunk": "0.001000", 2024-04-26T12:05:24.460 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_mode": "0", 2024-04-26T12:05:24.460 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_need_max": "1.200000", 2024-04-26T12:05:24.461 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_need_min": "0.800000", 2024-04-26T12:05:24.461 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-26T12:05:24.461 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-26T12:05:24.461 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_split_bits": "3", 2024-04-26T12:05:24.461 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-26T12:05:24.461 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_split_size": "10000", 2024-04-26T12:05:24.461 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-26T12:05:24.461 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_target_decay": "10.000000", 2024-04-26T12:05:24.461 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-26T12:05:24.461 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_beacon_grace": "15.000000", 2024-04-26T12:05:24.461 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_beacon_interval": "4.000000", 2024-04-26T12:05:24.461 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-26T12:05:24.461 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-26T12:05:24.461 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_mid": "0.700000", 2024-04-26T12:05:24.461 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_release_free_interval": "10", 2024-04-26T12:05:24.461 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_reservation": "0.050000", 2024-04-26T12:05:24.462 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-26T12:05:24.462 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_trim_interval": "1", 2024-04-26T12:05:24.462 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_trim_threshold": "262144", 2024-04-26T12:05:24.462 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-26T12:05:24.462 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-26T12:05:24.462 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-26T12:05:24.462 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_client_prealloc_inos": "1000", 2024-04-26T12:05:24.462 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-26T12:05:24.462 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_connect_bootstrapping": "false", 2024-04-26T12:05:24.462 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_damage_table_max_entries": "10000", 2024-04-26T12:05:24.462 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-26T12:05:24.462 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_debug_auth_pins": "false", 2024-04-26T12:05:24.463 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_debug_frag": "false", 2024-04-26T12:05:24.463 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_debug_scatterstat": "false", 2024-04-26T12:05:24.463 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_debug_subtrees": "false", 2024-04-26T12:05:24.463 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_decay_halflife": "5.000000", 2024-04-26T12:05:24.463 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_default_dir_hash": "2", 2024-04-26T12:05:24.463 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_defer_session_stale": "true", 2024-04-26T12:05:24.463 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_deny_all_reconnect": "false", 2024-04-26T12:05:24.463 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dir_keys_per_op": "16384", 2024-04-26T12:05:24.463 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dir_max_commit_size": "10", 2024-04-26T12:05:24.463 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dir_max_entries": "0", 2024-04-26T12:05:24.463 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dir_prefetch": "true", 2024-04-26T12:05:24.464 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-26T12:05:24.464 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-26T12:05:24.464 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dump_cache_on_map": "false", 2024-04-26T12:05:24.464 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-26T12:05:24.464 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-26T12:05:24.464 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_early_reply": "true", 2024-04-26T12:05:24.464 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_enable_op_tracker": "true", 2024-04-26T12:05:24.464 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_enforce_unique_name": "true", 2024-04-26T12:05:24.464 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-26T12:05:24.464 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-26T12:05:24.464 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_export_ephemeral_random": "true", 2024-04-26T12:05:24.464 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-26T12:05:24.464 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-26T12:05:24.464 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-26T12:05:24.465 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-26T12:05:24.465 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-26T12:05:24.465 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-26T12:05:24.465 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-26T12:05:24.465 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-26T12:05:24.465 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_health_summarize_threshold": "10", 2024-04-26T12:05:24.465 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-26T12:05:24.465 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-26T12:05:24.465 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_inject_health_dummy": "false", 2024-04-26T12:05:24.465 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-26T12:05:24.465 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_inject_migrator_session_race": "false", 2024-04-26T12:05:24.465 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-26T12:05:24.465 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-26T12:05:24.465 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-26T12:05:24.465 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_join_fs": "", 2024-04-26T12:05:24.466 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_journal_format": "1", 2024-04-26T12:05:24.466 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_create_at": "0", 2024-04-26T12:05:24.466 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_export_at": "0", 2024-04-26T12:05:24.466 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_import_at": "0", 2024-04-26T12:05:24.466 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_journal_at": "0", 2024-04-26T12:05:24.466 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_journal_expire_at": "0", 2024-04-26T12:05:24.466 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_journal_replay_at": "0", 2024-04-26T12:05:24.466 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_link_at": "0", 2024-04-26T12:05:24.466 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_mdstable_at": "0", 2024-04-26T12:05:24.466 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_openc_at": "0", 2024-04-26T12:05:24.466 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_rename_at": "0", 2024-04-26T12:05:24.466 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-26T12:05:24.466 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_events_per_segment": "1024", 2024-04-26T12:05:24.466 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_max_events": "-1", 2024-04-26T12:05:24.467 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_max_segments": "128", 2024-04-26T12:05:24.467 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_pause": "false", 2024-04-26T12:05:24.467 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_segment_size": "0", 2024-04-26T12:05:24.467 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-26T12:05:24.467 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_warn_factor": "2.000000", 2024-04-26T12:05:24.467 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_caps_per_client": "1048576", 2024-04-26T12:05:24.467 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_completed_flushes": "100000", 2024-04-26T12:05:24.467 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_completed_requests": "100000", 2024-04-26T12:05:24.467 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_export_size": "20971520", 2024-04-26T12:05:24.467 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_file_recover": "32", 2024-04-26T12:05:24.467 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_purge_files": "64", 2024-04-26T12:05:24.467 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_purge_ops": "8192", 2024-04-26T12:05:24.467 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-26T12:05:24.467 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-26T12:05:24.467 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_snaps_per_dir": "100", 2024-04-26T12:05:24.468 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_metrics_update_interval": "2", 2024-04-26T12:05:24.468 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_min_caps_per_client": "100", 2024-04-26T12:05:24.468 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_min_caps_working_set": "10000", 2024-04-26T12:05:24.468 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-26T12:05:24.468 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_numa_node": "-1", 2024-04-26T12:05:24.468 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-26T12:05:24.468 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_op_complaint_time": "30.000000", 2024-04-26T12:05:24.468 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_op_history_duration": "600", 2024-04-26T12:05:24.468 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_op_history_size": "20", 2024-04-26T12:05:24.468 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_op_history_slow_op_size": "20", 2024-04-26T12:05:24.468 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-26T12:05:24.468 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_op_log_threshold": "5", 2024-04-26T12:05:24.468 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_ping_grace": "15", 2024-04-26T12:05:24.468 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_ping_interval": "5", 2024-04-26T12:05:24.468 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-26T12:05:24.469 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-26T12:05:24.469 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_recall_max_caps": "30000", 2024-04-26T12:05:24.469 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-26T12:05:24.469 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-26T12:05:24.469 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-26T12:05:24.469 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_recall_warning_threshold": "262144", 2024-04-26T12:05:24.469 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-26T12:05:24.469 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_replay_interval": "1.000000", 2024-04-26T12:05:24.469 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-26T12:05:24.469 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-26T12:05:24.469 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_root_ino_gid": "0", 2024-04-26T12:05:24.469 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_root_ino_uid": "0", 2024-04-26T12:05:24.469 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-26T12:05:24.469 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-26T12:05:24.469 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-26T12:05:24.470 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-26T12:05:24.470 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-26T12:05:24.470 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-26T12:05:24.470 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-26T12:05:24.470 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-26T12:05:24.470 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-26T12:05:24.470 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-26T12:05:24.470 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_shutdown_check": "0", 2024-04-26T12:05:24.470 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_skip_ino": "0", 2024-04-26T12:05:24.470 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-26T12:05:24.470 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_snap_max_uid": "4294967294", 2024-04-26T12:05:24.470 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_snap_min_uid": "0", 2024-04-26T12:05:24.470 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_snap_rstat": "false", 2024-04-26T12:05:24.470 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_standby_replay_damaged": "false", 2024-04-26T12:05:24.471 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_symlink_recovery": "true", 2024-04-26T12:05:24.471 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-26T12:05:24.471 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_thrash_exports": "0", 2024-04-26T12:05:24.471 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_thrash_fragments": "0", 2024-04-26T12:05:24.471 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_tick_interval": "5.000000", 2024-04-26T12:05:24.471 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_valgrind_exit": "false", 2024-04-26T12:05:24.471 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_verify_backtrace": "1", 2024-04-26T12:05:24.471 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_verify_scatter": "false", 2024-04-26T12:05:24.471 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-26T12:05:24.471 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_wipe_sessions": "false", 2024-04-26T12:05:24.471 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool_debug": "false", 2024-04-26T12:05:24.471 INFO:teuthology.orchestra.run.smithi052.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-26T12:05:24.471 INFO:teuthology.orchestra.run.smithi052.stdout: "memstore_device_bytes": "1073741824", 2024-04-26T12:05:24.471 INFO:teuthology.orchestra.run.smithi052.stdout: "memstore_page_set": "false", 2024-04-26T12:05:24.471 INFO:teuthology.orchestra.run.smithi052.stdout: "memstore_page_size": "65536", 2024-04-26T12:05:24.472 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_client_bytes": "134217728", 2024-04-26T12:05:24.472 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_client_messages": "512", 2024-04-26T12:05:24.472 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-26T12:05:24.472 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-26T12:05:24.472 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-26T12:05:24.472 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-26T12:05:24.472 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_disabled_modules": "", 2024-04-26T12:05:24.472 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-26T12:05:24.472 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_max_pg_num_change": "128", 2024-04-26T12:05:24.472 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_mds_bytes": "134217728", 2024-04-26T12:05:24.472 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_mds_messages": "128", 2024-04-26T12:05:24.472 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-26T12:05:24.472 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_mon_bytes": "134217728", 2024-04-26T12:05:24.472 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_mon_messages": "128", 2024-04-26T12:05:24.472 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_osd_bytes": "536870912", 2024-04-26T12:05:24.473 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_osd_messages": "8192", 2024-04-26T12:05:24.473 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_pool": "true", 2024-04-26T12:05:24.473 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-26T12:05:24.473 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_standby_modules": "true", 2024-04-26T12:05:24.473 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_stats_period": "5", 2024-04-26T12:05:24.473 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_stats_threshold": "5", 2024-04-26T12:05:24.473 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_tick_period": "2", 2024-04-26T12:05:24.473 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-26T12:05:24.473 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-26T12:05:24.473 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_allow_pool_delete": "true", 2024-04-26T12:05:24.473 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_allow_pool_size_one": "true", 2024-04-26T12:05:24.473 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_auth_validate_all_caps": "true", 2024-04-26T12:05:24.473 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-26T12:05:24.473 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-26T12:05:24.474 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_bytes": "104857600", 2024-04-26T12:05:24.474 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_directed_command_retry": "2", 2024-04-26T12:05:24.474 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-26T12:05:24.474 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-26T12:05:24.474 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-26T12:05:24.474 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-26T12:05:24.474 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_hunt_parallel": "3", 2024-04-26T12:05:24.474 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_log_interval": "1.000000", 2024-04-26T12:05:24.474 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-26T12:05:24.474 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_ping_interval": "10.000000", 2024-04-26T12:05:24.474 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-26T12:05:24.474 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-26T12:05:24.474 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-26T12:05:24.474 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-26T12:05:24.474 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_file_level": "debug", 2024-04-26T12:05:24.475 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_file": "true", 2024-04-26T12:05:24.475 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-26T12:05:24.475 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-26T12:05:24.475 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-26T12:05:24.475 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_journald": "false", 2024-04-26T12:05:24.475 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-26T12:05:24.475 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-26T12:05:24.475 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-26T12:05:24.475 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-26T12:05:24.475 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_compact_on_bootstrap": "false", 2024-04-26T12:05:24.475 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_compact_on_start": "false", 2024-04-26T12:05:24.475 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_compact_on_trim": "true", 2024-04-26T12:05:24.475 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-26T12:05:24.475 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-26T12:05:24.475 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-26T12:05:24.476 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cpu_threads": "4", 2024-04-26T12:05:24.476 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_crush_min_required_version": "hammer", 2024-04-26T12:05:24.476 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_daemon_bytes": "419430400", 2024-04-26T12:05:24.476 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-26T12:05:24.476 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_data_avail_crit": "5", 2024-04-26T12:05:24.476 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_data_avail_warn": "5", 2024-04-26T12:05:24.476 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_data_size_warn": "16106127360", 2024-04-26T12:05:24.476 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-26T12:05:24.476 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-26T12:05:24.476 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_dump_json": "false", 2024-04-26T12:05:24.476 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-26T12:05:24.476 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_dump_transactions": "false", 2024-04-26T12:05:24.476 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_extra_checks": "false", 2024-04-26T12:05:24.476 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-26T12:05:24.476 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-26T12:05:24.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_no_require_quincy": "false", 2024-04-26T12:05:24.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_no_require_reef": "false", 2024-04-26T12:05:24.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-26T12:05:24.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-26T12:05:24.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-26T12:05:24.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_down_mkfs_grace": "120", 2024-04-26T12:05:24.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_election_default_strategy": "1", 2024-04-26T12:05:24.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_election_timeout": "5.000000", 2024-04-26T12:05:24.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-26T12:05:24.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_elector_ping_divisor": "2", 2024-04-26T12:05:24.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-26T12:05:24.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_enable_op_tracker": "true", 2024-04-26T12:05:24.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_fake_pool_delete": "false", 2024-04-26T12:05:24.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_force_quorum_join": "false", 2024-04-26T12:05:24.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_globalid_prealloc": "10000", 2024-04-26T12:05:24.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_health_detail_to_clog": "false", 2024-04-26T12:05:24.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_health_log_update_period": "5", 2024-04-26T12:05:24.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_health_max_detail": "50", 2024-04-26T12:05:24.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_health_to_clog": "true", 2024-04-26T12:05:24.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_health_to_clog_interval": "600", 2024-04-26T12:05:24.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-26T12:05:24.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_host": "172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],[v2:172.21.15.52:3302,v1:172.21.15.52:6791]", 2024-04-26T12:05:24.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_host_override": "", 2024-04-26T12:05:24.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_initial_members": "", 2024-04-26T12:05:24.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-26T12:05:24.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-26T12:05:24.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-26T12:05:24.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-26T12:05:24.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-26T12:05:24.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_lease": "5.000000", 2024-04-26T12:05:24.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-26T12:05:24.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-26T12:05:24.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_log_full_interval": "50", 2024-04-26T12:05:24.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_log_max": "10000", 2024-04-26T12:05:24.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_log_max_summary": "50", 2024-04-26T12:05:24.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-26T12:05:24.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_log_epochs": "500", 2024-04-26T12:05:24.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-26T12:05:24.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-26T12:05:24.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_osd": "10000", 2024-04-26T12:05:24.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_pg_per_osd": "10000", 2024-04-26T12:05:24.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_pool_pg_num": "65536", 2024-04-26T12:05:24.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-26T12:05:24.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-26T12:05:24.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mds_force_trim_to": "0", 2024-04-26T12:05:24.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mds_skip_sanity": "false", 2024-04-26T12:05:24.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_memory_autotune": "true", 2024-04-26T12:05:24.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_memory_target": "2147483648", 2024-04-26T12:05:24.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mgr_beacon_grace": "30", 2024-04-26T12:05:24.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-26T12:05:24.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mgr_digest_period": "5", 2024-04-26T12:05:24.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mgr_inactive_grace": "60", 2024-04-26T12:05:24.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-26T12:05:24.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-26T12:05:24.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_min_osdmap_epochs": "500", 2024-04-26T12:05:24.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_op_complaint_time": "30", 2024-04-26T12:05:24.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_op_history_duration": "600", 2024-04-26T12:05:24.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_op_history_size": "20", 2024-04-26T12:05:24.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_op_history_slow_op_size": "20", 2024-04-26T12:05:24.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-26T12:05:24.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_op_log_threshold": "5", 2024-04-26T12:05:24.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-26T12:05:24.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-26T12:05:24.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-26T12:05:24.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_auto_mark_in": "false", 2024-04-26T12:05:24.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-26T12:05:24.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-26T12:05:24.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-26T12:05:24.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_cache_size": "500", 2024-04-26T12:05:24.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-26T12:05:24.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-26T12:05:24.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-26T12:05:24.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_down_out_interval": "600", 2024-04-26T12:05:24.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-26T12:05:24.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-26T12:05:24.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_force_trim_to": "0", 2024-04-26T12:05:24.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-26T12:05:24.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-26T12:05:24.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-26T12:05:24.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-26T12:05:24.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-26T12:05:24.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-26T12:05:24.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-26T12:05:24.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-26T12:05:24.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_min_down_reporters": "2", 2024-04-26T12:05:24.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-26T12:05:24.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-26T12:05:24.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-26T12:05:24.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-26T12:05:24.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-26T12:05:24.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-26T12:05:24.483 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_report_timeout": "900", 2024-04-26T12:05:24.483 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-26T12:05:24.483 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-26T12:05:24.483 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-26T12:05:24.483 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-26T12:05:24.483 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-26T12:05:24.483 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-26T12:05:24.483 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-26T12:05:24.483 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-26T12:05:24.483 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-26T12:05:24.483 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pg_stuck_threshold": "60", 2024-04-26T12:05:24.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-26T12:05:24.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-26T12:05:24.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-26T12:05:24.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-26T12:05:24.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-26T12:05:24.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-26T12:05:24.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_probe_timeout": "2.000000", 2024-04-26T12:05:24.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_reweight_max_change": "0.050000", 2024-04-26T12:05:24.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_reweight_max_osds": "4", 2024-04-26T12:05:24.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-26T12:05:24.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-26T12:05:24.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-26T12:05:24.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-26T12:05:24.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-26T12:05:24.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_scrub_interval": "86400", 2024-04-26T12:05:24.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_scrub_max_keys": "100", 2024-04-26T12:05:24.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_scrub_timeout": "300", 2024-04-26T12:05:24.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_session_timeout": "300", 2024-04-26T12:05:24.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_smart_report_timeout": "5", 2024-04-26T12:05:24.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_stat_smooth_intervals": "6", 2024-04-26T12:05:24.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-26T12:05:24.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_stretch_pool_min_size": "2", 2024-04-26T12:05:24.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_stretch_pool_size": "4", 2024-04-26T12:05:24.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-26T12:05:24.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-26T12:05:24.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_sync_debug": "false", 2024-04-26T12:05:24.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-26T12:05:24.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-26T12:05:24.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_sync_provider_kill_at": "0", 2024-04-26T12:05:24.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_sync_requester_kill_at": "0", 2024-04-26T12:05:24.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_sync_timeout": "60.000000", 2024-04-26T12:05:24.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_target_pg_per_osd": "100", 2024-04-26T12:05:24.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_tick_interval": "5", 2024-04-26T12:05:24.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_timecheck_interval": "300.000000", 2024-04-26T12:05:24.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-26T12:05:24.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_use_min_delay_socket": "false", 2024-04-26T12:05:24.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_older_version_delay": "604800", 2024-04-26T12:05:24.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-26T12:05:24.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-26T12:05:24.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-26T12:05:24.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-26T12:05:24.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-26T12:05:24.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-26T12:05:24.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-26T12:05:24.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_misplaced": "false", 2024-04-26T12:05:24.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-26T12:05:24.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_older_version": "true", 2024-04-26T12:05:24.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-26T12:05:24.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-26T12:05:24.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-26T12:05:24.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-26T12:05:24.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-26T12:05:24.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-26T12:05:24.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-26T12:05:24.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-26T12:05:24.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-26T12:05:24.487 INFO:teuthology.orchestra.run.smithi052.stdout: "monmap": "", 2024-04-26T12:05:24.487 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T12:05:24.487 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-26T12:05:24.488 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-26T12:05:24.488 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T12:05:24.488 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-26T12:05:24.488 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-26T12:05:24.488 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_tracing_enabled": "false", 2024-04-26T12:05:24.488 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_op_threads": "3", 2024-04-26T12:05:24.488 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-26T12:05:24.488 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_cm": "false", 2024-04-26T12:05:24.488 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_device_name": "", 2024-04-26T12:05:24.488 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_dscp": "96", 2024-04-26T12:05:24.488 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-26T12:05:24.488 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-26T12:05:24.488 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_local_gid": "", 2024-04-26T12:05:24.488 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-26T12:05:24.488 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_port_num": "1", 2024-04-26T12:05:24.489 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-26T12:05:24.489 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-26T12:05:24.489 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-26T12:05:24.489 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-26T12:05:24.489 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_sl": "3", 2024-04-26T12:05:24.489 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_support_srq": "true", 2024-04-26T12:05:24.489 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_type": "ib", 2024-04-26T12:05:24.489 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_reap_threshold": "5", 2024-04-26T12:05:24.489 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_before_connect": "false", 2024-04-26T12:05:24.489 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_ipv4": "true", 2024-04-26T12:05:24.489 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_ipv6": "false", 2024-04-26T12:05:24.489 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_msgr1": "true", 2024-04-26T12:05:24.489 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_msgr2": "true", 2024-04-26T12:05:24.489 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_port_max": "7568", 2024-04-26T12:05:24.489 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_port_min": "6800", 2024-04-26T12:05:24.490 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-26T12:05:24.490 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_retry_count": "3", 2024-04-26T12:05:24.490 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_retry_delay": "5", 2024-04-26T12:05:24.490 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_blackhole_client": "false", 2024-04-26T12:05:24.490 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_blackhole_mds": "false", 2024-04-26T12:05:24.490 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_blackhole_mgr": "false", 2024-04-26T12:05:24.490 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_blackhole_mon": "false", 2024-04-26T12:05:24.490 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_blackhole_osd": "false", 2024-04-26T12:05:24.490 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_client_mode": "crc secure", 2024-04-26T12:05:24.490 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_cluster_mode": "crc secure", 2024-04-26T12:05:24.490 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_cluster_type": "", 2024-04-26T12:05:24.490 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_compress_secure": "false", 2024-04-26T12:05:24.490 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_connection_idle_timeout": "900", 2024-04-26T12:05:24.490 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_connection_ready_timeout": "10", 2024-04-26T12:05:24.491 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_crc_data": "true", 2024-04-26T12:05:24.491 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_crc_header": "true", 2024-04-26T12:05:24.491 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_die_on_bad_msg": "false", 2024-04-26T12:05:24.491 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_die_on_bug": "true", 2024-04-26T12:05:24.491 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_die_on_old_message": "true", 2024-04-26T12:05:24.491 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_die_on_skipped_message": "false", 2024-04-26T12:05:24.491 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-26T12:05:24.491 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-26T12:05:24.491 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_coremask": "0xF", 2024-04-26T12:05:24.491 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-26T12:05:24.491 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-26T12:05:24.491 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_enable_tso": "true", 2024-04-26T12:05:24.491 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-26T12:05:24.491 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-26T12:05:24.491 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_hugepages": "", 2024-04-26T12:05:24.491 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-26T12:05:24.492 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-26T12:05:24.492 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_lro": "true", 2024-04-26T12:05:24.492 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_memory_channel": "4", 2024-04-26T12:05:24.492 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-26T12:05:24.492 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_pmd": "", 2024-04-26T12:05:24.492 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_port_id": "0", 2024-04-26T12:05:24.492 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-26T12:05:24.492 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-26T12:05:24.492 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dump_on_send": "false", 2024-04-26T12:05:24.492 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_initial_backoff": "0.200000", 2024-04-26T12:05:24.492 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_inject_delay_max": "1.000000", 2024-04-26T12:05:24.492 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-26T12:05:24.492 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_inject_delay_type": "", 2024-04-26T12:05:24.492 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-26T12:05:24.492 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_inject_network_congestion": "0", 2024-04-26T12:05:24.493 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_inject_socket_failures": "0", 2024-04-26T12:05:24.493 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_learn_addr_from_peer": "true", 2024-04-26T12:05:24.493 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_max_accept_failures": "4", 2024-04-26T12:05:24.493 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_max_backoff": "15.000000", 2024-04-26T12:05:24.493 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_mon_client_mode": "secure crc", 2024-04-26T12:05:24.493 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-26T12:05:24.493 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_mon_service_mode": "secure crc", 2024-04-26T12:05:24.493 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_osd_compress_min_size": "1024", 2024-04-26T12:05:24.493 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_osd_compress_mode": "none", 2024-04-26T12:05:24.493 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-26T12:05:24.493 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-26T12:05:24.493 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_pq_min_cost": "65536", 2024-04-26T12:05:24.493 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_public_type": "", 2024-04-26T12:05:24.493 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_service_mode": "crc secure", 2024-04-26T12:05:24.493 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_tcp_listen_backlog": "512", 2024-04-26T12:05:24.494 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_tcp_nodelay": "true", 2024-04-26T12:05:24.494 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-26T12:05:24.494 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_tcp_rcvbuf": "0", 2024-04-26T12:05:24.494 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_type": "async+posix", 2024-04-26T12:05:24.494 INFO:teuthology.orchestra.run.smithi052.stdout: "no_config_file": "false", 2024-04-26T12:05:24.494 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_completion_locks_per_session": "32", 2024-04-26T12:05:24.494 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-26T12:05:24.494 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-26T12:05:24.494 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_inflight_ops": "1024", 2024-04-26T12:05:24.494 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-26T12:05:24.494 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-26T12:05:24.494 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_tick_interval": "5.000000", 2024-04-26T12:05:24.494 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_timeout": "10.000000", 2024-04-26T12:05:24.494 INFO:teuthology.orchestra.run.smithi052.stdout: "objectstore_blackhole": "false", 2024-04-26T12:05:24.494 INFO:teuthology.orchestra.run.smithi052.stdout: "openssl_engine_opts": "", 2024-04-26T12:05:24.495 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_delay_time": "5.000000", 2024-04-26T12:05:24.495 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_hist_halflife": "1000", 2024-04-26T12:05:24.495 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_max_low_ops": "2", 2024-04-26T12:05:24.495 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_max_ops": "4", 2024-04-26T12:05:24.495 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-26T12:05:24.495 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-26T12:05:24.495 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_slop": "0.020000", 2024-04-26T12:05:24.495 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-26T12:05:24.495 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-26T12:05:24.495 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_asio_thread_count": "2", 2024-04-26T12:05:24.495 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_async_recovery_min_cost": "100", 2024-04-26T12:05:24.495 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-26T12:05:24.495 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-26T12:05:24.495 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_backfill_scan_max": "512", 2024-04-26T12:05:24.495 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_backfill_scan_min": "64", 2024-04-26T12:05:24.495 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_backoff_on_degraded": "false", 2024-04-26T12:05:24.496 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_backoff_on_peering": "false", 2024-04-26T12:05:24.496 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_backoff_on_unfound": "true", 2024-04-26T12:05:24.496 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_beacon_report_interval": "300", 2024-04-26T12:05:24.496 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bench_duration": "30", 2024-04-26T12:05:24.496 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-26T12:05:24.496 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bench_max_block_size": "67108864", 2024-04-26T12:05:24.496 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-26T12:05:24.496 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_blkin_trace_all": "false", 2024-04-26T12:05:24.496 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-26T12:05:24.496 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-26T12:05:24.496 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-26T12:05:24.496 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-26T12:05:24.496 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_check_for_log_corruption": "false", 2024-04-26T12:05:24.496 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-26T12:05:24.496 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T12:05:24.497 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-04-26T12:05:24.497 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T12:05:24.497 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_class_update_on_start": "true", 2024-04-26T12:05:24.497 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_client_message_cap": "256", 2024-04-26T12:05:24.497 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_client_message_size_cap": "524288000", 2024-04-26T12:05:24.497 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_client_op_priority": "63", 2024-04-26T12:05:24.497 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_client_watch_timeout": "30", 2024-04-26T12:05:24.497 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_command_max_records": "256", 2024-04-26T12:05:24.497 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_compact_on_start": "false", 2024-04-26T12:05:24.497 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-26T12:05:24.497 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-26T12:05:24.497 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-26T12:05:24.497 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_crush_update_on_start": "true", 2024-04-26T12:05:24.497 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_crush_update_weight_set": "true", 2024-04-26T12:05:24.498 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-26T12:05:24.498 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-26T12:05:24.498 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-26T12:05:24.498 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-26T12:05:24.498 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-26T12:05:24.498 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_feed_pullee": "-1", 2024-04-26T12:05:24.498 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-26T12:05:24.498 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-26T12:05:24.498 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-26T12:05:24.498 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_misdirected_ops": "false", 2024-04-26T12:05:24.498 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_no_acting_change": "false", 2024-04-26T12:05:24.498 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_no_purge_strays": "false", 2024-04-26T12:05:24.498 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_op_order": "false", 2024-04-26T12:05:24.498 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-26T12:05:24.499 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-26T12:05:24.499 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-26T12:05:24.499 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-26T12:05:24.499 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_shutdown": "false", 2024-04-26T12:05:24.499 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-26T12:05:24.499 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-26T12:05:24.499 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-26T12:05:24.499 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-26T12:05:24.499 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_verify_snaps": "false", 2024-04-26T12:05:24.499 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-26T12:05:24.499 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-26T12:05:24.499 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_keys": "1024", 2024-04-26T12:05:24.499 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-26T12:05:24.500 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-26T12:05:24.500 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-26T12:05:24.500 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_stride": "524288", 2024-04-26T12:05:24.500 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-26T12:05:24.500 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-26T12:05:24.500 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_default_notify_timeout": "30", 2024-04-26T12:05:24.500 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_delete_sleep": "0.000000", 2024-04-26T12:05:24.500 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-26T12:05:24.500 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-26T12:05:24.500 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-26T12:05:24.500 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_discard_disconnected_ops": "true", 2024-04-26T12:05:24.500 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_enable_op_tracker": "true", 2024-04-26T12:05:24.500 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-26T12:05:24.500 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-26T12:05:24.500 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-26T12:05:24.501 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-26T12:05:24.501 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_fast_info": "true", 2024-04-26T12:05:24.501 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_fast_shutdown": "true", 2024-04-26T12:05:24.501 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-26T12:05:24.501 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-26T12:05:24.501 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-26T12:05:24.501 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-26T12:05:24.501 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-26T12:05:24.501 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_function_tracing": "false", 2024-04-26T12:05:24.501 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_grace": "20", 2024-04-26T12:05:24.501 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_interval": "6", 2024-04-26T12:05:24.501 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-26T12:05:24.501 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_min_peers": "10", 2024-04-26T12:05:24.502 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_min_size": "2000", 2024-04-26T12:05:24.502 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_stale": "600", 2024-04-26T12:05:24.502 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-26T12:05:24.502 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_hit_set_max_size": "100000", 2024-04-26T12:05:24.502 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_hit_set_min_size": "1000", 2024-04-26T12:05:24.502 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-26T12:05:24.502 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-26T12:05:24.502 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-26T12:05:24.502 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-26T12:05:24.502 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-26T12:05:24.502 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-26T12:05:24.502 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_journal_size": "5120", 2024-04-26T12:05:24.502 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_kill_backfill_at": "0", 2024-04-26T12:05:24.502 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-26T12:05:24.502 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_map_cache_size": "50", 2024-04-26T12:05:24.503 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_map_dedup": "true", 2024-04-26T12:05:24.503 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_map_message_max": "40", 2024-04-26T12:05:24.503 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-26T12:05:24.503 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_map_share_max_epochs": "40", 2024-04-26T12:05:24.503 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_attr_name_len": "100", 2024-04-26T12:05:24.503 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_attr_size": "0", 2024-04-26T12:05:24.503 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_backfills": "1", 2024-04-26T12:05:24.503 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_markdown_count": "5", 2024-04-26T12:05:24.503 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_markdown_period": "600", 2024-04-26T12:05:24.503 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_object_name_len": "2048", 2024-04-26T12:05:24.503 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_object_namespace_len": "256", 2024-04-26T12:05:24.503 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_object_size": "134217728", 2024-04-26T12:05:24.503 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-26T12:05:24.503 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-26T12:05:24.504 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_pg_blocked_by": "16", 2024-04-26T12:05:24.504 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_pg_log_entries": "10000", 2024-04-26T12:05:24.504 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-26T12:05:24.504 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_pgls": "1024", 2024-04-26T12:05:24.504 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_push_cost": "8388608", 2024-04-26T12:05:24.504 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_push_objects": "10", 2024-04-26T12:05:24.504 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_scrubs": "3", 2024-04-26T12:05:24.504 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-26T12:05:24.504 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_trimming_pgs": "2", 2024-04-26T12:05:24.504 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_write_op_reply_len": "64", 2024-04-26T12:05:24.504 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_write_size": "90", 2024-04-26T12:05:24.504 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-26T12:05:24.504 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-26T12:05:24.504 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-26T12:05:24.504 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-26T12:05:24.504 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-26T12:05:24.505 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-26T12:05:24.505 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-26T12:05:24.505 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-26T12:05:24.505 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_profile": "balanced", 2024-04-26T12:05:24.505 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-26T12:05:24.505 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-26T12:05:24.505 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-26T12:05:24.505 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-26T12:05:24.505 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-26T12:05:24.505 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-26T12:05:24.505 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-26T12:05:24.505 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-26T12:05:24.505 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-26T12:05:24.505 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-26T12:05:24.505 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-26T12:05:24.506 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_base": "805306368", 2024-04-26T12:05:24.506 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_cache_min": "134217728", 2024-04-26T12:05:24.506 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-26T12:05:24.506 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-26T12:05:24.506 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_target": "4294967296", 2024-04-26T12:05:24.506 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_target_autotune": "false", 2024-04-26T12:05:24.506 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-26T12:05:24.506 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_min_pg_log_entries": "250", 2024-04-26T12:05:24.506 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_min_recovery_priority": "0", 2024-04-26T12:05:24.506 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-26T12:05:24.506 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-26T12:05:24.506 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mon_report_interval": "5", 2024-04-26T12:05:24.506 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-26T12:05:24.506 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-26T12:05:24.507 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_num_cache_shards": "32", 2024-04-26T12:05:24.507 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_num_op_tracker_shard": "32", 2024-04-26T12:05:24.507 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_numa_auto_affinity": "true", 2024-04-26T12:05:24.507 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_numa_node": "-1", 2024-04-26T12:05:24.507 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_numa_prefer_iface": "true", 2024-04-26T12:05:24.507 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-26T12:05:24.507 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_objecter_finishers": "1", 2024-04-26T12:05:24.507 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_objectstore": "bluestore", 2024-04-26T12:05:24.507 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_objectstore_fuse": "false", 2024-04-26T12:05:24.507 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_objectstore_tracing": "false", 2024-04-26T12:05:24.507 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_complaint_time": "30.000000", 2024-04-26T12:05:24.507 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_history_duration": "600", 2024-04-26T12:05:24.507 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_history_size": "20", 2024-04-26T12:05:24.507 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_history_slow_op_size": "20", 2024-04-26T12:05:24.507 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-26T12:05:24.507 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_log_threshold": "5", 2024-04-26T12:05:24.508 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_num_shards": "0", 2024-04-26T12:05:24.508 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_num_shards_hdd": "5", 2024-04-26T12:05:24.508 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_num_shards_ssd": "8", 2024-04-26T12:05:24.508 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-26T12:05:24.508 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-26T12:05:24.508 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-26T12:05:24.508 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-26T12:05:24.508 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_pq_min_cost": "65536", 2024-04-26T12:05:24.508 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-26T12:05:24.508 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_queue_cut_off": "high", 2024-04-26T12:05:24.508 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-26T12:05:24.508 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_thread_timeout": "15", 2024-04-26T12:05:24.508 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_open_classes_on_start": "true", 2024-04-26T12:05:24.508 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_os_flags": "0", 2024-04-26T12:05:24.508 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_peering_op_priority": "255", 2024-04-26T12:05:24.509 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_delete_cost": "1048576", 2024-04-26T12:05:24.509 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_delete_priority": "5", 2024-04-26T12:05:24.509 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-26T12:05:24.509 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-26T12:05:24.509 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-26T12:05:24.509 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_log_trim_max": "10000", 2024-04-26T12:05:24.509 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_log_trim_min": "100", 2024-04-26T12:05:24.509 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-26T12:05:24.509 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-26T12:05:24.509 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_stat_report_interval_max": "500", 2024-04-26T12:05:24.509 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-26T12:05:24.509 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-26T12:05:24.509 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-26T12:05:24.509 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-26T12:05:24.509 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-26T12:05:24.510 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-26T12:05:24.510 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_crimson": "false", 2024-04-26T12:05:24.510 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-26T12:05:24.510 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-26T12:05:24.510 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-26T12:05:24.510 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-26T12:05:24.510 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-26T12:05:24.510 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-26T12:05:24.510 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-26T12:05:24.510 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-26T12:05:24.510 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_flags": "0", 2024-04-26T12:05:24.510 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-26T12:05:24.510 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_min_size": "0", 2024-04-26T12:05:24.510 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-26T12:05:24.511 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_pg_num": "32", 2024-04-26T12:05:24.511 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_pgp_num": "0", 2024-04-26T12:05:24.511 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-26T12:05:24.511 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_size": "2", 2024-04-26T12:05:24.511 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_type": "replicated", 2024-04-26T12:05:24.511 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-26T12:05:24.511 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-26T12:05:24.511 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_push_per_object_cost": "1000", 2024-04-26T12:05:24.511 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-26T12:05:24.511 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recover_clone_overlap": "true", 2024-04-26T12:05:24.511 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-26T12:05:24.511 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_cost": "20971520", 2024-04-26T12:05:24.511 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-26T12:05:24.511 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_max_active": "0", 2024-04-26T12:05:24.511 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-26T12:05:24.512 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-26T12:05:24.512 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-26T12:05:24.512 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-26T12:05:24.512 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_max_single_start": "1", 2024-04-26T12:05:24.512 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_op_priority": "3", 2024-04-26T12:05:24.512 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-26T12:05:24.512 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_priority": "5", 2024-04-26T12:05:24.512 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-26T12:05:24.512 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_sleep": "0.000000", 2024-04-26T12:05:24.512 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-26T12:05:24.512 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-26T12:05:24.512 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-26T12:05:24.512 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_repair_during_recovery": "false", 2024-04-26T12:05:24.512 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_requested_scrub_priority": "120", 2024-04-26T12:05:24.512 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-26T12:05:24.513 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-26T12:05:24.513 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_auto_repair": "false", 2024-04-26T12:05:24.513 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-26T12:05:24.513 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-26T12:05:24.513 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_begin_hour": "0", 2024-04-26T12:05:24.513 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_begin_week_day": "0", 2024-04-26T12:05:24.513 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_chunk_max": "25", 2024-04-26T12:05:24.513 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_chunk_min": "5", 2024-04-26T12:05:24.513 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_cost": "52428800", 2024-04-26T12:05:24.513 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_during_recovery": "false", 2024-04-26T12:05:24.513 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_end_hour": "0", 2024-04-26T12:05:24.513 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_end_week_day": "0", 2024-04-26T12:05:24.513 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_event_cost": "4096", 2024-04-26T12:05:24.513 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-26T12:05:24.513 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-26T12:05:24.513 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_invalid_stats": "true", 2024-04-26T12:05:24.514 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-26T12:05:24.514 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-26T12:05:24.514 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_max_preemptions": "5", 2024-04-26T12:05:24.514 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-26T12:05:24.514 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_priority": "5", 2024-04-26T12:05:24.514 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_reservation_timeout": "5000", 2024-04-26T12:05:24.514 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_sleep": "0.000000", 2024-04-26T12:05:24.514 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_slow_reservation_response": "2200", 2024-04-26T12:05:24.514 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-26T12:05:24.514 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-26T12:05:24.514 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-26T12:05:24.514 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_skip_data_digest": "false", 2024-04-26T12:05:24.514 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_smart_report_timeout": "5", 2024-04-26T12:05:24.514 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_snap_trim_cost": "1048576", 2024-04-26T12:05:24.514 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_snap_trim_priority": "5", 2024-04-26T12:05:24.515 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-26T12:05:24.515 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-26T12:05:24.515 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-26T12:05:24.515 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-26T12:05:24.515 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-26T12:05:24.515 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-26T12:05:24.515 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-26T12:05:24.515 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_target_transaction_size": "30", 2024-04-26T12:05:24.515 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-26T12:05:24.515 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-26T12:05:24.515 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-26T12:05:24.515 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-26T12:05:24.515 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-26T12:05:24.515 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-26T12:05:24.515 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-26T12:05:24.516 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-26T12:05:24.516 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-26T12:05:24.516 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-26T12:05:24.516 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tracing": "false", 2024-04-26T12:05:24.516 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_use_stale_snap": "false", 2024-04-26T12:05:24.516 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-26T12:05:24.516 INFO:teuthology.orchestra.run.smithi052.stdout: "osdc_blkin_trace_all": "false", 2024-04-26T12:05:24.516 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_kill_at": "0", 2024-04-26T12:05:24.516 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_max_join_drift": "10", 2024-04-26T12:05:24.516 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_min": "500", 2024-04-26T12:05:24.516 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_min_wait": "0.050000", 2024-04-26T12:05:24.516 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_propose_interval": "1.000000", 2024-04-26T12:05:24.516 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_service_trim_max": "500", 2024-04-26T12:05:24.516 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-26T12:05:24.516 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_service_trim_min": "250", 2024-04-26T12:05:24.517 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_stash_full_interval": "25", 2024-04-26T12:05:24.517 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_trim_max": "500", 2024-04-26T12:05:24.517 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_trim_min": "250", 2024-04-26T12:05:24.517 INFO:teuthology.orchestra.run.smithi052.stdout: "perf": "true", 2024-04-26T12:05:24.517 INFO:teuthology.orchestra.run.smithi052.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-26T12:05:24.517 INFO:teuthology.orchestra.run.smithi052.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-26T12:05:24.517 INFO:teuthology.orchestra.run.smithi052.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-04-26T12:05:24.517 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "-", 2024-04-26T12:05:24.517 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrv": "", 2024-04-26T12:05:24.517 INFO:teuthology.orchestra.run.smithi052.stdout: "public_bind_addr": "-", 2024-04-26T12:05:24.517 INFO:teuthology.orchestra.run.smithi052.stdout: "public_network": "", 2024-04-26T12:05:24.517 INFO:teuthology.orchestra.run.smithi052.stdout: "public_network_interface": "", 2024-04-26T12:05:24.517 INFO:teuthology.orchestra.run.smithi052.stdout: "qat_compressor_enabled": "false", 2024-04-26T12:05:24.517 INFO:teuthology.orchestra.run.smithi052.stdout: "qat_compressor_session_max_number": "256", 2024-04-26T12:05:24.517 INFO:teuthology.orchestra.run.smithi052.stdout: "rados_mon_op_timeout": "0", 2024-04-26T12:05:24.518 INFO:teuthology.orchestra.run.smithi052.stdout: "rados_osd_op_timeout": "0", 2024-04-26T12:05:24.518 INFO:teuthology.orchestra.run.smithi052.stdout: "rados_tracing": "false", 2024-04-26T12:05:24.518 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_atime_update_interval": "60", 2024-04-26T12:05:24.518 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-26T12:05:24.518 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_balance_parent_reads": "false", 2024-04-26T12:05:24.518 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_balance_snap_reads": "false", 2024-04-26T12:05:24.518 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_blkin_trace_all": "false", 2024-04-26T12:05:24.518 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-26T12:05:24.518 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-26T12:05:24.518 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache": "true", 2024-04-26T12:05:24.518 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-26T12:05:24.518 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-26T12:05:24.518 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-26T12:05:24.518 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-26T12:05:24.518 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_policy": "writearound", 2024-04-26T12:05:24.519 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_size": "33554432", 2024-04-26T12:05:24.519 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-26T12:05:24.519 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-26T12:05:24.519 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_clone_copy_on_read": "false", 2024-04-26T12:05:24.519 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_compression_hint": "none", 2024-04-26T12:05:24.519 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_concurrent_management_ops": "10", 2024-04-26T12:05:24.519 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-26T12:05:24.519 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_clone_format": "auto", 2024-04-26T12:05:24.519 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_data_pool": "", 2024-04-26T12:05:24.519 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_features": "61", 2024-04-26T12:05:24.519 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_format": "2", 2024-04-26T12:05:24.519 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_map_options": "", 2024-04-26T12:05:24.519 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_order": "22", 2024-04-26T12:05:24.519 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_pool": "rbd", 2024-04-26T12:05:24.519 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-26T12:05:24.520 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_stripe_count": "0", 2024-04-26T12:05:24.520 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_stripe_unit": "0", 2024-04-26T12:05:24.520 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-26T12:05:24.520 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-26T12:05:24.520 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-26T12:05:24.520 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_enable_alloc_hint": "true", 2024-04-26T12:05:24.520 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-26T12:05:24.520 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_io_scheduler": "simple", 2024-04-26T12:05:24.520 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-26T12:05:24.520 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-26T12:05:24.520 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-26T12:05:24.520 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-26T12:05:24.520 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-26T12:05:24.520 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-26T12:05:24.520 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-26T12:05:24.520 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-26T12:05:24.521 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-26T12:05:24.521 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_order": "24", 2024-04-26T12:05:24.521 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_pool": "", 2024-04-26T12:05:24.521 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_splay_width": "4", 2024-04-26T12:05:24.521 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_localize_parent_reads": "false", 2024-04-26T12:05:24.521 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_localize_snap_reads": "false", 2024-04-26T12:05:24.521 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-26T12:05:24.521 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-26T12:05:24.521 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-26T12:05:24.521 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-26T12:05:24.521 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-26T12:05:24.521 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-26T12:05:24.521 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-26T12:05:24.521 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-26T12:05:24.521 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-26T12:05:24.522 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-26T12:05:24.522 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-26T12:05:24.522 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-26T12:05:24.522 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-26T12:05:24.522 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-26T12:05:24.522 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-26T12:05:24.522 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-26T12:05:24.522 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-26T12:05:24.522 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-26T12:05:24.522 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-26T12:05:24.522 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-26T12:05:24.522 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-26T12:05:24.522 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-26T12:05:24.522 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-26T12:05:24.522 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-26T12:05:24.523 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-26T12:05:24.523 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-26T12:05:24.523 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-26T12:05:24.523 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-26T12:05:24.523 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-26T12:05:24.523 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-26T12:05:24.523 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-26T12:05:24.523 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mtime_update_interval": "60", 2024-04-26T12:05:24.523 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_non_blocking_aio": "true", 2024-04-26T12:05:24.523 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_op_thread_timeout": "60", 2024-04-26T12:05:24.523 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_op_threads": "1", 2024-04-26T12:05:24.523 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_parent_cache_enabled": "false", 2024-04-26T12:05:24.523 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-26T12:05:24.523 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-26T12:05:24.523 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-26T12:05:24.524 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_plugins": "", 2024-04-26T12:05:24.524 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_bps_burst": "0", 2024-04-26T12:05:24.524 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-26T12:05:24.524 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_bps_limit": "0", 2024-04-26T12:05:24.524 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_exclude_ops": "0", 2024-04-26T12:05:24.524 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_iops_burst": "0", 2024-04-26T12:05:24.524 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-26T12:05:24.524 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_iops_limit": "0", 2024-04-26T12:05:24.524 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-26T12:05:24.524 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-26T12:05:24.524 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-26T12:05:24.524 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-26T12:05:24.524 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-26T12:05:24.524 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-26T12:05:24.524 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-26T12:05:24.525 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-26T12:05:24.525 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-26T12:05:24.525 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-26T12:05:24.525 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-26T12:05:24.525 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-26T12:05:24.525 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-26T12:05:24.525 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-26T12:05:24.525 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_read_from_replica_policy": "default", 2024-04-26T12:05:24.525 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-26T12:05:24.525 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-26T12:05:24.525 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-26T12:05:24.525 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-26T12:05:24.525 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_skip_partial_discard": "true", 2024-04-26T12:05:24.525 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-26T12:05:24.525 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_tracing": "false", 2024-04-26T12:05:24.526 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_validate_names": "true", 2024-04-26T12:05:24.526 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_validate_pool": "true", 2024-04-26T12:05:24.526 INFO:teuthology.orchestra.run.smithi052.stdout: "restapi_base_url": "", 2024-04-26T12:05:24.526 INFO:teuthology.orchestra.run.smithi052.stdout: "restapi_log_level": "", 2024-04-26T12:05:24.526 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_acl_grants_max_num": "100", 2024-04-26T12:05:24.526 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_admin_entry": "admin", 2024-04-26T12:05:24.526 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-26T12:05:24.526 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_backend_store": "rados", 2024-04-26T12:05:24.526 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_barbican_url": "", 2024-04-26T12:05:24.526 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_beast_enable_async": "true", 2024-04-26T12:05:24.526 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-26T12:05:24.526 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-26T12:05:24.526 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-26T12:05:24.526 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-26T12:05:24.527 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-26T12:05:24.527 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-26T12:05:24.527 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-26T12:05:24.527 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_cache_enabled": "true", 2024-04-26T12:05:24.527 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_cache_expiry_interval": "900", 2024-04-26T12:05:24.527 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_cache_lru_size": "10000", 2024-04-26T12:05:24.527 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_config_store": "rados", 2024-04-26T12:05:24.527 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_content_length_compat": "false", 2024-04-26T12:05:24.527 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_copy_obj_progress": "true", 2024-04-26T12:05:24.527 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-26T12:05:24.527 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_cors_rules_max_num": "100", 2024-04-26T12:05:24.527 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_cross_domain_policy": "", 2024-04-26T12:05:24.527 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-26T12:05:24.527 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_addr": "", 2024-04-26T12:05:24.527 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-26T12:05:24.528 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-26T12:05:24.528 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-26T12:05:24.528 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-26T12:05:24.528 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_password": "", 2024-04-26T12:05:24.528 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-26T12:05:24.528 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_username": "", 2024-04-26T12:05:24.528 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_require_ssl": "true", 2024-04-26T12:05:24.528 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-26T12:05:24.528 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-26T12:05:24.528 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-26T12:05:24.528 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-26T12:05:24.528 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-26T12:05:24.528 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-26T12:05:24.528 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-26T12:05:24.528 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-26T12:05:24.529 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-26T12:05:24.529 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-26T12:05:24.529 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-26T12:05:24.529 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-26T12:05:24.529 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-26T12:05:24.529 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-26T12:05:24.529 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-26T12:05:24.529 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_addr": "", 2024-04-26T12:05:24.529 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_auth": "token", 2024-04-26T12:05:24.529 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_namespace": "", 2024-04-26T12:05:24.529 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_prefix": "", 2024-04-26T12:05:24.529 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-26T12:05:24.529 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-26T12:05:24.529 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-26T12:05:24.530 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-26T12:05:24.530 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_token_file": "", 2024-04-26T12:05:24.530 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-26T12:05:24.530 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_curl_buffersize": "524288", 2024-04-26T12:05:24.530 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-26T12:05:24.530 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_curl_low_speed_time": "300", 2024-04-26T12:05:24.530 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-26T12:05:24.530 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-26T12:05:24.530 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-26T12:05:24.530 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-26T12:05:24.530 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-26T12:05:24.530 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-26T12:05:24.530 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-26T12:05:24.530 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-26T12:05:24.530 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_log_changes_size": "1000", 2024-04-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_log_num_shards": "128", 2024-04-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_log_window": "30", 2024-04-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-26T12:05:24.532 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-26T12:05:24.532 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-26T12:05:24.532 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-26T12:05:24.532 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-26T12:05:24.532 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-26T12:05:24.532 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-26T12:05:24.532 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-26T12:05:24.532 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-26T12:05:24.532 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-26T12:05:24.532 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-26T12:05:24.532 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-26T12:05:24.532 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-26T12:05:24.532 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-26T12:05:24.532 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-26T12:05:24.532 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-26T12:05:24.533 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dns_name": "", 2024-04-26T12:05:24.533 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dns_s3website_name": "", 2024-04-26T12:05:24.533 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dynamic_resharding": "true", 2024-04-26T12:05:24.533 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-26T12:05:24.533 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_gc_threads": "true", 2024-04-26T12:05:24.533 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_lc_threads": "true", 2024-04-26T12:05:24.533 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_ops_log": "false", 2024-04-26T12:05:24.533 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_quota_threads": "true", 2024-04-26T12:05:24.533 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_static_website": "false", 2024-04-26T12:05:24.533 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_usage_log": "false", 2024-04-26T12:05:24.533 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enforce_swift_acls": "true", 2024-04-26T12:05:24.533 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_exit_timeout_secs": "120", 2024-04-26T12:05:24.533 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_expose_bucket": "false", 2024-04-26T12:05:24.533 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_extended_http_attrs": "", 2024-04-26T12:05:24.533 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_filter": "none", 2024-04-26T12:05:24.534 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-26T12:05:24.534 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_frontends": "beast port=7480", 2024-04-26T12:05:24.534 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-26T12:05:24.534 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_max_deferred": "50", 2024-04-26T12:05:24.534 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-26T12:05:24.534 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_max_objs": "32", 2024-04-26T12:05:24.534 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-26T12:05:24.534 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-26T12:05:24.534 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-26T12:05:24.534 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-26T12:05:24.534 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_processor_period": "3600", 2024-04-26T12:05:24.534 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-26T12:05:24.534 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-26T12:05:24.534 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-26T12:05:24.534 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-26T12:05:24.535 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_init_timeout": "300", 2024-04-26T12:05:24.535 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-26T12:05:24.535 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-26T12:05:24.535 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-26T12:05:24.535 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-26T12:05:24.535 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_domain": "", 2024-04-26T12:05:24.535 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_password": "", 2024-04-26T12:05:24.535 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_password_path": "", 2024-04-26T12:05:24.535 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_project": "", 2024-04-26T12:05:24.535 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_tenant": "", 2024-04-26T12:05:24.535 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_token": "", 2024-04-26T12:05:24.535 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_token_path": "", 2024-04-26T12:05:24.535 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_user": "", 2024-04-26T12:05:24.535 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_api_version": "2", 2024-04-26T12:05:24.535 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_barbican_domain": "", 2024-04-26T12:05:24.535 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_barbican_password": "", 2024-04-26T12:05:24.536 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_barbican_project": "", 2024-04-26T12:05:24.536 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-26T12:05:24.536 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_barbican_user": "", 2024-04-26T12:05:24.536 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-26T12:05:24.536 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-26T12:05:24.536 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-26T12:05:24.536 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-26T12:05:24.536 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-26T12:05:24.536 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_url": "", 2024-04-26T12:05:24.536 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-26T12:05:24.536 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_debug_interval": "-1", 2024-04-26T12:05:24.536 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_lock_max_time": "90", 2024-04-26T12:05:24.536 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_max_objs": "32", 2024-04-26T12:05:24.536 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_max_rules": "1000", 2024-04-26T12:05:24.536 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_max_worker": "3", 2024-04-26T12:05:24.537 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-26T12:05:24.537 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_thread_delay": "0", 2024-04-26T12:05:24.537 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-26T12:05:24.537 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ldap_dnattr": "uid", 2024-04-26T12:05:24.537 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-26T12:05:24.537 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ldap_searchfilter": "", 2024-04-26T12:05:24.537 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-26T12:05:24.537 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ldap_uri": "ldaps://", 2024-04-26T12:05:24.537 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-26T12:05:24.537 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-26T12:05:24.537 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-26T12:05:24.537 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_log_http_headers": "", 2024-04-26T12:05:24.537 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-26T12:05:24.537 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-26T12:05:24.538 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_log_object_name_utc": "false", 2024-04-26T12:05:24.538 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2024-04-26T12:05:24.538 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_attr_name_len": "0", 2024-04-26T12:05:24.538 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_attr_size": "0", 2024-04-26T12:05:24.538 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-26T12:05:24.538 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_chunk_size": "4194304", 2024-04-26T12:05:24.538 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-26T12:05:24.538 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-26T12:05:24.538 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-26T12:05:24.538 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_listing_results": "1000", 2024-04-26T12:05:24.538 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_notify_retries": "10", 2024-04-26T12:05:24.538 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-26T12:05:24.538 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_put_param_size": "1048576", 2024-04-26T12:05:24.538 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_put_size": "5368709120", 2024-04-26T12:05:24.539 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_slo_entries": "1000", 2024-04-26T12:05:24.539 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_md_log_max_shards": "64", 2024-04-26T12:05:24.539 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-26T12:05:24.539 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-26T12:05:24.539 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-26T12:05:24.539 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-26T12:05:24.539 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_mp_lock_max_time": "600", 2024-04-26T12:05:24.539 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-26T12:05:24.539 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-26T12:05:24.539 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-26T12:05:24.539 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-26T12:05:24.539 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-26T12:05:24.539 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-26T12:05:24.539 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-26T12:05:24.539 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-26T12:05:24.540 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_max_gc": "300", 2024-04-26T12:05:24.540 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-26T12:05:24.540 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-26T12:05:24.540 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-26T12:05:24.540 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-26T12:05:24.540 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-26T12:05:24.540 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-26T12:05:24.540 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-26T12:05:24.540 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_num_async_rados_threads": "32", 2024-04-26T12:05:24.540 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_num_control_oids": "8", 2024-04-26T12:05:24.540 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_numa_node": "-1", 2024-04-26T12:05:24.540 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-26T12:05:24.540 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-26T12:05:24.540 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_objexp_chunk_size": "100", 2024-04-26T12:05:24.540 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_objexp_gc_interval": "600", 2024-04-26T12:05:24.540 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-26T12:05:24.541 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-26T12:05:24.541 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-26T12:05:24.541 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_op_thread_timeout": "600", 2024-04-26T12:05:24.541 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_op_tracing": "false", 2024-04-26T12:05:24.541 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_opa_token": "", 2024-04-26T12:05:24.541 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_opa_url": "", 2024-04-26T12:05:24.541 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_opa_verify_ssl": "true", 2024-04-26T12:05:24.541 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-26T12:05:24.541 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-26T12:05:24.542 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ops_log_rados": "false", 2024-04-26T12:05:24.542 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ops_log_socket_path": "", 2024-04-26T12:05:24.542 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-26T12:05:24.542 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-26T12:05:24.542 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-26T12:05:24.542 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_period_push_interval": "2.000000", 2024-04-26T12:05:24.542 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-26T12:05:24.542 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-26T12:05:24.542 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-26T12:05:24.542 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_print_continue": "true", 2024-04-26T12:05:24.542 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-26T12:05:24.542 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-26T12:05:24.542 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-26T12:05:24.542 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-26T12:05:24.543 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-26T12:05:24.543 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_rados_tracing": "false", 2024-04-26T12:05:24.543 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_realm": "", 2024-04-26T12:05:24.543 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_realm_id": "", 2024-04-26T12:05:24.543 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-26T12:05:24.543 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_region": "", 2024-04-26T12:05:24.543 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-26T12:05:24.543 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-26T12:05:24.543 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-26T12:05:24.543 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-26T12:05:24.543 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_request_uri": "", 2024-04-26T12:05:24.543 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_reshard_batch_size": "64", 2024-04-26T12:05:24.543 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-26T12:05:24.543 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_reshard_max_aio": "128", 2024-04-26T12:05:24.543 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_reshard_num_logs": "16", 2024-04-26T12:05:24.544 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_reshard_thread_interval": "600", 2024-04-26T12:05:24.544 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_resolve_cname": "false", 2024-04-26T12:05:24.544 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-26T12:05:24.544 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_run_sync_thread": "true", 2024-04-26T12:05:24.544 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-26T12:05:24.544 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-26T12:05:24.544 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-26T12:05:24.544 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-26T12:05:24.544 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-26T12:05:24.544 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-26T12:05:24.544 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-26T12:05:24.544 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-26T12:05:24.544 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_scheduler_type": "throttler", 2024-04-26T12:05:24.544 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_script_uri": "", 2024-04-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_service_provider_name": "", 2024-04-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_client_id": "", 2024-04-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_client_secret": "", 2024-04-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_entry": "sts", 2024-04-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_key": "sts", 2024-04-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_min_session_duration": "900", 2024-04-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_token_introspection_url": "", 2024-04-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_account_in_url": "false", 2024-04-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_auth_entry": "auth", 2024-04-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_auth_url": "", 2024-04-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_custom_header": "", 2024-04-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_need_stats": "true", 2024-04-26T12:05:24.546 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_tenant_name": "", 2024-04-26T12:05:24.546 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_token_expiration": "86400", 2024-04-26T12:05:24.546 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_url": "", 2024-04-26T12:05:24.546 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_url_prefix": "swift", 2024-04-26T12:05:24.546 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-26T12:05:24.546 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-26T12:05:24.546 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-26T12:05:24.546 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_lease_period": "120", 2024-04-26T12:05:24.546 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-26T12:05:24.546 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-26T12:05:24.546 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_thread_pool_size": "512", 2024-04-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_comment": "", 2024-04-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_createby": "", 2024-04-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_encoding": "", 2024-04-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_flag": "false", 2024-04-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_origin": "", 2024-04-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_tracker": "", 2024-04-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_trust_forwarded_https": "false", 2024-04-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_usage_max_shards": "32", 2024-04-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_usage_max_user_shards": "1", 2024-04-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_use_opa_authz": "false", 2024-04-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_max_buckets": "1000", 2024-04-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_policies_max_num": "100", 2024-04-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_unique_email": "true", 2024-04-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_verify_ssl": "true", 2024-04-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_zone": "", 2024-04-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_zone_id": "", 2024-04-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_zonegroup": "", 2024-04-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_zonegroup_id": "", 2024-04-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rgwlc_auto_session_clear": "true", 2024-04-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_block_size": "4096", 2024-04-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-26T12:05:24.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-26T12:05:24.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cache_size": "536870912", 2024-04-26T12:05:24.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-26T12:05:24.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-26T12:05:24.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-26T12:05:24.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-26T12:05:24.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-26T12:05:24.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-26T12:05:24.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-26T12:05:24.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-26T12:05:24.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_index_type": "binary_search", 2024-04-26T12:05:24.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-26T12:05:24.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_partition_filters": "false", 2024-04-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_perf": "false", 2024-04-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi052.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi052.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi052.stdout: "run_dir": "/var/run/ceph", 2024-04-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_block_create": "true", 2024-04-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_cache_lru_size": "67108864", 2024-04-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_default_max_object_size": "16777216", 2024-04-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_device_size": "53687091200", 2024-04-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_journal_batch_capacity": "16", 2024-04-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-26T12:05:24.552 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-26T12:05:24.552 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_main_device_type": "SSD", 2024-04-26T12:05:24.552 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-26T12:05:24.552 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-26T12:05:24.552 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-26T12:05:24.552 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-26T12:05:24.552 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-26T12:05:24.552 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_segment_size": "67108864", 2024-04-26T12:05:24.552 INFO:teuthology.orchestra.run.smithi052.stdout: "set_keepcaps": "false", 2024-04-26T12:05:24.552 INFO:teuthology.orchestra.run.smithi052.stdout: "setgroup": "", 2024-04-26T12:05:24.552 INFO:teuthology.orchestra.run.smithi052.stdout: "setuser": "", 2024-04-26T12:05:24.552 INFO:teuthology.orchestra.run.smithi052.stdout: "setuser_match_path": "", 2024-04-26T12:05:24.552 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-26T12:05:24.552 INFO:teuthology.orchestra.run.smithi052.stdout: "thp": "false", 2024-04-26T12:05:24.552 INFO:teuthology.orchestra.run.smithi052.stdout: "threadpool_default_timeout": "60", 2024-04-26T12:05:24.553 INFO:teuthology.orchestra.run.smithi052.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-26T12:05:24.553 INFO:teuthology.orchestra.run.smithi052.stdout: "throttler_perf_counter": "true" 2024-04-26T12:05:24.553 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-26T12:05:24.555 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-26T12:05:24.668 INFO:teuthology.orchestra.run.smithi052.stdout:mon.a: {} 2024-04-26T12:05:24.669 INFO:teuthology.orchestra.run.smithi052.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:05:24.677 INFO:teuthology.orchestra.run.smithi052.stdout:mon.b: {} 2024-04-26T12:05:24.677 INFO:teuthology.orchestra.run.smithi052.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:05:24.686 INFO:teuthology.orchestra.run.smithi052.stdout:mon.c: {} 2024-04-26T12:05:24.686 INFO:teuthology.orchestra.run.smithi052.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:05:24.696 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-04-26T12:05:24.696 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-26T12:05:24.726 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-26T12:05:24.726 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-26T12:05:24.726 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-26T12:05:24.726 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T12:05:24.726 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T12:05:24.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:05:24.727 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-04-26T12:05:24.727 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-26T12:05:24.728 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:05:24.728 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T12:05:24.728 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-26T12:05:24.729 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-26T12:05:24.729 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:05:24.729 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-26T12:05:24.730 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:24.730 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-26T12:05:24.730 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:05:24.732 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:24.728+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:24.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:05:24.748 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2024-04-26T12:05:24.816 INFO:teuthology.orchestra.run.smithi052.stderr:Cannot find device "ceph-brx" 2024-04-26T12:05:24.817 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:05:24.818 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-26T12:05:24.818 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T12:05:24.830 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:24.829+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:24.846 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:24.846 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:24.846 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:05:24.846 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:24.855 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:24.869 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:05:24.869 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:05:24.887 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T12:05:24.887 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:05:24.905 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:05:24.905 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:05:24.931 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:24.930+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:24.959 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:24.959 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:24.968 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:25.052 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:25.051+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:25.110 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:25.110 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:25.119 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:25.160 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:25.159+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:25.234 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:25.234 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:25.234 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:25.233+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:25.236 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T12:05:25.243 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:25.249 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T12:05:25.249 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T12:05:25.249 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-04-26T12:05:25.249 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T12:05:25.249 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T12:05:25.249 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T12:05:25.249 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T12:05:25.249 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T12:05:25.249 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T12:05:25.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:05:25.250 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-04-26T12:05:25.265 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T12:05:25.265 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T12:05:25.265 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T12:05:25.265 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-04-26T12:05:25.265 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-04-26T12:05:25.266 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-04-26T12:05:25.266 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T12:05:25.266 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-04-26T12:05:25.266 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-04-26T12:05:25.266 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T12:05:25.266 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-04-26T12:05:25.266 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-04-26T12:05:25.266 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T12:05:25.266 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-04-26T12:05:25.266 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-04-26T12:05:25.266 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-26T12:05:25.266 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42657sec preferred_lft 42657sec 2024-04-26T12:05:25.266 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link noprefixroute 2024-04-26T12:05:25.266 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-04-26T12:05:25.267 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T12:05:25.267 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-04-26T12:05:25.267 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-04-26T12:05:25.267 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T12:05:25.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:05:25.267 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2024-04-26T12:05:25.267 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-04-26T12:05:25.267 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add name ceph-brx type bridge 2024-04-26T12:05:25.268 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr flush dev ceph-brx 2024-04-26T12:05:25.268 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set ceph-brx up 2024-04-26T12:05:25.268 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T12:05:25.268 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-04-26T12:05:25.335 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:25.334+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:25.386 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:25.387 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:25.395 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:25.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:05:25.407 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T12:05:25.430 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-04-26T12:05:25.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:05:25.432 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-04-26T12:05:25.436 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:25.435+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:25.496 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:25.496 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:25.505 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:25.509 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-04-26T12:05:25.509 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T12:05:25.509 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-26T12:05:25.509 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-26T12:05:25.509 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T12:05:25.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:05:25.509 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2024-04-26T12:05:25.510 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-04-26T12:05:25.510 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-26T12:05:25.510 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-26T12:05:25.510 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-26T12:05:25.510 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-04-26T12:05:25.536 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:25.536+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:25.619 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:25.619 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:25.629 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:25.637 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:25.637+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:25.731 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:25.731 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:25.738 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:25.737+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:25.740 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:25.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:05:25.742 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-04-26T12:05:25.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:05:25.759 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list-id 2024-04-26T12:05:25.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:05:25.815 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2024-04-26T12:05:25.815 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-04-26T12:05:25.815 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T12:05:25.815 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-26T12:05:25.815 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-04-26T12:05:25.830 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T12:05:25.830 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-26T12:05:25.839 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:25.838+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:25.843 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:25.843 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:25.844 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T12:05:25.852 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:25.869 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-26T12:05:25.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:05:25.870 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2024-04-26T12:05:25.870 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-04-26T12:05:25.870 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-26T12:05:25.870 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T12:05:25.870 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-26T12:05:25.870 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-26T12:05:25.870 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-26T12:05:25.870 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-04-26T12:05:25.939 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:25.938+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:25.965 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:25.965 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:25.974 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:26.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:05:26.026 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2024-04-26T12:05:26.026 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-04-26T12:05:26.026 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-04-26T12:05:26.026 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T12:05:26.026 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-04-26T12:05:26.041 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:26.040+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:26.065 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-26T12:05:26.065 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T12:05:26.065 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T12:05:26.077 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:26.077 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:26.087 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:26.120 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T12:05:26.120 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T12:05:26.120 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T12:05:26.142 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:26.140+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:26.176 DEBUG:teuthology.orchestra.run.smithi052:> sudo modprobe fuse 2024-04-26T12:05:26.188 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:26.188 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:26.198 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:26.242 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-26T12:05:26.243 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-26T12:05:26.243 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:26.241+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:26.300 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:26.301 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:26.307 INFO:teuthology.orchestra.run.smithi052.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-26T12:05:26.308 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-26T12:05:26.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:05:26.309 DEBUG:teuthology.orchestra.run.smithi052:> ls /sys/fs/fuse/connections 2024-04-26T12:05:26.310 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:26.353 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:26.352+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:26.364 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T12:05:26.364 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-26T12:05:26.406 DEBUG:teuthology.orchestra.run.smithi052:> sudo modprobe fuse 2024-04-26T12:05:26.410 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:26.410 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:26.419 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:26.429 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-26T12:05:26.430 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-26T12:05:26.460 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:26.459+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:26.495 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-26T12:05:26.496 INFO:teuthology.orchestra.run.smithi052.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-26T12:05:26.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:05:26.496 DEBUG:teuthology.orchestra.run.smithi052:> ls /sys/fs/fuse/connections 2024-04-26T12:05:26.497 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:2024-04-26T12:05:26.496+0000 7f0c8030e480 -1 init, newargv = 0x562ad2c5e870 newargc=15 2024-04-26T12:05:26.497 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:ceph-fuse[31800]: starting ceph client 2024-04-26T12:05:26.502 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:ceph-fuse[31800]: starting fuse 2024-04-26T12:05:26.512 INFO:teuthology.orchestra.run.smithi052.stdout:43 2024-04-26T12:05:26.512 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-26T12:05:26.512 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-26T12:05:26.512 DEBUG:teuthology.orchestra.run.smithi052:> import glob 2024-04-26T12:05:26.512 DEBUG:teuthology.orchestra.run.smithi052:> import re 2024-04-26T12:05:26.513 DEBUG:teuthology.orchestra.run.smithi052:> import os 2024-04-26T12:05:26.513 DEBUG:teuthology.orchestra.run.smithi052:> import subprocess 2024-04-26T12:05:26.513 DEBUG:teuthology.orchestra.run.smithi052:> 2024-04-26T12:05:26.513 DEBUG:teuthology.orchestra.run.smithi052:> def _find_admin_socket(client_name): 2024-04-26T12:05:26.513 DEBUG:teuthology.orchestra.run.smithi052:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-26T12:05:26.513 DEBUG:teuthology.orchestra.run.smithi052:> files = glob.glob(asok_path) 2024-04-26T12:05:26.513 DEBUG:teuthology.orchestra.run.smithi052:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-26T12:05:26.513 DEBUG:teuthology.orchestra.run.smithi052:> 2024-04-26T12:05:26.513 DEBUG:teuthology.orchestra.run.smithi052:> # Given a non-glob path, it better be there 2024-04-26T12:05:26.513 DEBUG:teuthology.orchestra.run.smithi052:> if "*" not in asok_path: 2024-04-26T12:05:26.513 DEBUG:teuthology.orchestra.run.smithi052:> assert(len(files) == 1) 2024-04-26T12:05:26.514 DEBUG:teuthology.orchestra.run.smithi052:> return files[0] 2024-04-26T12:05:26.514 DEBUG:teuthology.orchestra.run.smithi052:> 2024-04-26T12:05:26.514 DEBUG:teuthology.orchestra.run.smithi052:> for f in files: 2024-04-26T12:05:26.514 DEBUG:teuthology.orchestra.run.smithi052:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T12:05:26.514 DEBUG:teuthology.orchestra.run.smithi052:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T12:05:26.514 DEBUG:teuthology.orchestra.run.smithi052:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T12:05:26.514 DEBUG:teuthology.orchestra.run.smithi052:> contents = proc_f.read() 2024-04-26T12:05:26.514 DEBUG:teuthology.orchestra.run.smithi052:> if mountpoint in contents: 2024-04-26T12:05:26.514 DEBUG:teuthology.orchestra.run.smithi052:> return f 2024-04-26T12:05:26.514 DEBUG:teuthology.orchestra.run.smithi052:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T12:05:26.514 DEBUG:teuthology.orchestra.run.smithi052:> 2024-04-26T12:05:26.514 DEBUG:teuthology.orchestra.run.smithi052:> print(_find_admin_socket("client.0")) 2024-04-26T12:05:26.514 DEBUG:teuthology.orchestra.run.smithi052:> ' 2024-04-26T12:05:26.545 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:26.544+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:26.561 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:26.561 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:26.569 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:26.628 INFO:teuthology.orchestra.run.smithi052.stdout:/var/run/ceph/ceph-client.0.31800.asok 2024-04-26T12:05:26.646 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:26.645+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:26.683 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:26.683 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:26.693 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:26.747 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:26.747+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:26.813 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.31800.asok 2024-04-26T12:05:26.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:05:26.814 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.31800.asok status 2024-04-26T12:05:26.830 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T12:05:26.835 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:26.835 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:26.844 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:26.845 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T12:05:26.848 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:26.847+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:26.918 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:05:26.928 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-26T12:05:26.928 INFO:teuthology.orchestra.run.smithi052.stdout: "metadata": { 2024-04-26T12:05:26.928 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_sha1": "dc093b5e41f728edab6e0330295fdf9156d31664", 2024-04-26T12:05:26.928 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_version": "ceph version 18.2.2-1256-gdc093b5e (dc093b5e41f728edab6e0330295fdf9156d31664) reef (stable)", 2024-04-26T12:05:26.928 INFO:teuthology.orchestra.run.smithi052.stdout: "entity_id": "0", 2024-04-26T12:05:26.928 INFO:teuthology.orchestra.run.smithi052.stdout: "hostname": "smithi052", 2024-04-26T12:05:26.928 INFO:teuthology.orchestra.run.smithi052.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-26T12:05:26.928 INFO:teuthology.orchestra.run.smithi052.stdout: "pid": "31800", 2024-04-26T12:05:26.929 INFO:teuthology.orchestra.run.smithi052.stdout: "root": "/" 2024-04-26T12:05:26.929 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:26.929 INFO:teuthology.orchestra.run.smithi052.stdout: "dentry_count": 0, 2024-04-26T12:05:26.929 INFO:teuthology.orchestra.run.smithi052.stdout: "dentry_pinned_count": 0, 2024-04-26T12:05:26.929 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4564, 2024-04-26T12:05:26.929 INFO:teuthology.orchestra.run.smithi052.stdout: "inst": { 2024-04-26T12:05:26.929 INFO:teuthology.orchestra.run.smithi052.stdout: "name": { 2024-04-26T12:05:26.929 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "client", 2024-04-26T12:05:26.929 INFO:teuthology.orchestra.run.smithi052.stdout: "num": 4564 2024-04-26T12:05:26.929 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:26.929 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": { 2024-04-26T12:05:26.929 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:26.929 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "192.168.0.1:0", 2024-04-26T12:05:26.929 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 1869161429 2024-04-26T12:05:26.929 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:26.930 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:26.930 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": { 2024-04-26T12:05:26.930 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:26.930 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "192.168.0.1:0", 2024-04-26T12:05:26.930 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 1869161429 2024-04-26T12:05:26.930 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:26.930 INFO:teuthology.orchestra.run.smithi052.stdout: "inst_str": "client.4564 192.168.0.1:0/1869161429", 2024-04-26T12:05:26.930 INFO:teuthology.orchestra.run.smithi052.stdout: "addr_str": "192.168.0.1:0/1869161429", 2024-04-26T12:05:26.930 INFO:teuthology.orchestra.run.smithi052.stdout: "inode_count": 1, 2024-04-26T12:05:26.930 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_epoch": 5, 2024-04-26T12:05:26.930 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_epoch": 19, 2024-04-26T12:05:26.930 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_epoch_barrier": 0, 2024-04-26T12:05:26.930 INFO:teuthology.orchestra.run.smithi052.stdout: "blocklisted": false, 2024-04-26T12:05:26.930 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs" 2024-04-26T12:05:26.931 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-26T12:05:26.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:05:26.937 DEBUG:teuthology.orchestra.run.smithi052:> stat --file-system '--printf=%T 2024-04-26T12:05:26.937 DEBUG:teuthology.orchestra.run.smithi052:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-26T12:05:26.947 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:26.947 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:26.949 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:26.948+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:26.956 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:26.996 INFO:teuthology.orchestra.run.smithi052.stdout:fuseblk 2024-04-26T12:05:26.996 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-26T12:05:26.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:05:26.997 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T12:05:27.050 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:27.049+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:27.059 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:05:27.059 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:05:27.062 INFO:teuthology.run_tasks:Running task workunit... 2024-04-26T12:05:27.076 INFO:tasks.workunit:Pulling workunits from ref 7d2137f0a666c92a9411c1af5c33e4968be54da6 2024-04-26T12:05:27.077 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-26T12:05:27.077 INFO:tasks.workunit:timeout=3h 2024-04-26T12:05:27.077 INFO:tasks.workunit:cleanup=True 2024-04-26T12:05:27.077 DEBUG:teuthology.orchestra.run.smithi052:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-26T12:05:27.078 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T12:05:27.079 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:05:27.079 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:27.080 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:27.080 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:05:27.080 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:27.080 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:27.095 INFO:teuthology.orchestra.run.smithi052.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-26T12:05:27.095 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-26T12:05:27.095 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 2bh/43d Inode: 1 Links: 2 2024-04-26T12:05:27.095 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:05:27.095 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-26T12:05:27.095 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-26T12:05:27.095 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-04-26 12:05:03.777069905 +0000 2024-04-26T12:05:27.095 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-04-26 12:05:27.059962579 +0000 2024-04-26T12:05:27.095 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2024-04-26T12:05:27.096 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-26T12:05:27.096 DEBUG:teuthology.orchestra.run.smithi052:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-26T12:05:27.097 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:05:27.097 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:05:27.125 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7d2137f0a666c92a9411c1af5c33e4968be54da6 2024-04-26T12:05:27.152 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:27.151+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:27.181 INFO:tasks.workunit.client.0.smithi052.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-26T12:05:27.182 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:27.182 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:27.182 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:05:27.182 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:05:27.183 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:27.192 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:27.276 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:27.275+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:27.336 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:27.336 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:05:27.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:05:27.336 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:05:27.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.336 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:27.336 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:27.337 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.553714806999999, 2024-04-26T12:05:27.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:05:27.337 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:27.337 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.337 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:27.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:27.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:27.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:27.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:27.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:27.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:05:27.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:27.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:27.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:05:27.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:05:27.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:27.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:05:27.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:05:27.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.339 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.339 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:05:27.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:05:27.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.339 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:27.339 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:05:27.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:05:27.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.339 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:27.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:27.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:05:27.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:27.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:05:27.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:05:27.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:27.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:05:27.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:05:27.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:27.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:05:27.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:05:27.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:27.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:05:27.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:05:27.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:27.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:05:27.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:05:27.342 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.342 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:27.342 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.342 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:27.342 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:27.342 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.553659487000001, 2024-04-26T12:05:27.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:05:27.343 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:27.343 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.343 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:27.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.343 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:27.343 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:27.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.343 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:27.343 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:27.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:27.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:05:27.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:27.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:27.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:05:27.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:05:27.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:27.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:05:27.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:05:27.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:05:27.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:05:27.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:27.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:05:27.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:05:27.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:27.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:05:27.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:05:27.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:27.347 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:05:27.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:05:27.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:27.347 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:05:27.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:05:27.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:27.347 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:05:27.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:05:27.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:27.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:05:27.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:05:27.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:27.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:05:27.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:05:27.348 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.348 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:27.348 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.349 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:27.349 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:27.349 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.553609469000001, 2024-04-26T12:05:27.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:05:27.349 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:27.349 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.349 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:27.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:27.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:27.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:27.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:27.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:27.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:05:27.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:27.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:05:27.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:05:27.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:27.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:05:27.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:05:27.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:05:27.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:05:27.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.352 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:27.352 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:05:27.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:05:27.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.352 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:27.352 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:05:27.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:05:27.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.352 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:27.352 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:05:27.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:05:27.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:27.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:05:27.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:05:27.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:27.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:05:27.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:05:27.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:27.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:05:27.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:05:27.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:27.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:05:27.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:05:27.355 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.355 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:27.355 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.355 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:27.355 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:27.355 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.553574831999999, 2024-04-26T12:05:27.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:05:27.355 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:27.355 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.355 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:27.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.356 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:27.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:27.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.356 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:27.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:27.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:27.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:05:27.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:27.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:05:27.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:05:27.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:27.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:27.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:05:27.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:05:27.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:05:27.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:27.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:05:27.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:05:27.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:27.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:05:27.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:05:27.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:27.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:05:27.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:05:27.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:27.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:05:27.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:05:27.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:27.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:05:27.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:05:27.360 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.360 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.360 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:27.360 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:05:27.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:05:27.360 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.360 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.360 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:27.360 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:05:27.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:05:27.360 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.360 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:27.360 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.360 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.360 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.361 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:27.361 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:27.361 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.553536319999999, 2024-04-26T12:05:27.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:05:27.361 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:27.361 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.361 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:27.361 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.361 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:27.361 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:27.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.361 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:27.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:27.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:27.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:27.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:27.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:27.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:27.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:05:27.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:27.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:05:27.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:05:27.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:05:27.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:05:27.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:27.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:05:27.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:05:27.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:27.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:05:27.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:05:27.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:27.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:05:27.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:05:27.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.365 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:27.365 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:05:27.365 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:05:27.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:27.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:05:27.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:05:27.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:27.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:05:27.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:05:27.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:27.367 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:05:27.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:05:27.367 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.367 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:27.367 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.367 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:27.367 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:27.367 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.553505996999998, 2024-04-26T12:05:27.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:05:27.367 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:27.368 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.368 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:27.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.368 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:27.368 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:27.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.368 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:27.368 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:27.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.368 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:27.368 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:27.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:27.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:05:27.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:05:27.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:27.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:05:27.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:05:27.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:05:27.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:05:27.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:27.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:05:27.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:05:27.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:27.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:05:27.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:05:27.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:27.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:05:27.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:05:27.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:27.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:05:27.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:05:27.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:27.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:05:27.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:05:27.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.372 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:27.372 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:05:27.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:05:27.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.372 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:27.372 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:05:27.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:05:27.372 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.372 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:27.372 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.373 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:27.373 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:27.373 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.553479294999999, 2024-04-26T12:05:27.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:05:27.373 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:27.373 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:27.373 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:27.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:27.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:27.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:27.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:27.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:27.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:27.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:27.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:05:27.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:05:27.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:27.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:05:27.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:05:27.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:05:27.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:05:27.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:27.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:05:27.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:05:27.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:27.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:05:27.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:05:27.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:27.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:05:27.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:05:27.376 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.376 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:27.376 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.377 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:27.377 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:27.377 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.553437004999999, 2024-04-26T12:05:27.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:05:27.377 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:27.377 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:27.377 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:27.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:27.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:27.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:27.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:27.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:27.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:27.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:27.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:05:27.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:05:27.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:27.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:05:27.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:05:27.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:05:27.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:05:27.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:27.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:05:27.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:05:27.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:27.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:05:27.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:05:27.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:27.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:05:27.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:05:27.380 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.380 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:27.380 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.380 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:27.380 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:27.381 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.553408927, 2024-04-26T12:05:27.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:05:27.381 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:27.381 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:27.381 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:27.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:27.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:27.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:27.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:27.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:27.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:05:27.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:27.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:05:27.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:05:27.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:27.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:05:27.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:05:27.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:27.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:05:27.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:27.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:27.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:05:27.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:27.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:05:27.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:05:27.384 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.384 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:27.384 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:05:27.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:05:27.384 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.384 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:27.384 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.384 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.384 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:27.384 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:27.384 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.547413577, 2024-04-26T12:05:27.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:05:27.385 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:27.385 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.385 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:27.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:27.385 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:27.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.385 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:27.385 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:27.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.385 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:27.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:05:27.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.386 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:27.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:05:27.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:05:27.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.386 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:27.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:05:27.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:05:27.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:05:27.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:05:27.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:27.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:05:27.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:05:27.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:27.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:05:27.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:05:27.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.388 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:27.388 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:05:27.388 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:05:27.388 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.388 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:27.388 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:05:27.388 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:05:27.388 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.388 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:27.388 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.388 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.389 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:27.389 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:27.389 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.547344611, 2024-04-26T12:05:27.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:05:27.389 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:27.389 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.389 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:27.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.389 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:27.389 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:27.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.389 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.389 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:27.389 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:27.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.390 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:27.390 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:05:27.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.390 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:27.390 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:05:27.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:05:27.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.390 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:27.390 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:05:27.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:05:27.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:05:27.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:05:27.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:27.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:05:27.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:05:27.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:27.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:27.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:05:27.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.392 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:27.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:05:27.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:05:27.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.392 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:27.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:05:27.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:05:27.392 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.392 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:27.392 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.393 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:27.393 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:27.393 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.546850247999998, 2024-04-26T12:05:27.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:05:27.393 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:27.393 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.393 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:27.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:27.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:27.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:27.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:27.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:27.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:27.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:27.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:05:27.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:05:27.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:27.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:05:27.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:05:27.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:05:27.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:05:27.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:27.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:05:27.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:05:27.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.396 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:27.396 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:05:27.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:05:27.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.396 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:27.396 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:05:27.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:05:27.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.396 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:27.397 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:05:27.397 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:05:27.397 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.397 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:27.397 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.397 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.397 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.397 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:27.397 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:27.397 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.546811983000001, 2024-04-26T12:05:27.397 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:05:27.397 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:27.397 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.397 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:27.397 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:27.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:27.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:27.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:27.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:27.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:27.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:27.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:05:27.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:05:27.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:27.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:05:27.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:05:27.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:05:27.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:05:27.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.400 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:27.400 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:05:27.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:05:27.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.400 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:27.400 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:05:27.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:05:27.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.400 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:27.400 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:05:27.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:05:27.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:27.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:05:27.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:05:27.401 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.401 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:27.401 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.401 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:05:27.401 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:27.401 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.546132098000001, 2024-04-26T12:05:27.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:05:27.402 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:27.402 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:27.402 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:27.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.402 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:27.402 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:27.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.402 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:27.402 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:27.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:27.403 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:27.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.403 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:27.403 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:05:27.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:05:27.403 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:27.403 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:05:27.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:05:27.403 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:05:27.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:05:27.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:27.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:05:27.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:05:27.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:27.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:05:27.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:05:27.404 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.404 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:27.405 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.405 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:27.405 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:27.405 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.546102918999999, 2024-04-26T12:05:27.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:05:27.405 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:27.405 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:27.405 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:27.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.405 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:27.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:27.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.406 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.406 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.406 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:27.406 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:27.406 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.406 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.406 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.406 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:27.406 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:05:27.406 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.406 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.406 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.406 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:27.406 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:05:27.406 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:05:27.407 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.407 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:27.407 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:05:27.407 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:05:27.407 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.407 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.407 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:05:27.407 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:05:27.407 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.407 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:27.407 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:05:27.407 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:05:27.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.408 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:27.408 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:05:27.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:05:27.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.408 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:27.408 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:05:27.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:05:27.408 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.408 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:27.408 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.409 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:27.409 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:27.409 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.546071108, 2024-04-26T12:05:27.409 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:05:27.409 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:27.409 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:27.409 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:27.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.409 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:27.409 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:27.409 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.409 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.409 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:27.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:27.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:27.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:27.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:05:27.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:27.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:05:27.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:05:27.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.411 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:27.411 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:05:27.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:05:27.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.411 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.411 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:05:27.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:05:27.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.411 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:27.411 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:05:27.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:05:27.412 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.412 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.412 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:27.412 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:05:27.412 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:05:27.412 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.412 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.412 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:27.412 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:05:27.412 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:05:27.413 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.413 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:27.413 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.413 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.413 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.413 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:27.413 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:27.413 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.546049752000002, 2024-04-26T12:05:27.413 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:05:27.413 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:27.413 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:27.413 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:27.413 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:27.414 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:27.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.414 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.414 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:27.414 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:27.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.414 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.414 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.415 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:27.415 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:27.415 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:05:27.415 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.415 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.415 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:27.415 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:05:27.415 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:05:27.415 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.415 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.415 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:27.415 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:05:27.415 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:05:27.415 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.416 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.416 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:05:27.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:05:27.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.416 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:27.416 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:05:27.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:05:27.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.416 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:27.416 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:05:27.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:05:27.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:27.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:05:27.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:05:27.417 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.417 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:27.417 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.417 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:05:27.417 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:27.417 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.546021299, 2024-04-26T12:05:27.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:05:27.417 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:27.417 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:27.418 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:27.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.418 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:27.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:27.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.418 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:27.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:27.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.418 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:27.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:27.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.419 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.419 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:27.419 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:05:27.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:05:27.419 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.419 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:27.419 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:05:27.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:05:27.419 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.419 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.419 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:05:27.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:05:27.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:27.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:05:27.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:05:27.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:27.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:05:27.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:05:27.421 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.421 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:27.421 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.421 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:05:27.421 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:27.421 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.545299493000002, 2024-04-26T12:05:27.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:05:27.421 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:27.421 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:27.421 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:27.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.422 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:27.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:27.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.422 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.422 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:27.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:27.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.422 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.422 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:27.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:05:27.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:27.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:27.423 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:05:27.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:05:27.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:27.423 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:05:27.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:05:27.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.423 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:05:27.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:05:27.424 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.424 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.424 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:27.424 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:05:27.424 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:05:27.424 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.424 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.424 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:27.424 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:05:27.424 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:05:27.424 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.424 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:27.424 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.424 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.425 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:05:27.425 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:27.425 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.828372890000001, 2024-04-26T12:05:27.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:05:27.425 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:27.425 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.425 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:27.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.425 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:27.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:27.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.425 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:27.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:27.426 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:27.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:27.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:05:27.426 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:05:27.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:27.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:05:27.426 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:05:27.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.427 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:27.427 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:05:27.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:05:27.427 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.427 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.427 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:05:27.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:05:27.427 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.427 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:27.427 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:05:27.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:05:27.427 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.428 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.428 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:27.428 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:05:27.428 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:05:27.428 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.428 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.428 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:27.428 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:05:27.428 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:05:27.428 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.428 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.428 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:27.428 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:05:27.428 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:05:27.428 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.428 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.429 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:27.429 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:05:27.429 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:05:27.429 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.429 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.429 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:27.429 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:05:27.429 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:05:27.429 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:27.429 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:27.429 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:27.429 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:05:27.429 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:05:27.429 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.429 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:27.430 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.430 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:27.430 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:27.430 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:27.431 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:27.430+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:27.432 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:27.532 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:27.531+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:27.537 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:05:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-04-26T12:05:27.538 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:27.546 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:27.633 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:27.632+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:27.648 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:27.648 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:05:27.648 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T12:05:27.648 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T12:05:27.648 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:27.656 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:27.734 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:27.733+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:27.758 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:27.759 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T12:05:27.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T12:05:27.759 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T12:05:27.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.759 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:27.759 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:27.759 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.976010748, 2024-04-26T12:05:27.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017255857999999999, 2024-04-26T12:05:27.759 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:27.759 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.759 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:27.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:27.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:27.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:27.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:27.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:27.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780340+0000", 2024-04-26T12:05:27.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:27.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:27.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780351+0000", 2024-04-26T12:05:27.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0898e-05 2024-04-26T12:05:27.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:27.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:27.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1671999999999999e-05 2024-04-26T12:05:27.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780374+0000", 2024-04-26T12:05:27.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1117999999999999e-05 2024-04-26T12:05:27.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780423+0000", 2024-04-26T12:05:27.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9066000000000001e-05 2024-04-26T12:05:27.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:27.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780428+0000", 2024-04-26T12:05:27.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1320000000000002e-06 2024-04-26T12:05:27.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788902+0000", 2024-04-26T12:05:27.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084738560000000001 2024-04-26T12:05:27.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:27.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789167+0000", 2024-04-26T12:05:27.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026521100000000001 2024-04-26T12:05:27.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:27.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789279+0000", 2024-04-26T12:05:27.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111616 2024-04-26T12:05:27.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:27.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792335+0000", 2024-04-26T12:05:27.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030556419999999999 2024-04-26T12:05:27.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:27.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797519+0000", 2024-04-26T12:05:27.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051841550000000002 2024-04-26T12:05:27.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:27.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797559+0000", 2024-04-26T12:05:27.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0451999999999998e-05 2024-04-26T12:05:27.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:27.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797598+0000", 2024-04-26T12:05:27.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8500000000000001e-05 2024-04-26T12:05:27.765 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.765 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:27.765 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.765 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:27.765 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:27.765 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.975962441, 2024-04-26T12:05:27.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017668725, 2024-04-26T12:05:27.765 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:27.765 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.765 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:27.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:27.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:27.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:27.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:27.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:27.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:27.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:27.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780395+0000", 2024-04-26T12:05:27.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.198e-06 2024-04-26T12:05:27.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:27.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780402+0000", 2024-04-26T12:05:27.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:05:27.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780408+0000", 2024-04-26T12:05:27.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:27.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780481+0000", 2024-04-26T12:05:27.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3239999999999997e-05 2024-04-26T12:05:27.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:27.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780485+0000", 2024-04-26T12:05:27.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4039999999999999e-06 2024-04-26T12:05:27.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789518+0000", 2024-04-26T12:05:27.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090335480000000006 2024-04-26T12:05:27.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:27.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789585+0000", 2024-04-26T12:05:27.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6469000000000003e-05 2024-04-26T12:05:27.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:27.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789699+0000", 2024-04-26T12:05:27.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114613 2024-04-26T12:05:27.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:27.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793308+0000", 2024-04-26T12:05:27.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036088520000000001 2024-04-26T12:05:27.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:27.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797887+0000", 2024-04-26T12:05:27.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0045792790000000003 2024-04-26T12:05:27.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:27.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797955+0000", 2024-04-26T12:05:27.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T12:05:27.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:27.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798059+0000", 2024-04-26T12:05:27.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103874 2024-04-26T12:05:27.773 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.773 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:27.773 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.774 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:27.774 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:27.774 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.975932169, 2024-04-26T12:05:27.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017735145000000001, 2024-04-26T12:05:27.774 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:27.774 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.774 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:27.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:27.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:27.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:27.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:27.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:27.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:27.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:27.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780424+0000", 2024-04-26T12:05:27.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4519999999999999e-06 2024-04-26T12:05:27.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:27.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780431+0000", 2024-04-26T12:05:27.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0690000000000004e-06 2024-04-26T12:05:27.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780438+0000", 2024-04-26T12:05:27.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5719999999999999e-06 2024-04-26T12:05:27.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780468+0000", 2024-04-26T12:05:27.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.993e-05 2024-04-26T12:05:27.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:27.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780472+0000", 2024-04-26T12:05:27.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-04-26T12:05:27.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789916+0000", 2024-04-26T12:05:27.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094434940000000002 2024-04-26T12:05:27.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:27.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790004+0000", 2024-04-26T12:05:27.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8085999999999997e-05 2024-04-26T12:05:27.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:27.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790125+0000", 2024-04-26T12:05:27.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012186200000000001 2024-04-26T12:05:27.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:27.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793402+0000", 2024-04-26T12:05:27.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00327685 2024-04-26T12:05:27.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:27.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798068+0000", 2024-04-26T12:05:27.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046652150000000003 2024-04-26T12:05:27.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:27.780 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798108+0000", 2024-04-26T12:05:27.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0911000000000002e-05 2024-04-26T12:05:27.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:27.780 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798156+0000", 2024-04-26T12:05:27.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7128e-05 2024-04-26T12:05:27.780 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.780 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:27.781 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.781 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:27.781 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:27.781 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.97590915, 2024-04-26T12:05:27.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017792624, 2024-04-26T12:05:27.781 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:27.781 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.781 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:27.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:27.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:27.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:27.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:27.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:27.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:27.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:27.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780447+0000", 2024-04-26T12:05:27.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8519999999999997e-06 2024-04-26T12:05:27.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:27.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780453+0000", 2024-04-26T12:05:27.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2999999999999998e-06 2024-04-26T12:05:27.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:27.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0760000000000002e-06 2024-04-26T12:05:27.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780502+0000", 2024-04-26T12:05:27.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4079999999999998e-05 2024-04-26T12:05:27.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:27.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:27.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5450000000000002e-06 2024-04-26T12:05:27.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790390+0000", 2024-04-26T12:05:27.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098850759999999996 2024-04-26T12:05:27.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:27.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790447+0000", 2024-04-26T12:05:27.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6752999999999997e-05 2024-04-26T12:05:27.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.785 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:27.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790547+0000", 2024-04-26T12:05:27.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100344 2024-04-26T12:05:27.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.785 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:27.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793864+0000", 2024-04-26T12:05:27.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033169749999999998 2024-04-26T12:05:27.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:27.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798164+0000", 2024-04-26T12:05:27.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043000690000000001 2024-04-26T12:05:27.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:27.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798204+0000", 2024-04-26T12:05:27.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9478999999999999e-05 2024-04-26T12:05:27.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:27.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798236+0000", 2024-04-26T12:05:27.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2478999999999999e-05 2024-04-26T12:05:27.787 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.787 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:27.787 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.787 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:27.787 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:27.788 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.975868807000001, 2024-04-26T12:05:27.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016989500000000001, 2024-04-26T12:05:27.788 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:27.788 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.788 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:27.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:27.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:27.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:27.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:27.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:27.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780483+0000", 2024-04-26T12:05:27.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:27.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780488+0000", 2024-04-26T12:05:27.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6260000000000003e-06 2024-04-26T12:05:27.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:27.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780499+0000", 2024-04-26T12:05:27.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1236000000000001e-05 2024-04-26T12:05:27.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.790 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.790 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:27.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4569999999999996e-06 2024-04-26T12:05:27.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.790 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.790 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780529+0000", 2024-04-26T12:05:27.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4579e-05 2024-04-26T12:05:27.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.790 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:27.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780532+0000", 2024-04-26T12:05:27.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.74e-06 2024-04-26T12:05:27.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788868+0000", 2024-04-26T12:05:27.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0083357650000000002 2024-04-26T12:05:27.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:27.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789142+0000", 2024-04-26T12:05:27.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027472 2024-04-26T12:05:27.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:27.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789241+0000", 2024-04-26T12:05:27.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8394999999999996e-05 2024-04-26T12:05:27.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:27.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792096+0000", 2024-04-26T12:05:27.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002855677 2024-04-26T12:05:27.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:27.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797379+0000", 2024-04-26T12:05:27.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052822379999999999 2024-04-26T12:05:27.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:27.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797433+0000", 2024-04-26T12:05:27.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4109e-05 2024-04-26T12:05:27.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:27.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797473+0000", 2024-04-26T12:05:27.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0533e-05 2024-04-26T12:05:27.793 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.793 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:27.793 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.794 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:27.794 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:27.794 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.975829192999999, 2024-04-26T12:05:27.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017295965, 2024-04-26T12:05:27.794 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:27.794 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.794 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:27.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.794 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:27.794 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:27.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:27.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:27.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:27.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780513+0000", 2024-04-26T12:05:27.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999895 2024-04-26T12:05:27.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:27.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780528+0000", 2024-04-26T12:05:27.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5089000000000001e-05 2024-04-26T12:05:27.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:27.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780537+0000", 2024-04-26T12:05:27.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8400000000000001e-06 2024-04-26T12:05:27.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780544+0000", 2024-04-26T12:05:27.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.917e-06 2024-04-26T12:05:27.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780571+0000", 2024-04-26T12:05:27.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7032000000000001e-05 2024-04-26T12:05:27.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:27.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780574+0000", 2024-04-26T12:05:27.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:05:27.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.798 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.798 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789436+0000", 2024-04-26T12:05:27.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088622240000000001 2024-04-26T12:05:27.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.798 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:27.798 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789525+0000", 2024-04-26T12:05:27.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8549999999999998e-05 2024-04-26T12:05:27.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.798 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:27.798 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789642+0000", 2024-04-26T12:05:27.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011772100000000001 2024-04-26T12:05:27.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:27.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792129+0000", 2024-04-26T12:05:27.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024871709999999998 2024-04-26T12:05:27.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:27.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797732+0000", 2024-04-26T12:05:27.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056027580000000002 2024-04-26T12:05:27.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:27.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797777+0000", 2024-04-26T12:05:27.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4620999999999999e-05 2024-04-26T12:05:27.800 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.800 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:27.800 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797819+0000", 2024-04-26T12:05:27.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2536000000000001e-05 2024-04-26T12:05:27.800 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.800 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:27.800 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.800 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.800 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:27.800 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:27.800 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.975800242999998, 2024-04-26T12:05:27.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017840163999999999, 2024-04-26T12:05:27.801 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:27.801 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.801 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:27.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:27.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:27.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:27.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:27.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:27.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:27.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:27.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:27.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5419999999999999e-06 2024-04-26T12:05:27.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:27.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780563+0000", 2024-04-26T12:05:27.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:05:27.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780569+0000", 2024-04-26T12:05:27.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1479999999999997e-06 2024-04-26T12:05:27.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780594+0000", 2024-04-26T12:05:27.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5585e-05 2024-04-26T12:05:27.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:27.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780596+0000", 2024-04-26T12:05:27.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2630000000000002e-06 2024-04-26T12:05:27.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789932+0000", 2024-04-26T12:05:27.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093360479999999996 2024-04-26T12:05:27.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:27.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790070+0000", 2024-04-26T12:05:27.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013771399999999999 2024-04-26T12:05:27.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:27.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790219+0000", 2024-04-26T12:05:27.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014872299999999999 2024-04-26T12:05:27.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:27.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793632+0000", 2024-04-26T12:05:27.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003413368 2024-04-26T12:05:27.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:27.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798244+0000", 2024-04-26T12:05:27.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046113819999999998 2024-04-26T12:05:27.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:27.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798361+0000", 2024-04-26T12:05:27.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117726 2024-04-26T12:05:27.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:27.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798393+0000", 2024-04-26T12:05:27.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1099999999999997e-05 2024-04-26T12:05:27.807 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.807 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:27.807 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.807 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.807 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:27.807 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:27.807 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.975775318, 2024-04-26T12:05:27.807 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016645943, 2024-04-26T12:05:27.807 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:27.807 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:27.807 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:27.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:27.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:27.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:27.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:27.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:27.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:27.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:27.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780580+0000", 2024-04-26T12:05:27.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1549999999999999e-06 2024-04-26T12:05:27.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:27.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780588+0000", 2024-04-26T12:05:27.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:05:27.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780593+0000", 2024-04-26T12:05:27.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2399999999999998e-06 2024-04-26T12:05:27.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.810 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780628+0000", 2024-04-26T12:05:27.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5426000000000003e-05 2024-04-26T12:05:27.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.810 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:27.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780632+0000", 2024-04-26T12:05:27.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:05:27.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.811 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788288+0000", 2024-04-26T12:05:27.811 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076555879999999996 2024-04-26T12:05:27.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:27.811 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788570+0000", 2024-04-26T12:05:27.811 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028233700000000002 2024-04-26T12:05:27.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:27.811 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797223+0000", 2024-04-26T12:05:27.811 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086529150000000006 2024-04-26T12:05:27.812 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.812 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:27.812 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.812 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.812 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.812 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:27.812 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:27.812 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.975751348999999, 2024-04-26T12:05:27.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016536068000000001, 2024-04-26T12:05:27.812 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:27.812 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:27.812 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:27.812 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.813 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:27.813 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:27.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.813 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:27.813 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:27.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.813 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:27.813 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:27.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:27.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780609+0000", 2024-04-26T12:05:27.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8280000000000003e-06 2024-04-26T12:05:27.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:27.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780616+0000", 2024-04-26T12:05:27.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4939999999999997e-06 2024-04-26T12:05:27.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780621+0000", 2024-04-26T12:05:27.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6040000000000003e-06 2024-04-26T12:05:27.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780647+0000", 2024-04-26T12:05:27.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6441999999999999e-05 2024-04-26T12:05:27.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:27.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780650+0000", 2024-04-26T12:05:27.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4430000000000002e-06 2024-04-26T12:05:27.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788163+0000", 2024-04-26T12:05:27.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007513774 2024-04-26T12:05:27.816 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.816 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.816 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:27.816 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788307+0000", 2024-04-26T12:05:27.816 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014374400000000001 2024-04-26T12:05:27.816 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.816 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.816 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:27.816 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797137+0000", 2024-04-26T12:05:27.816 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088302160000000001 2024-04-26T12:05:27.816 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.816 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:27.816 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.816 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.817 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.817 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:27.817 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:27.817 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.972875077000001, 2024-04-26T12:05:27.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012911448000000001, 2024-04-26T12:05:27.817 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:27.817 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.817 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:27.817 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:27.818 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:27.818 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.818 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:27.818 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:27.818 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.818 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:27.818 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783477+0000", 2024-04-26T12:05:27.818 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.818 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.819 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.819 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:27.819 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783482+0000", 2024-04-26T12:05:27.819 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5709999999999999e-06 2024-04-26T12:05:27.819 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.819 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.819 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:27.819 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783491+0000", 2024-04-26T12:05:27.819 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3610000000000007e-06 2024-04-26T12:05:27.819 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.819 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.819 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.819 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783498+0000", 2024-04-26T12:05:27.820 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4209999999999998e-06 2024-04-26T12:05:27.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.820 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.820 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786045+0000", 2024-04-26T12:05:27.820 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0025465739999999998 2024-04-26T12:05:27.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.820 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:27.820 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786061+0000", 2024-04-26T12:05:27.820 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6348999999999999e-05 2024-04-26T12:05:27.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.821 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:27.821 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796342+0000", 2024-04-26T12:05:27.821 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010280643000000001 2024-04-26T12:05:27.821 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.821 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.821 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:27.821 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796389+0000", 2024-04-26T12:05:27.821 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6912000000000001e-05 2024-04-26T12:05:27.821 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.821 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:27.821 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.821 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.821 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.822 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:27.822 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:27.822 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.972846771, 2024-04-26T12:05:27.822 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013376469, 2024-04-26T12:05:27.822 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:27.822 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.822 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:27.822 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.822 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:27.822 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:27.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:27.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:27.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:27.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:27.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.824 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:27.824 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783516+0000", 2024-04-26T12:05:27.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.041e-05 2024-04-26T12:05:27.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.824 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:27.824 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783523+0000", 2024-04-26T12:05:27.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5749999999999997e-06 2024-04-26T12:05:27.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.824 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.824 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783528+0000", 2024-04-26T12:05:27.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5029999999999997e-06 2024-04-26T12:05:27.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787662+0000", 2024-04-26T12:05:27.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041336230000000003 2024-04-26T12:05:27.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:27.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787687+0000", 2024-04-26T12:05:27.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5769999999999999e-05 2024-04-26T12:05:27.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:27.826 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796817+0000", 2024-04-26T12:05:27.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091296750000000003 2024-04-26T12:05:27.826 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.826 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:27.826 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796882+0000", 2024-04-26T12:05:27.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5180999999999998e-05 2024-04-26T12:05:27.826 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.826 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:27.826 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.826 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.826 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:27.826 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:27.827 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.972778229999999, 2024-04-26T12:05:27.827 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013457291999999999, 2024-04-26T12:05:27.827 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:27.827 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.827 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:27.827 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.827 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:27.827 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:27.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.828 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:27.828 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:27.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.828 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:27.828 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:27.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.828 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:27.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783578+0000", 2024-04-26T12:05:27.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.659e-06 2024-04-26T12:05:27.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:27.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783584+0000", 2024-04-26T12:05:27.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:27.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783588+0000", 2024-04-26T12:05:27.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6190000000000002e-06 2024-04-26T12:05:27.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787834+0000", 2024-04-26T12:05:27.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042460529999999996 2024-04-26T12:05:27.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:27.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787854+0000", 2024-04-26T12:05:27.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9658999999999999e-05 2024-04-26T12:05:27.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:27.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:27.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009107604 2024-04-26T12:05:27.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.831 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:27.831 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797032+0000", 2024-04-26T12:05:27.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9987000000000006e-05 2024-04-26T12:05:27.831 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.831 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:27.831 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.831 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:27.831 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:27.831 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.970931851, 2024-04-26T12:05:27.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011003015999999999, 2024-04-26T12:05:27.832 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:27.832 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.832 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:27.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.832 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:27.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:27.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.832 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:27.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:27.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:27.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785420+0000", 2024-04-26T12:05:27.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:27.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785427+0000", 2024-04-26T12:05:27.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:05:27.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:27.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785438+0000", 2024-04-26T12:05:27.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069e-05 2024-04-26T12:05:27.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785457+0000", 2024-04-26T12:05:27.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8617000000000001e-05 2024-04-26T12:05:27.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786628+0000", 2024-04-26T12:05:27.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001171418 2024-04-26T12:05:27.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:27.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786651+0000", 2024-04-26T12:05:27.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3289e-05 2024-04-26T12:05:27.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:27.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796393+0000", 2024-04-26T12:05:27.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097413269999999993 2024-04-26T12:05:27.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:27.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796424+0000", 2024-04-26T12:05:27.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1188e-05 2024-04-26T12:05:27.836 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.836 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:27.836 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.836 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:27.836 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:27.836 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.970385104999998, 2024-04-26T12:05:27.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010561432000000001, 2024-04-26T12:05:27.836 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:27.836 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.836 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:27.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:27.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:27.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:27.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:27.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:27.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:27.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:27.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785973+0000", 2024-04-26T12:05:27.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4910000000000002e-06 2024-04-26T12:05:27.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:27.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785991+0000", 2024-04-26T12:05:27.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7663e-05 2024-04-26T12:05:27.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785998+0000", 2024-04-26T12:05:27.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1239999999999999e-06 2024-04-26T12:05:27.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786792+0000", 2024-04-26T12:05:27.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079334800000000003 2024-04-26T12:05:27.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:27.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786810+0000", 2024-04-26T12:05:27.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8746999999999999e-05 2024-04-26T12:05:27.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:27.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796500+0000", 2024-04-26T12:05:27.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096897619999999993 2024-04-26T12:05:27.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:27.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796529+0000", 2024-04-26T12:05:27.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8873999999999998e-05 2024-04-26T12:05:27.840 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.840 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:27.840 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.841 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:27.841 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:27.841 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.970306018999999, 2024-04-26T12:05:27.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010219911, 2024-04-26T12:05:27.841 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:27.841 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.841 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:27.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:27.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:27.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:27.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:27.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:27.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786046+0000", 2024-04-26T12:05:27.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:27.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786053+0000", 2024-04-26T12:05:27.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0360000000000001e-06 2024-04-26T12:05:27.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:27.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786064+0000", 2024-04-26T12:05:27.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1202999999999999e-05 2024-04-26T12:05:27.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786091+0000", 2024-04-26T12:05:27.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6859000000000002e-05 2024-04-26T12:05:27.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786212+0000", 2024-04-26T12:05:27.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120975 2024-04-26T12:05:27.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:27.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786236+0000", 2024-04-26T12:05:27.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4358999999999998e-05 2024-04-26T12:05:27.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:27.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796236+0000", 2024-04-26T12:05:27.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099998050000000005 2024-04-26T12:05:27.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:27.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796266+0000", 2024-04-26T12:05:27.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0278e-05 2024-04-26T12:05:27.845 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.845 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:27.845 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.845 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:3 3.14 e17/15 3:287034c4:::1.00000000.inode:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:27.845 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:27.845 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.969517058000001, 2024-04-26T12:05:27.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009764712, 2024-04-26T12:05:27.845 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:27.846 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.846 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:27.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:27.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:27.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:27.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:27.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:27.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786835+0000", 2024-04-26T12:05:27.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T12:05:27.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:27.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786844+0000", 2024-04-26T12:05:27.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6500000000000008e-06 2024-04-26T12:05:27.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:27.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786855+0000", 2024-04-26T12:05:27.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0932e-05 2024-04-26T12:05:27.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786864+0000", 2024-04-26T12:05:27.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2150000000000007e-06 2024-04-26T12:05:27.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787242+0000", 2024-04-26T12:05:27.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037708300000000001 2024-04-26T12:05:27.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:27.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787259+0000", 2024-04-26T12:05:27.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7258999999999999e-05 2024-04-26T12:05:27.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:27.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796579+0000", 2024-04-26T12:05:27.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093201099999999995 2024-04-26T12:05:27.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:27.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796600+0000", 2024-04-26T12:05:27.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1330000000000001e-05 2024-04-26T12:05:27.849 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.849 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:27.849 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.850 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:27.850 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:27.850 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.969473036, 2024-04-26T12:05:27.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096431940000000008, 2024-04-26T12:05:27.850 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:27.850 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.850 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:27.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:27.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:27.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:27.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:27.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:27.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786879+0000", 2024-04-26T12:05:27.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:27.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786887+0000", 2024-04-26T12:05:27.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9300000000000003e-06 2024-04-26T12:05:27.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:27.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786894+0000", 2024-04-26T12:05:27.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:05:27.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786899+0000", 2024-04-26T12:05:27.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8400000000000002e-06 2024-04-26T12:05:27.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786932+0000", 2024-04-26T12:05:27.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3031999999999998e-05 2024-04-26T12:05:27.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:27.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786945+0000", 2024-04-26T12:05:27.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3421000000000001e-05 2024-04-26T12:05:27.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:27.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796469+0000", 2024-04-26T12:05:27.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095236130000000002 2024-04-26T12:05:27.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.854 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:27.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796523+0000", 2024-04-26T12:05:27.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4089999999999999e-05 2024-04-26T12:05:27.854 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.854 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:27.854 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.854 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.854 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "pg_update_log_missing(3.14 epoch 17/15 rep_tid 169 entries 17'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:05:27.854 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:27.854 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.969409881000001, 2024-04-26T12:05:27.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097257639999999996, 2024-04-26T12:05:27.854 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:27.855 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-04-26T12:05:27.855 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:27.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.855 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:27.855 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:27.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.855 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:27.855 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:27.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:27.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786942+0000", 2024-04-26T12:05:27.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:27.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786951+0000", 2024-04-26T12:05:27.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:05:27.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:27.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786965+0000", 2024-04-26T12:05:27.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4268e-05 2024-04-26T12:05:27.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786977+0000", 2024-04-26T12:05:27.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1667e-05 2024-04-26T12:05:27.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787667+0000", 2024-04-26T12:05:27.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00069057400000000001 2024-04-26T12:05:27.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.858 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:27.858 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796668+0000", 2024-04-26T12:05:27.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090013309999999996 2024-04-26T12:05:27.858 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.858 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:27.858 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.858 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.858 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:27.858 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:27.858 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.969356737999998, 2024-04-26T12:05:27.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095908309999999993, 2024-04-26T12:05:27.859 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:27.859 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.859 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:27.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:27.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:27.859 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.859 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:27.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:27.859 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.859 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:27.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786995+0000", 2024-04-26T12:05:27.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:27.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787001+0000", 2024-04-26T12:05:27.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5099999999999998e-06 2024-04-26T12:05:27.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:27.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787009+0000", 2024-04-26T12:05:27.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9100000000000005e-06 2024-04-26T12:05:27.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787019+0000", 2024-04-26T12:05:27.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8109999999999997e-06 2024-04-26T12:05:27.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787136+0000", 2024-04-26T12:05:27.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011749899999999999 2024-04-26T12:05:27.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:27.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787154+0000", 2024-04-26T12:05:27.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8278999999999999e-05 2024-04-26T12:05:27.862 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.862 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:27.862 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796561+0000", 2024-04-26T12:05:27.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094064379999999996 2024-04-26T12:05:27.862 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.862 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:27.862 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796587+0000", 2024-04-26T12:05:27.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5856000000000001e-05 2024-04-26T12:05:27.862 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.862 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:27.863 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.863 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.863 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.863 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:27.863 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:27.863 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.968639680999999, 2024-04-26T12:05:27.863 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096460160000000003, 2024-04-26T12:05:27.863 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:27.863 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:27.863 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:27.863 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.863 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:27.863 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:27.863 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.864 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.864 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:27.864 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:27.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:27.864 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.864 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:27.864 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787712+0000", 2024-04-26T12:05:27.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:27.864 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.864 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:27.864 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787718+0000", 2024-04-26T12:05:27.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:05:27.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:27.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787727+0000", 2024-04-26T12:05:27.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.123e-06 2024-04-26T12:05:27.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:27.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787734+0000", 2024-04-26T12:05:27.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.391e-06 2024-04-26T12:05:27.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:27.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788867+0000", 2024-04-26T12:05:27.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001133207 2024-04-26T12:05:27.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:27.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788899+0000", 2024-04-26T12:05:27.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1526000000000003e-05 2024-04-26T12:05:27.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:27.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797328+0000", 2024-04-26T12:05:27.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084295389999999998 2024-04-26T12:05:27.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:27.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:27.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:27.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797359+0000", 2024-04-26T12:05:27.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0660999999999997e-05 2024-04-26T12:05:27.867 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.867 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:27.867 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.867 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:27.867 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:27.867 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:27.868 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:05:27.869 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:27.867+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:27.870 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T12:05:27.870 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:27.871 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T12:05:27.871 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:05:27.969 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:27.969+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:27.982 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:27.982 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:05:27.983 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:05:27.983 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:27.991 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:28.070 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:28.069+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:28.093 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:28.094 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:05:28.094 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:05:28.094 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:05:28.094 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:28.103 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:28.188 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:28.186+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:28.212 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:28.214 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:05:28.222 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-04-26T12:05:27.832775+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":85796,"kb_used_data":632,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283029724,"statfs":{"total":289910292480,"available":289822437376,"internally_reserved":0,"allocated":647168,"data_stored":1350688,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.496992"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348921+0000","last_change":"2024-04-26T12:05:03.796038+0000","last_active":"2024-04-26T12:05:06.348921+0000","last_peered":"2024-04-26T12:05:06.348921+0000","last_clean":"2024-04-26T12:05:06.348921+0000","last_became_active":"2024-04-26T12:05:03.795539+0000","last_became_peered":"2024-04-26T12:05:03.795539+0000","last_unstale":"2024-04-26T12:05:06.348921+0000","last_undegraded":"2024-04-26T12:05:06.348921+0000","last_fullsized":"2024-04-26T12:05:06.348921+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348844+0000","last_change":"2024-04-26T12:05:03.795955+0000","last_active":"2024-04-26T12:05:06.348844+0000","last_peered":"2024-04-26T12:05:06.348844+0000","last_clean":"2024-04-26T12:05:06.348844+0000","last_became_active":"2024-04-26T12:05:03.795303+0000","last_became_peered":"2024-04-26T12:05:03.795303+0000","last_unstale":"2024-04-26T12:05:06.348844+0000","last_undegraded":"2024-04-26T12:05:06.348844+0000","last_fullsized":"2024-04-26T12:05:06.348844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348520+0000","last_change":"2024-04-26T12:05:03.797557+0000","last_active":"2024-04-26T12:05:06.348520+0000","last_peered":"2024-04-26T12:05:06.348520+0000","last_clean":"2024-04-26T12:05:06.348520+0000","last_became_active":"2024-04-26T12:05:03.797122+0000","last_became_peered":"2024-04-26T12:05:03.797122+0000","last_unstale":"2024-04-26T12:05:06.348520+0000","last_undegraded":"2024-04-26T12:05:06.348520+0000","last_fullsized":"2024-04-26T12:05:06.348520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348462+0000","last_change":"2024-04-26T12:05:03.791234+0000","last_active":"2024-04-26T12:05:06.348462+0000","last_peered":"2024-04-26T12:05:06.348462+0000","last_clean":"2024-04-26T12:05:06.348462+0000","last_became_active":"2024-04-26T12:05:03.790717+0000","last_became_peered":"2024-04-26T12:05:03.790717+0000","last_unstale":"2024-04-26T12:05:06.348462+0000","last_undegraded":"2024-04-26T12:05:06.348462+0000","last_fullsized":"2024-04-26T12:05:06.348462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:52.358881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348625+0000","last_change":"2024-04-26T12:05:03.792885+0000","last_active":"2024-04-26T12:05:06.348625+0000","last_peered":"2024-04-26T12:05:06.348625+0000","last_clean":"2024-04-26T12:05:06.348625+0000","last_became_active":"2024-04-26T12:05:03.792354+0000","last_became_peered":"2024-04-26T12:05:03.792354+0000","last_unstale":"2024-04-26T12:05:06.348625+0000","last_undegraded":"2024-04-26T12:05:06.348625+0000","last_fullsized":"2024-04-26T12:05:06.348625+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348360+0000","last_change":"2024-04-26T12:05:03.791560+0000","last_active":"2024-04-26T12:05:06.348360+0000","last_peered":"2024-04-26T12:05:06.348360+0000","last_clean":"2024-04-26T12:05:06.348360+0000","last_became_active":"2024-04-26T12:05:03.790578+0000","last_became_peered":"2024-04-26T12:05:03.790578+0000","last_unstale":"2024-04-26T12:05:06.348360+0000","last_undegraded":"2024-04-26T12:05:06.348360+0000","last_fullsized":"2024-04-26T12:05:06.348360+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348338+0000","last_change":"2024-04-26T12:05:03.791215+0000","last_active":"2024-04-26T12:05:06.348338+0000","last_peered":"2024-04-26T12:05:06.348338+0000","last_clean":"2024-04-26T12:05:06.348338+0000","last_became_active":"2024-04-26T12:05:03.790615+0000","last_became_peered":"2024-04-26T12:05:03.790615+0000","last_unstale":"2024-04-26T12:05:06.348338+0000","last_undegraded":"2024-04-26T12:05:06.348338+0000","last_fullsized":"2024-04-26T12:05:06.348338+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:55.388027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348269+0000","last_change":"2024-04-26T12:05:03.785861+0000","last_active":"2024-04-26T12:05:06.348269+0000","last_peered":"2024-04-26T12:05:06.348269+0000","last_clean":"2024-04-26T12:05:06.348269+0000","last_became_active":"2024-04-26T12:05:03.785382+0000","last_became_peered":"2024-04-26T12:05:03.785382+0000","last_unstale":"2024-04-26T12:05:06.348269+0000","last_undegraded":"2024-04-26T12:05:06.348269+0000","last_fullsized":"2024-04-26T12:05:06.348269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:51.870183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348636+0000","last_change":"2024-04-26T12:05:03.797218+0000","last_active":"2024-04-26T12:05:06.348636+0000","last_peered":"2024-04-26T12:05:06.348636+0000","last_clean":"2024-04-26T12:05:06.348636+0000","last_became_active":"2024-04-26T12:05:03.796902+0000","last_became_peered":"2024-04-26T12:05:03.796902+0000","last_unstale":"2024-04-26T12:05:06.348636+0000","last_undegraded":"2024-04-26T12:05:06.348636+0000","last_fullsized":"2024-04-26T12:05:06.348636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:27.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348859+0000","last_change":"2024-04-26T12:05:03.795919+0000","last_active":"2024-04-26T12:05:06.348859+0000","last_peered":"2024-04-26T12:05:06.348859+0000","last_clean":"2024-04-26T12:05:06.348859+0000","last_became_active":"2024-04-26T12:05:03.795268+0000","last_became_peered":"2024-04-26T12:05:03.795268+0000","last_unstale":"2024-04-26T12:05:06.348859+0000","last_undegraded":"2024-04-26T12:05:06.348859+0000","last_fullsized":"2024-04-26T12:05:06.348859+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348529+0000","last_change":"2024-04-26T12:05:03.791046+0000","last_active":"2024-04-26T12:05:06.348529+0000","last_peered":"2024-04-26T12:05:06.348529+0000","last_clean":"2024-04-26T12:05:06.348529+0000","last_became_active":"2024-04-26T12:05:03.790662+0000","last_became_peered":"2024-04-26T12:05:03.790662+0000","last_unstale":"2024-04-26T12:05:06.348529+0000","last_undegraded":"2024-04-26T12:05:06.348529+0000","last_fullsized":"2024-04-26T12:05:06.348529+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:35.458663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348677+0000","last_change":"2024-04-26T12:05:03.795250+0000","last_active":"2024-04-26T12:05:06.348677+0000","last_peered":"2024-04-26T12:05:06.348677+0000","last_clean":"2024-04-26T12:05:06.348677+0000","last_became_active":"2024-04-26T12:05:03.794632+0000","last_became_peered":"2024-04-26T12:05:03.794632+0000","last_unstale":"2024-04-26T12:05:06.348677+0000","last_undegraded":"2024-04-26T12:05:06.348677+0000","last_fullsized":"2024-04-26T12:05:06.348677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:59.873501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348595+0000","last_change":"2024-04-26T12:05:03.794090+0000","last_active":"2024-04-26T12:05:06.348595+0000","last_peered":"2024-04-26T12:05:06.348595+0000","last_clean":"2024-04-26T12:05:06.348595+0000","last_became_active":"2024-04-26T12:05:03.793681+0000","last_became_peered":"2024-04-26T12:05:03.793681+0000","last_unstale":"2024-04-26T12:05:06.348595+0000","last_undegraded":"2024-04-26T12:05:06.348595+0000","last_fullsized":"2024-04-26T12:05:06.348595+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348369+0000","last_change":"2024-04-26T12:05:03.795539+0000","last_active":"2024-04-26T12:05:06.348369+0000","last_peered":"2024-04-26T12:05:06.348369+0000","last_clean":"2024-04-26T12:05:06.348369+0000","last_became_active":"2024-04-26T12:05:03.795281+0000","last_became_peered":"2024-04-26T12:05:03.795281+0000","last_unstale":"2024-04-26T12:05:06.348369+0000","last_undegraded":"2024-04-26T12:05:06.348369+0000","last_fullsized":"2024-04-26T12:05:06.348369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:27.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348347+0000","last_change":"2024-04-26T12:05:03.793487+0000","last_active":"2024-04-26T12:05:06.348347+0000","last_peered":"2024-04-26T12:05:06.348347+0000","last_clean":"2024-04-26T12:05:06.348347+0000","last_became_active":"2024-04-26T12:05:03.793242+0000","last_became_peered":"2024-04-26T12:05:03.793242+0000","last_unstale":"2024-04-26T12:05:06.348347+0000","last_undegraded":"2024-04-26T12:05:06.348347+0000","last_fullsized":"2024-04-26T12:05:06.348347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:53.331006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348288+0000","last_change":"2024-04-26T12:05:03.786360+0000","last_active":"2024-04-26T12:05:06.348288+0000","last_peered":"2024-04-26T12:05:06.348288+0000","last_clean":"2024-04-26T12:05:06.348288+0000","last_became_active":"2024-04-26T12:05:03.785991+0000","last_became_peered":"2024-04-26T12:05:03.785991+0000","last_unstale":"2024-04-26T12:05:06.348288+0000","last_undegraded":"2024-04-26T12:05:06.348288+0000","last_fullsized":"2024-04-26T12:05:06.348288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:17.702068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348713+0000","last_change":"2024-04-26T12:05:03.797390+0000","last_active":"2024-04-26T12:05:06.348713+0000","last_peered":"2024-04-26T12:05:06.348713+0000","last_clean":"2024-04-26T12:05:06.348713+0000","last_became_active":"2024-04-26T12:05:03.796969+0000","last_became_peered":"2024-04-26T12:05:03.796969+0000","last_unstale":"2024-04-26T12:05:06.348713+0000","last_undegraded":"2024-04-26T12:05:06.348713+0000","last_fullsized":"2024-04-26T12:05:06.348713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:57.461628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348874+0000","last_change":"2024-04-26T12:05:03.794013+0000","last_active":"2024-04-26T12:05:06.348874+0000","last_peered":"2024-04-26T12:05:06.348874+0000","last_clean":"2024-04-26T12:05:06.348874+0000","last_became_active":"2024-04-26T12:05:03.793512+0000","last_became_peered":"2024-04-26T12:05:03.793512+0000","last_unstale":"2024-04-26T12:05:06.348874+0000","last_undegraded":"2024-04-26T12:05:06.348874+0000","last_fullsized":"2024-04-26T12:05:06.348874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348569+0000","last_change":"2024-04-26T12:05:03.798195+0000","last_active":"2024-04-26T12:05:06.348569+0000","last_peered":"2024-04-26T12:05:06.348569+0000","last_clean":"2024-04-26T12:05:06.348569+0000","last_became_active":"2024-04-26T12:05:03.797935+0000","last_became_peered":"2024-04-26T12:05:03.797935+0000","last_unstale":"2024-04-26T12:05:06.348569+0000","last_undegraded":"2024-04-26T12:05:06.348569+0000","last_fullsized":"2024-04-26T12:05:06.348569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:58.872589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348471+0000","last_change":"2024-04-26T12:05:03.792219+0000","last_active":"2024-04-26T12:05:06.348471+0000","last_peered":"2024-04-26T12:05:06.348471+0000","last_clean":"2024-04-26T12:05:06.348471+0000","last_became_active":"2024-04-26T12:05:03.791061+0000","last_became_peered":"2024-04-26T12:05:03.791061+0000","last_unstale":"2024-04-26T12:05:06.348471+0000","last_undegraded":"2024-04-26T12:05:06.348471+0000","last_fullsized":"2024-04-26T12:05:06.348471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348431+0000","last_change":"2024-04-26T12:05:03.792073+0000","last_active":"2024-04-26T12:05:06.348431+0000","last_peered":"2024-04-26T12:05:06.348431+0000","last_clean":"2024-04-26T12:05:06.348431+0000","last_became_active":"2024-04-26T12:05:03.791693+0000","last_became_peered":"2024-04-26T12:05:03.791693+0000","last_unstale":"2024-04-26T12:05:06.348431+0000","last_undegraded":"2024-04-26T12:05:06.348431+0000","last_fullsized":"2024-04-26T12:05:06.348431+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348517+0000","last_change":"2024-04-26T12:05:03.794027+0000","last_active":"2024-04-26T12:05:06.348517+0000","last_peered":"2024-04-26T12:05:06.348517+0000","last_clean":"2024-04-26T12:05:06.348517+0000","last_became_active":"2024-04-26T12:05:03.793660+0000","last_became_peered":"2024-04-26T12:05:03.793660+0000","last_unstale":"2024-04-26T12:05:06.348517+0000","last_undegraded":"2024-04-26T12:05:06.348517+0000","last_fullsized":"2024-04-26T12:05:06.348517+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:53.331006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348421+0000","last_change":"2024-04-26T12:05:03.788658+0000","last_active":"2024-04-26T12:05:06.348421+0000","last_peered":"2024-04-26T12:05:06.348421+0000","last_clean":"2024-04-26T12:05:06.348421+0000","last_became_active":"2024-04-26T12:05:03.788050+0000","last_became_peered":"2024-04-26T12:05:03.788050+0000","last_unstale":"2024-04-26T12:05:06.348421+0000","last_undegraded":"2024-04-26T12:05:06.348421+0000","last_fullsized":"2024-04-26T12:05:06.348421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348355+0000","last_change":"2024-04-26T12:05:03.793554+0000","last_active":"2024-04-26T12:05:06.348355+0000","last_peered":"2024-04-26T12:05:06.348355+0000","last_clean":"2024-04-26T12:05:06.348355+0000","last_became_active":"2024-04-26T12:05:03.792588+0000","last_became_peered":"2024-04-26T12:05:03.792588+0000","last_unstale":"2024-04-26T12:05:06.348355+0000","last_undegraded":"2024-04-26T12:05:06.348355+0000","last_fullsized":"2024-04-26T12:05:06.348355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348937+0000","last_change":"2024-04-26T12:05:03.795510+0000","last_active":"2024-04-26T12:05:06.348937+0000","last_peered":"2024-04-26T12:05:06.348937+0000","last_clean":"2024-04-26T12:05:06.348937+0000","last_became_active":"2024-04-26T12:05:03.794639+0000","last_became_peered":"2024-04-26T12:05:03.794639+0000","last_unstale":"2024-04-26T12:05:06.348937+0000","last_undegraded":"2024-04-26T12:05:06.348937+0000","last_fullsized":"2024-04-26T12:05:06.348937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:57.461628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348586+0000","last_change":"2024-04-26T12:05:03.787909+0000","last_active":"2024-04-26T12:05:06.348586+0000","last_peered":"2024-04-26T12:05:06.348586+0000","last_clean":"2024-04-26T12:05:06.348586+0000","last_became_active":"2024-04-26T12:05:03.787562+0000","last_became_peered":"2024-04-26T12:05:03.787562+0000","last_unstale":"2024-04-26T12:05:06.348586+0000","last_undegraded":"2024-04-26T12:05:06.348586+0000","last_fullsized":"2024-04-26T12:05:06.348586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348539+0000","last_change":"2024-04-26T12:05:03.796836+0000","last_active":"2024-04-26T12:05:06.348539+0000","last_peered":"2024-04-26T12:05:06.348539+0000","last_clean":"2024-04-26T12:05:06.348539+0000","last_became_active":"2024-04-26T12:05:03.796524+0000","last_became_peered":"2024-04-26T12:05:03.796524+0000","last_unstale":"2024-04-26T12:05:06.348539+0000","last_undegraded":"2024-04-26T12:05:06.348539+0000","last_fullsized":"2024-04-26T12:05:06.348539+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348729+0000","last_change":"2024-04-26T12:05:03.792400+0000","last_active":"2024-04-26T12:05:06.348729+0000","last_peered":"2024-04-26T12:05:06.348729+0000","last_clean":"2024-04-26T12:05:06.348729+0000","last_became_active":"2024-04-26T12:05:03.792079+0000","last_became_peered":"2024-04-26T12:05:03.792079+0000","last_unstale":"2024-04-26T12:05:06.348729+0000","last_undegraded":"2024-04-26T12:05:06.348729+0000","last_fullsized":"2024-04-26T12:05:06.348729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:24.434355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348524+0000","last_change":"2024-04-26T12:05:03.797172+0000","last_active":"2024-04-26T12:05:06.348524+0000","last_peered":"2024-04-26T12:05:06.348524+0000","last_clean":"2024-04-26T12:05:06.348524+0000","last_became_active":"2024-04-26T12:05:03.796879+0000","last_became_peered":"2024-04-26T12:05:03.796879+0000","last_unstale":"2024-04-26T12:05:06.348524+0000","last_undegraded":"2024-04-26T12:05:06.348524+0000","last_fullsized":"2024-04-26T12:05:06.348524+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:24.434355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348556+0000","last_change":"2024-04-26T12:05:03.793269+0000","last_active":"2024-04-26T12:05:06.348556+0000","last_peered":"2024-04-26T12:05:06.348556+0000","last_clean":"2024-04-26T12:05:06.348556+0000","last_became_active":"2024-04-26T12:05:03.792698+0000","last_became_peered":"2024-04-26T12:05:03.792698+0000","last_unstale":"2024-04-26T12:05:06.348556+0000","last_undegraded":"2024-04-26T12:05:06.348556+0000","last_fullsized":"2024-04-26T12:05:06.348556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:58.579861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348429+0000","last_change":"2024-04-26T12:05:03.796871+0000","last_active":"2024-04-26T12:05:06.348429+0000","last_peered":"2024-04-26T12:05:06.348429+0000","last_clean":"2024-04-26T12:05:06.348429+0000","last_became_active":"2024-04-26T12:05:03.796546+0000","last_became_peered":"2024-04-26T12:05:03.796546+0000","last_unstale":"2024-04-26T12:05:06.348429+0000","last_undegraded":"2024-04-26T12:05:06.348429+0000","last_fullsized":"2024-04-26T12:05:06.348429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:53.331006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348298+0000","last_change":"2024-04-26T12:05:03.791605+0000","last_active":"2024-04-26T12:05:06.348298+0000","last_peered":"2024-04-26T12:05:06.348298+0000","last_clean":"2024-04-26T12:05:06.348298+0000","last_became_active":"2024-04-26T12:05:03.791251+0000","last_became_peered":"2024-04-26T12:05:03.791251+0000","last_unstale":"2024-04-26T12:05:06.348298+0000","last_undegraded":"2024-04-26T12:05:06.348298+0000","last_fullsized":"2024-04-26T12:05:06.348298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:27.239868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348714+0000","last_change":"2024-04-26T12:05:03.793791+0000","last_active":"2024-04-26T12:05:06.348714+0000","last_peered":"2024-04-26T12:05:06.348714+0000","last_clean":"2024-04-26T12:05:06.348714+0000","last_became_active":"2024-04-26T12:05:03.793468+0000","last_became_peered":"2024-04-26T12:05:03.793468+0000","last_unstale":"2024-04-26T12:05:06.348714+0000","last_undegraded":"2024-04-26T12:05:06.348714+0000","last_fullsized":"2024-04-26T12:05:06.348714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:01.289069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348440+0000","last_change":"2024-04-26T12:05:03.430021+0000","last_active":"2024-04-26T12:05:06.348440+0000","last_peered":"2024-04-26T12:05:06.348440+0000","last_clean":"2024-04-26T12:05:06.348440+0000","last_became_active":"2024-04-26T12:05:03.429695+0000","last_became_peered":"2024-04-26T12:05:03.429695+0000","last_unstale":"2024-04-26T12:05:06.348440+0000","last_undegraded":"2024-04-26T12:05:06.348440+0000","last_fullsized":"2024-04-26T12:05:06.348440+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348757+0000","last_change":"2024-04-26T12:05:03.796189+0000","last_active":"2024-04-26T12:05:06.348757+0000","last_peered":"2024-04-26T12:05:06.348757+0000","last_clean":"2024-04-26T12:05:06.348757+0000","last_became_active":"2024-04-26T12:05:03.795438+0000","last_became_peered":"2024-04-26T12:05:03.795438+0000","last_unstale":"2024-04-26T12:05:06.348757+0000","last_undegraded":"2024-04-26T12:05:06.348757+0000","last_fullsized":"2024-04-26T12:05:06.348757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:22.814807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348493+0000","last_change":"2024-04-26T12:05:03.428605+0000","last_active":"2024-04-26T12:05:06.348493+0000","last_peered":"2024-04-26T12:05:06.348493+0000","last_clean":"2024-04-26T12:05:06.348493+0000","last_became_active":"2024-04-26T12:05:03.428098+0000","last_became_peered":"2024-04-26T12:05:03.428098+0000","last_unstale":"2024-04-26T12:05:06.348493+0000","last_undegraded":"2024-04-26T12:05:06.348493+0000","last_fullsized":"2024-04-26T12:05:06.348493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348613+0000","last_change":"2024-04-26T12:05:03.788568+0000","last_active":"2024-04-26T12:05:06.348613+0000","last_peered":"2024-04-26T12:05:06.348613+0000","last_clean":"2024-04-26T12:05:06.348613+0000","last_became_active":"2024-04-26T12:05:03.788039+0000","last_became_peered":"2024-04-26T12:05:03.788039+0000","last_unstale":"2024-04-26T12:05:06.348613+0000","last_undegraded":"2024-04-26T12:05:06.348613+0000","last_fullsized":"2024-04-26T12:05:06.348613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348468+0000","last_change":"2024-04-26T12:05:03.422773+0000","last_active":"2024-04-26T12:05:06.348468+0000","last_peered":"2024-04-26T12:05:06.348468+0000","last_clean":"2024-04-26T12:05:06.348468+0000","last_became_active":"2024-04-26T12:05:03.422412+0000","last_became_peered":"2024-04-26T12:05:03.422412+0000","last_unstale":"2024-04-26T12:05:06.348468+0000","last_undegraded":"2024-04-26T12:05:06.348468+0000","last_fullsized":"2024-04-26T12:05:06.348468+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:06.758253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348645+0000","last_change":"2024-04-26T12:05:03.788505+0000","last_active":"2024-04-26T12:05:06.348645+0000","last_peered":"2024-04-26T12:05:06.348645+0000","last_clean":"2024-04-26T12:05:06.348645+0000","last_became_active":"2024-04-26T12:05:03.788184+0000","last_became_peered":"2024-04-26T12:05:03.788184+0000","last_unstale":"2024-04-26T12:05:06.348645+0000","last_undegraded":"2024-04-26T12:05:06.348645+0000","last_fullsized":"2024-04-26T12:05:06.348645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348307+0000","last_change":"2024-04-26T12:05:03.425495+0000","last_active":"2024-04-26T12:05:06.348307+0000","last_peered":"2024-04-26T12:05:06.348307+0000","last_clean":"2024-04-26T12:05:06.348307+0000","last_became_active":"2024-04-26T12:05:03.424963+0000","last_became_peered":"2024-04-26T12:05:03.424963+0000","last_unstale":"2024-04-26T12:05:06.348307+0000","last_undegraded":"2024-04-26T12:05:06.348307+0000","last_fullsized":"2024-04-26T12:05:06.348307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:55.660897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348623+0000","last_change":"2024-04-26T12:05:03.426142+0000","last_active":"2024-04-26T12:05:06.348623+0000","last_peered":"2024-04-26T12:05:06.348623+0000","last_clean":"2024-04-26T12:05:06.348623+0000","last_became_active":"2024-04-26T12:05:03.425699+0000","last_became_peered":"2024-04-26T12:05:03.425699+0000","last_unstale":"2024-04-26T12:05:06.348623+0000","last_undegraded":"2024-04-26T12:05:06.348623+0000","last_fullsized":"2024-04-26T12:05:06.348623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:41.279426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348376+0000","last_change":"2024-04-26T12:05:03.794778+0000","last_active":"2024-04-26T12:05:06.348376+0000","last_peered":"2024-04-26T12:05:06.348376+0000","last_clean":"2024-04-26T12:05:06.348376+0000","last_became_active":"2024-04-26T12:05:03.794192+0000","last_became_peered":"2024-04-26T12:05:03.794192+0000","last_unstale":"2024-04-26T12:05:06.348376+0000","last_undegraded":"2024-04-26T12:05:06.348376+0000","last_fullsized":"2024-04-26T12:05:06.348376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:16.372597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348903+0000","last_change":"2024-04-26T12:05:03.426530+0000","last_active":"2024-04-26T12:05:06.348903+0000","last_peered":"2024-04-26T12:05:06.348903+0000","last_clean":"2024-04-26T12:05:06.348903+0000","last_became_active":"2024-04-26T12:05:03.426113+0000","last_became_peered":"2024-04-26T12:05:03.426113+0000","last_unstale":"2024-04-26T12:05:06.348903+0000","last_undegraded":"2024-04-26T12:05:06.348903+0000","last_fullsized":"2024-04-26T12:05:06.348903+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:21.029311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348438+0000","last_change":"2024-04-26T12:05:03.793000+0000","last_active":"2024-04-26T12:05:06.348438+0000","last_peered":"2024-04-26T12:05:06.348438+0000","last_clean":"2024-04-26T12:05:06.348438+0000","last_became_active":"2024-04-26T12:05:03.792480+0000","last_became_peered":"2024-04-26T12:05:03.792480+0000","last_unstale":"2024-04-26T12:05:06.348438+0000","last_undegraded":"2024-04-26T12:05:06.348438+0000","last_fullsized":"2024-04-26T12:05:06.348438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348565+0000","last_change":"2024-04-26T12:05:03.426039+0000","last_active":"2024-04-26T12:05:06.348565+0000","last_peered":"2024-04-26T12:05:06.348565+0000","last_clean":"2024-04-26T12:05:06.348565+0000","last_became_active":"2024-04-26T12:05:03.425666+0000","last_became_peered":"2024-04-26T12:05:03.425666+0000","last_unstale":"2024-04-26T12:05:06.348565+0000","last_undegraded":"2024-04-26T12:05:06.348565+0000","last_fullsized":"2024-04-26T12:05:06.348565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:00.998013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348379+0000","last_change":"2024-04-26T12:05:03.791809+0000","last_active":"2024-04-26T12:05:06.348379+0000","last_peered":"2024-04-26T12:05:06.348379+0000","last_clean":"2024-04-26T12:05:06.348379+0000","last_became_active":"2024-04-26T12:05:03.791272+0000","last_became_peered":"2024-04-26T12:05:03.791272+0000","last_unstale":"2024-04-26T12:05:06.348379+0000","last_undegraded":"2024-04-26T12:05:06.348379+0000","last_fullsized":"2024-04-26T12:05:06.348379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348512+0000","last_change":"2024-04-26T12:05:03.430224+0000","last_active":"2024-04-26T12:05:06.348512+0000","last_peered":"2024-04-26T12:05:06.348512+0000","last_clean":"2024-04-26T12:05:06.348512+0000","last_became_active":"2024-04-26T12:05:03.429291+0000","last_became_peered":"2024-04-26T12:05:03.429291+0000","last_unstale":"2024-04-26T12:05:06.348512+0000","last_undegraded":"2024-04-26T12:05:06.348512+0000","last_fullsized":"2024-04-26T12:05:06.348512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348510+0000","last_change":"2024-04-26T12:05:03.788174+0000","last_active":"2024-04-26T12:05:06.348510+0000","last_peered":"2024-04-26T12:05:06.348510+0000","last_clean":"2024-04-26T12:05:06.348510+0000","last_became_active":"2024-04-26T12:05:03.787772+0000","last_became_peered":"2024-04-26T12:05:03.787772+0000","last_unstale":"2024-04-26T12:05:06.348510+0000","last_undegraded":"2024-04-26T12:05:06.348510+0000","last_fullsized":"2024-04-26T12:05:06.348510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348534+0000","last_change":"2024-04-26T12:05:03.431162+0000","last_active":"2024-04-26T12:05:06.348534+0000","last_peered":"2024-04-26T12:05:06.348534+0000","last_clean":"2024-04-26T12:05:06.348534+0000","last_became_active":"2024-04-26T12:05:03.430855+0000","last_became_peered":"2024-04-26T12:05:03.430855+0000","last_unstale":"2024-04-26T12:05:06.348534+0000","last_undegraded":"2024-04-26T12:05:06.348534+0000","last_fullsized":"2024-04-26T12:05:06.348534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:41.279426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348479+0000","last_change":"2024-04-26T12:05:03.792357+0000","last_active":"2024-04-26T12:05:06.348479+0000","last_peered":"2024-04-26T12:05:06.348479+0000","last_clean":"2024-04-26T12:05:06.348479+0000","last_became_active":"2024-04-26T12:05:03.792119+0000","last_became_peered":"2024-04-26T12:05:03.792119+0000","last_unstale":"2024-04-26T12:05:06.348479+0000","last_undegraded":"2024-04-26T12:05:06.348479+0000","last_fullsized":"2024-04-26T12:05:06.348479+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348396+0000","last_change":"2024-04-26T12:05:03.429811+0000","last_active":"2024-04-26T12:05:06.348396+0000","last_peered":"2024-04-26T12:05:06.348396+0000","last_clean":"2024-04-26T12:05:06.348396+0000","last_became_active":"2024-04-26T12:05:03.429469+0000","last_became_peered":"2024-04-26T12:05:03.429469+0000","last_unstale":"2024-04-26T12:05:06.348396+0000","last_undegraded":"2024-04-26T12:05:06.348396+0000","last_fullsized":"2024-04-26T12:05:06.348396+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348548+0000","last_change":"2024-04-26T12:05:03.795646+0000","last_active":"2024-04-26T12:05:06.348548+0000","last_peered":"2024-04-26T12:05:06.348548+0000","last_clean":"2024-04-26T12:05:06.348548+0000","last_became_active":"2024-04-26T12:05:03.795354+0000","last_became_peered":"2024-04-26T12:05:03.795354+0000","last_unstale":"2024-04-26T12:05:06.348548+0000","last_undegraded":"2024-04-26T12:05:06.348548+0000","last_fullsized":"2024-04-26T12:05:06.348548+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:22.814807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348484+0000","last_change":"2024-04-26T12:05:03.427908+0000","last_active":"2024-04-26T12:05:06.348484+0000","last_peered":"2024-04-26T12:05:06.348484+0000","last_clean":"2024-04-26T12:05:06.348484+0000","last_became_active":"2024-04-26T12:05:03.426718+0000","last_became_peered":"2024-04-26T12:05:03.426718+0000","last_unstale":"2024-04-26T12:05:06.348484+0000","last_undegraded":"2024-04-26T12:05:06.348484+0000","last_fullsized":"2024-04-26T12:05:06.348484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:40.538058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348606+0000","last_change":"2024-04-26T12:05:03.797113+0000","last_active":"2024-04-26T12:05:06.348606+0000","last_peered":"2024-04-26T12:05:06.348606+0000","last_clean":"2024-04-26T12:05:06.348606+0000","last_became_active":"2024-04-26T12:05:03.796739+0000","last_became_peered":"2024-04-26T12:05:03.796739+0000","last_unstale":"2024-04-26T12:05:06.348606+0000","last_undegraded":"2024-04-26T12:05:06.348606+0000","last_fullsized":"2024-04-26T12:05:06.348606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:59.873501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348406+0000","last_change":"2024-04-26T12:05:03.428262+0000","last_active":"2024-04-26T12:05:06.348406+0000","last_peered":"2024-04-26T12:05:06.348406+0000","last_clean":"2024-04-26T12:05:06.348406+0000","last_became_active":"2024-04-26T12:05:03.426588+0000","last_became_peered":"2024-04-26T12:05:03.426588+0000","last_unstale":"2024-04-26T12:05:06.348406+0000","last_undegraded":"2024-04-26T12:05:06.348406+0000","last_fullsized":"2024-04-26T12:05:06.348406+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:42.674797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348672+0000","last_change":"2024-04-26T12:05:03.797633+0000","last_active":"2024-04-26T12:05:06.348672+0000","last_peered":"2024-04-26T12:05:06.348672+0000","last_clean":"2024-04-26T12:05:06.348672+0000","last_became_active":"2024-04-26T12:05:03.797338+0000","last_became_peered":"2024-04-26T12:05:03.797338+0000","last_unstale":"2024-04-26T12:05:06.348672+0000","last_undegraded":"2024-04-26T12:05:06.348672+0000","last_fullsized":"2024-04-26T12:05:06.348672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:22.814807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781975+0000","last_change":"2024-04-26T12:04:53.388840+0000","last_active":"2024-04-26T12:05:04.781975+0000","last_peered":"2024-04-26T12:05:04.781975+0000","last_clean":"2024-04-26T12:05:04.781975+0000","last_became_active":"2024-04-26T12:04:53.388568+0000","last_became_peered":"2024-04-26T12:04:53.388568+0000","last_unstale":"2024-04-26T12:05:04.781975+0000","last_undegraded":"2024-04-26T12:05:04.781975+0000","last_fullsized":"2024-04-26T12:05:04.781975+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_clean_scrub_stamp":"2024-04-26T12:04:52.376986+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:04.970330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782588+0000","last_change":"2024-04-26T12:04:59.403711+0000","last_active":"2024-04-26T12:05:04.782588+0000","last_peered":"2024-04-26T12:05:04.782588+0000","last_clean":"2024-04-26T12:05:04.782588+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:05:04.782588+0000","last_undegraded":"2024-04-26T12:05:04.782588+0000","last_fullsized":"2024-04-26T12:05:04.782588+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:45.779614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348501+0000","last_change":"2024-04-26T12:05:03.429674+0000","last_active":"2024-04-26T12:05:06.348501+0000","last_peered":"2024-04-26T12:05:06.348501+0000","last_clean":"2024-04-26T12:05:06.348501+0000","last_became_active":"2024-04-26T12:05:03.429266+0000","last_became_peered":"2024-04-26T12:05:03.429266+0000","last_unstale":"2024-04-26T12:05:06.348501+0000","last_undegraded":"2024-04-26T12:05:06.348501+0000","last_fullsized":"2024-04-26T12:05:06.348501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:55.660897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348555+0000","last_change":"2024-04-26T12:05:03.797640+0000","last_active":"2024-04-26T12:05:06.348555+0000","last_peered":"2024-04-26T12:05:06.348555+0000","last_clean":"2024-04-26T12:05:06.348555+0000","last_became_active":"2024-04-26T12:05:03.797302+0000","last_became_peered":"2024-04-26T12:05:03.797302+0000","last_unstale":"2024-04-26T12:05:06.348555+0000","last_undegraded":"2024-04-26T12:05:06.348555+0000","last_fullsized":"2024-04-26T12:05:06.348555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:16.372597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781833+0000","last_change":"2024-04-26T12:04:59.405437+0000","last_active":"2024-04-26T12:05:04.781833+0000","last_peered":"2024-04-26T12:05:04.781833+0000","last_clean":"2024-04-26T12:05:04.781833+0000","last_became_active":"2024-04-26T12:04:59.405193+0000","last_became_peered":"2024-04-26T12:04:59.405193+0000","last_unstale":"2024-04-26T12:05:04.781833+0000","last_undegraded":"2024-04-26T12:05:04.781833+0000","last_fullsized":"2024-04-26T12:05:04.781833+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:20.977569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348467+0000","last_change":"2024-04-26T12:05:03.428547+0000","last_active":"2024-04-26T12:05:06.348467+0000","last_peered":"2024-04-26T12:05:06.348467+0000","last_clean":"2024-04-26T12:05:06.348467+0000","last_became_active":"2024-04-26T12:05:03.427985+0000","last_became_peered":"2024-04-26T12:05:03.427985+0000","last_unstale":"2024-04-26T12:05:06.348467+0000","last_undegraded":"2024-04-26T12:05:06.348467+0000","last_fullsized":"2024-04-26T12:05:06.348467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:19.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348887+0000","last_change":"2024-04-26T12:05:03.793800+0000","last_active":"2024-04-26T12:05:06.348887+0000","last_peered":"2024-04-26T12:05:06.348887+0000","last_clean":"2024-04-26T12:05:06.348887+0000","last_became_active":"2024-04-26T12:05:03.792932+0000","last_became_peered":"2024-04-26T12:05:03.792932+0000","last_unstale":"2024-04-26T12:05:06.348887+0000","last_undegraded":"2024-04-26T12:05:06.348887+0000","last_fullsized":"2024-04-26T12:05:06.348887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203931+0000","last_change":"2024-04-26T12:04:59.405617+0000","last_active":"2024-04-26T12:05:05.203931+0000","last_peered":"2024-04-26T12:05:05.203931+0000","last_clean":"2024-04-26T12:05:05.203931+0000","last_became_active":"2024-04-26T12:04:59.405328+0000","last_became_peered":"2024-04-26T12:04:59.405328+0000","last_unstale":"2024-04-26T12:05:05.203931+0000","last_undegraded":"2024-04-26T12:05:05.203931+0000","last_fullsized":"2024-04-26T12:05:05.203931+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:39.317039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348422+0000","last_change":"2024-04-26T12:05:03.424576+0000","last_active":"2024-04-26T12:05:06.348422+0000","last_peered":"2024-04-26T12:05:06.348422+0000","last_clean":"2024-04-26T12:05:06.348422+0000","last_became_active":"2024-04-26T12:05:03.424289+0000","last_became_peered":"2024-04-26T12:05:03.424289+0000","last_unstale":"2024-04-26T12:05:06.348422+0000","last_undegraded":"2024-04-26T12:05:06.348422+0000","last_fullsized":"2024-04-26T12:05:06.348422+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:10.759772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348679+0000","last_change":"2024-04-26T12:05:03.798238+0000","last_active":"2024-04-26T12:05:06.348679+0000","last_peered":"2024-04-26T12:05:06.348679+0000","last_clean":"2024-04-26T12:05:06.348679+0000","last_became_active":"2024-04-26T12:05:03.797924+0000","last_became_peered":"2024-04-26T12:05:03.797924+0000","last_unstale":"2024-04-26T12:05:06.348679+0000","last_undegraded":"2024-04-26T12:05:06.348679+0000","last_fullsized":"2024-04-26T12:05:06.348679+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:01.289069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782013+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:05:04.782013+0000","last_peered":"2024-04-26T12:05:04.782013+0000","last_clean":"2024-04-26T12:05:04.782013+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:05:04.782013+0000","last_undegraded":"2024-04-26T12:05:04.782013+0000","last_fullsized":"2024-04-26T12:05:04.782013+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:12.939539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348450+0000","last_change":"2024-04-26T12:05:03.430140+0000","last_active":"2024-04-26T12:05:06.348450+0000","last_peered":"2024-04-26T12:05:06.348450+0000","last_clean":"2024-04-26T12:05:06.348450+0000","last_became_active":"2024-04-26T12:05:03.429838+0000","last_became_peered":"2024-04-26T12:05:03.429838+0000","last_unstale":"2024-04-26T12:05:06.348450+0000","last_undegraded":"2024-04-26T12:05:06.348450+0000","last_fullsized":"2024-04-26T12:05:06.348450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348546+0000","last_change":"2024-04-26T12:05:03.796731+0000","last_active":"2024-04-26T12:05:06.348546+0000","last_peered":"2024-04-26T12:05:06.348546+0000","last_clean":"2024-04-26T12:05:06.348546+0000","last_became_active":"2024-04-26T12:05:03.796432+0000","last_became_peered":"2024-04-26T12:05:03.796432+0000","last_unstale":"2024-04-26T12:05:06.348546+0000","last_undegraded":"2024-04-26T12:05:06.348546+0000","last_fullsized":"2024-04-26T12:05:06.348546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:58.579861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348597+0000","last_change":"2024-04-26T12:05:03.429673+0000","last_active":"2024-04-26T12:05:06.348597+0000","last_peered":"2024-04-26T12:05:06.348597+0000","last_clean":"2024-04-26T12:05:06.348597+0000","last_became_active":"2024-04-26T12:05:03.429146+0000","last_became_peered":"2024-04-26T12:05:03.429146+0000","last_unstale":"2024-04-26T12:05:06.348597+0000","last_undegraded":"2024-04-26T12:05:06.348597+0000","last_fullsized":"2024-04-26T12:05:06.348597+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204510+0000","last_change":"2024-04-26T12:04:59.405766+0000","last_active":"2024-04-26T12:05:05.204510+0000","last_peered":"2024-04-26T12:05:05.204510+0000","last_clean":"2024-04-26T12:05:05.204510+0000","last_became_active":"2024-04-26T12:04:59.405406+0000","last_became_peered":"2024-04-26T12:04:59.405406+0000","last_unstale":"2024-04-26T12:05:05.204510+0000","last_undegraded":"2024-04-26T12:05:05.204510+0000","last_fullsized":"2024-04-26T12:05:05.204510+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:13.860871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348541+0000","last_change":"2024-04-26T12:05:03.792534+0000","last_active":"2024-04-26T12:05:06.348541+0000","last_peered":"2024-04-26T12:05:06.348541+0000","last_clean":"2024-04-26T12:05:06.348541+0000","last_became_active":"2024-04-26T12:05:03.792160+0000","last_became_peered":"2024-04-26T12:05:03.792160+0000","last_unstale":"2024-04-26T12:05:06.348541+0000","last_undegraded":"2024-04-26T12:05:06.348541+0000","last_fullsized":"2024-04-26T12:05:06.348541+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:41.930005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348555+0000","last_change":"2024-04-26T12:05:03.429642+0000","last_active":"2024-04-26T12:05:06.348555+0000","last_peered":"2024-04-26T12:05:06.348555+0000","last_clean":"2024-04-26T12:05:06.348555+0000","last_became_active":"2024-04-26T12:05:03.429197+0000","last_became_peered":"2024-04-26T12:05:03.429197+0000","last_unstale":"2024-04-26T12:05:06.348555+0000","last_undegraded":"2024-04-26T12:05:06.348555+0000","last_fullsized":"2024-04-26T12:05:06.348555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:40.538058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782757+0000","last_change":"2024-04-26T12:04:59.405294+0000","last_active":"2024-04-26T12:05:04.782757+0000","last_peered":"2024-04-26T12:05:04.782757+0000","last_clean":"2024-04-26T12:05:04.782757+0000","last_became_active":"2024-04-26T12:04:59.405044+0000","last_became_peered":"2024-04-26T12:04:59.405044+0000","last_unstale":"2024-04-26T12:05:04.782757+0000","last_undegraded":"2024-04-26T12:05:04.782757+0000","last_fullsized":"2024-04-26T12:05:04.782757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:47.042833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348610+0000","last_change":"2024-04-26T12:05:03.793408+0000","last_active":"2024-04-26T12:05:06.348610+0000","last_peered":"2024-04-26T12:05:06.348610+0000","last_clean":"2024-04-26T12:05:06.348610+0000","last_became_active":"2024-04-26T12:05:03.793019+0000","last_became_peered":"2024-04-26T12:05:03.793019+0000","last_unstale":"2024-04-26T12:05:06.348610+0000","last_undegraded":"2024-04-26T12:05:06.348610+0000","last_fullsized":"2024-04-26T12:05:06.348610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:25.062114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348723+0000","last_change":"2024-04-26T12:05:03.430008+0000","last_active":"2024-04-26T12:05:06.348723+0000","last_peered":"2024-04-26T12:05:06.348723+0000","last_clean":"2024-04-26T12:05:06.348723+0000","last_became_active":"2024-04-26T12:05:03.429362+0000","last_became_peered":"2024-04-26T12:05:03.429362+0000","last_unstale":"2024-04-26T12:05:06.348723+0000","last_undegraded":"2024-04-26T12:05:06.348723+0000","last_fullsized":"2024-04-26T12:05:06.348723+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204674+0000","last_change":"2024-04-26T12:04:59.405667+0000","last_active":"2024-04-26T12:05:05.204674+0000","last_peered":"2024-04-26T12:05:05.204674+0000","last_clean":"2024-04-26T12:05:05.204674+0000","last_became_active":"2024-04-26T12:04:59.405328+0000","last_became_peered":"2024-04-26T12:04:59.405328+0000","last_unstale":"2024-04-26T12:05:05.204674+0000","last_undegraded":"2024-04-26T12:05:05.204674+0000","last_fullsized":"2024-04-26T12:05:05.204674+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:20.977569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348401+0000","last_change":"2024-04-26T12:05:03.789623+0000","last_active":"2024-04-26T12:05:06.348401+0000","last_peered":"2024-04-26T12:05:06.348401+0000","last_clean":"2024-04-26T12:05:06.348401+0000","last_became_active":"2024-04-26T12:05:03.789390+0000","last_became_peered":"2024-04-26T12:05:03.789390+0000","last_unstale":"2024-04-26T12:05:06.348401+0000","last_undegraded":"2024-04-26T12:05:06.348401+0000","last_fullsized":"2024-04-26T12:05:06.348401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:09.507379+0000","last_change":"2024-04-26T12:05:03.429222+0000","last_active":"2024-04-26T12:05:09.507379+0000","last_peered":"2024-04-26T12:05:09.507379+0000","last_clean":"2024-04-26T12:05:09.507379+0000","last_became_active":"2024-04-26T12:05:03.428803+0000","last_became_peered":"2024-04-26T12:05:03.428803+0000","last_unstale":"2024-04-26T12:05:09.507379+0000","last_undegraded":"2024-04-26T12:05:09.507379+0000","last_fullsized":"2024-04-26T12:05:09.507379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:31.305644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782539+0000","last_change":"2024-04-26T12:04:59.408078+0000","last_active":"2024-04-26T12:05:04.782539+0000","last_peered":"2024-04-26T12:05:04.782539+0000","last_clean":"2024-04-26T12:05:04.782539+0000","last_became_active":"2024-04-26T12:04:59.407804+0000","last_became_peered":"2024-04-26T12:04:59.407804+0000","last_unstale":"2024-04-26T12:05:04.782539+0000","last_undegraded":"2024-04-26T12:05:04.782539+0000","last_fullsized":"2024-04-26T12:05:04.782539+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:56.449518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348454+0000","last_change":"2024-04-26T12:05:03.792547+0000","last_active":"2024-04-26T12:05:06.348454+0000","last_peered":"2024-04-26T12:05:06.348454+0000","last_clean":"2024-04-26T12:05:06.348454+0000","last_became_active":"2024-04-26T12:05:03.792078+0000","last_became_peered":"2024-04-26T12:05:03.792078+0000","last_unstale":"2024-04-26T12:05:06.348454+0000","last_undegraded":"2024-04-26T12:05:06.348454+0000","last_fullsized":"2024-04-26T12:05:06.348454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:45.563923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348418+0000","last_change":"2024-04-26T12:05:03.795500+0000","last_active":"2024-04-26T12:05:06.348418+0000","last_peered":"2024-04-26T12:05:06.348418+0000","last_clean":"2024-04-26T12:05:06.348418+0000","last_became_active":"2024-04-26T12:05:03.795173+0000","last_became_peered":"2024-04-26T12:05:03.795173+0000","last_unstale":"2024-04-26T12:05:06.348418+0000","last_undegraded":"2024-04-26T12:05:06.348418+0000","last_fullsized":"2024-04-26T12:05:06.348418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:01.289069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348503+0000","last_change":"2024-04-26T12:05:03.426261+0000","last_active":"2024-04-26T12:05:06.348503+0000","last_peered":"2024-04-26T12:05:06.348503+0000","last_clean":"2024-04-26T12:05:06.348503+0000","last_became_active":"2024-04-26T12:05:03.425897+0000","last_became_peered":"2024-04-26T12:05:03.425897+0000","last_unstale":"2024-04-26T12:05:06.348503+0000","last_undegraded":"2024-04-26T12:05:06.348503+0000","last_fullsized":"2024-04-26T12:05:06.348503+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:31.305644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348483+0000","last_change":"2024-04-26T12:05:03.795443+0000","last_active":"2024-04-26T12:05:06.348483+0000","last_peered":"2024-04-26T12:05:06.348483+0000","last_clean":"2024-04-26T12:05:06.348483+0000","last_became_active":"2024-04-26T12:05:03.795190+0000","last_became_peered":"2024-04-26T12:05:03.795190+0000","last_unstale":"2024-04-26T12:05:06.348483+0000","last_undegraded":"2024-04-26T12:05:06.348483+0000","last_fullsized":"2024-04-26T12:05:06.348483+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:59.873501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348810+0000","last_change":"2024-04-26T12:05:03.425106+0000","last_active":"2024-04-26T12:05:06.348810+0000","last_peered":"2024-04-26T12:05:06.348810+0000","last_clean":"2024-04-26T12:05:06.348810+0000","last_became_active":"2024-04-26T12:05:03.424753+0000","last_became_peered":"2024-04-26T12:05:03.424753+0000","last_unstale":"2024-04-26T12:05:06.348810+0000","last_undegraded":"2024-04-26T12:05:06.348810+0000","last_fullsized":"2024-04-26T12:05:06.348810+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:10.741652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348614+0000","last_change":"2024-04-26T12:05:03.429257+0000","last_active":"2024-04-26T12:05:06.348614+0000","last_peered":"2024-04-26T12:05:06.348614+0000","last_clean":"2024-04-26T12:05:06.348614+0000","last_became_active":"2024-04-26T12:05:03.428921+0000","last_became_peered":"2024-04-26T12:05:03.428921+0000","last_unstale":"2024-04-26T12:05:06.348614+0000","last_undegraded":"2024-04-26T12:05:06.348614+0000","last_fullsized":"2024-04-26T12:05:06.348614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:49.774845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348451+0000","last_change":"2024-04-26T12:05:03.788141+0000","last_active":"2024-04-26T12:05:06.348451+0000","last_peered":"2024-04-26T12:05:06.348451+0000","last_clean":"2024-04-26T12:05:06.348451+0000","last_became_active":"2024-04-26T12:05:03.787533+0000","last_became_peered":"2024-04-26T12:05:03.787533+0000","last_unstale":"2024-04-26T12:05:06.348451+0000","last_undegraded":"2024-04-26T12:05:06.348451+0000","last_fullsized":"2024-04-26T12:05:06.348451+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348704+0000","last_change":"2024-04-26T12:05:03.428971+0000","last_active":"2024-04-26T12:05:06.348704+0000","last_peered":"2024-04-26T12:05:06.348704+0000","last_clean":"2024-04-26T12:05:06.348704+0000","last_became_active":"2024-04-26T12:05:03.428445+0000","last_became_peered":"2024-04-26T12:05:03.428445+0000","last_unstale":"2024-04-26T12:05:06.348704+0000","last_undegraded":"2024-04-26T12:05:06.348704+0000","last_fullsized":"2024-04-26T12:05:06.348704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348385+0000","last_change":"2024-04-26T12:05:03.795318+0000","last_active":"2024-04-26T12:05:06.348385+0000","last_peered":"2024-04-26T12:05:06.348385+0000","last_clean":"2024-04-26T12:05:06.348385+0000","last_became_active":"2024-04-26T12:05:03.795053+0000","last_became_peered":"2024-04-26T12:05:03.795053+0000","last_unstale":"2024-04-26T12:05:06.348385+0000","last_undegraded":"2024-04-26T12:05:06.348385+0000","last_fullsized":"2024-04-26T12:05:06.348385+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:16.372597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348963+0000","last_change":"2024-04-26T12:05:03.795109+0000","last_active":"2024-04-26T12:05:06.348963+0000","last_peered":"2024-04-26T12:05:06.348963+0000","last_clean":"2024-04-26T12:05:06.348963+0000","last_became_active":"2024-04-26T12:05:03.794392+0000","last_became_peered":"2024-04-26T12:05:03.794392+0000","last_unstale":"2024-04-26T12:05:06.348963+0000","last_undegraded":"2024-04-26T12:05:06.348963+0000","last_fullsized":"2024-04-26T12:05:06.348963+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:05.327938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348410+0000","last_change":"2024-04-26T12:05:03.429889+0000","last_active":"2024-04-26T12:05:06.348410+0000","last_peered":"2024-04-26T12:05:06.348410+0000","last_clean":"2024-04-26T12:05:06.348410+0000","last_became_active":"2024-04-26T12:05:03.429370+0000","last_became_peered":"2024-04-26T12:05:03.429370+0000","last_unstale":"2024-04-26T12:05:06.348410+0000","last_undegraded":"2024-04-26T12:05:06.348410+0000","last_fullsized":"2024-04-26T12:05:06.348410+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:26.791180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348577+0000","last_change":"2024-04-26T12:05:03.788754+0000","last_active":"2024-04-26T12:05:06.348577+0000","last_peered":"2024-04-26T12:05:06.348577+0000","last_clean":"2024-04-26T12:05:06.348577+0000","last_became_active":"2024-04-26T12:05:03.788311+0000","last_became_peered":"2024-04-26T12:05:03.788311+0000","last_unstale":"2024-04-26T12:05:06.348577+0000","last_undegraded":"2024-04-26T12:05:06.348577+0000","last_fullsized":"2024-04-26T12:05:06.348577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348460+0000","last_change":"2024-04-26T12:05:03.428810+0000","last_active":"2024-04-26T12:05:06.348460+0000","last_peered":"2024-04-26T12:05:06.348460+0000","last_clean":"2024-04-26T12:05:06.348460+0000","last_became_active":"2024-04-26T12:05:03.428191+0000","last_became_peered":"2024-04-26T12:05:03.428191+0000","last_unstale":"2024-04-26T12:05:06.348460+0000","last_undegraded":"2024-04-26T12:05:06.348460+0000","last_fullsized":"2024-04-26T12:05:06.348460+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348744+0000","last_change":"2024-04-26T12:05:03.796880+0000","last_active":"2024-04-26T12:05:06.348744+0000","last_peered":"2024-04-26T12:05:06.348744+0000","last_clean":"2024-04-26T12:05:06.348744+0000","last_became_active":"2024-04-26T12:05:03.796419+0000","last_became_peered":"2024-04-26T12:05:03.796419+0000","last_unstale":"2024-04-26T12:05:06.348744+0000","last_undegraded":"2024-04-26T12:05:06.348744+0000","last_fullsized":"2024-04-26T12:05:06.348744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:58.872589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348572+0000","last_change":"2024-04-26T12:05:03.428084+0000","last_active":"2024-04-26T12:05:06.348572+0000","last_peered":"2024-04-26T12:05:06.348572+0000","last_clean":"2024-04-26T12:05:06.348572+0000","last_became_active":"2024-04-26T12:05:03.426982+0000","last_became_peered":"2024-04-26T12:05:03.426982+0000","last_unstale":"2024-04-26T12:05:06.348572+0000","last_undegraded":"2024-04-26T12:05:06.348572+0000","last_fullsized":"2024-04-26T12:05:06.348572+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:19.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348701+0000","last_change":"2024-04-26T12:05:03.793470+0000","last_active":"2024-04-26T12:05:06.348701+0000","last_peered":"2024-04-26T12:05:06.348701+0000","last_clean":"2024-04-26T12:05:06.348701+0000","last_became_active":"2024-04-26T12:05:03.792869+0000","last_became_peered":"2024-04-26T12:05:03.792869+0000","last_unstale":"2024-04-26T12:05:06.348701+0000","last_undegraded":"2024-04-26T12:05:06.348701+0000","last_fullsized":"2024-04-26T12:05:06.348701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:27.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348643+0000","last_change":"2024-04-26T12:05:03.426947+0000","last_active":"2024-04-26T12:05:06.348643+0000","last_peered":"2024-04-26T12:05:06.348643+0000","last_clean":"2024-04-26T12:05:06.348643+0000","last_became_active":"2024-04-26T12:05:03.426211+0000","last_became_peered":"2024-04-26T12:05:03.426211+0000","last_unstale":"2024-04-26T12:05:06.348643+0000","last_undegraded":"2024-04-26T12:05:06.348643+0000","last_fullsized":"2024-04-26T12:05:06.348643+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:11.959244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348410+0000","last_change":"2024-04-26T12:05:03.791986+0000","last_active":"2024-04-26T12:05:06.348410+0000","last_peered":"2024-04-26T12:05:06.348410+0000","last_clean":"2024-04-26T12:05:06.348410+0000","last_became_active":"2024-04-26T12:05:03.790823+0000","last_became_peered":"2024-04-26T12:05:03.790823+0000","last_unstale":"2024-04-26T12:05:06.348410+0000","last_undegraded":"2024-04-26T12:05:06.348410+0000","last_fullsized":"2024-04-26T12:05:06.348410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348488+0000","last_change":"2024-04-26T12:05:03.429469+0000","last_active":"2024-04-26T12:05:06.348488+0000","last_peered":"2024-04-26T12:05:06.348488+0000","last_clean":"2024-04-26T12:05:06.348488+0000","last_became_active":"2024-04-26T12:05:03.429015+0000","last_became_peered":"2024-04-26T12:05:03.429015+0000","last_unstale":"2024-04-26T12:05:06.348488+0000","last_undegraded":"2024-04-26T12:05:06.348488+0000","last_fullsized":"2024-04-26T12:05:06.348488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348387+0000","last_change":"2024-04-26T12:05:03.791929+0000","last_active":"2024-04-26T12:05:06.348387+0000","last_peered":"2024-04-26T12:05:06.348387+0000","last_clean":"2024-04-26T12:05:06.348387+0000","last_became_active":"2024-04-26T12:05:03.791540+0000","last_became_peered":"2024-04-26T12:05:03.791540+0000","last_unstale":"2024-04-26T12:05:06.348387+0000","last_undegraded":"2024-04-26T12:05:06.348387+0000","last_fullsized":"2024-04-26T12:05:06.348387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348792+0000","last_change":"2024-04-26T12:05:03.426210+0000","last_active":"2024-04-26T12:05:06.348792+0000","last_peered":"2024-04-26T12:05:06.348792+0000","last_clean":"2024-04-26T12:05:06.348792+0000","last_became_active":"2024-04-26T12:05:03.425782+0000","last_became_peered":"2024-04-26T12:05:03.425782+0000","last_unstale":"2024-04-26T12:05:06.348792+0000","last_undegraded":"2024-04-26T12:05:06.348792+0000","last_fullsized":"2024-04-26T12:05:06.348792+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:26.791180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348499+0000","last_change":"2024-04-26T12:05:03.795264+0000","last_active":"2024-04-26T12:05:06.348499+0000","last_peered":"2024-04-26T12:05:06.348499+0000","last_clean":"2024-04-26T12:05:06.348499+0000","last_became_active":"2024-04-26T12:05:03.794448+0000","last_became_peered":"2024-04-26T12:05:03.794448+0000","last_unstale":"2024-04-26T12:05:06.348499+0000","last_undegraded":"2024-04-26T12:05:06.348499+0000","last_fullsized":"2024-04-26T12:05:06.348499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348601+0000","last_change":"2024-04-26T12:05:03.429872+0000","last_active":"2024-04-26T12:05:06.348601+0000","last_peered":"2024-04-26T12:05:06.348601+0000","last_clean":"2024-04-26T12:05:06.348601+0000","last_became_active":"2024-04-26T12:05:03.429401+0000","last_became_peered":"2024-04-26T12:05:03.429401+0000","last_unstale":"2024-04-26T12:05:06.348601+0000","last_undegraded":"2024-04-26T12:05:06.348601+0000","last_fullsized":"2024-04-26T12:05:06.348601+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348316+0000","last_change":"2024-04-26T12:05:03.791827+0000","last_active":"2024-04-26T12:05:06.348316+0000","last_peered":"2024-04-26T12:05:06.348316+0000","last_clean":"2024-04-26T12:05:06.348316+0000","last_became_active":"2024-04-26T12:05:03.791442+0000","last_became_peered":"2024-04-26T12:05:03.791442+0000","last_unstale":"2024-04-26T12:05:06.348316+0000","last_undegraded":"2024-04-26T12:05:06.348316+0000","last_fullsized":"2024-04-26T12:05:06.348316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348694+0000","last_change":"2024-04-26T12:05:03.430659+0000","last_active":"2024-04-26T12:05:06.348694+0000","last_peered":"2024-04-26T12:05:06.348694+0000","last_clean":"2024-04-26T12:05:06.348694+0000","last_became_active":"2024-04-26T12:05:03.430164+0000","last_became_peered":"2024-04-26T12:05:03.430164+0000","last_unstale":"2024-04-26T12:05:06.348694+0000","last_undegraded":"2024-04-26T12:05:06.348694+0000","last_fullsized":"2024-04-26T12:05:06.348694+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738379,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":245760,"data_stored":647806,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]}]},{"osd":1,"up_from":8,"seq":34359738378,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":647190,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":55692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:05:28.227 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:05:28.247 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:28.247 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:05:28.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:05:28.247 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:05:28.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.247 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:28.248 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:28.248 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 34.389982138999997, 2024-04-26T12:05:28.248 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:05:28.248 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:28.248 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.248 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:28.248 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:28.248 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:28.248 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:05:28.248 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.248 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:28.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.248 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:28.248 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:28.248 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.249 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:28.249 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:28.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.249 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:28.249 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:28.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.249 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:28.249 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:05:28.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:05:28.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:28.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:05:28.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:05:28.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:05:28.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:05:28.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:28.251 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:05:28.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:05:28.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:28.251 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:05:28.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:05:28.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:28.251 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:05:28.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:05:28.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:28.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:05:28.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:05:28.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:05:28.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:05:28.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:28.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:05:28.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:05:28.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:28.253 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:05:28.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:05:28.253 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.253 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:28.253 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.253 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.253 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.253 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:28.253 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:28.253 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 34.389876243000003, 2024-04-26T12:05:28.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:05:28.253 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:28.253 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.253 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:28.253 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:28.254 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:28.254 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:05:28.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.254 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:28.254 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.254 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:28.254 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:28.254 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.254 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.254 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:28.254 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:28.254 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.254 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.255 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:28.255 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:28.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.255 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.255 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.255 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:28.255 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:05:28.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:05:28.255 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.255 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.255 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:28.255 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:05:28.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:05:28.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.256 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.256 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:05:28.256 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:05:28.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:28.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:05:28.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:05:28.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:28.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:05:28.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:05:28.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:28.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:05:28.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:05:28.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.258 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:28.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:05:28.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:05:28.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.258 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:05:28.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:05:28.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.258 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:28.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:05:28.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:05:28.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.259 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:28.259 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:05:28.259 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:05:28.259 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.259 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:28.259 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.259 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.259 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:28.259 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:28.259 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 34.389861263, 2024-04-26T12:05:28.259 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:05:28.259 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:28.259 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.260 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:28.260 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:28.260 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:28.260 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:05:28.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.260 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:28.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:28.260 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:28.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:28.260 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:28.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.261 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:28.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:28.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.261 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:28.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:05:28.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:05:28.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.261 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:28.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:05:28.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:05:28.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:05:28.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:05:28.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:28.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:05:28.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:05:28.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.263 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:28.263 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:05:28.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:05:28.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.263 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:28.263 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:05:28.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:05:28.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.263 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:28.263 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:05:28.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:05:28.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:05:28.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:05:28.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:28.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:05:28.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:05:28.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:28.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:05:28.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:05:28.264 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.264 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:28.265 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.265 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:28.265 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:28.265 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 34.389817387999997, 2024-04-26T12:05:28.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:05:28.265 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:28.265 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.265 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:28.265 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:28.265 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:28.265 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:05:28.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.265 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:28.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:28.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:28.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:28.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:28.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:28.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:28.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.267 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:28.267 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:05:28.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:05:28.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.267 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:28.267 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:05:28.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:05:28.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.267 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.267 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:05:28.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:05:28.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:28.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:05:28.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:05:28.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:28.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:05:28.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:05:28.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:28.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:05:28.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:05:28.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:28.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:05:28.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:05:28.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:05:28.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:05:28.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:28.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:05:28.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:05:28.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:28.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:05:28.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:05:28.270 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.270 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:28.270 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.270 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:28.270 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:28.270 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 34.389731724000001, 2024-04-26T12:05:28.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:05:28.270 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:28.270 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.270 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:28.270 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:28.271 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:28.271 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:05:28.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.271 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:28.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:28.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:28.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:28.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:28.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:28.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:28.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:28.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:05:28.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:05:28.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:28.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:05:28.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:05:28.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.273 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:05:28.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:05:28.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.273 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:28.273 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:05:28.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:05:28.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.273 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:28.273 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:05:28.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:05:28.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.273 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:28.274 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:05:28.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:05:28.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.274 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:28.274 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:05:28.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:05:28.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.274 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.274 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:05:28.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:05:28.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.274 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:28.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:05:28.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:05:28.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:28.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:05:28.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:05:28.275 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.275 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:28.275 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.276 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:28.276 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:28.276 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.463827437999999, 2024-04-26T12:05:28.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:05:28.276 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:28.276 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.276 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:28.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:28.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:28.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:28.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:28.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:28.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:28.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:28.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:28.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:05:28.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:05:28.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:28.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:05:28.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:05:28.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:05:28.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:05:28.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:28.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:05:28.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:05:28.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.279 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:28.279 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:05:28.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:05:28.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.279 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:28.279 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:05:28.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:05:28.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.279 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:28.279 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:05:28.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:05:28.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.279 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:05:28.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:05:28.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:28.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:05:28.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:05:28.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:28.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:05:28.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:05:28.280 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.280 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:28.280 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.281 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:28.281 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:28.281 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.463791343, 2024-04-26T12:05:28.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:05:28.281 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:28.281 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.281 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:28.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:28.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:28.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:28.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:28.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:28.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:05:28.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:28.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:28.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:05:28.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:05:28.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:28.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:05:28.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:05:28.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:05:28.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:05:28.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:28.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:05:28.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:05:28.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:28.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:05:28.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:05:28.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:28.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:05:28.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:05:28.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:28.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:05:28.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:05:28.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:05:28.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:05:28.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:28.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:05:28.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:05:28.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:28.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:05:28.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:05:28.285 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.286 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:28.286 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.286 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.286 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:28.286 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:28.286 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.463753658999998, 2024-04-26T12:05:28.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:05:28.286 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:28.286 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.286 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:28.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:28.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:28.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:28.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:28.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:28.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:05:28.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:28.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:05:28.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:05:28.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:28.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:05:28.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:05:28.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:05:28.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:05:28.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:28.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:05:28.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:05:28.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:28.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:28.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:05:28.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:28.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:05:28.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:05:28.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:28.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:05:28.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:05:28.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.290 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.290 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:05:28.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:05:28.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.290 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:28.290 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:05:28.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:05:28.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.290 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:28.290 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:05:28.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:05:28.291 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.291 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:28.291 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.291 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:28.291 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:28.291 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.463732319000002, 2024-04-26T12:05:28.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:05:28.291 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:28.291 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.291 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:28.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:28.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:05:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:05:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:05:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:05:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:05:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:05:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:05:28.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:28.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:05:28.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:05:28.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:28.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:05:28.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:05:28.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:28.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:05:28.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:05:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:05:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:05:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:05:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:05:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:05:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:05:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.463710053, 2024-04-26T12:05:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:05:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:05:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:05:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:05:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:05:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:05:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:05:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:05:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:05:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:05:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:05:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:05:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:05:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:05:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:05:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:05:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:05:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:05:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:05:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:05:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.463688431000001, 2024-04-26T12:05:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:05:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:28.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:28.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:28.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:28.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:28.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:05:28.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:05:28.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:28.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:05:28.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:05:28.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:05:28.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:05:28.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:28.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:05:28.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:05:28.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:28.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:05:28.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:05:28.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:28.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:05:28.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:05:28.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:28.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:05:28.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:05:28.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:05:28.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:05:28.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:28.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:05:28.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:05:28.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:28.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:05:28.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:05:28.305 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.306 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:28.306 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.306 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:28.306 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:28.306 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.463661864999999, 2024-04-26T12:05:28.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:05:28.306 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:28.306 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.306 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:28.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:28.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:28.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:28.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:28.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:28.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:05:28.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:28.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:05:28.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:05:28.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:28.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:05:28.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:05:28.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:05:28.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:05:28.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:28.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:05:28.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:05:28.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:28.309 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:05:28.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:05:28.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:28.309 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:05:28.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:05:28.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:28.309 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:05:28.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:05:28.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:05:28.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:05:28.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:28.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:05:28.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:05:28.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:28.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:05:28.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:05:28.311 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.311 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:28.311 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.311 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.311 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:28.311 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:28.311 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.463623352999999, 2024-04-26T12:05:28.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:05:28.311 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:28.311 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.311 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:28.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:28.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:28.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:28.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:28.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:28.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:28.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.313 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:28.313 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:05:28.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:05:28.313 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.313 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:28.313 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:05:28.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:05:28.313 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.313 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:05:28.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:05:28.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:28.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:05:28.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:05:28.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:28.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:05:28.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:05:28.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:28.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:05:28.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:05:28.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:28.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:05:28.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:05:28.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:05:28.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:05:28.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:28.316 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:05:28.316 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:05:28.316 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.316 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.316 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:28.316 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:05:28.316 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:05:28.316 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.316 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:28.316 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.316 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.316 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.316 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:28.316 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:28.316 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.463595179999999, 2024-04-26T12:05:28.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:05:28.317 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:28.317 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.317 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:28.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:28.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:28.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:28.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:28.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:28.318 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:28.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.318 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:28.318 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:05:28.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:05:28.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.318 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:28.318 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:05:28.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:05:28.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.318 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:05:28.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:05:28.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.319 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:28.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:05:28.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:05:28.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.319 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:28.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:05:28.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:05:28.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.319 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:28.320 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:05:28.320 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:05:28.320 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.320 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.320 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:28.320 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:05:28.320 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:05:28.320 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.320 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.320 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.320 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:05:28.320 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:05:28.320 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.320 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.320 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:28.320 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:05:28.321 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:05:28.321 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.321 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.321 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:28.321 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:05:28.321 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:05:28.321 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.321 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:28.321 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.321 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.321 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.321 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:28.321 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:28.321 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.463560615999999, 2024-04-26T12:05:28.321 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:05:28.322 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:28.322 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.322 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:28.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.322 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:28.322 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:28.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.322 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.322 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:28.322 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:28.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.322 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.322 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:28.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:05:28.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.323 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:28.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:05:28.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:05:28.323 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:28.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:05:28.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:05:28.323 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:05:28.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:05:28.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:28.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:05:28.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:05:28.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:28.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:05:28.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:05:28.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:28.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:05:28.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:05:28.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:28.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:05:28.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:05:28.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:05:28.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:05:28.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:28.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:28.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:05:28.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:28.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:05:28.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:05:28.326 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.326 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:28.326 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.327 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:28.327 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:28.327 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.462685835999999, 2024-04-26T12:05:28.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:05:28.327 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:28.327 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.327 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:28.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:28.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:28.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:28.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:28.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.328 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.328 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:28.328 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:05:28.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:28.328 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.328 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:28.328 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:05:28.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:05:28.328 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.328 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:28.328 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:05:28.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:05:28.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:05:28.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:05:28.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:28.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:05:28.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:05:28.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:28.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:05:28.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:05:28.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:28.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:05:28.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:05:28.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:28.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:05:28.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:05:28.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:05:28.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:05:28.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:28.331 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:05:28.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:05:28.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:28.331 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:05:28.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:05:28.331 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.331 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:28.331 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.332 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:28.332 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:28.332 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.462646877000001, 2024-04-26T12:05:28.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:05:28.333 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:28.333 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.333 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:28.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:28.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:28.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:28.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:28.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.334 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:28.334 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:05:28.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.334 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.334 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.334 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:28.334 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:05:28.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:05:28.334 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.334 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.334 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:28.334 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:05:28.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:05:28.334 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:05:28.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:05:28.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:28.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:05:28.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:05:28.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:28.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:05:28.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:05:28.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:28.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:05:28.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:05:28.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:28.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:05:28.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:05:28.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:05:28.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:05:28.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:28.337 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:05:28.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:05:28.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:28.337 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:05:28.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:05:28.337 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.337 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:28.337 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.337 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:28.337 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:28.338 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.462611405000001, 2024-04-26T12:05:28.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:05:28.338 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:28.338 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.338 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:28.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:28.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:28.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:28.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:28.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:28.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:28.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:28.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:05:28.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:05:28.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:28.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:05:28.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:05:28.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.340 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.340 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:05:28.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:05:28.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:28.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:05:28.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:05:28.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:28.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:05:28.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:05:28.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:28.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:05:28.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:05:28.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:28.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:05:28.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:05:28.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:05:28.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:05:28.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:28.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:05:28.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:05:28.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:28.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:05:28.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:05:28.343 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.343 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:28.343 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.343 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:28.343 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:28.343 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.462532715999998, 2024-04-26T12:05:28.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:05:28.343 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:28.344 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.344 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:28.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:28.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:28.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:28.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:28.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:28.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:05:28.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:28.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:28.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:05:28.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:05:28.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:28.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:05:28.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:05:28.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:05:28.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:05:28.346 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.346 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:28.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:05:28.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:05:28.346 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.346 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:28.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:05:28.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:05:28.346 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.346 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:28.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:05:28.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:05:28.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:28.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:05:28.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:05:28.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:05:28.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:05:28.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:28.348 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:05:28.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:05:28.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.348 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:28.348 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:05:28.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:05:28.348 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.348 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:28.348 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.348 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:28.348 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:28.348 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.462381868000001, 2024-04-26T12:05:28.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:05:28.349 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:28.349 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:05:28.349 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:28.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:28.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:28.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:28.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:28.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:28.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:28.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:05:28.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:28.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:28.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:05:28.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:05:28.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:28.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:05:28.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:05:28.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:05:28.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:05:28.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:28.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:05:28.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:05:28.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:28.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:28.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:05:28.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:28.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:28.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:28.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:05:28.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:05:28.352 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.352 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:28.352 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.353 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:28.353 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:28.353 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:28.354 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:28.353+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:28.355 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:28.455 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:28.454+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:28.470 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:28.470 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:28.471 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:05:28.471 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:28.480 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:28.556 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:28.554+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:28.581 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:28.581 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:28.581 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:05:28.582 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:05:28.582 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:28.590 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:28.651 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:28.653 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:05:28.656 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:28.655+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:28.661 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-04-26T12:05:28.337160+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":85796,"kb_used_data":632,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283029724,"statfs":{"total":289910292480,"available":289822437376,"internally_reserved":0,"allocated":647168,"data_stored":1350688,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001022"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348921+0000","last_change":"2024-04-26T12:05:03.796038+0000","last_active":"2024-04-26T12:05:06.348921+0000","last_peered":"2024-04-26T12:05:06.348921+0000","last_clean":"2024-04-26T12:05:06.348921+0000","last_became_active":"2024-04-26T12:05:03.795539+0000","last_became_peered":"2024-04-26T12:05:03.795539+0000","last_unstale":"2024-04-26T12:05:06.348921+0000","last_undegraded":"2024-04-26T12:05:06.348921+0000","last_fullsized":"2024-04-26T12:05:06.348921+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348844+0000","last_change":"2024-04-26T12:05:03.795955+0000","last_active":"2024-04-26T12:05:06.348844+0000","last_peered":"2024-04-26T12:05:06.348844+0000","last_clean":"2024-04-26T12:05:06.348844+0000","last_became_active":"2024-04-26T12:05:03.795303+0000","last_became_peered":"2024-04-26T12:05:03.795303+0000","last_unstale":"2024-04-26T12:05:06.348844+0000","last_undegraded":"2024-04-26T12:05:06.348844+0000","last_fullsized":"2024-04-26T12:05:06.348844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348520+0000","last_change":"2024-04-26T12:05:03.797557+0000","last_active":"2024-04-26T12:05:06.348520+0000","last_peered":"2024-04-26T12:05:06.348520+0000","last_clean":"2024-04-26T12:05:06.348520+0000","last_became_active":"2024-04-26T12:05:03.797122+0000","last_became_peered":"2024-04-26T12:05:03.797122+0000","last_unstale":"2024-04-26T12:05:06.348520+0000","last_undegraded":"2024-04-26T12:05:06.348520+0000","last_fullsized":"2024-04-26T12:05:06.348520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348462+0000","last_change":"2024-04-26T12:05:03.791234+0000","last_active":"2024-04-26T12:05:06.348462+0000","last_peered":"2024-04-26T12:05:06.348462+0000","last_clean":"2024-04-26T12:05:06.348462+0000","last_became_active":"2024-04-26T12:05:03.790717+0000","last_became_peered":"2024-04-26T12:05:03.790717+0000","last_unstale":"2024-04-26T12:05:06.348462+0000","last_undegraded":"2024-04-26T12:05:06.348462+0000","last_fullsized":"2024-04-26T12:05:06.348462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:52.358881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348625+0000","last_change":"2024-04-26T12:05:03.792885+0000","last_active":"2024-04-26T12:05:06.348625+0000","last_peered":"2024-04-26T12:05:06.348625+0000","last_clean":"2024-04-26T12:05:06.348625+0000","last_became_active":"2024-04-26T12:05:03.792354+0000","last_became_peered":"2024-04-26T12:05:03.792354+0000","last_unstale":"2024-04-26T12:05:06.348625+0000","last_undegraded":"2024-04-26T12:05:06.348625+0000","last_fullsized":"2024-04-26T12:05:06.348625+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348360+0000","last_change":"2024-04-26T12:05:03.791560+0000","last_active":"2024-04-26T12:05:06.348360+0000","last_peered":"2024-04-26T12:05:06.348360+0000","last_clean":"2024-04-26T12:05:06.348360+0000","last_became_active":"2024-04-26T12:05:03.790578+0000","last_became_peered":"2024-04-26T12:05:03.790578+0000","last_unstale":"2024-04-26T12:05:06.348360+0000","last_undegraded":"2024-04-26T12:05:06.348360+0000","last_fullsized":"2024-04-26T12:05:06.348360+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348338+0000","last_change":"2024-04-26T12:05:03.791215+0000","last_active":"2024-04-26T12:05:06.348338+0000","last_peered":"2024-04-26T12:05:06.348338+0000","last_clean":"2024-04-26T12:05:06.348338+0000","last_became_active":"2024-04-26T12:05:03.790615+0000","last_became_peered":"2024-04-26T12:05:03.790615+0000","last_unstale":"2024-04-26T12:05:06.348338+0000","last_undegraded":"2024-04-26T12:05:06.348338+0000","last_fullsized":"2024-04-26T12:05:06.348338+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:55.388027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348269+0000","last_change":"2024-04-26T12:05:03.785861+0000","last_active":"2024-04-26T12:05:06.348269+0000","last_peered":"2024-04-26T12:05:06.348269+0000","last_clean":"2024-04-26T12:05:06.348269+0000","last_became_active":"2024-04-26T12:05:03.785382+0000","last_became_peered":"2024-04-26T12:05:03.785382+0000","last_unstale":"2024-04-26T12:05:06.348269+0000","last_undegraded":"2024-04-26T12:05:06.348269+0000","last_fullsized":"2024-04-26T12:05:06.348269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:51.870183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348636+0000","last_change":"2024-04-26T12:05:03.797218+0000","last_active":"2024-04-26T12:05:06.348636+0000","last_peered":"2024-04-26T12:05:06.348636+0000","last_clean":"2024-04-26T12:05:06.348636+0000","last_became_active":"2024-04-26T12:05:03.796902+0000","last_became_peered":"2024-04-26T12:05:03.796902+0000","last_unstale":"2024-04-26T12:05:06.348636+0000","last_undegraded":"2024-04-26T12:05:06.348636+0000","last_fullsized":"2024-04-26T12:05:06.348636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:27.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348859+0000","last_change":"2024-04-26T12:05:03.795919+0000","last_active":"2024-04-26T12:05:06.348859+0000","last_peered":"2024-04-26T12:05:06.348859+0000","last_clean":"2024-04-26T12:05:06.348859+0000","last_became_active":"2024-04-26T12:05:03.795268+0000","last_became_peered":"2024-04-26T12:05:03.795268+0000","last_unstale":"2024-04-26T12:05:06.348859+0000","last_undegraded":"2024-04-26T12:05:06.348859+0000","last_fullsized":"2024-04-26T12:05:06.348859+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348529+0000","last_change":"2024-04-26T12:05:03.791046+0000","last_active":"2024-04-26T12:05:06.348529+0000","last_peered":"2024-04-26T12:05:06.348529+0000","last_clean":"2024-04-26T12:05:06.348529+0000","last_became_active":"2024-04-26T12:05:03.790662+0000","last_became_peered":"2024-04-26T12:05:03.790662+0000","last_unstale":"2024-04-26T12:05:06.348529+0000","last_undegraded":"2024-04-26T12:05:06.348529+0000","last_fullsized":"2024-04-26T12:05:06.348529+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:35.458663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348677+0000","last_change":"2024-04-26T12:05:03.795250+0000","last_active":"2024-04-26T12:05:06.348677+0000","last_peered":"2024-04-26T12:05:06.348677+0000","last_clean":"2024-04-26T12:05:06.348677+0000","last_became_active":"2024-04-26T12:05:03.794632+0000","last_became_peered":"2024-04-26T12:05:03.794632+0000","last_unstale":"2024-04-26T12:05:06.348677+0000","last_undegraded":"2024-04-26T12:05:06.348677+0000","last_fullsized":"2024-04-26T12:05:06.348677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:59.873501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348595+0000","last_change":"2024-04-26T12:05:03.794090+0000","last_active":"2024-04-26T12:05:06.348595+0000","last_peered":"2024-04-26T12:05:06.348595+0000","last_clean":"2024-04-26T12:05:06.348595+0000","last_became_active":"2024-04-26T12:05:03.793681+0000","last_became_peered":"2024-04-26T12:05:03.793681+0000","last_unstale":"2024-04-26T12:05:06.348595+0000","last_undegraded":"2024-04-26T12:05:06.348595+0000","last_fullsized":"2024-04-26T12:05:06.348595+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348369+0000","last_change":"2024-04-26T12:05:03.795539+0000","last_active":"2024-04-26T12:05:06.348369+0000","last_peered":"2024-04-26T12:05:06.348369+0000","last_clean":"2024-04-26T12:05:06.348369+0000","last_became_active":"2024-04-26T12:05:03.795281+0000","last_became_peered":"2024-04-26T12:05:03.795281+0000","last_unstale":"2024-04-26T12:05:06.348369+0000","last_undegraded":"2024-04-26T12:05:06.348369+0000","last_fullsized":"2024-04-26T12:05:06.348369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:27.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348347+0000","last_change":"2024-04-26T12:05:03.793487+0000","last_active":"2024-04-26T12:05:06.348347+0000","last_peered":"2024-04-26T12:05:06.348347+0000","last_clean":"2024-04-26T12:05:06.348347+0000","last_became_active":"2024-04-26T12:05:03.793242+0000","last_became_peered":"2024-04-26T12:05:03.793242+0000","last_unstale":"2024-04-26T12:05:06.348347+0000","last_undegraded":"2024-04-26T12:05:06.348347+0000","last_fullsized":"2024-04-26T12:05:06.348347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:53.331006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348288+0000","last_change":"2024-04-26T12:05:03.786360+0000","last_active":"2024-04-26T12:05:06.348288+0000","last_peered":"2024-04-26T12:05:06.348288+0000","last_clean":"2024-04-26T12:05:06.348288+0000","last_became_active":"2024-04-26T12:05:03.785991+0000","last_became_peered":"2024-04-26T12:05:03.785991+0000","last_unstale":"2024-04-26T12:05:06.348288+0000","last_undegraded":"2024-04-26T12:05:06.348288+0000","last_fullsized":"2024-04-26T12:05:06.348288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:17.702068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348713+0000","last_change":"2024-04-26T12:05:03.797390+0000","last_active":"2024-04-26T12:05:06.348713+0000","last_peered":"2024-04-26T12:05:06.348713+0000","last_clean":"2024-04-26T12:05:06.348713+0000","last_became_active":"2024-04-26T12:05:03.796969+0000","last_became_peered":"2024-04-26T12:05:03.796969+0000","last_unstale":"2024-04-26T12:05:06.348713+0000","last_undegraded":"2024-04-26T12:05:06.348713+0000","last_fullsized":"2024-04-26T12:05:06.348713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:57.461628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348874+0000","last_change":"2024-04-26T12:05:03.794013+0000","last_active":"2024-04-26T12:05:06.348874+0000","last_peered":"2024-04-26T12:05:06.348874+0000","last_clean":"2024-04-26T12:05:06.348874+0000","last_became_active":"2024-04-26T12:05:03.793512+0000","last_became_peered":"2024-04-26T12:05:03.793512+0000","last_unstale":"2024-04-26T12:05:06.348874+0000","last_undegraded":"2024-04-26T12:05:06.348874+0000","last_fullsized":"2024-04-26T12:05:06.348874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348569+0000","last_change":"2024-04-26T12:05:03.798195+0000","last_active":"2024-04-26T12:05:06.348569+0000","last_peered":"2024-04-26T12:05:06.348569+0000","last_clean":"2024-04-26T12:05:06.348569+0000","last_became_active":"2024-04-26T12:05:03.797935+0000","last_became_peered":"2024-04-26T12:05:03.797935+0000","last_unstale":"2024-04-26T12:05:06.348569+0000","last_undegraded":"2024-04-26T12:05:06.348569+0000","last_fullsized":"2024-04-26T12:05:06.348569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:58.872589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348471+0000","last_change":"2024-04-26T12:05:03.792219+0000","last_active":"2024-04-26T12:05:06.348471+0000","last_peered":"2024-04-26T12:05:06.348471+0000","last_clean":"2024-04-26T12:05:06.348471+0000","last_became_active":"2024-04-26T12:05:03.791061+0000","last_became_peered":"2024-04-26T12:05:03.791061+0000","last_unstale":"2024-04-26T12:05:06.348471+0000","last_undegraded":"2024-04-26T12:05:06.348471+0000","last_fullsized":"2024-04-26T12:05:06.348471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348431+0000","last_change":"2024-04-26T12:05:03.792073+0000","last_active":"2024-04-26T12:05:06.348431+0000","last_peered":"2024-04-26T12:05:06.348431+0000","last_clean":"2024-04-26T12:05:06.348431+0000","last_became_active":"2024-04-26T12:05:03.791693+0000","last_became_peered":"2024-04-26T12:05:03.791693+0000","last_unstale":"2024-04-26T12:05:06.348431+0000","last_undegraded":"2024-04-26T12:05:06.348431+0000","last_fullsized":"2024-04-26T12:05:06.348431+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348517+0000","last_change":"2024-04-26T12:05:03.794027+0000","last_active":"2024-04-26T12:05:06.348517+0000","last_peered":"2024-04-26T12:05:06.348517+0000","last_clean":"2024-04-26T12:05:06.348517+0000","last_became_active":"2024-04-26T12:05:03.793660+0000","last_became_peered":"2024-04-26T12:05:03.793660+0000","last_unstale":"2024-04-26T12:05:06.348517+0000","last_undegraded":"2024-04-26T12:05:06.348517+0000","last_fullsized":"2024-04-26T12:05:06.348517+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:53.331006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348421+0000","last_change":"2024-04-26T12:05:03.788658+0000","last_active":"2024-04-26T12:05:06.348421+0000","last_peered":"2024-04-26T12:05:06.348421+0000","last_clean":"2024-04-26T12:05:06.348421+0000","last_became_active":"2024-04-26T12:05:03.788050+0000","last_became_peered":"2024-04-26T12:05:03.788050+0000","last_unstale":"2024-04-26T12:05:06.348421+0000","last_undegraded":"2024-04-26T12:05:06.348421+0000","last_fullsized":"2024-04-26T12:05:06.348421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348355+0000","last_change":"2024-04-26T12:05:03.793554+0000","last_active":"2024-04-26T12:05:06.348355+0000","last_peered":"2024-04-26T12:05:06.348355+0000","last_clean":"2024-04-26T12:05:06.348355+0000","last_became_active":"2024-04-26T12:05:03.792588+0000","last_became_peered":"2024-04-26T12:05:03.792588+0000","last_unstale":"2024-04-26T12:05:06.348355+0000","last_undegraded":"2024-04-26T12:05:06.348355+0000","last_fullsized":"2024-04-26T12:05:06.348355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348937+0000","last_change":"2024-04-26T12:05:03.795510+0000","last_active":"2024-04-26T12:05:06.348937+0000","last_peered":"2024-04-26T12:05:06.348937+0000","last_clean":"2024-04-26T12:05:06.348937+0000","last_became_active":"2024-04-26T12:05:03.794639+0000","last_became_peered":"2024-04-26T12:05:03.794639+0000","last_unstale":"2024-04-26T12:05:06.348937+0000","last_undegraded":"2024-04-26T12:05:06.348937+0000","last_fullsized":"2024-04-26T12:05:06.348937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:57.461628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348586+0000","last_change":"2024-04-26T12:05:03.787909+0000","last_active":"2024-04-26T12:05:06.348586+0000","last_peered":"2024-04-26T12:05:06.348586+0000","last_clean":"2024-04-26T12:05:06.348586+0000","last_became_active":"2024-04-26T12:05:03.787562+0000","last_became_peered":"2024-04-26T12:05:03.787562+0000","last_unstale":"2024-04-26T12:05:06.348586+0000","last_undegraded":"2024-04-26T12:05:06.348586+0000","last_fullsized":"2024-04-26T12:05:06.348586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348539+0000","last_change":"2024-04-26T12:05:03.796836+0000","last_active":"2024-04-26T12:05:06.348539+0000","last_peered":"2024-04-26T12:05:06.348539+0000","last_clean":"2024-04-26T12:05:06.348539+0000","last_became_active":"2024-04-26T12:05:03.796524+0000","last_became_peered":"2024-04-26T12:05:03.796524+0000","last_unstale":"2024-04-26T12:05:06.348539+0000","last_undegraded":"2024-04-26T12:05:06.348539+0000","last_fullsized":"2024-04-26T12:05:06.348539+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348729+0000","last_change":"2024-04-26T12:05:03.792400+0000","last_active":"2024-04-26T12:05:06.348729+0000","last_peered":"2024-04-26T12:05:06.348729+0000","last_clean":"2024-04-26T12:05:06.348729+0000","last_became_active":"2024-04-26T12:05:03.792079+0000","last_became_peered":"2024-04-26T12:05:03.792079+0000","last_unstale":"2024-04-26T12:05:06.348729+0000","last_undegraded":"2024-04-26T12:05:06.348729+0000","last_fullsized":"2024-04-26T12:05:06.348729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:24.434355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348524+0000","last_change":"2024-04-26T12:05:03.797172+0000","last_active":"2024-04-26T12:05:06.348524+0000","last_peered":"2024-04-26T12:05:06.348524+0000","last_clean":"2024-04-26T12:05:06.348524+0000","last_became_active":"2024-04-26T12:05:03.796879+0000","last_became_peered":"2024-04-26T12:05:03.796879+0000","last_unstale":"2024-04-26T12:05:06.348524+0000","last_undegraded":"2024-04-26T12:05:06.348524+0000","last_fullsized":"2024-04-26T12:05:06.348524+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:24.434355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348556+0000","last_change":"2024-04-26T12:05:03.793269+0000","last_active":"2024-04-26T12:05:06.348556+0000","last_peered":"2024-04-26T12:05:06.348556+0000","last_clean":"2024-04-26T12:05:06.348556+0000","last_became_active":"2024-04-26T12:05:03.792698+0000","last_became_peered":"2024-04-26T12:05:03.792698+0000","last_unstale":"2024-04-26T12:05:06.348556+0000","last_undegraded":"2024-04-26T12:05:06.348556+0000","last_fullsized":"2024-04-26T12:05:06.348556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:58.579861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348429+0000","last_change":"2024-04-26T12:05:03.796871+0000","last_active":"2024-04-26T12:05:06.348429+0000","last_peered":"2024-04-26T12:05:06.348429+0000","last_clean":"2024-04-26T12:05:06.348429+0000","last_became_active":"2024-04-26T12:05:03.796546+0000","last_became_peered":"2024-04-26T12:05:03.796546+0000","last_unstale":"2024-04-26T12:05:06.348429+0000","last_undegraded":"2024-04-26T12:05:06.348429+0000","last_fullsized":"2024-04-26T12:05:06.348429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:53.331006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348298+0000","last_change":"2024-04-26T12:05:03.791605+0000","last_active":"2024-04-26T12:05:06.348298+0000","last_peered":"2024-04-26T12:05:06.348298+0000","last_clean":"2024-04-26T12:05:06.348298+0000","last_became_active":"2024-04-26T12:05:03.791251+0000","last_became_peered":"2024-04-26T12:05:03.791251+0000","last_unstale":"2024-04-26T12:05:06.348298+0000","last_undegraded":"2024-04-26T12:05:06.348298+0000","last_fullsized":"2024-04-26T12:05:06.348298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:27.239868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348714+0000","last_change":"2024-04-26T12:05:03.793791+0000","last_active":"2024-04-26T12:05:06.348714+0000","last_peered":"2024-04-26T12:05:06.348714+0000","last_clean":"2024-04-26T12:05:06.348714+0000","last_became_active":"2024-04-26T12:05:03.793468+0000","last_became_peered":"2024-04-26T12:05:03.793468+0000","last_unstale":"2024-04-26T12:05:06.348714+0000","last_undegraded":"2024-04-26T12:05:06.348714+0000","last_fullsized":"2024-04-26T12:05:06.348714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:01.289069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348440+0000","last_change":"2024-04-26T12:05:03.430021+0000","last_active":"2024-04-26T12:05:06.348440+0000","last_peered":"2024-04-26T12:05:06.348440+0000","last_clean":"2024-04-26T12:05:06.348440+0000","last_became_active":"2024-04-26T12:05:03.429695+0000","last_became_peered":"2024-04-26T12:05:03.429695+0000","last_unstale":"2024-04-26T12:05:06.348440+0000","last_undegraded":"2024-04-26T12:05:06.348440+0000","last_fullsized":"2024-04-26T12:05:06.348440+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348757+0000","last_change":"2024-04-26T12:05:03.796189+0000","last_active":"2024-04-26T12:05:06.348757+0000","last_peered":"2024-04-26T12:05:06.348757+0000","last_clean":"2024-04-26T12:05:06.348757+0000","last_became_active":"2024-04-26T12:05:03.795438+0000","last_became_peered":"2024-04-26T12:05:03.795438+0000","last_unstale":"2024-04-26T12:05:06.348757+0000","last_undegraded":"2024-04-26T12:05:06.348757+0000","last_fullsized":"2024-04-26T12:05:06.348757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:22.814807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348493+0000","last_change":"2024-04-26T12:05:03.428605+0000","last_active":"2024-04-26T12:05:06.348493+0000","last_peered":"2024-04-26T12:05:06.348493+0000","last_clean":"2024-04-26T12:05:06.348493+0000","last_became_active":"2024-04-26T12:05:03.428098+0000","last_became_peered":"2024-04-26T12:05:03.428098+0000","last_unstale":"2024-04-26T12:05:06.348493+0000","last_undegraded":"2024-04-26T12:05:06.348493+0000","last_fullsized":"2024-04-26T12:05:06.348493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348613+0000","last_change":"2024-04-26T12:05:03.788568+0000","last_active":"2024-04-26T12:05:06.348613+0000","last_peered":"2024-04-26T12:05:06.348613+0000","last_clean":"2024-04-26T12:05:06.348613+0000","last_became_active":"2024-04-26T12:05:03.788039+0000","last_became_peered":"2024-04-26T12:05:03.788039+0000","last_unstale":"2024-04-26T12:05:06.348613+0000","last_undegraded":"2024-04-26T12:05:06.348613+0000","last_fullsized":"2024-04-26T12:05:06.348613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348468+0000","last_change":"2024-04-26T12:05:03.422773+0000","last_active":"2024-04-26T12:05:06.348468+0000","last_peered":"2024-04-26T12:05:06.348468+0000","last_clean":"2024-04-26T12:05:06.348468+0000","last_became_active":"2024-04-26T12:05:03.422412+0000","last_became_peered":"2024-04-26T12:05:03.422412+0000","last_unstale":"2024-04-26T12:05:06.348468+0000","last_undegraded":"2024-04-26T12:05:06.348468+0000","last_fullsized":"2024-04-26T12:05:06.348468+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:06.758253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348645+0000","last_change":"2024-04-26T12:05:03.788505+0000","last_active":"2024-04-26T12:05:06.348645+0000","last_peered":"2024-04-26T12:05:06.348645+0000","last_clean":"2024-04-26T12:05:06.348645+0000","last_became_active":"2024-04-26T12:05:03.788184+0000","last_became_peered":"2024-04-26T12:05:03.788184+0000","last_unstale":"2024-04-26T12:05:06.348645+0000","last_undegraded":"2024-04-26T12:05:06.348645+0000","last_fullsized":"2024-04-26T12:05:06.348645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348307+0000","last_change":"2024-04-26T12:05:03.425495+0000","last_active":"2024-04-26T12:05:06.348307+0000","last_peered":"2024-04-26T12:05:06.348307+0000","last_clean":"2024-04-26T12:05:06.348307+0000","last_became_active":"2024-04-26T12:05:03.424963+0000","last_became_peered":"2024-04-26T12:05:03.424963+0000","last_unstale":"2024-04-26T12:05:06.348307+0000","last_undegraded":"2024-04-26T12:05:06.348307+0000","last_fullsized":"2024-04-26T12:05:06.348307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:55.660897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348623+0000","last_change":"2024-04-26T12:05:03.426142+0000","last_active":"2024-04-26T12:05:06.348623+0000","last_peered":"2024-04-26T12:05:06.348623+0000","last_clean":"2024-04-26T12:05:06.348623+0000","last_became_active":"2024-04-26T12:05:03.425699+0000","last_became_peered":"2024-04-26T12:05:03.425699+0000","last_unstale":"2024-04-26T12:05:06.348623+0000","last_undegraded":"2024-04-26T12:05:06.348623+0000","last_fullsized":"2024-04-26T12:05:06.348623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:41.279426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348376+0000","last_change":"2024-04-26T12:05:03.794778+0000","last_active":"2024-04-26T12:05:06.348376+0000","last_peered":"2024-04-26T12:05:06.348376+0000","last_clean":"2024-04-26T12:05:06.348376+0000","last_became_active":"2024-04-26T12:05:03.794192+0000","last_became_peered":"2024-04-26T12:05:03.794192+0000","last_unstale":"2024-04-26T12:05:06.348376+0000","last_undegraded":"2024-04-26T12:05:06.348376+0000","last_fullsized":"2024-04-26T12:05:06.348376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:16.372597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348903+0000","last_change":"2024-04-26T12:05:03.426530+0000","last_active":"2024-04-26T12:05:06.348903+0000","last_peered":"2024-04-26T12:05:06.348903+0000","last_clean":"2024-04-26T12:05:06.348903+0000","last_became_active":"2024-04-26T12:05:03.426113+0000","last_became_peered":"2024-04-26T12:05:03.426113+0000","last_unstale":"2024-04-26T12:05:06.348903+0000","last_undegraded":"2024-04-26T12:05:06.348903+0000","last_fullsized":"2024-04-26T12:05:06.348903+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:21.029311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348438+0000","last_change":"2024-04-26T12:05:03.793000+0000","last_active":"2024-04-26T12:05:06.348438+0000","last_peered":"2024-04-26T12:05:06.348438+0000","last_clean":"2024-04-26T12:05:06.348438+0000","last_became_active":"2024-04-26T12:05:03.792480+0000","last_became_peered":"2024-04-26T12:05:03.792480+0000","last_unstale":"2024-04-26T12:05:06.348438+0000","last_undegraded":"2024-04-26T12:05:06.348438+0000","last_fullsized":"2024-04-26T12:05:06.348438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348565+0000","last_change":"2024-04-26T12:05:03.426039+0000","last_active":"2024-04-26T12:05:06.348565+0000","last_peered":"2024-04-26T12:05:06.348565+0000","last_clean":"2024-04-26T12:05:06.348565+0000","last_became_active":"2024-04-26T12:05:03.425666+0000","last_became_peered":"2024-04-26T12:05:03.425666+0000","last_unstale":"2024-04-26T12:05:06.348565+0000","last_undegraded":"2024-04-26T12:05:06.348565+0000","last_fullsized":"2024-04-26T12:05:06.348565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:00.998013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348379+0000","last_change":"2024-04-26T12:05:03.791809+0000","last_active":"2024-04-26T12:05:06.348379+0000","last_peered":"2024-04-26T12:05:06.348379+0000","last_clean":"2024-04-26T12:05:06.348379+0000","last_became_active":"2024-04-26T12:05:03.791272+0000","last_became_peered":"2024-04-26T12:05:03.791272+0000","last_unstale":"2024-04-26T12:05:06.348379+0000","last_undegraded":"2024-04-26T12:05:06.348379+0000","last_fullsized":"2024-04-26T12:05:06.348379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348512+0000","last_change":"2024-04-26T12:05:03.430224+0000","last_active":"2024-04-26T12:05:06.348512+0000","last_peered":"2024-04-26T12:05:06.348512+0000","last_clean":"2024-04-26T12:05:06.348512+0000","last_became_active":"2024-04-26T12:05:03.429291+0000","last_became_peered":"2024-04-26T12:05:03.429291+0000","last_unstale":"2024-04-26T12:05:06.348512+0000","last_undegraded":"2024-04-26T12:05:06.348512+0000","last_fullsized":"2024-04-26T12:05:06.348512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348510+0000","last_change":"2024-04-26T12:05:03.788174+0000","last_active":"2024-04-26T12:05:06.348510+0000","last_peered":"2024-04-26T12:05:06.348510+0000","last_clean":"2024-04-26T12:05:06.348510+0000","last_became_active":"2024-04-26T12:05:03.787772+0000","last_became_peered":"2024-04-26T12:05:03.787772+0000","last_unstale":"2024-04-26T12:05:06.348510+0000","last_undegraded":"2024-04-26T12:05:06.348510+0000","last_fullsized":"2024-04-26T12:05:06.348510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348534+0000","last_change":"2024-04-26T12:05:03.431162+0000","last_active":"2024-04-26T12:05:06.348534+0000","last_peered":"2024-04-26T12:05:06.348534+0000","last_clean":"2024-04-26T12:05:06.348534+0000","last_became_active":"2024-04-26T12:05:03.430855+0000","last_became_peered":"2024-04-26T12:05:03.430855+0000","last_unstale":"2024-04-26T12:05:06.348534+0000","last_undegraded":"2024-04-26T12:05:06.348534+0000","last_fullsized":"2024-04-26T12:05:06.348534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:41.279426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348479+0000","last_change":"2024-04-26T12:05:03.792357+0000","last_active":"2024-04-26T12:05:06.348479+0000","last_peered":"2024-04-26T12:05:06.348479+0000","last_clean":"2024-04-26T12:05:06.348479+0000","last_became_active":"2024-04-26T12:05:03.792119+0000","last_became_peered":"2024-04-26T12:05:03.792119+0000","last_unstale":"2024-04-26T12:05:06.348479+0000","last_undegraded":"2024-04-26T12:05:06.348479+0000","last_fullsized":"2024-04-26T12:05:06.348479+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348396+0000","last_change":"2024-04-26T12:05:03.429811+0000","last_active":"2024-04-26T12:05:06.348396+0000","last_peered":"2024-04-26T12:05:06.348396+0000","last_clean":"2024-04-26T12:05:06.348396+0000","last_became_active":"2024-04-26T12:05:03.429469+0000","last_became_peered":"2024-04-26T12:05:03.429469+0000","last_unstale":"2024-04-26T12:05:06.348396+0000","last_undegraded":"2024-04-26T12:05:06.348396+0000","last_fullsized":"2024-04-26T12:05:06.348396+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348548+0000","last_change":"2024-04-26T12:05:03.795646+0000","last_active":"2024-04-26T12:05:06.348548+0000","last_peered":"2024-04-26T12:05:06.348548+0000","last_clean":"2024-04-26T12:05:06.348548+0000","last_became_active":"2024-04-26T12:05:03.795354+0000","last_became_peered":"2024-04-26T12:05:03.795354+0000","last_unstale":"2024-04-26T12:05:06.348548+0000","last_undegraded":"2024-04-26T12:05:06.348548+0000","last_fullsized":"2024-04-26T12:05:06.348548+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:22.814807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348484+0000","last_change":"2024-04-26T12:05:03.427908+0000","last_active":"2024-04-26T12:05:06.348484+0000","last_peered":"2024-04-26T12:05:06.348484+0000","last_clean":"2024-04-26T12:05:06.348484+0000","last_became_active":"2024-04-26T12:05:03.426718+0000","last_became_peered":"2024-04-26T12:05:03.426718+0000","last_unstale":"2024-04-26T12:05:06.348484+0000","last_undegraded":"2024-04-26T12:05:06.348484+0000","last_fullsized":"2024-04-26T12:05:06.348484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:40.538058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348606+0000","last_change":"2024-04-26T12:05:03.797113+0000","last_active":"2024-04-26T12:05:06.348606+0000","last_peered":"2024-04-26T12:05:06.348606+0000","last_clean":"2024-04-26T12:05:06.348606+0000","last_became_active":"2024-04-26T12:05:03.796739+0000","last_became_peered":"2024-04-26T12:05:03.796739+0000","last_unstale":"2024-04-26T12:05:06.348606+0000","last_undegraded":"2024-04-26T12:05:06.348606+0000","last_fullsized":"2024-04-26T12:05:06.348606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:59.873501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348406+0000","last_change":"2024-04-26T12:05:03.428262+0000","last_active":"2024-04-26T12:05:06.348406+0000","last_peered":"2024-04-26T12:05:06.348406+0000","last_clean":"2024-04-26T12:05:06.348406+0000","last_became_active":"2024-04-26T12:05:03.426588+0000","last_became_peered":"2024-04-26T12:05:03.426588+0000","last_unstale":"2024-04-26T12:05:06.348406+0000","last_undegraded":"2024-04-26T12:05:06.348406+0000","last_fullsized":"2024-04-26T12:05:06.348406+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:42.674797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348672+0000","last_change":"2024-04-26T12:05:03.797633+0000","last_active":"2024-04-26T12:05:06.348672+0000","last_peered":"2024-04-26T12:05:06.348672+0000","last_clean":"2024-04-26T12:05:06.348672+0000","last_became_active":"2024-04-26T12:05:03.797338+0000","last_became_peered":"2024-04-26T12:05:03.797338+0000","last_unstale":"2024-04-26T12:05:06.348672+0000","last_undegraded":"2024-04-26T12:05:06.348672+0000","last_fullsized":"2024-04-26T12:05:06.348672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:22.814807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781975+0000","last_change":"2024-04-26T12:04:53.388840+0000","last_active":"2024-04-26T12:05:04.781975+0000","last_peered":"2024-04-26T12:05:04.781975+0000","last_clean":"2024-04-26T12:05:04.781975+0000","last_became_active":"2024-04-26T12:04:53.388568+0000","last_became_peered":"2024-04-26T12:04:53.388568+0000","last_unstale":"2024-04-26T12:05:04.781975+0000","last_undegraded":"2024-04-26T12:05:04.781975+0000","last_fullsized":"2024-04-26T12:05:04.781975+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_clean_scrub_stamp":"2024-04-26T12:04:52.376986+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:04.970330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782588+0000","last_change":"2024-04-26T12:04:59.403711+0000","last_active":"2024-04-26T12:05:04.782588+0000","last_peered":"2024-04-26T12:05:04.782588+0000","last_clean":"2024-04-26T12:05:04.782588+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:05:04.782588+0000","last_undegraded":"2024-04-26T12:05:04.782588+0000","last_fullsized":"2024-04-26T12:05:04.782588+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:45.779614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348501+0000","last_change":"2024-04-26T12:05:03.429674+0000","last_active":"2024-04-26T12:05:06.348501+0000","last_peered":"2024-04-26T12:05:06.348501+0000","last_clean":"2024-04-26T12:05:06.348501+0000","last_became_active":"2024-04-26T12:05:03.429266+0000","last_became_peered":"2024-04-26T12:05:03.429266+0000","last_unstale":"2024-04-26T12:05:06.348501+0000","last_undegraded":"2024-04-26T12:05:06.348501+0000","last_fullsized":"2024-04-26T12:05:06.348501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:55.660897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348555+0000","last_change":"2024-04-26T12:05:03.797640+0000","last_active":"2024-04-26T12:05:06.348555+0000","last_peered":"2024-04-26T12:05:06.348555+0000","last_clean":"2024-04-26T12:05:06.348555+0000","last_became_active":"2024-04-26T12:05:03.797302+0000","last_became_peered":"2024-04-26T12:05:03.797302+0000","last_unstale":"2024-04-26T12:05:06.348555+0000","last_undegraded":"2024-04-26T12:05:06.348555+0000","last_fullsized":"2024-04-26T12:05:06.348555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:16.372597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.781833+0000","last_change":"2024-04-26T12:04:59.405437+0000","last_active":"2024-04-26T12:05:04.781833+0000","last_peered":"2024-04-26T12:05:04.781833+0000","last_clean":"2024-04-26T12:05:04.781833+0000","last_became_active":"2024-04-26T12:04:59.405193+0000","last_became_peered":"2024-04-26T12:04:59.405193+0000","last_unstale":"2024-04-26T12:05:04.781833+0000","last_undegraded":"2024-04-26T12:05:04.781833+0000","last_fullsized":"2024-04-26T12:05:04.781833+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:20.977569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348467+0000","last_change":"2024-04-26T12:05:03.428547+0000","last_active":"2024-04-26T12:05:06.348467+0000","last_peered":"2024-04-26T12:05:06.348467+0000","last_clean":"2024-04-26T12:05:06.348467+0000","last_became_active":"2024-04-26T12:05:03.427985+0000","last_became_peered":"2024-04-26T12:05:03.427985+0000","last_unstale":"2024-04-26T12:05:06.348467+0000","last_undegraded":"2024-04-26T12:05:06.348467+0000","last_fullsized":"2024-04-26T12:05:06.348467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:19.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348887+0000","last_change":"2024-04-26T12:05:03.793800+0000","last_active":"2024-04-26T12:05:06.348887+0000","last_peered":"2024-04-26T12:05:06.348887+0000","last_clean":"2024-04-26T12:05:06.348887+0000","last_became_active":"2024-04-26T12:05:03.792932+0000","last_became_peered":"2024-04-26T12:05:03.792932+0000","last_unstale":"2024-04-26T12:05:06.348887+0000","last_undegraded":"2024-04-26T12:05:06.348887+0000","last_fullsized":"2024-04-26T12:05:06.348887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.203931+0000","last_change":"2024-04-26T12:04:59.405617+0000","last_active":"2024-04-26T12:05:05.203931+0000","last_peered":"2024-04-26T12:05:05.203931+0000","last_clean":"2024-04-26T12:05:05.203931+0000","last_became_active":"2024-04-26T12:04:59.405328+0000","last_became_peered":"2024-04-26T12:04:59.405328+0000","last_unstale":"2024-04-26T12:05:05.203931+0000","last_undegraded":"2024-04-26T12:05:05.203931+0000","last_fullsized":"2024-04-26T12:05:05.203931+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:39.317039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348422+0000","last_change":"2024-04-26T12:05:03.424576+0000","last_active":"2024-04-26T12:05:06.348422+0000","last_peered":"2024-04-26T12:05:06.348422+0000","last_clean":"2024-04-26T12:05:06.348422+0000","last_became_active":"2024-04-26T12:05:03.424289+0000","last_became_peered":"2024-04-26T12:05:03.424289+0000","last_unstale":"2024-04-26T12:05:06.348422+0000","last_undegraded":"2024-04-26T12:05:06.348422+0000","last_fullsized":"2024-04-26T12:05:06.348422+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:10.759772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348679+0000","last_change":"2024-04-26T12:05:03.798238+0000","last_active":"2024-04-26T12:05:06.348679+0000","last_peered":"2024-04-26T12:05:06.348679+0000","last_clean":"2024-04-26T12:05:06.348679+0000","last_became_active":"2024-04-26T12:05:03.797924+0000","last_became_peered":"2024-04-26T12:05:03.797924+0000","last_unstale":"2024-04-26T12:05:06.348679+0000","last_undegraded":"2024-04-26T12:05:06.348679+0000","last_fullsized":"2024-04-26T12:05:06.348679+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:01.289069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782013+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:05:04.782013+0000","last_peered":"2024-04-26T12:05:04.782013+0000","last_clean":"2024-04-26T12:05:04.782013+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:05:04.782013+0000","last_undegraded":"2024-04-26T12:05:04.782013+0000","last_fullsized":"2024-04-26T12:05:04.782013+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:12.939539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348450+0000","last_change":"2024-04-26T12:05:03.430140+0000","last_active":"2024-04-26T12:05:06.348450+0000","last_peered":"2024-04-26T12:05:06.348450+0000","last_clean":"2024-04-26T12:05:06.348450+0000","last_became_active":"2024-04-26T12:05:03.429838+0000","last_became_peered":"2024-04-26T12:05:03.429838+0000","last_unstale":"2024-04-26T12:05:06.348450+0000","last_undegraded":"2024-04-26T12:05:06.348450+0000","last_fullsized":"2024-04-26T12:05:06.348450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348546+0000","last_change":"2024-04-26T12:05:03.796731+0000","last_active":"2024-04-26T12:05:06.348546+0000","last_peered":"2024-04-26T12:05:06.348546+0000","last_clean":"2024-04-26T12:05:06.348546+0000","last_became_active":"2024-04-26T12:05:03.796432+0000","last_became_peered":"2024-04-26T12:05:03.796432+0000","last_unstale":"2024-04-26T12:05:06.348546+0000","last_undegraded":"2024-04-26T12:05:06.348546+0000","last_fullsized":"2024-04-26T12:05:06.348546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:58.579861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348597+0000","last_change":"2024-04-26T12:05:03.429673+0000","last_active":"2024-04-26T12:05:06.348597+0000","last_peered":"2024-04-26T12:05:06.348597+0000","last_clean":"2024-04-26T12:05:06.348597+0000","last_became_active":"2024-04-26T12:05:03.429146+0000","last_became_peered":"2024-04-26T12:05:03.429146+0000","last_unstale":"2024-04-26T12:05:06.348597+0000","last_undegraded":"2024-04-26T12:05:06.348597+0000","last_fullsized":"2024-04-26T12:05:06.348597+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204510+0000","last_change":"2024-04-26T12:04:59.405766+0000","last_active":"2024-04-26T12:05:05.204510+0000","last_peered":"2024-04-26T12:05:05.204510+0000","last_clean":"2024-04-26T12:05:05.204510+0000","last_became_active":"2024-04-26T12:04:59.405406+0000","last_became_peered":"2024-04-26T12:04:59.405406+0000","last_unstale":"2024-04-26T12:05:05.204510+0000","last_undegraded":"2024-04-26T12:05:05.204510+0000","last_fullsized":"2024-04-26T12:05:05.204510+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:13.860871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348541+0000","last_change":"2024-04-26T12:05:03.792534+0000","last_active":"2024-04-26T12:05:06.348541+0000","last_peered":"2024-04-26T12:05:06.348541+0000","last_clean":"2024-04-26T12:05:06.348541+0000","last_became_active":"2024-04-26T12:05:03.792160+0000","last_became_peered":"2024-04-26T12:05:03.792160+0000","last_unstale":"2024-04-26T12:05:06.348541+0000","last_undegraded":"2024-04-26T12:05:06.348541+0000","last_fullsized":"2024-04-26T12:05:06.348541+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:41.930005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348555+0000","last_change":"2024-04-26T12:05:03.429642+0000","last_active":"2024-04-26T12:05:06.348555+0000","last_peered":"2024-04-26T12:05:06.348555+0000","last_clean":"2024-04-26T12:05:06.348555+0000","last_became_active":"2024-04-26T12:05:03.429197+0000","last_became_peered":"2024-04-26T12:05:03.429197+0000","last_unstale":"2024-04-26T12:05:06.348555+0000","last_undegraded":"2024-04-26T12:05:06.348555+0000","last_fullsized":"2024-04-26T12:05:06.348555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:40.538058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782757+0000","last_change":"2024-04-26T12:04:59.405294+0000","last_active":"2024-04-26T12:05:04.782757+0000","last_peered":"2024-04-26T12:05:04.782757+0000","last_clean":"2024-04-26T12:05:04.782757+0000","last_became_active":"2024-04-26T12:04:59.405044+0000","last_became_peered":"2024-04-26T12:04:59.405044+0000","last_unstale":"2024-04-26T12:05:04.782757+0000","last_undegraded":"2024-04-26T12:05:04.782757+0000","last_fullsized":"2024-04-26T12:05:04.782757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:47.042833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348610+0000","last_change":"2024-04-26T12:05:03.793408+0000","last_active":"2024-04-26T12:05:06.348610+0000","last_peered":"2024-04-26T12:05:06.348610+0000","last_clean":"2024-04-26T12:05:06.348610+0000","last_became_active":"2024-04-26T12:05:03.793019+0000","last_became_peered":"2024-04-26T12:05:03.793019+0000","last_unstale":"2024-04-26T12:05:06.348610+0000","last_undegraded":"2024-04-26T12:05:06.348610+0000","last_fullsized":"2024-04-26T12:05:06.348610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:25.062114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348723+0000","last_change":"2024-04-26T12:05:03.430008+0000","last_active":"2024-04-26T12:05:06.348723+0000","last_peered":"2024-04-26T12:05:06.348723+0000","last_clean":"2024-04-26T12:05:06.348723+0000","last_became_active":"2024-04-26T12:05:03.429362+0000","last_became_peered":"2024-04-26T12:05:03.429362+0000","last_unstale":"2024-04-26T12:05:06.348723+0000","last_undegraded":"2024-04-26T12:05:06.348723+0000","last_fullsized":"2024-04-26T12:05:06.348723+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:05.204674+0000","last_change":"2024-04-26T12:04:59.405667+0000","last_active":"2024-04-26T12:05:05.204674+0000","last_peered":"2024-04-26T12:05:05.204674+0000","last_clean":"2024-04-26T12:05:05.204674+0000","last_became_active":"2024-04-26T12:04:59.405328+0000","last_became_peered":"2024-04-26T12:04:59.405328+0000","last_unstale":"2024-04-26T12:05:05.204674+0000","last_undegraded":"2024-04-26T12:05:05.204674+0000","last_fullsized":"2024-04-26T12:05:05.204674+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:20.977569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348401+0000","last_change":"2024-04-26T12:05:03.789623+0000","last_active":"2024-04-26T12:05:06.348401+0000","last_peered":"2024-04-26T12:05:06.348401+0000","last_clean":"2024-04-26T12:05:06.348401+0000","last_became_active":"2024-04-26T12:05:03.789390+0000","last_became_peered":"2024-04-26T12:05:03.789390+0000","last_unstale":"2024-04-26T12:05:06.348401+0000","last_undegraded":"2024-04-26T12:05:06.348401+0000","last_fullsized":"2024-04-26T12:05:06.348401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:09.507379+0000","last_change":"2024-04-26T12:05:03.429222+0000","last_active":"2024-04-26T12:05:09.507379+0000","last_peered":"2024-04-26T12:05:09.507379+0000","last_clean":"2024-04-26T12:05:09.507379+0000","last_became_active":"2024-04-26T12:05:03.428803+0000","last_became_peered":"2024-04-26T12:05:03.428803+0000","last_unstale":"2024-04-26T12:05:09.507379+0000","last_undegraded":"2024-04-26T12:05:09.507379+0000","last_fullsized":"2024-04-26T12:05:09.507379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:31.305644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:04.782539+0000","last_change":"2024-04-26T12:04:59.408078+0000","last_active":"2024-04-26T12:05:04.782539+0000","last_peered":"2024-04-26T12:05:04.782539+0000","last_clean":"2024-04-26T12:05:04.782539+0000","last_became_active":"2024-04-26T12:04:59.407804+0000","last_became_peered":"2024-04-26T12:04:59.407804+0000","last_unstale":"2024-04-26T12:05:04.782539+0000","last_undegraded":"2024-04-26T12:05:04.782539+0000","last_fullsized":"2024-04-26T12:05:04.782539+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:56.449518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348454+0000","last_change":"2024-04-26T12:05:03.792547+0000","last_active":"2024-04-26T12:05:06.348454+0000","last_peered":"2024-04-26T12:05:06.348454+0000","last_clean":"2024-04-26T12:05:06.348454+0000","last_became_active":"2024-04-26T12:05:03.792078+0000","last_became_peered":"2024-04-26T12:05:03.792078+0000","last_unstale":"2024-04-26T12:05:06.348454+0000","last_undegraded":"2024-04-26T12:05:06.348454+0000","last_fullsized":"2024-04-26T12:05:06.348454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:45.563923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348418+0000","last_change":"2024-04-26T12:05:03.795500+0000","last_active":"2024-04-26T12:05:06.348418+0000","last_peered":"2024-04-26T12:05:06.348418+0000","last_clean":"2024-04-26T12:05:06.348418+0000","last_became_active":"2024-04-26T12:05:03.795173+0000","last_became_peered":"2024-04-26T12:05:03.795173+0000","last_unstale":"2024-04-26T12:05:06.348418+0000","last_undegraded":"2024-04-26T12:05:06.348418+0000","last_fullsized":"2024-04-26T12:05:06.348418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:01.289069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348503+0000","last_change":"2024-04-26T12:05:03.426261+0000","last_active":"2024-04-26T12:05:06.348503+0000","last_peered":"2024-04-26T12:05:06.348503+0000","last_clean":"2024-04-26T12:05:06.348503+0000","last_became_active":"2024-04-26T12:05:03.425897+0000","last_became_peered":"2024-04-26T12:05:03.425897+0000","last_unstale":"2024-04-26T12:05:06.348503+0000","last_undegraded":"2024-04-26T12:05:06.348503+0000","last_fullsized":"2024-04-26T12:05:06.348503+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:31.305644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348483+0000","last_change":"2024-04-26T12:05:03.795443+0000","last_active":"2024-04-26T12:05:06.348483+0000","last_peered":"2024-04-26T12:05:06.348483+0000","last_clean":"2024-04-26T12:05:06.348483+0000","last_became_active":"2024-04-26T12:05:03.795190+0000","last_became_peered":"2024-04-26T12:05:03.795190+0000","last_unstale":"2024-04-26T12:05:06.348483+0000","last_undegraded":"2024-04-26T12:05:06.348483+0000","last_fullsized":"2024-04-26T12:05:06.348483+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:59.873501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348810+0000","last_change":"2024-04-26T12:05:03.425106+0000","last_active":"2024-04-26T12:05:06.348810+0000","last_peered":"2024-04-26T12:05:06.348810+0000","last_clean":"2024-04-26T12:05:06.348810+0000","last_became_active":"2024-04-26T12:05:03.424753+0000","last_became_peered":"2024-04-26T12:05:03.424753+0000","last_unstale":"2024-04-26T12:05:06.348810+0000","last_undegraded":"2024-04-26T12:05:06.348810+0000","last_fullsized":"2024-04-26T12:05:06.348810+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:10.741652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348614+0000","last_change":"2024-04-26T12:05:03.429257+0000","last_active":"2024-04-26T12:05:06.348614+0000","last_peered":"2024-04-26T12:05:06.348614+0000","last_clean":"2024-04-26T12:05:06.348614+0000","last_became_active":"2024-04-26T12:05:03.428921+0000","last_became_peered":"2024-04-26T12:05:03.428921+0000","last_unstale":"2024-04-26T12:05:06.348614+0000","last_undegraded":"2024-04-26T12:05:06.348614+0000","last_fullsized":"2024-04-26T12:05:06.348614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:49.774845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348451+0000","last_change":"2024-04-26T12:05:03.788141+0000","last_active":"2024-04-26T12:05:06.348451+0000","last_peered":"2024-04-26T12:05:06.348451+0000","last_clean":"2024-04-26T12:05:06.348451+0000","last_became_active":"2024-04-26T12:05:03.787533+0000","last_became_peered":"2024-04-26T12:05:03.787533+0000","last_unstale":"2024-04-26T12:05:06.348451+0000","last_undegraded":"2024-04-26T12:05:06.348451+0000","last_fullsized":"2024-04-26T12:05:06.348451+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348704+0000","last_change":"2024-04-26T12:05:03.428971+0000","last_active":"2024-04-26T12:05:06.348704+0000","last_peered":"2024-04-26T12:05:06.348704+0000","last_clean":"2024-04-26T12:05:06.348704+0000","last_became_active":"2024-04-26T12:05:03.428445+0000","last_became_peered":"2024-04-26T12:05:03.428445+0000","last_unstale":"2024-04-26T12:05:06.348704+0000","last_undegraded":"2024-04-26T12:05:06.348704+0000","last_fullsized":"2024-04-26T12:05:06.348704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348385+0000","last_change":"2024-04-26T12:05:03.795318+0000","last_active":"2024-04-26T12:05:06.348385+0000","last_peered":"2024-04-26T12:05:06.348385+0000","last_clean":"2024-04-26T12:05:06.348385+0000","last_became_active":"2024-04-26T12:05:03.795053+0000","last_became_peered":"2024-04-26T12:05:03.795053+0000","last_unstale":"2024-04-26T12:05:06.348385+0000","last_undegraded":"2024-04-26T12:05:06.348385+0000","last_fullsized":"2024-04-26T12:05:06.348385+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:16.372597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348963+0000","last_change":"2024-04-26T12:05:03.795109+0000","last_active":"2024-04-26T12:05:06.348963+0000","last_peered":"2024-04-26T12:05:06.348963+0000","last_clean":"2024-04-26T12:05:06.348963+0000","last_became_active":"2024-04-26T12:05:03.794392+0000","last_became_peered":"2024-04-26T12:05:03.794392+0000","last_unstale":"2024-04-26T12:05:06.348963+0000","last_undegraded":"2024-04-26T12:05:06.348963+0000","last_fullsized":"2024-04-26T12:05:06.348963+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:05.327938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348410+0000","last_change":"2024-04-26T12:05:03.429889+0000","last_active":"2024-04-26T12:05:06.348410+0000","last_peered":"2024-04-26T12:05:06.348410+0000","last_clean":"2024-04-26T12:05:06.348410+0000","last_became_active":"2024-04-26T12:05:03.429370+0000","last_became_peered":"2024-04-26T12:05:03.429370+0000","last_unstale":"2024-04-26T12:05:06.348410+0000","last_undegraded":"2024-04-26T12:05:06.348410+0000","last_fullsized":"2024-04-26T12:05:06.348410+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:26.791180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348577+0000","last_change":"2024-04-26T12:05:03.788754+0000","last_active":"2024-04-26T12:05:06.348577+0000","last_peered":"2024-04-26T12:05:06.348577+0000","last_clean":"2024-04-26T12:05:06.348577+0000","last_became_active":"2024-04-26T12:05:03.788311+0000","last_became_peered":"2024-04-26T12:05:03.788311+0000","last_unstale":"2024-04-26T12:05:06.348577+0000","last_undegraded":"2024-04-26T12:05:06.348577+0000","last_fullsized":"2024-04-26T12:05:06.348577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348460+0000","last_change":"2024-04-26T12:05:03.428810+0000","last_active":"2024-04-26T12:05:06.348460+0000","last_peered":"2024-04-26T12:05:06.348460+0000","last_clean":"2024-04-26T12:05:06.348460+0000","last_became_active":"2024-04-26T12:05:03.428191+0000","last_became_peered":"2024-04-26T12:05:03.428191+0000","last_unstale":"2024-04-26T12:05:06.348460+0000","last_undegraded":"2024-04-26T12:05:06.348460+0000","last_fullsized":"2024-04-26T12:05:06.348460+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348744+0000","last_change":"2024-04-26T12:05:03.796880+0000","last_active":"2024-04-26T12:05:06.348744+0000","last_peered":"2024-04-26T12:05:06.348744+0000","last_clean":"2024-04-26T12:05:06.348744+0000","last_became_active":"2024-04-26T12:05:03.796419+0000","last_became_peered":"2024-04-26T12:05:03.796419+0000","last_unstale":"2024-04-26T12:05:06.348744+0000","last_undegraded":"2024-04-26T12:05:06.348744+0000","last_fullsized":"2024-04-26T12:05:06.348744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:58.872589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348572+0000","last_change":"2024-04-26T12:05:03.428084+0000","last_active":"2024-04-26T12:05:06.348572+0000","last_peered":"2024-04-26T12:05:06.348572+0000","last_clean":"2024-04-26T12:05:06.348572+0000","last_became_active":"2024-04-26T12:05:03.426982+0000","last_became_peered":"2024-04-26T12:05:03.426982+0000","last_unstale":"2024-04-26T12:05:06.348572+0000","last_undegraded":"2024-04-26T12:05:06.348572+0000","last_fullsized":"2024-04-26T12:05:06.348572+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:19.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348701+0000","last_change":"2024-04-26T12:05:03.793470+0000","last_active":"2024-04-26T12:05:06.348701+0000","last_peered":"2024-04-26T12:05:06.348701+0000","last_clean":"2024-04-26T12:05:06.348701+0000","last_became_active":"2024-04-26T12:05:03.792869+0000","last_became_peered":"2024-04-26T12:05:03.792869+0000","last_unstale":"2024-04-26T12:05:06.348701+0000","last_undegraded":"2024-04-26T12:05:06.348701+0000","last_fullsized":"2024-04-26T12:05:06.348701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:27.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348643+0000","last_change":"2024-04-26T12:05:03.426947+0000","last_active":"2024-04-26T12:05:06.348643+0000","last_peered":"2024-04-26T12:05:06.348643+0000","last_clean":"2024-04-26T12:05:06.348643+0000","last_became_active":"2024-04-26T12:05:03.426211+0000","last_became_peered":"2024-04-26T12:05:03.426211+0000","last_unstale":"2024-04-26T12:05:06.348643+0000","last_undegraded":"2024-04-26T12:05:06.348643+0000","last_fullsized":"2024-04-26T12:05:06.348643+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:11.959244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348410+0000","last_change":"2024-04-26T12:05:03.791986+0000","last_active":"2024-04-26T12:05:06.348410+0000","last_peered":"2024-04-26T12:05:06.348410+0000","last_clean":"2024-04-26T12:05:06.348410+0000","last_became_active":"2024-04-26T12:05:03.790823+0000","last_became_peered":"2024-04-26T12:05:03.790823+0000","last_unstale":"2024-04-26T12:05:06.348410+0000","last_undegraded":"2024-04-26T12:05:06.348410+0000","last_fullsized":"2024-04-26T12:05:06.348410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348488+0000","last_change":"2024-04-26T12:05:03.429469+0000","last_active":"2024-04-26T12:05:06.348488+0000","last_peered":"2024-04-26T12:05:06.348488+0000","last_clean":"2024-04-26T12:05:06.348488+0000","last_became_active":"2024-04-26T12:05:03.429015+0000","last_became_peered":"2024-04-26T12:05:03.429015+0000","last_unstale":"2024-04-26T12:05:06.348488+0000","last_undegraded":"2024-04-26T12:05:06.348488+0000","last_fullsized":"2024-04-26T12:05:06.348488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348387+0000","last_change":"2024-04-26T12:05:03.791929+0000","last_active":"2024-04-26T12:05:06.348387+0000","last_peered":"2024-04-26T12:05:06.348387+0000","last_clean":"2024-04-26T12:05:06.348387+0000","last_became_active":"2024-04-26T12:05:03.791540+0000","last_became_peered":"2024-04-26T12:05:03.791540+0000","last_unstale":"2024-04-26T12:05:06.348387+0000","last_undegraded":"2024-04-26T12:05:06.348387+0000","last_fullsized":"2024-04-26T12:05:06.348387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348792+0000","last_change":"2024-04-26T12:05:03.426210+0000","last_active":"2024-04-26T12:05:06.348792+0000","last_peered":"2024-04-26T12:05:06.348792+0000","last_clean":"2024-04-26T12:05:06.348792+0000","last_became_active":"2024-04-26T12:05:03.425782+0000","last_became_peered":"2024-04-26T12:05:03.425782+0000","last_unstale":"2024-04-26T12:05:06.348792+0000","last_undegraded":"2024-04-26T12:05:06.348792+0000","last_fullsized":"2024-04-26T12:05:06.348792+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:26.791180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348499+0000","last_change":"2024-04-26T12:05:03.795264+0000","last_active":"2024-04-26T12:05:06.348499+0000","last_peered":"2024-04-26T12:05:06.348499+0000","last_clean":"2024-04-26T12:05:06.348499+0000","last_became_active":"2024-04-26T12:05:03.794448+0000","last_became_peered":"2024-04-26T12:05:03.794448+0000","last_unstale":"2024-04-26T12:05:06.348499+0000","last_undegraded":"2024-04-26T12:05:06.348499+0000","last_fullsized":"2024-04-26T12:05:06.348499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348601+0000","last_change":"2024-04-26T12:05:03.429872+0000","last_active":"2024-04-26T12:05:06.348601+0000","last_peered":"2024-04-26T12:05:06.348601+0000","last_clean":"2024-04-26T12:05:06.348601+0000","last_became_active":"2024-04-26T12:05:03.429401+0000","last_became_peered":"2024-04-26T12:05:03.429401+0000","last_unstale":"2024-04-26T12:05:06.348601+0000","last_undegraded":"2024-04-26T12:05:06.348601+0000","last_fullsized":"2024-04-26T12:05:06.348601+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348316+0000","last_change":"2024-04-26T12:05:03.791827+0000","last_active":"2024-04-26T12:05:06.348316+0000","last_peered":"2024-04-26T12:05:06.348316+0000","last_clean":"2024-04-26T12:05:06.348316+0000","last_became_active":"2024-04-26T12:05:03.791442+0000","last_became_peered":"2024-04-26T12:05:03.791442+0000","last_unstale":"2024-04-26T12:05:06.348316+0000","last_undegraded":"2024-04-26T12:05:06.348316+0000","last_fullsized":"2024-04-26T12:05:06.348316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:05:06.348694+0000","last_change":"2024-04-26T12:05:03.430659+0000","last_active":"2024-04-26T12:05:06.348694+0000","last_peered":"2024-04-26T12:05:06.348694+0000","last_clean":"2024-04-26T12:05:06.348694+0000","last_became_active":"2024-04-26T12:05:03.430164+0000","last_became_peered":"2024-04-26T12:05:03.430164+0000","last_unstale":"2024-04-26T12:05:06.348694+0000","last_undegraded":"2024-04-26T12:05:06.348694+0000","last_fullsized":"2024-04-26T12:05:06.348694+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738379,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":245760,"data_stored":647806,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]}]},{"osd":1,"up_from":8,"seq":34359738378,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":647190,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":55692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:05:28.665 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T12:05:28.666 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:05:28.666 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-04-26T12:05:28.666 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-04-26T12:05:28.694 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:28.694 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:05:28.694 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:05:28.694 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:05:28.694 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.694 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:28.694 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:28.694 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 24.910311476, 2024-04-26T12:05:28.694 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:05:28.695 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:28.695 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.695 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:28.695 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.695 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:28.695 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:28.695 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.695 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.695 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.695 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:28.695 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:28.695 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.695 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.695 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.695 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:28.696 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:05:28.696 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:28.696 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.696 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.696 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:28.696 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:05:28.696 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:05:28.696 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.696 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.696 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:28.696 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:05:28.696 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:05:28.696 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.696 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.697 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.697 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:05:28.697 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:05:28.697 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.697 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.698 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:28.698 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:05:28.699 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:05:28.699 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.699 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.699 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:28.699 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:28.699 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:05:28.699 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.699 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.699 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:28.699 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:05:28.699 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:05:28.699 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.699 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.699 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:28.700 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:05:28.700 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:05:28.700 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.700 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.700 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.700 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:05:28.700 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:05:28.700 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.700 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.700 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:28.700 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:05:28.700 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:05:28.700 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.700 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.701 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:28.701 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:05:28.701 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:05:28.701 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.701 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:28.701 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.701 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.701 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.701 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:28.701 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:28.701 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 24.910256155999999, 2024-04-26T12:05:28.701 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:05:28.701 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:28.701 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.701 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:28.702 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.702 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:28.702 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:28.702 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.702 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.702 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.702 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:28.702 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:28.702 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.702 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.702 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.702 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:28.702 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:05:28.702 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:28.703 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.703 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.703 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:28.703 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:05:28.703 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:05:28.703 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.703 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.703 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:28.704 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:05:28.704 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:05:28.704 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.704 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.704 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.704 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:05:28.704 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:05:28.705 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.705 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.705 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:28.705 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:05:28.706 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:05:28.706 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.706 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.706 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:28.707 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:05:28.707 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:05:28.707 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.707 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.707 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:28.707 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:05:28.708 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:05:28.708 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.708 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.708 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:28.708 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:05:28.708 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:05:28.709 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.709 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.709 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.709 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:05:28.709 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:05:28.709 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.710 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.710 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:28.710 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:05:28.710 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:05:28.710 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.711 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.711 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:28.711 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:05:28.711 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:05:28.711 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.711 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:28.712 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.712 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.712 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.712 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:28.712 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:28.712 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 24.910206137999999, 2024-04-26T12:05:28.712 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:05:28.713 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:28.713 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.713 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:28.713 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.713 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:28.713 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:28.714 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.714 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.714 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.714 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:28.714 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:28.715 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.715 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.715 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.715 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:28.715 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:05:28.716 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.716 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.716 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.716 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:28.717 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:05:28.717 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:05:28.717 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.717 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.717 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:28.717 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:05:28.717 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:05:28.717 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.717 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.717 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.717 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:05:28.717 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:05:28.717 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.717 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.718 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:28.718 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:05:28.718 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:05:28.718 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.718 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.718 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:28.718 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:05:28.718 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:05:28.718 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.718 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.719 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:28.719 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:05:28.719 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:05:28.719 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.719 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.719 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:28.719 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:05:28.719 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:05:28.719 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.719 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.719 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.719 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:05:28.719 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:05:28.719 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.720 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.720 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:28.720 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:05:28.720 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:05:28.720 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.720 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.720 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:28.720 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:05:28.720 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:05:28.720 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.720 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:28.720 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.720 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.720 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.721 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:28.721 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:28.721 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 24.910171501000001, 2024-04-26T12:05:28.721 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:05:28.721 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:28.721 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.721 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:28.721 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.721 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:28.721 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:28.722 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.722 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.722 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.722 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:28.722 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:28.722 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.722 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.722 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.722 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:28.722 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:05:28.722 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.722 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.722 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.722 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:28.723 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:05:28.723 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:05:28.723 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.723 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.723 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:28.723 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:28.723 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:05:28.723 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.723 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.723 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.723 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:05:28.723 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:05:28.723 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.723 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.724 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:28.724 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:05:28.724 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:05:28.724 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.724 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.724 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:28.724 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:05:28.724 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:05:28.724 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.724 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.724 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:28.724 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:05:28.724 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:05:28.724 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.725 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.725 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.725 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:05:28.725 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:05:28.725 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.725 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.725 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:28.726 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:05:28.726 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:05:28.726 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.726 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.726 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:28.726 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:05:28.727 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:05:28.728 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.728 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.728 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:28.728 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:05:28.728 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:05:28.728 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.728 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:28.728 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.728 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.728 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.728 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:28.729 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:28.729 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 24.910132989000001, 2024-04-26T12:05:28.729 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:05:28.729 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:28.729 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.729 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:28.729 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.729 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:28.729 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:28.729 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.729 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.729 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.729 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:28.729 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:28.730 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.730 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.730 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.730 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:28.730 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:28.730 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:28.730 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.730 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.730 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:28.731 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:28.731 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:05:28.731 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.731 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.731 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:28.731 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:05:28.731 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:05:28.731 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.731 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.731 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.731 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:05:28.731 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:05:28.731 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.731 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.732 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:28.732 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:05:28.732 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:05:28.732 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.732 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.733 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:28.733 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:05:28.733 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:05:28.733 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.733 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.733 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:28.733 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:05:28.733 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:05:28.734 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.734 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.734 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.734 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:05:28.734 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:05:28.734 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.734 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.734 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:28.735 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:05:28.735 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:05:28.735 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.735 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.735 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:28.735 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:05:28.735 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:05:28.735 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.735 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.736 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:28.736 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:05:28.736 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:05:28.736 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.736 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:28.736 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.736 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.736 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.737 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:28.737 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:28.737 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 24.910102666, 2024-04-26T12:05:28.737 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:05:28.737 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:28.737 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.737 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:28.737 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.737 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:28.737 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:28.737 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.737 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.737 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.738 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:28.738 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:28.738 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.738 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.738 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.738 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:28.738 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:28.738 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.738 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.738 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.738 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:28.739 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:05:28.739 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:05:28.739 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.739 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.739 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:28.740 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:05:28.740 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:05:28.740 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.740 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.740 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.740 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:05:28.740 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:05:28.740 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.740 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.740 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:28.740 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:05:28.740 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:05:28.740 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.741 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.741 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:28.741 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:05:28.741 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:05:28.741 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.741 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.741 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:28.741 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:05:28.741 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:05:28.741 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.741 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.741 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:28.741 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:05:28.741 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:05:28.742 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.742 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.742 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.742 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:05:28.742 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:05:28.742 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.742 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.742 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:28.742 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:05:28.742 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:05:28.742 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.742 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.742 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:28.742 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:05:28.742 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:05:28.743 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.743 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:28.743 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.743 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.743 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.743 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:28.743 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:28.743 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 24.910075964000001, 2024-04-26T12:05:28.743 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:05:28.743 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:28.743 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:28.743 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:28.744 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.744 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:28.744 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:28.744 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.744 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.744 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.744 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:28.744 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:28.744 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.744 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.744 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.744 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:28.744 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:28.744 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.745 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.745 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.745 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:28.745 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:05:28.745 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:05:28.745 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.745 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.745 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:28.745 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:05:28.745 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:05:28.745 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.745 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.746 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.746 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:05:28.746 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:05:28.746 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.746 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.746 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:28.746 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:05:28.746 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:05:28.746 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.746 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.746 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:28.746 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:05:28.746 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:05:28.746 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.747 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.747 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:28.747 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:05:28.747 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:05:28.747 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.747 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:28.747 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.747 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.747 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.747 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:28.747 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:28.747 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 24.910033674000001, 2024-04-26T12:05:28.747 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:05:28.747 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:28.747 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:28.748 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:28.748 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.748 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:28.748 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:28.748 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.748 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.748 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.748 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:28.748 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:28.748 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.748 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.748 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.748 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:28.748 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:28.748 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.749 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.749 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.749 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:28.749 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:05:28.749 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:05:28.749 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.749 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.749 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:28.749 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:05:28.749 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:05:28.749 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.749 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.749 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.750 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:05:28.750 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:05:28.750 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.750 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.750 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:28.750 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:05:28.750 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:05:28.750 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.750 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.750 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:28.750 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:05:28.750 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:05:28.751 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.751 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.751 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:28.751 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:05:28.751 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:05:28.751 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.751 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:28.751 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.751 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.751 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.751 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:28.751 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:28.751 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 24.910005596000001, 2024-04-26T12:05:28.751 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:05:28.752 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:28.752 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:28.752 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:28.752 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.752 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:28.752 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:28.752 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.752 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.752 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.752 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:28.752 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:28.752 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.753 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.753 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.753 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:28.753 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:05:28.753 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.753 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.753 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.753 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:28.753 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:05:28.753 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:05:28.753 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.753 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.753 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:28.753 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:05:28.754 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:05:28.754 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.754 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.754 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.754 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:28.754 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:05:28.754 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.754 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.754 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:28.754 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:28.754 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:05:28.754 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.754 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.754 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:28.755 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:05:28.755 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:05:28.755 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.755 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.755 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:28.755 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:05:28.755 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:05:28.755 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.755 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:28.755 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.755 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.755 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.755 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:28.755 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:28.755 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 24.904010245999999, 2024-04-26T12:05:28.756 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:05:28.756 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:28.756 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.756 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:28.756 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.756 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:28.756 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:28.756 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.756 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.756 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.756 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:28.756 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:28.756 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.756 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.757 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.757 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:28.757 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:05:28.757 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.757 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.757 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.757 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:28.757 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:05:28.757 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:05:28.757 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.757 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.757 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:28.757 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:05:28.757 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:05:28.758 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.758 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.758 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.758 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:05:28.758 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:05:28.758 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.758 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.758 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:28.758 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:05:28.758 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:05:28.758 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.759 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.759 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:28.759 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:05:28.759 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:05:28.759 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.759 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.759 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:28.759 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:05:28.759 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:05:28.759 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.759 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.759 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:28.759 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:05:28.759 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:05:28.759 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.760 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:28.760 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.760 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.760 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.760 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:28.760 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:28.760 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 24.903941280000002, 2024-04-26T12:05:28.760 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:05:28.760 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:28.760 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.760 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:28.760 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.760 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:28.760 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:28.761 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.761 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.761 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.761 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:28.761 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:28.761 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.761 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.761 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.761 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:28.761 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:05:28.761 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.761 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.761 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.761 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:28.761 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:05:28.762 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:05:28.762 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.762 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.762 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:28.762 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:05:28.762 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:05:28.762 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.762 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.762 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.762 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:05:28.762 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:05:28.762 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.762 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.762 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:28.763 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:05:28.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:05:28.763 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.763 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:28.763 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:28.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:05:28.763 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.763 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:28.763 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:05:28.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:05:28.763 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.764 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.764 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:28.764 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:05:28.764 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:05:28.764 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.764 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:28.764 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.764 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.764 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.764 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:28.764 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:28.764 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 24.903446917, 2024-04-26T12:05:28.764 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:05:28.765 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:28.765 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.765 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:28.765 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.765 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:28.765 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:28.765 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.765 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.765 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.765 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:28.766 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:28.766 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.766 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.766 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:28.766 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:28.766 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.766 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.766 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:28.766 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:05:28.767 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:05:28.767 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.767 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.767 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:28.767 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:05:28.767 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:05:28.767 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.767 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.767 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.767 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:05:28.767 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:05:28.767 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.767 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.767 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:28.768 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:05:28.768 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:05:28.768 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.768 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.768 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:28.768 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:05:28.768 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:05:28.768 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.768 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.768 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:28.768 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:05:28.768 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:05:28.768 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.768 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.768 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:28.769 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:05:28.769 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:05:28.769 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.769 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:28.769 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.769 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.769 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.769 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:28.769 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:28.769 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 24.903408652, 2024-04-26T12:05:28.769 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:05:28.769 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:28.769 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.769 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:28.769 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.770 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:28.770 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:28.770 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.770 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.770 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:28.770 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:28.770 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.770 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.770 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:28.770 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:28.770 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.771 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.771 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:28.771 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:05:28.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:05:28.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.771 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.771 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:28.771 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:05:28.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:05:28.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.771 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.771 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.771 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:05:28.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:05:28.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:28.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:05:28.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:05:28.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:28.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:05:28.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:05:28.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:28.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:05:28.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:05:28.773 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.773 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.773 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:28.773 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:05:28.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:05:28.773 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.773 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:28.773 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.773 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.773 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.773 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:05:28.773 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:28.773 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 24.902728766999999, 2024-04-26T12:05:28.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:05:28.773 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:28.774 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:28.774 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:28.774 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.774 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:28.774 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:28.774 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.774 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.774 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.774 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:28.774 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:28.775 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.775 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:28.775 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:28.775 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.775 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:28.775 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:05:28.775 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:05:28.775 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:28.776 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:05:28.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:05:28.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.776 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:05:28.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:05:28.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:28.776 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:05:28.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:05:28.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.777 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:28.777 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:05:28.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:05:28.777 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.777 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:28.777 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.777 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:28.777 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:28.777 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 24.902699588000001, 2024-04-26T12:05:28.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:05:28.778 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:28.778 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:28.778 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:28.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:28.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:28.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:28.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:28.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.779 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.779 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:28.779 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:05:28.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.779 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.779 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.779 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:28.779 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:05:28.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:05:28.779 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.779 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.779 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:28.779 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:05:28.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:05:28.780 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.780 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.780 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.780 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:05:28.780 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:05:28.780 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.780 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.780 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:28.780 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:05:28.780 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:05:28.780 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.780 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.780 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:28.780 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:05:28.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:05:28.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.781 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:28.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:05:28.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:05:28.781 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.781 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:28.781 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.781 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:28.781 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:28.781 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 24.902667777000001, 2024-04-26T12:05:28.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:05:28.782 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:28.782 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:28.782 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:28.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:28.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:28.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:28.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:28.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.783 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:28.783 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:28.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:05:28.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.783 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.783 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:28.783 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:05:28.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:05:28.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.783 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.783 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:28.783 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:05:28.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:05:28.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.784 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:05:28.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:05:28.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:28.784 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:05:28.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:05:28.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:28.785 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:05:28.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:05:28.785 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.785 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.785 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:28.785 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:05:28.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:05:28.785 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.785 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:28.785 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.785 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.785 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.786 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:28.786 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:28.786 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 24.902646421, 2024-04-26T12:05:28.786 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:05:28.786 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:28.786 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:28.786 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:28.786 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.786 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:28.786 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:28.786 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.786 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.786 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.786 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:28.786 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:05:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:05:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:05:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:05:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:05:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:05:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:05:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:05:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:05:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:05:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:05:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:05:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:05:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:05:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 24.902617968000001, 2024-04-26T12:05:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:05:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:05:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:05:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:05:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:05:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:05:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:05:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:05:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:05:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:05:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:05:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:05:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 24.901896162, 2024-04-26T12:05:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:05:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:05:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:05:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:05:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:05:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:05:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:05:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:05:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:05:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:05:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:05:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:05:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:05:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 19.184969558999999, 2024-04-26T12:05:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:05:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.798 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:05:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:05:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:05:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:05:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:05:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:05:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:28.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:05:28.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:05:28.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:28.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:05:28.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:05:28.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:28.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:05:28.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:05:28.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:05:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:05:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:05:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:05:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:05:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:05:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:05:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:05:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:05:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:05:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:28.802 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:28.804 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:28.805 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:28.803+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:28.839 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-26T12:05:28.904 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:28.903+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:28.919 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:28.919 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:05:28.919 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-04-26T12:05:28.919 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:28.928 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:28.944 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-04-26T12:05:29.005 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:29.004+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:29.072 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:29.072 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:05:29.072 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T12:05:29.072 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T12:05:29.072 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:29.080 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:29.081 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-04-26T12:05:29.106 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:29.105+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:29.109 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:05:29.184 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:29.184 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T12:05:29.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T12:05:29.184 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T12:05:29.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.184 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:29.184 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:29.185 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 25.401803163, 2024-04-26T12:05:29.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017255857999999999, 2024-04-26T12:05:29.185 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:29.185 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:29.185 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:29.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:29.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:29.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:29.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:29.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:29.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780340+0000", 2024-04-26T12:05:29.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:29.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:29.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780351+0000", 2024-04-26T12:05:29.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0898e-05 2024-04-26T12:05:29.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:29.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:29.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1671999999999999e-05 2024-04-26T12:05:29.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:29.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780374+0000", 2024-04-26T12:05:29.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1117999999999999e-05 2024-04-26T12:05:29.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780423+0000", 2024-04-26T12:05:29.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9066000000000001e-05 2024-04-26T12:05:29.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:29.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780428+0000", 2024-04-26T12:05:29.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1320000000000002e-06 2024-04-26T12:05:29.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788902+0000", 2024-04-26T12:05:29.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084738560000000001 2024-04-26T12:05:29.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:29.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789167+0000", 2024-04-26T12:05:29.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026521100000000001 2024-04-26T12:05:29.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:29.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789279+0000", 2024-04-26T12:05:29.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111616 2024-04-26T12:05:29.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:29.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792335+0000", 2024-04-26T12:05:29.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030556419999999999 2024-04-26T12:05:29.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:29.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797519+0000", 2024-04-26T12:05:29.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051841550000000002 2024-04-26T12:05:29.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:29.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797559+0000", 2024-04-26T12:05:29.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0451999999999998e-05 2024-04-26T12:05:29.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:29.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797598+0000", 2024-04-26T12:05:29.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8500000000000001e-05 2024-04-26T12:05:29.190 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.190 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:29.190 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.190 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:29.190 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:29.190 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 25.401754856, 2024-04-26T12:05:29.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017668725, 2024-04-26T12:05:29.191 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:29.191 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:29.191 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:29.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:29.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:29.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:29.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:29.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:29.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:29.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:29.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:29.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780395+0000", 2024-04-26T12:05:29.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.198e-06 2024-04-26T12:05:29.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:29.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780402+0000", 2024-04-26T12:05:29.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:05:29.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:29.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780408+0000", 2024-04-26T12:05:29.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:29.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780481+0000", 2024-04-26T12:05:29.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3239999999999997e-05 2024-04-26T12:05:29.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:29.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780485+0000", 2024-04-26T12:05:29.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4039999999999999e-06 2024-04-26T12:05:29.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789518+0000", 2024-04-26T12:05:29.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090335480000000006 2024-04-26T12:05:29.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:29.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789585+0000", 2024-04-26T12:05:29.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6469000000000003e-05 2024-04-26T12:05:29.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:29.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789699+0000", 2024-04-26T12:05:29.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114613 2024-04-26T12:05:29.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:29.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793308+0000", 2024-04-26T12:05:29.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036088520000000001 2024-04-26T12:05:29.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:29.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797887+0000", 2024-04-26T12:05:29.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0045792790000000003 2024-04-26T12:05:29.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:29.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797955+0000", 2024-04-26T12:05:29.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T12:05:29.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:29.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798059+0000", 2024-04-26T12:05:29.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103874 2024-04-26T12:05:29.196 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.196 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:29.196 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.196 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:29.196 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:29.196 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 25.401724584, 2024-04-26T12:05:29.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017735145000000001, 2024-04-26T12:05:29.196 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:29.196 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:29.196 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:29.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:29.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:29.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:29.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:29.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:29.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:29.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:29.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:29.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780424+0000", 2024-04-26T12:05:29.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4519999999999999e-06 2024-04-26T12:05:29.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:29.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780431+0000", 2024-04-26T12:05:29.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0690000000000004e-06 2024-04-26T12:05:29.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:29.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780438+0000", 2024-04-26T12:05:29.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5719999999999999e-06 2024-04-26T12:05:29.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780468+0000", 2024-04-26T12:05:29.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.993e-05 2024-04-26T12:05:29.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:29.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780472+0000", 2024-04-26T12:05:29.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-04-26T12:05:29.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789916+0000", 2024-04-26T12:05:29.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094434940000000002 2024-04-26T12:05:29.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:29.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790004+0000", 2024-04-26T12:05:29.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8085999999999997e-05 2024-04-26T12:05:29.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:29.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790125+0000", 2024-04-26T12:05:29.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012186200000000001 2024-04-26T12:05:29.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:29.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793402+0000", 2024-04-26T12:05:29.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00327685 2024-04-26T12:05:29.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:29.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798068+0000", 2024-04-26T12:05:29.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046652150000000003 2024-04-26T12:05:29.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:29.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798108+0000", 2024-04-26T12:05:29.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0911000000000002e-05 2024-04-26T12:05:29.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:29.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798156+0000", 2024-04-26T12:05:29.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7128e-05 2024-04-26T12:05:29.202 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.202 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:29.202 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.202 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:29.202 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:29.202 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 25.401701565, 2024-04-26T12:05:29.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017792624, 2024-04-26T12:05:29.202 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:29.203 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:29.203 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:29.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:29.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:29.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:29.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:29.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:29.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:29.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:29.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:29.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780447+0000", 2024-04-26T12:05:29.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8519999999999997e-06 2024-04-26T12:05:29.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:29.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780453+0000", 2024-04-26T12:05:29.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2999999999999998e-06 2024-04-26T12:05:29.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:29.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:29.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0760000000000002e-06 2024-04-26T12:05:29.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780502+0000", 2024-04-26T12:05:29.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4079999999999998e-05 2024-04-26T12:05:29.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:29.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:29.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5450000000000002e-06 2024-04-26T12:05:29.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790390+0000", 2024-04-26T12:05:29.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098850759999999996 2024-04-26T12:05:29.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:29.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790447+0000", 2024-04-26T12:05:29.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6752999999999997e-05 2024-04-26T12:05:29.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:29.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790547+0000", 2024-04-26T12:05:29.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100344 2024-04-26T12:05:29.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:29.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793864+0000", 2024-04-26T12:05:29.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033169749999999998 2024-04-26T12:05:29.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:29.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798164+0000", 2024-04-26T12:05:29.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043000690000000001 2024-04-26T12:05:29.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:29.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798204+0000", 2024-04-26T12:05:29.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9478999999999999e-05 2024-04-26T12:05:29.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:29.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798236+0000", 2024-04-26T12:05:29.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2478999999999999e-05 2024-04-26T12:05:29.211 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.211 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:29.211 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.211 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:29.211 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:29.211 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 25.401661222000001, 2024-04-26T12:05:29.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016989500000000001, 2024-04-26T12:05:29.211 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:29.211 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:29.211 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:29.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:29.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:29.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:29.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:29.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:29.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780483+0000", 2024-04-26T12:05:29.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:29.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:29.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780488+0000", 2024-04-26T12:05:29.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6260000000000003e-06 2024-04-26T12:05:29.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:29.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780499+0000", 2024-04-26T12:05:29.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1236000000000001e-05 2024-04-26T12:05:29.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:29.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:29.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4569999999999996e-06 2024-04-26T12:05:29.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780529+0000", 2024-04-26T12:05:29.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4579e-05 2024-04-26T12:05:29.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:29.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780532+0000", 2024-04-26T12:05:29.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.74e-06 2024-04-26T12:05:29.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788868+0000", 2024-04-26T12:05:29.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0083357650000000002 2024-04-26T12:05:29.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:29.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789142+0000", 2024-04-26T12:05:29.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027472 2024-04-26T12:05:29.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:29.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789241+0000", 2024-04-26T12:05:29.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8394999999999996e-05 2024-04-26T12:05:29.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:29.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792096+0000", 2024-04-26T12:05:29.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002855677 2024-04-26T12:05:29.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:29.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797379+0000", 2024-04-26T12:05:29.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052822379999999999 2024-04-26T12:05:29.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:29.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797433+0000", 2024-04-26T12:05:29.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4109e-05 2024-04-26T12:05:29.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:29.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797473+0000", 2024-04-26T12:05:29.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0533e-05 2024-04-26T12:05:29.218 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.218 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:29.218 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.218 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:29.219 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:29.219 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 25.401621607999999, 2024-04-26T12:05:29.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017295965, 2024-04-26T12:05:29.219 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:29.219 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:29.219 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:29.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:29.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:29.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:29.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:29.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:29.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780513+0000", 2024-04-26T12:05:29.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999895 2024-04-26T12:05:29.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:29.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780528+0000", 2024-04-26T12:05:29.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5089000000000001e-05 2024-04-26T12:05:29.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:29.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780537+0000", 2024-04-26T12:05:29.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8400000000000001e-06 2024-04-26T12:05:29.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:29.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780544+0000", 2024-04-26T12:05:29.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.917e-06 2024-04-26T12:05:29.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780571+0000", 2024-04-26T12:05:29.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7032000000000001e-05 2024-04-26T12:05:29.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:29.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780574+0000", 2024-04-26T12:05:29.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:05:29.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789436+0000", 2024-04-26T12:05:29.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088622240000000001 2024-04-26T12:05:29.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:29.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789525+0000", 2024-04-26T12:05:29.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8549999999999998e-05 2024-04-26T12:05:29.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:29.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789642+0000", 2024-04-26T12:05:29.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011772100000000001 2024-04-26T12:05:29.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:29.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792129+0000", 2024-04-26T12:05:29.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024871709999999998 2024-04-26T12:05:29.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:29.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797732+0000", 2024-04-26T12:05:29.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056027580000000002 2024-04-26T12:05:29.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:29.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797777+0000", 2024-04-26T12:05:29.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4620999999999999e-05 2024-04-26T12:05:29.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:29.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797819+0000", 2024-04-26T12:05:29.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2536000000000001e-05 2024-04-26T12:05:29.224 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.224 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:29.224 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.224 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:29.224 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:29.224 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 25.401592657999998, 2024-04-26T12:05:29.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017840163999999999, 2024-04-26T12:05:29.224 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:29.224 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:29.224 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:29.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:29.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:29.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:29.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:29.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:29.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:29.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:29.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:29.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:29.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5419999999999999e-06 2024-04-26T12:05:29.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:29.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780563+0000", 2024-04-26T12:05:29.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:05:29.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:29.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780569+0000", 2024-04-26T12:05:29.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1479999999999997e-06 2024-04-26T12:05:29.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780594+0000", 2024-04-26T12:05:29.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5585e-05 2024-04-26T12:05:29.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:29.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780596+0000", 2024-04-26T12:05:29.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2630000000000002e-06 2024-04-26T12:05:29.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789932+0000", 2024-04-26T12:05:29.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093360479999999996 2024-04-26T12:05:29.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:29.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790070+0000", 2024-04-26T12:05:29.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013771399999999999 2024-04-26T12:05:29.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:29.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790219+0000", 2024-04-26T12:05:29.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014872299999999999 2024-04-26T12:05:29.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:29.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793632+0000", 2024-04-26T12:05:29.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003413368 2024-04-26T12:05:29.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:29.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798244+0000", 2024-04-26T12:05:29.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046113819999999998 2024-04-26T12:05:29.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:29.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798361+0000", 2024-04-26T12:05:29.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117726 2024-04-26T12:05:29.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:29.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798393+0000", 2024-04-26T12:05:29.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1099999999999997e-05 2024-04-26T12:05:29.229 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.229 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:29.229 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.230 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:29.230 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:29.230 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 25.401567733, 2024-04-26T12:05:29.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016645943, 2024-04-26T12:05:29.230 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:29.230 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:29.230 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:29.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:29.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:29.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:29.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:29.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:29.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:29.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:29.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:29.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780580+0000", 2024-04-26T12:05:29.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1549999999999999e-06 2024-04-26T12:05:29.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:29.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780588+0000", 2024-04-26T12:05:29.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:05:29.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:29.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780593+0000", 2024-04-26T12:05:29.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2399999999999998e-06 2024-04-26T12:05:29.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780628+0000", 2024-04-26T12:05:29.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5426000000000003e-05 2024-04-26T12:05:29.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:29.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780632+0000", 2024-04-26T12:05:29.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:05:29.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788288+0000", 2024-04-26T12:05:29.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076555879999999996 2024-04-26T12:05:29.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:29.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788570+0000", 2024-04-26T12:05:29.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028233700000000002 2024-04-26T12:05:29.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:29.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797223+0000", 2024-04-26T12:05:29.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086529150000000006 2024-04-26T12:05:29.234 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.234 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:29.234 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.234 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:29.234 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:29.234 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 25.401543763999999, 2024-04-26T12:05:29.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016536068000000001, 2024-04-26T12:05:29.234 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:29.234 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:29.234 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:29.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:29.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:29.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:29.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:29.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:29.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:29.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:29.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:29.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780609+0000", 2024-04-26T12:05:29.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8280000000000003e-06 2024-04-26T12:05:29.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:29.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780616+0000", 2024-04-26T12:05:29.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4939999999999997e-06 2024-04-26T12:05:29.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:29.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780621+0000", 2024-04-26T12:05:29.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6040000000000003e-06 2024-04-26T12:05:29.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780647+0000", 2024-04-26T12:05:29.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6441999999999999e-05 2024-04-26T12:05:29.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:29.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780650+0000", 2024-04-26T12:05:29.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4430000000000002e-06 2024-04-26T12:05:29.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788163+0000", 2024-04-26T12:05:29.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007513774 2024-04-26T12:05:29.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:29.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788307+0000", 2024-04-26T12:05:29.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014374400000000001 2024-04-26T12:05:29.238 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.238 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.238 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:29.238 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797137+0000", 2024-04-26T12:05:29.238 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088302160000000001 2024-04-26T12:05:29.238 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.238 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:29.238 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.238 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.238 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.238 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:29.238 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:29.238 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 25.398667492000001, 2024-04-26T12:05:29.238 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012911448000000001, 2024-04-26T12:05:29.238 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:29.238 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:29.239 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:29.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:29.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:29.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:29.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:29.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:29.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783477+0000", 2024-04-26T12:05:29.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:29.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:29.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783482+0000", 2024-04-26T12:05:29.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5709999999999999e-06 2024-04-26T12:05:29.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:29.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783491+0000", 2024-04-26T12:05:29.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3610000000000007e-06 2024-04-26T12:05:29.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:29.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783498+0000", 2024-04-26T12:05:29.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4209999999999998e-06 2024-04-26T12:05:29.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786045+0000", 2024-04-26T12:05:29.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0025465739999999998 2024-04-26T12:05:29.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:29.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786061+0000", 2024-04-26T12:05:29.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6348999999999999e-05 2024-04-26T12:05:29.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:29.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796342+0000", 2024-04-26T12:05:29.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010280643000000001 2024-04-26T12:05:29.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:29.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796389+0000", 2024-04-26T12:05:29.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6912000000000001e-05 2024-04-26T12:05:29.242 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.242 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:29.242 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.242 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:29.242 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:29.242 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 25.398639186, 2024-04-26T12:05:29.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013376469, 2024-04-26T12:05:29.242 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:29.243 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:29.243 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:29.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:29.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:29.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:29.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:29.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:29.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:29.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:29.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.244 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:29.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783516+0000", 2024-04-26T12:05:29.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.041e-05 2024-04-26T12:05:29.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.244 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:29.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783523+0000", 2024-04-26T12:05:29.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5749999999999997e-06 2024-04-26T12:05:29.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.244 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:29.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783528+0000", 2024-04-26T12:05:29.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5029999999999997e-06 2024-04-26T12:05:29.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787662+0000", 2024-04-26T12:05:29.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041336230000000003 2024-04-26T12:05:29.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:29.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787687+0000", 2024-04-26T12:05:29.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5769999999999999e-05 2024-04-26T12:05:29.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:29.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796817+0000", 2024-04-26T12:05:29.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091296750000000003 2024-04-26T12:05:29.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:29.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796882+0000", 2024-04-26T12:05:29.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5180999999999998e-05 2024-04-26T12:05:29.246 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.246 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:29.246 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.246 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:29.246 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:29.246 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 25.398570645, 2024-04-26T12:05:29.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013457291999999999, 2024-04-26T12:05:29.246 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:29.247 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:29.247 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:29.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:29.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:29.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:29.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:29.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:29.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:29.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:29.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:29.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783578+0000", 2024-04-26T12:05:29.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.659e-06 2024-04-26T12:05:29.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:29.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783584+0000", 2024-04-26T12:05:29.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:29.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:29.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783588+0000", 2024-04-26T12:05:29.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6190000000000002e-06 2024-04-26T12:05:29.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787834+0000", 2024-04-26T12:05:29.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042460529999999996 2024-04-26T12:05:29.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:29.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787854+0000", 2024-04-26T12:05:29.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9658999999999999e-05 2024-04-26T12:05:29.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:29.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:29.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009107604 2024-04-26T12:05:29.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.250 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:29.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797032+0000", 2024-04-26T12:05:29.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9987000000000006e-05 2024-04-26T12:05:29.250 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.250 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:29.250 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.250 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:29.250 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:29.250 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 25.396724266, 2024-04-26T12:05:29.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011003015999999999, 2024-04-26T12:05:29.250 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:29.250 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:29.250 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:29.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:29.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:29.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:29.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:29.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:29.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785420+0000", 2024-04-26T12:05:29.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:29.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:29.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785427+0000", 2024-04-26T12:05:29.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:05:29.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:29.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785438+0000", 2024-04-26T12:05:29.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069e-05 2024-04-26T12:05:29.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:29.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785457+0000", 2024-04-26T12:05:29.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8617000000000001e-05 2024-04-26T12:05:29.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786628+0000", 2024-04-26T12:05:29.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001171418 2024-04-26T12:05:29.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:29.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786651+0000", 2024-04-26T12:05:29.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3289e-05 2024-04-26T12:05:29.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:29.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796393+0000", 2024-04-26T12:05:29.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097413269999999993 2024-04-26T12:05:29.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:29.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796424+0000", 2024-04-26T12:05:29.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1188e-05 2024-04-26T12:05:29.254 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.254 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:29.254 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.254 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:29.254 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:29.254 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 25.396177519999998, 2024-04-26T12:05:29.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010561432000000001, 2024-04-26T12:05:29.254 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:29.254 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:29.255 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:29.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:29.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:29.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:29.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:29.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:29.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:29.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:29.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:29.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785973+0000", 2024-04-26T12:05:29.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4910000000000002e-06 2024-04-26T12:05:29.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:29.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785991+0000", 2024-04-26T12:05:29.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7663e-05 2024-04-26T12:05:29.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:29.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785998+0000", 2024-04-26T12:05:29.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1239999999999999e-06 2024-04-26T12:05:29.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786792+0000", 2024-04-26T12:05:29.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079334800000000003 2024-04-26T12:05:29.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:29.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786810+0000", 2024-04-26T12:05:29.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8746999999999999e-05 2024-04-26T12:05:29.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:29.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796500+0000", 2024-04-26T12:05:29.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096897619999999993 2024-04-26T12:05:29.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:29.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796529+0000", 2024-04-26T12:05:29.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8873999999999998e-05 2024-04-26T12:05:29.258 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.258 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:29.258 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.258 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:29.258 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:29.258 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 25.396098433999999, 2024-04-26T12:05:29.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010219911, 2024-04-26T12:05:29.258 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:29.258 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:29.259 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:29.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:29.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:29.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:29.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:29.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:29.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786046+0000", 2024-04-26T12:05:29.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:29.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:29.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786053+0000", 2024-04-26T12:05:29.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0360000000000001e-06 2024-04-26T12:05:29.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:29.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786064+0000", 2024-04-26T12:05:29.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1202999999999999e-05 2024-04-26T12:05:29.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:29.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786091+0000", 2024-04-26T12:05:29.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6859000000000002e-05 2024-04-26T12:05:29.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786212+0000", 2024-04-26T12:05:29.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120975 2024-04-26T12:05:29.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:29.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786236+0000", 2024-04-26T12:05:29.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4358999999999998e-05 2024-04-26T12:05:29.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:29.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796236+0000", 2024-04-26T12:05:29.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099998050000000005 2024-04-26T12:05:29.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:29.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796266+0000", 2024-04-26T12:05:29.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0278e-05 2024-04-26T12:05:29.262 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.262 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:29.262 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.262 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:3 3.14 e17/15 3:287034c4:::1.00000000.inode:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:29.262 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:29.262 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 25.395309473000001, 2024-04-26T12:05:29.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009764712, 2024-04-26T12:05:29.262 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:29.262 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:29.262 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:29.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:29.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:29.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:29.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:29.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:29.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786835+0000", 2024-04-26T12:05:29.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T12:05:29.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:29.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786844+0000", 2024-04-26T12:05:29.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6500000000000008e-06 2024-04-26T12:05:29.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:29.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786855+0000", 2024-04-26T12:05:29.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0932e-05 2024-04-26T12:05:29.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:29.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786864+0000", 2024-04-26T12:05:29.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2150000000000007e-06 2024-04-26T12:05:29.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787242+0000", 2024-04-26T12:05:29.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037708300000000001 2024-04-26T12:05:29.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:29.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787259+0000", 2024-04-26T12:05:29.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7258999999999999e-05 2024-04-26T12:05:29.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:29.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796579+0000", 2024-04-26T12:05:29.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093201099999999995 2024-04-26T12:05:29.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:29.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796600+0000", 2024-04-26T12:05:29.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1330000000000001e-05 2024-04-26T12:05:29.266 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.266 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:29.266 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.266 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:29.266 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:29.266 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 25.395265451, 2024-04-26T12:05:29.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096431940000000008, 2024-04-26T12:05:29.266 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:29.266 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:29.266 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:29.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:29.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:29.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:29.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:29.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:29.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786879+0000", 2024-04-26T12:05:29.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:29.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:29.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786887+0000", 2024-04-26T12:05:29.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9300000000000003e-06 2024-04-26T12:05:29.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:29.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786894+0000", 2024-04-26T12:05:29.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:05:29.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:29.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786899+0000", 2024-04-26T12:05:29.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8400000000000002e-06 2024-04-26T12:05:29.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786932+0000", 2024-04-26T12:05:29.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3031999999999998e-05 2024-04-26T12:05:29.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:29.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786945+0000", 2024-04-26T12:05:29.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3421000000000001e-05 2024-04-26T12:05:29.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:29.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796469+0000", 2024-04-26T12:05:29.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095236130000000002 2024-04-26T12:05:29.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:29.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796523+0000", 2024-04-26T12:05:29.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4089999999999999e-05 2024-04-26T12:05:29.270 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.270 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:29.270 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.270 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "pg_update_log_missing(3.14 epoch 17/15 rep_tid 169 entries 17'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:05:29.270 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:29.270 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 25.395202296000001, 2024-04-26T12:05:29.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097257639999999996, 2024-04-26T12:05:29.270 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:29.270 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-04-26T12:05:29.270 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:29.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:29.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:29.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:29.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:29.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:29.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786942+0000", 2024-04-26T12:05:29.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:29.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:29.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786951+0000", 2024-04-26T12:05:29.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:05:29.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:29.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786965+0000", 2024-04-26T12:05:29.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4268e-05 2024-04-26T12:05:29.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:29.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786977+0000", 2024-04-26T12:05:29.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1667e-05 2024-04-26T12:05:29.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787667+0000", 2024-04-26T12:05:29.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00069057400000000001 2024-04-26T12:05:29.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:29.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796668+0000", 2024-04-26T12:05:29.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090013309999999996 2024-04-26T12:05:29.273 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.273 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:29.273 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.273 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:29.273 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:29.273 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 25.395149152999998, 2024-04-26T12:05:29.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095908309999999993, 2024-04-26T12:05:29.274 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:29.274 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:29.274 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:29.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:29.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:29.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:29.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:29.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:29.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786995+0000", 2024-04-26T12:05:29.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:29.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:29.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787001+0000", 2024-04-26T12:05:29.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5099999999999998e-06 2024-04-26T12:05:29.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:29.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787009+0000", 2024-04-26T12:05:29.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9100000000000005e-06 2024-04-26T12:05:29.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:29.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787019+0000", 2024-04-26T12:05:29.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8109999999999997e-06 2024-04-26T12:05:29.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787136+0000", 2024-04-26T12:05:29.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011749899999999999 2024-04-26T12:05:29.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:29.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787154+0000", 2024-04-26T12:05:29.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8278999999999999e-05 2024-04-26T12:05:29.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:29.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796561+0000", 2024-04-26T12:05:29.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094064379999999996 2024-04-26T12:05:29.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:29.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796587+0000", 2024-04-26T12:05:29.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5856000000000001e-05 2024-04-26T12:05:29.277 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.277 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:29.277 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.277 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:29.277 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:29.277 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 25.394432095999999, 2024-04-26T12:05:29.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096460160000000003, 2024-04-26T12:05:29.277 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:29.278 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:29.278 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:29.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:29.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:29.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:29.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:29.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:29.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:29.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787712+0000", 2024-04-26T12:05:29.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:29.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:29.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787718+0000", 2024-04-26T12:05:29.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:05:29.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:29.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787727+0000", 2024-04-26T12:05:29.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.123e-06 2024-04-26T12:05:29.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:29.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787734+0000", 2024-04-26T12:05:29.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.391e-06 2024-04-26T12:05:29.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:29.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788867+0000", 2024-04-26T12:05:29.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001133207 2024-04-26T12:05:29.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:29.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788899+0000", 2024-04-26T12:05:29.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1526000000000003e-05 2024-04-26T12:05:29.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:29.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797328+0000", 2024-04-26T12:05:29.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084295389999999998 2024-04-26T12:05:29.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:29.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:29.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:29.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797359+0000", 2024-04-26T12:05:29.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0660999999999997e-05 2024-04-26T12:05:29.281 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.281 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:29.281 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.281 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:29.281 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:29.281 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:29.283 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:29.282+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:29.284 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:05:29.284 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:29.284 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:05:29.285 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T12:05:29.285 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:05:29.288 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:05:29.288 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:05:29.384 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:29.382+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:29.397 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:29.397 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:29.407 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:29.485 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:29.484+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:29.510 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:29.510 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:29.518 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:29.586 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:29.585+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:29.619 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:29.620 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:29.628 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:29.686 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:29.685+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:29.743 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:29.743 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:29.751 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:29.787 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:29.786+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:29.890 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:29.888+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:29.895 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:29.895 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:29.905 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:29.990 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:29.989+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:30.047 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:30.047 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:30.056 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:30.091 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:30.090+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:30.169 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:30.169 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:30.178 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:30.192 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:30.192+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:30.279 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:30.279 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:30.288 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:30.294 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:30.293+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:30.389 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:30.389 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:30.394 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:30.393+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:30.397 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:30.495 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:30.494+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:30.508 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:30.508 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:30.517 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:30.596 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:30.594+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:30.619 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:30.620 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:30.628 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:30.697 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:30.696+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:30.732 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:30.732 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:30.740 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:30.798 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:30.797+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:30.847 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:30.847 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:30.853 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:05:30.857 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:30.900 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:30.899+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:30.958 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:30.958 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:30.967 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:31.001 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:30.999+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:31.102 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:31.100+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:31.107 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:31.108 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:31.116 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:31.202 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:31.201+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:31.227 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:31.227 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:31.236 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:31.299 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:05:31.320 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:31.319+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:31.378 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:31.379 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:31.387 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:31.404 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:31.403+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:31.422 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:05:31.422 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:05:31.439 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T12:05:31.440 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:05:31.457 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:05:31.457 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:05:31.505 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:31.505+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:31.530 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:31.530 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T12:05:31.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T12:05:31.530 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T12:05:31.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.530 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:31.530 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:31.530 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.747535816999999, 2024-04-26T12:05:31.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017255857999999999, 2024-04-26T12:05:31.530 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:31.530 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780340+0000", 2024-04-26T12:05:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780351+0000", 2024-04-26T12:05:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0898e-05 2024-04-26T12:05:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1671999999999999e-05 2024-04-26T12:05:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780374+0000", 2024-04-26T12:05:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1117999999999999e-05 2024-04-26T12:05:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780423+0000", 2024-04-26T12:05:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9066000000000001e-05 2024-04-26T12:05:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780428+0000", 2024-04-26T12:05:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1320000000000002e-06 2024-04-26T12:05:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788902+0000", 2024-04-26T12:05:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084738560000000001 2024-04-26T12:05:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789167+0000", 2024-04-26T12:05:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026521100000000001 2024-04-26T12:05:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789279+0000", 2024-04-26T12:05:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111616 2024-04-26T12:05:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792335+0000", 2024-04-26T12:05:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030556419999999999 2024-04-26T12:05:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797519+0000", 2024-04-26T12:05:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051841550000000002 2024-04-26T12:05:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797559+0000", 2024-04-26T12:05:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0451999999999998e-05 2024-04-26T12:05:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797598+0000", 2024-04-26T12:05:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8500000000000001e-05 2024-04-26T12:05:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.747487509999999, 2024-04-26T12:05:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017668725, 2024-04-26T12:05:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780395+0000", 2024-04-26T12:05:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.198e-06 2024-04-26T12:05:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780402+0000", 2024-04-26T12:05:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:05:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780408+0000", 2024-04-26T12:05:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780481+0000", 2024-04-26T12:05:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3239999999999997e-05 2024-04-26T12:05:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780485+0000", 2024-04-26T12:05:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4039999999999999e-06 2024-04-26T12:05:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789518+0000", 2024-04-26T12:05:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090335480000000006 2024-04-26T12:05:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789585+0000", 2024-04-26T12:05:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6469000000000003e-05 2024-04-26T12:05:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789699+0000", 2024-04-26T12:05:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114613 2024-04-26T12:05:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793308+0000", 2024-04-26T12:05:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036088520000000001 2024-04-26T12:05:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797887+0000", 2024-04-26T12:05:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0045792790000000003 2024-04-26T12:05:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797955+0000", 2024-04-26T12:05:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T12:05:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798059+0000", 2024-04-26T12:05:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103874 2024-04-26T12:05:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.747457237999999, 2024-04-26T12:05:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017735145000000001, 2024-04-26T12:05:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780424+0000", 2024-04-26T12:05:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4519999999999999e-06 2024-04-26T12:05:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780431+0000", 2024-04-26T12:05:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0690000000000004e-06 2024-04-26T12:05:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780438+0000", 2024-04-26T12:05:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5719999999999999e-06 2024-04-26T12:05:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780468+0000", 2024-04-26T12:05:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.993e-05 2024-04-26T12:05:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780472+0000", 2024-04-26T12:05:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-04-26T12:05:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789916+0000", 2024-04-26T12:05:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094434940000000002 2024-04-26T12:05:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790004+0000", 2024-04-26T12:05:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8085999999999997e-05 2024-04-26T12:05:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790125+0000", 2024-04-26T12:05:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012186200000000001 2024-04-26T12:05:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793402+0000", 2024-04-26T12:05:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00327685 2024-04-26T12:05:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798068+0000", 2024-04-26T12:05:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046652150000000003 2024-04-26T12:05:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798108+0000", 2024-04-26T12:05:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0911000000000002e-05 2024-04-26T12:05:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798156+0000", 2024-04-26T12:05:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7128e-05 2024-04-26T12:05:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.747434218999999, 2024-04-26T12:05:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017792624, 2024-04-26T12:05:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780447+0000", 2024-04-26T12:05:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8519999999999997e-06 2024-04-26T12:05:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780453+0000", 2024-04-26T12:05:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2999999999999998e-06 2024-04-26T12:05:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0760000000000002e-06 2024-04-26T12:05:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780502+0000", 2024-04-26T12:05:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4079999999999998e-05 2024-04-26T12:05:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5450000000000002e-06 2024-04-26T12:05:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790390+0000", 2024-04-26T12:05:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098850759999999996 2024-04-26T12:05:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790447+0000", 2024-04-26T12:05:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6752999999999997e-05 2024-04-26T12:05:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790547+0000", 2024-04-26T12:05:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100344 2024-04-26T12:05:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793864+0000", 2024-04-26T12:05:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033169749999999998 2024-04-26T12:05:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798164+0000", 2024-04-26T12:05:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043000690000000001 2024-04-26T12:05:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798204+0000", 2024-04-26T12:05:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9478999999999999e-05 2024-04-26T12:05:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798236+0000", 2024-04-26T12:05:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2478999999999999e-05 2024-04-26T12:05:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.747393876, 2024-04-26T12:05:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016989500000000001, 2024-04-26T12:05:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780483+0000", 2024-04-26T12:05:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780488+0000", 2024-04-26T12:05:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6260000000000003e-06 2024-04-26T12:05:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780499+0000", 2024-04-26T12:05:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1236000000000001e-05 2024-04-26T12:05:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4569999999999996e-06 2024-04-26T12:05:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780529+0000", 2024-04-26T12:05:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4579e-05 2024-04-26T12:05:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780532+0000", 2024-04-26T12:05:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.74e-06 2024-04-26T12:05:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788868+0000", 2024-04-26T12:05:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0083357650000000002 2024-04-26T12:05:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789142+0000", 2024-04-26T12:05:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027472 2024-04-26T12:05:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789241+0000", 2024-04-26T12:05:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8394999999999996e-05 2024-04-26T12:05:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792096+0000", 2024-04-26T12:05:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002855677 2024-04-26T12:05:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797379+0000", 2024-04-26T12:05:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052822379999999999 2024-04-26T12:05:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797433+0000", 2024-04-26T12:05:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4109e-05 2024-04-26T12:05:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797473+0000", 2024-04-26T12:05:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0533e-05 2024-04-26T12:05:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.747354262000002, 2024-04-26T12:05:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017295965, 2024-04-26T12:05:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780513+0000", 2024-04-26T12:05:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999895 2024-04-26T12:05:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780528+0000", 2024-04-26T12:05:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5089000000000001e-05 2024-04-26T12:05:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780537+0000", 2024-04-26T12:05:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8400000000000001e-06 2024-04-26T12:05:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780544+0000", 2024-04-26T12:05:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.917e-06 2024-04-26T12:05:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780571+0000", 2024-04-26T12:05:31.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7032000000000001e-05 2024-04-26T12:05:31.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:31.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780574+0000", 2024-04-26T12:05:31.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:05:31.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789436+0000", 2024-04-26T12:05:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088622240000000001 2024-04-26T12:05:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789525+0000", 2024-04-26T12:05:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8549999999999998e-05 2024-04-26T12:05:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789642+0000", 2024-04-26T12:05:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011772100000000001 2024-04-26T12:05:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792129+0000", 2024-04-26T12:05:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024871709999999998 2024-04-26T12:05:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797732+0000", 2024-04-26T12:05:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056027580000000002 2024-04-26T12:05:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797777+0000", 2024-04-26T12:05:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4620999999999999e-05 2024-04-26T12:05:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797819+0000", 2024-04-26T12:05:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2536000000000001e-05 2024-04-26T12:05:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.747325312000001, 2024-04-26T12:05:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017840163999999999, 2024-04-26T12:05:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5419999999999999e-06 2024-04-26T12:05:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780563+0000", 2024-04-26T12:05:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:05:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780569+0000", 2024-04-26T12:05:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1479999999999997e-06 2024-04-26T12:05:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780594+0000", 2024-04-26T12:05:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5585e-05 2024-04-26T12:05:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780596+0000", 2024-04-26T12:05:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2630000000000002e-06 2024-04-26T12:05:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789932+0000", 2024-04-26T12:05:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093360479999999996 2024-04-26T12:05:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790070+0000", 2024-04-26T12:05:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013771399999999999 2024-04-26T12:05:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790219+0000", 2024-04-26T12:05:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014872299999999999 2024-04-26T12:05:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793632+0000", 2024-04-26T12:05:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003413368 2024-04-26T12:05:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798244+0000", 2024-04-26T12:05:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046113819999999998 2024-04-26T12:05:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798361+0000", 2024-04-26T12:05:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117726 2024-04-26T12:05:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798393+0000", 2024-04-26T12:05:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1099999999999997e-05 2024-04-26T12:05:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.747300386999999, 2024-04-26T12:05:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016645943, 2024-04-26T12:05:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780580+0000", 2024-04-26T12:05:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1549999999999999e-06 2024-04-26T12:05:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780588+0000", 2024-04-26T12:05:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:05:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780593+0000", 2024-04-26T12:05:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2399999999999998e-06 2024-04-26T12:05:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780628+0000", 2024-04-26T12:05:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5426000000000003e-05 2024-04-26T12:05:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780632+0000", 2024-04-26T12:05:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:05:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788288+0000", 2024-04-26T12:05:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076555879999999996 2024-04-26T12:05:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788570+0000", 2024-04-26T12:05:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028233700000000002 2024-04-26T12:05:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797223+0000", 2024-04-26T12:05:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086529150000000006 2024-04-26T12:05:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.747276417999998, 2024-04-26T12:05:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016536068000000001, 2024-04-26T12:05:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780609+0000", 2024-04-26T12:05:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8280000000000003e-06 2024-04-26T12:05:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780616+0000", 2024-04-26T12:05:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4939999999999997e-06 2024-04-26T12:05:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780621+0000", 2024-04-26T12:05:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6040000000000003e-06 2024-04-26T12:05:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780647+0000", 2024-04-26T12:05:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6441999999999999e-05 2024-04-26T12:05:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780650+0000", 2024-04-26T12:05:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4430000000000002e-06 2024-04-26T12:05:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788163+0000", 2024-04-26T12:05:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007513774 2024-04-26T12:05:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788307+0000", 2024-04-26T12:05:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014374400000000001 2024-04-26T12:05:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797137+0000", 2024-04-26T12:05:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088302160000000001 2024-04-26T12:05:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.744400146, 2024-04-26T12:05:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012911448000000001, 2024-04-26T12:05:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783477+0000", 2024-04-26T12:05:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783482+0000", 2024-04-26T12:05:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5709999999999999e-06 2024-04-26T12:05:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783491+0000", 2024-04-26T12:05:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3610000000000007e-06 2024-04-26T12:05:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783498+0000", 2024-04-26T12:05:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4209999999999998e-06 2024-04-26T12:05:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786045+0000", 2024-04-26T12:05:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0025465739999999998 2024-04-26T12:05:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786061+0000", 2024-04-26T12:05:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6348999999999999e-05 2024-04-26T12:05:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796342+0000", 2024-04-26T12:05:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010280643000000001 2024-04-26T12:05:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796389+0000", 2024-04-26T12:05:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6912000000000001e-05 2024-04-26T12:05:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.744371839999999, 2024-04-26T12:05:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013376469, 2024-04-26T12:05:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783516+0000", 2024-04-26T12:05:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.041e-05 2024-04-26T12:05:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783523+0000", 2024-04-26T12:05:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5749999999999997e-06 2024-04-26T12:05:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783528+0000", 2024-04-26T12:05:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5029999999999997e-06 2024-04-26T12:05:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787662+0000", 2024-04-26T12:05:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041336230000000003 2024-04-26T12:05:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787687+0000", 2024-04-26T12:05:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5769999999999999e-05 2024-04-26T12:05:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796817+0000", 2024-04-26T12:05:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091296750000000003 2024-04-26T12:05:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796882+0000", 2024-04-26T12:05:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5180999999999998e-05 2024-04-26T12:05:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.744303298999998, 2024-04-26T12:05:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013457291999999999, 2024-04-26T12:05:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783578+0000", 2024-04-26T12:05:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.659e-06 2024-04-26T12:05:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783584+0000", 2024-04-26T12:05:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783588+0000", 2024-04-26T12:05:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6190000000000002e-06 2024-04-26T12:05:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787834+0000", 2024-04-26T12:05:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042460529999999996 2024-04-26T12:05:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787854+0000", 2024-04-26T12:05:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9658999999999999e-05 2024-04-26T12:05:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009107604 2024-04-26T12:05:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797032+0000", 2024-04-26T12:05:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9987000000000006e-05 2024-04-26T12:05:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.742456919999999, 2024-04-26T12:05:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011003015999999999, 2024-04-26T12:05:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785420+0000", 2024-04-26T12:05:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785427+0000", 2024-04-26T12:05:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:05:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785438+0000", 2024-04-26T12:05:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069e-05 2024-04-26T12:05:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785457+0000", 2024-04-26T12:05:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8617000000000001e-05 2024-04-26T12:05:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786628+0000", 2024-04-26T12:05:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001171418 2024-04-26T12:05:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786651+0000", 2024-04-26T12:05:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3289e-05 2024-04-26T12:05:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796393+0000", 2024-04-26T12:05:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097413269999999993 2024-04-26T12:05:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796424+0000", 2024-04-26T12:05:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1188e-05 2024-04-26T12:05:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.741910174000001, 2024-04-26T12:05:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010561432000000001, 2024-04-26T12:05:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785973+0000", 2024-04-26T12:05:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4910000000000002e-06 2024-04-26T12:05:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785991+0000", 2024-04-26T12:05:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7663e-05 2024-04-26T12:05:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785998+0000", 2024-04-26T12:05:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1239999999999999e-06 2024-04-26T12:05:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786792+0000", 2024-04-26T12:05:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079334800000000003 2024-04-26T12:05:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786810+0000", 2024-04-26T12:05:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8746999999999999e-05 2024-04-26T12:05:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796500+0000", 2024-04-26T12:05:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096897619999999993 2024-04-26T12:05:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796529+0000", 2024-04-26T12:05:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8873999999999998e-05 2024-04-26T12:05:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.603 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:31.603 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:31.603 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.741831088000001, 2024-04-26T12:05:31.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010219911, 2024-04-26T12:05:31.603 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:31.603 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:31.603 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:31.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:31.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:31.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786046+0000", 2024-04-26T12:05:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786053+0000", 2024-04-26T12:05:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0360000000000001e-06 2024-04-26T12:05:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786064+0000", 2024-04-26T12:05:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1202999999999999e-05 2024-04-26T12:05:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786091+0000", 2024-04-26T12:05:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6859000000000002e-05 2024-04-26T12:05:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786212+0000", 2024-04-26T12:05:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120975 2024-04-26T12:05:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786236+0000", 2024-04-26T12:05:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4358999999999998e-05 2024-04-26T12:05:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796236+0000", 2024-04-26T12:05:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099998050000000005 2024-04-26T12:05:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796266+0000", 2024-04-26T12:05:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0278e-05 2024-04-26T12:05:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:3 3.14 e17/15 3:287034c4:::1.00000000.inode:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.741042127, 2024-04-26T12:05:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009764712, 2024-04-26T12:05:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:31.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:31.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:31.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786835+0000", 2024-04-26T12:05:31.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T12:05:31.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:31.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786844+0000", 2024-04-26T12:05:31.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6500000000000008e-06 2024-04-26T12:05:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786855+0000", 2024-04-26T12:05:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0932e-05 2024-04-26T12:05:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786864+0000", 2024-04-26T12:05:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2150000000000007e-06 2024-04-26T12:05:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787242+0000", 2024-04-26T12:05:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037708300000000001 2024-04-26T12:05:31.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:31.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787259+0000", 2024-04-26T12:05:31.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7258999999999999e-05 2024-04-26T12:05:31.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:31.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796579+0000", 2024-04-26T12:05:31.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093201099999999995 2024-04-26T12:05:31.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:31.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796600+0000", 2024-04-26T12:05:31.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1330000000000001e-05 2024-04-26T12:05:31.611 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.611 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:31.611 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.611 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:31.611 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:31.611 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.740998104999999, 2024-04-26T12:05:31.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096431940000000008, 2024-04-26T12:05:31.611 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:31.611 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:31.611 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:31.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:31.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:31.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:31.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:31.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:31.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786879+0000", 2024-04-26T12:05:31.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:31.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:31.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786887+0000", 2024-04-26T12:05:31.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9300000000000003e-06 2024-04-26T12:05:31.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:31.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786894+0000", 2024-04-26T12:05:31.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:05:31.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:31.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786899+0000", 2024-04-26T12:05:31.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8400000000000002e-06 2024-04-26T12:05:31.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786932+0000", 2024-04-26T12:05:31.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3031999999999998e-05 2024-04-26T12:05:31.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:31.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786945+0000", 2024-04-26T12:05:31.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3421000000000001e-05 2024-04-26T12:05:31.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:31.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796469+0000", 2024-04-26T12:05:31.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095236130000000002 2024-04-26T12:05:31.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:31.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796523+0000", 2024-04-26T12:05:31.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4089999999999999e-05 2024-04-26T12:05:31.615 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.615 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:31.615 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.615 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "pg_update_log_missing(3.14 epoch 17/15 rep_tid 169 entries 17'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:05:31.615 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:31.615 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.74093495, 2024-04-26T12:05:31.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097257639999999996, 2024-04-26T12:05:31.615 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:31.615 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-04-26T12:05:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786942+0000", 2024-04-26T12:05:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786951+0000", 2024-04-26T12:05:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:05:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786965+0000", 2024-04-26T12:05:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4268e-05 2024-04-26T12:05:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786977+0000", 2024-04-26T12:05:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1667e-05 2024-04-26T12:05:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787667+0000", 2024-04-26T12:05:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00069057400000000001 2024-04-26T12:05:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796668+0000", 2024-04-26T12:05:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090013309999999996 2024-04-26T12:05:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.740881807000001, 2024-04-26T12:05:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095908309999999993, 2024-04-26T12:05:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786995+0000", 2024-04-26T12:05:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787001+0000", 2024-04-26T12:05:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5099999999999998e-06 2024-04-26T12:05:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787009+0000", 2024-04-26T12:05:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9100000000000005e-06 2024-04-26T12:05:31.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:31.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787019+0000", 2024-04-26T12:05:31.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8109999999999997e-06 2024-04-26T12:05:31.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787136+0000", 2024-04-26T12:05:31.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011749899999999999 2024-04-26T12:05:31.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:31.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787154+0000", 2024-04-26T12:05:31.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8278999999999999e-05 2024-04-26T12:05:31.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:31.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796561+0000", 2024-04-26T12:05:31.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094064379999999996 2024-04-26T12:05:31.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:31.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796587+0000", 2024-04-26T12:05:31.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5856000000000001e-05 2024-04-26T12:05:31.622 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.622 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:31.622 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.623 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:31.623 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:31.623 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.740164750000002, 2024-04-26T12:05:31.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096460160000000003, 2024-04-26T12:05:31.623 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:31.623 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:31.623 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:31.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:31.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:31.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:31.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:31.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:31.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:31.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787712+0000", 2024-04-26T12:05:31.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:31.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:31.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787718+0000", 2024-04-26T12:05:31.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:05:31.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787727+0000", 2024-04-26T12:05:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.123e-06 2024-04-26T12:05:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787734+0000", 2024-04-26T12:05:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.391e-06 2024-04-26T12:05:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788867+0000", 2024-04-26T12:05:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001133207 2024-04-26T12:05:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:31.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788899+0000", 2024-04-26T12:05:31.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1526000000000003e-05 2024-04-26T12:05:31.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:31.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797328+0000", 2024-04-26T12:05:31.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084295389999999998 2024-04-26T12:05:31.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:31.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:31.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:31.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797359+0000", 2024-04-26T12:05:31.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0660999999999997e-05 2024-04-26T12:05:31.626 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.626 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:31.627 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.627 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:31.627 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:31.627 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:31.628 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:31.629 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:31.627+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:31.729 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:31.728+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:31.737 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:31.737 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:05:31.737 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:05:31.737 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:31.746 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:31.830 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:31.829+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:31.842 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-26T12:05:31.848 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:31.849 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:05:31.849 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:05:31.849 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:05:31.849 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:31.858 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:31.942 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:31.941+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:32.002 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:32.002 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:05:32.002 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:05:32.002 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:05:32.002 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.002 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:32.002 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:32.002 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.144788353000003, 2024-04-26T12:05:32.002 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:05:32.002 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:32.003 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.003 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:32.003 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:32.003 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:32.003 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:05:32.003 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.003 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:32.003 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.003 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:32.003 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:32.003 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.003 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.003 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.003 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:32.004 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:32.004 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.004 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.004 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.004 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:32.004 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:32.004 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.004 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.004 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.004 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:32.004 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:05:32.004 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:05:32.004 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.004 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.004 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:32.005 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:05:32.005 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:05:32.005 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.005 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.005 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.005 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:05:32.005 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:05:32.005 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.005 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.005 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:32.005 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:05:32.005 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:05:32.005 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.005 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.005 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:32.006 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:05:32.006 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:05:32.006 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.006 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.006 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:32.006 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:05:32.006 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:05:32.006 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.006 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.006 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:32.006 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:05:32.006 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:05:32.007 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.007 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.007 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.007 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:05:32.007 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:05:32.007 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.007 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.007 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:32.007 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:05:32.008 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:05:32.008 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.008 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.008 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:32.008 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:05:32.008 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:05:32.008 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.008 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:32.008 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.008 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.008 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.008 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:32.008 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:32.008 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.144682457000002, 2024-04-26T12:05:32.008 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:05:32.009 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:32.009 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.009 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:32.009 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:32.009 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:32.009 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:05:32.009 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.009 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:32.009 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.009 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:32.009 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:32.009 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.009 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.009 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.010 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:32.010 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:32.010 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.010 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.010 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.010 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:32.010 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:32.010 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.010 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.010 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.010 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:32.010 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:05:32.010 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:05:32.010 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.011 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.011 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:32.011 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:05:32.011 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:05:32.011 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.011 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.011 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.011 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:05:32.011 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:05:32.011 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.011 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.011 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:32.011 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:05:32.011 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:05:32.011 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.012 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.012 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:32.012 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:05:32.012 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:05:32.012 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.012 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.013 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:32.013 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:05:32.013 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:05:32.014 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.014 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.014 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:32.014 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:05:32.014 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:05:32.014 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.014 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.014 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.014 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:05:32.014 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:05:32.014 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.015 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.015 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:32.015 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:05:32.015 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:05:32.015 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.015 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.015 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:32.015 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:05:32.016 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:05:32.016 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.016 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:32.016 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.016 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.016 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.016 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:32.016 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:32.016 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.144667476999999, 2024-04-26T12:05:32.016 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:05:32.016 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:32.016 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.016 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:32.016 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:32.016 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:32.017 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:05:32.017 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.017 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:32.017 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.017 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:32.017 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:32.017 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.017 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.017 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.017 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:32.017 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:32.017 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.017 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.017 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.017 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:32.018 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:32.018 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.018 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.018 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.018 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:32.018 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:05:32.018 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:05:32.018 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.018 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.018 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:32.018 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:05:32.018 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:05:32.018 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.018 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:05:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:05:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:05:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:05:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:05:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:05:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.020 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:32.020 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:05:32.020 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:05:32.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.020 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.020 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:32.020 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:05:32.020 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:05:32.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.020 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.020 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.021 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:05:32.021 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:05:32.021 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.021 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.021 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:32.021 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:05:32.021 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:05:32.021 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.021 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.021 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:32.021 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:05:32.021 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:05:32.021 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.022 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:32.022 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.022 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.022 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.022 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:32.022 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:32.022 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.144623602000003, 2024-04-26T12:05:32.022 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:05:32.022 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:32.022 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.022 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:32.023 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:32.023 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:32.023 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:05:32.023 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.023 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:32.023 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.023 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:32.023 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:32.023 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.023 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.023 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.023 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:32.023 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:32.023 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.023 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:32.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:32.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:32.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:05:32.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:05:32.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:32.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:05:32.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:05:32.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:05:32.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:05:32.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:32.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:05:32.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:05:32.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:32.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:05:32.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:05:32.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:32.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:05:32.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:05:32.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:32.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:05:32.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:05:32.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:05:32.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:05:32.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:32.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:05:32.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:05:32.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:32.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:05:32.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:05:32.027 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.027 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:32.027 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.028 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:32.028 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:32.028 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.144537937999999, 2024-04-26T12:05:32.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:05:32.028 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:32.028 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.028 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:32.028 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:32.028 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:32.028 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:05:32.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.028 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:32.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:32.029 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:32.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:32.029 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:32.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:32.030 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:32.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.030 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:32.030 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:05:32.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:05:32.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.030 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:32.030 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:05:32.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:05:32.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:05:32.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:05:32.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:32.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:05:32.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:05:32.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:32.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:05:32.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:05:32.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:32.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:05:32.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:05:32.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:32.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:05:32.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:05:32.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:05:32.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:05:32.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:32.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:05:32.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:05:32.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:32.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:05:32.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:05:32.033 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.034 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:32.034 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.034 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.034 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:32.034 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.218633652000001, 2024-04-26T12:05:32.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:05:32.034 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:32.034 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.034 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:32.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:32.034 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:32.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.035 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.035 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.035 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:32.035 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:32.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.035 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.035 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.035 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:32.035 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:32.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:32.035 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.035 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.035 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:32.035 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:05:32.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:05:32.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.036 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:32.036 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:05:32.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:05:32.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.036 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.036 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:05:32.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:05:32.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.036 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:32.036 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:05:32.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:05:32.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:32.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:05:32.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:05:32.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:32.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:05:32.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:05:32.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:32.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:05:32.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:05:32.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:05:32.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:05:32.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:32.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:05:32.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:05:32.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:32.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:05:32.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:05:32.039 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.039 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:32.039 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.039 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.039 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:32.039 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.218597556999999, 2024-04-26T12:05:32.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:05:32.039 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:32.039 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.039 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:32.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.039 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:32.040 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:32.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.040 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:32.040 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:32.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.040 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:32.040 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:05:32.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:32.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.040 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:32.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:05:32.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:05:32.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:32.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:05:32.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:05:32.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:05:32.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:05:32.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:32.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:05:32.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:05:32.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:32.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:05:32.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:05:32.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:32.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:05:32.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:05:32.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:32.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:05:32.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:05:32.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:05:32.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:05:32.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:32.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:05:32.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:05:32.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:32.044 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:05:32.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:05:32.044 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.044 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:32.044 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.044 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.044 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:32.044 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.218559873, 2024-04-26T12:05:32.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:05:32.044 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:32.044 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.044 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:32.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:32.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:32.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:32.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:32.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:32.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:05:32.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.046 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:32.046 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:05:32.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:05:32.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.046 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.046 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:32.046 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:05:32.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:05:32.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.046 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:05:32.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:05:32.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:32.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:05:32.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:05:32.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:32.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:32.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:05:32.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:32.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:05:32.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:05:32.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:32.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:05:32.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:05:32.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:05:32.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:05:32.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.049 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:32.049 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:05:32.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:05:32.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.049 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:32.049 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:05:32.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:05:32.049 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.049 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:32.049 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.049 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.050 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:32.050 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.218538533, 2024-04-26T12:05:32.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:05:32.050 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:32.050 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.050 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:32.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.050 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:32.050 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:32.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.050 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.050 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:32.050 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:32.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:32.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:32.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:32.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:05:32.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:32.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:32.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:05:32.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:05:32.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:05:32.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:05:32.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:32.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:05:32.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:05:32.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:32.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:05:32.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:05:32.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:32.053 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:05:32.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:05:32.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:32.053 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:05:32.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:05:32.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.053 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:05:32.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:05:32.054 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.054 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.054 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:32.054 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:05:32.054 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:05:32.054 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.054 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.054 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:32.054 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:05:32.054 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:05:32.054 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.054 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:32.054 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.054 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.054 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.055 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.055 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:32.055 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.218516266999998, 2024-04-26T12:05:32.055 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:05:32.055 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:32.055 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.055 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:32.055 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.055 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:32.055 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:32.055 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.055 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.055 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.055 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:32.055 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:32.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.056 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.056 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:32.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:32.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.056 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.056 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:32.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:05:32.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:32.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.056 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.056 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:32.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:05:32.057 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:05:32.057 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.057 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.057 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.057 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:05:32.057 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:05:32.057 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.057 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.057 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:32.057 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:05:32.057 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:05:32.057 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.057 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.057 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:32.057 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:05:32.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:05:32.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.058 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:32.058 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:05:32.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:05:32.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.058 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:32.058 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:05:32.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:05:32.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.058 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:05:32.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:05:32.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:32.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:05:32.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:05:32.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:32.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:05:32.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:05:32.059 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.059 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:32.059 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.060 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.060 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.060 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:32.060 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.218494645, 2024-04-26T12:05:32.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:05:32.060 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:32.060 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.060 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:32.060 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.060 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:32.060 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:32.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.061 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:32.061 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:32.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.061 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:32.061 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:32.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.061 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:32.061 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:05:32.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:05:32.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.062 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:32.062 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:05:32.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:05:32.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.062 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.062 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:05:32.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:05:32.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.062 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:32.062 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:05:32.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:05:32.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:32.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:05:32.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:05:32.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:32.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:05:32.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:05:32.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:32.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:05:32.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:05:32.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:05:32.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:05:32.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:32.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:05:32.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:05:32.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:32.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:05:32.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:05:32.064 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.065 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:32.065 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.065 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.065 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:32.065 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.218468079000001, 2024-04-26T12:05:32.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:05:32.065 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:32.065 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.065 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:32.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:32.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:32.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.066 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:32.066 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:32.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.066 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:32.066 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:05:32.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.066 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:32.066 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:05:32.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:05:32.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:32.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:05:32.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:05:32.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:05:32.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:05:32.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:32.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:05:32.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:05:32.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:32.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:05:32.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:05:32.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:32.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:05:32.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:05:32.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:32.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:05:32.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:05:32.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:05:32.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:05:32.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:32.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:05:32.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:05:32.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:32.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:05:32.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:05:32.069 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.070 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:32.070 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.070 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.070 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:32.070 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.218429567000001, 2024-04-26T12:05:32.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:05:32.070 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:32.070 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.070 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:32.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.071 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:32.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:32.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.071 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:32.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:32.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.071 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:32.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:32.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:32.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:05:32.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:05:32.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:32.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:05:32.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:05:32.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:05:32.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:05:32.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.073 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:32.073 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:05:32.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:05:32.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.073 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:32.073 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:05:32.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:05:32.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.073 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:32.073 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:05:32.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:05:32.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:32.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:05:32.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:05:32.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:05:32.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:05:32.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:32.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:05:32.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:05:32.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.075 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:32.075 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:05:32.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:05:32.075 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.075 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:32.075 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.075 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.075 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:32.075 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.218401394000001, 2024-04-26T12:05:32.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:05:32.075 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:32.075 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.075 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:32.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:32.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:32.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:32.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:32.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:32.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:32.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:32.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:05:32.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:05:32.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:32.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:05:32.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:05:32.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:05:32.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:05:32.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:32.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:05:32.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:05:32.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:32.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:05:32.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:05:32.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:32.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:05:32.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:05:32.079 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.079 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:32.079 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:05:32.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:05:32.079 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.079 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.079 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:05:32.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:05:32.079 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.079 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:32.079 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:05:32.080 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:05:32.080 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.080 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:32.080 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:05:32.080 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:05:32.080 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.080 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:32.080 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.080 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.080 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.080 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:32.080 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.218366830000001, 2024-04-26T12:05:32.080 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:05:32.081 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:32.081 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.081 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:32.081 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.081 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:32.081 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:32.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.081 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.081 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:32.081 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:32.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.081 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.081 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:32.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:05:32.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.082 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.082 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.082 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:32.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:05:32.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:05:32.082 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.082 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.082 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:32.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:05:32.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:05:32.082 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.082 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.083 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.083 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:05:32.083 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:05:32.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.083 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.083 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:32.083 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:05:32.083 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:05:32.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.083 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.083 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:32.083 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:05:32.083 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:05:32.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.084 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.084 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:32.084 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:05:32.084 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:05:32.084 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.084 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.084 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:32.084 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:05:32.084 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:05:32.084 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.084 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.084 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.084 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:05:32.084 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:05:32.084 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.085 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.085 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:32.085 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:32.085 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:05:32.085 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.085 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.085 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:32.085 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:05:32.085 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:05:32.085 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.085 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:32.085 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.085 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.085 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.085 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.086 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:32.086 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.217492050000001, 2024-04-26T12:05:32.086 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:05:32.086 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:32.086 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.086 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:32.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.086 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:32.086 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:32.086 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.086 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.086 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:32.086 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:32.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.087 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.087 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.087 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:32.087 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:05:32.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:32.087 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.087 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.087 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:32.087 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:05:32.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:05:32.087 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.087 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.087 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:32.087 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:05:32.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:05:32.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:05:32.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:05:32.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:32.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:05:32.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:05:32.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:32.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:05:32.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:05:32.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:32.089 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:05:32.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:05:32.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:32.089 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:05:32.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:05:32.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.089 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:05:32.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:05:32.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.090 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.090 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:32.090 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:05:32.090 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:05:32.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.090 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.090 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:32.090 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:05:32.090 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:05:32.090 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.090 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:32.090 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.091 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.091 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.091 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.091 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:32.091 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.217453090999999, 2024-04-26T12:05:32.091 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:05:32.091 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:32.091 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.091 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:32.091 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.091 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:32.091 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:32.091 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.091 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.091 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.091 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:32.092 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:32.092 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.092 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.092 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:32.092 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:05:32.092 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.092 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.092 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:32.092 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:05:32.092 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:05:32.092 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.092 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:32.093 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:05:32.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:05:32.093 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.093 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.093 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:05:32.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:05:32.093 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.093 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:32.093 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:05:32.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:05:32.093 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.093 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:32.094 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:05:32.094 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:05:32.094 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.094 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:32.094 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:05:32.094 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:05:32.094 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.094 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:32.094 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:05:32.094 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:05:32.094 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.094 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:05:32.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:05:32.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:32.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:05:32.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:05:32.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:32.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:05:32.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:05:32.095 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.095 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:32.096 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.096 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.096 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.096 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.096 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:32.096 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.217417618999999, 2024-04-26T12:05:32.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:05:32.096 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:32.096 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.096 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:32.096 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.096 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:32.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:32.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.097 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.097 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.097 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:32.097 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:32.097 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.097 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.097 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.097 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:32.097 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:32.097 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.097 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.097 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.097 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:32.097 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:05:32.098 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:05:32.098 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.098 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.098 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:32.098 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:05:32.098 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:05:32.098 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.098 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.098 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.098 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:05:32.098 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:05:32.098 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.098 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.098 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:32.099 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:05:32.099 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:05:32.099 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.099 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.099 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:32.099 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:05:32.099 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:05:32.099 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.099 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.099 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:32.099 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:05:32.099 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:05:32.099 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.099 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.099 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:32.100 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:05:32.100 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:05:32.100 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.100 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.100 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.100 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:05:32.100 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:05:32.100 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.100 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.100 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:32.100 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:05:32.100 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:05:32.100 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.100 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.101 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:32.101 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:05:32.101 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:05:32.101 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.101 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:32.101 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.101 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.101 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.101 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.101 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:32.101 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.21733893, 2024-04-26T12:05:32.101 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:05:32.101 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:32.101 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.101 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:32.102 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.102 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:32.102 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:32.102 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.102 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.102 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.102 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:32.102 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:32.102 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.102 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.102 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.102 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:32.102 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:05:32.102 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:32.102 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.103 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.103 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:32.103 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:05:32.103 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:05:32.103 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.103 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.103 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:32.103 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:05:32.103 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:05:32.103 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.103 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.103 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.103 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:05:32.103 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:05:32.103 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.104 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.104 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:32.104 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:05:32.104 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:05:32.104 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.104 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.104 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:32.104 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:05:32.104 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:05:32.104 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.104 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.104 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:32.104 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:05:32.104 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:05:32.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.105 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:32.105 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:05:32.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:05:32.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.105 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.105 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:05:32.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:05:32.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.105 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:32.105 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:05:32.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:05:32.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.106 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.106 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:32.106 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:05:32.106 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:05:32.106 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.106 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:32.106 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.106 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.106 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.106 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.106 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:32.106 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.217188082, 2024-04-26T12:05:32.106 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:05:32.106 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:32.106 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:05:32.107 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:32.107 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.107 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:32.107 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:32.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.107 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.107 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.107 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:32.107 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:32.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:32.107 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.107 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.107 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:32.107 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:05:32.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:32.108 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:32.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:05:32.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:05:32.108 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:32.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:05:32.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:05:32.108 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:05:32.109 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:05:32.109 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.109 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.109 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:32.109 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:05:32.109 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:05:32.109 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.109 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.109 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:32.109 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:32.109 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:05:32.109 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:32.109 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:32.109 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:32.109 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:05:32.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:05:32.110 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.110 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:32.110 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.110 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:32.110 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:32.110 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:32.111 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:32.110+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:32.112 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:32.212 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:32.211+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:32.226 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:32.226 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:32.226 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:05:32.226 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:32.238 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:32.313 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:32.311+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:32.340 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:32.340 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:32.341 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:05:32.341 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:05:32.341 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:32.349 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:32.414 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:32.413+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:32.491 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:32.491 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:05:32.492 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:05:32.492 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:05:32.492 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.492 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.492 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:32.492 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 28.709497149000001, 2024-04-26T12:05:32.492 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:05:32.492 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:32.492 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.492 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:32.492 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.492 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:32.492 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:32.492 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.493 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.493 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.493 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:32.493 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:32.493 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.493 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.493 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.493 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:32.493 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:05:32.493 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:32.493 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.493 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.493 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:32.493 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:05:32.494 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:05:32.494 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.494 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.494 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:32.494 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:05:32.494 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:05:32.494 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.494 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.494 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.494 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:05:32.494 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:05:32.494 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.494 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.494 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:32.494 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:05:32.495 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:05:32.495 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.495 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.495 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:32.495 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:32.495 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:05:32.495 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.495 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.495 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:32.495 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:05:32.495 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:05:32.495 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.495 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.495 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:32.496 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:05:32.496 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:05:32.496 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.496 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.496 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.496 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:05:32.496 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:05:32.496 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.496 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.496 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:32.496 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:05:32.496 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:05:32.496 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.496 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.496 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:32.496 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:05:32.497 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:05:32.497 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.497 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:32.497 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.497 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.497 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.497 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.497 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:32.497 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 28.709441828999999, 2024-04-26T12:05:32.497 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:05:32.497 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:32.497 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.497 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:32.497 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.498 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:32.498 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:32.498 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.498 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.498 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.498 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:32.498 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:32.498 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.498 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.498 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.498 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:32.498 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:05:32.498 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:32.498 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.499 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.499 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:32.499 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:05:32.499 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:05:32.499 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.499 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.499 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:32.499 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:05:32.499 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:05:32.499 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.499 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.499 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.499 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:05:32.499 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:05:32.499 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.500 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.500 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:32.500 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:05:32.500 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:05:32.500 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.500 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.500 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:32.500 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:05:32.500 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:05:32.500 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.500 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.500 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:32.500 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:05:32.500 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:05:32.500 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.501 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.501 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:32.501 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:05:32.501 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:05:32.501 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.501 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.501 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.501 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:05:32.501 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:05:32.501 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.501 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.501 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:32.501 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:05:32.501 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:05:32.501 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.502 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.502 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:32.502 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:05:32.502 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:05:32.502 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.502 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:32.502 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.502 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.502 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.502 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.502 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:32.502 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 28.709391811, 2024-04-26T12:05:32.502 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:05:32.502 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:32.503 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.503 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:32.503 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.503 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:32.503 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:32.503 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.503 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.503 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.503 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:32.503 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:32.503 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.503 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.503 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.503 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:32.504 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:05:32.504 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.504 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.504 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.504 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:32.504 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:05:32.504 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:05:32.504 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.504 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.504 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:32.504 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:05:32.504 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:05:32.504 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.504 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.504 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.505 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:05:32.505 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:05:32.505 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.505 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.505 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:32.505 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:05:32.505 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:05:32.505 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.505 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.505 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:32.505 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:05:32.505 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:05:32.505 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.505 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.506 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:32.506 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:05:32.506 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:05:32.506 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.506 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.506 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:32.506 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:05:32.506 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:05:32.506 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.506 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.506 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.506 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:05:32.506 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:05:32.507 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.507 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.507 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:32.507 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:05:32.507 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:05:32.507 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.507 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.507 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:32.507 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:05:32.507 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:05:32.507 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.507 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:32.507 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.507 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.508 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.508 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.508 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:32.508 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 28.709357174000001, 2024-04-26T12:05:32.508 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:05:32.508 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:32.508 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.508 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:32.508 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.508 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:32.508 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:32.508 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.508 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.508 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.509 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:32.509 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:32.509 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.509 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.509 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.509 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:32.509 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:05:32.509 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.509 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.509 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.509 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:32.509 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:05:32.509 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:05:32.509 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.509 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.510 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:32.510 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:32.510 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:05:32.510 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.510 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.510 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.510 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:05:32.510 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:05:32.510 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.510 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.510 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:32.510 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:05:32.510 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:05:32.510 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.511 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.511 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:32.511 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:05:32.511 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:05:32.511 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.511 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.511 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:32.511 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:05:32.511 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:05:32.511 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.511 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.511 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.511 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:05:32.511 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:05:32.512 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.512 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.512 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:32.512 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:05:32.512 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:05:32.512 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.512 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.512 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:32.512 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:05:32.512 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:05:32.512 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.512 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.512 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:32.512 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:05:32.512 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:05:32.513 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.513 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:32.513 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.513 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.513 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.513 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:32.513 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 28.709318662000001, 2024-04-26T12:05:32.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:05:32.513 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:32.513 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.513 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:32.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.513 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:32.513 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:32.514 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.514 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.514 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:32.514 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:32.514 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.514 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.514 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:32.514 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:32.514 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:32.514 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.514 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:32.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:32.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:05:32.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.515 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:32.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:05:32.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:05:32.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.515 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:05:32.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:05:32.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.515 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:32.516 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:05:32.516 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:05:32.516 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.516 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:32.516 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:05:32.516 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:05:32.516 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.516 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:32.516 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:05:32.516 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:05:32.516 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.516 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.517 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:05:32.517 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:05:32.517 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.517 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.517 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:32.517 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:05:32.517 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:05:32.517 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.517 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.517 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:32.517 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:05:32.517 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:05:32.517 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.517 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.517 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:32.518 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:05:32.518 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:05:32.518 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.518 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:32.518 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.518 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.518 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.518 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.518 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:32.518 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 28.709288339, 2024-04-26T12:05:32.518 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:05:32.518 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:32.518 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.518 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:32.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:32.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:32.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:32.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:32.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:32.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:32.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:32.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:05:32.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:05:32.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:32.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:05:32.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:05:32.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:05:32.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:05:32.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:32.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:05:32.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:05:32.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:32.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:05:32.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:05:32.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:32.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:05:32.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:05:32.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.522 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:32.522 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:05:32.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:05:32.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.522 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.522 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:05:32.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:05:32.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.522 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:32.522 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:05:32.523 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:05:32.523 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.523 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.523 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:32.523 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:05:32.523 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:05:32.523 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.523 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:32.523 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.523 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.523 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.523 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.523 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:32.523 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 28.709261637000001, 2024-04-26T12:05:32.524 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:05:32.524 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:32.524 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:32.524 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:32.524 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.524 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:32.524 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:32.524 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.524 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.524 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.524 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:32.524 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:32.524 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.524 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.524 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.524 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:32.525 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:32.525 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.525 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.525 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:32.525 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:05:32.525 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:05:32.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.525 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.525 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:32.525 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:05:32.525 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:05:32.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.525 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:05:32.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:05:32.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:32.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:05:32.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:05:32.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:32.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:05:32.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:05:32.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.527 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:32.527 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:05:32.527 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:05:32.527 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.527 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:32.527 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.527 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.527 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.527 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.527 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:32.527 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 28.709219347000001, 2024-04-26T12:05:32.527 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:05:32.527 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:32.527 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:32.527 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:32.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:32.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:32.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:32.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:32.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:32.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:32.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.529 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:32.529 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:05:32.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:05:32.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.529 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:32.529 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:05:32.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:05:32.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.529 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.529 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:05:32.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:05:32.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.530 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:32.530 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:05:32.530 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:05:32.530 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.530 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:32.530 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:05:32.530 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:05:32.530 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.530 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:32.530 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:05:32.530 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:05:32.530 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.531 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:32.531 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.531 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.531 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:32.531 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 28.709191269000002, 2024-04-26T12:05:32.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:05:32.531 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:32.531 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:32.531 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:32.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:32.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:32.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:32.532 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:32.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:32.532 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:05:32.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:32.533 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:05:32.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:05:32.533 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.533 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.533 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:32.533 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:05:32.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:05:32.533 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.533 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.533 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:32.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:05:32.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.534 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:32.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:32.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:05:32.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.534 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:32.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:05:32.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:05:32.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.534 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:32.535 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:05:32.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:05:32.535 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.535 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:32.535 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.535 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:32.535 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:32.535 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 28.703195918999999, 2024-04-26T12:05:32.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:05:32.535 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:32.535 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.536 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:32.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:32.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:32.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:32.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:32.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:32.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:05:32.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.537 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.537 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:32.537 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:05:32.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:05:32.537 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.537 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:32.537 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:05:32.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:05:32.537 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.537 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.537 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:05:32.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:05:32.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:32.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:05:32.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:05:32.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:32.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:05:32.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:05:32.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:32.539 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:05:32.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:05:32.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.539 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:32.539 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:05:32.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:05:32.539 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.539 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:32.539 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.539 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:32.539 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:32.539 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 28.703126953000002, 2024-04-26T12:05:32.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:05:32.540 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:32.540 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.540 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:32.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.540 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:32.540 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:32.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.540 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:32.540 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:32.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:32.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:05:32.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:32.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:05:32.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:05:32.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:32.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:05:32.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:05:32.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:05:32.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:05:32.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:32.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:05:32.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:05:32.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:32.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:32.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:05:32.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:32.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:05:32.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:05:32.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:32.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:05:32.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:05:32.543 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.543 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:32.543 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.544 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:32.544 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:32.544 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 28.70263259, 2024-04-26T12:05:32.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:05:32.544 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:32.544 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.544 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:32.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.544 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:32.544 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:32.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.544 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:32.544 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:32.545 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.545 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.545 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.545 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:32.545 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:32.545 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.545 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.545 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.545 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:32.545 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:05:32.545 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:05:32.545 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.545 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.545 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:32.546 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:05:32.546 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:05:32.546 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.546 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.546 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.546 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:05:32.546 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:05:32.546 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.546 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.546 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:32.546 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:05:32.546 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:05:32.546 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.546 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:32.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:05:32.547 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:05:32.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:32.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:05:32.547 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:05:32.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:32.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:05:32.547 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:05:32.547 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.547 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:32.548 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.548 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.548 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:32.548 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:32.548 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 28.702594325, 2024-04-26T12:05:32.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:05:32.548 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:32.548 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.548 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:32.548 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.548 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:32.548 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:32.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.549 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:32.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:32.549 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.549 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:32.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:32.549 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.549 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:32.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:05:32.549 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:05:32.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.550 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.550 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:32.550 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:05:32.550 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:05:32.550 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.550 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.550 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.550 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:05:32.550 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:05:32.550 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.550 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.550 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:32.550 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:05:32.550 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:05:32.551 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.551 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.551 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:32.551 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:05:32.551 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:05:32.551 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.551 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.551 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:32.551 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:05:32.551 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:05:32.551 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.551 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.551 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:32.551 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:05:32.551 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:05:32.552 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.552 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:32.552 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.552 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.552 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.552 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:05:32.552 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:32.552 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 28.701914439999999, 2024-04-26T12:05:32.552 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:05:32.552 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:32.552 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:32.552 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:32.552 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.552 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:32.552 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:32.553 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.553 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.553 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.553 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:32.553 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:32.553 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.553 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.553 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.553 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:32.553 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:32.553 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.553 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.553 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.553 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:32.553 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:05:32.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:05:32.554 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.554 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.554 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:32.554 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:05:32.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:05:32.554 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.554 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.554 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.554 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:05:32.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:05:32.554 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.554 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.554 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:32.554 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:05:32.555 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:05:32.555 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.555 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:32.555 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:05:32.555 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:05:32.555 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.555 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:32.555 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.555 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.555 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:32.555 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:32.555 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 28.701885261000001, 2024-04-26T12:05:32.555 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:05:32.556 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:32.556 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:32.556 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:32.556 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.556 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:32.556 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:32.556 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.556 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.556 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:32.556 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:32.556 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.557 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.557 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:32.557 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:05:32.557 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.557 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.557 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.557 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:32.557 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:05:32.557 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:05:32.557 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.557 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.557 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:32.557 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:05:32.558 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:05:32.558 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.558 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.558 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.558 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:05:32.558 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:05:32.558 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.558 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.558 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:32.558 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:05:32.558 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:05:32.558 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.558 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.558 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:32.559 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:05:32.559 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:05:32.559 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.559 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.559 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:32.559 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:05:32.559 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:05:32.559 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.559 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:32.559 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.559 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.559 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.559 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:32.559 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:32.560 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 28.701853450000002, 2024-04-26T12:05:32.560 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:05:32.560 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:32.560 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:32.560 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:32.560 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.560 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:32.560 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:32.560 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.560 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.560 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.560 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:32.560 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:32.560 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.561 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.561 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.561 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:32.561 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:32.561 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:05:32.561 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.561 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.561 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:32.561 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:05:32.561 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:05:32.561 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.561 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.561 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:32.561 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:05:32.561 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:05:32.562 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.562 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.562 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.562 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:05:32.562 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:05:32.562 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.562 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.562 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:32.562 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:05:32.562 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:05:32.562 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.562 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.562 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:32.562 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:05:32.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:05:32.563 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.563 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.563 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:32.563 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:05:32.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:05:32.563 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.563 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:32.563 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.563 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.563 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.563 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:32.563 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:32.563 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 28.701832094, 2024-04-26T12:05:32.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:05:32.564 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:32.564 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:32.564 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:32.564 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.564 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:32.564 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:32.564 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.564 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.564 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.564 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:32.564 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:32.564 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.564 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.564 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.564 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:32.565 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:32.565 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:05:32.565 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.565 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.565 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:32.565 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:05:32.565 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:05:32.565 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.565 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.565 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:32.565 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:05:32.565 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:05:32.565 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.565 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.565 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.566 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:05:32.566 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:05:32.566 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.566 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.566 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:32.566 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:05:32.566 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:05:32.566 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.566 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.566 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:32.566 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:05:32.566 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:05:32.566 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.566 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.567 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:32.567 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:05:32.567 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:05:32.567 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.567 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:32.567 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.567 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.567 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.567 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:05:32.567 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:32.567 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 28.701803641000001, 2024-04-26T12:05:32.567 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:05:32.567 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:32.567 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:32.567 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:32.568 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.568 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:32.568 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:32.568 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.568 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.568 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.568 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:32.568 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:32.568 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.568 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.568 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.568 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:32.568 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:32.568 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.568 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.569 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.569 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:32.569 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:05:32.569 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:05:32.569 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.569 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.569 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:32.569 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:05:32.569 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:05:32.569 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.569 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.569 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.569 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:05:32.569 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:05:32.570 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.570 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.570 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:32.570 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:05:32.570 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:05:32.570 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.570 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.570 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:32.570 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:05:32.570 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:05:32.570 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.570 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:32.570 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.570 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.570 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.571 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:05:32.571 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:32.571 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 28.701081835, 2024-04-26T12:05:32.571 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:05:32.571 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:32.571 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:32.571 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:32.571 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.571 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:32.571 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:32.571 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.571 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.571 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.571 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:32.571 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:32.572 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.572 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.572 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.572 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:32.572 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:05:32.572 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:32.572 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.572 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.572 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:32.572 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:05:32.572 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:05:32.572 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.572 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.572 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:32.573 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:05:32.573 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:05:32.573 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.573 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.573 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.573 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:05:32.573 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:05:32.573 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.573 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.573 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:32.573 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:05:32.573 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:05:32.573 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.573 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.573 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:32.574 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:05:32.574 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:05:32.574 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.574 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:32.574 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.574 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.574 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:05:32.574 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:32.574 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.984155231999999, 2024-04-26T12:05:32.574 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:05:32.574 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:32.574 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.574 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:32.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.575 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:32.575 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:32.575 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.575 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.575 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.575 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:32.575 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:32.575 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:32.575 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.575 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.575 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:32.575 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:05:32.575 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:05:32.575 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.575 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.576 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:32.576 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:05:32.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:05:32.576 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.576 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.576 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:32.576 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:05:32.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:05:32.576 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.576 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.576 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.576 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:05:32.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:05:32.576 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.576 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.577 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:32.577 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:05:32.577 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:05:32.577 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.577 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.577 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:32.577 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:05:32.577 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:05:32.577 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.577 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.577 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:32.577 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:05:32.577 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:05:32.577 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.577 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:05:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:05:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:05:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:05:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:05:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:05:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:32.579 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:32.579 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:32.579 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:05:32.579 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:05:32.579 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.579 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:32.579 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.579 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:32.579 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:32.579 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:32.581 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:32.581 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:32.579+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:32.682 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:32.681+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:32.693 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:32.694 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:05:32.694 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-04-26T12:05:32.694 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:32.703 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:32.783 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:32.782+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:32.806 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:32.806 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:05:32.806 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T12:05:32.806 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T12:05:32.807 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:32.815 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:32.885 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:32.883+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:32.959 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:32.959 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T12:05:32.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T12:05:32.959 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T12:05:32.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.959 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.176854517999999, 2024-04-26T12:05:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017255857999999999, 2024-04-26T12:05:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780340+0000", 2024-04-26T12:05:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780351+0000", 2024-04-26T12:05:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0898e-05 2024-04-26T12:05:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1671999999999999e-05 2024-04-26T12:05:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780374+0000", 2024-04-26T12:05:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1117999999999999e-05 2024-04-26T12:05:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780423+0000", 2024-04-26T12:05:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9066000000000001e-05 2024-04-26T12:05:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780428+0000", 2024-04-26T12:05:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1320000000000002e-06 2024-04-26T12:05:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788902+0000", 2024-04-26T12:05:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084738560000000001 2024-04-26T12:05:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789167+0000", 2024-04-26T12:05:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026521100000000001 2024-04-26T12:05:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789279+0000", 2024-04-26T12:05:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111616 2024-04-26T12:05:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792335+0000", 2024-04-26T12:05:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030556419999999999 2024-04-26T12:05:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797519+0000", 2024-04-26T12:05:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051841550000000002 2024-04-26T12:05:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797559+0000", 2024-04-26T12:05:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0451999999999998e-05 2024-04-26T12:05:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797598+0000", 2024-04-26T12:05:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8500000000000001e-05 2024-04-26T12:05:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:32.966 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:32.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.966 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.966 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:32.966 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.176806210999999, 2024-04-26T12:05:32.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017668725, 2024-04-26T12:05:32.966 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:32.967 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.967 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:32.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:32.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:32.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:32.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:32.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:32.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780395+0000", 2024-04-26T12:05:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.198e-06 2024-04-26T12:05:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780402+0000", 2024-04-26T12:05:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:05:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780408+0000", 2024-04-26T12:05:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780481+0000", 2024-04-26T12:05:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3239999999999997e-05 2024-04-26T12:05:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780485+0000", 2024-04-26T12:05:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4039999999999999e-06 2024-04-26T12:05:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789518+0000", 2024-04-26T12:05:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090335480000000006 2024-04-26T12:05:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789585+0000", 2024-04-26T12:05:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6469000000000003e-05 2024-04-26T12:05:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789699+0000", 2024-04-26T12:05:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114613 2024-04-26T12:05:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793308+0000", 2024-04-26T12:05:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036088520000000001 2024-04-26T12:05:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797887+0000", 2024-04-26T12:05:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0045792790000000003 2024-04-26T12:05:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797955+0000", 2024-04-26T12:05:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T12:05:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798059+0000", 2024-04-26T12:05:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103874 2024-04-26T12:05:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.176775938999999, 2024-04-26T12:05:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017735145000000001, 2024-04-26T12:05:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:32.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:32.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:32.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:32.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:32.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780424+0000", 2024-04-26T12:05:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4519999999999999e-06 2024-04-26T12:05:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780431+0000", 2024-04-26T12:05:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0690000000000004e-06 2024-04-26T12:05:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780438+0000", 2024-04-26T12:05:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5719999999999999e-06 2024-04-26T12:05:32.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:32.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780468+0000", 2024-04-26T12:05:32.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.993e-05 2024-04-26T12:05:32.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:32.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780472+0000", 2024-04-26T12:05:32.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-04-26T12:05:32.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:32.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789916+0000", 2024-04-26T12:05:32.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094434940000000002 2024-04-26T12:05:32.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:32.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790004+0000", 2024-04-26T12:05:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8085999999999997e-05 2024-04-26T12:05:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790125+0000", 2024-04-26T12:05:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012186200000000001 2024-04-26T12:05:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793402+0000", 2024-04-26T12:05:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00327685 2024-04-26T12:05:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798068+0000", 2024-04-26T12:05:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046652150000000003 2024-04-26T12:05:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798108+0000", 2024-04-26T12:05:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0911000000000002e-05 2024-04-26T12:05:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:32.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798156+0000", 2024-04-26T12:05:32.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7128e-05 2024-04-26T12:05:32.980 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:32.980 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:32.980 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:32.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.980 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.980 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:32.980 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.176752919999998, 2024-04-26T12:05:32.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017792624, 2024-04-26T12:05:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:32.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:32.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:32.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780447+0000", 2024-04-26T12:05:32.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8519999999999997e-06 2024-04-26T12:05:32.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780453+0000", 2024-04-26T12:05:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2999999999999998e-06 2024-04-26T12:05:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0760000000000002e-06 2024-04-26T12:05:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:32.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780502+0000", 2024-04-26T12:05:32.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4079999999999998e-05 2024-04-26T12:05:32.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:32.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:32.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5450000000000002e-06 2024-04-26T12:05:32.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:32.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790390+0000", 2024-04-26T12:05:32.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098850759999999996 2024-04-26T12:05:32.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:32.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790447+0000", 2024-04-26T12:05:32.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6752999999999997e-05 2024-04-26T12:05:32.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790547+0000", 2024-04-26T12:05:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100344 2024-04-26T12:05:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793864+0000", 2024-04-26T12:05:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033169749999999998 2024-04-26T12:05:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798164+0000", 2024-04-26T12:05:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043000690000000001 2024-04-26T12:05:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798204+0000", 2024-04-26T12:05:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9478999999999999e-05 2024-04-26T12:05:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798236+0000", 2024-04-26T12:05:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2478999999999999e-05 2024-04-26T12:05:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.176712577, 2024-04-26T12:05:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016989500000000001, 2024-04-26T12:05:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780483+0000", 2024-04-26T12:05:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780488+0000", 2024-04-26T12:05:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6260000000000003e-06 2024-04-26T12:05:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780499+0000", 2024-04-26T12:05:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1236000000000001e-05 2024-04-26T12:05:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4569999999999996e-06 2024-04-26T12:05:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780529+0000", 2024-04-26T12:05:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4579e-05 2024-04-26T12:05:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780532+0000", 2024-04-26T12:05:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.74e-06 2024-04-26T12:05:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788868+0000", 2024-04-26T12:05:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0083357650000000002 2024-04-26T12:05:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789142+0000", 2024-04-26T12:05:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027472 2024-04-26T12:05:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789241+0000", 2024-04-26T12:05:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8394999999999996e-05 2024-04-26T12:05:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792096+0000", 2024-04-26T12:05:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002855677 2024-04-26T12:05:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797379+0000", 2024-04-26T12:05:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052822379999999999 2024-04-26T12:05:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797433+0000", 2024-04-26T12:05:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4109e-05 2024-04-26T12:05:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797473+0000", 2024-04-26T12:05:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0533e-05 2024-04-26T12:05:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.176672963000001, 2024-04-26T12:05:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017295965, 2024-04-26T12:05:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:32.995 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:32.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:32.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:32.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:32.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:32.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:32.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:32.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780513+0000", 2024-04-26T12:05:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999895 2024-04-26T12:05:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780528+0000", 2024-04-26T12:05:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5089000000000001e-05 2024-04-26T12:05:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780537+0000", 2024-04-26T12:05:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8400000000000001e-06 2024-04-26T12:05:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780544+0000", 2024-04-26T12:05:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.917e-06 2024-04-26T12:05:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780571+0000", 2024-04-26T12:05:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7032000000000001e-05 2024-04-26T12:05:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780574+0000", 2024-04-26T12:05:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:05:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789436+0000", 2024-04-26T12:05:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088622240000000001 2024-04-26T12:05:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789525+0000", 2024-04-26T12:05:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8549999999999998e-05 2024-04-26T12:05:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789642+0000", 2024-04-26T12:05:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011772100000000001 2024-04-26T12:05:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792129+0000", 2024-04-26T12:05:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024871709999999998 2024-04-26T12:05:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797732+0000", 2024-04-26T12:05:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056027580000000002 2024-04-26T12:05:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797777+0000", 2024-04-26T12:05:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4620999999999999e-05 2024-04-26T12:05:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797819+0000", 2024-04-26T12:05:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2536000000000001e-05 2024-04-26T12:05:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.176644013000001, 2024-04-26T12:05:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017840163999999999, 2024-04-26T12:05:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5419999999999999e-06 2024-04-26T12:05:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780563+0000", 2024-04-26T12:05:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:05:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780569+0000", 2024-04-26T12:05:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1479999999999997e-06 2024-04-26T12:05:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780594+0000", 2024-04-26T12:05:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5585e-05 2024-04-26T12:05:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780596+0000", 2024-04-26T12:05:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2630000000000002e-06 2024-04-26T12:05:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789932+0000", 2024-04-26T12:05:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093360479999999996 2024-04-26T12:05:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790070+0000", 2024-04-26T12:05:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013771399999999999 2024-04-26T12:05:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790219+0000", 2024-04-26T12:05:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014872299999999999 2024-04-26T12:05:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793632+0000", 2024-04-26T12:05:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003413368 2024-04-26T12:05:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798244+0000", 2024-04-26T12:05:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046113819999999998 2024-04-26T12:05:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798361+0000", 2024-04-26T12:05:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117726 2024-04-26T12:05:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798393+0000", 2024-04-26T12:05:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1099999999999997e-05 2024-04-26T12:05:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.176619087999999, 2024-04-26T12:05:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016645943, 2024-04-26T12:05:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780580+0000", 2024-04-26T12:05:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1549999999999999e-06 2024-04-26T12:05:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780588+0000", 2024-04-26T12:05:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:05:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780593+0000", 2024-04-26T12:05:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2399999999999998e-06 2024-04-26T12:05:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780628+0000", 2024-04-26T12:05:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5426000000000003e-05 2024-04-26T12:05:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780632+0000", 2024-04-26T12:05:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:05:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788288+0000", 2024-04-26T12:05:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076555879999999996 2024-04-26T12:05:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788570+0000", 2024-04-26T12:05:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028233700000000002 2024-04-26T12:05:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797223+0000", 2024-04-26T12:05:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086529150000000006 2024-04-26T12:05:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.176595119000002, 2024-04-26T12:05:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016536068000000001, 2024-04-26T12:05:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780609+0000", 2024-04-26T12:05:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8280000000000003e-06 2024-04-26T12:05:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780616+0000", 2024-04-26T12:05:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4939999999999997e-06 2024-04-26T12:05:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780621+0000", 2024-04-26T12:05:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6040000000000003e-06 2024-04-26T12:05:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780647+0000", 2024-04-26T12:05:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6441999999999999e-05 2024-04-26T12:05:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780650+0000", 2024-04-26T12:05:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4430000000000002e-06 2024-04-26T12:05:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788163+0000", 2024-04-26T12:05:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007513774 2024-04-26T12:05:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788307+0000", 2024-04-26T12:05:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014374400000000001 2024-04-26T12:05:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797137+0000", 2024-04-26T12:05:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088302160000000001 2024-04-26T12:05:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.173718847, 2024-04-26T12:05:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012911448000000001, 2024-04-26T12:05:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783477+0000", 2024-04-26T12:05:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783482+0000", 2024-04-26T12:05:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5709999999999999e-06 2024-04-26T12:05:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783491+0000", 2024-04-26T12:05:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3610000000000007e-06 2024-04-26T12:05:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783498+0000", 2024-04-26T12:05:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4209999999999998e-06 2024-04-26T12:05:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786045+0000", 2024-04-26T12:05:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0025465739999999998 2024-04-26T12:05:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786061+0000", 2024-04-26T12:05:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6348999999999999e-05 2024-04-26T12:05:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796342+0000", 2024-04-26T12:05:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010280643000000001 2024-04-26T12:05:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796389+0000", 2024-04-26T12:05:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6912000000000001e-05 2024-04-26T12:05:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.173690540999999, 2024-04-26T12:05:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013376469, 2024-04-26T12:05:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783516+0000", 2024-04-26T12:05:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.041e-05 2024-04-26T12:05:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783523+0000", 2024-04-26T12:05:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5749999999999997e-06 2024-04-26T12:05:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783528+0000", 2024-04-26T12:05:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5029999999999997e-06 2024-04-26T12:05:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787662+0000", 2024-04-26T12:05:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041336230000000003 2024-04-26T12:05:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787687+0000", 2024-04-26T12:05:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5769999999999999e-05 2024-04-26T12:05:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:33.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796817+0000", 2024-04-26T12:05:33.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091296750000000003 2024-04-26T12:05:33.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:33.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796882+0000", 2024-04-26T12:05:33.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5180999999999998e-05 2024-04-26T12:05:33.024 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.024 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:33.024 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.024 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:33.025 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:33.025 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.173622000000002, 2024-04-26T12:05:33.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013457291999999999, 2024-04-26T12:05:33.025 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:33.025 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.025 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:33.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:33.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:33.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:33.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:33.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:33.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:33.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:33.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783578+0000", 2024-04-26T12:05:33.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.659e-06 2024-04-26T12:05:33.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:33.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783584+0000", 2024-04-26T12:05:33.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:33.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783588+0000", 2024-04-26T12:05:33.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6190000000000002e-06 2024-04-26T12:05:33.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:33.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787834+0000", 2024-04-26T12:05:33.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042460529999999996 2024-04-26T12:05:33.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:33.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787854+0000", 2024-04-26T12:05:33.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9658999999999999e-05 2024-04-26T12:05:33.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:33.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:33.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009107604 2024-04-26T12:05:33.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:33.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797032+0000", 2024-04-26T12:05:33.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9987000000000006e-05 2024-04-26T12:05:33.029 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.029 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:33.029 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.029 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:33.029 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:33.029 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.171775620999998, 2024-04-26T12:05:33.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011003015999999999, 2024-04-26T12:05:33.029 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:33.029 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.029 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:33.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:33.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:33.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:33.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:33.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:33.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785420+0000", 2024-04-26T12:05:33.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:33.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785427+0000", 2024-04-26T12:05:33.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:05:33.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:33.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785438+0000", 2024-04-26T12:05:33.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069e-05 2024-04-26T12:05:33.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785457+0000", 2024-04-26T12:05:33.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8617000000000001e-05 2024-04-26T12:05:33.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:33.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786628+0000", 2024-04-26T12:05:33.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001171418 2024-04-26T12:05:33.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:33.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786651+0000", 2024-04-26T12:05:33.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3289e-05 2024-04-26T12:05:33.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:33.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796393+0000", 2024-04-26T12:05:33.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097413269999999993 2024-04-26T12:05:33.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:33.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796424+0000", 2024-04-26T12:05:33.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1188e-05 2024-04-26T12:05:33.033 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.033 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:33.033 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.033 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:33.033 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:33.033 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.171228875000001, 2024-04-26T12:05:33.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010561432000000001, 2024-04-26T12:05:33.034 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:33.034 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.034 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:33.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:33.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:33.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:33.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:33.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:33.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:33.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:33.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785973+0000", 2024-04-26T12:05:33.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4910000000000002e-06 2024-04-26T12:05:33.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:33.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785991+0000", 2024-04-26T12:05:33.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7663e-05 2024-04-26T12:05:33.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785998+0000", 2024-04-26T12:05:33.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1239999999999999e-06 2024-04-26T12:05:33.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:33.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786792+0000", 2024-04-26T12:05:33.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079334800000000003 2024-04-26T12:05:33.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:33.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786810+0000", 2024-04-26T12:05:33.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8746999999999999e-05 2024-04-26T12:05:33.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:33.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796500+0000", 2024-04-26T12:05:33.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096897619999999993 2024-04-26T12:05:33.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:33.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796529+0000", 2024-04-26T12:05:33.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8873999999999998e-05 2024-04-26T12:05:33.037 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.037 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:33.037 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.038 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:33.038 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:33.038 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.171149789000001, 2024-04-26T12:05:33.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010219911, 2024-04-26T12:05:33.038 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:33.038 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.038 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:33.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:33.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:33.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:33.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:33.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:33.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786046+0000", 2024-04-26T12:05:33.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:33.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786053+0000", 2024-04-26T12:05:33.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0360000000000001e-06 2024-04-26T12:05:33.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:33.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786064+0000", 2024-04-26T12:05:33.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1202999999999999e-05 2024-04-26T12:05:33.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786091+0000", 2024-04-26T12:05:33.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6859000000000002e-05 2024-04-26T12:05:33.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:33.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786212+0000", 2024-04-26T12:05:33.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120975 2024-04-26T12:05:33.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:33.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786236+0000", 2024-04-26T12:05:33.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4358999999999998e-05 2024-04-26T12:05:33.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:33.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796236+0000", 2024-04-26T12:05:33.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099998050000000005 2024-04-26T12:05:33.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:33.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796266+0000", 2024-04-26T12:05:33.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0278e-05 2024-04-26T12:05:33.043 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.043 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:33.043 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.044 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:3 3.14 e17/15 3:287034c4:::1.00000000.inode:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:33.044 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:33.044 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.170360828, 2024-04-26T12:05:33.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009764712, 2024-04-26T12:05:33.044 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:33.044 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.044 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:33.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:33.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:33.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:33.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:33.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:33.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786835+0000", 2024-04-26T12:05:33.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T12:05:33.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:33.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786844+0000", 2024-04-26T12:05:33.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6500000000000008e-06 2024-04-26T12:05:33.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:33.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786855+0000", 2024-04-26T12:05:33.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0932e-05 2024-04-26T12:05:33.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786864+0000", 2024-04-26T12:05:33.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2150000000000007e-06 2024-04-26T12:05:33.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:33.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787242+0000", 2024-04-26T12:05:33.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037708300000000001 2024-04-26T12:05:33.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:33.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787259+0000", 2024-04-26T12:05:33.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7258999999999999e-05 2024-04-26T12:05:33.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:33.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796579+0000", 2024-04-26T12:05:33.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093201099999999995 2024-04-26T12:05:33.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:33.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796600+0000", 2024-04-26T12:05:33.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1330000000000001e-05 2024-04-26T12:05:33.048 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.048 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:33.048 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.048 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:33.048 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:33.048 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.170316805999999, 2024-04-26T12:05:33.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096431940000000008, 2024-04-26T12:05:33.048 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:33.048 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.048 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:33.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:33.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:33.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:33.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:33.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:33.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786879+0000", 2024-04-26T12:05:33.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:33.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786887+0000", 2024-04-26T12:05:33.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9300000000000003e-06 2024-04-26T12:05:33.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:33.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786894+0000", 2024-04-26T12:05:33.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:05:33.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786899+0000", 2024-04-26T12:05:33.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8400000000000002e-06 2024-04-26T12:05:33.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:33.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786932+0000", 2024-04-26T12:05:33.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3031999999999998e-05 2024-04-26T12:05:33.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:33.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786945+0000", 2024-04-26T12:05:33.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3421000000000001e-05 2024-04-26T12:05:33.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:33.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796469+0000", 2024-04-26T12:05:33.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095236130000000002 2024-04-26T12:05:33.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:33.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796523+0000", 2024-04-26T12:05:33.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4089999999999999e-05 2024-04-26T12:05:33.052 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.052 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:33.052 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.052 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "pg_update_log_missing(3.14 epoch 17/15 rep_tid 169 entries 17'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:05:33.052 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:33.052 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.170253650999999, 2024-04-26T12:05:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097257639999999996, 2024-04-26T12:05:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-04-26T12:05:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786942+0000", 2024-04-26T12:05:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786951+0000", 2024-04-26T12:05:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:05:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786965+0000", 2024-04-26T12:05:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4268e-05 2024-04-26T12:05:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786977+0000", 2024-04-26T12:05:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1667e-05 2024-04-26T12:05:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787667+0000", 2024-04-26T12:05:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00069057400000000001 2024-04-26T12:05:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796668+0000", 2024-04-26T12:05:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090013309999999996 2024-04-26T12:05:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.170200508000001, 2024-04-26T12:05:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095908309999999993, 2024-04-26T12:05:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786995+0000", 2024-04-26T12:05:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787001+0000", 2024-04-26T12:05:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5099999999999998e-06 2024-04-26T12:05:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787009+0000", 2024-04-26T12:05:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9100000000000005e-06 2024-04-26T12:05:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787019+0000", 2024-04-26T12:05:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8109999999999997e-06 2024-04-26T12:05:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787136+0000", 2024-04-26T12:05:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011749899999999999 2024-04-26T12:05:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787154+0000", 2024-04-26T12:05:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8278999999999999e-05 2024-04-26T12:05:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796561+0000", 2024-04-26T12:05:33.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094064379999999996 2024-04-26T12:05:33.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:33.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796587+0000", 2024-04-26T12:05:33.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5856000000000001e-05 2024-04-26T12:05:33.060 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.060 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:33.060 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.169483451000001, 2024-04-26T12:05:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096460160000000003, 2024-04-26T12:05:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787712+0000", 2024-04-26T12:05:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787718+0000", 2024-04-26T12:05:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:05:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787727+0000", 2024-04-26T12:05:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.123e-06 2024-04-26T12:05:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787734+0000", 2024-04-26T12:05:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.391e-06 2024-04-26T12:05:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788867+0000", 2024-04-26T12:05:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001133207 2024-04-26T12:05:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788899+0000", 2024-04-26T12:05:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1526000000000003e-05 2024-04-26T12:05:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797328+0000", 2024-04-26T12:05:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084295389999999998 2024-04-26T12:05:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:33.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797359+0000", 2024-04-26T12:05:33.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0660999999999997e-05 2024-04-26T12:05:33.065 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.065 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:33.065 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.065 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:33.065 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:33.065 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:33.067 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:33.067 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:33.065+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:33.167 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:33.166+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:33.181 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:33.181 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:05:33.181 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:05:33.181 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:33.190 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:33.268 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:33.266+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:33.292 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:33.292 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:05:33.292 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:05:33.293 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:05:33.293 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:33.301 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:33.369 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:33.367+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:33.404 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:33.404 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:05:33.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:05:33.405 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:05:33.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.405 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:33.405 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:33.405 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 39.547397416999999, 2024-04-26T12:05:33.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:05:33.405 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:33.405 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.405 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:33.405 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:33.405 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:33.405 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:05:33.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.405 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:33.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:33.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:33.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:33.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:33.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:33.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:33.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.407 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:33.407 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:05:33.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:05:33.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.407 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:33.407 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:05:33.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:05:33.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.407 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.407 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:05:33.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:05:33.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:33.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:05:33.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:05:33.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:33.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:05:33.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:05:33.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:33.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:05:33.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:05:33.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:33.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:05:33.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:05:33.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:33.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:05:33.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:05:33.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:33.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:05:33.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:05:33.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.410 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:33.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:05:33.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:05:33.410 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.410 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:33.410 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.410 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:33.410 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:33.410 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 39.547291520999998, 2024-04-26T12:05:33.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:05:33.411 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:33.411 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.411 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:33.411 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:33.411 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:33.411 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:05:33.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.411 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:33.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:33.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:33.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:33.412 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:33.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:33.412 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:33.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:33.412 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:05:33.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:05:33.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:33.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:05:33.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:05:33.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:05:33.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:05:33.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:33.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:05:33.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:05:33.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.414 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:33.414 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:05:33.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:05:33.414 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.414 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.414 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:33.414 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:05:33.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:05:33.414 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.414 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.414 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:33.414 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:05:33.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:05:33.414 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.414 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:33.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:05:33.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:05:33.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:33.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:05:33.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:05:33.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:33.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:05:33.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:05:33.415 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.416 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:33.416 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.416 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:33.416 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:33.416 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 39.547276541000002, 2024-04-26T12:05:33.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:05:33.416 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:33.416 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.416 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:33.416 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:33.416 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:33.417 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:05:33.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.417 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:33.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:33.417 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:33.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:33.417 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:33.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:33.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:33.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:33.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:05:33.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:05:33.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:33.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:05:33.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:05:33.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:05:33.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:05:33.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:33.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:05:33.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:05:33.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:33.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:05:33.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:05:33.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:33.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:05:33.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:05:33.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:33.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:05:33.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:05:33.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:33.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:05:33.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:05:33.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:33.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:05:33.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:05:33.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:33.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:05:33.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:05:33.421 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.421 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:33.422 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.422 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:33.422 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:33.422 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 39.547232665999999, 2024-04-26T12:05:33.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:05:33.422 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:33.422 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.422 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:33.422 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:33.422 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:33.422 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:05:33.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.423 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:33.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.423 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:33.423 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:33.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.423 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.423 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:33.423 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:33.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.423 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.423 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:33.423 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:33.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:33.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:05:33.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:05:33.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:33.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:05:33.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:05:33.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:05:33.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:05:33.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:33.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:05:33.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:05:33.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:33.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:05:33.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:05:33.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:33.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:05:33.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:05:33.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.426 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:33.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:05:33.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:05:33.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.426 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:33.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:05:33.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:05:33.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.426 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:33.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:05:33.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:05:33.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.427 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.427 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:33.427 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:05:33.427 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:05:33.427 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.427 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:33.427 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.427 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.427 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.427 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:33.427 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:33.427 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 39.547147002000003, 2024-04-26T12:05:33.427 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:05:33.427 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:33.427 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.427 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:33.428 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:33.428 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:33.428 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:05:33.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.428 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:33.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:33.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:33.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:33.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:33.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:33.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:33.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:33.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:05:33.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:05:33.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:33.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:05:33.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:05:33.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.430 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.430 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:05:33.430 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:05:33.430 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.430 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.430 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:33.430 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:05:33.430 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:05:33.430 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.430 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.430 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:33.430 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:05:33.430 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:05:33.430 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.431 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.431 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:33.431 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:05:33.431 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:05:33.431 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.431 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.431 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:33.431 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:05:33.431 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:05:33.431 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.431 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.431 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:33.431 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:05:33.431 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:05:33.432 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.432 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.432 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:33.432 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:05:33.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:05:33.432 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.432 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.432 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:33.432 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:05:33.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:05:33.433 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.433 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:33.433 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.433 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.433 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.433 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:33.433 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:33.433 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.621242716000001, 2024-04-26T12:05:33.433 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:05:33.433 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:33.433 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.433 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:33.433 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.433 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:33.434 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:33.434 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.434 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.434 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.434 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:33.434 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:33.434 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.434 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.434 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.434 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:33.434 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:33.434 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:33.434 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.434 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.435 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:33.435 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:05:33.435 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:05:33.435 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.435 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.435 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:33.435 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:05:33.435 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:05:33.435 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.435 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.435 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.435 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:05:33.435 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:05:33.435 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.435 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.436 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:33.436 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:05:33.436 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:05:33.436 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.436 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.436 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:33.436 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:05:33.436 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:05:33.436 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.436 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.436 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:33.436 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:05:33.436 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:05:33.436 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.436 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.437 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:33.437 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:05:33.437 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:05:33.437 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.437 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.437 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:33.437 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:05:33.437 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:05:33.437 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.437 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.437 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:33.437 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:05:33.437 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:05:33.437 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.437 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.438 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:33.438 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:05:33.438 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:05:33.438 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.438 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:33.438 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.438 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.438 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.438 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:33.438 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:33.438 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.621206620999999, 2024-04-26T12:05:33.438 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:05:33.438 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:33.438 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.439 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:33.439 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.439 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:33.439 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:33.439 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.439 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.439 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.439 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:33.439 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:33.439 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.439 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.439 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.439 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:33.439 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:05:33.440 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:33.440 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.440 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.440 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:33.440 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:05:33.440 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:05:33.440 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.440 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.440 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:33.440 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:05:33.440 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:05:33.440 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.440 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.440 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.440 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:05:33.441 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:05:33.441 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.441 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.441 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:33.441 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:05:33.441 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:05:33.441 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.441 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.441 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:33.441 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:05:33.441 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:05:33.441 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.441 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.441 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:33.441 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:05:33.442 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:05:33.442 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.442 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.442 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:33.442 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:05:33.442 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:05:33.442 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.442 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.442 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:33.442 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:05:33.442 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:05:33.442 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.442 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.442 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:33.442 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:05:33.443 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:05:33.443 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.443 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.443 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:33.443 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:05:33.443 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:05:33.443 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.443 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:33.443 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.443 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.443 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.443 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:33.443 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:33.443 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.621168937, 2024-04-26T12:05:33.443 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:05:33.444 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:33.444 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.444 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:33.444 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.444 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:33.444 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:33.444 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.444 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.444 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.444 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:33.444 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:33.444 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.444 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.445 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.445 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:33.445 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:05:33.445 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.445 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.445 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.445 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:33.445 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:05:33.445 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:05:33.445 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.445 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.445 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:33.445 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:05:33.445 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:05:33.445 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.446 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.446 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.446 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:05:33.446 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:05:33.446 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.446 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.446 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:33.446 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:05:33.446 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:05:33.446 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.446 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.446 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:33.446 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:33.446 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:05:33.446 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.447 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.447 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:33.447 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:05:33.447 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:05:33.447 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.447 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.447 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:33.447 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:05:33.449 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:05:33.449 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.449 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.449 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:33.449 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:05:33.449 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:05:33.449 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.449 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.449 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:33.449 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:05:33.450 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:05:33.450 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.450 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.450 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:33.450 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:05:33.450 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:05:33.450 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.450 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:33.450 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.450 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.450 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.450 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:33.450 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:33.450 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.621147597, 2024-04-26T12:05:33.451 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:05:33.451 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:33.451 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.451 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:33.451 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.451 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:33.451 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:33.451 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.451 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.451 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.451 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:33.451 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:33.451 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.451 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.451 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.451 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:33.452 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:33.452 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.452 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.452 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.452 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:33.452 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:05:33.452 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:33.452 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.452 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.452 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:33.452 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:05:33.452 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:05:33.452 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.452 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.452 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.453 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:05:33.453 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:05:33.453 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.453 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.453 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:33.453 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:05:33.453 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:05:33.453 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.453 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.453 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:33.453 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:05:33.453 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:05:33.453 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.453 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.453 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:33.453 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:05:33.454 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:05:33.454 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.454 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.454 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:33.454 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:05:33.454 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:05:33.454 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.454 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.454 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:33.454 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:05:33.454 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:05:33.454 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.454 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.454 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:33.454 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:05:33.455 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:05:33.455 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.455 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.455 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:33.455 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:05:33.455 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:05:33.455 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.455 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:33.455 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.455 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.455 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.455 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:33.455 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:33.455 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.621125331000002, 2024-04-26T12:05:33.455 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:05:33.456 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:33.456 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.456 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:33.456 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.456 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:33.456 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:33.456 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.456 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.456 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.456 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:33.456 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:33.456 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.456 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.456 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.457 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:33.457 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:33.457 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.457 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.457 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.457 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:33.457 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:05:33.457 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:33.457 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.457 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.457 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:33.457 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:05:33.457 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:05:33.457 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.457 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.458 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.458 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:05:33.458 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:05:33.458 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.458 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.458 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:33.458 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:05:33.458 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:05:33.458 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.458 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.458 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:33.458 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:05:33.458 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:05:33.458 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.459 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.459 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:33.459 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:05:33.459 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:05:33.459 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.459 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.459 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:33.459 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:05:33.459 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:05:33.459 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.459 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.459 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:33.459 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:05:33.459 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:05:33.459 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.460 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.460 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:33.460 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:05:33.460 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:05:33.460 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.460 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.460 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:33.460 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:05:33.460 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:05:33.460 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.460 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:33.460 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.460 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.460 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.461 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:33.461 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:33.461 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.621103709, 2024-04-26T12:05:33.461 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:05:33.461 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:33.461 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.461 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:33.461 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.461 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:33.461 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:33.461 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.461 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.461 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.461 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:33.461 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:33.462 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.462 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.462 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.462 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:33.462 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:33.462 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.462 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.462 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.462 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:33.462 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:05:33.462 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:05:33.462 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.462 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.462 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:33.463 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:05:33.463 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:05:33.463 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.463 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.463 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.463 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:05:33.463 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:05:33.463 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.463 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.463 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:33.463 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:05:33.463 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:05:33.463 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.463 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.463 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:33.463 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:05:33.464 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:05:33.464 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.464 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.464 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:33.464 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:05:33.464 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:05:33.464 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.464 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.464 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:33.464 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:05:33.464 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:05:33.464 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.465 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.465 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:33.465 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:05:33.465 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:05:33.465 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.465 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.465 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:33.465 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:05:33.465 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:05:33.465 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.465 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.465 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:33.465 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:05:33.465 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:05:33.465 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.466 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:33.466 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.466 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.466 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.466 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:33.466 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:33.466 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.621077143000001, 2024-04-26T12:05:33.466 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:05:33.466 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:33.466 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.466 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:33.466 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.466 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:33.466 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:33.466 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.467 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.467 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.467 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:33.467 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:33.467 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.467 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.467 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.467 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:33.467 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:05:33.467 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.467 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.467 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.467 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:33.467 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:05:33.467 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:05:33.468 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.468 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.468 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:33.468 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:05:33.468 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:05:33.468 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.468 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.468 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.468 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:05:33.468 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:05:33.468 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.468 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.468 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:33.469 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:05:33.469 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:05:33.469 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.469 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.469 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:33.469 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:05:33.469 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:05:33.469 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.469 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.469 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:33.469 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:05:33.469 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:05:33.469 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.469 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.469 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:33.470 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:05:33.470 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:05:33.470 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.470 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.470 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:33.470 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:05:33.470 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:05:33.470 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.470 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.470 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:33.470 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:05:33.470 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:05:33.470 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.470 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.470 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:33.471 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:05:33.471 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:05:33.471 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.471 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:33.471 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.471 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.471 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.471 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:33.471 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:33.471 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.621038631000001, 2024-04-26T12:05:33.471 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:05:33.471 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:33.471 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.471 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:33.472 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.472 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:33.472 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:33.472 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.472 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.472 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.472 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:33.472 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:33.472 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.472 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.472 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.472 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:33.472 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:33.472 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.472 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.473 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.473 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:33.473 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:05:33.473 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:05:33.473 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.473 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.473 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:33.473 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:05:33.473 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:05:33.473 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.473 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.473 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.473 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:05:33.473 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:05:33.473 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.474 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.474 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:33.474 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:05:33.474 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:05:33.474 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.474 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.474 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:33.474 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:05:33.474 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:05:33.474 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.474 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.474 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:33.474 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:05:33.474 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:05:33.475 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.475 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.475 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:33.475 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:05:33.475 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:05:33.475 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.475 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.475 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:33.475 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:05:33.475 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:05:33.475 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.475 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.475 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:33.475 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:05:33.475 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:05:33.476 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.476 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.476 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:33.476 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:05:33.476 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:05:33.476 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.476 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:33.476 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.476 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.476 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.476 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:33.476 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:33.476 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.621010458000001, 2024-04-26T12:05:33.476 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:05:33.477 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:33.477 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.477 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:33.477 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.477 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:33.477 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:33.477 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.477 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.477 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.477 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:33.477 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:33.477 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.477 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.477 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.477 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:33.478 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:33.478 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.478 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.478 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.478 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:33.478 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:05:33.478 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:05:33.478 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.478 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.478 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:33.478 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:05:33.478 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:05:33.478 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.478 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.479 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.479 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:05:33.479 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:05:33.479 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.479 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.479 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:33.479 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:05:33.479 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:05:33.479 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.479 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.479 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:33.479 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:05:33.479 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:05:33.479 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.479 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.480 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:33.480 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:05:33.480 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:05:33.480 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.480 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.480 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:33.480 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:05:33.480 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:05:33.480 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.480 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.480 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:33.480 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:05:33.480 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:05:33.480 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.481 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.481 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:33.481 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:05:33.481 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:05:33.481 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.481 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.481 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:33.481 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:05:33.481 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:05:33.481 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.481 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:33.481 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.481 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.481 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.481 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:33.481 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:33.482 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.620975894000001, 2024-04-26T12:05:33.482 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:05:33.482 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:33.482 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.482 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:33.482 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.482 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:33.482 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:33.482 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.482 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.482 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.482 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:33.482 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:33.482 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.483 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.483 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:33.483 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:05:33.483 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.483 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.483 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:33.483 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:05:33.483 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:05:33.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.483 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.483 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:33.483 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:05:33.483 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:05:33.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.484 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.484 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.484 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:05:33.484 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:05:33.484 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.484 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.484 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:33.484 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:05:33.484 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:05:33.484 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.484 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.484 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:33.484 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:05:33.484 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:05:33.484 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.485 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.485 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:33.485 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:05:33.485 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:05:33.485 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.485 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.485 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:33.485 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:05:33.485 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:05:33.485 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.485 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.485 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:33.485 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:05:33.485 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:05:33.485 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.486 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.486 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:33.486 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:33.486 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:05:33.486 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.486 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.486 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:33.486 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:05:33.486 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:05:33.486 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.486 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:33.486 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.486 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.486 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.487 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:33.487 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:33.487 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.620101114000001, 2024-04-26T12:05:33.487 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:05:33.487 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:33.487 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.487 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:33.487 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.487 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:33.487 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:33.487 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.487 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.487 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.487 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:33.487 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:33.488 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.488 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.488 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.488 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:33.488 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:05:33.488 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:33.488 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.488 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.488 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:33.488 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:05:33.488 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:05:33.488 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.488 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.488 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:33.488 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:05:33.489 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:05:33.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.489 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.489 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.489 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:05:33.489 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:05:33.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.489 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.489 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:33.489 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:05:33.489 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:05:33.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.489 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.489 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:33.489 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:05:33.490 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:05:33.490 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.490 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.490 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:33.490 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:05:33.490 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:05:33.490 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.490 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.490 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:33.490 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:05:33.490 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:05:33.490 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.490 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.491 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:33.491 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:05:33.491 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:05:33.491 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.491 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.491 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:33.491 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:05:33.491 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:05:33.491 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.491 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.491 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:33.491 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:05:33.491 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:05:33.491 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.492 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:33.492 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.492 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.492 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.492 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:33.492 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:33.492 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.620062154999999, 2024-04-26T12:05:33.492 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:05:33.492 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:33.492 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.492 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:33.492 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.492 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:33.492 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:33.493 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.493 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.493 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.493 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:33.493 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:33.493 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.493 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.493 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.493 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:33.493 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:05:33.493 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.493 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.493 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.493 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:33.493 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:05:33.494 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:05:33.494 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.494 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.494 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:33.494 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:05:33.494 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:05:33.494 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.494 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.494 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.494 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:05:33.494 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:05:33.494 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.494 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.494 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:33.495 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:05:33.495 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:05:33.495 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.495 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.495 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:33.495 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:05:33.495 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:05:33.495 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.495 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.495 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:33.495 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:05:33.495 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:05:33.495 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.495 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.495 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:33.496 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:05:33.496 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:05:33.496 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.496 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.496 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:33.496 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:05:33.496 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:05:33.496 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.496 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.496 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:33.496 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:05:33.497 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:05:33.497 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.497 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.497 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:33.497 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:05:33.497 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:05:33.497 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.497 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:33.497 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.497 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.497 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.497 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:33.497 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:33.498 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.620026682999999, 2024-04-26T12:05:33.498 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:05:33.498 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:33.498 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.498 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:33.498 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.498 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:33.498 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:33.498 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.498 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.498 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.498 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:33.498 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:33.498 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.498 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.499 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.499 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:33.499 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:33.499 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:33.499 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.499 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.499 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:33.499 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:05:33.499 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:05:33.499 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.499 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.499 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:33.499 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:05:33.499 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:05:33.500 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.500 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.500 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.500 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:05:33.500 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:05:33.500 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.500 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.500 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:33.500 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:05:33.500 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:05:33.500 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.500 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.500 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:33.500 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:05:33.501 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:05:33.501 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.501 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.501 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:33.501 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:05:33.501 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:05:33.501 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.501 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.501 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:33.501 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:05:33.501 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:05:33.501 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.501 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.501 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:33.501 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:05:33.502 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:05:33.502 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.502 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.502 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:33.502 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:05:33.502 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:05:33.502 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.502 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.502 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:33.502 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:05:33.502 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:05:33.502 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.502 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:33.502 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.502 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.503 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.503 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:33.503 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:33.503 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.619947994, 2024-04-26T12:05:33.503 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:05:33.503 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:33.503 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:33.503 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:33.503 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.503 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:33.503 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:33.503 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.503 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.503 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.504 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:33.504 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:33.504 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.504 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.504 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.504 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:33.504 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:05:33.504 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:33.504 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.504 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.504 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:33.504 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:05:33.504 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:05:33.504 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.504 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.505 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:33.505 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:05:33.505 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:05:33.505 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.505 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.505 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.505 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:05:33.505 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:05:33.505 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.505 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.505 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:33.505 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:05:33.505 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:05:33.505 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.505 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.505 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:33.506 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:05:33.506 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:05:33.506 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.506 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.506 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:33.506 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:05:33.506 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:05:33.506 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.506 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.506 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:33.506 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:05:33.506 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:05:33.506 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.506 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.506 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:33.507 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:05:33.507 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:05:33.507 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.507 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.507 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:33.507 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:05:33.507 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:05:33.507 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.507 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.507 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:33.507 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:05:33.507 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:05:33.507 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.507 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.619797146, 2024-04-26T12:05:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:05:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:05:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:05:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:05:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:05:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:05:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:05:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:05:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:05:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:05:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:05:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:05:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:05:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:05:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:33.512 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:33.512 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:05:33.514 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:33.514 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:33.512+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:33.614 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:33.613+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:33.627 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:33.627 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:33.627 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:05:33.628 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:33.637 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:33.646 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:05:33.646 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:05:33.665 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T12:05:33.665 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:05:33.682 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:05:33.683 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:05:33.715 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:33.714+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:33.740 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:33.740 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:33.748 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:33.817 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:33.816+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:33.858 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:05:33.891 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:33.892 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:33.900 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:33.918 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:33.916+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:34.014 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:34.014 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:34.018 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:34.017+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:34.023 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:34.120 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:34.119+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:34.126 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:34.126 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:34.134 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:34.220 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:34.219+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:34.236 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:34.236 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:34.245 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:34.286 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:05:34.286 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:05:34.287 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-04-26T12:05:34.287 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T12:05:34.287 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T12:05:34.287 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-04-26T12:05:34.331 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:34.330+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:34.354 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:34.354 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:34.363 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:34.388 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:34.388 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-26T12:05:34.388 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:34.422 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:34.421+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:34.465 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:34.465 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:34.474 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:34.523 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:34.522+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:34.575 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:34.575 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:34.584 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:34.624 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:34.623+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:34.688 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:34.688 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:34.696 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:34.725 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:34.724+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:34.797 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:34.798 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:34.806 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:34.825 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:34.825+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:34.854 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-26T12:05:34.908 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:34.909 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:34.918 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:34.926 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:34.925+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:35.025 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:35.025 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:35.028 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:35.026+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:35.034 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:35.129 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:35.128+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:35.136 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:35.136 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:35.145 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:35.230 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:35.229+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:35.246 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:35.246 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:35.255 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:35.332 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:35.331+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:35.358 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:35.358 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:35.367 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:35.433 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:35.431+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:35.509 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:35.509 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:35.517 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:35.561 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:35.560+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:35.619 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:35.619 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:35.628 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:35.673 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:35.672+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:35.694 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:05:35.736 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:35.735+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:35.737 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:35.737 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:35.747 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:35.829 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:05:35.830 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:05:35.838 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:35.836+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:35.848 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T12:05:35.848 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:05:35.867 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:05:35.867 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:05:35.888 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:35.888 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:35.888 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:05:35.888 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:05:35.888 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:35.899 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:35.938 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:35.937+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:36.001 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:36.002 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:05:36.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:05:36.002 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:05:36.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.002 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:36.002 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:36.002 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 32.219387472999998, 2024-04-26T12:05:36.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:05:36.003 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:36.003 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.003 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:36.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:36.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:36.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:36.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:36.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:36.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:05:36.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:36.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:36.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:05:36.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:05:36.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.005 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:36.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:05:36.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:05:36.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.005 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.006 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:05:36.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:05:36.006 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.006 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.006 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:36.006 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:05:36.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:05:36.006 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.006 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.006 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:36.006 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:36.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:05:36.006 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.006 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.006 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:36.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:05:36.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:05:36.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:36.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:05:36.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:05:36.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:36.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:05:36.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:05:36.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.008 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:36.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:05:36.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:05:36.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.008 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:36.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:05:36.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:05:36.008 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.008 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:36.008 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.008 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:36.008 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:36.009 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 32.219332153000003, 2024-04-26T12:05:36.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:05:36.009 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:36.009 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.009 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:36.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:36.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:36.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:36.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:36.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.010 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:36.010 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:05:36.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:36.010 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.010 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:36.010 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:05:36.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:05:36.010 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.010 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:36.010 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:05:36.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:05:36.010 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.011 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.011 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:05:36.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:05:36.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.011 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:36.011 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:05:36.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:05:36.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.011 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:36.011 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:05:36.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:05:36.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.012 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:36.012 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:05:36.012 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:05:36.012 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.012 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:36.012 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:05:36.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:05:36.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.013 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:36.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:05:36.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:05:36.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.013 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:36.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:05:36.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:05:36.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:36.014 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:05:36.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:05:36.014 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.014 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:36.014 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.014 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.014 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:36.014 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:36.014 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 32.219282135, 2024-04-26T12:05:36.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:05:36.014 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:36.014 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.015 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:36.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:36.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:36.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:36.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:36.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.016 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:36.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:05:36.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.016 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:36.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:05:36.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:05:36.016 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:36.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:05:36.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:05:36.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.017 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:05:36.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:05:36.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.017 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:36.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:05:36.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:05:36.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.017 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:36.018 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:05:36.018 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:05:36.018 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.018 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.018 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:36.018 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:05:36.018 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:05:36.018 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.018 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.018 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:36.018 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:05:36.018 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:05:36.018 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.018 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.019 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:36.019 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:05:36.019 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:05:36.019 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.019 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.019 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:36.019 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:05:36.019 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:05:36.019 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.019 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.019 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:36.019 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:05:36.019 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:05:36.019 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.020 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:36.020 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.020 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.020 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.020 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:36.020 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:36.020 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 32.219247498000001, 2024-04-26T12:05:36.020 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:05:36.020 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:36.020 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.020 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:36.020 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.020 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:36.020 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:36.020 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.021 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.021 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.021 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:36.021 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:36.021 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.021 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.021 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.021 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:36.021 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:05:36.021 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.021 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.021 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.021 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:36.021 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:05:36.022 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:05:36.022 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.022 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.022 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:36.022 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:36.022 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:05:36.022 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.022 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.022 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.022 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:05:36.022 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:05:36.022 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.022 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.022 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:36.023 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:05:36.023 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:05:36.023 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.023 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.023 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:36.023 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:05:36.023 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:05:36.023 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.023 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.023 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:36.023 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:05:36.023 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:05:36.023 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.023 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.024 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:36.024 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:05:36.024 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:05:36.024 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.024 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.024 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:36.024 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:05:36.024 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:05:36.024 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.024 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.024 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:36.024 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:05:36.024 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:05:36.024 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.025 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.025 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:36.025 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:05:36.025 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:05:36.025 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.025 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:36.025 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.025 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.025 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.025 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:36.025 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:36.025 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 32.219208985999998, 2024-04-26T12:05:36.025 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:05:36.025 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:36.025 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.026 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:36.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:36.026 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:36.026 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.026 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:36.026 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:36.026 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.026 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:36.026 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:36.027 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:36.027 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.027 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.027 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:36.027 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:36.027 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:05:36.027 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.027 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.027 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:36.027 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:05:36.027 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:05:36.027 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.027 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.027 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.028 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:05:36.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:05:36.028 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.028 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.028 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:36.028 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:05:36.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:05:36.028 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.028 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.028 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:36.028 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:05:36.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:05:36.029 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.029 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.030 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:36.030 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:05:36.030 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:05:36.030 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.030 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.030 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:36.030 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:05:36.030 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:05:36.030 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.030 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.030 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:36.030 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:05:36.030 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:05:36.030 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.031 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.031 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:36.031 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:05:36.031 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:05:36.031 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.031 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.031 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:36.031 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:05:36.031 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:05:36.031 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.031 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:36.031 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.031 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.032 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.032 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:36.032 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:36.032 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 32.219178663000001, 2024-04-26T12:05:36.032 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:05:36.032 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:36.032 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.032 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:36.032 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.032 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:36.032 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:36.032 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.032 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.032 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.033 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:36.033 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:36.033 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.033 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.033 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.033 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:36.033 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:36.033 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.033 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.033 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.033 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:36.033 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:05:36.033 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:05:36.033 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.033 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.034 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:36.034 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:05:36.034 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:05:36.034 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.034 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.034 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.034 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:05:36.034 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:05:36.034 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.034 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.034 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:36.034 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:05:36.034 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:05:36.034 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.035 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.035 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:36.035 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:05:36.035 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:05:36.035 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.035 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.035 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:36.035 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:05:36.035 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:05:36.035 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.035 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.035 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:36.035 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:05:36.035 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:05:36.035 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.036 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.036 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:36.036 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:05:36.036 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:05:36.036 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.036 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.036 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:36.036 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:05:36.036 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:05:36.036 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.036 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.036 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:36.036 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:05:36.036 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:05:36.036 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.037 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:36.037 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.037 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.037 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.037 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:36.037 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:36.037 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 32.219151961000001, 2024-04-26T12:05:36.037 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:05:36.037 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:36.037 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:36.037 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:36.037 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.037 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:36.037 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:36.038 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.038 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.038 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.038 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:36.038 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:36.038 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.038 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.038 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.038 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:36.038 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:36.038 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.038 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.038 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.038 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:36.038 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:05:36.039 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:05:36.039 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.039 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.039 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:36.039 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:05:36.039 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:05:36.039 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.039 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.039 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.039 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:05:36.039 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:05:36.039 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.039 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.039 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:36.039 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:05:36.040 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:05:36.040 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.040 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.040 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:36.040 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:05:36.040 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:05:36.040 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.040 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.040 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:36.040 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:05:36.040 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:05:36.040 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.040 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:36.040 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.040 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.041 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.041 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:36.041 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:36.041 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 32.219109670999998, 2024-04-26T12:05:36.041 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:05:36.041 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:36.041 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:36.041 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:36.041 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.041 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:36.041 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:36.041 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.041 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.041 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.042 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:36.042 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:36.042 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.042 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.042 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.042 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:36.042 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:36.042 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.042 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.042 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.042 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:36.042 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:05:36.042 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:05:36.042 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.042 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.043 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:36.043 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:05:36.043 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:05:36.043 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.043 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.043 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.043 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:05:36.043 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:05:36.043 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.043 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.043 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:36.043 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:05:36.043 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:05:36.043 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.043 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.044 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:36.044 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:05:36.044 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:05:36.044 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.044 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.044 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:36.044 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:05:36.044 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:05:36.044 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.044 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:36.044 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.044 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.044 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.044 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:36.045 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:36.045 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 32.219081592999999, 2024-04-26T12:05:36.045 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:05:36.045 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:36.045 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:36.045 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:36.045 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.045 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:36.045 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:36.045 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.045 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.045 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.045 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:36.045 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:36.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.046 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.046 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.046 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:36.046 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:05:36.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.046 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.046 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.046 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:36.046 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:05:36.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:05:36.046 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.046 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.046 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:36.047 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:05:36.047 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:05:36.047 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.047 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.047 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.047 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:36.047 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:05:36.047 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.047 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.047 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:36.047 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:36.047 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:05:36.047 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.047 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.047 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:36.048 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:05:36.048 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:05:36.048 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.048 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.048 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:36.048 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:05:36.048 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:05:36.048 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.048 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:36.048 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.048 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.048 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.048 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:36.048 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:36.048 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 32.213086242999999, 2024-04-26T12:05:36.049 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:05:36.049 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:36.049 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.049 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:36.049 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.049 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:36.049 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:36.049 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.049 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.049 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.049 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:36.049 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:36.049 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.049 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.049 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.050 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:36.050 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:05:36.050 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.050 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.050 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.050 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:36.050 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:05:36.050 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:05:36.050 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.050 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.050 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:36.050 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:05:36.050 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:05:36.050 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.051 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.051 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.051 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:05:36.051 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:05:36.051 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.051 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.051 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:36.051 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:05:36.051 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:05:36.051 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.051 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.051 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:36.051 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:05:36.051 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:05:36.051 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.052 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.052 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:36.052 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:05:36.052 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:05:36.052 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.052 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.052 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:36.052 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:05:36.052 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:05:36.052 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.052 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:36.052 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.052 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.052 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.052 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:36.053 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:36.053 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 32.213017276999999, 2024-04-26T12:05:36.053 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:05:36.053 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:36.053 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.053 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:36.053 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.053 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:36.053 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:36.053 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.053 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.053 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.053 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:36.053 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:36.054 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.054 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.054 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.054 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:36.054 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:05:36.054 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.054 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.054 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.054 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:36.054 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:05:36.054 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:05:36.054 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.054 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.054 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:36.054 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:05:36.055 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:05:36.055 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.055 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.055 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.055 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:05:36.055 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:05:36.055 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.055 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.055 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:36.055 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:05:36.055 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:05:36.055 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.055 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.055 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:36.056 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:36.056 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:05:36.056 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.056 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.056 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:36.056 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:05:36.056 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:05:36.056 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.056 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.056 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:36.056 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:05:36.056 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:05:36.056 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.056 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:36.056 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.057 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.057 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.057 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:36.057 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:36.057 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 32.212522913999997, 2024-04-26T12:05:36.057 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:05:36.057 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:36.057 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.057 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:36.057 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.057 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:36.057 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:36.057 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.057 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.057 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.058 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:36.058 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:36.058 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.058 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.058 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.058 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:36.058 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:36.058 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.058 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.058 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.058 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:36.058 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:05:36.058 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:05:36.058 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.059 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.059 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:36.059 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:05:36.059 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:05:36.059 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.059 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.059 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.059 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:05:36.059 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:05:36.059 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.059 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.059 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:36.059 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:05:36.059 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:05:36.059 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.060 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.060 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:36.060 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:05:36.060 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:05:36.060 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.060 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.060 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:36.060 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:05:36.060 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:05:36.060 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.060 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.060 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:36.060 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:05:36.060 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:05:36.061 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.061 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:36.061 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.061 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.061 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.061 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:36.061 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:36.061 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 32.212484648999997, 2024-04-26T12:05:36.061 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:05:36.061 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:36.061 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.061 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:36.061 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.061 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:36.061 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:36.062 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.062 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.062 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.062 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:36.062 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:36.062 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.062 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.062 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.062 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:36.062 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:36.062 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.062 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.062 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.062 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:36.062 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:05:36.063 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:05:36.063 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.063 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.063 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:36.063 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:05:36.063 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:05:36.063 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.063 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.063 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.063 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:05:36.063 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:05:36.063 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.063 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.063 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:36.063 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:05:36.064 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:05:36.064 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.064 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.064 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:36.064 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:05:36.064 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:05:36.064 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.064 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.064 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:36.064 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:05:36.064 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:05:36.064 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.064 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.064 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:36.064 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:05:36.065 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:05:36.065 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.065 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:36.065 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.065 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.065 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.065 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:05:36.065 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:36.065 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 32.211804764, 2024-04-26T12:05:36.065 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:05:36.065 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:36.065 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:36.065 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:36.065 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.066 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:36.066 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:36.066 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.066 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.066 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.066 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:36.066 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:36.066 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.066 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.066 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.066 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:36.066 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:36.066 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.066 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.066 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.067 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:36.067 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:05:36.067 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:05:36.067 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.067 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.067 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:36.067 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:05:36.067 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:05:36.067 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.067 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.067 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.067 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:05:36.067 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:05:36.067 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.068 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.068 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:36.068 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:05:36.068 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:05:36.068 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.068 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.068 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:36.068 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:05:36.068 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:05:36.068 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.068 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:36.068 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.068 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.068 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.068 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:36.069 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:36.069 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 32.211775584999998, 2024-04-26T12:05:36.069 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:05:36.069 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:36.069 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:36.069 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:36.069 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.069 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:36.069 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:36.069 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.069 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.069 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.069 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:36.069 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:36.070 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.070 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.070 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.070 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:36.070 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:05:36.070 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.070 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.070 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.070 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:36.070 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:05:36.070 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:05:36.070 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.070 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.070 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:36.071 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:05:36.071 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:05:36.071 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.071 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.071 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.071 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:05:36.071 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:05:36.071 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.071 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.071 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:36.071 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:05:36.071 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:05:36.071 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.071 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.071 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:36.072 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:05:36.072 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:05:36.072 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.072 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.072 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:36.072 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:05:36.072 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:05:36.072 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.072 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:36.072 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.072 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.072 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.072 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:36.072 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:36.073 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 32.211743773999999, 2024-04-26T12:05:36.073 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:05:36.073 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:36.073 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:36.073 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:36.073 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.073 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:36.073 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:36.073 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.073 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.073 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.073 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:36.073 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:36.073 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.073 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.074 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.074 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:36.074 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:36.074 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:05:36.074 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.074 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.074 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:36.074 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:05:36.074 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:05:36.074 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.074 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.074 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:36.074 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:05:36.074 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:05:36.075 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.075 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.075 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.075 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:05:36.075 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:05:36.075 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.075 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.075 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:36.075 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:05:36.075 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:05:36.075 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.075 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.075 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:36.075 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:05:36.075 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:05:36.076 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.076 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.076 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:36.076 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:05:36.076 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:05:36.076 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.076 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:36.076 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.076 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.076 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.076 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:36.076 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:36.076 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 32.211722418000001, 2024-04-26T12:05:36.076 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:05:36.076 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:36.077 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:36.077 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:36.077 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.077 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:36.077 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:36.077 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.077 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.077 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.077 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:36.077 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:36.077 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.077 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.077 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.077 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:36.077 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:36.078 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:05:36.078 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.078 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.078 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:36.078 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:05:36.078 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:05:36.078 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.078 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.078 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:36.078 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:05:36.078 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:05:36.078 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.078 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.078 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.078 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:05:36.079 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:05:36.079 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.079 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.079 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:36.079 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:05:36.079 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:05:36.079 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.079 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.079 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:36.079 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:05:36.079 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:05:36.079 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.079 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.079 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:36.079 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:05:36.080 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:05:36.080 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.080 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:36.080 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.080 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.080 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.080 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:05:36.080 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:36.080 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 32.211693965000002, 2024-04-26T12:05:36.080 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:05:36.080 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:36.080 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:36.080 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:36.080 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.080 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:36.081 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:36.081 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.081 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.081 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.081 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:36.081 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:36.081 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.081 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.081 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.081 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:36.081 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:36.081 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.081 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.081 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.081 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:36.082 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:05:36.082 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:05:36.082 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.082 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.082 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:36.082 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:05:36.082 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:05:36.082 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.082 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.082 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.082 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:05:36.082 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:05:36.082 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.082 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.082 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:36.083 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:05:36.083 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:05:36.083 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.083 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.083 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:36.083 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:05:36.083 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:05:36.083 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.083 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:36.083 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.083 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.083 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.083 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:05:36.083 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:36.083 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 32.210972159000001, 2024-04-26T12:05:36.084 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:05:36.084 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:36.084 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:36.084 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:36.084 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.084 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:36.084 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:36.084 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.084 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.084 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.084 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:36.084 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:36.084 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.084 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.084 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.085 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:36.085 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:05:36.085 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:36.085 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.085 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.085 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:36.085 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:05:36.085 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:05:36.085 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.085 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.085 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:36.085 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:05:36.085 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:05:36.085 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.085 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.086 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.086 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:05:36.086 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:05:36.086 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.086 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.086 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:36.086 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:05:36.086 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:05:36.086 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.086 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.086 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:36.086 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:05:36.086 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:05:36.086 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.086 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:36.087 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.087 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.087 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.087 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:05:36.087 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:36.087 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.494045556, 2024-04-26T12:05:36.087 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:05:36.087 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:36.087 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.087 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:36.087 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.087 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:36.087 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:36.087 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.087 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.088 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.088 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:36.088 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:36.088 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:36.088 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.088 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.088 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:36.088 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:05:36.088 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:05:36.088 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.088 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.088 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:36.088 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:05:36.088 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:05:36.088 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.089 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.089 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:36.089 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:05:36.089 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:05:36.089 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.089 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.089 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.089 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:05:36.089 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:05:36.089 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.089 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.089 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:36.089 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:05:36.089 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:05:36.089 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.090 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.090 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:36.090 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:05:36.090 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:05:36.090 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.090 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.090 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:36.090 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:05:36.090 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:05:36.090 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.090 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.090 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:36.090 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:05:36.090 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:05:36.090 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.091 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.091 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:36.091 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:05:36.091 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:05:36.091 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.091 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.091 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:36.091 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:05:36.091 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:05:36.091 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:36.091 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:36.091 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:36.091 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:05:36.091 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:05:36.091 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.092 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:36.092 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.092 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:36.092 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:36.092 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:36.093 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:36.094 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:36.092+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:36.194 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:36.193+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:36.202 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:36.202 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:05:36.202 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-04-26T12:05:36.202 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:36.211 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:36.295 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:36.294+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:36.352 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:36.352 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:05:36.352 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T12:05:36.352 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T12:05:36.352 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:36.361 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:36.404 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:36.403+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:36.465 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:36.465 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T12:05:36.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T12:05:36.465 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T12:05:36.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.465 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:36.465 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:36.465 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.682184532000001, 2024-04-26T12:05:36.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017255857999999999, 2024-04-26T12:05:36.466 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:36.466 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.466 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:36.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:36.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:36.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:36.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:36.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:36.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780340+0000", 2024-04-26T12:05:36.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:36.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:36.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780351+0000", 2024-04-26T12:05:36.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0898e-05 2024-04-26T12:05:36.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:36.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:36.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1671999999999999e-05 2024-04-26T12:05:36.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780374+0000", 2024-04-26T12:05:36.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1117999999999999e-05 2024-04-26T12:05:36.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780423+0000", 2024-04-26T12:05:36.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9066000000000001e-05 2024-04-26T12:05:36.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:36.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780428+0000", 2024-04-26T12:05:36.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1320000000000002e-06 2024-04-26T12:05:36.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788902+0000", 2024-04-26T12:05:36.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084738560000000001 2024-04-26T12:05:36.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:36.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789167+0000", 2024-04-26T12:05:36.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026521100000000001 2024-04-26T12:05:36.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:36.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789279+0000", 2024-04-26T12:05:36.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111616 2024-04-26T12:05:36.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:36.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792335+0000", 2024-04-26T12:05:36.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030556419999999999 2024-04-26T12:05:36.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:36.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797519+0000", 2024-04-26T12:05:36.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051841550000000002 2024-04-26T12:05:36.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:36.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797559+0000", 2024-04-26T12:05:36.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0451999999999998e-05 2024-04-26T12:05:36.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:36.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797598+0000", 2024-04-26T12:05:36.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8500000000000001e-05 2024-04-26T12:05:36.473 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.473 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:36.473 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.473 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:36.473 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:36.473 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.682136225000001, 2024-04-26T12:05:36.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017668725, 2024-04-26T12:05:36.473 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:36.473 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.473 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:36.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:36.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:36.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:36.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:36.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:36.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:36.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:36.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780395+0000", 2024-04-26T12:05:36.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.198e-06 2024-04-26T12:05:36.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:36.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780402+0000", 2024-04-26T12:05:36.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:05:36.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780408+0000", 2024-04-26T12:05:36.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:36.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780481+0000", 2024-04-26T12:05:36.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3239999999999997e-05 2024-04-26T12:05:36.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:36.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780485+0000", 2024-04-26T12:05:36.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4039999999999999e-06 2024-04-26T12:05:36.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789518+0000", 2024-04-26T12:05:36.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090335480000000006 2024-04-26T12:05:36.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:36.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789585+0000", 2024-04-26T12:05:36.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6469000000000003e-05 2024-04-26T12:05:36.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:36.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789699+0000", 2024-04-26T12:05:36.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114613 2024-04-26T12:05:36.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:36.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793308+0000", 2024-04-26T12:05:36.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036088520000000001 2024-04-26T12:05:36.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:36.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797887+0000", 2024-04-26T12:05:36.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0045792790000000003 2024-04-26T12:05:36.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:36.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797955+0000", 2024-04-26T12:05:36.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T12:05:36.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:36.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798059+0000", 2024-04-26T12:05:36.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103874 2024-04-26T12:05:36.480 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.480 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:36.480 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.480 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:36.480 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:36.480 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.682105952999997, 2024-04-26T12:05:36.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017735145000000001, 2024-04-26T12:05:36.480 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:36.480 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.480 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:36.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:36.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:36.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:36.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:36.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:36.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:36.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:36.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780424+0000", 2024-04-26T12:05:36.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4519999999999999e-06 2024-04-26T12:05:36.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:36.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780431+0000", 2024-04-26T12:05:36.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0690000000000004e-06 2024-04-26T12:05:36.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780438+0000", 2024-04-26T12:05:36.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5719999999999999e-06 2024-04-26T12:05:36.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780468+0000", 2024-04-26T12:05:36.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.993e-05 2024-04-26T12:05:36.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:36.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780472+0000", 2024-04-26T12:05:36.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-04-26T12:05:36.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789916+0000", 2024-04-26T12:05:36.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094434940000000002 2024-04-26T12:05:36.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:36.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790004+0000", 2024-04-26T12:05:36.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8085999999999997e-05 2024-04-26T12:05:36.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:36.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790125+0000", 2024-04-26T12:05:36.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012186200000000001 2024-04-26T12:05:36.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:36.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793402+0000", 2024-04-26T12:05:36.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00327685 2024-04-26T12:05:36.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:36.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798068+0000", 2024-04-26T12:05:36.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046652150000000003 2024-04-26T12:05:36.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:36.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798108+0000", 2024-04-26T12:05:36.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0911000000000002e-05 2024-04-26T12:05:36.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:36.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798156+0000", 2024-04-26T12:05:36.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7128e-05 2024-04-26T12:05:36.490 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.490 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:36.490 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.490 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:36.490 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:36.490 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.682082934, 2024-04-26T12:05:36.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017792624, 2024-04-26T12:05:36.491 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:36.491 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.491 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:36.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:36.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:36.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:36.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:36.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:36.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:36.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:36.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780447+0000", 2024-04-26T12:05:36.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8519999999999997e-06 2024-04-26T12:05:36.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:36.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780453+0000", 2024-04-26T12:05:36.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2999999999999998e-06 2024-04-26T12:05:36.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:36.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0760000000000002e-06 2024-04-26T12:05:36.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780502+0000", 2024-04-26T12:05:36.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4079999999999998e-05 2024-04-26T12:05:36.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:36.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:36.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5450000000000002e-06 2024-04-26T12:05:36.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790390+0000", 2024-04-26T12:05:36.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098850759999999996 2024-04-26T12:05:36.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:36.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790447+0000", 2024-04-26T12:05:36.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6752999999999997e-05 2024-04-26T12:05:36.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:36.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790547+0000", 2024-04-26T12:05:36.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100344 2024-04-26T12:05:36.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:36.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793864+0000", 2024-04-26T12:05:36.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033169749999999998 2024-04-26T12:05:36.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:36.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798164+0000", 2024-04-26T12:05:36.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043000690000000001 2024-04-26T12:05:36.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:36.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798204+0000", 2024-04-26T12:05:36.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9478999999999999e-05 2024-04-26T12:05:36.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:36.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798236+0000", 2024-04-26T12:05:36.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2478999999999999e-05 2024-04-26T12:05:36.496 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.496 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:36.496 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.496 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:36.496 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:36.496 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.682042590999998, 2024-04-26T12:05:36.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016989500000000001, 2024-04-26T12:05:36.496 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:36.497 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.497 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:36.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:36.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:36.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:36.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:36.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:36.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780483+0000", 2024-04-26T12:05:36.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:36.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780488+0000", 2024-04-26T12:05:36.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6260000000000003e-06 2024-04-26T12:05:36.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:36.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780499+0000", 2024-04-26T12:05:36.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1236000000000001e-05 2024-04-26T12:05:36.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:36.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4569999999999996e-06 2024-04-26T12:05:36.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780529+0000", 2024-04-26T12:05:36.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4579e-05 2024-04-26T12:05:36.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:36.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780532+0000", 2024-04-26T12:05:36.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.74e-06 2024-04-26T12:05:36.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788868+0000", 2024-04-26T12:05:36.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0083357650000000002 2024-04-26T12:05:36.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:36.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789142+0000", 2024-04-26T12:05:36.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027472 2024-04-26T12:05:36.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:36.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789241+0000", 2024-04-26T12:05:36.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8394999999999996e-05 2024-04-26T12:05:36.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:36.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792096+0000", 2024-04-26T12:05:36.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002855677 2024-04-26T12:05:36.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:36.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797379+0000", 2024-04-26T12:05:36.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052822379999999999 2024-04-26T12:05:36.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:36.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797433+0000", 2024-04-26T12:05:36.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4109e-05 2024-04-26T12:05:36.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:36.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797473+0000", 2024-04-26T12:05:36.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0533e-05 2024-04-26T12:05:36.504 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.505 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:36.505 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.505 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:36.505 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:36.506 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.682002977000003, 2024-04-26T12:05:36.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017295965, 2024-04-26T12:05:36.506 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:36.506 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.506 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:36.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:36.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:36.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:36.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:36.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:36.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780513+0000", 2024-04-26T12:05:36.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999895 2024-04-26T12:05:36.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:36.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780528+0000", 2024-04-26T12:05:36.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5089000000000001e-05 2024-04-26T12:05:36.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:36.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780537+0000", 2024-04-26T12:05:36.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8400000000000001e-06 2024-04-26T12:05:36.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780544+0000", 2024-04-26T12:05:36.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.917e-06 2024-04-26T12:05:36.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780571+0000", 2024-04-26T12:05:36.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7032000000000001e-05 2024-04-26T12:05:36.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:36.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780574+0000", 2024-04-26T12:05:36.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:05:36.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789436+0000", 2024-04-26T12:05:36.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088622240000000001 2024-04-26T12:05:36.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789525+0000", 2024-04-26T12:05:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8549999999999998e-05 2024-04-26T12:05:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789642+0000", 2024-04-26T12:05:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011772100000000001 2024-04-26T12:05:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792129+0000", 2024-04-26T12:05:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024871709999999998 2024-04-26T12:05:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797732+0000", 2024-04-26T12:05:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056027580000000002 2024-04-26T12:05:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797777+0000", 2024-04-26T12:05:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4620999999999999e-05 2024-04-26T12:05:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797819+0000", 2024-04-26T12:05:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2536000000000001e-05 2024-04-26T12:05:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.681974027000003, 2024-04-26T12:05:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017840163999999999, 2024-04-26T12:05:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:36.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:36.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:36.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:36.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:36.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:36.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5419999999999999e-06 2024-04-26T12:05:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780563+0000", 2024-04-26T12:05:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:05:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780569+0000", 2024-04-26T12:05:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1479999999999997e-06 2024-04-26T12:05:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780594+0000", 2024-04-26T12:05:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5585e-05 2024-04-26T12:05:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780596+0000", 2024-04-26T12:05:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2630000000000002e-06 2024-04-26T12:05:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789932+0000", 2024-04-26T12:05:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093360479999999996 2024-04-26T12:05:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790070+0000", 2024-04-26T12:05:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013771399999999999 2024-04-26T12:05:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790219+0000", 2024-04-26T12:05:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014872299999999999 2024-04-26T12:05:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:36.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793632+0000", 2024-04-26T12:05:36.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003413368 2024-04-26T12:05:36.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:36.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798244+0000", 2024-04-26T12:05:36.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046113819999999998 2024-04-26T12:05:36.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:36.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798361+0000", 2024-04-26T12:05:36.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117726 2024-04-26T12:05:36.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:36.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798393+0000", 2024-04-26T12:05:36.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1099999999999997e-05 2024-04-26T12:05:36.522 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.522 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:36.522 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.681949101999997, 2024-04-26T12:05:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016645943, 2024-04-26T12:05:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:36.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:36.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:36.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:36.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:36.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780580+0000", 2024-04-26T12:05:36.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1549999999999999e-06 2024-04-26T12:05:36.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:36.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780588+0000", 2024-04-26T12:05:36.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:05:36.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780593+0000", 2024-04-26T12:05:36.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2399999999999998e-06 2024-04-26T12:05:36.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780628+0000", 2024-04-26T12:05:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5426000000000003e-05 2024-04-26T12:05:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780632+0000", 2024-04-26T12:05:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:05:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788288+0000", 2024-04-26T12:05:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076555879999999996 2024-04-26T12:05:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:36.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788570+0000", 2024-04-26T12:05:36.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028233700000000002 2024-04-26T12:05:36.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:36.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797223+0000", 2024-04-26T12:05:36.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086529150000000006 2024-04-26T12:05:36.527 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.527 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:36.527 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.527 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:36.527 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.681925133, 2024-04-26T12:05:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016536068000000001, 2024-04-26T12:05:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:36.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:36.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:36.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780609+0000", 2024-04-26T12:05:36.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8280000000000003e-06 2024-04-26T12:05:36.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:36.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780616+0000", 2024-04-26T12:05:36.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4939999999999997e-06 2024-04-26T12:05:36.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780621+0000", 2024-04-26T12:05:36.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6040000000000003e-06 2024-04-26T12:05:36.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780647+0000", 2024-04-26T12:05:36.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6441999999999999e-05 2024-04-26T12:05:36.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:36.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780650+0000", 2024-04-26T12:05:36.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4430000000000002e-06 2024-04-26T12:05:36.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788163+0000", 2024-04-26T12:05:36.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007513774 2024-04-26T12:05:36.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:36.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788307+0000", 2024-04-26T12:05:36.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014374400000000001 2024-04-26T12:05:36.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797137+0000", 2024-04-26T12:05:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088302160000000001 2024-04-26T12:05:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.679048860999998, 2024-04-26T12:05:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012911448000000001, 2024-04-26T12:05:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:36.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:36.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:36.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:36.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:36.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783477+0000", 2024-04-26T12:05:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783482+0000", 2024-04-26T12:05:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5709999999999999e-06 2024-04-26T12:05:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783491+0000", 2024-04-26T12:05:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3610000000000007e-06 2024-04-26T12:05:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783498+0000", 2024-04-26T12:05:36.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4209999999999998e-06 2024-04-26T12:05:36.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786045+0000", 2024-04-26T12:05:36.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0025465739999999998 2024-04-26T12:05:36.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:36.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786061+0000", 2024-04-26T12:05:36.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6348999999999999e-05 2024-04-26T12:05:36.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796342+0000", 2024-04-26T12:05:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010280643000000001 2024-04-26T12:05:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796389+0000", 2024-04-26T12:05:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6912000000000001e-05 2024-04-26T12:05:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:36.538 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.679020555000001, 2024-04-26T12:05:36.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013376469, 2024-04-26T12:05:36.538 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:36.538 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.538 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:36.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:36.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:36.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:36.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783516+0000", 2024-04-26T12:05:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.041e-05 2024-04-26T12:05:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783523+0000", 2024-04-26T12:05:36.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5749999999999997e-06 2024-04-26T12:05:36.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783528+0000", 2024-04-26T12:05:36.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5029999999999997e-06 2024-04-26T12:05:36.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787662+0000", 2024-04-26T12:05:36.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041336230000000003 2024-04-26T12:05:36.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:36.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787687+0000", 2024-04-26T12:05:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5769999999999999e-05 2024-04-26T12:05:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796817+0000", 2024-04-26T12:05:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091296750000000003 2024-04-26T12:05:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796882+0000", 2024-04-26T12:05:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5180999999999998e-05 2024-04-26T12:05:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.542 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:36.542 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:36.542 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.678952014000004, 2024-04-26T12:05:36.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013457291999999999, 2024-04-26T12:05:36.542 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:36.542 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.542 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:36.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:36.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:36.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:36.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:36.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:36.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:36.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783578+0000", 2024-04-26T12:05:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.659e-06 2024-04-26T12:05:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783584+0000", 2024-04-26T12:05:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783588+0000", 2024-04-26T12:05:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6190000000000002e-06 2024-04-26T12:05:36.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787834+0000", 2024-04-26T12:05:36.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042460529999999996 2024-04-26T12:05:36.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:36.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787854+0000", 2024-04-26T12:05:36.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9658999999999999e-05 2024-04-26T12:05:36.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:36.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:36.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009107604 2024-04-26T12:05:36.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:36.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797032+0000", 2024-04-26T12:05:36.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9987000000000006e-05 2024-04-26T12:05:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.677105634999997, 2024-04-26T12:05:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011003015999999999, 2024-04-26T12:05:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785420+0000", 2024-04-26T12:05:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785427+0000", 2024-04-26T12:05:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:05:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785438+0000", 2024-04-26T12:05:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069e-05 2024-04-26T12:05:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785457+0000", 2024-04-26T12:05:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8617000000000001e-05 2024-04-26T12:05:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786628+0000", 2024-04-26T12:05:36.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001171418 2024-04-26T12:05:36.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:36.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786651+0000", 2024-04-26T12:05:36.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3289e-05 2024-04-26T12:05:36.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:36.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796393+0000", 2024-04-26T12:05:36.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097413269999999993 2024-04-26T12:05:36.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796424+0000", 2024-04-26T12:05:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1188e-05 2024-04-26T12:05:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.676558888999999, 2024-04-26T12:05:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010561432000000001, 2024-04-26T12:05:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:36.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785973+0000", 2024-04-26T12:05:36.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4910000000000002e-06 2024-04-26T12:05:36.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:36.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785991+0000", 2024-04-26T12:05:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7663e-05 2024-04-26T12:05:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785998+0000", 2024-04-26T12:05:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1239999999999999e-06 2024-04-26T12:05:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786792+0000", 2024-04-26T12:05:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079334800000000003 2024-04-26T12:05:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786810+0000", 2024-04-26T12:05:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8746999999999999e-05 2024-04-26T12:05:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796500+0000", 2024-04-26T12:05:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096897619999999993 2024-04-26T12:05:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796529+0000", 2024-04-26T12:05:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8873999999999998e-05 2024-04-26T12:05:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.676479802999999, 2024-04-26T12:05:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010219911, 2024-04-26T12:05:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786046+0000", 2024-04-26T12:05:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786053+0000", 2024-04-26T12:05:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0360000000000001e-06 2024-04-26T12:05:36.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:36.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786064+0000", 2024-04-26T12:05:36.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1202999999999999e-05 2024-04-26T12:05:36.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786091+0000", 2024-04-26T12:05:36.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6859000000000002e-05 2024-04-26T12:05:36.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786212+0000", 2024-04-26T12:05:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120975 2024-04-26T12:05:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786236+0000", 2024-04-26T12:05:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4358999999999998e-05 2024-04-26T12:05:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796236+0000", 2024-04-26T12:05:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099998050000000005 2024-04-26T12:05:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796266+0000", 2024-04-26T12:05:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0278e-05 2024-04-26T12:05:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:3 3.14 e17/15 3:287034c4:::1.00000000.inode:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.675690842000002, 2024-04-26T12:05:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009764712, 2024-04-26T12:05:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786835+0000", 2024-04-26T12:05:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T12:05:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:36.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786844+0000", 2024-04-26T12:05:36.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6500000000000008e-06 2024-04-26T12:05:36.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:36.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786855+0000", 2024-04-26T12:05:36.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0932e-05 2024-04-26T12:05:36.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786864+0000", 2024-04-26T12:05:36.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2150000000000007e-06 2024-04-26T12:05:36.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787242+0000", 2024-04-26T12:05:36.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037708300000000001 2024-04-26T12:05:36.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:36.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787259+0000", 2024-04-26T12:05:36.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7258999999999999e-05 2024-04-26T12:05:36.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:36.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796579+0000", 2024-04-26T12:05:36.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093201099999999995 2024-04-26T12:05:36.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:36.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796600+0000", 2024-04-26T12:05:36.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1330000000000001e-05 2024-04-26T12:05:36.565 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.565 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.675646819999997, 2024-04-26T12:05:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096431940000000008, 2024-04-26T12:05:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786879+0000", 2024-04-26T12:05:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786887+0000", 2024-04-26T12:05:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9300000000000003e-06 2024-04-26T12:05:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786894+0000", 2024-04-26T12:05:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:05:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786899+0000", 2024-04-26T12:05:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8400000000000002e-06 2024-04-26T12:05:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786932+0000", 2024-04-26T12:05:36.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3031999999999998e-05 2024-04-26T12:05:36.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:36.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786945+0000", 2024-04-26T12:05:36.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3421000000000001e-05 2024-04-26T12:05:36.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:36.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796469+0000", 2024-04-26T12:05:36.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095236130000000002 2024-04-26T12:05:36.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:36.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796523+0000", 2024-04-26T12:05:36.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4089999999999999e-05 2024-04-26T12:05:36.570 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.570 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:36.570 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.570 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "pg_update_log_missing(3.14 epoch 17/15 rep_tid 169 entries 17'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:05:36.570 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:36.570 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.675583664999998, 2024-04-26T12:05:36.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097257639999999996, 2024-04-26T12:05:36.570 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:36.571 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-04-26T12:05:36.571 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:36.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:36.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:36.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:36.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:36.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786942+0000", 2024-04-26T12:05:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786951+0000", 2024-04-26T12:05:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:05:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786965+0000", 2024-04-26T12:05:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4268e-05 2024-04-26T12:05:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786977+0000", 2024-04-26T12:05:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1667e-05 2024-04-26T12:05:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787667+0000", 2024-04-26T12:05:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00069057400000000001 2024-04-26T12:05:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796668+0000", 2024-04-26T12:05:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090013309999999996 2024-04-26T12:05:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.574 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:36.574 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.574 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:36.574 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:36.574 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.675530522000003, 2024-04-26T12:05:36.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095908309999999993, 2024-04-26T12:05:36.574 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:36.574 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.574 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:36.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:36.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:36.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:36.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:36.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:36.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786995+0000", 2024-04-26T12:05:36.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:36.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787001+0000", 2024-04-26T12:05:36.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5099999999999998e-06 2024-04-26T12:05:36.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:36.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787009+0000", 2024-04-26T12:05:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9100000000000005e-06 2024-04-26T12:05:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787019+0000", 2024-04-26T12:05:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8109999999999997e-06 2024-04-26T12:05:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787136+0000", 2024-04-26T12:05:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011749899999999999 2024-04-26T12:05:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787154+0000", 2024-04-26T12:05:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8278999999999999e-05 2024-04-26T12:05:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796561+0000", 2024-04-26T12:05:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094064379999999996 2024-04-26T12:05:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796587+0000", 2024-04-26T12:05:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5856000000000001e-05 2024-04-26T12:05:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.579 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:36.579 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:36.579 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.674813465, 2024-04-26T12:05:36.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096460160000000003, 2024-04-26T12:05:36.579 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:36.579 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.579 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:36.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787712+0000", 2024-04-26T12:05:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:36.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787718+0000", 2024-04-26T12:05:36.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:05:36.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:36.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787727+0000", 2024-04-26T12:05:36.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.123e-06 2024-04-26T12:05:36.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787734+0000", 2024-04-26T12:05:36.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.391e-06 2024-04-26T12:05:36.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:36.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788867+0000", 2024-04-26T12:05:36.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001133207 2024-04-26T12:05:36.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:36.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788899+0000", 2024-04-26T12:05:36.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1526000000000003e-05 2024-04-26T12:05:36.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:36.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797328+0000", 2024-04-26T12:05:36.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084295389999999998 2024-04-26T12:05:36.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:36.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:36.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:36.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797359+0000", 2024-04-26T12:05:36.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0660999999999997e-05 2024-04-26T12:05:36.583 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.583 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:36.583 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.583 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:36.583 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:36.583 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:36.585 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:36.586 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:36.583+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:36.685 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:36.684+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:36.699 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:36.699 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:05:36.699 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:05:36.699 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:36.708 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:36.786 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:36.785+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:36.850 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:36.851 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:05:36.851 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:05:36.851 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:05:36.851 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:36.859 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:36.871 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:05:36.887 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:36.885+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:36.961 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:36.962 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:05:36.962 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:05:36.962 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:05:36.962 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.962 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:36.962 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:36.962 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.104719656, 2024-04-26T12:05:36.962 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:05:36.962 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:36.962 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.962 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:36.962 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:36.963 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:36.963 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:05:36.963 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.963 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:36.963 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.963 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:36.963 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:36.963 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:36.963 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.963 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.963 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:36.963 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:36.963 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:36.963 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.964 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.964 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:36.964 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:36.964 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.964 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.964 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.964 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:36.964 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:05:36.964 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:05:36.964 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.964 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.964 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:36.964 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:05:36.965 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:05:36.965 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.965 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.965 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.965 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:05:36.965 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:05:36.965 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.965 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.965 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:36.965 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:05:36.965 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:05:36.965 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.965 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.965 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:36.965 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:05:36.966 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:05:36.966 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.966 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.966 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:36.966 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:05:36.966 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:05:36.966 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.966 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.966 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:36.966 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:05:36.966 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:05:36.966 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.966 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.966 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:36.966 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:05:36.967 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:05:36.967 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.967 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.967 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:36.967 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:05:36.967 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:05:36.967 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.967 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.967 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:36.967 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:05:36.967 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:05:36.967 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:36.967 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:36.967 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:36.968 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.968 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.968 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:36.968 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:36.968 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.104613759999999, 2024-04-26T12:05:36.968 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:05:36.968 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:36.968 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.968 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:36.968 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:36.968 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:36.968 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:05:36.968 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.968 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:36.968 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.969 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:36.969 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:36.969 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:36.969 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.969 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.969 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:36.969 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:36.969 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:36.969 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.969 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.969 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:36.969 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:36.969 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.969 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.970 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.970 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:36.970 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:05:36.970 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:05:36.970 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.970 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.970 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:36.970 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:05:36.970 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:05:36.970 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.970 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.970 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.970 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:05:36.971 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:05:36.971 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.971 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.971 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:36.971 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:05:36.971 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:05:36.971 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.971 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.971 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:36.971 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:05:36.971 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:05:36.971 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.971 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.971 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:36.972 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:05:36.972 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:05:36.972 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.972 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.972 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:36.972 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:05:36.972 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:05:36.972 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.972 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.972 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:36.972 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:05:36.972 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:05:36.972 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.972 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.972 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:36.973 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:05:36.973 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:05:36.973 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.973 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.973 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:36.973 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:05:36.973 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:05:36.973 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:36.973 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:36.973 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:36.973 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.973 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.973 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:36.973 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:36.974 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.104598780000003, 2024-04-26T12:05:36.974 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:05:36.974 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:36.974 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.974 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:36.974 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:36.974 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:36.974 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:05:36.974 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.974 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:36.974 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.974 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:36.974 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:36.974 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:36.975 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.975 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.975 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:36.975 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:36.975 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:36.975 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.975 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.976 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:36.976 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:36.976 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.976 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.976 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.976 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:36.976 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:05:36.976 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:05:36.976 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.977 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.977 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:36.977 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:05:36.977 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:05:36.977 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.977 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.977 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.977 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:05:36.977 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:05:36.977 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.977 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.977 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:36.977 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:05:36.977 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:05:36.977 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.978 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.978 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:36.978 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:05:36.978 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:05:36.978 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.978 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.978 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:36.978 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:05:36.978 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:05:36.978 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.978 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.978 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:36.978 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:05:36.979 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:05:36.979 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.979 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.979 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:36.979 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:05:36.979 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:05:36.979 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.979 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.979 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:36.979 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:05:36.979 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:05:36.979 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.979 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.979 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:36.980 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:05:36.980 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:05:36.980 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:36.980 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:36.980 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:36.980 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.980 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.980 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:36.980 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:36.980 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.104554905000001, 2024-04-26T12:05:36.980 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:05:36.980 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:36.980 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.980 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:36.981 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:36.981 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:36.981 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:05:36.981 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.981 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:36.981 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.981 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:36.981 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:36.981 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:36.981 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.981 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.981 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:36.981 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:36.981 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:36.981 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.982 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.982 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:36.982 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:36.982 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.982 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.982 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.982 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:36.982 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:05:36.982 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:05:36.982 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.982 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.982 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:36.982 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:05:36.982 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:05:36.983 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.983 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.983 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.983 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:05:36.983 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:05:36.983 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.983 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.983 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:36.983 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:05:36.983 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:05:36.983 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.983 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.983 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:36.983 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:05:36.984 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:05:36.984 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.984 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.984 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:36.984 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:05:36.984 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:05:36.984 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.984 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.984 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:36.984 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:05:36.984 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:05:36.984 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.984 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.984 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:36.985 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:05:36.985 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:05:36.985 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.985 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.985 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:36.985 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:05:36.985 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:05:36.985 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.985 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.985 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:36.985 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:05:36.985 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:05:36.985 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:36.985 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:36.985 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:36.986 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.986 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.986 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:36.986 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:36.986 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.104469240999997, 2024-04-26T12:05:36.986 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:05:36.986 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:36.986 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.986 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:36.986 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:36.986 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:36.986 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:05:36.986 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.986 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:36.987 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.987 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:36.987 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:36.987 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:36.987 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.987 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.987 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:36.987 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:36.987 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:36.987 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.987 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.987 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:36.987 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:36.987 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:36.987 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.988 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.988 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:36.988 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:05:36.988 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:05:36.988 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.988 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.988 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:36.988 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:05:36.988 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:05:36.988 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.988 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.988 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.988 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:05:36.988 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:05:36.988 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.989 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.989 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:36.989 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:05:36.989 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:05:36.989 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.989 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.989 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:36.989 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:05:36.989 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:05:36.989 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.989 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.989 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:36.989 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:05:36.989 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:05:36.990 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.990 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.990 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:36.990 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:05:36.990 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:05:36.990 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.990 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.990 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:36.990 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:05:36.990 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:05:36.990 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.990 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.990 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:36.990 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:05:36.990 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:05:36.991 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.991 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.991 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:36.991 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:05:36.991 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:05:36.991 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:36.991 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:36.991 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:36.991 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.991 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.991 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:36.991 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:36.991 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.178564954999999, 2024-04-26T12:05:36.992 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:05:36.992 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:36.992 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.992 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:36.992 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.992 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:36.992 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:36.992 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:36.992 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.992 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.992 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:36.992 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:36.992 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:36.992 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.993 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.993 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:36.993 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:36.993 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:36.993 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.993 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.993 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:36.993 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:05:36.993 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:05:36.993 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.993 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.993 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:36.993 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:05:36.993 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:05:36.993 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.994 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.994 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.994 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:05:36.994 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:05:36.994 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.994 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.994 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:36.994 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:05:36.994 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:05:36.994 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.994 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.994 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:36.994 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:05:36.995 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:05:36.995 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.995 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.995 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:36.995 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:05:36.995 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:05:36.995 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.995 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.995 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:36.995 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:05:36.995 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:05:36.995 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.995 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.995 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:36.995 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:05:36.995 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:05:36.996 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.996 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.996 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:36.996 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:05:36.996 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:05:36.996 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.996 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.996 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:36.996 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:05:36.996 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:05:36.996 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:36.996 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:36.996 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:36.996 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.996 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.997 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:36.997 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:36.997 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.17852886, 2024-04-26T12:05:36.997 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:05:36.997 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:36.997 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:36.997 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:36.997 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.997 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:36.997 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:36.997 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:36.997 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.997 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.997 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:36.997 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:36.998 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:36.998 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.998 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.998 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:36.998 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:05:36.998 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:36.998 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.998 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.998 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:36.998 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:05:36.998 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:05:36.998 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.998 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.998 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:36.999 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:05:36.999 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:05:36.999 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.999 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.999 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:36.999 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:05:36.999 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:05:36.999 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.999 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.999 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:36.999 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:05:36.999 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:05:36.999 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:36.999 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:36.999 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:37.000 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:05:37.000 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:05:37.000 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.000 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.000 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:37.000 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:05:37.000 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:05:37.000 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.000 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.000 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:37.000 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:05:37.000 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:05:37.000 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.000 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.000 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.001 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:05:37.001 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:05:37.001 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.001 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.001 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:37.001 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:05:37.001 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:05:37.001 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.001 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.001 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:37.001 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:05:37.001 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:05:37.001 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.001 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:37.001 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.001 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.002 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.002 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.002 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:37.002 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.178491176000001, 2024-04-26T12:05:37.002 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:05:37.002 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:37.002 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.002 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:37.002 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.002 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:37.002 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:37.002 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.002 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.002 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.003 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:37.003 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:37.003 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.003 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.003 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.003 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:37.003 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:05:37.003 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.003 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.003 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.003 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:37.003 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:05:37.003 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:05:37.003 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.003 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.004 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:37.004 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:05:37.004 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:05:37.004 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.004 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.004 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.004 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:05:37.004 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:05:37.004 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.004 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.004 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:37.004 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:05:37.004 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:05:37.004 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.004 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.005 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:37.005 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:37.005 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:05:37.005 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.005 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.005 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:37.005 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:05:37.005 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:05:37.005 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.005 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.005 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:37.005 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:05:37.005 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:05:37.005 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.006 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.006 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.006 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:05:37.006 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:05:37.006 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.006 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.006 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:37.006 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:05:37.006 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:05:37.006 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.006 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.006 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:37.006 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:05:37.006 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:05:37.007 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.007 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:37.007 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.007 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.007 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.007 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.007 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:37.007 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.178469835999998, 2024-04-26T12:05:37.007 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:05:37.007 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:37.007 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.007 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:37.007 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.007 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:37.007 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:37.008 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.008 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.008 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.008 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:37.008 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:37.008 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.008 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.008 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.008 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:37.008 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:37.008 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.008 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.008 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.008 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:37.008 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:05:37.009 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:37.009 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.009 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.009 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:37.009 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:05:37.009 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:05:37.009 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.009 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.009 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.009 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:05:37.009 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:05:37.009 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.009 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.009 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:37.009 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:05:37.010 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:05:37.010 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.010 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.010 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:37.010 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:05:37.010 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:05:37.010 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.010 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.010 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:37.010 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:05:37.010 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:05:37.010 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.010 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.010 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:37.011 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:05:37.011 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:05:37.011 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.011 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.011 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.011 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:05:37.011 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:05:37.011 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.011 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.011 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:37.011 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:05:37.011 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:05:37.011 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.011 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.011 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:37.012 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:05:37.012 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:05:37.012 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.012 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:37.012 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.012 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.012 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.012 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.012 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:37.012 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.178447570000003, 2024-04-26T12:05:37.012 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:05:37.012 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:37.012 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.012 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:37.012 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.013 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:37.013 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:37.013 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.013 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.013 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.013 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:37.013 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:37.013 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.013 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.013 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.013 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:37.013 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:37.013 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.013 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.013 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.013 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:37.014 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:05:37.014 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:37.014 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.014 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.014 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:37.014 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:05:37.014 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:05:37.014 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.014 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.014 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.014 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:05:37.014 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:05:37.014 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.014 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.015 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:37.015 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:05:37.015 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:05:37.015 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.015 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.015 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:37.015 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:05:37.015 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:05:37.015 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.015 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.015 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:37.015 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:05:37.015 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:05:37.015 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.016 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.016 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:37.016 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:05:37.016 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:05:37.016 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.016 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.016 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.016 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:05:37.016 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:05:37.016 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.016 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.016 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:37.016 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:05:37.016 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:05:37.017 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.017 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.017 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:37.017 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:05:37.017 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:05:37.017 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.017 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:37.017 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.017 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.017 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.017 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.017 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:37.017 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.178425947999997, 2024-04-26T12:05:37.017 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:05:37.017 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:37.018 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.018 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:37.018 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.018 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:37.018 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:37.018 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.018 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.018 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.018 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:37.018 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:37.018 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.018 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.018 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.018 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:37.019 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:37.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.019 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.019 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.019 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:37.019 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:05:37.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:05:37.019 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.019 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.019 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:37.019 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:05:37.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:05:37.019 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.019 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.020 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.020 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:05:37.020 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:05:37.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.020 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.020 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:37.020 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:05:37.020 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:05:37.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.020 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.020 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:37.020 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:05:37.020 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:05:37.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.020 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.021 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:37.021 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:05:37.021 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:05:37.021 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.021 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.021 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:37.021 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:05:37.021 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:05:37.021 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.021 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.021 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.021 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:05:37.021 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:05:37.021 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.021 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.022 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:37.022 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:05:37.022 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:05:37.022 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.022 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.022 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:37.022 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:05:37.022 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:05:37.022 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.022 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:37.022 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.022 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.022 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.023 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.023 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:37.023 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.178399382000002, 2024-04-26T12:05:37.023 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:05:37.023 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:37.023 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.023 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:37.023 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.023 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:37.023 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:37.023 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.023 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.023 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.023 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:37.023 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:37.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:37.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:05:37.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:37.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:05:37.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:05:37.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:37.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:05:37.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:05:37.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:05:37.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:05:37.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:37.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:05:37.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:05:37.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:37.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:05:37.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:05:37.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:37.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:05:37.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:05:37.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:37.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:05:37.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:05:37.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:05:37.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:05:37.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:37.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:05:37.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:05:37.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:37.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:05:37.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:05:37.027 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.027 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:37.028 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.028 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.028 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:37.028 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.178360869999999, 2024-04-26T12:05:37.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:05:37.028 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:37.028 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.028 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:37.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:37.028 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:37.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:37.029 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:37.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:37.029 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:37.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:37.029 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:05:37.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:05:37.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.030 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:37.030 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:05:37.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:05:37.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.030 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.030 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:05:37.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:05:37.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.030 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:37.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:05:37.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:05:37.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:37.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:05:37.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:05:37.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:37.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:05:37.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:05:37.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:37.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:05:37.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:05:37.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:05:37.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:05:37.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:37.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:05:37.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:05:37.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:37.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:05:37.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:05:37.033 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.033 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:37.033 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.033 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.033 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:37.033 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.178332697000002, 2024-04-26T12:05:37.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:05:37.033 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:37.033 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.034 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:37.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:37.034 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:37.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:37.034 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:37.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.035 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.035 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:37.035 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:37.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.035 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.035 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.035 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:37.035 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:05:37.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:05:37.035 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.035 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.036 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:37.036 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:05:37.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:05:37.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.036 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.036 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:05:37.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:05:37.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.036 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:37.036 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:05:37.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:05:37.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.036 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:37.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:05:37.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:05:37.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:37.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:05:37.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:05:37.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:37.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:05:37.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:05:37.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:05:37.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:05:37.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:37.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:05:37.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:05:37.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:37.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:05:37.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:05:37.038 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.038 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:37.039 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.039 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.039 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:37.039 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.178298132999998, 2024-04-26T12:05:37.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:05:37.039 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:37.039 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.039 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:37.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.039 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:37.039 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:37.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.040 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:37.040 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:37.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.040 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:37.040 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:05:37.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.040 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:37.040 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:05:37.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:05:37.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:37.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:05:37.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:05:37.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:05:37.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:05:37.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:37.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:05:37.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:05:37.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:37.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:05:37.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:05:37.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:37.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:05:37.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:05:37.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:37.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:05:37.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:05:37.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:05:37.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:05:37.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:37.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:37.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:05:37.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.044 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:37.044 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:05:37.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:05:37.044 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.044 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:37.044 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.044 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.044 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:37.044 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.177423353000002, 2024-04-26T12:05:37.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:05:37.044 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:37.044 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.044 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:37.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:37.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:37.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:37.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:37.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:37.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:05:37.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:37.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.046 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.046 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:37.046 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:05:37.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:05:37.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.046 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.046 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:37.046 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:05:37.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:05:37.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.046 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.046 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.046 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:05:37.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:05:37.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:37.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:05:37.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:05:37.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:37.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:05:37.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:05:37.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:37.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:05:37.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:05:37.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:37.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:05:37.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:05:37.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:05:37.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:05:37.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:37.049 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:05:37.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:05:37.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.049 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:37.049 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:05:37.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:05:37.049 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.049 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:37.049 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.049 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.049 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:37.050 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.177384394000001, 2024-04-26T12:05:37.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:05:37.050 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:37.050 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.050 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:37.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.050 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:37.050 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:37.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.050 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.050 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:37.050 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:37.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:37.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:05:37.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:37.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:05:37.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:05:37.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:37.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:05:37.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:05:37.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:05:37.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:05:37.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:37.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:05:37.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:05:37.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:37.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:05:37.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:05:37.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:37.053 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:05:37.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:05:37.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:37.053 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:05:37.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:05:37.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.053 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:05:37.054 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:05:37.054 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.054 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.054 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:37.054 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:05:37.054 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:05:37.054 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.054 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.054 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:37.054 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:05:37.054 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:05:37.054 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.054 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:37.054 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.055 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.055 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.055 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.055 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:37.055 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.177348922, 2024-04-26T12:05:37.055 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:05:37.055 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:37.055 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.055 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:37.055 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.055 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:37.055 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:37.055 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.055 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.056 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.056 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:37.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:37.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.056 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.056 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:37.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:37.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.056 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.056 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:37.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:05:37.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:05:37.057 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.057 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.057 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:37.057 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:05:37.057 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:05:37.057 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.057 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.057 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.057 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:05:37.057 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:05:37.057 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.057 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.057 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:37.057 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:05:37.057 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:05:37.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.058 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:37.058 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:05:37.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:05:37.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.058 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:37.058 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:05:37.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:05:37.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.058 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:37.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:05:37.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:05:37.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:05:37.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:05:37.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:37.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:05:37.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:05:37.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:37.060 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:05:37.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:05:37.060 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.060 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:37.060 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.060 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.060 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.060 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:37.060 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.177270233000002, 2024-04-26T12:05:37.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:05:37.060 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:37.060 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.060 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:37.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.061 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:37.061 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:37.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.061 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:37.061 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:37.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.061 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:37.061 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:05:37.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:37.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.062 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:37.062 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:05:37.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:05:37.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.062 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:37.062 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:05:37.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:05:37.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.062 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.062 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:05:37.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:05:37.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:37.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:05:37.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:05:37.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:37.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:05:37.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:05:37.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:37.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:05:37.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:05:37.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:37.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:05:37.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:05:37.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:05:37.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:05:37.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:37.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:05:37.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:05:37.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:37.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:05:37.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:05:37.065 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.065 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:37.065 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.065 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.065 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:37.065 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.177119384999997, 2024-04-26T12:05:37.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:05:37.066 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:37.066 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:05:37.066 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:37.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.066 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:37.066 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:37.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.066 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:37.066 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:37.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:37.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:37.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:05:37.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:37.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:37.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:05:37.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:05:37.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:37.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:05:37.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:05:37.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:05:37.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:05:37.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:37.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:05:37.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:05:37.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:37.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:37.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:05:37.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:37.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:37.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:37.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:05:37.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:05:37.069 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.069 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:37.069 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.069 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:37.069 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:37.069 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:37.071 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:37.071 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:37.069+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:37.171 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:37.170+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:37.184 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:37.184 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:37.184 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:05:37.184 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:37.194 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:37.272 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:37.271+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:37.296 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:37.296 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:37.296 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:05:37.296 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:05:37.297 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:37.305 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:37.373 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:37.372+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:37.408 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:37.408 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:05:37.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:05:37.408 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:05:37.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.408 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.408 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:37.408 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 33.626020570999998, 2024-04-26T12:05:37.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:05:37.409 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:37.409 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.409 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:37.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.409 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:37.409 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:37.409 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.409 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.409 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:37.409 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:37.409 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.409 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:37.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:05:37.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:37.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:37.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:05:37.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:05:37.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:37.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:05:37.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:05:37.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.411 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.411 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:05:37.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:05:37.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.411 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:37.411 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:05:37.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:05:37.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.411 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:37.411 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:37.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:05:37.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.412 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:37.412 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:05:37.412 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:05:37.412 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.412 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.412 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:37.412 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:05:37.412 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:05:37.412 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.412 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.412 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.412 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:05:37.412 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:05:37.412 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.412 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.413 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:37.413 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:05:37.413 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:05:37.413 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.413 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.413 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:37.413 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:05:37.413 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:05:37.413 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.413 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:37.413 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.413 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.413 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.413 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.413 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:37.414 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 33.625965250999997, 2024-04-26T12:05:37.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:05:37.414 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:37.414 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.414 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:37.414 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:37.414 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:37.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.414 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.414 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:37.414 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:37.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.414 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.415 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.415 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:37.415 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:05:37.415 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:37.415 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.415 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.415 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:37.415 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:05:37.415 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:05:37.415 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.415 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.415 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:37.415 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:05:37.415 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:05:37.415 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.416 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.416 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:05:37.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:05:37.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.416 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:37.416 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:05:37.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:05:37.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.416 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:37.416 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:05:37.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:05:37.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:37.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:05:37.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:05:37.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:37.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:05:37.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:05:37.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:05:37.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:05:37.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.418 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:37.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:05:37.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:05:37.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.418 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:37.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:05:37.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:05:37.418 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.418 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:37.418 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.418 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.418 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:37.419 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 33.625915233000001, 2024-04-26T12:05:37.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:05:37.419 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:37.419 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.419 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:37.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.419 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:37.419 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:37.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.419 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:37.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:37.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:37.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:05:37.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:37.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:05:37.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:05:37.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.421 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:37.421 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:05:37.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:05:37.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.421 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.421 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:05:37.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:05:37.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.421 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:37.421 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:05:37.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:05:37.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.422 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.422 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:37.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:05:37.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:05:37.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.422 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.422 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:37.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:05:37.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:05:37.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.422 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.422 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:37.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:05:37.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:05:37.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.423 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:05:37.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:05:37.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:37.423 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:05:37.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:05:37.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.424 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:37.424 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:05:37.424 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:05:37.424 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.424 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:37.424 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.424 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.424 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.424 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.424 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:37.424 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 33.625880596000002, 2024-04-26T12:05:37.424 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:05:37.424 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:37.424 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.424 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:37.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.425 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:37.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:37.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.425 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.425 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:37.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:37.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.425 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.425 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:37.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:05:37.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.425 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:37.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:05:37.426 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:05:37.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:37.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:37.426 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:05:37.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:05:37.426 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:05:37.427 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.427 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:37.427 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:05:37.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:05:37.427 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.427 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:37.427 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:05:37.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:05:37.427 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.427 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:37.427 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:05:37.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:05:37.428 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.428 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.428 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.428 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:05:37.428 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:05:37.428 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.428 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.428 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:37.428 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:05:37.428 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:05:37.428 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.428 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.428 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:37.428 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:05:37.428 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:05:37.428 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.429 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.429 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:37.429 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:05:37.429 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:05:37.429 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.429 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:37.429 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.429 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.429 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.429 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.429 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:37.429 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 33.625842083999999, 2024-04-26T12:05:37.429 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:05:37.429 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:37.429 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.430 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:37.430 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.430 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:37.430 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:37.430 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.430 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.430 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.430 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:37.430 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:37.430 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.430 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.430 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.430 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:37.430 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:37.431 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:37.431 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.431 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.431 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:37.431 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:37.431 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:05:37.431 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.431 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.431 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:37.431 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:05:37.431 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:05:37.431 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.431 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.431 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.431 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:05:37.432 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:05:37.432 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.432 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.432 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:37.432 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:05:37.432 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:05:37.432 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.432 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.432 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:37.432 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:05:37.432 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:05:37.432 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.432 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.432 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:37.432 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:05:37.432 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:05:37.433 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.433 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.433 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.433 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:05:37.433 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:05:37.433 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.433 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.433 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:37.433 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:05:37.433 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:05:37.433 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.433 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.433 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:37.433 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:05:37.433 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:05:37.434 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.434 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.434 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:37.434 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:05:37.434 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:05:37.434 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.434 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:37.434 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.434 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.434 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.434 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.434 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:37.434 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 33.625811761000001, 2024-04-26T12:05:37.434 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:05:37.435 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:37.435 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.435 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:37.435 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.435 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:37.435 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:37.435 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.435 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.435 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.435 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:37.435 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:37.435 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.435 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.435 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.435 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:37.436 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:37.436 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.436 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.436 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.436 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:37.436 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:05:37.436 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:05:37.436 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.436 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.436 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:37.436 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:05:37.436 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:05:37.436 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.436 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.436 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.437 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:05:37.437 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:05:37.437 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.437 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.437 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:37.437 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:05:37.437 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:05:37.437 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.437 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.437 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:37.437 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:05:37.437 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:05:37.437 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.437 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.437 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:37.438 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:05:37.438 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:05:37.438 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.438 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.438 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:37.438 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:05:37.438 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:05:37.438 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.438 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.438 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.438 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:05:37.438 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:05:37.438 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.438 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.439 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:37.439 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:05:37.439 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:05:37.439 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.439 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.439 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:37.439 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:05:37.439 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:05:37.439 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.439 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:37.439 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.439 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.439 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.439 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.439 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:37.440 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 33.625785059000002, 2024-04-26T12:05:37.440 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:05:37.440 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:37.440 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:37.440 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:37.440 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.440 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:37.440 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:37.440 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.440 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.440 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.440 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:37.440 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:37.440 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.440 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.440 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.441 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:37.441 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:37.441 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.441 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.441 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.441 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:37.441 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:05:37.441 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:05:37.441 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.441 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.441 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:37.441 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:05:37.441 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:05:37.441 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.441 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.442 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.442 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:05:37.442 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:05:37.442 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.442 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.442 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:37.442 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:05:37.442 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:05:37.442 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.442 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.442 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:37.442 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:05:37.442 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:05:37.442 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.443 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.443 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:37.443 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:05:37.443 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:05:37.443 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.443 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:37.443 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.443 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.443 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.443 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.443 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:37.443 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 33.625742768999999, 2024-04-26T12:05:37.443 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:05:37.443 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:37.444 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:37.444 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:37.444 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.444 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:37.444 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:37.444 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.444 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.444 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.444 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:37.444 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:37.444 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.444 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.444 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.444 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:37.444 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:37.445 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.445 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.445 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.445 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:37.445 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:05:37.445 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:05:37.445 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.445 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.445 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:37.445 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:05:37.445 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:05:37.445 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.445 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.445 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.445 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:05:37.446 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:05:37.446 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.446 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.446 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:37.446 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:05:37.446 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:05:37.446 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.446 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.446 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:37.446 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:05:37.446 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:05:37.446 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.446 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.446 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:37.446 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:05:37.447 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:05:37.447 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.447 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:37.447 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.447 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.447 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.447 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.447 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:37.447 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 33.625714690999999, 2024-04-26T12:05:37.447 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:05:37.447 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:37.447 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:37.447 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:37.447 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.448 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:37.448 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:37.448 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.448 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.448 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.448 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:37.448 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:37.448 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.448 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.448 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.448 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:37.448 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:05:37.448 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.448 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.448 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.449 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:37.449 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:05:37.449 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:05:37.449 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.449 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.449 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:37.449 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:05:37.449 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:05:37.449 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.449 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.449 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.449 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:37.449 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:05:37.449 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.449 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.450 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:37.450 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:37.450 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:05:37.450 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.450 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.450 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:37.450 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:05:37.450 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:05:37.450 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.450 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.450 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:37.450 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:05:37.450 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:05:37.450 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.450 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:37.451 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.451 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.451 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.451 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:37.451 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:37.451 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 33.619719341, 2024-04-26T12:05:37.451 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:05:37.451 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:37.451 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.451 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:37.451 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.451 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:37.451 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:37.451 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.452 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.452 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.452 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:37.452 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:37.452 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.452 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.452 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.452 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:37.452 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:05:37.452 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.452 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.453 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.453 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:37.453 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:05:37.453 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:05:37.453 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.453 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.453 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:37.453 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:05:37.453 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:05:37.453 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.453 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.453 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.453 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:05:37.453 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:05:37.453 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.454 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.454 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:37.454 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:05:37.454 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:05:37.454 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.454 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.454 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:37.454 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:05:37.454 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:05:37.454 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.454 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.454 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:37.454 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:05:37.454 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:05:37.455 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.455 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.455 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:37.455 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:05:37.455 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:05:37.455 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.455 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:37.455 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.455 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.455 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.455 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:37.455 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:37.455 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 33.619650374999999, 2024-04-26T12:05:37.455 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:05:37.455 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:37.455 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.456 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:37.456 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.456 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:37.456 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:37.456 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.456 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.456 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.456 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:37.456 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:37.456 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.456 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.456 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.456 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:37.456 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:05:37.456 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.457 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.457 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:37.457 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:05:37.457 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:05:37.457 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.457 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:37.457 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:05:37.457 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:05:37.457 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.457 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.457 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:05:37.457 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:05:37.458 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.458 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.458 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:37.458 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:05:37.458 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:05:37.458 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.458 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.458 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:37.458 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:37.458 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:05:37.458 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.458 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.458 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:37.458 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:05:37.459 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:05:37.459 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.459 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:37.459 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:05:37.459 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:05:37.459 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.459 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:37.459 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.459 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.459 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:37.459 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:37.459 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 33.619156011999998, 2024-04-26T12:05:37.460 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:05:37.460 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:37.460 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.460 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:37.460 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.460 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:37.460 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:37.460 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.460 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.460 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.460 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:37.460 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:37.460 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.460 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.460 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.460 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:37.461 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:37.461 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.461 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.461 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.461 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:37.461 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:05:37.461 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:05:37.461 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.461 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.461 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:37.461 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:05:37.461 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:05:37.461 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.461 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.462 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.462 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:05:37.462 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:05:37.462 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.462 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.462 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:37.462 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:05:37.462 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:05:37.462 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.462 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.462 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:37.462 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:05:37.462 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:05:37.462 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.462 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.463 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:37.463 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:05:37.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:05:37.463 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.463 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:37.463 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:05:37.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:05:37.463 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.463 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:37.463 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.463 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.463 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:37.464 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:37.464 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 33.619117746999997, 2024-04-26T12:05:37.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:05:37.464 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:37.464 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.464 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:37.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:37.464 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:37.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.464 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:37.464 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:37.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.465 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:37.465 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:37.465 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.465 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:37.465 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:05:37.465 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:05:37.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.465 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:37.465 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:05:37.466 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:05:37.466 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.466 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.466 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:05:37.466 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:05:37.466 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.466 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:37.466 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:05:37.466 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:05:37.466 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.466 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:37.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:05:37.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:05:37.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.467 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.467 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:37.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:05:37.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:05:37.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.467 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.467 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:37.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:05:37.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:05:37.467 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.467 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:37.467 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.468 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.468 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:05:37.468 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:37.468 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 33.618437862, 2024-04-26T12:05:37.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:05:37.468 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:37.468 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:37.468 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:37.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.468 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:37.468 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:37.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.468 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.469 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:37.469 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:37.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.469 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.469 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.469 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:37.469 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:37.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.469 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.469 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.469 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:37.469 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:05:37.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:05:37.469 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.469 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:37.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:05:37.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:05:37.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:05:37.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:05:37.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:37.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:05:37.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:05:37.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.471 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:37.471 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:05:37.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:05:37.471 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.471 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:37.471 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.471 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:37.471 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:37.471 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 33.618408682999998, 2024-04-26T12:05:37.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:05:37.471 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:37.471 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:37.472 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:37.472 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.472 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:37.472 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:37.472 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.472 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.472 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.472 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:37.472 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:37.472 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.472 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.472 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.472 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:37.472 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:05:37.473 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.473 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.473 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.473 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:37.473 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:05:37.473 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:05:37.473 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.473 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.473 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:37.473 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:05:37.473 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:05:37.473 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.473 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.473 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.473 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:05:37.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:05:37.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.474 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:37.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:05:37.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:05:37.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.474 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:37.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:05:37.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:05:37.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.474 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:37.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:05:37.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:05:37.475 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.475 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:37.475 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.475 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:37.475 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:37.475 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 33.618376871999999, 2024-04-26T12:05:37.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:05:37.475 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:37.475 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:37.475 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:37.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:37.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:37.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.476 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:37.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:37.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.476 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:37.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:37.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:05:37.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.476 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:37.477 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:05:37.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:05:37.477 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.477 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:37.477 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:05:37.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:05:37.477 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.477 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.477 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:05:37.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:05:37.477 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.477 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:37.478 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:05:37.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:05:37.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.478 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.478 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:37.478 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:05:37.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:05:37.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.478 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.478 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:37.478 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:05:37.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:05:37.478 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.478 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:37.479 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.479 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.479 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.479 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:37.479 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:37.479 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 33.618355516000001, 2024-04-26T12:05:37.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:05:37.479 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:37.479 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:37.479 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:37.479 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.479 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:37.479 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:37.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.479 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.480 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:37.480 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:37.480 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.480 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.480 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:37.480 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:37.480 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:05:37.480 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.480 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:37.480 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:05:37.480 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:05:37.480 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:37.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:05:37.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:05:37.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:05:37.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:05:37.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:37.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:05:37.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:05:37.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:37.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:05:37.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:05:37.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:37.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:05:37.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:05:37.482 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.482 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:37.482 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.482 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:05:37.483 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:37.483 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 33.618327063000002, 2024-04-26T12:05:37.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:05:37.483 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:37.483 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:37.483 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:37.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.483 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:37.483 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:37.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.483 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.483 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:37.483 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:37.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.484 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.484 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.484 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:37.484 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:37.484 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.484 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.484 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.484 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:37.484 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:05:37.484 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:05:37.484 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.484 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.484 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:37.484 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:05:37.484 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:05:37.485 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.485 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.485 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.485 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:05:37.485 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:05:37.485 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.485 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.485 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:37.485 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:05:37.485 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:05:37.485 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.485 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.485 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:37.485 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:05:37.485 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:05:37.486 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.486 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:37.486 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.486 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.486 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.486 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:05:37.486 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:37.486 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 33.617605257000001, 2024-04-26T12:05:37.486 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:05:37.486 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:37.486 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:37.486 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:37.486 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.486 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:37.486 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:37.487 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.487 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.487 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.487 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:37.487 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:37.487 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.487 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.487 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.487 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:37.487 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:05:37.487 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:37.487 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.487 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.487 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:37.488 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:05:37.488 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:05:37.488 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.488 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.488 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:37.488 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:05:37.488 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:05:37.488 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.488 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.488 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.488 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:05:37.488 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:05:37.488 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.488 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.489 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:37.489 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:05:37.489 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:05:37.489 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.489 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.489 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:37.489 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:05:37.489 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:05:37.489 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.489 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:37.489 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.489 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.489 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.489 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:05:37.489 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:37.490 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 27.900678654, 2024-04-26T12:05:37.490 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:05:37.490 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:37.490 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.490 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:37.490 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.490 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:37.490 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:37.490 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.490 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.490 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:37.490 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:37.490 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:37.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.491 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:37.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:05:37.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:05:37.491 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.491 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:37.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:05:37.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:05:37.491 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.491 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:37.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:05:37.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:05:37.491 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.492 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.492 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.492 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:05:37.492 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:05:37.492 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.492 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.492 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:37.492 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:05:37.492 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:05:37.492 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.492 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.492 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:37.492 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:05:37.492 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:05:37.492 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.493 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.493 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:37.493 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:05:37.493 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:05:37.493 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.493 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.493 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:37.493 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:05:37.493 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:05:37.493 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.493 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.493 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.493 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:05:37.493 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:05:37.493 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.494 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.494 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:37.494 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:05:37.494 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:05:37.494 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:37.494 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:37.494 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:37.494 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:05:37.494 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:05:37.494 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.494 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:37.494 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.494 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:37.495 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:37.495 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:37.496 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:37.497 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:37.495+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:37.597 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:37.596+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:37.610 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:37.610 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:05:37.610 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-04-26T12:05:37.610 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:37.619 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:37.698 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:37.696+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:37.760 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:37.761 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:05:37.761 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T12:05:37.761 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T12:05:37.761 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:37.769 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:37.799 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:37.798+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:37.856 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-26T12:05:37.873 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:37.874 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T12:05:37.874 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T12:05:37.874 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T12:05:37.874 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.874 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.874 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:37.874 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.090510964000003, 2024-04-26T12:05:37.874 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017255857999999999, 2024-04-26T12:05:37.874 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:37.874 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.874 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:37.874 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780340+0000", 2024-04-26T12:05:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780351+0000", 2024-04-26T12:05:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0898e-05 2024-04-26T12:05:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1671999999999999e-05 2024-04-26T12:05:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780374+0000", 2024-04-26T12:05:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1117999999999999e-05 2024-04-26T12:05:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780423+0000", 2024-04-26T12:05:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9066000000000001e-05 2024-04-26T12:05:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780428+0000", 2024-04-26T12:05:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1320000000000002e-06 2024-04-26T12:05:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788902+0000", 2024-04-26T12:05:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084738560000000001 2024-04-26T12:05:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789167+0000", 2024-04-26T12:05:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026521100000000001 2024-04-26T12:05:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789279+0000", 2024-04-26T12:05:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111616 2024-04-26T12:05:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792335+0000", 2024-04-26T12:05:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030556419999999999 2024-04-26T12:05:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797519+0000", 2024-04-26T12:05:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051841550000000002 2024-04-26T12:05:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797559+0000", 2024-04-26T12:05:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0451999999999998e-05 2024-04-26T12:05:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797598+0000", 2024-04-26T12:05:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8500000000000001e-05 2024-04-26T12:05:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.090462657000003, 2024-04-26T12:05:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017668725, 2024-04-26T12:05:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780395+0000", 2024-04-26T12:05:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.198e-06 2024-04-26T12:05:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780402+0000", 2024-04-26T12:05:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:05:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780408+0000", 2024-04-26T12:05:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780481+0000", 2024-04-26T12:05:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3239999999999997e-05 2024-04-26T12:05:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780485+0000", 2024-04-26T12:05:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4039999999999999e-06 2024-04-26T12:05:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789518+0000", 2024-04-26T12:05:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090335480000000006 2024-04-26T12:05:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789585+0000", 2024-04-26T12:05:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6469000000000003e-05 2024-04-26T12:05:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789699+0000", 2024-04-26T12:05:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114613 2024-04-26T12:05:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793308+0000", 2024-04-26T12:05:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036088520000000001 2024-04-26T12:05:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797887+0000", 2024-04-26T12:05:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0045792790000000003 2024-04-26T12:05:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797955+0000", 2024-04-26T12:05:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T12:05:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798059+0000", 2024-04-26T12:05:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103874 2024-04-26T12:05:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.090432385, 2024-04-26T12:05:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017735145000000001, 2024-04-26T12:05:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780424+0000", 2024-04-26T12:05:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4519999999999999e-06 2024-04-26T12:05:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780431+0000", 2024-04-26T12:05:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0690000000000004e-06 2024-04-26T12:05:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780438+0000", 2024-04-26T12:05:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5719999999999999e-06 2024-04-26T12:05:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780468+0000", 2024-04-26T12:05:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.993e-05 2024-04-26T12:05:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780472+0000", 2024-04-26T12:05:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-04-26T12:05:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789916+0000", 2024-04-26T12:05:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094434940000000002 2024-04-26T12:05:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790004+0000", 2024-04-26T12:05:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8085999999999997e-05 2024-04-26T12:05:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790125+0000", 2024-04-26T12:05:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012186200000000001 2024-04-26T12:05:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793402+0000", 2024-04-26T12:05:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00327685 2024-04-26T12:05:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798068+0000", 2024-04-26T12:05:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046652150000000003 2024-04-26T12:05:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798108+0000", 2024-04-26T12:05:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0911000000000002e-05 2024-04-26T12:05:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798156+0000", 2024-04-26T12:05:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7128e-05 2024-04-26T12:05:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.090409366000003, 2024-04-26T12:05:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017792624, 2024-04-26T12:05:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780447+0000", 2024-04-26T12:05:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8519999999999997e-06 2024-04-26T12:05:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780453+0000", 2024-04-26T12:05:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2999999999999998e-06 2024-04-26T12:05:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0760000000000002e-06 2024-04-26T12:05:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780502+0000", 2024-04-26T12:05:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4079999999999998e-05 2024-04-26T12:05:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.895 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:37.895 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:37.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5450000000000002e-06 2024-04-26T12:05:37.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.895 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.895 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790390+0000", 2024-04-26T12:05:37.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098850759999999996 2024-04-26T12:05:37.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.895 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:37.896 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790447+0000", 2024-04-26T12:05:37.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6752999999999997e-05 2024-04-26T12:05:37.896 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.896 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.896 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:37.896 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790547+0000", 2024-04-26T12:05:37.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100344 2024-04-26T12:05:37.896 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.896 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.896 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793864+0000", 2024-04-26T12:05:37.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033169749999999998 2024-04-26T12:05:37.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:37.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798164+0000", 2024-04-26T12:05:37.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043000690000000001 2024-04-26T12:05:37.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:37.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798204+0000", 2024-04-26T12:05:37.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9478999999999999e-05 2024-04-26T12:05:37.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:37.898 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798236+0000", 2024-04-26T12:05:37.898 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2478999999999999e-05 2024-04-26T12:05:37.898 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.898 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:37.898 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.898 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.898 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.898 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:37.898 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.090369023000001, 2024-04-26T12:05:37.898 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016989500000000001, 2024-04-26T12:05:37.898 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:37.898 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.898 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:37.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.899 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:37.899 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:37.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.899 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.899 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:37.899 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:37.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.899 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.899 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:37.899 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780483+0000", 2024-04-26T12:05:37.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.899 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.900 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:37.900 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780488+0000", 2024-04-26T12:05:37.900 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6260000000000003e-06 2024-04-26T12:05:37.900 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.900 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.900 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:37.900 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780499+0000", 2024-04-26T12:05:37.900 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1236000000000001e-05 2024-04-26T12:05:37.900 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.900 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.900 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.900 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:37.900 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4569999999999996e-06 2024-04-26T12:05:37.900 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780529+0000", 2024-04-26T12:05:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4579e-05 2024-04-26T12:05:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780532+0000", 2024-04-26T12:05:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.74e-06 2024-04-26T12:05:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788868+0000", 2024-04-26T12:05:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0083357650000000002 2024-04-26T12:05:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789142+0000", 2024-04-26T12:05:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027472 2024-04-26T12:05:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789241+0000", 2024-04-26T12:05:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8394999999999996e-05 2024-04-26T12:05:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792096+0000", 2024-04-26T12:05:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002855677 2024-04-26T12:05:37.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.903 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:37.903 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797379+0000", 2024-04-26T12:05:37.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052822379999999999 2024-04-26T12:05:37.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.903 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:37.903 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797433+0000", 2024-04-26T12:05:37.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4109e-05 2024-04-26T12:05:37.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797473+0000", 2024-04-26T12:05:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0533e-05 2024-04-26T12:05:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.090329408999999, 2024-04-26T12:05:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017295965, 2024-04-26T12:05:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780513+0000", 2024-04-26T12:05:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999895 2024-04-26T12:05:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780528+0000", 2024-04-26T12:05:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5089000000000001e-05 2024-04-26T12:05:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780537+0000", 2024-04-26T12:05:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8400000000000001e-06 2024-04-26T12:05:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780544+0000", 2024-04-26T12:05:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.917e-06 2024-04-26T12:05:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780571+0000", 2024-04-26T12:05:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7032000000000001e-05 2024-04-26T12:05:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780574+0000", 2024-04-26T12:05:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:05:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789436+0000", 2024-04-26T12:05:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088622240000000001 2024-04-26T12:05:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789525+0000", 2024-04-26T12:05:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8549999999999998e-05 2024-04-26T12:05:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789642+0000", 2024-04-26T12:05:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011772100000000001 2024-04-26T12:05:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792129+0000", 2024-04-26T12:05:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024871709999999998 2024-04-26T12:05:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797732+0000", 2024-04-26T12:05:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056027580000000002 2024-04-26T12:05:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797777+0000", 2024-04-26T12:05:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4620999999999999e-05 2024-04-26T12:05:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797819+0000", 2024-04-26T12:05:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2536000000000001e-05 2024-04-26T12:05:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.090300458999998, 2024-04-26T12:05:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017840163999999999, 2024-04-26T12:05:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:37.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:37.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5419999999999999e-06 2024-04-26T12:05:37.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:37.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780563+0000", 2024-04-26T12:05:37.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:05:37.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780569+0000", 2024-04-26T12:05:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1479999999999997e-06 2024-04-26T12:05:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780594+0000", 2024-04-26T12:05:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5585e-05 2024-04-26T12:05:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780596+0000", 2024-04-26T12:05:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2630000000000002e-06 2024-04-26T12:05:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789932+0000", 2024-04-26T12:05:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093360479999999996 2024-04-26T12:05:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790070+0000", 2024-04-26T12:05:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013771399999999999 2024-04-26T12:05:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790219+0000", 2024-04-26T12:05:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014872299999999999 2024-04-26T12:05:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793632+0000", 2024-04-26T12:05:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003413368 2024-04-26T12:05:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798244+0000", 2024-04-26T12:05:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046113819999999998 2024-04-26T12:05:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798361+0000", 2024-04-26T12:05:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117726 2024-04-26T12:05:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798393+0000", 2024-04-26T12:05:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1099999999999997e-05 2024-04-26T12:05:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.090275534, 2024-04-26T12:05:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016645943, 2024-04-26T12:05:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780580+0000", 2024-04-26T12:05:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1549999999999999e-06 2024-04-26T12:05:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780588+0000", 2024-04-26T12:05:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:05:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780593+0000", 2024-04-26T12:05:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2399999999999998e-06 2024-04-26T12:05:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780628+0000", 2024-04-26T12:05:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5426000000000003e-05 2024-04-26T12:05:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780632+0000", 2024-04-26T12:05:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:05:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788288+0000", 2024-04-26T12:05:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076555879999999996 2024-04-26T12:05:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788570+0000", 2024-04-26T12:05:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028233700000000002 2024-04-26T12:05:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797223+0000", 2024-04-26T12:05:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086529150000000006 2024-04-26T12:05:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.090251565000003, 2024-04-26T12:05:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016536068000000001, 2024-04-26T12:05:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780609+0000", 2024-04-26T12:05:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8280000000000003e-06 2024-04-26T12:05:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780616+0000", 2024-04-26T12:05:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4939999999999997e-06 2024-04-26T12:05:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780621+0000", 2024-04-26T12:05:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6040000000000003e-06 2024-04-26T12:05:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780647+0000", 2024-04-26T12:05:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6441999999999999e-05 2024-04-26T12:05:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780650+0000", 2024-04-26T12:05:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4430000000000002e-06 2024-04-26T12:05:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788163+0000", 2024-04-26T12:05:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007513774 2024-04-26T12:05:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788307+0000", 2024-04-26T12:05:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014374400000000001 2024-04-26T12:05:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797137+0000", 2024-04-26T12:05:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088302160000000001 2024-04-26T12:05:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.087375293000001, 2024-04-26T12:05:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012911448000000001, 2024-04-26T12:05:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783477+0000", 2024-04-26T12:05:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783482+0000", 2024-04-26T12:05:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5709999999999999e-06 2024-04-26T12:05:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783491+0000", 2024-04-26T12:05:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3610000000000007e-06 2024-04-26T12:05:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783498+0000", 2024-04-26T12:05:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4209999999999998e-06 2024-04-26T12:05:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786045+0000", 2024-04-26T12:05:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0025465739999999998 2024-04-26T12:05:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786061+0000", 2024-04-26T12:05:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6348999999999999e-05 2024-04-26T12:05:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796342+0000", 2024-04-26T12:05:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010280643000000001 2024-04-26T12:05:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796389+0000", 2024-04-26T12:05:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6912000000000001e-05 2024-04-26T12:05:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.087346986999997, 2024-04-26T12:05:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013376469, 2024-04-26T12:05:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783516+0000", 2024-04-26T12:05:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.041e-05 2024-04-26T12:05:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783523+0000", 2024-04-26T12:05:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5749999999999997e-06 2024-04-26T12:05:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783528+0000", 2024-04-26T12:05:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5029999999999997e-06 2024-04-26T12:05:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787662+0000", 2024-04-26T12:05:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041336230000000003 2024-04-26T12:05:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787687+0000", 2024-04-26T12:05:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5769999999999999e-05 2024-04-26T12:05:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796817+0000", 2024-04-26T12:05:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091296750000000003 2024-04-26T12:05:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796882+0000", 2024-04-26T12:05:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5180999999999998e-05 2024-04-26T12:05:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.087278445999999, 2024-04-26T12:05:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013457291999999999, 2024-04-26T12:05:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783578+0000", 2024-04-26T12:05:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.659e-06 2024-04-26T12:05:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783584+0000", 2024-04-26T12:05:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783588+0000", 2024-04-26T12:05:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6190000000000002e-06 2024-04-26T12:05:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787834+0000", 2024-04-26T12:05:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042460529999999996 2024-04-26T12:05:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787854+0000", 2024-04-26T12:05:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9658999999999999e-05 2024-04-26T12:05:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009107604 2024-04-26T12:05:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797032+0000", 2024-04-26T12:05:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9987000000000006e-05 2024-04-26T12:05:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.938 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:37.938 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:37.938 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.085432066999999, 2024-04-26T12:05:37.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011003015999999999, 2024-04-26T12:05:37.938 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:37.938 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.938 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:37.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:37.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:37.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:37.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:37.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:37.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785420+0000", 2024-04-26T12:05:37.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:37.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785427+0000", 2024-04-26T12:05:37.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:05:37.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:37.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785438+0000", 2024-04-26T12:05:37.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069e-05 2024-04-26T12:05:37.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785457+0000", 2024-04-26T12:05:37.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8617000000000001e-05 2024-04-26T12:05:37.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786628+0000", 2024-04-26T12:05:37.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001171418 2024-04-26T12:05:37.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:37.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786651+0000", 2024-04-26T12:05:37.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3289e-05 2024-04-26T12:05:37.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:37.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796393+0000", 2024-04-26T12:05:37.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097413269999999993 2024-04-26T12:05:37.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:37.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796424+0000", 2024-04-26T12:05:37.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1188e-05 2024-04-26T12:05:37.941 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.942 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:37.942 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.942 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:37.942 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:37.942 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.084885321000002, 2024-04-26T12:05:37.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010561432000000001, 2024-04-26T12:05:37.942 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:37.942 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.942 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:37.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:37.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:37.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785973+0000", 2024-04-26T12:05:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4910000000000002e-06 2024-04-26T12:05:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785991+0000", 2024-04-26T12:05:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7663e-05 2024-04-26T12:05:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785998+0000", 2024-04-26T12:05:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1239999999999999e-06 2024-04-26T12:05:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786792+0000", 2024-04-26T12:05:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079334800000000003 2024-04-26T12:05:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786810+0000", 2024-04-26T12:05:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8746999999999999e-05 2024-04-26T12:05:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796500+0000", 2024-04-26T12:05:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096897619999999993 2024-04-26T12:05:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796529+0000", 2024-04-26T12:05:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8873999999999998e-05 2024-04-26T12:05:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.084806235000002, 2024-04-26T12:05:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010219911, 2024-04-26T12:05:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786046+0000", 2024-04-26T12:05:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786053+0000", 2024-04-26T12:05:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0360000000000001e-06 2024-04-26T12:05:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786064+0000", 2024-04-26T12:05:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1202999999999999e-05 2024-04-26T12:05:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786091+0000", 2024-04-26T12:05:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6859000000000002e-05 2024-04-26T12:05:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786212+0000", 2024-04-26T12:05:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120975 2024-04-26T12:05:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786236+0000", 2024-04-26T12:05:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4358999999999998e-05 2024-04-26T12:05:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796236+0000", 2024-04-26T12:05:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099998050000000005 2024-04-26T12:05:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796266+0000", 2024-04-26T12:05:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0278e-05 2024-04-26T12:05:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:3 3.14 e17/15 3:287034c4:::1.00000000.inode:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.084017273999997, 2024-04-26T12:05:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009764712, 2024-04-26T12:05:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786835+0000", 2024-04-26T12:05:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T12:05:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786844+0000", 2024-04-26T12:05:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6500000000000008e-06 2024-04-26T12:05:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786855+0000", 2024-04-26T12:05:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0932e-05 2024-04-26T12:05:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786864+0000", 2024-04-26T12:05:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2150000000000007e-06 2024-04-26T12:05:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787242+0000", 2024-04-26T12:05:37.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037708300000000001 2024-04-26T12:05:37.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:37.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787259+0000", 2024-04-26T12:05:37.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7258999999999999e-05 2024-04-26T12:05:37.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796579+0000", 2024-04-26T12:05:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093201099999999995 2024-04-26T12:05:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796600+0000", 2024-04-26T12:05:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1330000000000001e-05 2024-04-26T12:05:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.083973252, 2024-04-26T12:05:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096431940000000008, 2024-04-26T12:05:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786879+0000", 2024-04-26T12:05:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786887+0000", 2024-04-26T12:05:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9300000000000003e-06 2024-04-26T12:05:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786894+0000", 2024-04-26T12:05:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:05:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786899+0000", 2024-04-26T12:05:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8400000000000002e-06 2024-04-26T12:05:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786932+0000", 2024-04-26T12:05:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3031999999999998e-05 2024-04-26T12:05:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786945+0000", 2024-04-26T12:05:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3421000000000001e-05 2024-04-26T12:05:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796469+0000", 2024-04-26T12:05:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095236130000000002 2024-04-26T12:05:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796523+0000", 2024-04-26T12:05:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4089999999999999e-05 2024-04-26T12:05:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "pg_update_log_missing(3.14 epoch 17/15 rep_tid 169 entries 17'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:05:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.083910097, 2024-04-26T12:05:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097257639999999996, 2024-04-26T12:05:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-04-26T12:05:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786942+0000", 2024-04-26T12:05:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786951+0000", 2024-04-26T12:05:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:05:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786965+0000", 2024-04-26T12:05:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4268e-05 2024-04-26T12:05:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786977+0000", 2024-04-26T12:05:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1667e-05 2024-04-26T12:05:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787667+0000", 2024-04-26T12:05:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00069057400000000001 2024-04-26T12:05:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796668+0000", 2024-04-26T12:05:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090013309999999996 2024-04-26T12:05:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.083856953999998, 2024-04-26T12:05:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095908309999999993, 2024-04-26T12:05:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786995+0000", 2024-04-26T12:05:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787001+0000", 2024-04-26T12:05:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5099999999999998e-06 2024-04-26T12:05:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787009+0000", 2024-04-26T12:05:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9100000000000005e-06 2024-04-26T12:05:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787019+0000", 2024-04-26T12:05:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8109999999999997e-06 2024-04-26T12:05:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787136+0000", 2024-04-26T12:05:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011749899999999999 2024-04-26T12:05:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787154+0000", 2024-04-26T12:05:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8278999999999999e-05 2024-04-26T12:05:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796561+0000", 2024-04-26T12:05:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094064379999999996 2024-04-26T12:05:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796587+0000", 2024-04-26T12:05:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5856000000000001e-05 2024-04-26T12:05:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.083139897000002, 2024-04-26T12:05:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096460160000000003, 2024-04-26T12:05:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787712+0000", 2024-04-26T12:05:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787718+0000", 2024-04-26T12:05:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:05:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787727+0000", 2024-04-26T12:05:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.123e-06 2024-04-26T12:05:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787734+0000", 2024-04-26T12:05:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.391e-06 2024-04-26T12:05:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788867+0000", 2024-04-26T12:05:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001133207 2024-04-26T12:05:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788899+0000", 2024-04-26T12:05:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1526000000000003e-05 2024-04-26T12:05:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797328+0000", 2024-04-26T12:05:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084295389999999998 2024-04-26T12:05:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797359+0000", 2024-04-26T12:05:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0660999999999997e-05 2024-04-26T12:05:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:37.970 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:37.971 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:05:37.972 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:37.973 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:37.971+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:38.073 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:38.072+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:38.086 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:38.086 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:05:38.086 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:05:38.086 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:38.095 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:38.103 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:05:38.104 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:05:38.122 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T12:05:38.122 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:05:38.139 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:05:38.139 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:05:38.174 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:38.172+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:38.197 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:38.197 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:38.206 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:38.275 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:38.274+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:38.308 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:38.308 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:38.317 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:38.376 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:38.374+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:38.431 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:38.431 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:38.440 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:38.477 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:38.476+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:38.542 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:38.542 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:38.551 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:38.577 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:38.577+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:38.651 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:38.651 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:38.660 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:38.704 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:38.703+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:38.769 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:38.770 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:38.777 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:38.779 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:38.779+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:38.880 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:38.879+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:38.920 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:38.921 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:38.930 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:38.981 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:38.980+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:39.032 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:39.032 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:39.041 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:39.082 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:39.081+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:39.152 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:39.152 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:39.161 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:39.183 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:39.182+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:39.263 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:39.264 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:39.273 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:39.317 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:39.316+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:39.375 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:39.376 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:39.385 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:39.386 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:39.384+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:39.397 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:05:39.397 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:05:39.397 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-26T12:05:39.397 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T12:05:39.397 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T12:05:39.398 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-26T12:05:39.485 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:39.484+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:39.489 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:39.489 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:39.498 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:39.526 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:39.526 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-26T12:05:39.526 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:39.589 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:39.586+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:39.640 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:39.641 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:39.650 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:39.688 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:39.687+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:39.789 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:39.788+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:39.790 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:39.790 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:39.799 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:39.873 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:05:39.889 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:39.889+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:39.907 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:39.907 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:39.916 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:39.990 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:39.989+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:40.017 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:40.017 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:40.025 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:40.109 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:40.108+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:40.151 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:05:40.167 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:40.167 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:40.175 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:40.192 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:40.191+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:40.273 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:05:40.273 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:05:40.281 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:40.281 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:40.290 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:40.291 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T12:05:40.291 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:05:40.292 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:40.291+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:40.309 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:05:40.309 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:05:40.392 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:40.392 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:05:40.392 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:05:40.392 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:05:40.392 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:40.393 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:40.392+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:40.400 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:40.494 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:40.493+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:40.504 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:40.504 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:05:40.504 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:05:40.504 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:05:40.504 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.504 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:40.504 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:40.504 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 46.647316695999997, 2024-04-26T12:05:40.505 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:05:40.505 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:40.505 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.505 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:40.505 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:40.505 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:40.505 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:05:40.505 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.505 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:40.505 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.505 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:40.505 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:40.505 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.505 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.505 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.506 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:40.506 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:40.506 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.506 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.506 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.506 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:40.506 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:40.506 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:40.506 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.506 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.506 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:40.506 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:05:40.506 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:05:40.506 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.507 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.507 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:40.507 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:05:40.507 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:05:40.507 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.507 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.507 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.507 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:05:40.507 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:05:40.507 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.507 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.507 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:40.507 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:05:40.507 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:05:40.507 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.508 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.508 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:40.508 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:05:40.508 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:05:40.508 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.508 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.508 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:40.508 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:05:40.508 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:05:40.508 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.508 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.508 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:40.508 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:05:40.508 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:05:40.508 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.509 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:40.509 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:05:40.509 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:05:40.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.509 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:40.509 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:05:40.509 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:05:40.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.509 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:40.509 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:05:40.509 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:05:40.509 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.510 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:40.510 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.510 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.510 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.510 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:40.510 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:40.510 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 46.647210800000003, 2024-04-26T12:05:40.510 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:05:40.510 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:40.510 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.510 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:40.510 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:40.510 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:40.510 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:05:40.510 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.511 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:40.511 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.511 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:40.511 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:40.511 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.511 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.511 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.511 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:40.511 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:40.511 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.511 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.511 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.511 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:40.511 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:40.511 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:40.512 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.512 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.512 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:40.512 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:05:40.512 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:05:40.512 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.512 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.512 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:40.512 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:05:40.512 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:05:40.512 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.512 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.512 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.512 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:05:40.512 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:05:40.513 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.513 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.513 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:40.513 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:05:40.513 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:05:40.513 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.513 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.513 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:40.513 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:05:40.513 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:05:40.513 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.513 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.513 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:40.513 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:05:40.513 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:05:40.514 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.514 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.514 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:40.514 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:05:40.514 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:05:40.514 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.514 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.514 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:40.514 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:05:40.514 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:05:40.514 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.514 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.514 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:40.514 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:05:40.515 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:05:40.515 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.515 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.515 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:40.515 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:05:40.515 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:05:40.515 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.515 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:40.515 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.515 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.515 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.515 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:40.515 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:40.515 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 46.64719582, 2024-04-26T12:05:40.515 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:05:40.516 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:40.516 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.516 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:40.516 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:40.516 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:40.516 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:05:40.516 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.516 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:40.516 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.516 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:40.516 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:40.516 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.516 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.516 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.516 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:40.517 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:40.517 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.517 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.517 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.517 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:40.517 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:40.517 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:40.517 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.517 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.517 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:40.517 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:05:40.517 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:05:40.517 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.517 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.518 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:40.518 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:05:40.518 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:05:40.518 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.518 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.518 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.518 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:05:40.518 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:05:40.518 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.518 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.518 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:40.518 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:05:40.519 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:05:40.519 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.519 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.519 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:40.519 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:05:40.519 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:05:40.519 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.519 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.520 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:40.520 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:05:40.520 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:05:40.520 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.521 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.521 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:40.521 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:05:40.521 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:05:40.521 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.521 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.521 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:40.521 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:05:40.521 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:05:40.521 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.521 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.521 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:40.521 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:05:40.521 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:05:40.522 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.522 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.522 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:40.522 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:05:40.522 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:05:40.522 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.522 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:40.522 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.522 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.522 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.522 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:40.522 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:40.522 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 46.647151944999997, 2024-04-26T12:05:40.523 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:05:40.523 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:40.523 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.523 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:40.523 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:40.523 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:40.523 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:05:40.523 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.523 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:40.523 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.523 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:40.523 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:40.523 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.523 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.523 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:05:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:05:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:05:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:05:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:05:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:05:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:05:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:05:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:05:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:05:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:05:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:05:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:05:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:05:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:05:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:05:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:05:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:05:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:05:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:05:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 46.647066281000001, 2024-04-26T12:05:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:05:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:05:40.529 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.529 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:40.529 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.529 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:40.529 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:40.529 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.529 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.529 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.529 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:40.529 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:40.529 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:05:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:05:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:05:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:05:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:05:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:05:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:05:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:05:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:05:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:05:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:05:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:05:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:05:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:05:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:05:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:05:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:05:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:05:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:05:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:05:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 36.721161995000003, 2024-04-26T12:05:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:05:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:05:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:05:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:05:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:05:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:05:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:05:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:05:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:05:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:05:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:05:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:05:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:05:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:05:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:05:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:05:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:05:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:05:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:05:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:05:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:05:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 36.721125899999997, 2024-04-26T12:05:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:05:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:05:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:05:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:05:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:05:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:05:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:05:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:05:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:05:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:05:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:05:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:05:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:05:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:05:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:05:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:05:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:05:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:05:40.544 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.544 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.544 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:40.544 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:05:40.544 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:05:40.544 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.544 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.544 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:40.544 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:05:40.544 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:05:40.544 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.544 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:40.544 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.544 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.545 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.545 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:40.545 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:40.545 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 36.721088215999998, 2024-04-26T12:05:40.545 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:05:40.545 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:40.545 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.545 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:40.545 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.545 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:40.546 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:40.546 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.546 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.546 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.546 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:40.546 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:40.546 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.546 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.546 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.546 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:40.546 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:05:40.546 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:40.546 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.546 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.547 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:40.547 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:05:40.547 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:05:40.547 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.547 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.547 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:40.547 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:05:40.547 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:05:40.547 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.547 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.547 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.547 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:05:40.547 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:05:40.547 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.548 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.548 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:40.548 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:05:40.548 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:05:40.548 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.548 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.548 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:40.548 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:40.548 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:05:40.548 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.548 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.548 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:40.548 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:05:40.548 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:05:40.549 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.549 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.549 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:40.549 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:05:40.549 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:05:40.549 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.549 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.549 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:40.549 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:05:40.549 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:05:40.549 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.549 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.549 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:40.549 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:05:40.549 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:05:40.550 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.550 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.550 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:40.550 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:05:40.550 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:05:40.550 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.550 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:40.550 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.550 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.550 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.550 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:40.550 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:40.550 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 36.721066876000002, 2024-04-26T12:05:40.550 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:05:40.551 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:40.551 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.551 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:40.551 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.551 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:40.551 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:40.551 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.551 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.551 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.551 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:40.551 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:40.551 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.551 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.551 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.552 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:40.552 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:40.552 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:40.552 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.552 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.552 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:40.552 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:05:40.552 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:40.552 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.552 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.552 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:40.552 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:05:40.552 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:05:40.552 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.552 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.553 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.553 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:05:40.553 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:05:40.553 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.553 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.553 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:40.553 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:05:40.553 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:05:40.553 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.553 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.553 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:40.553 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:05:40.553 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:05:40.553 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.553 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.554 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:40.554 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:05:40.554 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:05:40.554 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.554 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.554 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:40.554 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:05:40.554 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:05:40.554 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.554 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.554 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:40.554 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:05:40.554 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:05:40.554 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.555 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.555 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:40.555 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:05:40.555 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:05:40.555 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.555 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.555 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:40.555 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:05:40.555 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:05:40.555 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.555 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:40.555 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.555 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.555 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.556 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:40.556 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:40.556 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 36.72104461, 2024-04-26T12:05:40.556 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:05:40.556 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:40.556 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.556 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:40.556 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.556 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:40.556 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:40.556 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.556 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.556 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.556 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:40.556 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:40.557 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.557 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.557 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.557 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:40.557 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:40.557 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:40.557 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.557 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.557 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:40.557 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:05:40.557 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:40.557 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.557 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.557 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:40.557 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:05:40.558 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:05:40.558 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.558 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.558 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.558 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:05:40.558 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:05:40.558 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.558 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.558 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:40.558 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:05:40.558 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:05:40.558 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.558 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.558 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:40.558 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:05:40.559 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:05:40.559 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.559 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.559 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:40.559 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:05:40.559 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:05:40.559 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.559 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.559 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:40.559 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:05:40.559 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:05:40.559 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.559 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.559 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:40.560 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:05:40.560 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:05:40.560 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.560 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.560 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:40.560 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:05:40.560 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:05:40.560 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.560 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.560 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:40.560 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:05:40.560 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:05:40.560 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.560 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:40.561 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.561 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.561 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.561 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:40.561 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:40.561 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 36.721022988000001, 2024-04-26T12:05:40.561 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:05:40.561 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:40.561 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.561 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:40.561 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.561 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:40.561 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:40.561 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.561 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.562 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.562 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:40.562 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:40.562 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.562 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.562 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.562 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:40.562 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:40.562 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:40.562 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.562 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.562 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:40.562 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:05:40.562 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:05:40.562 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.563 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.563 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:40.563 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:05:40.563 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:05:40.563 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.563 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.563 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.563 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:05:40.563 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:05:40.563 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.563 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.563 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:40.563 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:05:40.563 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:05:40.564 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.564 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.564 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:40.564 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:05:40.564 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:05:40.564 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.564 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.564 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:40.564 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:05:40.564 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:05:40.564 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.564 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.564 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:40.564 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:05:40.564 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:05:40.565 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.565 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.565 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:40.565 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:05:40.565 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:05:40.565 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.565 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.565 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:40.565 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:05:40.565 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:05:40.565 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.565 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.565 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:40.565 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:05:40.566 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:05:40.566 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.566 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:40.566 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.566 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.566 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.566 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:40.566 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:40.566 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 36.720996421999999, 2024-04-26T12:05:40.566 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:05:40.566 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:40.566 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.566 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:40.566 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.566 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:40.567 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:40.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.567 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:40.567 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:40.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.567 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:40.567 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:05:40.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:40.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.567 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:40.568 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:05:40.568 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:05:40.568 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.568 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:40.568 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:05:40.568 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:05:40.568 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.568 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.568 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:05:40.568 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:05:40.568 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.569 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:40.569 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:05:40.569 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:05:40.569 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.569 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:40.569 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:05:40.569 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:05:40.569 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.569 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:40.569 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:05:40.569 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:05:40.569 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.570 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:40.570 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:05:40.570 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:05:40.570 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.570 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.570 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:40.570 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:05:40.570 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:05:40.570 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.570 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.570 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:40.570 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:05:40.570 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:05:40.570 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.571 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.571 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:40.571 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:05:40.571 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:05:40.571 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.571 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:40.571 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.571 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.571 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.571 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:40.571 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:40.571 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 36.720957910000003, 2024-04-26T12:05:40.571 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:05:40.571 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:40.572 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.572 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:40.572 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.572 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:40.572 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:40.572 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.572 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.572 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.572 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:40.572 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:40.572 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.572 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.572 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.572 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:40.573 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:40.573 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:40.573 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.573 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.573 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:40.573 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:05:40.573 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:05:40.573 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.573 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.573 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:40.573 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:05:40.573 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:05:40.573 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.573 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.573 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.574 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:05:40.574 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:05:40.574 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.574 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.574 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:40.574 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:05:40.574 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:05:40.574 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.574 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.574 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:40.574 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:05:40.574 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:05:40.574 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.574 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.575 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:40.575 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:05:40.575 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:05:40.575 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.575 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.575 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:40.575 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:05:40.575 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:05:40.575 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.575 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.575 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:40.575 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:05:40.575 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:05:40.575 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.576 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.576 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:40.576 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:05:40.576 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:05:40.576 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.576 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.576 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:40.576 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:05:40.576 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:05:40.576 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.576 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:40.576 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.576 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.576 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.576 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:40.577 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:40.577 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 36.720929736999999, 2024-04-26T12:05:40.577 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:05:40.577 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:40.577 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.577 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:40.577 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.577 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:40.577 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:40.577 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.577 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.577 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.577 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:40.577 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:40.578 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.578 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.578 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.578 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:40.578 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:40.578 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:40.578 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.578 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.578 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:40.578 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:05:40.578 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:05:40.578 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.578 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.578 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:40.579 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:05:40.579 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:05:40.579 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.579 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.579 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.579 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:05:40.579 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:05:40.579 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.579 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.579 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:40.579 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:05:40.579 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:05:40.579 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.579 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.579 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:40.580 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:05:40.580 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:05:40.580 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.580 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.580 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:40.580 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:05:40.580 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:05:40.580 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.580 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.580 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:40.580 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:05:40.580 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:05:40.580 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.580 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.581 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:40.581 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:05:40.581 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:05:40.581 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.581 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.581 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:40.581 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:05:40.581 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:05:40.581 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.581 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.581 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:40.581 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:05:40.581 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:05:40.581 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.581 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:40.582 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.582 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.582 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.582 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:40.582 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:40.582 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 36.720895173000002, 2024-04-26T12:05:40.582 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:05:40.582 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:40.582 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.582 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:40.582 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.582 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:40.582 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:40.582 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.583 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.583 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.583 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:40.583 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:40.583 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.583 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.583 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.583 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:40.583 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:05:40.583 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:40.583 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.583 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.583 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:40.583 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:05:40.584 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:05:40.584 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.584 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.584 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:40.584 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:05:40.584 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:05:40.584 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.584 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.584 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.584 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:05:40.584 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:05:40.584 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.584 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.584 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:40.585 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:05:40.585 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:05:40.585 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.585 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.585 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:40.585 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:05:40.585 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:05:40.585 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.585 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.585 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:40.585 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:05:40.585 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:05:40.585 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.585 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.586 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:40.586 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:05:40.586 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:05:40.586 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.586 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.586 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:40.586 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:05:40.586 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:05:40.586 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.586 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.586 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:40.586 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:40.586 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:05:40.586 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.586 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.587 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:40.587 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:05:40.587 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:05:40.587 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.587 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:40.587 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.587 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.587 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.587 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:40.587 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:40.587 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 36.720020392999999, 2024-04-26T12:05:40.587 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:05:40.587 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:40.587 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.588 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:40.588 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.588 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:40.588 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:40.588 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.588 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.588 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.588 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:40.588 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:40.588 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.588 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.588 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.588 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:40.588 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:05:40.588 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:40.589 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.589 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.589 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:40.589 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:05:40.589 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:05:40.589 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.589 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.589 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:40.589 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:05:40.589 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:05:40.589 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.589 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.589 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.589 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:05:40.589 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:05:40.590 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.590 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.590 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:40.590 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:05:40.590 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:05:40.590 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.590 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.590 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:40.590 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:05:40.590 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:05:40.590 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.590 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.590 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:40.590 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:05:40.591 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:05:40.591 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.591 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.591 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:40.591 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:05:40.591 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:05:40.591 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.591 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.591 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:40.591 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:05:40.591 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:05:40.591 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.591 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.591 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:40.591 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:05:40.592 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:05:40.592 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.592 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.592 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:40.592 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:05:40.592 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:05:40.592 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.592 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:40.592 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.592 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.592 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.592 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:40.592 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:40.592 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 36.719981433999997, 2024-04-26T12:05:40.592 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:05:40.593 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:40.593 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.593 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:40.593 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.593 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:40.593 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:40.593 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.593 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.593 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.593 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:40.593 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:40.593 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.593 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.593 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.593 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:40.594 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:05:40.594 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:40.594 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.594 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.594 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:40.594 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:05:40.594 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:05:40.594 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.594 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.594 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:40.594 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:05:40.594 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:05:40.594 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.594 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.594 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.595 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:05:40.595 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:05:40.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.595 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.595 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:40.595 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:05:40.595 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:05:40.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.595 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.595 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:40.595 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:05:40.595 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:05:40.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.595 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.596 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:40.596 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:05:40.596 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:05:40.596 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.596 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.596 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:40.596 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:05:40.596 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:05:40.596 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.596 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.596 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:40.596 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:05:40.596 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:05:40.596 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.596 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.597 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:40.597 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:05:40.597 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:05:40.597 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.597 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.597 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:40.597 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:05:40.597 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:05:40.597 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.597 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:40.597 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.597 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.597 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.597 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:40.597 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:40.598 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 36.719945961999997, 2024-04-26T12:05:40.598 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:05:40.598 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:40.598 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.598 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:40.598 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.598 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:40.598 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:40.598 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.598 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.598 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.598 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:40.598 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:40.598 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.599 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.599 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.599 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:40.599 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:40.599 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:40.599 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.599 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.599 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:40.599 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:05:40.599 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:05:40.599 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.599 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.599 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:40.599 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:05:40.599 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:05:40.600 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.600 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.600 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.600 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:05:40.600 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:05:40.600 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.600 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.600 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:40.600 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:05:40.600 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:05:40.600 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.600 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.600 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:40.600 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:05:40.601 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:05:40.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.601 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:40.601 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:05:40.601 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:05:40.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.601 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:40.601 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:05:40.601 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:05:40.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.601 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:40.601 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:05:40.602 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:05:40.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.602 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.602 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:40.602 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:05:40.602 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:05:40.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.602 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.602 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:40.602 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:05:40.602 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:05:40.602 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.602 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:40.602 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.603 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.603 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:40.603 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:40.603 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 36.719867272999998, 2024-04-26T12:05:40.603 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:05:40.603 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:40.603 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.603 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:40.603 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.603 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:40.603 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:40.603 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.603 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.603 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.603 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:40.604 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:40.604 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.604 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.604 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.604 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:40.604 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:05:40.604 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:40.604 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.604 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.604 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:40.604 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:05:40.604 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:05:40.604 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.604 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.604 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:40.605 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:05:40.605 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:05:40.605 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.605 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.605 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.605 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:05:40.605 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:05:40.605 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.605 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.605 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:40.605 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:05:40.605 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:05:40.605 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.605 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.605 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:40.606 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:05:40.606 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:05:40.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.606 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.606 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:40.606 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:05:40.606 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:05:40.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.606 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.606 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:40.606 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:05:40.606 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:05:40.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.606 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.607 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:40.607 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:05:40.607 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:05:40.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.607 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.607 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:40.607 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:05:40.607 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:05:40.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.607 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.607 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:40.607 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:05:40.607 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:05:40.607 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.608 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:40.608 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.608 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.608 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.608 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:40.608 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:40.608 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 36.719716425000001, 2024-04-26T12:05:40.608 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:05:40.608 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:40.608 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:05:40.608 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:40.608 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.608 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:40.608 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:40.608 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.609 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.609 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.609 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:40.609 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:40.609 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:40.609 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.609 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.609 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:40.609 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:05:40.609 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:40.609 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.609 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.609 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:40.609 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:05:40.609 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:05:40.610 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.610 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.610 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:40.610 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:05:40.610 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:05:40.610 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.610 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.610 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.610 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:05:40.610 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:05:40.610 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.610 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.610 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:40.610 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:05:40.610 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:05:40.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.611 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.611 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:40.611 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:40.611 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:05:40.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:40.611 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:40.611 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:40.611 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:05:40.611 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:05:40.611 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.611 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:40.611 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.611 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:40.612 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:40.612 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:40.613 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:40.614 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:40.612+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:40.714 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:40.713+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:40.718 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:40.718 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:40.718 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:05:40.718 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:40.727 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:40.815 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:40.814+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:40.828 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:40.828 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:40.828 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:05:40.828 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:05:40.828 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:40.837 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:40.869 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-26T12:05:40.916 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:40.915+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:40.939 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:40.939 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:05:40.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:05:40.939 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:05:40.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.939 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:40.939 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:40.939 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 37.157159819999997, 2024-04-26T12:05:40.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:05:40.940 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:40.940 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.940 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:40.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:40.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:40.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:40.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:40.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:40.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:05:40.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:40.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:40.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:05:40.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:05:40.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:40.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:05:40.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:05:40.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:05:40.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:05:40.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:40.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:05:40.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:05:40.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:40.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:40.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:05:40.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:40.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:05:40.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:05:40.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:40.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:05:40.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:05:40.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:40.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:05:40.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:05:40.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:40.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:05:40.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:05:40.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:40.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:05:40.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:05:40.944 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:40.944 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:40.944 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:40.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.945 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:40.945 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:40.945 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 37.157104500000003, 2024-04-26T12:05:40.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:05:40.945 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:40.945 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.945 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:40.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:40.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:40.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:40.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:40.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:40.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:05:40.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:40.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:40.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:05:40.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:05:40.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:40.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:05:40.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:05:40.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:05:40.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:05:40.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:40.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:05:40.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:05:40.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:40.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:05:40.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:05:40.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:40.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:05:40.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:05:40.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:40.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:05:40.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:05:40.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:40.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:05:40.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:05:40.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:40.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:05:40.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:05:40.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:40.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:05:40.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:05:40.950 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:40.950 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:40.950 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:40.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.950 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:40.950 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:40.950 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 37.157054481999999, 2024-04-26T12:05:40.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:05:40.951 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:40.951 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.951 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:40.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:40.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:40.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:40.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:40.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:40.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:05:40.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:40.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:40.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:05:40.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:05:40.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:40.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:05:40.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:05:40.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:05:40.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:05:40.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:40.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:05:40.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:05:40.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:40.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:05:40.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:05:40.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:40.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:05:40.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:05:40.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:40.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:05:40.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:05:40.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:40.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:05:40.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:05:40.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:40.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:05:40.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:05:40.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:40.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:05:40.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:05:40.955 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:40.955 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:40.955 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:40.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.956 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:40.956 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:40.956 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 37.157019845000001, 2024-04-26T12:05:40.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:05:40.956 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:40.956 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.956 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:40.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:40.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:40.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:40.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:40.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:40.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:05:40.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:40.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:40.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:05:40.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:05:40.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:40.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:40.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:05:40.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:05:40.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:05:40.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:40.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:05:40.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:05:40.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:40.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:05:40.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:05:40.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:40.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:05:40.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:05:40.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:40.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:05:40.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:05:40.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:40.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:05:40.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:05:40.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:40.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:05:40.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:05:40.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:40.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:05:40.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:05:40.961 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:40.961 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:40.961 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:40.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.961 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:40.961 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:40.961 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 37.156981332999997, 2024-04-26T12:05:40.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:05:40.961 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:40.961 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.961 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:40.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:40.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:40.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:40.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:40.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:40.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:40.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:40.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:40.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:40.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:05:40.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:40.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:05:40.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:05:40.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:05:40.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:05:40.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:40.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:05:40.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:05:40.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:40.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:05:40.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:05:40.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:40.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:05:40.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:05:40.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:40.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:05:40.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:05:40.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:40.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:05:40.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:05:40.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:40.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:05:40.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:05:40.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:40.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:05:40.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:05:40.966 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:40.966 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:40.966 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:40.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.966 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:40.967 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:40.967 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 37.15695101, 2024-04-26T12:05:40.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:05:40.967 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:40.967 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.967 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:40.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:40.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:40.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:40.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:40.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:40.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:40.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:40.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:40.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:05:40.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:05:40.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:40.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:05:40.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:05:40.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:05:40.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:05:40.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:40.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:05:40.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:05:40.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:40.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:05:40.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:05:40.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:40.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:05:40.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:05:40.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:40.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:05:40.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:05:40.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:40.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:05:40.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:05:40.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:40.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:05:40.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:05:40.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:40.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:05:40.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:05:40.971 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:40.971 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:40.971 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:40.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.972 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:40.972 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:40.972 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 37.156924308000001, 2024-04-26T12:05:40.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:05:40.972 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:40.972 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:40.972 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:40.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:40.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:40.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:40.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:40.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:40.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:40.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:40.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:40.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:05:40.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:05:40.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:40.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:05:40.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:05:40.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:05:40.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:05:40.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:40.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:05:40.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:05:40.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:40.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:05:40.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:05:40.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:40.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:05:40.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:05:40.975 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:40.975 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:40.975 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:40.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.976 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:40.976 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:40.976 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 37.156882017999997, 2024-04-26T12:05:40.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:05:40.976 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:40.976 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:40.976 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:40.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:40.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:40.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:40.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:40.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:40.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:40.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:40.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:40.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:05:40.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:05:40.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:40.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:05:40.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:05:40.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:05:40.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:05:40.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:40.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:05:40.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:05:40.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:40.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:05:40.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:05:40.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:40.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:05:40.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:05:40.979 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:40.979 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:40.979 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:40.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.980 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:40.980 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:40.980 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 37.156853939999998, 2024-04-26T12:05:40.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:05:40.980 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:40.980 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:40.980 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:40.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:40.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:40.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:40.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:40.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:40.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:05:40.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:40.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:40.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:05:40.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:05:40.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:40.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:05:40.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:05:40.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:40.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:05:40.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:40.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:40.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:05:40.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:40.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:05:40.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:05:40.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:40.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:05:40.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:05:40.983 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:40.983 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:40.983 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:40.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.984 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:40.984 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:40.984 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 37.150858589999999, 2024-04-26T12:05:40.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:05:40.984 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:40.984 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.984 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:40.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:40.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:40.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:40.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:40.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:40.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:05:40.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:40.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:40.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:05:40.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:05:40.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:40.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:05:40.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:05:40.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:05:40.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:05:40.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:40.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:05:40.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:05:40.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:40.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:05:40.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:05:40.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:40.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:05:40.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:05:40.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:40.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:05:40.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:05:40.988 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:40.988 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:40.988 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:40.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.988 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:40.988 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:40.988 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 37.150789623999998, 2024-04-26T12:05:40.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:05:40.988 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:40.988 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.989 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:40.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:40.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:40.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:40.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:40.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:40.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:05:40.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:40.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:40.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:05:40.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:05:40.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:40.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:05:40.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:05:40.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:05:40.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:05:40.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:40.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:05:40.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:05:40.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:40.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:40.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:05:40.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:40.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:05:40.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:05:40.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.992 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:40.992 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:05:40.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:05:40.992 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:40.992 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:40.992 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:40.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.992 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:40.992 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:40.992 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 37.150295260999997, 2024-04-26T12:05:40.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:05:40.993 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:40.993 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.993 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:40.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:40.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:40.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:40.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:40.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:40.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:40.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:40.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:40.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:05:40.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:05:40.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:40.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:05:40.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:05:40.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:05:40.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:05:40.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:40.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:05:40.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:05:40.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:40.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:05:40.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:05:40.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:40.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:05:40.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:05:40.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:40.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:05:40.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:05:40.996 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:40.996 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:40.996 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:40.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.997 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:40.997 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:40.997 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 37.150256996000003, 2024-04-26T12:05:40.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:05:40.997 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:40.997 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:40.997 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:40.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.997 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:40.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:40.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.997 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.997 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:40.998 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:40.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:40.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:40.998 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:40.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:40.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:40.998 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:05:40.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:05:40.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:40.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:05:40.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:05:40.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:40.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:05:40.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:05:40.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:40.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:05:40.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:05:40.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:40.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:40.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:41.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:05:41.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:05:41.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:41.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:05:41.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:05:41.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:41.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:05:41.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:05:41.000 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:41.000 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:41.000 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:41.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.001 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:05:41.001 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:41.001 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 37.149577110999999, 2024-04-26T12:05:41.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:05:41.001 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:41.001 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:41.001 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:41.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.001 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:41.001 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:41.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:41.001 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.001 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:41.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:41.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:41.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:41.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:41.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:41.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:05:41.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:05:41.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:41.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:05:41.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:05:41.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:05:41.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:05:41.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:41.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:05:41.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:05:41.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:41.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:05:41.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:05:41.004 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:41.004 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:41.004 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:41.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.004 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:41.004 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:41.004 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 37.149547931999997, 2024-04-26T12:05:41.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:05:41.004 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:41.004 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:41.004 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:41.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.005 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:41.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:41.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:41.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.005 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:41.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:41.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:41.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.005 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:41.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:05:41.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.006 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.006 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:41.006 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:05:41.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:05:41.006 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.006 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.006 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:41.006 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:05:41.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:05:41.006 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.006 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.006 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.006 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:05:41.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:05:41.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:41.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:05:41.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:05:41.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:41.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:05:41.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:05:41.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:41.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:05:41.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:05:41.008 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:41.008 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:41.008 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:41.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.008 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:41.008 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:41.008 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 37.149516120999998, 2024-04-26T12:05:41.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:05:41.008 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:41.008 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:41.008 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:41.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:41.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:41.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:41.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:41.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:41.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:41.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:41.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:41.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:05:41.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.010 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:41.010 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:05:41.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:05:41.010 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.010 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:41.010 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:05:41.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:05:41.010 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.010 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.010 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:05:41.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:05:41.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.011 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:41.011 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:05:41.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:05:41.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.011 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:41.011 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:05:41.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:05:41.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.011 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:41.011 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:05:41.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:05:41.012 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:41.012 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:41.012 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:41.012 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.012 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:41.012 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:41.012 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 37.149494765, 2024-04-26T12:05:41.012 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:05:41.012 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:41.012 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:41.012 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:41.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.012 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:41.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:41.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:41.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.013 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:41.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:41.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:41.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.013 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:41.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:41.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:05:41.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:41.014 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:05:41.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:05:41.014 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:41.014 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:05:41.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:05:41.014 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.014 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:05:41.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:05:41.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:41.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:05:41.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:05:41.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:41.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:05:41.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:05:41.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:41.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:05:41.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:05:41.016 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:41.016 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:41.016 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:41.016 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.016 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:05:41.016 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:41.016 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 37.149466312000001, 2024-04-26T12:05:41.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:05:41.016 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:41.016 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:41.016 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:41.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:41.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:41.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:41.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.017 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:41.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:41.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:41.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.017 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:41.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:41.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.017 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:41.018 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:05:41.018 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:05:41.018 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.018 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.018 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:41.018 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:05:41.018 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:05:41.018 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.018 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.018 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.018 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:05:41.018 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:05:41.019 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.019 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.019 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:41.019 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:05:41.019 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:05:41.019 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.019 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.019 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:41.019 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:05:41.019 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:05:41.019 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:41.019 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:41.019 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:41.019 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.020 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.020 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:05:41.020 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:41.020 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 37.148744506, 2024-04-26T12:05:41.020 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:05:41.020 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:41.020 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:41.020 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:41.020 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.020 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:41.020 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:41.020 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:41.020 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.020 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.021 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:41.021 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:41.021 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:41.021 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.021 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.021 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:41.021 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:05:41.021 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:41.021 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.021 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.021 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:41.021 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:05:41.021 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:05:41.021 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.022 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.022 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:41.022 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:05:41.022 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:05:41.022 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.022 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.022 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.022 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:05:41.022 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:05:41.022 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.022 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.022 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:41.022 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:05:41.022 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:05:41.023 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.023 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.023 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:41.023 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:05:41.023 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:05:41.023 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:41.023 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:41.023 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:41.023 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.023 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.023 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:05:41.023 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:41.025 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 31.431817902999999, 2024-04-26T12:05:41.025 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:05:41.025 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:41.025 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.025 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:41.025 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.025 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:41.025 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:41.025 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:41.025 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.025 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:41.026 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:41.026 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:41.026 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:41.026 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:05:41.026 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:05:41.026 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:41.026 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:05:41.026 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:05:41.027 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.027 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.027 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:41.027 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:05:41.027 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:05:41.027 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.027 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.027 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.027 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:05:41.027 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:05:41.027 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.027 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.027 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:41.027 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:05:41.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:05:41.028 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.028 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.028 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:41.028 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:05:41.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:05:41.028 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.028 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.028 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:41.028 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:05:41.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:05:41.028 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.028 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.028 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:41.028 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:05:41.029 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:05:41.029 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.029 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.029 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.029 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:05:41.029 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:05:41.029 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.029 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.029 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:41.029 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:05:41.029 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:05:41.029 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:41.029 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:41.029 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:41.030 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:05:41.030 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:05:41.030 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:41.030 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:41.030 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:41.030 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:41.030 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:41.030 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:41.032 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:41.032 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:41.030+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:41.132 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:41.131+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:41.140 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:41.140 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:05:41.140 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-04-26T12:05:41.140 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:41.148 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:41.232 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:41.232+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:41.249 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:41.250 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:05:41.250 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T12:05:41.250 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T12:05:41.250 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:41.258 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:41.333 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:41.332+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:41.362 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:41.362 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T12:05:41.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T12:05:41.362 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T12:05:41.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.362 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:41.362 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:41.363 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.579961130000001, 2024-04-26T12:05:41.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017255857999999999, 2024-04-26T12:05:41.363 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:41.363 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.363 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:41.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:41.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:41.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:41.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:41.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:41.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780340+0000", 2024-04-26T12:05:41.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:41.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:41.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780351+0000", 2024-04-26T12:05:41.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0898e-05 2024-04-26T12:05:41.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:41.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:41.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1671999999999999e-05 2024-04-26T12:05:41.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780374+0000", 2024-04-26T12:05:41.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1117999999999999e-05 2024-04-26T12:05:41.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780423+0000", 2024-04-26T12:05:41.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9066000000000001e-05 2024-04-26T12:05:41.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:41.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780428+0000", 2024-04-26T12:05:41.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1320000000000002e-06 2024-04-26T12:05:41.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788902+0000", 2024-04-26T12:05:41.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084738560000000001 2024-04-26T12:05:41.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:41.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789167+0000", 2024-04-26T12:05:41.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026521100000000001 2024-04-26T12:05:41.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:41.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789279+0000", 2024-04-26T12:05:41.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111616 2024-04-26T12:05:41.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792335+0000", 2024-04-26T12:05:41.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030556419999999999 2024-04-26T12:05:41.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:41.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797519+0000", 2024-04-26T12:05:41.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051841550000000002 2024-04-26T12:05:41.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:41.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797559+0000", 2024-04-26T12:05:41.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0451999999999998e-05 2024-04-26T12:05:41.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:41.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797598+0000", 2024-04-26T12:05:41.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8500000000000001e-05 2024-04-26T12:05:41.368 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.368 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:41.368 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.368 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:41.369 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:41.369 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.579912823000001, 2024-04-26T12:05:41.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017668725, 2024-04-26T12:05:41.369 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:41.369 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.369 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:41.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:41.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:41.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:41.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:41.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:41.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:41.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:41.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780395+0000", 2024-04-26T12:05:41.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.198e-06 2024-04-26T12:05:41.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:41.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780402+0000", 2024-04-26T12:05:41.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:05:41.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780408+0000", 2024-04-26T12:05:41.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:41.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780481+0000", 2024-04-26T12:05:41.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3239999999999997e-05 2024-04-26T12:05:41.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:41.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780485+0000", 2024-04-26T12:05:41.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4039999999999999e-06 2024-04-26T12:05:41.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789518+0000", 2024-04-26T12:05:41.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090335480000000006 2024-04-26T12:05:41.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:41.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789585+0000", 2024-04-26T12:05:41.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6469000000000003e-05 2024-04-26T12:05:41.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:41.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789699+0000", 2024-04-26T12:05:41.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114613 2024-04-26T12:05:41.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793308+0000", 2024-04-26T12:05:41.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036088520000000001 2024-04-26T12:05:41.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:41.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797887+0000", 2024-04-26T12:05:41.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0045792790000000003 2024-04-26T12:05:41.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:41.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797955+0000", 2024-04-26T12:05:41.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T12:05:41.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:41.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798059+0000", 2024-04-26T12:05:41.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103874 2024-04-26T12:05:41.374 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.374 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:41.374 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.374 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:41.374 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:41.375 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.579882550999997, 2024-04-26T12:05:41.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017735145000000001, 2024-04-26T12:05:41.375 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:41.375 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.375 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:41.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:41.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:41.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:41.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:41.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:41.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:41.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:41.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780424+0000", 2024-04-26T12:05:41.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4519999999999999e-06 2024-04-26T12:05:41.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:41.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780431+0000", 2024-04-26T12:05:41.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0690000000000004e-06 2024-04-26T12:05:41.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780438+0000", 2024-04-26T12:05:41.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5719999999999999e-06 2024-04-26T12:05:41.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780468+0000", 2024-04-26T12:05:41.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.993e-05 2024-04-26T12:05:41.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:41.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780472+0000", 2024-04-26T12:05:41.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-04-26T12:05:41.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789916+0000", 2024-04-26T12:05:41.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094434940000000002 2024-04-26T12:05:41.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:41.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790004+0000", 2024-04-26T12:05:41.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8085999999999997e-05 2024-04-26T12:05:41.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:41.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790125+0000", 2024-04-26T12:05:41.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012186200000000001 2024-04-26T12:05:41.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793402+0000", 2024-04-26T12:05:41.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00327685 2024-04-26T12:05:41.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:41.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798068+0000", 2024-04-26T12:05:41.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046652150000000003 2024-04-26T12:05:41.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:41.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798108+0000", 2024-04-26T12:05:41.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0911000000000002e-05 2024-04-26T12:05:41.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:41.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798156+0000", 2024-04-26T12:05:41.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7128e-05 2024-04-26T12:05:41.380 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.380 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:41.380 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.381 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:41.381 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:41.381 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.579859532, 2024-04-26T12:05:41.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017792624, 2024-04-26T12:05:41.381 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:41.381 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.381 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:41.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:41.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:41.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:41.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:41.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:41.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:41.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:41.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780447+0000", 2024-04-26T12:05:41.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8519999999999997e-06 2024-04-26T12:05:41.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:41.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780453+0000", 2024-04-26T12:05:41.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2999999999999998e-06 2024-04-26T12:05:41.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:41.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0760000000000002e-06 2024-04-26T12:05:41.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780502+0000", 2024-04-26T12:05:41.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4079999999999998e-05 2024-04-26T12:05:41.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:41.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:41.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5450000000000002e-06 2024-04-26T12:05:41.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790390+0000", 2024-04-26T12:05:41.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098850759999999996 2024-04-26T12:05:41.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:41.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790447+0000", 2024-04-26T12:05:41.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6752999999999997e-05 2024-04-26T12:05:41.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:41.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790547+0000", 2024-04-26T12:05:41.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100344 2024-04-26T12:05:41.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793864+0000", 2024-04-26T12:05:41.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033169749999999998 2024-04-26T12:05:41.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:41.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798164+0000", 2024-04-26T12:05:41.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043000690000000001 2024-04-26T12:05:41.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:41.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798204+0000", 2024-04-26T12:05:41.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9478999999999999e-05 2024-04-26T12:05:41.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:41.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798236+0000", 2024-04-26T12:05:41.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2478999999999999e-05 2024-04-26T12:05:41.386 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.386 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:41.386 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.386 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:41.386 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:41.386 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.579819188999998, 2024-04-26T12:05:41.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016989500000000001, 2024-04-26T12:05:41.387 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:41.387 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.387 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:41.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:41.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:41.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:41.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:41.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:41.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780483+0000", 2024-04-26T12:05:41.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:41.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780488+0000", 2024-04-26T12:05:41.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6260000000000003e-06 2024-04-26T12:05:41.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:41.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780499+0000", 2024-04-26T12:05:41.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1236000000000001e-05 2024-04-26T12:05:41.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:41.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4569999999999996e-06 2024-04-26T12:05:41.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780529+0000", 2024-04-26T12:05:41.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4579e-05 2024-04-26T12:05:41.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:41.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780532+0000", 2024-04-26T12:05:41.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.74e-06 2024-04-26T12:05:41.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788868+0000", 2024-04-26T12:05:41.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0083357650000000002 2024-04-26T12:05:41.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:41.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789142+0000", 2024-04-26T12:05:41.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027472 2024-04-26T12:05:41.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:41.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789241+0000", 2024-04-26T12:05:41.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8394999999999996e-05 2024-04-26T12:05:41.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792096+0000", 2024-04-26T12:05:41.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002855677 2024-04-26T12:05:41.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:41.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797379+0000", 2024-04-26T12:05:41.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052822379999999999 2024-04-26T12:05:41.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:41.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797433+0000", 2024-04-26T12:05:41.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4109e-05 2024-04-26T12:05:41.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:41.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797473+0000", 2024-04-26T12:05:41.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0533e-05 2024-04-26T12:05:41.392 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.392 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:41.392 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.392 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:41.392 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:41.393 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.579779575000003, 2024-04-26T12:05:41.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017295965, 2024-04-26T12:05:41.393 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:41.393 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.393 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:41.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:41.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:41.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:41.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:41.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:41.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780513+0000", 2024-04-26T12:05:41.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999895 2024-04-26T12:05:41.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:41.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780528+0000", 2024-04-26T12:05:41.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5089000000000001e-05 2024-04-26T12:05:41.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:41.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780537+0000", 2024-04-26T12:05:41.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8400000000000001e-06 2024-04-26T12:05:41.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780544+0000", 2024-04-26T12:05:41.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.917e-06 2024-04-26T12:05:41.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780571+0000", 2024-04-26T12:05:41.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7032000000000001e-05 2024-04-26T12:05:41.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:41.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780574+0000", 2024-04-26T12:05:41.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:05:41.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789436+0000", 2024-04-26T12:05:41.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088622240000000001 2024-04-26T12:05:41.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:41.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789525+0000", 2024-04-26T12:05:41.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8549999999999998e-05 2024-04-26T12:05:41.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:41.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789642+0000", 2024-04-26T12:05:41.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011772100000000001 2024-04-26T12:05:41.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792129+0000", 2024-04-26T12:05:41.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024871709999999998 2024-04-26T12:05:41.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:41.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797732+0000", 2024-04-26T12:05:41.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056027580000000002 2024-04-26T12:05:41.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:41.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797777+0000", 2024-04-26T12:05:41.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4620999999999999e-05 2024-04-26T12:05:41.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:41.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797819+0000", 2024-04-26T12:05:41.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2536000000000001e-05 2024-04-26T12:05:41.398 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.398 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:41.398 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.398 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:41.398 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:41.398 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.579750625000003, 2024-04-26T12:05:41.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017840163999999999, 2024-04-26T12:05:41.398 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:41.399 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.399 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:41.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:41.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:41.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:41.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:41.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:41.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:41.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:41.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:41.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5419999999999999e-06 2024-04-26T12:05:41.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:41.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780563+0000", 2024-04-26T12:05:41.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:05:41.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780569+0000", 2024-04-26T12:05:41.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1479999999999997e-06 2024-04-26T12:05:41.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780594+0000", 2024-04-26T12:05:41.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5585e-05 2024-04-26T12:05:41.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:41.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780596+0000", 2024-04-26T12:05:41.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2630000000000002e-06 2024-04-26T12:05:41.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789932+0000", 2024-04-26T12:05:41.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093360479999999996 2024-04-26T12:05:41.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:41.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790070+0000", 2024-04-26T12:05:41.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013771399999999999 2024-04-26T12:05:41.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:41.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790219+0000", 2024-04-26T12:05:41.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014872299999999999 2024-04-26T12:05:41.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793632+0000", 2024-04-26T12:05:41.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003413368 2024-04-26T12:05:41.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:41.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798244+0000", 2024-04-26T12:05:41.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046113819999999998 2024-04-26T12:05:41.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:41.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798361+0000", 2024-04-26T12:05:41.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117726 2024-04-26T12:05:41.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:41.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798393+0000", 2024-04-26T12:05:41.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1099999999999997e-05 2024-04-26T12:05:41.404 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.404 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:41.404 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.404 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:41.404 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:41.404 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.579725699999997, 2024-04-26T12:05:41.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016645943, 2024-04-26T12:05:41.404 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:41.404 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:41.405 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:41.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:41.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:41.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:41.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:41.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:41.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:41.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:41.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780580+0000", 2024-04-26T12:05:41.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1549999999999999e-06 2024-04-26T12:05:41.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:41.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780588+0000", 2024-04-26T12:05:41.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:05:41.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780593+0000", 2024-04-26T12:05:41.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2399999999999998e-06 2024-04-26T12:05:41.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780628+0000", 2024-04-26T12:05:41.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5426000000000003e-05 2024-04-26T12:05:41.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:41.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780632+0000", 2024-04-26T12:05:41.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:05:41.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788288+0000", 2024-04-26T12:05:41.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076555879999999996 2024-04-26T12:05:41.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:41.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788570+0000", 2024-04-26T12:05:41.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028233700000000002 2024-04-26T12:05:41.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:41.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797223+0000", 2024-04-26T12:05:41.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086529150000000006 2024-04-26T12:05:41.409 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.409 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:41.409 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.409 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:41.409 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:41.409 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.579701731, 2024-04-26T12:05:41.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016536068000000001, 2024-04-26T12:05:41.409 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:41.409 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:41.409 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:41.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:41.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:41.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:41.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:41.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:41.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:41.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:41.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780609+0000", 2024-04-26T12:05:41.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8280000000000003e-06 2024-04-26T12:05:41.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:41.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780616+0000", 2024-04-26T12:05:41.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4939999999999997e-06 2024-04-26T12:05:41.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780621+0000", 2024-04-26T12:05:41.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6040000000000003e-06 2024-04-26T12:05:41.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780647+0000", 2024-04-26T12:05:41.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6441999999999999e-05 2024-04-26T12:05:41.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:41.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780650+0000", 2024-04-26T12:05:41.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4430000000000002e-06 2024-04-26T12:05:41.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788163+0000", 2024-04-26T12:05:41.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007513774 2024-04-26T12:05:41.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:41.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788307+0000", 2024-04-26T12:05:41.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014374400000000001 2024-04-26T12:05:41.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:41.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797137+0000", 2024-04-26T12:05:41.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088302160000000001 2024-04-26T12:05:41.413 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.413 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:41.413 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.413 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:41.414 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:41.414 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.576825458999998, 2024-04-26T12:05:41.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012911448000000001, 2024-04-26T12:05:41.414 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:41.414 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.414 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:41.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:41.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:41.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:41.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:41.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:41.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783477+0000", 2024-04-26T12:05:41.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:41.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783482+0000", 2024-04-26T12:05:41.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5709999999999999e-06 2024-04-26T12:05:41.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:41.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783491+0000", 2024-04-26T12:05:41.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3610000000000007e-06 2024-04-26T12:05:41.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783498+0000", 2024-04-26T12:05:41.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4209999999999998e-06 2024-04-26T12:05:41.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786045+0000", 2024-04-26T12:05:41.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0025465739999999998 2024-04-26T12:05:41.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:41.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786061+0000", 2024-04-26T12:05:41.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6348999999999999e-05 2024-04-26T12:05:41.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:41.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796342+0000", 2024-04-26T12:05:41.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010280643000000001 2024-04-26T12:05:41.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:41.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796389+0000", 2024-04-26T12:05:41.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6912000000000001e-05 2024-04-26T12:05:41.417 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.417 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:41.418 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.418 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:41.418 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:41.418 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.576797153000001, 2024-04-26T12:05:41.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013376469, 2024-04-26T12:05:41.418 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:41.418 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.418 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:41.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:41.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:41.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:41.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:41.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:41.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:41.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:41.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783516+0000", 2024-04-26T12:05:41.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.041e-05 2024-04-26T12:05:41.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:41.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783523+0000", 2024-04-26T12:05:41.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5749999999999997e-06 2024-04-26T12:05:41.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783528+0000", 2024-04-26T12:05:41.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5029999999999997e-06 2024-04-26T12:05:41.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787662+0000", 2024-04-26T12:05:41.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041336230000000003 2024-04-26T12:05:41.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:41.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787687+0000", 2024-04-26T12:05:41.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5769999999999999e-05 2024-04-26T12:05:41.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:41.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796817+0000", 2024-04-26T12:05:41.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091296750000000003 2024-04-26T12:05:41.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:41.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796882+0000", 2024-04-26T12:05:41.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5180999999999998e-05 2024-04-26T12:05:41.422 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.422 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:41.422 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.422 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:41.422 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:41.422 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.576728611999997, 2024-04-26T12:05:41.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013457291999999999, 2024-04-26T12:05:41.422 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:41.422 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.422 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:41.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:41.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:41.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:41.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:41.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:41.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:41.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:41.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783578+0000", 2024-04-26T12:05:41.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.659e-06 2024-04-26T12:05:41.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:41.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783584+0000", 2024-04-26T12:05:41.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:41.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783588+0000", 2024-04-26T12:05:41.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6190000000000002e-06 2024-04-26T12:05:41.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787834+0000", 2024-04-26T12:05:41.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042460529999999996 2024-04-26T12:05:41.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:41.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787854+0000", 2024-04-26T12:05:41.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9658999999999999e-05 2024-04-26T12:05:41.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:41.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:41.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009107604 2024-04-26T12:05:41.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:41.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797032+0000", 2024-04-26T12:05:41.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9987000000000006e-05 2024-04-26T12:05:41.426 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.426 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:41.426 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.426 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:41.426 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:41.426 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.574882232999997, 2024-04-26T12:05:41.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011003015999999999, 2024-04-26T12:05:41.427 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:41.427 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.427 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:41.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:41.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:41.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:41.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:41.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:41.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785420+0000", 2024-04-26T12:05:41.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:41.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785427+0000", 2024-04-26T12:05:41.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:05:41.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:41.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785438+0000", 2024-04-26T12:05:41.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069e-05 2024-04-26T12:05:41.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785457+0000", 2024-04-26T12:05:41.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8617000000000001e-05 2024-04-26T12:05:41.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786628+0000", 2024-04-26T12:05:41.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001171418 2024-04-26T12:05:41.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:41.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786651+0000", 2024-04-26T12:05:41.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3289e-05 2024-04-26T12:05:41.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:41.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796393+0000", 2024-04-26T12:05:41.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097413269999999993 2024-04-26T12:05:41.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:41.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796424+0000", 2024-04-26T12:05:41.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1188e-05 2024-04-26T12:05:41.430 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.430 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:41.430 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.431 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:41.431 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:41.431 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.574335486999999, 2024-04-26T12:05:41.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010561432000000001, 2024-04-26T12:05:41.431 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:41.431 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.431 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:41.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:41.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:41.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:41.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:41.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:41.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:41.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:41.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785973+0000", 2024-04-26T12:05:41.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4910000000000002e-06 2024-04-26T12:05:41.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:41.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785991+0000", 2024-04-26T12:05:41.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7663e-05 2024-04-26T12:05:41.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785998+0000", 2024-04-26T12:05:41.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1239999999999999e-06 2024-04-26T12:05:41.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786792+0000", 2024-04-26T12:05:41.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079334800000000003 2024-04-26T12:05:41.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:41.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786810+0000", 2024-04-26T12:05:41.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8746999999999999e-05 2024-04-26T12:05:41.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:41.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796500+0000", 2024-04-26T12:05:41.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096897619999999993 2024-04-26T12:05:41.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:41.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796529+0000", 2024-04-26T12:05:41.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8873999999999998e-05 2024-04-26T12:05:41.435 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.435 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:41.435 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.435 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:41.435 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:41.435 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.574256401, 2024-04-26T12:05:41.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010219911, 2024-04-26T12:05:41.435 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:41.435 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.435 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:41.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:41.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:41.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:41.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:41.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:41.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786046+0000", 2024-04-26T12:05:41.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:41.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786053+0000", 2024-04-26T12:05:41.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0360000000000001e-06 2024-04-26T12:05:41.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:41.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786064+0000", 2024-04-26T12:05:41.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1202999999999999e-05 2024-04-26T12:05:41.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786091+0000", 2024-04-26T12:05:41.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6859000000000002e-05 2024-04-26T12:05:41.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786212+0000", 2024-04-26T12:05:41.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120975 2024-04-26T12:05:41.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:41.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786236+0000", 2024-04-26T12:05:41.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4358999999999998e-05 2024-04-26T12:05:41.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:41.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796236+0000", 2024-04-26T12:05:41.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099998050000000005 2024-04-26T12:05:41.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:41.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796266+0000", 2024-04-26T12:05:41.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0278e-05 2024-04-26T12:05:41.439 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.439 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:41.439 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.439 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:3 3.14 e17/15 3:287034c4:::1.00000000.inode:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:41.439 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:41.439 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.573467440000002, 2024-04-26T12:05:41.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009764712, 2024-04-26T12:05:41.439 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:41.440 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.440 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:41.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:41.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:41.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:41.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:41.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:41.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786835+0000", 2024-04-26T12:05:41.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T12:05:41.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:41.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786844+0000", 2024-04-26T12:05:41.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6500000000000008e-06 2024-04-26T12:05:41.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:41.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786855+0000", 2024-04-26T12:05:41.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0932e-05 2024-04-26T12:05:41.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786864+0000", 2024-04-26T12:05:41.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2150000000000007e-06 2024-04-26T12:05:41.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787242+0000", 2024-04-26T12:05:41.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037708300000000001 2024-04-26T12:05:41.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:41.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787259+0000", 2024-04-26T12:05:41.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7258999999999999e-05 2024-04-26T12:05:41.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:41.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796579+0000", 2024-04-26T12:05:41.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093201099999999995 2024-04-26T12:05:41.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:41.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796600+0000", 2024-04-26T12:05:41.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1330000000000001e-05 2024-04-26T12:05:41.443 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.443 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:41.443 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.443 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:41.444 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:41.444 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.573423417999997, 2024-04-26T12:05:41.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096431940000000008, 2024-04-26T12:05:41.444 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:41.444 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.444 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:41.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:41.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:41.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:41.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:41.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:41.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786879+0000", 2024-04-26T12:05:41.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:41.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786887+0000", 2024-04-26T12:05:41.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9300000000000003e-06 2024-04-26T12:05:41.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:41.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786894+0000", 2024-04-26T12:05:41.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:05:41.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786899+0000", 2024-04-26T12:05:41.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8400000000000002e-06 2024-04-26T12:05:41.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786932+0000", 2024-04-26T12:05:41.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3031999999999998e-05 2024-04-26T12:05:41.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:41.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786945+0000", 2024-04-26T12:05:41.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3421000000000001e-05 2024-04-26T12:05:41.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:41.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796469+0000", 2024-04-26T12:05:41.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095236130000000002 2024-04-26T12:05:41.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:41.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796523+0000", 2024-04-26T12:05:41.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4089999999999999e-05 2024-04-26T12:05:41.447 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.447 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:41.448 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.448 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "pg_update_log_missing(3.14 epoch 17/15 rep_tid 169 entries 17'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:05:41.448 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:41.448 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.573360262999998, 2024-04-26T12:05:41.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097257639999999996, 2024-04-26T12:05:41.448 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:41.448 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-04-26T12:05:41.448 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:41.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:41.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:41.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:41.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:41.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:41.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786942+0000", 2024-04-26T12:05:41.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:41.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786951+0000", 2024-04-26T12:05:41.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:05:41.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:41.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786965+0000", 2024-04-26T12:05:41.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4268e-05 2024-04-26T12:05:41.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786977+0000", 2024-04-26T12:05:41.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1667e-05 2024-04-26T12:05:41.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787667+0000", 2024-04-26T12:05:41.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00069057400000000001 2024-04-26T12:05:41.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:41.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796668+0000", 2024-04-26T12:05:41.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090013309999999996 2024-04-26T12:05:41.451 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.451 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:41.451 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.451 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:41.451 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:41.451 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.573307120000003, 2024-04-26T12:05:41.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095908309999999993, 2024-04-26T12:05:41.452 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:41.452 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.452 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:41.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:41.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:41.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:41.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:41.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:41.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786995+0000", 2024-04-26T12:05:41.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:41.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787001+0000", 2024-04-26T12:05:41.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5099999999999998e-06 2024-04-26T12:05:41.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:41.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787009+0000", 2024-04-26T12:05:41.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9100000000000005e-06 2024-04-26T12:05:41.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787019+0000", 2024-04-26T12:05:41.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8109999999999997e-06 2024-04-26T12:05:41.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787136+0000", 2024-04-26T12:05:41.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011749899999999999 2024-04-26T12:05:41.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:41.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787154+0000", 2024-04-26T12:05:41.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8278999999999999e-05 2024-04-26T12:05:41.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:41.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796561+0000", 2024-04-26T12:05:41.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094064379999999996 2024-04-26T12:05:41.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:41.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796587+0000", 2024-04-26T12:05:41.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5856000000000001e-05 2024-04-26T12:05:41.455 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.455 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:41.455 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.455 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:41.455 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:41.455 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.572590063, 2024-04-26T12:05:41.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096460160000000003, 2024-04-26T12:05:41.456 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:41.456 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.456 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:41.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:41.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:41.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:41.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:41.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:41.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:41.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787712+0000", 2024-04-26T12:05:41.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:41.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787718+0000", 2024-04-26T12:05:41.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:05:41.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:41.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787727+0000", 2024-04-26T12:05:41.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.123e-06 2024-04-26T12:05:41.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787734+0000", 2024-04-26T12:05:41.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.391e-06 2024-04-26T12:05:41.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:41.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788867+0000", 2024-04-26T12:05:41.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001133207 2024-04-26T12:05:41.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:41.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788899+0000", 2024-04-26T12:05:41.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1526000000000003e-05 2024-04-26T12:05:41.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:41.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797328+0000", 2024-04-26T12:05:41.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084295389999999998 2024-04-26T12:05:41.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:41.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:41.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:41.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797359+0000", 2024-04-26T12:05:41.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0660999999999997e-05 2024-04-26T12:05:41.459 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.459 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:41.459 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.459 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:41.459 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:41.459 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:41.461 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:41.461 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:41.460+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:41.561 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:41.560+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:41.574 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:41.574 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:05:41.574 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:05:41.574 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:41.584 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:41.662 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:41.661+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:41.727 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:41.727 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:05:41.727 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:05:41.727 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:05:41.728 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:41.736 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:41.763 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:41.762+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:41.839 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:41.839 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:05:41.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:05:41.839 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:05:41.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.839 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:41.839 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:41.839 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 47.981987322000002, 2024-04-26T12:05:41.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:05:41.840 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:41.840 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.840 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:41.840 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:41.840 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:41.840 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:05:41.840 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.840 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:41.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:41.840 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:41.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.840 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.841 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:41.841 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:41.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.841 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:41.841 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:41.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.841 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:41.841 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:05:41.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:05:41.842 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.842 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:41.842 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:05:41.842 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:05:41.842 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.842 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.842 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:05:41.842 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:05:41.842 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.842 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:41.842 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:05:41.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:05:41.843 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:41.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:05:41.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:05:41.843 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:41.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:05:41.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:05:41.843 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:41.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:05:41.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:05:41.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:05:41.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:05:41.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:41.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:05:41.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:05:41.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:41.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:05:41.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:05:41.845 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.845 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:41.845 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.845 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:41.845 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:41.845 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 47.981881426000001, 2024-04-26T12:05:41.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:05:41.846 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:41.846 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.846 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:41.846 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:41.846 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:41.846 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:05:41.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.846 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:41.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:41.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:41.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.847 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.847 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.847 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:41.847 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:41.847 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.847 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.847 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.847 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:41.847 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:41.847 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.847 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.847 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.847 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:41.847 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:05:41.848 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:05:41.848 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.848 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:41.848 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:05:41.848 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:05:41.848 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.848 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.848 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:05:41.848 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:05:41.848 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.848 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:41.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:05:41.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:05:41.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:41.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:05:41.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:05:41.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:41.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:05:41.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:05:41.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.850 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:41.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:05:41.850 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:05:41.850 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.850 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:05:41.850 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:05:41.850 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.850 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:41.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:05:41.850 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:05:41.850 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.851 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:41.851 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:05:41.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:05:41.851 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.851 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:41.851 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.851 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.851 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:41.851 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:41.851 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 47.981866445999998, 2024-04-26T12:05:41.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:05:41.851 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:41.851 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.851 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:41.852 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:41.852 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:41.852 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:05:41.852 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.852 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:41.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.852 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:41.852 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:41.852 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.852 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.852 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:41.852 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:41.852 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.852 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.853 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:41.853 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:41.853 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.853 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.853 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:41.853 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:05:41.853 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:05:41.853 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.854 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:41.854 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:05:41.854 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:05:41.854 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.854 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.854 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.854 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:05:41.854 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:05:41.854 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.854 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.854 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:41.854 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:05:41.854 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:05:41.854 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:41.855 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:05:41.855 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:05:41.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:41.855 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:05:41.855 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:05:41.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:41.855 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:05:41.855 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:05:41.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.856 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.856 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.856 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:05:41.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:05:41.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.856 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.856 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:41.856 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:05:41.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:05:41.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.856 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.856 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:41.857 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:05:41.857 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:05:41.857 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.857 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:41.857 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.857 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.857 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:41.857 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:41.857 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 47.981822571000002, 2024-04-26T12:05:41.857 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:05:41.857 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:41.857 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.857 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:41.857 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:41.858 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:41.858 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:05:41.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.858 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:41.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:41.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:41.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:41.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:41.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.859 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:41.859 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:41.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.859 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.859 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:41.859 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:05:41.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:05:41.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.859 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.859 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:41.859 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:05:41.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:05:41.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.859 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.860 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.860 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:05:41.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:05:41.860 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.860 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:41.860 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:05:41.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:05:41.860 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.860 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:41.860 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:05:41.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:05:41.860 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:41.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:05:41.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:05:41.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:41.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:05:41.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:05:41.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:05:41.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:05:41.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.862 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:41.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:05:41.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:05:41.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.862 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:41.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:05:41.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:05:41.862 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.862 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:41.862 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.862 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:41.863 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:41.863 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 47.981736906999998, 2024-04-26T12:05:41.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:05:41.863 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:41.863 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.863 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:41.863 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:41.863 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:41.863 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:05:41.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.863 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:41.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:41.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:41.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:41.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:41.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:41.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:41.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:41.865 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:05:41.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:05:41.865 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.865 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.865 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:41.865 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:05:41.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:05:41.865 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.865 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.865 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.865 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:05:41.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:05:41.865 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.865 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.865 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:41.866 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:05:41.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:05:41.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.866 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:41.866 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:05:41.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:05:41.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.866 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:41.866 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:05:41.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:05:41.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:41.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:05:41.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:05:41.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:05:41.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:05:41.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:41.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:05:41.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:05:41.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.868 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:41.868 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:05:41.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:05:41.868 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.868 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:41.868 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.868 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.868 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.868 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:41.868 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:41.868 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.055832621, 2024-04-26T12:05:41.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:05:41.868 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:41.868 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.869 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:41.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:41.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:41.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:41.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:41.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:41.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:41.870 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:41.870 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.870 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.870 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:41.870 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:05:41.870 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:05:41.870 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.870 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.870 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:41.870 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:05:41.870 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:05:41.870 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.870 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.870 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.871 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:05:41.871 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:05:41.871 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.871 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.871 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:41.871 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:05:41.871 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:05:41.871 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.871 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.871 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:41.871 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:05:41.871 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:05:41.871 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.871 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.871 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:41.872 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:05:41.872 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:05:41.872 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.872 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.872 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:41.872 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:05:41.872 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:05:41.872 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.872 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.872 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.872 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:05:41.872 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:05:41.872 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.872 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.872 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:41.873 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:05:41.873 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:05:41.873 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.873 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.873 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:41.873 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:05:41.873 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:05:41.873 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.873 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:41.873 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.873 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.873 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.873 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:41.873 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:41.873 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.055796526000002, 2024-04-26T12:05:41.874 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:05:41.874 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:41.874 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.874 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:41.874 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.874 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:41.874 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:41.874 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.874 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.874 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.874 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:41.874 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:41.874 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.874 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.874 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.875 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:41.875 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:05:41.875 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:41.875 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.875 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.875 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:41.875 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:05:41.875 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:05:41.875 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.875 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.875 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:41.875 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:05:41.875 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:05:41.875 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.876 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.876 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.876 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:05:41.876 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:05:41.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.876 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.876 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:41.876 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:05:41.876 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:05:41.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.876 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.876 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:41.876 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:05:41.876 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:05:41.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.877 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.877 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:41.877 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:05:41.877 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:05:41.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.877 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.877 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:41.877 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:05:41.877 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:05:41.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.877 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.877 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.877 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:05:41.878 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:05:41.878 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.878 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.878 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:41.878 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:05:41.878 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:05:41.878 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.878 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.878 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:41.878 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:05:41.878 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:05:41.878 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.878 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:41.878 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.879 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.879 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.879 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:41.879 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:41.879 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.055758842000003, 2024-04-26T12:05:41.879 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:05:41.879 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:41.879 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.879 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:41.879 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.879 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:41.879 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:41.879 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.879 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.880 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.880 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:41.880 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:41.880 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.880 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.880 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.880 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:41.880 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:05:41.880 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.880 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.880 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.881 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:41.881 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:05:41.881 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:05:41.881 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.881 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.881 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:41.881 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:05:41.881 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:05:41.881 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.881 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.881 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.881 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:05:41.881 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:05:41.881 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.882 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.882 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:41.882 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:05:41.882 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:05:41.882 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.882 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.882 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:41.882 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:41.882 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:05:41.882 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.882 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.882 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:41.882 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:05:41.882 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:05:41.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.883 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.883 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:41.883 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:05:41.883 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:05:41.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.883 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.883 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.883 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:05:41.883 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:05:41.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.883 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.883 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:41.883 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:05:41.884 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:05:41.884 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.884 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.884 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:41.884 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:05:41.884 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:05:41.884 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.884 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:41.884 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.884 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.884 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.884 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:41.884 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:41.884 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.055737501999999, 2024-04-26T12:05:41.885 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:05:41.885 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:41.885 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.885 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:41.885 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.885 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:41.885 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:41.885 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.885 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.885 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.885 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:41.885 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:41.885 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.885 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.885 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.886 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:41.886 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:41.886 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.886 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.886 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.886 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:41.886 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:05:41.886 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:41.886 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.886 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.886 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:41.886 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:05:41.886 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:05:41.886 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.887 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.887 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.887 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:05:41.887 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:05:41.887 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.887 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.887 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:41.887 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:05:41.887 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:05:41.887 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.887 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.887 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:41.887 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:05:41.887 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:05:41.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.888 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:41.888 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:05:41.888 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:05:41.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.888 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:41.888 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:05:41.888 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:05:41.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.888 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.888 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:05:41.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:05:41.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.889 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:41.889 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:05:41.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:05:41.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.889 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:41.889 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:05:41.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:05:41.889 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.889 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:41.889 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.890 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.890 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:41.890 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:41.890 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.055715235999998, 2024-04-26T12:05:41.890 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:05:41.890 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:41.890 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.890 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:41.890 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.890 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:41.890 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:41.890 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.890 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.890 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.891 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:41.891 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:41.891 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.891 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.891 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.891 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:41.891 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:41.891 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.891 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.891 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.891 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:41.891 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:05:41.891 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:41.891 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.891 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.892 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:41.892 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:05:41.892 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:05:41.892 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.892 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.892 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.892 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:05:41.892 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:05:41.892 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.892 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.892 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:41.892 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:05:41.892 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:05:41.892 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.893 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.893 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:41.893 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:05:41.893 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:05:41.893 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.893 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.893 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:41.893 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:05:41.893 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:05:41.893 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.893 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.893 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:41.893 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:05:41.893 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:05:41.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.894 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.894 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.894 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:05:41.894 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:05:41.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.894 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.894 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:41.894 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:05:41.894 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:05:41.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.894 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.894 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:41.895 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:05:41.895 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:05:41.895 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.895 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:41.895 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.895 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.895 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.895 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:41.895 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:41.895 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.055693613999999, 2024-04-26T12:05:41.895 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:05:41.895 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:41.895 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.895 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:41.896 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.896 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:41.896 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:41.896 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.896 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.896 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.896 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:41.896 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:41.896 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.896 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.896 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.896 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:41.896 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:41.896 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.897 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.897 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.897 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:41.897 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:05:41.897 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:05:41.897 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.897 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.897 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:41.897 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:05:41.897 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:05:41.897 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.897 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.897 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.897 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:05:41.898 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:05:41.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.898 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:41.898 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:05:41.898 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:05:41.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.898 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:41.898 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:05:41.898 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:05:41.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.898 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:41.899 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:05:41.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:05:41.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.899 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.899 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:41.899 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:05:41.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:05:41.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.899 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.899 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.899 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:05:41.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:05:41.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.899 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.899 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:41.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:05:41.900 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:05:41.900 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.900 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.900 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:41.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:05:41.900 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:05:41.900 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.900 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:41.900 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.900 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.900 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.900 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:41.900 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:41.901 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.055667047999997, 2024-04-26T12:05:41.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:05:41.901 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:41.901 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.901 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:41.901 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.901 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:41.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:41.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.901 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.901 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.901 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:41.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:41.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.901 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.902 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.902 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:41.902 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:05:41.902 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.902 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.902 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.902 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:41.902 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:05:41.902 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:05:41.902 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.902 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.902 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:41.902 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:05:41.902 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:05:41.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.903 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.903 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:05:41.903 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:05:41.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.903 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:41.903 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:05:41.903 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:05:41.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.903 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:41.903 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:05:41.903 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:05:41.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.904 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.904 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:41.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:05:41.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:05:41.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.904 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.904 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:41.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:05:41.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:05:41.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.904 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.904 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:05:41.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:05:41.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.905 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.905 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:41.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:05:41.905 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:05:41.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.905 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.905 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:41.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:05:41.905 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:05:41.905 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.905 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:41.906 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.906 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.906 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:41.906 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:41.906 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.055628536, 2024-04-26T12:05:41.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:05:41.906 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:41.906 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.906 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:41.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.906 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:41.906 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:41.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.907 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.907 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.907 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:41.907 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:41.907 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.907 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.907 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.907 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:41.907 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:41.907 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.907 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.907 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.907 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:41.907 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:05:41.908 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:05:41.908 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.908 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.908 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:41.908 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:05:41.908 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:05:41.908 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.908 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.908 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.908 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:05:41.908 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:05:41.908 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.908 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.908 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:41.909 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:05:41.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:05:41.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.909 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:41.909 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:05:41.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:05:41.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.909 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:41.909 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:05:41.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:05:41.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.910 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:41.910 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:05:41.910 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:05:41.910 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.910 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.910 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.910 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:05:41.910 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:05:41.910 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.910 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.910 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:41.910 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:05:41.910 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:05:41.910 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.910 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.911 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:41.911 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:05:41.911 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:05:41.911 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.911 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:41.911 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.911 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.911 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.911 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:41.911 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:41.911 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.055600363000003, 2024-04-26T12:05:41.911 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:05:41.911 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:41.911 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.912 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:41.912 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.912 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:41.912 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:41.912 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.912 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.912 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.912 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:41.912 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:41.912 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.912 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.912 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.912 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:41.912 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:41.912 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.913 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.913 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.913 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:41.913 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:05:41.913 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:05:41.913 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.913 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.913 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:41.913 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:05:41.913 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:05:41.913 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.913 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.913 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.914 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:05:41.914 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:05:41.914 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.914 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.914 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:41.914 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:05:41.914 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:05:41.914 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.914 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.914 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:41.914 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:05:41.914 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:05:41.914 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.915 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.915 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:41.915 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:05:41.915 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:05:41.915 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.915 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.915 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:41.915 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:05:41.915 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:05:41.915 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.915 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.915 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.915 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:05:41.915 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:05:41.915 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.916 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.916 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:41.916 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:05:41.916 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:05:41.916 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.916 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.916 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:41.916 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:05:41.916 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:05:41.916 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.916 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:41.916 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.916 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.916 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.916 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:41.917 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:41.917 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.055565799, 2024-04-26T12:05:41.917 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:05:41.917 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:41.917 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.917 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:41.917 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.917 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:41.917 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:41.917 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.917 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.917 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.917 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:41.917 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:41.917 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.918 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.918 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.918 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:41.918 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:05:41.918 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.918 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.918 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.918 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:41.918 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:05:41.918 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:05:41.918 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.918 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.918 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:41.918 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:05:41.919 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:05:41.919 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.919 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.919 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.919 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:05:41.919 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:05:41.919 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.919 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.919 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:41.919 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:05:41.919 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:05:41.919 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.919 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.919 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:41.920 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:05:41.920 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:05:41.920 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.920 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.920 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:41.920 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:05:41.920 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:05:41.920 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.920 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.920 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:41.920 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:05:41.920 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:05:41.920 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.920 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.921 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.921 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:05:41.921 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:05:41.921 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.921 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.921 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:41.921 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:41.921 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:05:41.921 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.921 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.921 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:41.921 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:05:41.921 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:05:41.921 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.921 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:41.922 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.922 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.922 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.922 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:41.922 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:41.922 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.054691019000003, 2024-04-26T12:05:41.922 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:05:41.922 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:41.922 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.922 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:41.922 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.922 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:41.922 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:41.922 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.923 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.923 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.923 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:41.923 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:41.923 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.923 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.923 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.923 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:41.923 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:05:41.923 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:41.923 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.923 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.923 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:41.923 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:05:41.923 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:05:41.924 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.924 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.924 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:41.924 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:05:41.924 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:05:41.924 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.924 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.924 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.924 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:05:41.924 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:05:41.924 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.924 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.924 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:41.924 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:05:41.924 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:05:41.925 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.925 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.925 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:41.925 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:05:41.925 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:05:41.925 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.925 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.925 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:41.925 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:05:41.925 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:05:41.925 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.925 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.925 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:41.925 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:05:41.926 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:05:41.926 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.926 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.926 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.926 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:05:41.926 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:05:41.926 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.926 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.926 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:41.926 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:05:41.926 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:05:41.926 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.926 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.926 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:41.926 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:05:41.927 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:05:41.927 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.927 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:41.927 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.927 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.927 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.927 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:41.927 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:41.927 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.054652060000002, 2024-04-26T12:05:41.927 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:05:41.927 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:41.927 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.927 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:41.927 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.928 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:41.928 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:41.928 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.928 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.928 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.928 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:41.928 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:41.928 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.928 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.928 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.928 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:41.928 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:05:41.928 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.928 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.928 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.929 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:41.929 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:05:41.929 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:05:41.929 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.929 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.929 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:41.929 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:05:41.929 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:05:41.929 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.929 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.929 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.929 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:05:41.929 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:05:41.929 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.930 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.930 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:41.930 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:05:41.930 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:05:41.930 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.930 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.930 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:41.930 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:05:41.930 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:05:41.930 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.930 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.930 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:41.930 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:05:41.930 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:05:41.930 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.931 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.931 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:41.931 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:05:41.931 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:05:41.931 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.931 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.931 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.931 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:05:41.931 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:05:41.931 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.931 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.931 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:41.931 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:05:41.931 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:05:41.931 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.932 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.932 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:41.932 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:05:41.932 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:05:41.932 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.932 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:41.932 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.932 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.932 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.932 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:41.932 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:41.932 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.054616588000002, 2024-04-26T12:05:41.932 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:05:41.932 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:41.932 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.933 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:41.933 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.933 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:41.933 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:41.933 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.933 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.933 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.933 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:41.933 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:41.933 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.933 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.933 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.933 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:41.933 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:41.933 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:41.934 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.934 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.934 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:41.934 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:05:41.934 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:05:41.934 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.934 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.934 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:41.934 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:05:41.934 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:05:41.934 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.934 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.934 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.934 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:05:41.935 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:05:41.935 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.935 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.935 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:41.935 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:05:41.935 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:05:41.935 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.935 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.935 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:41.935 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:05:41.935 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:05:41.935 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.935 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.935 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:41.935 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:05:41.936 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:05:41.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.936 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.936 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:41.936 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:05:41.936 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:05:41.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.936 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.936 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.936 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:05:41.936 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:05:41.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.936 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.936 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:41.936 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:05:41.937 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:05:41.937 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.937 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.937 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:41.937 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:05:41.937 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:05:41.937 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.937 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:41.937 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.937 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.937 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.937 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:41.937 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:41.937 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.054537899000003, 2024-04-26T12:05:41.937 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:05:41.938 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:41.938 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:41.938 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:41.938 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.938 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:41.938 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:41.938 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.938 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.938 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.938 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:41.938 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:41.938 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.938 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.939 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.939 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:41.939 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:05:41.939 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:41.939 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.939 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.939 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:41.939 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:05:41.939 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:05:41.939 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.939 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.939 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:41.939 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:05:41.939 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:05:41.940 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.940 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.940 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.940 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:05:41.940 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:05:41.940 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.940 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.940 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:41.940 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:05:41.940 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:05:41.940 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.940 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.940 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:41.940 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:05:41.941 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:05:41.941 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.941 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.941 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:41.941 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:05:41.941 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:05:41.941 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.941 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.941 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:41.941 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:05:41.941 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:05:41.941 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.941 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.941 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:41.941 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:05:41.942 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:05:41.942 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.942 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.942 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:41.942 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:05:41.942 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:05:41.942 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.942 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.942 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:41.942 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:05:41.942 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:05:41.942 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.942 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:41.942 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.943 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.943 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.943 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:41.943 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:41.943 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.054387050999999, 2024-04-26T12:05:41.943 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:05:41.943 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:41.943 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:05:41.943 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:41.943 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.943 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:41.943 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:41.943 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.943 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.943 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.944 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:41.944 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:41.944 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:41.944 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.944 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.944 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:41.944 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:05:41.944 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:41.944 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.944 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.944 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:41.944 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:05:41.944 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:05:41.944 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.944 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.945 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:41.945 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:05:41.945 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:05:41.945 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.945 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.945 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:41.945 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:05:41.945 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:05:41.945 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.945 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.945 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:41.945 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:05:41.945 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:05:41.946 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.946 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.946 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:41.946 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:41.946 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:05:41.946 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:41.946 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:41.946 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:41.946 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:05:41.946 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:05:41.946 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.947 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:41.947 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.947 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:41.947 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:41.947 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:41.948 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:41.947+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:41.949 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:42.049 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:42.047+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:42.056 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:42.056 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:42.056 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:05:42.056 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:42.065 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:42.150 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:42.149+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:42.205 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:42.206 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:42.206 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:05:42.206 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:05:42.206 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:42.214 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:42.251 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:42.250+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:42.317 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:42.317 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:05:42.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:05:42.317 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:05:42.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.317 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:42.317 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:42.317 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.534782602, 2024-04-26T12:05:42.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:05:42.317 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:42.317 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:42.317 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:42.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:42.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:42.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:42.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:42.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:42.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:05:42.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:42.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:42.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:05:42.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:05:42.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:42.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:05:42.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:05:42.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:42.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:05:42.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:05:42.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:42.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:05:42.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:05:42.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:42.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:42.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:05:42.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:42.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:05:42.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:05:42.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:42.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:05:42.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:05:42.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:42.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:05:42.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:05:42.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:42.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:05:42.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:05:42.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:42.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:05:42.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:05:42.322 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.322 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:42.322 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.322 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:42.322 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:42.322 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.534727281999999, 2024-04-26T12:05:42.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:05:42.322 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:42.323 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:42.323 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:42.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:42.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:42.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:42.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:42.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:42.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:05:42.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:42.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:42.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:05:42.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:05:42.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:42.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:05:42.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:05:42.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:42.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:05:42.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:05:42.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:42.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:05:42.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:05:42.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:42.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:05:42.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:05:42.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:42.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:05:42.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:05:42.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:42.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:05:42.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:05:42.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:42.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:05:42.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:05:42.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:42.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:05:42.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:05:42.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:42.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:05:42.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:05:42.327 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.327 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:42.327 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.327 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:42.327 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:42.328 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.534677264000003, 2024-04-26T12:05:42.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:05:42.328 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:42.328 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:42.328 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:42.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:42.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:42.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:42.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:42.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.329 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:42.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:05:42.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:42.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.329 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:42.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:05:42.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:05:42.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.329 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:42.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:05:42.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:05:42.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:42.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:05:42.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:05:42.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:42.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:05:42.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:05:42.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:42.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:05:42.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:05:42.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:42.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:05:42.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:05:42.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:42.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:05:42.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:05:42.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:42.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:05:42.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:05:42.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:42.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:05:42.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:05:42.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:42.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:05:42.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:05:42.332 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.332 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:42.332 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.333 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:42.333 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:42.333 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.534642626999997, 2024-04-26T12:05:42.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:05:42.333 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:42.333 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:42.333 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:42.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:42.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:42.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.334 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:42.334 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:42.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.334 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:42.334 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:05:42.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:42.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.334 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:42.334 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:05:42.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:05:42.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.335 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:42.335 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:42.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:05:42.335 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.335 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:42.335 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:05:42.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:05:42.335 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.335 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:42.335 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:05:42.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:05:42.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:42.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:05:42.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:05:42.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:42.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:05:42.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:05:42.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:42.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:05:42.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:05:42.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:42.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:05:42.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:05:42.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:42.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:05:42.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:05:42.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:42.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:05:42.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:05:42.338 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.338 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:42.338 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.338 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:42.338 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:42.338 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.534604115, 2024-04-26T12:05:42.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:05:42.338 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:42.338 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:42.338 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:42.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:42.339 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:42.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.339 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:42.339 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:42.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.339 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:42.339 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:42.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:42.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:42.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:42.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:05:42.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:42.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:05:42.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:05:42.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:42.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:05:42.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:05:42.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:42.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:05:42.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:05:42.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:42.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:05:42.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:05:42.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:42.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:05:42.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:05:42.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:42.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:05:42.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:05:42.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:42.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:05:42.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:05:42.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:42.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:05:42.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:05:42.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.343 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:42.343 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:05:42.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:05:42.343 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.343 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:42.343 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.343 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:42.343 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:42.343 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.534573792000003, 2024-04-26T12:05:42.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:05:42.344 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:42.344 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:42.344 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:42.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:42.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:42.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:42.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:42.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:42.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:42.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:42.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:42.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:05:42.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:05:42.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:42.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:05:42.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:05:42.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:42.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:05:42.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:05:42.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:42.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:05:42.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:05:42.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:42.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:05:42.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:05:42.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:42.347 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:05:42.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:05:42.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:42.347 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:05:42.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:05:42.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:42.347 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:05:42.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:05:42.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:42.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:05:42.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:05:42.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:42.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:05:42.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:05:42.348 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.348 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:42.348 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.349 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:42.349 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:42.349 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.534547089999997, 2024-04-26T12:05:42.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:05:42.349 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:42.349 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:42.349 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:42.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:42.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:42.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:42.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:42.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:42.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:42.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:42.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:42.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:05:42.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:05:42.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:42.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:05:42.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:05:42.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:42.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:05:42.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:05:42.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:42.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:05:42.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:05:42.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:42.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:05:42.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:05:42.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.352 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:42.352 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:05:42.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:05:42.352 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.352 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:42.352 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.352 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:42.352 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:42.352 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.534504800000001, 2024-04-26T12:05:42.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:05:42.353 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:42.353 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:42.353 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:42.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:42.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:42.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:42.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:42.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:42.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:42.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:42.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:42.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:05:42.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:05:42.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:42.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:05:42.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:05:42.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:42.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:05:42.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:05:42.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:42.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:05:42.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:05:42.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:42.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:05:42.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:05:42.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:42.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:05:42.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:05:42.356 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.356 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:42.356 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.356 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:42.356 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:42.356 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.534476722000001, 2024-04-26T12:05:42.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:05:42.356 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:42.356 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:42.356 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:42.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:42.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:42.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:42.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:42.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:42.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:05:42.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:42.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:42.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:05:42.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:05:42.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:42.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:05:42.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:05:42.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:42.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:42.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:05:42.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:42.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:42.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:05:42.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:42.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:05:42.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:05:42.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:42.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:05:42.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:05:42.360 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.360 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:42.360 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.360 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.360 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.360 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:42.360 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:42.360 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.528481372000002, 2024-04-26T12:05:42.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:05:42.360 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:42.360 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:42.360 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:42.360 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.360 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:42.361 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:42.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.361 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.361 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.361 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:42.361 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:42.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.361 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.361 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.361 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:42.361 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:05:42.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:42.361 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.361 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.361 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:42.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:05:42.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:05:42.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:42.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:05:42.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:05:42.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:42.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:05:42.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:05:42.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:42.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:05:42.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:05:42.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:42.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:05:42.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:05:42.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:42.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:05:42.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:05:42.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:42.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:05:42.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:05:42.364 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.364 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:42.364 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.364 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:42.364 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:42.364 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.528412406000001, 2024-04-26T12:05:42.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:05:42.364 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:42.364 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:42.364 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:42.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.365 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:42.365 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:42.365 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.365 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.365 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.365 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:42.365 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:42.365 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.365 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.365 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.365 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:42.365 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:05:42.365 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:42.365 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.365 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:42.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:05:42.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:05:42.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:42.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:05:42.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:05:42.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:42.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:05:42.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:05:42.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:42.367 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:05:42.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:05:42.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:42.367 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:42.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:05:42.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:42.367 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:05:42.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:05:42.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.368 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:42.368 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:05:42.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:05:42.368 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.368 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:42.368 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.368 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:42.368 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:42.368 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.527918043, 2024-04-26T12:05:42.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:05:42.368 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:42.368 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:42.368 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:42.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:42.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:42.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:42.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:42.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:42.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:42.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:42.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:42.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:05:42.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:05:42.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:42.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:05:42.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:05:42.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:42.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:05:42.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:05:42.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:42.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:05:42.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:05:42.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:42.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:05:42.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:05:42.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:42.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:05:42.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:05:42.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:42.372 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:05:42.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:05:42.372 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.372 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:42.372 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.372 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:42.372 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:42.372 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.527879777999999, 2024-04-26T12:05:42.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:05:42.372 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:42.372 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:42.372 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:42.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:42.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:42.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:42.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:42.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:42.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:42.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:42.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:42.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:05:42.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:05:42.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:42.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:05:42.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:05:42.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:42.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:05:42.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:05:42.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:42.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:05:42.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:05:42.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:42.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:05:42.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:05:42.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:42.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:05:42.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:05:42.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:42.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:05:42.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:05:42.376 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.376 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:42.376 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.376 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:05:42.376 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:42.376 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.527199893000002, 2024-04-26T12:05:42.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:05:42.376 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:42.376 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:42.376 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:42.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:42.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:42.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:42.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:42.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:42.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:42.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:42.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:42.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:05:42.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:05:42.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:42.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:05:42.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:05:42.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:42.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:05:42.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:05:42.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:42.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:05:42.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:05:42.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:42.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:05:42.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:05:42.379 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.379 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:42.379 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.379 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:42.379 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:42.379 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.527170714, 2024-04-26T12:05:42.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:05:42.379 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:42.380 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:42.380 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:42.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:42.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:42.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:42.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:42.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:42.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:05:42.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:42.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:42.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:05:42.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:05:42.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:42.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:05:42.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:05:42.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:42.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:05:42.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:05:42.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:42.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:05:42.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:05:42.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:42.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:05:42.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:05:42.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:42.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:05:42.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:05:42.383 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.383 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:42.383 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.383 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:42.383 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:42.383 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.527138903000001, 2024-04-26T12:05:42.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:05:42.383 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:42.383 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:42.383 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:42.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:42.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:42.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.384 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.384 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:42.384 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:42.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.384 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.384 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:42.384 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:42.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:05:42.384 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.384 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:42.385 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:05:42.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:05:42.385 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:42.385 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:05:42.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:05:42.385 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:42.385 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:05:42.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:05:42.385 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:42.385 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:05:42.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:05:42.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.386 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:42.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:05:42.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:05:42.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.386 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:42.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:05:42.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:05:42.386 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.386 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:42.386 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.386 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:42.387 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:42.387 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.527117547000003, 2024-04-26T12:05:42.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:05:42.387 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:42.387 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:42.387 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:42.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:42.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:42.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:42.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:42.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.388 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.388 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:42.388 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:42.388 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:05:42.388 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.388 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:42.388 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:05:42.388 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:05:42.388 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.388 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:42.388 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:05:42.388 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:05:42.389 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.389 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:42.389 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:05:42.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:05:42.389 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.389 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:42.389 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:05:42.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:05:42.389 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.389 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:42.390 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:05:42.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:05:42.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.390 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:42.390 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:05:42.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:05:42.390 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.390 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:42.390 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.390 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:05:42.390 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:42.390 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.527089093999997, 2024-04-26T12:05:42.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:05:42.391 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:42.391 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:42.391 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:42.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:42.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:42.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:42.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:42.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:42.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:42.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:42.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.392 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:42.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:05:42.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:05:42.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.392 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:42.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:05:42.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:05:42.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.392 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:42.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:05:42.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:05:42.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:42.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:05:42.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:05:42.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:42.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:05:42.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:05:42.393 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.393 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:42.393 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.393 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:05:42.394 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:42.394 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.526367288000003, 2024-04-26T12:05:42.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:05:42.394 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:42.394 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:42.394 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:42.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:42.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:42.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:42.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:42.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:42.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:05:42.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:42.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:42.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:05:42.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:05:42.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:42.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:05:42.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:05:42.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.396 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:42.396 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:05:42.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:05:42.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.396 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:42.396 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:05:42.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:05:42.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.396 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:42.396 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:05:42.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:05:42.396 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.397 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:42.397 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.397 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.397 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.397 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:05:42.397 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:42.397 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 32.809440684999998, 2024-04-26T12:05:42.397 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:05:42.397 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:42.397 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:42.397 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:42.397 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.397 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:42.397 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:42.397 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:42.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:42.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:42.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:42.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:05:42.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:05:42.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:42.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:05:42.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:05:42.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:42.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:05:42.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:05:42.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:42.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:05:42.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:05:42.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:42.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:05:42.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:05:42.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.400 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:42.400 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:05:42.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:05:42.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.400 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:42.400 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:05:42.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:05:42.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.400 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:42.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:05:42.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:05:42.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:42.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:05:42.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:05:42.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:42.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:05:42.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:05:42.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:42.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:42.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:42.402 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:05:42.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:05:42.402 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.402 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:42.402 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.402 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:42.402 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:42.402 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:42.402 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:05:42.404 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:42.403+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:42.405 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:42.505 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:42.504+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:42.519 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:42.519 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:05:42.519 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-04-26T12:05:42.519 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:42.528 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:42.538 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:05:42.538 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:05:42.556 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T12:05:42.556 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:05:42.573 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:05:42.573 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:05:42.612 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:42.611+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:42.670 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:42.670 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:42.679 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:42.706 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:42.705+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:42.807 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:42.806+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:42.821 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:42.821 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:42.831 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:42.885 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:05:42.908 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:42.907+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:42.941 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:42.941 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:42.951 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:43.009 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:43.008+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:43.052 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:43.052 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:43.061 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:43.109 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:43.108+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:43.164 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:43.164 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:43.173 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:43.210 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:43.209+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:43.284 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:43.284 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:43.293 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:43.337 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:43.336+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:43.394 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:43.394 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:43.404 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:43.412 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:43.411+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:43.513 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:43.512+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:43.546 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:43.546 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:43.555 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:43.614 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:43.613+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:43.659 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:43.659 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:43.669 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:43.715 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:43.714+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:43.769 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:43.769 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:43.777 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:43.816 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:43.815+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:43.875 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-26T12:05:43.880 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:43.880 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:43.890 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:43.917 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:43.916+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:43.997 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:43.997 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:44.006 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:44.050 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:44.049+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:44.109 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:44.109 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:44.118 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:44.119 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:44.118+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:44.219 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:44.219+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:44.259 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:44.259 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:44.268 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:44.320 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:44.319+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:44.373 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:44.373 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:44.382 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:44.424 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:44.423+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:44.483 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:44.483 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:44.492 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:44.523 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:44.522+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:44.536 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:05:44.536 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:05:44.536 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-26T12:05:44.536 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T12:05:44.536 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T12:05:44.537 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-26T12:05:44.584 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:05:44.594 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:44.594 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:44.603 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:44.624 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:44.623+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:44.640 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:44.640 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "" 2024-04-26T12:05:44.640 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:44.710 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:44.710 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:44.719 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:44.721 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:05:44.721 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:05:44.725 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:44.724+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:44.739 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T12:05:44.739 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:05:44.756 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:05:44.756 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:05:44.821 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:44.821 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:05:44.821 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T12:05:44.821 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T12:05:44.821 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:44.825 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:44.824+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:44.829 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:44.926 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:44.925+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:44.982 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:44.983 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T12:05:44.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T12:05:44.983 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T12:05:44.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.983 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:44.983 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:44.983 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.196056859999999, 2024-04-26T12:05:44.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017255857999999999, 2024-04-26T12:05:44.984 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:44.984 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:44.984 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:44.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:44.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:44.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:44.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:44.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:44.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:44.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:44.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780340+0000", 2024-04-26T12:05:44.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:44.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:44.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780351+0000", 2024-04-26T12:05:44.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0898e-05 2024-04-26T12:05:44.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:44.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:44.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1671999999999999e-05 2024-04-26T12:05:44.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:44.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780374+0000", 2024-04-26T12:05:44.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1117999999999999e-05 2024-04-26T12:05:44.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:44.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780423+0000", 2024-04-26T12:05:44.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9066000000000001e-05 2024-04-26T12:05:44.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:44.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780428+0000", 2024-04-26T12:05:44.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1320000000000002e-06 2024-04-26T12:05:44.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:44.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788902+0000", 2024-04-26T12:05:44.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084738560000000001 2024-04-26T12:05:44.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:44.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789167+0000", 2024-04-26T12:05:44.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026521100000000001 2024-04-26T12:05:44.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:44.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789279+0000", 2024-04-26T12:05:44.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111616 2024-04-26T12:05:44.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:44.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792335+0000", 2024-04-26T12:05:44.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030556419999999999 2024-04-26T12:05:44.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:44.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797519+0000", 2024-04-26T12:05:44.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051841550000000002 2024-04-26T12:05:44.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:44.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797559+0000", 2024-04-26T12:05:44.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0451999999999998e-05 2024-04-26T12:05:44.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:44.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797598+0000", 2024-04-26T12:05:44.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8500000000000001e-05 2024-04-26T12:05:44.990 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:44.990 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:44.990 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:44.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.990 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:44.990 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:44.990 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.196008552999999, 2024-04-26T12:05:44.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017668725, 2024-04-26T12:05:44.990 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:44.991 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:44.991 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:44.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:44.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:44.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:44.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:44.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:44.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:44.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:44.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:44.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:44.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:44.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780395+0000", 2024-04-26T12:05:44.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.198e-06 2024-04-26T12:05:44.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:44.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780402+0000", 2024-04-26T12:05:44.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:05:44.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:44.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780408+0000", 2024-04-26T12:05:44.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:44.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:44.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780481+0000", 2024-04-26T12:05:44.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3239999999999997e-05 2024-04-26T12:05:44.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:44.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780485+0000", 2024-04-26T12:05:44.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4039999999999999e-06 2024-04-26T12:05:44.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:44.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789518+0000", 2024-04-26T12:05:44.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090335480000000006 2024-04-26T12:05:44.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:44.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789585+0000", 2024-04-26T12:05:44.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6469000000000003e-05 2024-04-26T12:05:44.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:44.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789699+0000", 2024-04-26T12:05:44.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114613 2024-04-26T12:05:44.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:44.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793308+0000", 2024-04-26T12:05:44.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036088520000000001 2024-04-26T12:05:44.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:44.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797887+0000", 2024-04-26T12:05:44.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0045792790000000003 2024-04-26T12:05:44.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:44.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797955+0000", 2024-04-26T12:05:44.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T12:05:44.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:44.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798059+0000", 2024-04-26T12:05:44.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103874 2024-04-26T12:05:44.996 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:44.996 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:44.996 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:44.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.996 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:44.996 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:44.997 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.195978281000002, 2024-04-26T12:05:44.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017735145000000001, 2024-04-26T12:05:44.997 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:44.997 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:44.997 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:44.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:44.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:44.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:44.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:44.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:44.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:44.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:44.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:44.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:44.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:44.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780424+0000", 2024-04-26T12:05:44.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4519999999999999e-06 2024-04-26T12:05:44.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:44.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780431+0000", 2024-04-26T12:05:44.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0690000000000004e-06 2024-04-26T12:05:44.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:44.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780438+0000", 2024-04-26T12:05:44.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5719999999999999e-06 2024-04-26T12:05:44.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:44.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780468+0000", 2024-04-26T12:05:44.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.993e-05 2024-04-26T12:05:44.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:44.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:44.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:45.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780472+0000", 2024-04-26T12:05:45.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-04-26T12:05:45.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:45.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789916+0000", 2024-04-26T12:05:45.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094434940000000002 2024-04-26T12:05:45.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:45.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790004+0000", 2024-04-26T12:05:45.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8085999999999997e-05 2024-04-26T12:05:45.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:45.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790125+0000", 2024-04-26T12:05:45.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012186200000000001 2024-04-26T12:05:45.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793402+0000", 2024-04-26T12:05:45.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00327685 2024-04-26T12:05:45.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:45.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798068+0000", 2024-04-26T12:05:45.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046652150000000003 2024-04-26T12:05:45.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:45.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798108+0000", 2024-04-26T12:05:45.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0911000000000002e-05 2024-04-26T12:05:45.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:45.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798156+0000", 2024-04-26T12:05:45.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7128e-05 2024-04-26T12:05:45.002 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.002 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:45.002 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.003 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.003 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:45.003 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.195955261999998, 2024-04-26T12:05:45.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017792624, 2024-04-26T12:05:45.003 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:45.003 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.003 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:45.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:45.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:45.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:45.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:45.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:45.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:45.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:45.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780447+0000", 2024-04-26T12:05:45.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8519999999999997e-06 2024-04-26T12:05:45.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:45.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780453+0000", 2024-04-26T12:05:45.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2999999999999998e-06 2024-04-26T12:05:45.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:45.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0760000000000002e-06 2024-04-26T12:05:45.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:45.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780502+0000", 2024-04-26T12:05:45.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4079999999999998e-05 2024-04-26T12:05:45.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:45.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:45.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5450000000000002e-06 2024-04-26T12:05:45.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:45.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790390+0000", 2024-04-26T12:05:45.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098850759999999996 2024-04-26T12:05:45.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:45.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790447+0000", 2024-04-26T12:05:45.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6752999999999997e-05 2024-04-26T12:05:45.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:45.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790547+0000", 2024-04-26T12:05:45.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100344 2024-04-26T12:05:45.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793864+0000", 2024-04-26T12:05:45.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033169749999999998 2024-04-26T12:05:45.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:45.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798164+0000", 2024-04-26T12:05:45.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043000690000000001 2024-04-26T12:05:45.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:45.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798204+0000", 2024-04-26T12:05:45.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9478999999999999e-05 2024-04-26T12:05:45.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:45.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798236+0000", 2024-04-26T12:05:45.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2478999999999999e-05 2024-04-26T12:05:45.009 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.009 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:45.009 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.009 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.009 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:45.009 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.195914919000003, 2024-04-26T12:05:45.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016989500000000001, 2024-04-26T12:05:45.010 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:45.010 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.010 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:45.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:45.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:45.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:45.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:45.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:45.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780483+0000", 2024-04-26T12:05:45.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:45.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780488+0000", 2024-04-26T12:05:45.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6260000000000003e-06 2024-04-26T12:05:45.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:45.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780499+0000", 2024-04-26T12:05:45.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1236000000000001e-05 2024-04-26T12:05:45.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:45.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4569999999999996e-06 2024-04-26T12:05:45.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:45.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780529+0000", 2024-04-26T12:05:45.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4579e-05 2024-04-26T12:05:45.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:45.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780532+0000", 2024-04-26T12:05:45.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.74e-06 2024-04-26T12:05:45.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:45.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788868+0000", 2024-04-26T12:05:45.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0083357650000000002 2024-04-26T12:05:45.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:45.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789142+0000", 2024-04-26T12:05:45.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027472 2024-04-26T12:05:45.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:45.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789241+0000", 2024-04-26T12:05:45.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8394999999999996e-05 2024-04-26T12:05:45.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792096+0000", 2024-04-26T12:05:45.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002855677 2024-04-26T12:05:45.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:45.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797379+0000", 2024-04-26T12:05:45.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052822379999999999 2024-04-26T12:05:45.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:45.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797433+0000", 2024-04-26T12:05:45.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4109e-05 2024-04-26T12:05:45.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:45.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797473+0000", 2024-04-26T12:05:45.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0533e-05 2024-04-26T12:05:45.015 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.015 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:45.015 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.016 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.016 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:45.016 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.195875305000001, 2024-04-26T12:05:45.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017295965, 2024-04-26T12:05:45.016 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:45.016 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.016 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:45.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:45.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:45.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:45.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:45.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:45.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780513+0000", 2024-04-26T12:05:45.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999895 2024-04-26T12:05:45.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:45.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780528+0000", 2024-04-26T12:05:45.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5089000000000001e-05 2024-04-26T12:05:45.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:45.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780537+0000", 2024-04-26T12:05:45.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8400000000000001e-06 2024-04-26T12:05:45.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780544+0000", 2024-04-26T12:05:45.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.917e-06 2024-04-26T12:05:45.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:45.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780571+0000", 2024-04-26T12:05:45.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7032000000000001e-05 2024-04-26T12:05:45.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:45.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780574+0000", 2024-04-26T12:05:45.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:05:45.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:45.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789436+0000", 2024-04-26T12:05:45.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088622240000000001 2024-04-26T12:05:45.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:45.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789525+0000", 2024-04-26T12:05:45.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8549999999999998e-05 2024-04-26T12:05:45.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:45.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789642+0000", 2024-04-26T12:05:45.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011772100000000001 2024-04-26T12:05:45.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792129+0000", 2024-04-26T12:05:45.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024871709999999998 2024-04-26T12:05:45.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:45.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797732+0000", 2024-04-26T12:05:45.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056027580000000002 2024-04-26T12:05:45.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:45.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797777+0000", 2024-04-26T12:05:45.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4620999999999999e-05 2024-04-26T12:05:45.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:45.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797819+0000", 2024-04-26T12:05:45.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2536000000000001e-05 2024-04-26T12:05:45.022 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.022 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:45.022 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.022 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.022 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:45.022 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.195846355, 2024-04-26T12:05:45.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017840163999999999, 2024-04-26T12:05:45.023 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:45.023 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.023 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:45.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:45.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:45.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:45.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:45.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:45.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:45.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:45.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:45.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5419999999999999e-06 2024-04-26T12:05:45.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:45.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780563+0000", 2024-04-26T12:05:45.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:05:45.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780569+0000", 2024-04-26T12:05:45.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1479999999999997e-06 2024-04-26T12:05:45.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:45.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780594+0000", 2024-04-26T12:05:45.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5585e-05 2024-04-26T12:05:45.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:45.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780596+0000", 2024-04-26T12:05:45.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2630000000000002e-06 2024-04-26T12:05:45.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:45.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789932+0000", 2024-04-26T12:05:45.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093360479999999996 2024-04-26T12:05:45.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:45.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790070+0000", 2024-04-26T12:05:45.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013771399999999999 2024-04-26T12:05:45.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:45.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790219+0000", 2024-04-26T12:05:45.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014872299999999999 2024-04-26T12:05:45.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793632+0000", 2024-04-26T12:05:45.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003413368 2024-04-26T12:05:45.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:45.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798244+0000", 2024-04-26T12:05:45.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046113819999999998 2024-04-26T12:05:45.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:45.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798361+0000", 2024-04-26T12:05:45.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117726 2024-04-26T12:05:45.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:45.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798393+0000", 2024-04-26T12:05:45.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1099999999999997e-05 2024-04-26T12:05:45.030 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.030 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:45.030 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.030 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.030 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:45.030 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.195821430000002, 2024-04-26T12:05:45.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016645943, 2024-04-26T12:05:45.030 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:45.030 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:45.030 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:45.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:45.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:45.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:45.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:45.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:45.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:45.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:45.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780580+0000", 2024-04-26T12:05:45.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1549999999999999e-06 2024-04-26T12:05:45.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:45.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780588+0000", 2024-04-26T12:05:45.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:05:45.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780593+0000", 2024-04-26T12:05:45.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2399999999999998e-06 2024-04-26T12:05:45.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:45.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780628+0000", 2024-04-26T12:05:45.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5426000000000003e-05 2024-04-26T12:05:45.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:45.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780632+0000", 2024-04-26T12:05:45.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:05:45.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:45.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788288+0000", 2024-04-26T12:05:45.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076555879999999996 2024-04-26T12:05:45.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:45.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788570+0000", 2024-04-26T12:05:45.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028233700000000002 2024-04-26T12:05:45.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:45.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797223+0000", 2024-04-26T12:05:45.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086529150000000006 2024-04-26T12:05:45.034 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.034 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:45.035 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.035 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.035 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:45.035 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.195797460999998, 2024-04-26T12:05:45.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016536068000000001, 2024-04-26T12:05:45.035 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:45.035 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:45.035 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:45.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:45.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:45.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:45.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:45.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:45.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:45.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:45.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780609+0000", 2024-04-26T12:05:45.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8280000000000003e-06 2024-04-26T12:05:45.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:45.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780616+0000", 2024-04-26T12:05:45.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4939999999999997e-06 2024-04-26T12:05:45.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780621+0000", 2024-04-26T12:05:45.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6040000000000003e-06 2024-04-26T12:05:45.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:45.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780647+0000", 2024-04-26T12:05:45.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6441999999999999e-05 2024-04-26T12:05:45.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:45.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780650+0000", 2024-04-26T12:05:45.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4430000000000002e-06 2024-04-26T12:05:45.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:45.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788163+0000", 2024-04-26T12:05:45.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007513774 2024-04-26T12:05:45.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:45.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788307+0000", 2024-04-26T12:05:45.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014374400000000001 2024-04-26T12:05:45.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:45.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797137+0000", 2024-04-26T12:05:45.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088302160000000001 2024-04-26T12:05:45.039 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.039 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:45.040 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.040 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:45.040 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:45.040 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.192921189000003, 2024-04-26T12:05:45.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012911448000000001, 2024-04-26T12:05:45.040 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:45.040 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.040 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:45.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:45.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:45.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:45.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:45.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:45.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783477+0000", 2024-04-26T12:05:45.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:45.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783482+0000", 2024-04-26T12:05:45.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5709999999999999e-06 2024-04-26T12:05:45.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:45.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783491+0000", 2024-04-26T12:05:45.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3610000000000007e-06 2024-04-26T12:05:45.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783498+0000", 2024-04-26T12:05:45.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4209999999999998e-06 2024-04-26T12:05:45.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:45.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786045+0000", 2024-04-26T12:05:45.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0025465739999999998 2024-04-26T12:05:45.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:45.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786061+0000", 2024-04-26T12:05:45.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6348999999999999e-05 2024-04-26T12:05:45.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:45.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796342+0000", 2024-04-26T12:05:45.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010280643000000001 2024-04-26T12:05:45.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:45.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796389+0000", 2024-04-26T12:05:45.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6912000000000001e-05 2024-04-26T12:05:45.044 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.044 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:45.044 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.045 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:45.045 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:45.045 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.192892882999999, 2024-04-26T12:05:45.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013376469, 2024-04-26T12:05:45.045 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:45.045 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.045 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:45.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:45.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:45.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:45.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:45.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:45.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:45.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:45.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783516+0000", 2024-04-26T12:05:45.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.041e-05 2024-04-26T12:05:45.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:45.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783523+0000", 2024-04-26T12:05:45.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5749999999999997e-06 2024-04-26T12:05:45.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783528+0000", 2024-04-26T12:05:45.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5029999999999997e-06 2024-04-26T12:05:45.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:45.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787662+0000", 2024-04-26T12:05:45.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041336230000000003 2024-04-26T12:05:45.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:45.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787687+0000", 2024-04-26T12:05:45.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5769999999999999e-05 2024-04-26T12:05:45.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:45.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796817+0000", 2024-04-26T12:05:45.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091296750000000003 2024-04-26T12:05:45.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:45.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796882+0000", 2024-04-26T12:05:45.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5180999999999998e-05 2024-04-26T12:05:45.050 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.050 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:45.050 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.051 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:45.051 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:45.051 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.192824342000002, 2024-04-26T12:05:45.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013457291999999999, 2024-04-26T12:05:45.051 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:45.051 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.051 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:45.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:45.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:45.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:45.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:45.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:45.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:45.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:45.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783578+0000", 2024-04-26T12:05:45.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.659e-06 2024-04-26T12:05:45.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:45.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783584+0000", 2024-04-26T12:05:45.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:45.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783588+0000", 2024-04-26T12:05:45.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6190000000000002e-06 2024-04-26T12:05:45.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:45.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787834+0000", 2024-04-26T12:05:45.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042460529999999996 2024-04-26T12:05:45.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:45.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787854+0000", 2024-04-26T12:05:45.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9658999999999999e-05 2024-04-26T12:05:45.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:45.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:45.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009107604 2024-04-26T12:05:45.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:45.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797032+0000", 2024-04-26T12:05:45.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9987000000000006e-05 2024-04-26T12:05:45.055 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.055 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:45.055 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.056 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:45.056 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:45.056 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.190977963000002, 2024-04-26T12:05:45.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011003015999999999, 2024-04-26T12:05:45.056 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:45.056 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.056 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:45.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:45.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:45.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:45.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:45.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:45.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785420+0000", 2024-04-26T12:05:45.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:45.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785427+0000", 2024-04-26T12:05:45.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:05:45.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:45.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785438+0000", 2024-04-26T12:05:45.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069e-05 2024-04-26T12:05:45.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785457+0000", 2024-04-26T12:05:45.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8617000000000001e-05 2024-04-26T12:05:45.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:45.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786628+0000", 2024-04-26T12:05:45.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001171418 2024-04-26T12:05:45.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:45.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786651+0000", 2024-04-26T12:05:45.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3289e-05 2024-04-26T12:05:45.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:45.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796393+0000", 2024-04-26T12:05:45.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097413269999999993 2024-04-26T12:05:45.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:45.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796424+0000", 2024-04-26T12:05:45.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1188e-05 2024-04-26T12:05:45.060 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.060 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:45.060 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.060 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:45.060 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:45.060 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.190431216999997, 2024-04-26T12:05:45.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010561432000000001, 2024-04-26T12:05:45.060 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:45.060 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.061 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:45.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:45.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:45.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:45.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:45.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:45.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:45.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:45.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785973+0000", 2024-04-26T12:05:45.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4910000000000002e-06 2024-04-26T12:05:45.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:45.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785991+0000", 2024-04-26T12:05:45.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7663e-05 2024-04-26T12:05:45.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785998+0000", 2024-04-26T12:05:45.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1239999999999999e-06 2024-04-26T12:05:45.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:45.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786792+0000", 2024-04-26T12:05:45.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079334800000000003 2024-04-26T12:05:45.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:45.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786810+0000", 2024-04-26T12:05:45.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8746999999999999e-05 2024-04-26T12:05:45.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:45.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796500+0000", 2024-04-26T12:05:45.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096897619999999993 2024-04-26T12:05:45.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:45.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796529+0000", 2024-04-26T12:05:45.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8873999999999998e-05 2024-04-26T12:05:45.064 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.064 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:45.064 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.065 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:45.065 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:45.065 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.190352130999997, 2024-04-26T12:05:45.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010219911, 2024-04-26T12:05:45.065 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:45.065 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.065 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:45.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:45.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:45.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:45.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:45.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:45.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786046+0000", 2024-04-26T12:05:45.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:45.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786053+0000", 2024-04-26T12:05:45.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0360000000000001e-06 2024-04-26T12:05:45.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:45.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786064+0000", 2024-04-26T12:05:45.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1202999999999999e-05 2024-04-26T12:05:45.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786091+0000", 2024-04-26T12:05:45.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6859000000000002e-05 2024-04-26T12:05:45.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:45.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786212+0000", 2024-04-26T12:05:45.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120975 2024-04-26T12:05:45.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:45.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786236+0000", 2024-04-26T12:05:45.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4358999999999998e-05 2024-04-26T12:05:45.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:45.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796236+0000", 2024-04-26T12:05:45.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099998050000000005 2024-04-26T12:05:45.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:45.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796266+0000", 2024-04-26T12:05:45.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0278e-05 2024-04-26T12:05:45.069 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.069 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:45.069 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.070 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:3 3.14 e17/15 3:287034c4:::1.00000000.inode:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:45.070 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:45.070 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.18956317, 2024-04-26T12:05:45.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009764712, 2024-04-26T12:05:45.070 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:45.070 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.070 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:45.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:45.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:45.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:45.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:45.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:45.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786835+0000", 2024-04-26T12:05:45.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T12:05:45.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:45.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786844+0000", 2024-04-26T12:05:45.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6500000000000008e-06 2024-04-26T12:05:45.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:45.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786855+0000", 2024-04-26T12:05:45.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0932e-05 2024-04-26T12:05:45.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786864+0000", 2024-04-26T12:05:45.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2150000000000007e-06 2024-04-26T12:05:45.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:45.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787242+0000", 2024-04-26T12:05:45.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037708300000000001 2024-04-26T12:05:45.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:45.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787259+0000", 2024-04-26T12:05:45.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7258999999999999e-05 2024-04-26T12:05:45.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:45.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796579+0000", 2024-04-26T12:05:45.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093201099999999995 2024-04-26T12:05:45.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:45.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796600+0000", 2024-04-26T12:05:45.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1330000000000001e-05 2024-04-26T12:05:45.074 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.074 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:45.074 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.074 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:45.074 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:45.074 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.189519148000002, 2024-04-26T12:05:45.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096431940000000008, 2024-04-26T12:05:45.075 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:45.075 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.075 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:45.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:45.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:45.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:45.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:45.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:45.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786879+0000", 2024-04-26T12:05:45.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:45.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786887+0000", 2024-04-26T12:05:45.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9300000000000003e-06 2024-04-26T12:05:45.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:45.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786894+0000", 2024-04-26T12:05:45.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:05:45.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786899+0000", 2024-04-26T12:05:45.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8400000000000002e-06 2024-04-26T12:05:45.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:45.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786932+0000", 2024-04-26T12:05:45.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3031999999999998e-05 2024-04-26T12:05:45.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:45.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786945+0000", 2024-04-26T12:05:45.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3421000000000001e-05 2024-04-26T12:05:45.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:45.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796469+0000", 2024-04-26T12:05:45.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095236130000000002 2024-04-26T12:05:45.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:45.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796523+0000", 2024-04-26T12:05:45.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4089999999999999e-05 2024-04-26T12:05:45.079 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.079 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:45.079 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.079 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "pg_update_log_missing(3.14 epoch 17/15 rep_tid 169 entries 17'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:05:45.079 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:45.079 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.189455993000003, 2024-04-26T12:05:45.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097257639999999996, 2024-04-26T12:05:45.080 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:45.080 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-04-26T12:05:45.080 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:45.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:45.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:45.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:45.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:45.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:45.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786942+0000", 2024-04-26T12:05:45.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:45.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786951+0000", 2024-04-26T12:05:45.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:05:45.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:45.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786965+0000", 2024-04-26T12:05:45.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4268e-05 2024-04-26T12:05:45.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786977+0000", 2024-04-26T12:05:45.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1667e-05 2024-04-26T12:05:45.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:45.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787667+0000", 2024-04-26T12:05:45.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00069057400000000001 2024-04-26T12:05:45.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:45.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796668+0000", 2024-04-26T12:05:45.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090013309999999996 2024-04-26T12:05:45.083 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.083 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:45.083 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.083 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:45.083 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:45.083 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.18940285, 2024-04-26T12:05:45.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095908309999999993, 2024-04-26T12:05:45.083 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:45.083 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.083 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:45.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:45.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:45.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:45.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:45.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:45.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786995+0000", 2024-04-26T12:05:45.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:45.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787001+0000", 2024-04-26T12:05:45.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5099999999999998e-06 2024-04-26T12:05:45.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:45.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787009+0000", 2024-04-26T12:05:45.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9100000000000005e-06 2024-04-26T12:05:45.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787019+0000", 2024-04-26T12:05:45.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8109999999999997e-06 2024-04-26T12:05:45.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:45.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787136+0000", 2024-04-26T12:05:45.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011749899999999999 2024-04-26T12:05:45.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:45.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787154+0000", 2024-04-26T12:05:45.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8278999999999999e-05 2024-04-26T12:05:45.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:45.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796561+0000", 2024-04-26T12:05:45.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094064379999999996 2024-04-26T12:05:45.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:45.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796587+0000", 2024-04-26T12:05:45.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5856000000000001e-05 2024-04-26T12:05:45.087 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.087 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:45.087 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.088 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:45.088 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:45.088 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.188685792999998, 2024-04-26T12:05:45.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096460160000000003, 2024-04-26T12:05:45.088 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:45.088 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.088 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:45.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:45.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:45.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:45.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:45.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:45.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:45.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787712+0000", 2024-04-26T12:05:45.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:45.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787718+0000", 2024-04-26T12:05:45.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:05:45.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:45.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787727+0000", 2024-04-26T12:05:45.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.123e-06 2024-04-26T12:05:45.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787734+0000", 2024-04-26T12:05:45.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.391e-06 2024-04-26T12:05:45.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:45.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788867+0000", 2024-04-26T12:05:45.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001133207 2024-04-26T12:05:45.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:45.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788899+0000", 2024-04-26T12:05:45.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1526000000000003e-05 2024-04-26T12:05:45.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:45.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797328+0000", 2024-04-26T12:05:45.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084295389999999998 2024-04-26T12:05:45.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:45.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:45.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:45.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797359+0000", 2024-04-26T12:05:45.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0660999999999997e-05 2024-04-26T12:05:45.092 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.092 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:45.092 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.092 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:45.092 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:45.092 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:45.094 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:45.094 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:45.093+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:45.195 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:45.194+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:45.197 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:45.198 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:05:45.198 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:05:45.198 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:45.207 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:45.296 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:45.295+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:45.311 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:45.311 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:05:45.311 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:05:45.311 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:05:45.311 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:45.320 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:45.407 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:45.406+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:45.466 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:45.466 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:05:45.467 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:05:45.467 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:05:45.467 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.467 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:45.467 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:45.467 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 51.607711317000003, 2024-04-26T12:05:45.467 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:05:45.467 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:45.467 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.467 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:45.467 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:45.467 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:45.467 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:05:45.468 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.468 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:45.468 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.468 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:45.468 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:45.468 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.468 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.468 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.468 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:45.468 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:45.468 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.468 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.468 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.468 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:45.469 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:45.469 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.469 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.469 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.469 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:45.469 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:05:45.469 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:05:45.469 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.469 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.469 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:45.469 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:05:45.469 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:05:45.469 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.469 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.469 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.470 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:05:45.470 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:05:45.470 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.470 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.470 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:45.470 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:05:45.470 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:05:45.470 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.470 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.470 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:45.470 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:05:45.470 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:05:45.470 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.470 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.471 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:45.471 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:05:45.471 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:05:45.471 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.471 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.471 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:45.471 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:05:45.471 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:05:45.471 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.471 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.471 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.471 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:05:45.471 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:05:45.471 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.472 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.472 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:45.472 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:05:45.472 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:05:45.472 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.472 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.472 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:45.472 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:05:45.472 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:05:45.472 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.472 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:45.472 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.472 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.472 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.472 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:45.473 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:45.473 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 51.607605421000002, 2024-04-26T12:05:45.473 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:05:45.473 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:45.473 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.473 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:45.473 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:45.473 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:45.473 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:05:45.473 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.473 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:45.473 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.473 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:45.473 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:45.473 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.474 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.474 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.474 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:45.474 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:45.474 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.474 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.474 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.474 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:45.474 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:45.474 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.474 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.474 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.474 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:45.474 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:05:45.475 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:05:45.475 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.475 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.475 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:45.475 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:05:45.475 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:05:45.475 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.475 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.475 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.475 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:05:45.475 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:05:45.475 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.475 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.475 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:45.476 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:05:45.476 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:05:45.476 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.476 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.476 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:45.476 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:05:45.476 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:05:45.476 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.476 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.476 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:45.476 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:05:45.476 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:05:45.476 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.476 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.476 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:45.477 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:05:45.477 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:05:45.477 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.477 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.477 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.477 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:05:45.477 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:05:45.477 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.477 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.477 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:45.477 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:05:45.477 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:05:45.477 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.477 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.478 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:45.478 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:05:45.478 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:05:45.478 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.478 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:45.478 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.478 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.478 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.478 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:45.478 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:45.478 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 51.607590440999999, 2024-04-26T12:05:45.478 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:05:45.478 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:45.478 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.479 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:45.479 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:45.479 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:45.479 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:05:45.479 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.479 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:45.479 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.479 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:45.479 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:45.479 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.479 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.479 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.479 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:45.479 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:45.479 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.480 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.480 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.480 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:45.480 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:45.480 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.480 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.480 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.480 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:45.480 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:05:45.480 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:05:45.480 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.480 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.480 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:45.481 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:05:45.481 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:05:45.481 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.481 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.481 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.481 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:05:45.481 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:05:45.481 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.481 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.481 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:45.481 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:05:45.481 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:05:45.481 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.481 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.482 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:45.482 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:05:45.482 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:05:45.482 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.482 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.482 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:45.482 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:05:45.482 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:05:45.482 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.482 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.482 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:45.482 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:05:45.482 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:05:45.482 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.483 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.483 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.483 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:05:45.483 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:05:45.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.483 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.483 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:45.483 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:05:45.483 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:05:45.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.483 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.483 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:45.483 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:05:45.484 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:05:45.484 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.484 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:45.484 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.484 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.484 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.484 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:45.484 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:45.484 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 51.607546566000003, 2024-04-26T12:05:45.484 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:05:45.484 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:45.484 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.484 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:45.484 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:45.485 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:45.485 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:05:45.485 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.485 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:45.485 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.485 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:45.485 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:45.485 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.485 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.485 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.485 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:45.485 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:45.485 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.485 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.485 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.486 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:45.486 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:45.486 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.486 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.486 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.486 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:45.486 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:05:45.486 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:05:45.486 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.486 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.486 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:45.486 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:05:45.486 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:05:45.486 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.487 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.487 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.487 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:05:45.487 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:05:45.487 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.487 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.487 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:45.487 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:05:45.487 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:05:45.487 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.487 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.487 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:45.487 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:05:45.487 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:05:45.488 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.488 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.488 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:45.488 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:05:45.488 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:05:45.488 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.488 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.488 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:45.488 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:05:45.488 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:05:45.488 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.488 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.488 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.488 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:05:45.488 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:05:45.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.489 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.489 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:45.489 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:05:45.489 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:05:45.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.489 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.489 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:45.489 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:05:45.489 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:05:45.489 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.489 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:45.489 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.490 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.490 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:45.490 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:45.490 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 51.607460902, 2024-04-26T12:05:45.490 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:05:45.490 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:45.490 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.490 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:45.490 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:45.490 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:45.490 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:05:45.490 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.490 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:45.490 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.491 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:45.491 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:45.491 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.491 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.491 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.491 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:45.491 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:45.491 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.491 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.491 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.491 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:45.491 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:45.491 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.491 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.492 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.492 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:45.492 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:05:45.492 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:05:45.492 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.492 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.492 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:45.492 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:05:45.492 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:05:45.492 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.492 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.492 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.492 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:05:45.492 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:05:45.493 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.493 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.493 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:45.493 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:05:45.493 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:05:45.493 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.493 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.493 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:45.493 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:05:45.493 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:05:45.493 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.493 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.493 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:45.493 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:05:45.494 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:05:45.494 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.494 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.494 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:45.494 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:05:45.494 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:05:45.494 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.494 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.494 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.494 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:05:45.494 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:05:45.494 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.494 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.494 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:45.495 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:05:45.495 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:05:45.495 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.495 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.495 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:45.495 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:05:45.495 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:05:45.495 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.495 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:45.495 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.495 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.495 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.495 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.495 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:45.496 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.681556616000002, 2024-04-26T12:05:45.496 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:05:45.496 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:45.496 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.496 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:45.496 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.496 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:45.496 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:45.496 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.496 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.496 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.496 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:45.496 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:45.497 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.497 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.497 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.497 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:45.497 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:45.497 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:45.497 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.497 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.497 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:45.497 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:05:45.497 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:05:45.497 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.497 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.497 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:45.497 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:05:45.498 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:05:45.498 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.498 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.498 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.498 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:05:45.498 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:05:45.498 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.498 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.498 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:45.498 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:05:45.498 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:05:45.498 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.498 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.499 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:45.499 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:05:45.499 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:05:45.499 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.499 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.499 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:45.499 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:05:45.499 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:05:45.499 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.499 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.499 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:45.499 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:05:45.499 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:05:45.499 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.499 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.500 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.500 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:05:45.500 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:05:45.500 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.500 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.500 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:45.500 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:05:45.500 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:05:45.500 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.500 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.500 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:45.500 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:05:45.500 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:05:45.500 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.501 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:45.501 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.501 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.501 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.501 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.501 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:45.501 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.681520521000003, 2024-04-26T12:05:45.501 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:05:45.501 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:45.501 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.501 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:45.501 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.501 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:45.501 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:45.502 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.502 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.502 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.502 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:45.502 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:45.502 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.502 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.502 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.502 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:45.502 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:05:45.502 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:45.502 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.502 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.503 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:45.503 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:05:45.503 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:05:45.503 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.503 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.503 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:45.503 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:05:45.503 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:05:45.503 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.503 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.503 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.503 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:05:45.504 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:05:45.504 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.504 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.504 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:45.504 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:05:45.504 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:05:45.504 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.504 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.504 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:45.504 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:05:45.504 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:05:45.504 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.504 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.504 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:45.505 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:05:45.505 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:05:45.505 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.505 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.505 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:45.505 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:05:45.505 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:05:45.506 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.506 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.506 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.506 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:05:45.507 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:05:45.507 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.507 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.507 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:45.507 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:05:45.507 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:05:45.507 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.507 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.507 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:45.507 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:05:45.508 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:05:45.508 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.508 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:45.508 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.508 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.508 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.508 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.508 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:45.508 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.681482836999997, 2024-04-26T12:05:45.508 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:05:45.508 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:45.508 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.509 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:45.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.509 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:45.509 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:45.509 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.509 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:45.509 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:45.509 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.510 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:45.510 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:05:45.510 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.510 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.510 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.510 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:45.510 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:05:45.510 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:05:45.510 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.510 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.510 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:45.510 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:05:45.511 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:05:45.511 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.511 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.511 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.511 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:05:45.511 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:05:45.511 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.511 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.511 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:45.511 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:05:45.511 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:05:45.511 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.511 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.512 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:45.512 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:45.512 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:05:45.512 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.512 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.512 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:45.512 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:05:45.512 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:05:45.512 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.512 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.512 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:45.512 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:05:45.513 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:05:45.513 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.513 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.513 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.513 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:05:45.513 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:05:45.513 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.513 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.513 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:45.513 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:05:45.513 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:05:45.513 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.513 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.514 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:45.514 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:05:45.514 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:05:45.514 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.514 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:45.514 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.514 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.514 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.514 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.514 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:45.514 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.681461497000001, 2024-04-26T12:05:45.514 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:05:45.514 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:45.515 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.515 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:45.515 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.515 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:45.515 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:45.515 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.515 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.515 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.515 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:45.515 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:45.515 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.515 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.515 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.516 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:45.516 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:45.516 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.516 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.516 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.516 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:45.516 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:05:45.516 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:45.516 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.516 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.516 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:45.516 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:05:45.516 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:05:45.517 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.517 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.517 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.517 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:05:45.517 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:05:45.517 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.517 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.517 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:45.517 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:05:45.517 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:05:45.517 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.517 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.517 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:45.517 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:05:45.518 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:05:45.518 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.518 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.518 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:45.518 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:05:45.518 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:05:45.518 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.518 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.518 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:45.518 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:05:45.518 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:05:45.518 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.518 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.519 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.519 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:05:45.519 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:05:45.519 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.519 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.519 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:45.519 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:05:45.519 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:05:45.519 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.519 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.519 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:45.519 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:05:45.519 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:05:45.519 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.520 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:45.520 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.520 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.520 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.520 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.520 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:45.520 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.681439230999999, 2024-04-26T12:05:45.520 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:05:45.520 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:45.520 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.520 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:45.520 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.520 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:45.521 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:45.521 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.521 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.521 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.521 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:45.521 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:45.521 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.521 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.521 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.521 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:45.521 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:45.521 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.521 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.521 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.521 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:45.522 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:05:45.522 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:45.522 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.522 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.522 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:45.522 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:05:45.522 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:05:45.522 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.522 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.522 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.522 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:05:45.522 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:05:45.522 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.522 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.523 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:45.523 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:05:45.523 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:05:45.523 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.523 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.523 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:45.523 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:05:45.523 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:05:45.525 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.525 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.525 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:45.525 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:05:45.525 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:05:45.525 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.525 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.525 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:45.526 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:05:45.526 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:05:45.526 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.526 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.526 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.526 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:05:45.526 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:05:45.526 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.526 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.526 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:45.526 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:05:45.526 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:05:45.526 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.526 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.527 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:45.527 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:05:45.527 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:05:45.527 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.527 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:45.527 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.527 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.527 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.527 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.527 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:45.527 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.681417609, 2024-04-26T12:05:45.527 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:05:45.527 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:45.527 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.527 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:45.528 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.528 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:45.528 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:45.528 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.528 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.528 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.528 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:45.528 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:45.528 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.528 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.528 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.528 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:45.528 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:45.528 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.529 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.529 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.529 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:45.529 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:05:45.529 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:05:45.529 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.529 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.529 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:45.529 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:05:45.529 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:05:45.529 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.529 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.529 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.529 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:05:45.529 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:05:45.530 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.530 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.530 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:45.530 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:05:45.530 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:05:45.530 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.530 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.530 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:45.530 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:05:45.530 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:05:45.530 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.530 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.530 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:45.530 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:05:45.530 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:05:45.531 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.531 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.531 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:45.531 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:05:45.531 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:05:45.531 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.531 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.531 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.531 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:05:45.531 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:05:45.531 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.531 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.531 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:45.531 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:05:45.532 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:05:45.532 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.532 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.532 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:45.532 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:05:45.532 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:05:45.532 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.532 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:45.532 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.532 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.532 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.532 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.532 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:45.532 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.681391042999998, 2024-04-26T12:05:45.533 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:05:45.533 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:45.533 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.533 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:45.533 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.533 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:45.533 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:45.533 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.533 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.533 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.533 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:45.533 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:45.533 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.533 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.533 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.534 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:45.534 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:05:45.534 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.534 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.534 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.534 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:45.534 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:05:45.534 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:05:45.534 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.534 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.534 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:45.534 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:05:45.534 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:05:45.534 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.535 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.535 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.535 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:05:45.535 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:05:45.535 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.535 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.535 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:45.535 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:05:45.535 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:05:45.535 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.535 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.535 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:45.535 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:05:45.535 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:05:45.535 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.536 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.536 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:45.536 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:05:45.536 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:05:45.536 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.536 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.536 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:45.536 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:05:45.536 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:05:45.536 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.536 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.536 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.536 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:05:45.536 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:05:45.536 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.537 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.537 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:45.537 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:05:45.537 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:05:45.537 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.537 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.537 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:45.537 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:05:45.537 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:05:45.537 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.537 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:45.537 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.537 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.537 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.537 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.538 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:45.538 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.681352531000002, 2024-04-26T12:05:45.538 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:05:45.538 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:45.538 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.538 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:45.538 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.538 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:45.538 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:45.538 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.538 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.538 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.538 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:45.538 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:45.539 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.539 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.539 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.539 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:45.539 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:45.539 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.539 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.539 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.539 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:45.539 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:05:45.539 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:05:45.539 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.539 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.539 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:45.540 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:05:45.540 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:05:45.540 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.540 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.540 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.540 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:05:45.540 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:05:45.540 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.540 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.540 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:45.540 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:05:45.540 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:05:45.540 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.540 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.540 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:45.541 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:05:45.541 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:05:45.541 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.541 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.541 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:45.541 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:05:45.541 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:05:45.541 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.541 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.541 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:45.541 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:05:45.541 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:05:45.541 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.541 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.541 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.542 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:05:45.542 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:05:45.542 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.542 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.542 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:45.542 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:05:45.542 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:05:45.542 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.542 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.542 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:45.542 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:05:45.542 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:05:45.542 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.542 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:45.543 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.543 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.543 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.543 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.543 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:45.543 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.681324357999998, 2024-04-26T12:05:45.543 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:05:45.543 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:45.543 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.543 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:45.543 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.543 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:45.543 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:45.543 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.543 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.544 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.544 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:45.544 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:45.544 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.544 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.544 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.544 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:45.544 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:45.544 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.544 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.544 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.544 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:45.544 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:05:45.544 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:05:45.544 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.545 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.545 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:45.545 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:05:45.545 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:05:45.545 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.545 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.545 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.545 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:05:45.545 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:05:45.545 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.545 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.545 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:45.545 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:05:45.545 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:05:45.545 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.546 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.546 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:45.546 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:05:45.546 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:05:45.546 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.546 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.546 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:45.546 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:05:45.546 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:05:45.546 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.546 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.546 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:45.546 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:05:45.546 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:05:45.547 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.547 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.547 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.547 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:05:45.547 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:05:45.547 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.547 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.547 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:45.547 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:05:45.547 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:05:45.547 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.547 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.547 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:45.547 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:05:45.547 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:05:45.548 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.548 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:45.548 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.548 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.548 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.548 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.548 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:45.548 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.681289794000001, 2024-04-26T12:05:45.548 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:05:45.548 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:45.548 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.548 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:45.548 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.548 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:45.548 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:45.549 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.549 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.549 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.549 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:45.549 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:45.549 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.549 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.549 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.549 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:45.549 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:05:45.549 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.549 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.549 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.549 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:45.550 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:05:45.550 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:05:45.550 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.550 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.550 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:45.550 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:05:45.550 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:05:45.550 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.550 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.550 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.550 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:05:45.550 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:05:45.550 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.550 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.550 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:45.551 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:05:45.551 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:05:45.551 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.551 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.551 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:45.551 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:05:45.551 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:05:45.551 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.551 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.551 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:45.551 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:05:45.551 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:05:45.551 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.552 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.552 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:45.552 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:05:45.552 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:05:45.552 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.552 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.552 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.552 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:05:45.552 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:05:45.552 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.552 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.552 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:45.552 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:45.552 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:05:45.552 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.553 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.553 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:45.553 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:05:45.553 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:05:45.553 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.553 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:45.553 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.553 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.553 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.553 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.553 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:45.553 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.680415013999998, 2024-04-26T12:05:45.553 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:05:45.553 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:45.553 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.554 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:45.554 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.554 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:45.554 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:45.554 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.554 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.554 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.554 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:45.554 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:45.554 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.554 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.554 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.554 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:45.554 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:05:45.555 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:45.555 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.555 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.555 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:45.555 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:05:45.555 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:05:45.555 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.555 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.555 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:45.555 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:05:45.555 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:05:45.555 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.555 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.555 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.556 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:05:45.556 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:05:45.556 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.556 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.556 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:45.556 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:05:45.556 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:05:45.556 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.556 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.556 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:45.556 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:05:45.556 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:05:45.556 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.556 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.557 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:45.557 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:05:45.557 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:05:45.557 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.557 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.557 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:45.557 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:05:45.557 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:05:45.557 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.557 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.557 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.557 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:05:45.557 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:05:45.557 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.557 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.558 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:45.558 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:05:45.558 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:05:45.558 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.558 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.558 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:45.558 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:05:45.558 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:05:45.558 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.558 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:45.558 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.558 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.558 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.558 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.558 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:45.559 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.680376054999996, 2024-04-26T12:05:45.559 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:05:45.559 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:45.559 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.559 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:45.559 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.559 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:45.559 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:45.559 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.559 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.559 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.559 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:45.559 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:45.559 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.560 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.560 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.560 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:45.560 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:05:45.560 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.560 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.560 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.560 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:45.560 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:05:45.560 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:05:45.560 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.560 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.560 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:45.560 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:05:45.560 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:05:45.561 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.561 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.561 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.561 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:05:45.561 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:05:45.561 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.561 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.561 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:45.561 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:05:45.561 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:05:45.561 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.561 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.561 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:45.561 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:05:45.562 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:05:45.562 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.562 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.562 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:45.562 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:05:45.562 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:05:45.562 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.562 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.562 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:45.562 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:05:45.562 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:05:45.562 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.562 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.562 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.562 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:05:45.563 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:05:45.563 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.563 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.563 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:45.563 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:05:45.563 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:05:45.563 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.563 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.563 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:45.563 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:05:45.563 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:05:45.563 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.563 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:45.563 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.564 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.564 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.564 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.564 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:45.564 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.680340583000003, 2024-04-26T12:05:45.564 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:05:45.564 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:45.564 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.564 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:45.564 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.564 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:45.564 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:45.564 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.564 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.565 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.565 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:45.565 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:45.565 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.565 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.565 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.565 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:45.565 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:45.565 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.565 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.565 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.565 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:45.565 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:05:45.565 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:05:45.566 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.566 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.566 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:45.566 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:05:45.566 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:05:45.566 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.566 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.566 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.566 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:05:45.566 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:05:45.566 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.566 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.566 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:45.566 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:05:45.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:05:45.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.567 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:45.567 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:05:45.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:05:45.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.567 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:45.567 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:05:45.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:05:45.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.567 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:45.568 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:05:45.568 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:05:45.568 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.568 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.568 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:05:45.568 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:05:45.568 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.568 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:45.568 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:05:45.568 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:05:45.568 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.569 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:45.569 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:05:45.569 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:05:45.569 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.569 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:45.569 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.569 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.569 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.569 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:45.569 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.680261893999997, 2024-04-26T12:05:45.570 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:05:45.570 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:45.570 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.570 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:45.570 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.570 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:45.570 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:45.570 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.570 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.570 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.570 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:45.570 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:45.570 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.570 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.571 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.571 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:45.571 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:05:45.571 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:45.571 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.571 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.571 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:45.571 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:05:45.571 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:05:45.571 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.571 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.571 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:45.571 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:05:45.572 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:05:45.572 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.572 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.572 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.572 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:05:45.572 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:05:45.572 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.572 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.572 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:45.572 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:05:45.572 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:05:45.572 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.572 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.572 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:45.573 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:05:45.573 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:05:45.573 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.573 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.573 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:45.573 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:05:45.573 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:05:45.573 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.573 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.573 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:45.573 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:05:45.573 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:05:45.573 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.574 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.574 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.574 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:05:45.574 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:05:45.574 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.574 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.574 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:45.574 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:05:45.574 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:05:45.574 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.574 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.574 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:45.574 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:05:45.575 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:05:45.575 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.575 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:45.575 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.575 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.575 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.575 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.575 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:45.575 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.680111046, 2024-04-26T12:05:45.575 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:05:45.575 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:45.575 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:05:45.575 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:45.575 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.576 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:45.576 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:45.576 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.576 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.576 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.576 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:45.576 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:45.576 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:45.576 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.576 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.576 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:45.576 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:05:45.576 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:45.576 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.577 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.577 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:45.577 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:05:45.577 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:05:45.577 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.577 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.577 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:45.577 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:05:45.577 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:05:45.577 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.577 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.577 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.577 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:05:45.577 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:05:45.577 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.578 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.578 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:45.578 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:05:45.578 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:05:45.578 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.578 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.578 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:45.578 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:45.578 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:05:45.578 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:45.578 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:45.578 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:45.578 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:05:45.578 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:05:45.579 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.579 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:45.579 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.579 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:45.579 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:45.579 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:45.579 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:45.580 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:45.524+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:45.626 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:45.624+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:45.691 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:45.691 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:45.691 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:05:45.691 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:45.701 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:45.747 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:45.745+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:45.805 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:45.805 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:45.805 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:05:45.805 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:05:45.805 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:45.813 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:45.828 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:45.827+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:45.894 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:05:45.929 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:45.928+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:45.958 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:45.958 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:05:45.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:05:45.958 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:05:45.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.958 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.958 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:45.958 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.175408099999999, 2024-04-26T12:05:45.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:05:45.958 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:45.958 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.959 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:45.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:45.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:45.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:45.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:45.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:45.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:45.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:45.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:05:45.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:45.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:45.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:05:45.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:05:45.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:45.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:05:45.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:05:45.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:05:45.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:05:45.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:45.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:05:45.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:05:45.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:45.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:45.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:05:45.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:45.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:05:45.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:05:45.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:45.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:05:45.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:05:45.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:05:45.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:05:45.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:45.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:05:45.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:05:45.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:45.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:05:45.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:05:45.963 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:45.963 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:45.963 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:45.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.963 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.964 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:45.964 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.175352779999997, 2024-04-26T12:05:45.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:05:45.964 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:45.964 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.964 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:45.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:45.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:45.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:45.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:45.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:45.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:45.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:45.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:05:45.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:45.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:45.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:05:45.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:05:45.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:45.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:05:45.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:05:45.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:05:45.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:05:45.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:45.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:05:45.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:05:45.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:45.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:05:45.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:05:45.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:45.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:05:45.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:05:45.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:45.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:05:45.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:05:45.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:05:45.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:05:45.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:45.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:05:45.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:05:45.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:45.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:05:45.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:05:45.969 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:45.969 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:45.969 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:45.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.969 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.970 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:45.970 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.175302762000001, 2024-04-26T12:05:45.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:05:45.970 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:45.970 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.970 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:45.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:45.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:45.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:45.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:45.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:45.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:45.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:45.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:05:45.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:45.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:05:45.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:05:45.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:45.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:05:45.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:05:45.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:05:45.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:05:45.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:45.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:05:45.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:05:45.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:45.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:05:45.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:05:45.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:45.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:05:45.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:05:45.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:45.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:05:45.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:05:45.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:05:45.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:05:45.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:45.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:05:45.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:05:45.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:45.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:05:45.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:05:45.975 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:45.975 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:45.975 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:45.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.975 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.975 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:45.975 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.175268125000002, 2024-04-26T12:05:45.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:05:45.975 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:45.975 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.976 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:45.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:45.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:45.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:45.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:45.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:45.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:45.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:45.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:05:45.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:45.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:05:45.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:05:45.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:45.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:45.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:05:45.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:05:45.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:05:45.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:45.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:05:45.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:05:45.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:45.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:05:45.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:05:45.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:45.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:05:45.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:05:45.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:05:45.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:05:45.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:45.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:05:45.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:05:45.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:45.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:05:45.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:05:45.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:45.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:05:45.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:05:45.980 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:45.980 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:45.980 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:45.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.981 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.981 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:45.981 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.175229612999999, 2024-04-26T12:05:45.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:05:45.981 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:45.981 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.981 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:45.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:45.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:45.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:45.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:45.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:45.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:45.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:45.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:45.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:45.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:45.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:45.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:05:45.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:45.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:05:45.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:05:45.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:05:45.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:05:45.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:45.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:05:45.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:05:45.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:45.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:05:45.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:05:45.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:45.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:05:45.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:05:45.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:05:45.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:05:45.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:45.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:05:45.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:05:45.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:45.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:05:45.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:05:45.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:45.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:05:45.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:05:45.986 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:45.986 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:45.986 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:45.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.986 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.986 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:45.986 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.175199290000002, 2024-04-26T12:05:45.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:05:45.987 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:45.987 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:45.987 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:45.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:45.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:45.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:45.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:45.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:45.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:45.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:45.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:45.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:45.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:05:45.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:05:45.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:45.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:05:45.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:05:45.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:05:45.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:05:45.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:45.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:05:45.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:05:45.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:45.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:05:45.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:05:45.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:45.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:05:45.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:05:45.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:45.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:05:45.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:05:45.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:45.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:05:45.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:05:45.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:45.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:05:45.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:05:45.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.992 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:45.992 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:05:45.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:05:45.992 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:45.992 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:45.992 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:45.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.992 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.992 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:45.992 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.175172588000002, 2024-04-26T12:05:45.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:05:45.992 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:45.993 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:45.993 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:45.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:45.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:45.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:45.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:45.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:45.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:45.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:45.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:45.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:45.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:05:45.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:05:45.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:45.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:05:45.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:05:45.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:05:45.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:05:45.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:45.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:05:45.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:05:45.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:45.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:05:45.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:05:45.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:45.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:05:45.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:05:45.996 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:45.997 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:45.997 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:45.997 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.997 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:45.997 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:45.997 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.175130297999999, 2024-04-26T12:05:45.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:05:45.997 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:45.997 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:45.997 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:45.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.997 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:45.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:45.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:45.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:45.998 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:45.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:45.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:45.998 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:45.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:45.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:45.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:05:45.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:05:45.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:45.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:05:45.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:05:45.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:45.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:45.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:05:45.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:05:45.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:45.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:46.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:05:46.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:05:46.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:46.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:05:46.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:05:46.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:46.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:05:46.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:05:46.000 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.000 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:46.001 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.001 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.001 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:46.001 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:46.001 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.175102219999999, 2024-04-26T12:05:46.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:05:46.001 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:46.001 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:46.001 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:46.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.001 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:46.001 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:46.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:46.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:46.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:46.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:46.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:46.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:05:46.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:46.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:05:46.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:05:46.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:46.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:05:46.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:05:46.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:46.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:05:46.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:46.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:46.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:05:46.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:46.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:05:46.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:05:46.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:46.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:05:46.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:05:46.004 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.004 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:46.005 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.005 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:46.005 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:46.005 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.16910687, 2024-04-26T12:05:46.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:05:46.005 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:46.005 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.005 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:46.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.005 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:46.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:46.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:46.006 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.006 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.006 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:46.006 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:46.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:46.006 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.006 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.006 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:46.006 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:05:46.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.006 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.006 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.006 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:46.006 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:05:46.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:05:46.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:46.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:05:46.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:05:46.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:05:46.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:05:46.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:46.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:05:46.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:05:46.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.008 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:46.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:05:46.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:05:46.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:46.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:05:46.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:05:46.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:46.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:05:46.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:05:46.009 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.009 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:46.009 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.010 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.010 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:46.010 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:46.010 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.169037904, 2024-04-26T12:05:46.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:05:46.010 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:46.010 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.010 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:46.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.010 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:46.010 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:46.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:46.010 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.011 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:46.011 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:46.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:46.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.011 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:46.011 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:05:46.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.011 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:46.011 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:05:46.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:05:46.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.012 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:46.012 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:05:46.012 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:05:46.012 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.012 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.012 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:05:46.012 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:05:46.012 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.012 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:46.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:05:46.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:05:46.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.013 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:46.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:46.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:05:46.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.013 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:46.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:05:46.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:05:46.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.013 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:46.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:05:46.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:05:46.014 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.014 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:46.014 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.014 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.014 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:46.014 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:46.014 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.168543540999998, 2024-04-26T12:05:46.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:05:46.014 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:46.014 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.014 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:46.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:46.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:46.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:46.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:46.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:46.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:46.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:46.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:46.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:46.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:05:46.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:05:46.016 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:46.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:05:46.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:05:46.016 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:05:46.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:05:46.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.017 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:46.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:05:46.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:05:46.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.017 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:46.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:05:46.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:05:46.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.017 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:46.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:05:46.018 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:05:46.018 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.018 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.018 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:46.018 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:05:46.018 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:05:46.018 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.018 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:46.018 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.018 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.018 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.018 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:46.018 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:46.018 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.168505275999998, 2024-04-26T12:05:46.019 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:05:46.019 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:46.019 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.019 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:46.019 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.019 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:46.019 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:46.019 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:46.019 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.019 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.019 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:46.019 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:46.019 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:46.019 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.019 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.020 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:46.020 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:46.020 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.020 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.020 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.020 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:46.021 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:05:46.021 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:05:46.021 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.021 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.021 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:46.021 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:05:46.021 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:05:46.021 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.021 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.021 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.021 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:05:46.021 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:05:46.021 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.021 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.022 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:46.022 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:05:46.022 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:05:46.022 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.022 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.022 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:46.022 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:05:46.022 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:05:46.022 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.022 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.022 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:46.022 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:05:46.023 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:05:46.023 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.023 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.023 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:46.023 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:05:46.023 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:05:46.023 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.023 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:46.023 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.023 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.023 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.023 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:05:46.023 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:46.023 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.167825391000001, 2024-04-26T12:05:46.024 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:05:46.024 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:46.024 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:46.024 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:46.024 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.024 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:46.024 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:46.024 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:46.024 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.024 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.024 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:46.024 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:46.024 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:46.024 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.025 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.025 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:46.025 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:46.025 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.025 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.025 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.025 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:46.025 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:05:46.025 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:05:46.025 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.025 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.025 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:46.025 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:05:46.025 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:05:46.025 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.026 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:05:46.026 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:05:46.026 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:46.026 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:05:46.026 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:05:46.026 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:46.026 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:05:46.026 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:05:46.027 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.027 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:46.027 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.027 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.027 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.027 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:46.027 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:46.027 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.167796211999999, 2024-04-26T12:05:46.027 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:05:46.027 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:46.027 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:46.027 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:46.027 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.027 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:46.027 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:46.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:46.028 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.028 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.028 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:46.028 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:46.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:46.028 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.028 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.028 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:46.028 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:05:46.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.028 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.028 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.028 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:46.028 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:05:46.029 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:05:46.029 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.029 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.029 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:46.029 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:05:46.029 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:05:46.029 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.029 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.029 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.029 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:05:46.029 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:05:46.029 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.029 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.029 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:46.029 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:05:46.030 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:05:46.030 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.030 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.030 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:46.030 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:05:46.030 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:05:46.030 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.030 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.030 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:46.030 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:05:46.030 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:05:46.030 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.030 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:46.030 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.031 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.031 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.031 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:46.031 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:46.031 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.167764400999999, 2024-04-26T12:05:46.031 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:05:46.031 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:46.031 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:46.031 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:46.031 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.031 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:46.031 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:46.031 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:46.031 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.032 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.032 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:46.032 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:46.032 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:46.032 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.032 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.032 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:46.032 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:46.032 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:05:46.032 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.032 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.032 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:46.032 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:05:46.032 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:05:46.032 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.033 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.033 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:46.033 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:05:46.033 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:05:46.033 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.033 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.033 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.033 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:05:46.033 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:05:46.033 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.033 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.033 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:46.033 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:05:46.033 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:05:46.033 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.034 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.034 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:46.034 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:05:46.034 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:05:46.034 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.034 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.034 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:46.034 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:05:46.034 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:05:46.034 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.034 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:46.034 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.034 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.034 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.035 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:46.035 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:46.035 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.167743045000002, 2024-04-26T12:05:46.035 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:05:46.035 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:46.035 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:46.035 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:46.035 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.035 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:46.035 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:46.035 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:46.035 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.035 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.035 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:46.035 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:46.036 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:46.036 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.036 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.036 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:46.036 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:46.036 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:05:46.036 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.036 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.036 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:46.036 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:05:46.036 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:05:46.036 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.036 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.036 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:46.036 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:05:46.037 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:05:46.037 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.037 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.037 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.037 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:05:46.037 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:05:46.037 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.037 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.037 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:46.037 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:05:46.037 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:05:46.037 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.037 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.037 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:46.038 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:05:46.038 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:05:46.038 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.038 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.038 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:46.038 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:05:46.038 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:05:46.039 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.039 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:46.039 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.039 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.039 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.039 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:05:46.039 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:46.039 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.167714592000003, 2024-04-26T12:05:46.039 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:05:46.039 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:46.039 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:46.039 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:46.039 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.039 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:46.039 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:46.040 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:46.040 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.040 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.040 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:46.041 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:46.041 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:46.041 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.041 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.041 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:46.041 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:46.041 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.041 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.041 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.041 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:46.041 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:05:46.042 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:05:46.042 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.042 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.042 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:46.042 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:05:46.042 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:05:46.042 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.042 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.042 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.042 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:05:46.042 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:05:46.042 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.043 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.043 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:46.043 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:05:46.043 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:05:46.043 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.043 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.043 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:46.043 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:05:46.043 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:05:46.043 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.043 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:46.043 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.044 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.044 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.044 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:05:46.044 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:46.044 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.166992786000002, 2024-04-26T12:05:46.044 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:05:46.044 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:46.044 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:46.044 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:46.044 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.044 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:46.045 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:46.045 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:46.045 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.045 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.045 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:46.045 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:46.045 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:46.045 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.045 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.045 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:46.045 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:05:46.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:46.046 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.046 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.046 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:46.046 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:05:46.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:05:46.046 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.046 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.046 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:46.046 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:05:46.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:05:46.047 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.047 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.047 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.047 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:05:46.047 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:05:46.047 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.047 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.047 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:46.047 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:05:46.047 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:05:46.047 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.047 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.048 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:46.048 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:05:46.048 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:05:46.048 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.048 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:46.048 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.048 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.048 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.048 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:05:46.048 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:46.048 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 36.450066182999997, 2024-04-26T12:05:46.048 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:05:46.049 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:46.049 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.049 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:46.049 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.049 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:46.049 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:46.049 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:46.049 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.049 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.049 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:46.049 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:46.050 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:46.050 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.050 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.050 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:46.050 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:05:46.050 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:05:46.050 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.050 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.050 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:46.050 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:05:46.050 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:05:46.050 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.051 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.051 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:46.051 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:05:46.051 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:05:46.051 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.051 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.051 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.051 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:05:46.051 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:05:46.051 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.051 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.051 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:46.052 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:05:46.052 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:05:46.052 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.052 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.052 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:46.052 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:05:46.052 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:05:46.052 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.052 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.052 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:46.052 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:05:46.052 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:05:46.052 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.053 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.053 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:46.053 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:05:46.053 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:05:46.053 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.053 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.053 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.053 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:05:46.053 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:05:46.053 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.053 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.053 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:46.053 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:05:46.054 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:05:46.054 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:46.054 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:46.054 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:46.054 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:05:46.054 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:05:46.054 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.054 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:46.054 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.054 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:46.054 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:46.054 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:46.056 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:46.057 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:46.055+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:46.158 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:46.157+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:46.171 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:46.172 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:05:46.172 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-04-26T12:05:46.172 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:46.181 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:46.259 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:46.258+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:46.284 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:05:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T12:05:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T12:05:46.284 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:46.293 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:46.359 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:46.358+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:46.397 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:46.397 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T12:05:46.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T12:05:46.397 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T12:05:46.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.397 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:46.397 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:46.397 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.614576679000002, 2024-04-26T12:05:46.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017255857999999999, 2024-04-26T12:05:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780340+0000", 2024-04-26T12:05:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780351+0000", 2024-04-26T12:05:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0898e-05 2024-04-26T12:05:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1671999999999999e-05 2024-04-26T12:05:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780374+0000", 2024-04-26T12:05:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1117999999999999e-05 2024-04-26T12:05:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780423+0000", 2024-04-26T12:05:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9066000000000001e-05 2024-04-26T12:05:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780428+0000", 2024-04-26T12:05:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1320000000000002e-06 2024-04-26T12:05:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788902+0000", 2024-04-26T12:05:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084738560000000001 2024-04-26T12:05:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789167+0000", 2024-04-26T12:05:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026521100000000001 2024-04-26T12:05:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789279+0000", 2024-04-26T12:05:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111616 2024-04-26T12:05:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792335+0000", 2024-04-26T12:05:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030556419999999999 2024-04-26T12:05:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797519+0000", 2024-04-26T12:05:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051841550000000002 2024-04-26T12:05:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797559+0000", 2024-04-26T12:05:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0451999999999998e-05 2024-04-26T12:05:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797598+0000", 2024-04-26T12:05:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8500000000000001e-05 2024-04-26T12:05:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.614528372000002, 2024-04-26T12:05:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017668725, 2024-04-26T12:05:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:46.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:46.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780395+0000", 2024-04-26T12:05:46.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.198e-06 2024-04-26T12:05:46.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:46.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780402+0000", 2024-04-26T12:05:46.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:05:46.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780408+0000", 2024-04-26T12:05:46.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:46.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780481+0000", 2024-04-26T12:05:46.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3239999999999997e-05 2024-04-26T12:05:46.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:46.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780485+0000", 2024-04-26T12:05:46.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4039999999999999e-06 2024-04-26T12:05:46.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789518+0000", 2024-04-26T12:05:46.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090335480000000006 2024-04-26T12:05:46.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:46.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789585+0000", 2024-04-26T12:05:46.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6469000000000003e-05 2024-04-26T12:05:46.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:46.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789699+0000", 2024-04-26T12:05:46.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114613 2024-04-26T12:05:46.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793308+0000", 2024-04-26T12:05:46.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036088520000000001 2024-04-26T12:05:46.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:46.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797887+0000", 2024-04-26T12:05:46.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0045792790000000003 2024-04-26T12:05:46.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:46.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797955+0000", 2024-04-26T12:05:46.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T12:05:46.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:46.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798059+0000", 2024-04-26T12:05:46.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103874 2024-04-26T12:05:46.409 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.409 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:46.409 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.409 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:46.409 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:46.409 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.614498099999999, 2024-04-26T12:05:46.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017735145000000001, 2024-04-26T12:05:46.409 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:46.409 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.409 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:46.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:46.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:46.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:46.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:46.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:46.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:46.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:46.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780424+0000", 2024-04-26T12:05:46.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4519999999999999e-06 2024-04-26T12:05:46.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:46.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780431+0000", 2024-04-26T12:05:46.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0690000000000004e-06 2024-04-26T12:05:46.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780438+0000", 2024-04-26T12:05:46.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5719999999999999e-06 2024-04-26T12:05:46.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780468+0000", 2024-04-26T12:05:46.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.993e-05 2024-04-26T12:05:46.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:46.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780472+0000", 2024-04-26T12:05:46.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-04-26T12:05:46.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789916+0000", 2024-04-26T12:05:46.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094434940000000002 2024-04-26T12:05:46.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:46.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790004+0000", 2024-04-26T12:05:46.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8085999999999997e-05 2024-04-26T12:05:46.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:46.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790125+0000", 2024-04-26T12:05:46.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012186200000000001 2024-04-26T12:05:46.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793402+0000", 2024-04-26T12:05:46.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00327685 2024-04-26T12:05:46.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:46.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798068+0000", 2024-04-26T12:05:46.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046652150000000003 2024-04-26T12:05:46.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:46.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798108+0000", 2024-04-26T12:05:46.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0911000000000002e-05 2024-04-26T12:05:46.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:46.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798156+0000", 2024-04-26T12:05:46.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7128e-05 2024-04-26T12:05:46.415 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.415 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:46.415 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.415 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:46.416 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:46.416 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.614475081000002, 2024-04-26T12:05:46.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017792624, 2024-04-26T12:05:46.416 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:46.416 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.416 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:46.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:46.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:46.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:46.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:46.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:46.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:46.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:46.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780447+0000", 2024-04-26T12:05:46.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8519999999999997e-06 2024-04-26T12:05:46.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:46.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780453+0000", 2024-04-26T12:05:46.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2999999999999998e-06 2024-04-26T12:05:46.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:46.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0760000000000002e-06 2024-04-26T12:05:46.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780502+0000", 2024-04-26T12:05:46.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4079999999999998e-05 2024-04-26T12:05:46.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:46.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:46.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5450000000000002e-06 2024-04-26T12:05:46.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790390+0000", 2024-04-26T12:05:46.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098850759999999996 2024-04-26T12:05:46.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:46.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790447+0000", 2024-04-26T12:05:46.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6752999999999997e-05 2024-04-26T12:05:46.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:46.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790547+0000", 2024-04-26T12:05:46.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100344 2024-04-26T12:05:46.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793864+0000", 2024-04-26T12:05:46.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033169749999999998 2024-04-26T12:05:46.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:46.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798164+0000", 2024-04-26T12:05:46.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043000690000000001 2024-04-26T12:05:46.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:46.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798204+0000", 2024-04-26T12:05:46.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9478999999999999e-05 2024-04-26T12:05:46.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:46.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798236+0000", 2024-04-26T12:05:46.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2478999999999999e-05 2024-04-26T12:05:46.421 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.421 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:46.421 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.421 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:46.422 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:46.422 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.614434738, 2024-04-26T12:05:46.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016989500000000001, 2024-04-26T12:05:46.422 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:46.422 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.422 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:46.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:46.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:46.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:46.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:46.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:46.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780483+0000", 2024-04-26T12:05:46.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:46.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780488+0000", 2024-04-26T12:05:46.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6260000000000003e-06 2024-04-26T12:05:46.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:46.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780499+0000", 2024-04-26T12:05:46.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1236000000000001e-05 2024-04-26T12:05:46.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:46.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4569999999999996e-06 2024-04-26T12:05:46.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780529+0000", 2024-04-26T12:05:46.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4579e-05 2024-04-26T12:05:46.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:46.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780532+0000", 2024-04-26T12:05:46.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.74e-06 2024-04-26T12:05:46.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788868+0000", 2024-04-26T12:05:46.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0083357650000000002 2024-04-26T12:05:46.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:46.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789142+0000", 2024-04-26T12:05:46.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027472 2024-04-26T12:05:46.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:46.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789241+0000", 2024-04-26T12:05:46.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8394999999999996e-05 2024-04-26T12:05:46.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792096+0000", 2024-04-26T12:05:46.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002855677 2024-04-26T12:05:46.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:46.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797379+0000", 2024-04-26T12:05:46.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052822379999999999 2024-04-26T12:05:46.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:46.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797433+0000", 2024-04-26T12:05:46.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4109e-05 2024-04-26T12:05:46.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:46.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797473+0000", 2024-04-26T12:05:46.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0533e-05 2024-04-26T12:05:46.427 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.427 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:46.427 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.428 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:46.428 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:46.428 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.614395123999998, 2024-04-26T12:05:46.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017295965, 2024-04-26T12:05:46.428 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:46.428 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.428 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:46.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:46.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:46.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:46.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:46.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:46.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780513+0000", 2024-04-26T12:05:46.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999895 2024-04-26T12:05:46.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:46.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780528+0000", 2024-04-26T12:05:46.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5089000000000001e-05 2024-04-26T12:05:46.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:46.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780537+0000", 2024-04-26T12:05:46.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8400000000000001e-06 2024-04-26T12:05:46.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780544+0000", 2024-04-26T12:05:46.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.917e-06 2024-04-26T12:05:46.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780571+0000", 2024-04-26T12:05:46.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7032000000000001e-05 2024-04-26T12:05:46.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:46.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780574+0000", 2024-04-26T12:05:46.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:05:46.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789436+0000", 2024-04-26T12:05:46.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088622240000000001 2024-04-26T12:05:46.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:46.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789525+0000", 2024-04-26T12:05:46.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8549999999999998e-05 2024-04-26T12:05:46.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:46.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789642+0000", 2024-04-26T12:05:46.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011772100000000001 2024-04-26T12:05:46.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792129+0000", 2024-04-26T12:05:46.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024871709999999998 2024-04-26T12:05:46.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:46.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797732+0000", 2024-04-26T12:05:46.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056027580000000002 2024-04-26T12:05:46.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:46.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797777+0000", 2024-04-26T12:05:46.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4620999999999999e-05 2024-04-26T12:05:46.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:46.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797819+0000", 2024-04-26T12:05:46.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2536000000000001e-05 2024-04-26T12:05:46.433 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.433 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:46.433 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.433 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:46.434 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:46.434 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.614366173999997, 2024-04-26T12:05:46.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017840163999999999, 2024-04-26T12:05:46.434 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:46.434 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.434 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:46.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:46.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:46.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:46.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:46.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:46.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:46.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:46.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:46.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5419999999999999e-06 2024-04-26T12:05:46.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:46.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780563+0000", 2024-04-26T12:05:46.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:05:46.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780569+0000", 2024-04-26T12:05:46.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1479999999999997e-06 2024-04-26T12:05:46.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780594+0000", 2024-04-26T12:05:46.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5585e-05 2024-04-26T12:05:46.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:46.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780596+0000", 2024-04-26T12:05:46.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2630000000000002e-06 2024-04-26T12:05:46.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789932+0000", 2024-04-26T12:05:46.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093360479999999996 2024-04-26T12:05:46.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:46.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790070+0000", 2024-04-26T12:05:46.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013771399999999999 2024-04-26T12:05:46.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:46.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790219+0000", 2024-04-26T12:05:46.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014872299999999999 2024-04-26T12:05:46.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793632+0000", 2024-04-26T12:05:46.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003413368 2024-04-26T12:05:46.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:46.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798244+0000", 2024-04-26T12:05:46.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046113819999999998 2024-04-26T12:05:46.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:46.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798361+0000", 2024-04-26T12:05:46.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117726 2024-04-26T12:05:46.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:46.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798393+0000", 2024-04-26T12:05:46.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1099999999999997e-05 2024-04-26T12:05:46.439 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.439 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:46.439 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.439 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:46.440 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:46.440 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.614341248999999, 2024-04-26T12:05:46.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016645943, 2024-04-26T12:05:46.440 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:46.440 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:46.440 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:46.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:46.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:46.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:46.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:46.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:46.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:46.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:46.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780580+0000", 2024-04-26T12:05:46.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1549999999999999e-06 2024-04-26T12:05:46.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:46.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780588+0000", 2024-04-26T12:05:46.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:05:46.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780593+0000", 2024-04-26T12:05:46.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2399999999999998e-06 2024-04-26T12:05:46.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780628+0000", 2024-04-26T12:05:46.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5426000000000003e-05 2024-04-26T12:05:46.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:46.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780632+0000", 2024-04-26T12:05:46.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:05:46.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788288+0000", 2024-04-26T12:05:46.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076555879999999996 2024-04-26T12:05:46.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:46.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788570+0000", 2024-04-26T12:05:46.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028233700000000002 2024-04-26T12:05:46.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:46.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797223+0000", 2024-04-26T12:05:46.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086529150000000006 2024-04-26T12:05:46.444 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.444 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:46.444 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.444 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:46.444 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:46.444 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.614317280000002, 2024-04-26T12:05:46.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016536068000000001, 2024-04-26T12:05:46.444 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:46.444 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:46.444 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:46.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:46.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:46.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:46.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:46.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:46.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:46.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:46.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780609+0000", 2024-04-26T12:05:46.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8280000000000003e-06 2024-04-26T12:05:46.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:46.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780616+0000", 2024-04-26T12:05:46.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4939999999999997e-06 2024-04-26T12:05:46.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780621+0000", 2024-04-26T12:05:46.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6040000000000003e-06 2024-04-26T12:05:46.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780647+0000", 2024-04-26T12:05:46.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6441999999999999e-05 2024-04-26T12:05:46.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:46.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780650+0000", 2024-04-26T12:05:46.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4430000000000002e-06 2024-04-26T12:05:46.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788163+0000", 2024-04-26T12:05:46.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007513774 2024-04-26T12:05:46.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:46.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788307+0000", 2024-04-26T12:05:46.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014374400000000001 2024-04-26T12:05:46.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:46.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797137+0000", 2024-04-26T12:05:46.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088302160000000001 2024-04-26T12:05:46.448 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.448 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:46.448 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.448 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:46.448 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:46.449 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.611441008, 2024-04-26T12:05:46.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012911448000000001, 2024-04-26T12:05:46.449 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:46.449 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.449 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:46.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:46.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:46.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:46.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:46.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:46.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783477+0000", 2024-04-26T12:05:46.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:46.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783482+0000", 2024-04-26T12:05:46.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5709999999999999e-06 2024-04-26T12:05:46.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:46.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783491+0000", 2024-04-26T12:05:46.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3610000000000007e-06 2024-04-26T12:05:46.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783498+0000", 2024-04-26T12:05:46.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4209999999999998e-06 2024-04-26T12:05:46.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786045+0000", 2024-04-26T12:05:46.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0025465739999999998 2024-04-26T12:05:46.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:46.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786061+0000", 2024-04-26T12:05:46.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6348999999999999e-05 2024-04-26T12:05:46.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:46.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796342+0000", 2024-04-26T12:05:46.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010280643000000001 2024-04-26T12:05:46.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:46.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796389+0000", 2024-04-26T12:05:46.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6912000000000001e-05 2024-04-26T12:05:46.452 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.452 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:46.452 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.453 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:46.453 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:46.453 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.611412702000003, 2024-04-26T12:05:46.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013376469, 2024-04-26T12:05:46.453 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:46.453 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.453 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:46.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:46.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:46.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:46.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:46.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:46.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:46.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:46.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783516+0000", 2024-04-26T12:05:46.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.041e-05 2024-04-26T12:05:46.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:46.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783523+0000", 2024-04-26T12:05:46.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5749999999999997e-06 2024-04-26T12:05:46.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783528+0000", 2024-04-26T12:05:46.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5029999999999997e-06 2024-04-26T12:05:46.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787662+0000", 2024-04-26T12:05:46.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041336230000000003 2024-04-26T12:05:46.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:46.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787687+0000", 2024-04-26T12:05:46.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5769999999999999e-05 2024-04-26T12:05:46.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:46.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796817+0000", 2024-04-26T12:05:46.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091296750000000003 2024-04-26T12:05:46.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:46.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796882+0000", 2024-04-26T12:05:46.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5180999999999998e-05 2024-04-26T12:05:46.457 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.457 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:46.457 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.457 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:46.457 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:46.457 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.611344160999998, 2024-04-26T12:05:46.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013457291999999999, 2024-04-26T12:05:46.457 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:46.457 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.457 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:46.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:46.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:46.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:46.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:46.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:46.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:46.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:46.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783578+0000", 2024-04-26T12:05:46.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.659e-06 2024-04-26T12:05:46.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:46.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783584+0000", 2024-04-26T12:05:46.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:46.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783588+0000", 2024-04-26T12:05:46.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6190000000000002e-06 2024-04-26T12:05:46.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787834+0000", 2024-04-26T12:05:46.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042460529999999996 2024-04-26T12:05:46.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:46.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787854+0000", 2024-04-26T12:05:46.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9658999999999999e-05 2024-04-26T12:05:46.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:46.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:46.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009107604 2024-04-26T12:05:46.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:46.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797032+0000", 2024-04-26T12:05:46.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9987000000000006e-05 2024-04-26T12:05:46.461 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.461 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:46.461 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.461 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:46.461 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:46.461 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.609497781999998, 2024-04-26T12:05:46.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011003015999999999, 2024-04-26T12:05:46.461 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:46.461 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.461 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:46.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:46.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:46.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:46.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:46.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:46.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785420+0000", 2024-04-26T12:05:46.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:46.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785427+0000", 2024-04-26T12:05:46.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:05:46.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:46.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785438+0000", 2024-04-26T12:05:46.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069e-05 2024-04-26T12:05:46.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785457+0000", 2024-04-26T12:05:46.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8617000000000001e-05 2024-04-26T12:05:46.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786628+0000", 2024-04-26T12:05:46.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001171418 2024-04-26T12:05:46.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:46.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786651+0000", 2024-04-26T12:05:46.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3289e-05 2024-04-26T12:05:46.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:46.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796393+0000", 2024-04-26T12:05:46.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097413269999999993 2024-04-26T12:05:46.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:46.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796424+0000", 2024-04-26T12:05:46.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1188e-05 2024-04-26T12:05:46.465 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.465 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:46.465 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.465 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:46.465 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:46.465 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.608951036000001, 2024-04-26T12:05:46.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010561432000000001, 2024-04-26T12:05:46.466 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:46.466 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.466 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:46.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:46.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:46.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:46.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:46.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:46.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:46.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:46.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785973+0000", 2024-04-26T12:05:46.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4910000000000002e-06 2024-04-26T12:05:46.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:46.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785991+0000", 2024-04-26T12:05:46.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7663e-05 2024-04-26T12:05:46.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785998+0000", 2024-04-26T12:05:46.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1239999999999999e-06 2024-04-26T12:05:46.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786792+0000", 2024-04-26T12:05:46.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079334800000000003 2024-04-26T12:05:46.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:46.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786810+0000", 2024-04-26T12:05:46.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8746999999999999e-05 2024-04-26T12:05:46.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:46.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796500+0000", 2024-04-26T12:05:46.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096897619999999993 2024-04-26T12:05:46.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:46.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796529+0000", 2024-04-26T12:05:46.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8873999999999998e-05 2024-04-26T12:05:46.469 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.469 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:46.469 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.469 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:46.470 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:46.470 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.608871950000001, 2024-04-26T12:05:46.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010219911, 2024-04-26T12:05:46.470 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:46.470 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.470 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:46.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:46.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:46.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:46.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:46.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:46.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786046+0000", 2024-04-26T12:05:46.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:46.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786053+0000", 2024-04-26T12:05:46.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0360000000000001e-06 2024-04-26T12:05:46.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:46.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786064+0000", 2024-04-26T12:05:46.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1202999999999999e-05 2024-04-26T12:05:46.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786091+0000", 2024-04-26T12:05:46.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6859000000000002e-05 2024-04-26T12:05:46.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786212+0000", 2024-04-26T12:05:46.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120975 2024-04-26T12:05:46.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:46.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786236+0000", 2024-04-26T12:05:46.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4358999999999998e-05 2024-04-26T12:05:46.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:46.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796236+0000", 2024-04-26T12:05:46.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099998050000000005 2024-04-26T12:05:46.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:46.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796266+0000", 2024-04-26T12:05:46.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0278e-05 2024-04-26T12:05:46.473 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.474 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:46.474 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.474 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:3 3.14 e17/15 3:287034c4:::1.00000000.inode:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:46.474 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:46.474 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.608082989000003, 2024-04-26T12:05:46.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009764712, 2024-04-26T12:05:46.474 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:46.474 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.474 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:46.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:46.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:46.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:46.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:46.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:46.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786835+0000", 2024-04-26T12:05:46.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T12:05:46.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:46.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786844+0000", 2024-04-26T12:05:46.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6500000000000008e-06 2024-04-26T12:05:46.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:46.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786855+0000", 2024-04-26T12:05:46.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0932e-05 2024-04-26T12:05:46.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786864+0000", 2024-04-26T12:05:46.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2150000000000007e-06 2024-04-26T12:05:46.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787242+0000", 2024-04-26T12:05:46.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037708300000000001 2024-04-26T12:05:46.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:46.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787259+0000", 2024-04-26T12:05:46.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7258999999999999e-05 2024-04-26T12:05:46.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:46.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796579+0000", 2024-04-26T12:05:46.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093201099999999995 2024-04-26T12:05:46.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:46.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796600+0000", 2024-04-26T12:05:46.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1330000000000001e-05 2024-04-26T12:05:46.478 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.478 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:46.478 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.478 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:46.478 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:46.478 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.608038966999999, 2024-04-26T12:05:46.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096431940000000008, 2024-04-26T12:05:46.478 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:46.478 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.479 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:46.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:46.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:46.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:46.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:46.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:46.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786879+0000", 2024-04-26T12:05:46.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:46.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786887+0000", 2024-04-26T12:05:46.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9300000000000003e-06 2024-04-26T12:05:46.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:46.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786894+0000", 2024-04-26T12:05:46.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:05:46.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786899+0000", 2024-04-26T12:05:46.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8400000000000002e-06 2024-04-26T12:05:46.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786932+0000", 2024-04-26T12:05:46.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3031999999999998e-05 2024-04-26T12:05:46.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:46.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786945+0000", 2024-04-26T12:05:46.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3421000000000001e-05 2024-04-26T12:05:46.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:46.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796469+0000", 2024-04-26T12:05:46.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095236130000000002 2024-04-26T12:05:46.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:46.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796523+0000", 2024-04-26T12:05:46.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4089999999999999e-05 2024-04-26T12:05:46.482 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.482 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:46.482 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.483 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "pg_update_log_missing(3.14 epoch 17/15 rep_tid 169 entries 17'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:05:46.483 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:46.483 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.607975811999999, 2024-04-26T12:05:46.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097257639999999996, 2024-04-26T12:05:46.483 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:46.483 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-04-26T12:05:46.483 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:46.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:46.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:46.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:46.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:46.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:46.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786942+0000", 2024-04-26T12:05:46.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:46.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786951+0000", 2024-04-26T12:05:46.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:05:46.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:46.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786965+0000", 2024-04-26T12:05:46.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4268e-05 2024-04-26T12:05:46.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786977+0000", 2024-04-26T12:05:46.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1667e-05 2024-04-26T12:05:46.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787667+0000", 2024-04-26T12:05:46.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00069057400000000001 2024-04-26T12:05:46.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:46.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796668+0000", 2024-04-26T12:05:46.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090013309999999996 2024-04-26T12:05:46.486 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.486 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:46.486 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.486 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:46.486 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:46.486 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.607922668999997, 2024-04-26T12:05:46.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095908309999999993, 2024-04-26T12:05:46.487 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:46.487 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.487 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:46.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:46.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:46.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:46.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:46.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:46.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786995+0000", 2024-04-26T12:05:46.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:46.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787001+0000", 2024-04-26T12:05:46.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5099999999999998e-06 2024-04-26T12:05:46.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:46.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787009+0000", 2024-04-26T12:05:46.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9100000000000005e-06 2024-04-26T12:05:46.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787019+0000", 2024-04-26T12:05:46.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8109999999999997e-06 2024-04-26T12:05:46.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787136+0000", 2024-04-26T12:05:46.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011749899999999999 2024-04-26T12:05:46.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:46.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787154+0000", 2024-04-26T12:05:46.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8278999999999999e-05 2024-04-26T12:05:46.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:46.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796561+0000", 2024-04-26T12:05:46.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094064379999999996 2024-04-26T12:05:46.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:46.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796587+0000", 2024-04-26T12:05:46.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5856000000000001e-05 2024-04-26T12:05:46.490 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.490 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:46.490 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.490 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:46.490 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:46.491 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.607205612000001, 2024-04-26T12:05:46.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096460160000000003, 2024-04-26T12:05:46.491 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:46.491 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.491 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:46.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:46.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:46.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:46.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:46.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:46.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:46.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787712+0000", 2024-04-26T12:05:46.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:46.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787718+0000", 2024-04-26T12:05:46.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:05:46.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:46.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787727+0000", 2024-04-26T12:05:46.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.123e-06 2024-04-26T12:05:46.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787734+0000", 2024-04-26T12:05:46.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.391e-06 2024-04-26T12:05:46.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:46.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788867+0000", 2024-04-26T12:05:46.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001133207 2024-04-26T12:05:46.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:46.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788899+0000", 2024-04-26T12:05:46.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1526000000000003e-05 2024-04-26T12:05:46.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:46.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797328+0000", 2024-04-26T12:05:46.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084295389999999998 2024-04-26T12:05:46.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:46.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:46.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:46.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797359+0000", 2024-04-26T12:05:46.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0660999999999997e-05 2024-04-26T12:05:46.494 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.494 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:46.494 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.495 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:46.495 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:46.495 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:46.496 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:46.497 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:46.495+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:46.597 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:46.596+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:46.605 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:46.605 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:05:46.605 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:05:46.605 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:46.614 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:46.698 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:46.697+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:46.715 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:46.715 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:05:46.715 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:05:46.716 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:05:46.716 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:46.725 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:46.768 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:05:46.799 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:46.798+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:46.829 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:46.829 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:05:46.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:05:46.829 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:05:46.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.829 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:46.829 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:46.829 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 52.971787724000002, 2024-04-26T12:05:46.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:05:46.829 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:46.829 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.829 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:46.830 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:46.830 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:46.830 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:05:46.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.830 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:46.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:46.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:46.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:46.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:46.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:46.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:46.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:46.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:05:46.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:05:46.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:46.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:05:46.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:05:46.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:05:46.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:05:46.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:46.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:05:46.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:05:46.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:46.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:05:46.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:05:46.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:46.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:05:46.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:05:46.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:46.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:05:46.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:05:46.834 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.834 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.834 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:05:46.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:05:46.834 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.834 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:46.834 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:05:46.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:05:46.834 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.834 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:46.835 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:05:46.835 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:05:46.835 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.835 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:46.835 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.835 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.835 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.835 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:46.835 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:46.835 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 52.971681828000001, 2024-04-26T12:05:46.835 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:05:46.835 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:46.835 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.835 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:46.836 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:46.836 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:46.836 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:05:46.836 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.836 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:46.836 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.836 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:46.836 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:46.836 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.836 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.836 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.836 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:46.836 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:46.836 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:46.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:46.837 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:46.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:05:46.837 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:05:46.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:46.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:05:46.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:05:46.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.838 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.838 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:05:46.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:05:46.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.838 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.838 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:46.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:05:46.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:05:46.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.839 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:46.839 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:05:46.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:05:46.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.839 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:46.839 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:05:46.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:05:46.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.839 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:46.839 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:05:46.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:05:46.840 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.840 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:05:46.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:05:46.840 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:46.840 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:05:46.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:05:46.840 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:46.841 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:05:46.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:05:46.841 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.841 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:46.841 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.841 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:46.841 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:46.841 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 52.971666847999998, 2024-04-26T12:05:46.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:05:46.841 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:46.841 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.841 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:46.842 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:46.842 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:46.842 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:05:46.842 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.842 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:46.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.842 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:46.842 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:46.842 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.842 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:46.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:46.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.843 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:46.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:46.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.843 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:46.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:05:46.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:05:46.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:46.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:05:46.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:05:46.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:05:46.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:05:46.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:46.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:05:46.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:05:46.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:46.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:05:46.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:05:46.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:46.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:05:46.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:05:46.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:46.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:05:46.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:05:46.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:05:46.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:05:46.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:46.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:05:46.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:05:46.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:46.847 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:05:46.847 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:05:46.847 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.847 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:46.847 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.847 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.847 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.847 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:46.847 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:46.847 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 52.971622973000002, 2024-04-26T12:05:46.847 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:05:46.847 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:46.847 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.847 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:46.848 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:46.848 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:46.848 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:05:46.848 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.848 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:46.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.848 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:46.848 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:46.848 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.848 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:05:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:05:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.850 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:46.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:05:46.850 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:05:46.850 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.850 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:05:46.850 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:05:46.850 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.850 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:46.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:05:46.850 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:05:46.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.851 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.851 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:46.851 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:05:46.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:05:46.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.851 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.851 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:46.851 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:05:46.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:05:46.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.851 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.851 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:46.851 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:05:46.852 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:05:46.852 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.852 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.852 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:05:46.852 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:05:46.852 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.852 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:46.852 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:05:46.852 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:05:46.852 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.852 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:46.853 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:05:46.853 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:05:46.853 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.853 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:46.853 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.853 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.853 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:46.853 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:46.853 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 52.971537308999999, 2024-04-26T12:05:46.853 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:05:46.853 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:46.853 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.853 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:46.853 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:46.854 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:46.854 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:05:46.854 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.854 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:46.854 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.854 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:46.854 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:46.854 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.854 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.854 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.854 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:46.854 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:46.854 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:46.855 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:46.855 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:46.855 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:05:46.855 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:05:46.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:46.856 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:05:46.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:05:46.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.856 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.856 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.856 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:05:46.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:05:46.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.856 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.856 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:46.856 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:05:46.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:05:46.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.857 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:46.857 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:05:46.857 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:05:46.857 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.857 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:46.857 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:05:46.857 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:05:46.857 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.857 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:46.857 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:05:46.857 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:05:46.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:05:46.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:05:46.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:46.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:05:46.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:05:46.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:46.859 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:05:46.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:05:46.859 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.859 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:46.859 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.859 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.859 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:46.859 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:46.859 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.045633023000001, 2024-04-26T12:05:46.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:05:46.859 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:46.859 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.860 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:46.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.860 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:46.860 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:46.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.860 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.860 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:46.860 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:46.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.860 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.860 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:46.860 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:46.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:46.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:46.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:05:46.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:05:46.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:46.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:05:46.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:05:46.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:05:46.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:05:46.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.862 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:46.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:05:46.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:05:46.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.862 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:46.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:05:46.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:05:46.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:46.863 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:05:46.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:05:46.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:46.863 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:05:46.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:05:46.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.863 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:05:46.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:05:46.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:46.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:05:46.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:05:46.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:46.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:05:46.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:05:46.864 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.864 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:46.864 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.864 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:46.865 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:46.865 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.045596928000002, 2024-04-26T12:05:46.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:05:46.865 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:46.865 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.865 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:46.865 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.865 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:46.865 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:46.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.865 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.865 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.865 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:46.866 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:46.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.866 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:46.866 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:05:46.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:46.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.866 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:46.866 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:05:46.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:05:46.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:46.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:05:46.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:05:46.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:05:46.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:05:46.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:46.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:05:46.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:05:46.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:46.868 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:05:46.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:05:46.868 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.868 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:46.868 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:05:46.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:05:46.868 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.868 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:46.868 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:05:46.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:05:46.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:05:46.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:05:46.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:46.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:05:46.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:05:46.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:46.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:05:46.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:05:46.870 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.870 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:46.870 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.870 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.870 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.870 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:46.870 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:46.870 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.045559244000003, 2024-04-26T12:05:46.870 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:05:46.870 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:46.870 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.870 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:46.870 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.870 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:46.871 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:46.871 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.871 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.871 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.871 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:46.871 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:46.871 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.871 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.871 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.871 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:46.871 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:05:46.871 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.871 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.871 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.871 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:46.872 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:05:46.872 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:05:46.872 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.872 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.872 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:46.872 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:05:46.872 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:05:46.872 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.872 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.872 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.872 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:05:46.872 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:05:46.872 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.872 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.872 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:46.873 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:05:46.873 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:05:46.873 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.873 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.873 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:46.873 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:46.873 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:05:46.873 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.873 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.873 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:46.873 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:05:46.873 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:05:46.873 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.873 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.873 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:46.874 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:05:46.874 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:05:46.874 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.874 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.874 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.874 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:05:46.874 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:05:46.874 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.874 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.874 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:46.875 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:05:46.875 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:05:46.875 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.875 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.875 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:46.875 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:05:46.875 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:05:46.875 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.875 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:46.875 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.875 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.875 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.875 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:46.875 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:46.875 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.045537904, 2024-04-26T12:05:46.876 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:05:46.876 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:46.876 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.876 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:46.876 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.876 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:46.876 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:46.876 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.876 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.876 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:46.876 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:46.876 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.876 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.877 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:46.877 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:46.877 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.877 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.877 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:46.877 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:05:46.877 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:46.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.877 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.877 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:46.877 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:05:46.877 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:05:46.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.877 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.878 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.878 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:05:46.878 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:05:46.878 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.878 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.878 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:46.878 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:05:46.878 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:05:46.878 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.878 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.878 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:46.878 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:05:46.878 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:05:46.878 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.878 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.879 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:46.879 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:05:46.879 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:05:46.879 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.879 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.879 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:46.879 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:05:46.879 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:05:46.879 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.879 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.879 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.879 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:05:46.879 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:05:46.879 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.879 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.880 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:46.880 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:05:46.880 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:05:46.880 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.880 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.880 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:46.880 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:05:46.880 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:05:46.880 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.880 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:46.880 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.880 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.880 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.880 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:46.881 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:46.881 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.045515637999998, 2024-04-26T12:05:46.881 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:05:46.881 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:46.881 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.881 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:46.881 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.881 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:46.881 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:46.881 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.881 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.881 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.881 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:46.881 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:46.881 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.882 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.882 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.882 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:46.882 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:46.882 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.882 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.882 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.882 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:46.882 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:05:46.882 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:46.882 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.882 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.882 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:46.882 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:05:46.882 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:05:46.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.883 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.883 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.883 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:05:46.883 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:05:46.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.883 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.883 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:46.883 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:05:46.883 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:05:46.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.883 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.883 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:46.883 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:05:46.883 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:05:46.884 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.884 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.884 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:46.884 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:05:46.884 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:05:46.884 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.884 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.884 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:46.884 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:05:46.884 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:05:46.884 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.884 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.884 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.884 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:05:46.885 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:05:46.885 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.885 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.885 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:46.885 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:05:46.885 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:05:46.885 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.885 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.885 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:46.885 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:05:46.885 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:05:46.885 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.885 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:46.885 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.885 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.886 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.886 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:46.886 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:46.886 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.045494015999999, 2024-04-26T12:05:46.886 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:05:46.886 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:46.886 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.886 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:46.886 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.886 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:46.886 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:46.886 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.886 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.886 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.886 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:46.887 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:46.887 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.887 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.887 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.887 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:46.887 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:46.887 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.887 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.887 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.887 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:46.887 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:05:46.887 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:05:46.887 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.887 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.888 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:46.888 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:05:46.888 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:05:46.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.888 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.888 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:05:46.888 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:05:46.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.888 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:46.888 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:05:46.888 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:05:46.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.889 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:46.889 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:05:46.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:05:46.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.889 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:46.889 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:05:46.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:05:46.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.889 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:46.889 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:05:46.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:05:46.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.890 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.890 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:05:46.890 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:05:46.890 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.890 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.890 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:46.890 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:05:46.890 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:05:46.890 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.890 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.890 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:46.890 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:05:46.890 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:05:46.891 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.891 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:46.891 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.891 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.891 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.891 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:46.891 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:46.891 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.045467449999997, 2024-04-26T12:05:46.891 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:05:46.891 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:46.891 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.891 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:46.891 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.891 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:46.892 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:46.892 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.892 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.892 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.892 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:46.892 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:46.892 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.892 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.892 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.892 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:46.893 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:05:46.893 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.893 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.893 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.893 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:46.893 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:05:46.893 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:05:46.893 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.893 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.893 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:46.893 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:05:46.893 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:05:46.893 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.893 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.894 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.894 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:05:46.894 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:05:46.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.894 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.894 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:46.894 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:05:46.894 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:05:46.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.894 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.894 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:46.894 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:05:46.894 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:05:46.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.895 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.895 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:46.895 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:05:46.895 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:05:46.895 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.895 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.895 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:46.895 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:05:46.895 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:05:46.895 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.895 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.895 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.895 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:05:46.895 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:05:46.895 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.896 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.896 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:46.896 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:05:46.896 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:05:46.896 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.896 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.896 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:46.896 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:05:46.896 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:05:46.896 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.896 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:46.896 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.896 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.896 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.896 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:46.897 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:46.897 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.045428938000001, 2024-04-26T12:05:46.897 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:05:46.897 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:46.897 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.897 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:46.897 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.897 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:46.897 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:46.897 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.897 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.897 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.897 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:46.897 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:46.898 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.898 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:46.898 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:46.898 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.898 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:46.898 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:05:46.898 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:05:46.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.898 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:46.899 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:05:46.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:05:46.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.899 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.899 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.899 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:05:46.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:05:46.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.899 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.899 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:46.899 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:05:46.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:05:46.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.899 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.899 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:46.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:05:46.900 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:05:46.900 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.900 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.900 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:46.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:05:46.900 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:05:46.900 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.900 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.900 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:46.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:05:46.900 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:05:46.900 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.900 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.901 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:05:46.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:05:46.901 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.901 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.901 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:46.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:05:46.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:05:46.901 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.901 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.901 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:46.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:05:46.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:05:46.901 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.902 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:46.902 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.902 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.902 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.902 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:46.902 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:46.902 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.045400764999997, 2024-04-26T12:05:46.902 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:05:46.902 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:46.902 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.902 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:46.902 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.902 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:46.902 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:46.903 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.903 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:46.903 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:46.903 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.903 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:46.903 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:46.903 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.903 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:46.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:05:46.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:05:46.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.904 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.904 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:46.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:05:46.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:05:46.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.904 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.904 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:05:46.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:05:46.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.904 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.904 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:46.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:05:46.905 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:05:46.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.905 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.905 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:46.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:05:46.905 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:05:46.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.905 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.905 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:46.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:05:46.905 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:05:46.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.905 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.905 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:46.906 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:05:46.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:05:46.906 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.906 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.906 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:05:46.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:05:46.906 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.906 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:46.906 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:05:46.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:05:46.906 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.906 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:46.907 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:05:46.907 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:05:46.907 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.907 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:46.907 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.907 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.907 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.907 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:46.907 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:46.907 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.045366201, 2024-04-26T12:05:46.907 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:05:46.907 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:46.907 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.907 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:46.908 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.908 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:46.908 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:46.908 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.908 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.908 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.908 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:46.908 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:46.908 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.908 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.908 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.908 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:46.908 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:05:46.908 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.909 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:46.909 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:05:46.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:05:46.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.909 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:46.909 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:05:46.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:05:46.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.909 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.909 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:05:46.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:05:46.910 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.910 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.910 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:46.910 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:05:46.910 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:05:46.910 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.910 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.910 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:46.910 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:05:46.910 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:05:46.910 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.910 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.911 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:46.911 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:05:46.911 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:05:46.911 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.911 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.911 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:46.911 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:05:46.911 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:05:46.911 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.911 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.911 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.911 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:05:46.911 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:05:46.911 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.911 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.912 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:46.912 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:46.912 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:05:46.912 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.912 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.912 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:46.912 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:05:46.912 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:05:46.912 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.912 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:46.912 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.912 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.912 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.912 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:46.913 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:46.913 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.044491420999996, 2024-04-26T12:05:46.913 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:05:46.913 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:46.913 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.913 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:46.913 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.913 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:46.913 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:46.913 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.913 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.913 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.913 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:46.913 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:46.913 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.914 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.914 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.914 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:46.914 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:05:46.914 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:46.914 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.914 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.914 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:46.914 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:05:46.914 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:05:46.914 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.914 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.914 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:46.914 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:05:46.915 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:05:46.915 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.915 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.915 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.915 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:05:46.915 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:05:46.915 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.915 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.915 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:46.915 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:05:46.915 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:05:46.915 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.915 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.915 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:46.916 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:05:46.916 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:05:46.916 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.916 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.916 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:46.916 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:05:46.916 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:05:46.916 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.916 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.916 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:46.916 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:05:46.916 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:05:46.916 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.916 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.916 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.917 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:05:46.917 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:05:46.917 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.917 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.917 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:46.917 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:05:46.917 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:05:46.917 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.917 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.917 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:46.917 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:05:46.917 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:05:46.917 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.917 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:46.918 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.918 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.918 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.918 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:46.918 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:46.918 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.044452462000002, 2024-04-26T12:05:46.918 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:05:46.918 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:46.918 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.918 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:46.918 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.918 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:46.918 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:46.918 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.919 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.919 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.919 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:46.919 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:46.919 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.919 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.919 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.919 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:46.919 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:05:46.919 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.919 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.919 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.919 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:46.919 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:05:46.919 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:05:46.920 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.920 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.920 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:46.920 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:05:46.920 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:05:46.920 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.920 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.920 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.920 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:05:46.920 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:05:46.920 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.920 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.920 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:46.920 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:05:46.920 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:05:46.921 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.921 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.921 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:46.921 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:05:46.921 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:05:46.921 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.921 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.921 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:46.921 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:05:46.921 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:05:46.921 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.921 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.921 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:46.921 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:05:46.921 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:05:46.922 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.922 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.922 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.922 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:05:46.922 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:05:46.922 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.922 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.922 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:46.922 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:05:46.922 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:05:46.922 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.922 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.922 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:46.922 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:05:46.923 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:05:46.923 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.923 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:46.923 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.923 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.923 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.923 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:46.923 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:46.923 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.044416990000002, 2024-04-26T12:05:46.923 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:05:46.923 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:46.923 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.924 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:46.924 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.924 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:46.924 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:46.924 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.924 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.924 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.924 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:46.924 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:46.924 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.924 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.924 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.924 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:46.924 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:46.925 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:46.925 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.925 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.925 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:46.925 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:05:46.925 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:05:46.925 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.925 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.925 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:46.925 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:05:46.925 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:05:46.925 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.925 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.925 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.926 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:05:46.926 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:05:46.926 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.926 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.926 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:46.926 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:05:46.926 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:05:46.926 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.926 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.926 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:46.926 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:05:46.926 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:05:46.926 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.926 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.927 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:46.927 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:05:46.927 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:05:46.927 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.927 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.927 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:46.927 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:05:46.927 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:05:46.927 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.927 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.927 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.927 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:05:46.927 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:05:46.927 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.928 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.928 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:46.928 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:05:46.928 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:05:46.928 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.928 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.928 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:46.928 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:05:46.928 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:05:46.928 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.928 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:46.928 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.928 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.928 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.928 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:46.929 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:46.929 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.044338301000003, 2024-04-26T12:05:46.929 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:05:46.929 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:46.929 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:46.929 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:46.929 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.929 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:46.929 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:46.929 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.929 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.929 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.929 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:46.929 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:46.930 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.930 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.930 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.930 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:46.930 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:05:46.930 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:46.930 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.930 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.930 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:46.930 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:05:46.930 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:05:46.930 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.930 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.930 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:46.931 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:05:46.931 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:05:46.931 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.931 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.931 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.931 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:05:46.931 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:05:46.931 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.931 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.931 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:46.931 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:05:46.931 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:05:46.931 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.931 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.931 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:46.932 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:05:46.932 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:05:46.932 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.932 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.932 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:46.932 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:05:46.932 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:05:46.932 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.932 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.932 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:46.932 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:05:46.932 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:05:46.932 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.932 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.933 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:46.933 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:05:46.933 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:05:46.933 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.933 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.933 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:46.933 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:05:46.933 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:05:46.933 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.933 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.933 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:46.933 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:05:46.933 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:05:46.933 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.934 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:46.934 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.934 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.934 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.934 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:46.934 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:46.934 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.044187452999999, 2024-04-26T12:05:46.934 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:05:46.934 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:46.934 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:05:46.934 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:46.934 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.934 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:46.934 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:46.935 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.935 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.935 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.935 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:46.935 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:46.935 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:46.935 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.935 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.935 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:46.935 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:05:46.935 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:46.935 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.935 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.935 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:46.936 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:05:46.936 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:05:46.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.936 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.936 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:46.936 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:05:46.936 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:05:46.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.936 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.936 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:46.936 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:05:46.936 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:05:46.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.936 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.937 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:46.937 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:05:46.937 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:05:46.937 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.937 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.937 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:46.937 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:46.937 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:05:46.937 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:46.937 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:46.937 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:46.937 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:05:46.937 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:05:46.937 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.938 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:46.938 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.938 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:46.938 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:46.938 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:46.940 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-26T12:05:46.940 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:46.938+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:46.940 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:05:46.941 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:46.941 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:05:46.942 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T12:05:46.942 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:05:46.942 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:05:46.943 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:05:47.039 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:47.038+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:47.049 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:47.049 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:47.058 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:47.141 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:47.140+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:47.159 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:47.160 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:47.168 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:47.242 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:47.241+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:47.311 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:47.311 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:47.321 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:47.342 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:47.341+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:47.426 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:47.426 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:47.435 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:47.479 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:47.478+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:47.536 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:47.536 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:47.545 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:47.546 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:47.544+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:47.645 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:47.644+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:47.688 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:47.688 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:47.697 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:47.747 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:47.746+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:47.806 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:47.806 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:47.815 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:47.848 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:47.847+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:47.916 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:47.917 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:47.925 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:47.969 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:47.968+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:48.027 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:48.027 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:48.037 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:48.078 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:48.077+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:48.141 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:48.141 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:48.151 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:48.152 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:48.150+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:48.254 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:48.251+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:48.293 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:48.293 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:48.301 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:48.353 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:48.352+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:48.402 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:48.402 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:48.410 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:48.456 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:48.455+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:48.516 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:48.516 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:48.525 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:48.556 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:48.555+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:48.657 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:48.656+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:48.668 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:48.668 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:48.676 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:48.760 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:48.759+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:48.818 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:48.818 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:48.827 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:48.871 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:48.870+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:48.934 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:48.934 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:48.941 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:05:48.942 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:48.954 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:05:48.984 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:48.983+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:49.060 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:49.059+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:49.085 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:49.086 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:49.094 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:49.135 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:05:49.135 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:05:49.161 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:49.160+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:49.169 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T12:05:49.169 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:05:49.204 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:05:49.204 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:05:49.239 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:49.240 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:05:49.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:05:49.240 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:05:49.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.240 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:49.240 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:49.240 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 55.382651580000001, 2024-04-26T12:05:49.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:05:49.240 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:49.240 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.240 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:49.240 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:49.241 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:49.241 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:05:49.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.241 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:49.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:49.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:49.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:49.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:49.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.242 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.242 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:49.242 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:49.242 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.242 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.242 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.242 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:49.242 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:05:49.242 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:05:49.242 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.242 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.242 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:49.242 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:05:49.243 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:05:49.243 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.243 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.243 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.243 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:05:49.243 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:05:49.243 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.243 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.243 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:49.243 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:05:49.243 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:05:49.243 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.243 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.243 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:49.244 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:05:49.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:05:49.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.244 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:49.244 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:05:49.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:05:49.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.244 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:49.244 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:05:49.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:05:49.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:05:49.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:05:49.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:49.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:05:49.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:05:49.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:49.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:05:49.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:05:49.245 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.245 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:49.245 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.246 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:49.246 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:49.246 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 55.382545684, 2024-04-26T12:05:49.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:05:49.246 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:49.246 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.246 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:49.246 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:49.246 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:49.246 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:05:49.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.247 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:49.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:49.247 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:49.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.247 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:49.247 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:49.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.247 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:49.247 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:49.248 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.248 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.248 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:49.248 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:05:49.248 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:05:49.248 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.248 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:49.248 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:05:49.248 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:05:49.248 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.248 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.249 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:05:49.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:05:49.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.249 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:49.249 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:05:49.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:05:49.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.249 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:49.249 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:05:49.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:05:49.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:49.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:05:49.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:05:49.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:49.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:05:49.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:05:49.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:05:49.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:05:49.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:49.251 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:05:49.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:05:49.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:49.251 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:05:49.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:05:49.251 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.251 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:49.251 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.252 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:49.252 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:49.252 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 55.382530703999997, 2024-04-26T12:05:49.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:05:49.252 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:49.252 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.252 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:49.252 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:49.252 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:49.252 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:05:49.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.252 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:49.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:49.253 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:49.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.253 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.253 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.253 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:49.253 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:49.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.253 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.253 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.253 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:49.253 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:49.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.253 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.253 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.254 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:49.254 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:05:49.254 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:05:49.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.254 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.254 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:49.254 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:05:49.254 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:05:49.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.254 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.254 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.254 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:05:49.254 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:05:49.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.255 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.255 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:49.255 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:05:49.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:05:49.255 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.255 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.255 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:49.255 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:05:49.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:05:49.255 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.255 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.255 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:49.255 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:05:49.256 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:05:49.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.256 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:49.256 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:05:49.256 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:05:49.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.256 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.256 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:05:49.256 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:05:49.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.256 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:49.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:05:49.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:05:49.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:49.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:05:49.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:05:49.257 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.257 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:49.257 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.257 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:49.257 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:49.257 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 55.382486829000001, 2024-04-26T12:05:49.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:05:49.258 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:49.258 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.258 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:49.258 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:49.258 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:49.258 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:05:49.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.258 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:49.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.258 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:49.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:49.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.259 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:49.259 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:49.259 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.259 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.259 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:49.259 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:49.259 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.259 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.259 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:49.259 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:05:49.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:05:49.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:49.260 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:05:49.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:05:49.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.260 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:05:49.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:05:49.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:49.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:05:49.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:05:49.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.261 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:49.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:05:49.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:05:49.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.261 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:49.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:05:49.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:05:49.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.261 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:49.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:05:49.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:05:49.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:05:49.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:05:49.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:49.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:05:49.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:05:49.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.263 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:49.263 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:05:49.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:05:49.263 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.263 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:49.263 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.263 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:49.263 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:49.263 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 55.382401164999997, 2024-04-26T12:05:49.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:05:49.263 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:49.263 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.264 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:49.264 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:49.264 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:49.264 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:05:49.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.264 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:49.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:49.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:49.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:49.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:49.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:49.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:49.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:49.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:05:49.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:05:49.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:49.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:05:49.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:05:49.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:05:49.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:05:49.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:49.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:05:49.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:05:49.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.267 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:49.267 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:05:49.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:05:49.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.267 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:49.267 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:05:49.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:05:49.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.267 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:49.267 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:05:49.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:05:49.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:05:49.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:05:49.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:49.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:05:49.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:05:49.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:49.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:05:49.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:05:49.268 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.268 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:49.269 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.269 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:49.269 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:49.269 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 45.456496878999999, 2024-04-26T12:05:49.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:05:49.269 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:49.269 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.269 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:49.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:49.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:49.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:49.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:49.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:49.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:49.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:49.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:49.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:05:49.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:05:49.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:49.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:05:49.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:05:49.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:05:49.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:05:49.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:49.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:05:49.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:05:49.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:49.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:05:49.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:05:49.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:49.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:05:49.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:05:49.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.273 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:49.273 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:05:49.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:05:49.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.273 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.273 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:05:49.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:05:49.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.273 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:49.273 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:05:49.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:05:49.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.274 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:49.274 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:05:49.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:05:49.274 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.274 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:49.274 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.274 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:49.274 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:49.274 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 45.456460784000001, 2024-04-26T12:05:49.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:05:49.274 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:49.274 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.275 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:49.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:49.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:49.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:49.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:49.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:49.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:05:49.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:49.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:49.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:05:49.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:05:49.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:49.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:05:49.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:05:49.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:05:49.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:05:49.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:49.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:05:49.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:05:49.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:49.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:05:49.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:05:49.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:49.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:05:49.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:05:49.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:49.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:05:49.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:05:49.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:05:49.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:05:49.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:49.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:05:49.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:05:49.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.279 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:49.279 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:05:49.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:05:49.279 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.279 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:49.279 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.279 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:49.279 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:49.279 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 45.456423100000002, 2024-04-26T12:05:49.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:05:49.280 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:49.280 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.280 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:49.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:49.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:49.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:49.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:49.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:49.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:05:49.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:49.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:05:49.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:05:49.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:49.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:05:49.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:05:49.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:05:49.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:05:49.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:49.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:05:49.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:05:49.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:49.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:49.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:05:49.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:49.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:05:49.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:05:49.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:49.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:05:49.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:05:49.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:05:49.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:05:49.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:49.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:05:49.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:05:49.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:49.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:05:49.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:05:49.285 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.285 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:49.285 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.285 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:49.285 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:49.285 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 45.456401759999999, 2024-04-26T12:05:49.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:05:49.285 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:49.285 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.285 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:49.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:49.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:49.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.286 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:49.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:49.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.286 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:49.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:49.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.286 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:49.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:05:49.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:49.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:49.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:05:49.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:05:49.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:05:49.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:05:49.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:49.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:05:49.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:05:49.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:49.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:05:49.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:05:49.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:49.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:05:49.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:05:49.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:49.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:05:49.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:05:49.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:05:49.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:05:49.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:49.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:05:49.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:05:49.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.290 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:49.290 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:05:49.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:05:49.290 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.290 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:49.290 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.290 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:49.290 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:49.290 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 45.456379493999997, 2024-04-26T12:05:49.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:05:49.291 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:49.291 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.291 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:49.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:49.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:49.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:49.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:49.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:49.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:49.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:49.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:05:49.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:49.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:49.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:05:49.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:05:49.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:05:49.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:05:49.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:49.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:05:49.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:05:49.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:49.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:05:49.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:05:49.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:49.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:05:49.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:05:49.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:49.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:05:49.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:05:49.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:05:49.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:05:49.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:49.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:05:49.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:05:49.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:49.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:05:49.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:05:49.295 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.295 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:49.295 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.295 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:49.296 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:49.296 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 45.456357871999998, 2024-04-26T12:05:49.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:05:49.296 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:49.296 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.296 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:49.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:49.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:49.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:49.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:49.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:49.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:49.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:49.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:05:49.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:05:49.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:49.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:05:49.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:05:49.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:05:49.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:05:49.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:49.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:05:49.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:05:49.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:49.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:05:49.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:05:49.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:49.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:05:49.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:05:49.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:49.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:05:49.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:05:49.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:05:49.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:05:49.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:49.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:05:49.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:05:49.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:49.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:05:49.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:05:49.300 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.300 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:49.300 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.301 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:49.301 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:49.301 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 45.456331306000003, 2024-04-26T12:05:49.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:05:49.301 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:49.301 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.301 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:49.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:49.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:49.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:49.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:49.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:49.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:05:49.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:49.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:05:49.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:05:49.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:49.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:05:49.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:05:49.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:05:49.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:05:49.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:49.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:05:49.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:05:49.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:49.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:05:49.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:05:49.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:49.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:05:49.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:05:49.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:49.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:05:49.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:05:49.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:05:49.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:05:49.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:49.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:05:49.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:05:49.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:49.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:05:49.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:05:49.305 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.306 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:49.306 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.306 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:49.306 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:49.306 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 45.456292793999999, 2024-04-26T12:05:49.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:05:49.306 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:49.306 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.306 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:49.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:49.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:49.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:49.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:49.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:49.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:49.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:49.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:05:49.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:05:49.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:49.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:05:49.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:05:49.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:05:49.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:05:49.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:49.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:05:49.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:05:49.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:49.309 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:05:49.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:05:49.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:49.309 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:05:49.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:05:49.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:49.309 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:05:49.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:05:49.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:05:49.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:05:49.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:49.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:05:49.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:05:49.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:49.311 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:05:49.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:05:49.311 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.311 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:49.311 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.311 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.311 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:49.311 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:49.311 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 45.456264621000003, 2024-04-26T12:05:49.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:05:49.311 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:49.311 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.311 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:49.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.311 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:49.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:49.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:49.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:49.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:49.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:49.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:49.313 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:05:49.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:05:49.313 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.313 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:49.313 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:05:49.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:05:49.313 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.313 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.313 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:05:49.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:05:49.313 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.313 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:49.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:05:49.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:05:49.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:49.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:05:49.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:05:49.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:49.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:05:49.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:05:49.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:49.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:05:49.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:05:49.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:05:49.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:05:49.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:49.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:05:49.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:05:49.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:49.316 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:05:49.316 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:05:49.316 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.316 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:49.316 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.316 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.316 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.316 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:49.316 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:49.316 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 45.456230056999999, 2024-04-26T12:05:49.316 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:05:49.316 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:49.316 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.316 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:49.316 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:49.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:49.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:49.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:49.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:49.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:05:49.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:49.318 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:05:49.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:05:49.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.318 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:49.318 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:05:49.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:05:49.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.318 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.318 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:05:49.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:05:49.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:49.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:05:49.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:05:49.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.319 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:49.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:05:49.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:05:49.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.319 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:49.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:05:49.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:05:49.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.319 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.320 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:49.320 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:05:49.320 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:05:49.320 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.320 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.320 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.320 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:05:49.320 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:05:49.320 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.320 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.320 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:49.320 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:49.320 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:05:49.320 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.321 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.321 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:49.321 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:05:49.321 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:05:49.321 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.321 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:49.321 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.321 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.321 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.321 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:49.321 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:49.321 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 45.455355277000002, 2024-04-26T12:05:49.321 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:05:49.321 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:49.322 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.322 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:49.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.322 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:49.322 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:49.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.322 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.322 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:49.322 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:49.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.322 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.322 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:49.322 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:05:49.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:49.323 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:49.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:05:49.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:05:49.323 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:49.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:05:49.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:05:49.323 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:05:49.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:05:49.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:49.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:05:49.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:05:49.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:49.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:05:49.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:05:49.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:49.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:05:49.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:05:49.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:49.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:05:49.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:05:49.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:05:49.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:05:49.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:49.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:05:49.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:05:49.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:49.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:05:49.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:05:49.326 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.326 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:49.326 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.326 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:49.326 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:49.327 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 45.455316318000001, 2024-04-26T12:05:49.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:05:49.327 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:49.327 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.327 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:49.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:49.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:49.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:49.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:49.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.328 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:49.328 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:05:49.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.328 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.328 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:49.328 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:05:49.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:05:49.328 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.328 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:49.328 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:05:49.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:05:49.328 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:05:49.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:05:49.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:49.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:05:49.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:05:49.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:49.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:05:49.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:05:49.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:49.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:05:49.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:05:49.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:49.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:05:49.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:05:49.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:05:49.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:05:49.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:49.331 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:05:49.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:05:49.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:49.331 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:05:49.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:05:49.331 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.331 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:49.331 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.332 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:49.332 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:49.332 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 45.455280846000001, 2024-04-26T12:05:49.332 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:05:49.332 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:49.332 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.332 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:49.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.332 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:49.332 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:49.332 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:49.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:49.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:49.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:49.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:49.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:05:49.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:05:49.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.334 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:49.334 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:05:49.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:05:49.334 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.334 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.334 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.334 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:05:49.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:05:49.334 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.334 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.334 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:49.334 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:05:49.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:05:49.334 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:49.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:05:49.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:05:49.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:49.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:05:49.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:05:49.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:49.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:05:49.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:05:49.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:05:49.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:05:49.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:49.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:05:49.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:05:49.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:49.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:05:49.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:05:49.337 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.337 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:49.337 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.337 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:49.337 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:49.337 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 45.455202157000002, 2024-04-26T12:05:49.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:05:49.337 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:49.337 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.337 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:49.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:49.337 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:49.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:49.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:49.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:49.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:05:49.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:49.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:49.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:05:49.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:05:49.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:49.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:05:49.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:05:49.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:05:49.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:05:49.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:49.340 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:05:49.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:05:49.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.340 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:49.340 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:05:49.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:05:49.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.340 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:49.340 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:05:49.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:05:49.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:49.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:05:49.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:05:49.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:05:49.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:05:49.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:49.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:05:49.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:05:49.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:49.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:05:49.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:05:49.342 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.342 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:49.342 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.342 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:49.342 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:49.342 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 45.455051308999998, 2024-04-26T12:05:49.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:05:49.342 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:49.342 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:05:49.342 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:49.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:49.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:49.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:49.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:49.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:49.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:49.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:05:49.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:49.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:49.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:05:49.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:05:49.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:49.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:05:49.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:05:49.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:05:49.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:05:49.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:49.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:05:49.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:05:49.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:49.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:49.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:05:49.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:49.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:49.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:49.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:05:49.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:05:49.346 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.346 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:49.346 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.346 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:49.346 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:49.346 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:49.347 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:49.346+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:49.348 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:49.448 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:49.447+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:49.458 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:49.458 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:49.458 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:05:49.459 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:49.467 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:49.549 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:49.548+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:49.611 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:49.611 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:49.611 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:05:49.611 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:05:49.611 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:49.620 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:49.650 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:05:49.650 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:05:49.650 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-26T12:05:49.650 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T12:05:49.651 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:49.649+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:49.723 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:49.723 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:05:49.723 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:05:49.723 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:05:49.724 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.724 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:49.724 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:49.724 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 45.941116033999997, 2024-04-26T12:05:49.724 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:05:49.724 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:49.724 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.724 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:49.724 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.724 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:49.724 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:49.725 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.725 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.725 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.725 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:49.725 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:49.725 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.725 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.725 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.725 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:49.725 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:05:49.725 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:49.725 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.726 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.726 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:49.726 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:05:49.726 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:05:49.726 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.726 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.726 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:49.726 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:05:49.726 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:05:49.726 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.726 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.727 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.727 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:05:49.727 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:05:49.727 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.727 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.727 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:49.727 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:05:49.727 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:05:49.727 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.727 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.727 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:49.727 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:49.728 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:05:49.728 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.728 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:49.775 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:05:49.775 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:05:49.775 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:49.775 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:05:49.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:05:49.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.776 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:05:49.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:05:49.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:49.776 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:05:49.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:05:49.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:49.776 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:05:49.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:05:49.777 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.777 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:49.777 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.777 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:49.777 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:49.777 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 45.941060714000002, 2024-04-26T12:05:49.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:05:49.777 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:49.777 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.777 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:49.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.777 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:49.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:49.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:49.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:49.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:49.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:05:49.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:49.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.779 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:49.779 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:05:49.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:05:49.779 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.779 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.779 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:49.779 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:05:49.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:05:49.779 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.779 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.779 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.779 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:05:49.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:05:49.779 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.780 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.780 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:49.780 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:05:49.780 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:05:49.780 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.780 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.780 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:49.780 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:05:49.780 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:05:49.780 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.780 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.780 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:49.780 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:05:49.780 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:05:49.780 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.781 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:49.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:05:49.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:05:49.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.781 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:05:49.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:05:49.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.781 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:49.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:05:49.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:05:49.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:49.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:05:49.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:05:49.782 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.782 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:49.782 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.782 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:49.782 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:49.782 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 45.941010695999999, 2024-04-26T12:05:49.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:05:49.782 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:49.783 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.783 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:49.783 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.783 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:49.783 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:49.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.783 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.783 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:49.783 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:49.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.783 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.783 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:49.783 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:05:49.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:49.784 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:05:49.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:05:49.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:49.784 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:05:49.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:05:49.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.785 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:05:49.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:05:49.785 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.785 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.785 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:49.785 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:05:49.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:05:49.785 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.785 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.785 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:49.785 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:05:49.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:05:49.785 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.785 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.786 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:49.786 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:05:49.786 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:05:49.786 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.786 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.786 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:49.786 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:05:49.786 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:05:49.786 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.786 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.786 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.786 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:05:49.786 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:05:49.786 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.786 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.787 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:49.787 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:05:49.787 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:05:49.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.787 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.787 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:49.787 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:05:49.787 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:05:49.787 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.787 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:49.787 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.787 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.787 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:49.788 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:49.788 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 45.940976059, 2024-04-26T12:05:49.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:05:49.788 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:49.788 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.788 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:49.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:49.788 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:49.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:49.788 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:49.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:49.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:05:49.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:49.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:05:49.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:05:49.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:49.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:49.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:05:49.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.790 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.790 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:05:49.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:05:49.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.790 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.790 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:49.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:05:49.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:05:49.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.790 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.790 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:49.791 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:05:49.791 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:05:49.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.791 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:49.791 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:05:49.791 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:05:49.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.791 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.791 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:05:49.791 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:05:49.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.792 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:49.792 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:05:49.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:05:49.792 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.792 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.792 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:49.792 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:05:49.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:05:49.792 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.792 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.792 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:49.792 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:05:49.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:05:49.792 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.793 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:49.793 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.793 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:49.793 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:49.793 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 45.940937546999997, 2024-04-26T12:05:49.793 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:05:49.793 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:49.793 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.793 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:49.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:49.793 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:49.793 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:49.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:49.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:49.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:49.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:49.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:49.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:49.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:05:49.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:49.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:05:49.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:05:49.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:05:49.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:05:49.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:49.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:05:49.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:05:49.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:49.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:05:49.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:05:49.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:49.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:05:49.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:05:49.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.797 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:05:49.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:05:49.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.797 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:49.797 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:05:49.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:05:49.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.797 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:49.797 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:05:49.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:05:49.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.798 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:49.798 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:05:49.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:05:49.798 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.798 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:49.798 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.798 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.798 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:49.798 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:49.798 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 45.940907224, 2024-04-26T12:05:49.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:05:49.798 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:49.799 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.799 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:49.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:49.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:49.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:49.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:49.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:49.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:49.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:49.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:05:49.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:05:49.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:49.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:05:49.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:05:49.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:05:49.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:05:49.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:49.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:05:49.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:05:49.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:49.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:05:49.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:05:49.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:49.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:05:49.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:05:49.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:49.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:05:49.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:05:49.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:05:49.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:05:49.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.803 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:49.803 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:05:49.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:05:49.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.803 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:49.803 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:05:49.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:05:49.803 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.803 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:49.803 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.804 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:49.804 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:49.804 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 45.940880522, 2024-04-26T12:05:49.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:05:49.804 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:49.804 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:49.804 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:49.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:49.804 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:49.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:49.804 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:49.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:49.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:49.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:49.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:05:49.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:05:49.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:49.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:05:49.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:05:49.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:05:49.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:05:49.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:49.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:05:49.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:05:49.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:49.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:05:49.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:05:49.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:49.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:05:49.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:05:49.807 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.807 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:49.807 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.807 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:49.807 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:49.807 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 45.940838231999997, 2024-04-26T12:05:49.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:05:49.808 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:49.808 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:49.808 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:49.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:49.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:49.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:49.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:49.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.809 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:49.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:49.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.809 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:49.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:05:49.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:05:49.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.809 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:49.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:05:49.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:05:49.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.810 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:05:49.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:05:49.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:49.810 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:05:49.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:05:49.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:49.810 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:05:49.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:05:49.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.811 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:49.811 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:05:49.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:05:49.811 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.811 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:49.811 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.811 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.811 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:49.811 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:49.811 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 45.940810153999998, 2024-04-26T12:05:49.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:05:49.811 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:49.812 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:49.812 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:49.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:49.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:49.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:49.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:49.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:49.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:05:49.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:49.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:05:49.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:05:49.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:49.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:05:49.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:05:49.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:49.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:05:49.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:49.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:49.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:05:49.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:49.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:05:49.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:05:49.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:49.815 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:05:49.815 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:05:49.815 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.815 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:49.815 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.815 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:49.815 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:49.815 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 45.934814803999998, 2024-04-26T12:05:49.815 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:05:49.815 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:49.815 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.815 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:49.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.816 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:49.816 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:49.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.816 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:49.816 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:49.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.816 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:49.816 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:05:49.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:49.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:05:49.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:05:49.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.817 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:49.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:05:49.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:05:49.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.817 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:05:49.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:05:49.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.817 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:49.818 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:05:49.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:05:49.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:49.818 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:05:49.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:05:49.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:49.818 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:05:49.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:05:49.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.819 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:49.819 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:05:49.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:05:49.819 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.819 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:49.819 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.819 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.819 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.819 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:49.819 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:49.819 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 45.934745837999998, 2024-04-26T12:05:49.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:05:49.819 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:49.819 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.820 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:49.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:49.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:49.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:49.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:49.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:49.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:05:49.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.821 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.821 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.821 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:49.821 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:05:49.821 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:05:49.821 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.821 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.821 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:49.821 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:05:49.821 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:05:49.821 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.821 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.821 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.821 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:05:49.821 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:05:49.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.822 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:49.822 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:05:49.822 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:05:49.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.822 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:49.822 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:49.822 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:05:49.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.822 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:49.822 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:05:49.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:05:49.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:49.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:05:49.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:05:49.823 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.823 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:49.823 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.823 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:49.823 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:49.823 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 45.934251475000003, 2024-04-26T12:05:49.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:05:49.823 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:49.824 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.824 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:49.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:49.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:49.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:49.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:49.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:49.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:49.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:49.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:05:49.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:05:49.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:49.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:05:49.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:05:49.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:05:49.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:05:49.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:49.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:05:49.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:05:49.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:49.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:05:49.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:05:49.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:49.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:05:49.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:05:49.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:49.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:05:49.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:05:49.827 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.827 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:49.827 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.827 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:49.828 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:49.828 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 45.934213210000003, 2024-04-26T12:05:49.828 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:05:49.828 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:49.828 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.828 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:49.828 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.828 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:49.828 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:49.828 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.828 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.828 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.828 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:49.828 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:49.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:49.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:49.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:49.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:05:49.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:05:49.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:49.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:05:49.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:05:49.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:05:49.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:05:49.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:49.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:05:49.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:05:49.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:49.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:05:49.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:05:49.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.831 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:49.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:05:49.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:05:49.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.831 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:49.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:05:49.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:05:49.831 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.831 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:49.832 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.832 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:05:49.832 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:49.832 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 45.933533324999999, 2024-04-26T12:05:49.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:05:49.832 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:49.832 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:49.832 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:49.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:49.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:49.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.833 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:49.833 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:49.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.833 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:49.833 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:49.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.833 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:49.833 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:05:49.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:05:49.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.834 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:49.834 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:05:49.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:05:49.834 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.834 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.834 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:05:49.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:05:49.834 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.834 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:49.834 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:05:49.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:05:49.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:49.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:05:49.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:05:49.835 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.835 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:49.835 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.835 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:49.835 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:49.835 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 45.933504145999997, 2024-04-26T12:05:49.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:05:49.836 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:49.836 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:49.836 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:49.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:49.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:49.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:49.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:49.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:49.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:05:49.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:49.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:05:49.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:05:49.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:49.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:05:49.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:05:49.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.838 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.838 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:05:49.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:05:49.838 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.838 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:49.838 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:05:49.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:05:49.838 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.838 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:49.838 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:05:49.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:05:49.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:49.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:05:49.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:05:49.839 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.839 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:49.839 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.839 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:49.839 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:49.839 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 45.933472334999998, 2024-04-26T12:05:49.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:05:49.839 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:49.840 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:49.840 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:49.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:49.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:49.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:49.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:49.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:49.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:49.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:05:49.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:49.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:05:49.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:05:49.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:49.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:05:49.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:05:49.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:05:49.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:05:49.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:49.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:05:49.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:05:49.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:49.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:05:49.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:05:49.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:49.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:05:49.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:05:49.843 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.843 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:49.843 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.843 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:49.843 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:49.843 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 45.933450979, 2024-04-26T12:05:49.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:05:49.844 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:49.844 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:49.844 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:49.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.844 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:49.844 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:49.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.844 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.844 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:49.844 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:49.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.844 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.844 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:49.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:49.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:05:49.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:49.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:05:49.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:05:49.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:49.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:05:49.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:05:49.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:05:49.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:05:49.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.846 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:49.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:05:49.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:05:49.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.846 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:49.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:05:49.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:05:49.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:49.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:05:49.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:05:49.847 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.847 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:49.847 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.847 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:05:49.847 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:49.847 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 45.933422526000001, 2024-04-26T12:05:49.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:05:49.847 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:49.847 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:49.847 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:49.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:49.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:49.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:49.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:49.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.850 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:49.850 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:49.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:49.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.850 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:49.850 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:05:49.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:05:49.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.850 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:49.850 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:05:49.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:05:49.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:05:49.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:05:49.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:49.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:05:49.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:05:49.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:49.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:05:49.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:05:49.852 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.852 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:49.852 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.852 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:05:49.852 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:49.852 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 45.93270072, 2024-04-26T12:05:49.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:05:49.852 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:49.852 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:49.852 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:49.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:49.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:49.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:49.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:49.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:49.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:05:49.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:49.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:49.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:05:49.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:05:49.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:49.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:05:49.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:05:49.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:05:49.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:05:49.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:49.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:05:49.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:05:49.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:49.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:05:49.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:05:49.855 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.855 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:49.855 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.856 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:05:49.856 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:49.856 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 40.215774117000002, 2024-04-26T12:05:49.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:05:49.856 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:49.856 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:49.856 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:49.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:49.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:49.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:49.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:49.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:49.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:49.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:05:49.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:05:49.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:49.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:05:49.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:05:49.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:49.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:05:49.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:05:49.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:49.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:05:49.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:05:49.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:49.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:05:49.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:05:49.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:49.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:05:49.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:05:49.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:49.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:05:49.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:05:49.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:49.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:05:49.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:05:49.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:49.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:05:49.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:05:49.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:49.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:05:49.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:05:49.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:49.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:49.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:49.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:05:49.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:05:49.861 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.861 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:49.861 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.861 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:49.861 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:49.861 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:49.863 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:49.863 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:49.862+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:49.888 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-26T12:05:49.961 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:49.961 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-26T12:05:49.961 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 29, 2024-04-26T12:05:49.961 INFO:teuthology.orchestra.run.smithi052.stdout: "fsid": "5bc300ae-e948-4ce3-81bb-5abae8c06799", 2024-04-26T12:05:49.961 INFO:teuthology.orchestra.run.smithi052.stdout: "created": "2024-04-26T12:04:41.919527+0000", 2024-04-26T12:05:49.962 INFO:teuthology.orchestra.run.smithi052.stdout: "modified": "2024-04-26T12:05:49.883881+0000", 2024-04-26T12:05:49.962 INFO:teuthology.orchestra.run.smithi052.stdout: "last_up_change": "2024-04-26T12:04:51.084680+0000", 2024-04-26T12:05:49.962 INFO:teuthology.orchestra.run.smithi052.stdout: "last_in_change": "2024-04-26T12:04:43.540390+0000", 2024-04-26T12:05:49.962 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T12:05:49.962 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_num": 5801984, 2024-04-26T12:05:49.962 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_set": [ 2024-04-26T12:05:49.963 INFO:teuthology.orchestra.run.smithi052.stdout: "noscrub", 2024-04-26T12:05:49.963 INFO:teuthology.orchestra.run.smithi052.stdout: "pglog_hardlimit", 2024-04-26T12:05:49.963 INFO:teuthology.orchestra.run.smithi052.stdout: "purged_snapdirs", 2024-04-26T12:05:49.963 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_deletes", 2024-04-26T12:05:49.963 INFO:teuthology.orchestra.run.smithi052.stdout: "sortbitwise" 2024-04-26T12:05:49.963 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-04-26T12:05:49.963 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_version": 4, 2024-04-26T12:05:49.964 INFO:teuthology.orchestra.run.smithi052.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T12:05:49.964 INFO:teuthology.orchestra.run.smithi052.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T12:05:49.964 INFO:teuthology.orchestra.run.smithi052.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T12:05:49.964 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_snapshot": "", 2024-04-26T12:05:49.964 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_max": 4, 2024-04-26T12:05:49.964 INFO:teuthology.orchestra.run.smithi052.stdout: "max_osd": 3, 2024-04-26T12:05:49.965 INFO:teuthology.orchestra.run.smithi052.stdout: "require_min_compat_client": "luminous", 2024-04-26T12:05:49.965 INFO:teuthology.orchestra.run.smithi052.stdout: "min_compat_client": "jewel", 2024-04-26T12:05:49.965 INFO:teuthology.orchestra.run.smithi052.stdout: "require_osd_release": "reef", 2024-04-26T12:05:49.965 INFO:teuthology.orchestra.run.smithi052.stdout: "allow_crimson": false, 2024-04-26T12:05:49.965 INFO:teuthology.orchestra.run.smithi052.stdout: "pools": [ 2024-04-26T12:05:49.965 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:49.965 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 1, 2024-04-26T12:05:49.965 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": ".mgr", 2024-04-26T12:05:49.966 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-04-26T12:04:52.376506+0000", 2024-04-26T12:05:49.966 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-04-26T12:05:49.966 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-04-26T12:05:49.966 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-04-26T12:05:49.966 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-04-26T12:05:49.966 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-04-26T12:05:49.966 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-04-26T12:05:49.966 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:05:49.967 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:05:49.967 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:05:49.967 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:05:49.967 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-04-26T12:05:49.967 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:05:49.967 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 1, 2024-04-26T12:05:49.967 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 1, 2024-04-26T12:05:49.967 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 1, 2024-04-26T12:05:49.968 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 1, 2024-04-26T12:05:49.968 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 1, 2024-04-26T12:05:49.968 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-04-26T12:05:49.968 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-04-26T12:05:49.968 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-04-26T12:05:49.968 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-04-26T12:05:49.968 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-04-26T12:05:49.968 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-04-26T12:05:49.968 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-04-26T12:05:49.969 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:49.969 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "11", 2024-04-26T12:05:49.969 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-04-26T12:05:49.969 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:05:49.969 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:05:49.969 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-04-26T12:05:49.969 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:05:49.969 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-04-26T12:05:49.970 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-04-26T12:05:49.970 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-04-26T12:05:49.970 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-04-26T12:05:49.970 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-04-26T12:05:49.970 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-04-26T12:05:49.970 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-04-26T12:05:49.970 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-04-26T12:05:49.970 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-04-26T12:05:49.971 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-04-26T12:05:49.971 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-04-26T12:05:49.971 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-04-26T12:05:49.971 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-04-26T12:05:49.971 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:05:49.971 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:05:49.971 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:05:49.971 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-04-26T12:05:49.971 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-04-26T12:05:49.972 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-04-26T12:05:49.972 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-04-26T12:05:49.972 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-04-26T12:05:49.972 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:49.972 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-04-26T12:05:49.972 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-04-26T12:05:49.972 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-04-26T12:05:49.972 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:05:49.972 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:05:49.972 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:05:49.972 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:05:49.972 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-04-26T12:05:49.972 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-04-26T12:05:49.972 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-04-26T12:05:49.973 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-04-26T12:05:49.973 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-04-26T12:05:49.973 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_max": 32, 2024-04-26T12:05:49.973 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 1 2024-04-26T12:05:49.973 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:49.973 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-04-26T12:05:49.973 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": {} 2024-04-26T12:05:49.973 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:49.973 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-04-26T12:05:49.973 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 2.9900000095367432, 2024-04-26T12:05:49.973 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 2.9900000095367432, 2024-04-26T12:05:49.973 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T12:05:49.973 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 2, 2024-04-26T12:05:49.973 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 2, 2024-04-26T12:05:49.973 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:05:49.974 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-04-26T12:05:49.974 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:05:49.974 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:49.974 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:49.974 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:49.974 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 2, 2024-04-26T12:05:49.974 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "rbd", 2024-04-26T12:05:49.974 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-04-26T12:04:57.775333+0000", 2024-04-26T12:05:49.974 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-04-26T12:05:49.974 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-04-26T12:05:49.974 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-04-26T12:05:49.974 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-04-26T12:05:49.974 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-04-26T12:05:49.975 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-04-26T12:05:49.975 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:05:49.975 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:05:49.975 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:05:49.975 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:05:49.975 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-04-26T12:05:49.975 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:05:49.975 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 8, 2024-04-26T12:05:49.975 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 8, 2024-04-26T12:05:49.975 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 8, 2024-04-26T12:05:49.975 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 8, 2024-04-26T12:05:49.975 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 8, 2024-04-26T12:05:49.975 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-04-26T12:05:49.976 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-04-26T12:05:49.976 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-04-26T12:05:49.976 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-04-26T12:05:49.976 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-04-26T12:05:49.976 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-04-26T12:05:49.976 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-04-26T12:05:49.977 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:49.977 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "14", 2024-04-26T12:05:49.977 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-04-26T12:05:49.977 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:05:49.977 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:05:49.977 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-04-26T12:05:49.978 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:05:49.978 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-04-26T12:05:49.978 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-04-26T12:05:49.978 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-04-26T12:05:49.978 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-04-26T12:05:49.978 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-04-26T12:05:49.978 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-04-26T12:05:49.979 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-04-26T12:05:49.979 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-04-26T12:05:49.979 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-04-26T12:05:49.979 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-04-26T12:05:49.979 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-04-26T12:05:49.979 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-04-26T12:05:49.979 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-04-26T12:05:49.980 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:05:49.980 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:05:49.980 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:05:49.980 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-04-26T12:05:49.980 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-04-26T12:05:49.980 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-04-26T12:05:49.980 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-04-26T12:05:49.980 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-04-26T12:05:49.980 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:49.981 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-04-26T12:05:49.981 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-04-26T12:05:49.981 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-04-26T12:05:49.981 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:05:49.981 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:05:49.981 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:05:49.981 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:05:49.981 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-04-26T12:05:49.981 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-04-26T12:05:49.982 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-04-26T12:05:49.982 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-04-26T12:05:49.982 INFO:teuthology.orchestra.run.smithi052.stdout: "options": {}, 2024-04-26T12:05:49.982 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-04-26T12:05:49.982 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd": {} 2024-04-26T12:05:49.982 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:49.982 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-04-26T12:05:49.982 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.5, 2024-04-26T12:05:49.982 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.5, 2024-04-26T12:05:49.982 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-04-26T12:05:49.982 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.5, 2024-04-26T12:05:49.982 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.5, 2024-04-26T12:05:49.982 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:05:49.983 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-04-26T12:05:49.983 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:05:49.983 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:49.983 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:49.983 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:49.983 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 3, 2024-04-26T12:05:49.983 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "cephfs_metadata", 2024-04-26T12:05:49.983 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-04-26T12:05:02.226064+0000", 2024-04-26T12:05:49.983 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-04-26T12:05:49.983 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-04-26T12:05:49.983 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-04-26T12:05:49.983 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-04-26T12:05:49.983 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-04-26T12:05:49.983 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-04-26T12:05:49.983 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:05:49.984 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:05:49.984 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:05:49.984 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:05:49.984 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-04-26T12:05:49.984 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:05:49.984 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 32, 2024-04-26T12:05:49.984 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 32, 2024-04-26T12:05:49.984 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 32, 2024-04-26T12:05:49.984 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 32, 2024-04-26T12:05:49.984 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 32, 2024-04-26T12:05:49.984 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-04-26T12:05:49.984 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-04-26T12:05:49.984 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-04-26T12:05:49.984 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-04-26T12:05:49.984 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-04-26T12:05:49.984 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-04-26T12:05:49.985 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-04-26T12:05:49.985 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:49.985 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "17", 2024-04-26T12:05:49.985 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-04-26T12:05:49.985 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:05:49.985 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:05:49.985 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-04-26T12:05:49.985 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:05:49.985 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-04-26T12:05:49.985 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-04-26T12:05:49.985 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-04-26T12:05:49.985 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-04-26T12:05:49.985 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-04-26T12:05:49.986 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-04-26T12:05:49.986 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-04-26T12:05:49.986 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-04-26T12:05:49.986 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-04-26T12:05:49.986 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-04-26T12:05:49.986 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-04-26T12:05:49.986 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-04-26T12:05:49.986 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-04-26T12:05:49.986 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:05:49.986 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:05:49.986 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:05:49.986 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-04-26T12:05:49.986 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-04-26T12:05:49.987 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-04-26T12:05:49.987 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-04-26T12:05:49.987 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-04-26T12:05:49.987 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:49.987 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-04-26T12:05:49.987 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-04-26T12:05:49.987 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-04-26T12:05:49.987 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:05:49.987 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:05:49.987 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:05:49.987 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:05:49.987 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-04-26T12:05:49.987 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-04-26T12:05:49.987 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-04-26T12:05:49.987 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-04-26T12:05:49.988 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-04-26T12:05:49.988 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_bias": 4, 2024-04-26T12:05:49.988 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 16, 2024-04-26T12:05:49.988 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_priority": 5 2024-04-26T12:05:49.988 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:49.988 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-04-26T12:05:49.988 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs": { 2024-04-26T12:05:49.988 INFO:teuthology.orchestra.run.smithi052.stdout: "metadata": "cephfs" 2024-04-26T12:05:49.988 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:49.988 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:49.988 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-04-26T12:05:49.988 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.1299999952316284, 2024-04-26T12:05:49.988 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.1299999952316284, 2024-04-26T12:05:49.988 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-04-26T12:05:49.989 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T12:05:49.989 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T12:05:49.989 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:05:49.989 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-04-26T12:05:49.989 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:05:49.989 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:49.989 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:49.989 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:49.989 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 4, 2024-04-26T12:05:49.989 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "cephfs_data", 2024-04-26T12:05:49.989 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-04-26T12:05:02.758806+0000", 2024-04-26T12:05:49.989 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-04-26T12:05:49.989 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-04-26T12:05:49.989 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-04-26T12:05:49.990 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-04-26T12:05:49.990 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-04-26T12:05:49.990 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-04-26T12:05:49.990 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:05:49.990 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:05:49.990 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:05:49.991 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:05:49.991 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-04-26T12:05:49.991 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:05:49.991 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 64, 2024-04-26T12:05:49.991 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 64, 2024-04-26T12:05:49.991 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 64, 2024-04-26T12:05:49.992 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 64, 2024-04-26T12:05:49.992 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 64, 2024-04-26T12:05:49.992 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-04-26T12:05:49.992 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-04-26T12:05:49.992 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-04-26T12:05:49.992 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-04-26T12:05:49.992 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-04-26T12:05:49.993 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-04-26T12:05:49.993 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-04-26T12:05:49.993 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:49.993 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "18", 2024-04-26T12:05:49.993 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-04-26T12:05:49.993 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:05:49.994 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:05:49.994 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-04-26T12:05:49.994 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:05:49.994 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-04-26T12:05:49.994 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-04-26T12:05:49.994 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-04-26T12:05:49.995 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-04-26T12:05:49.995 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-04-26T12:05:49.995 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-04-26T12:05:49.995 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-04-26T12:05:49.995 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-04-26T12:05:49.996 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-04-26T12:05:49.996 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-04-26T12:05:49.996 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-04-26T12:05:49.996 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-04-26T12:05:49.996 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-04-26T12:05:49.996 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:05:49.997 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:05:49.997 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:05:49.997 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-04-26T12:05:49.997 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-04-26T12:05:49.997 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-04-26T12:05:49.997 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-04-26T12:05:49.998 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-04-26T12:05:49.998 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:49.998 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-04-26T12:05:49.998 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-04-26T12:05:49.998 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-04-26T12:05:49.998 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:05:49.999 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:05:49.999 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:05:49.999 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:05:49.999 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-04-26T12:05:49.999 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-04-26T12:05:50.000 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-04-26T12:05:50.000 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-04-26T12:05:50.000 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-04-26T12:05:50.000 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 64, 2024-04-26T12:05:50.000 INFO:teuthology.orchestra.run.smithi052.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T12:05:50.000 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.001 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-04-26T12:05:50.001 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs": { 2024-04-26T12:05:50.001 INFO:teuthology.orchestra.run.smithi052.stdout: "data": "cephfs" 2024-04-26T12:05:50.001 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:50.001 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.001 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-04-26T12:05:50.002 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.1299999952316284, 2024-04-26T12:05:50.002 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.1299999952316284, 2024-04-26T12:05:50.002 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-04-26T12:05:50.002 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T12:05:50.002 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T12:05:50.002 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:05:50.002 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-04-26T12:05:50.003 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:05:50.003 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:50.003 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:50.003 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-04-26T12:05:50.003 INFO:teuthology.orchestra.run.smithi052.stdout: "osds": [ 2024-04-26T12:05:50.003 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.003 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-04-26T12:05:50.004 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "638cfa85-e921-4403-9bcb-a7f4653cc3b2", 2024-04-26T12:05:50.004 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-04-26T12:05:50.004 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-04-26T12:05:50.004 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-04-26T12:05:50.004 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-04-26T12:05:50.004 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-04-26T12:05:50.004 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-04-26T12:05:50.005 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-04-26T12:05:50.005 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 16, 2024-04-26T12:05:50.005 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-04-26T12:05:50.005 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-04-26T12:05:50.005 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-04-26T12:05:50.005 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:05:50.005 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.005 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:05:50.006 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.143:6800", 2024-04-26T12:05:50.006 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28597 2024-04-26T12:05:50.006 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.006 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.006 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:50.006 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.143:6801", 2024-04-26T12:05:50.006 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28597 2024-04-26T12:05:50.007 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:50.007 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:50.007 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.007 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-04-26T12:05:50.007 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:05:50.007 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.007 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:05:50.008 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.143:6802", 2024-04-26T12:05:50.008 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28597 2024-04-26T12:05:50.008 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.008 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.008 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:50.008 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.143:6803", 2024-04-26T12:05:50.009 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28597 2024-04-26T12:05:50.009 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:50.009 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:50.009 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.009 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-04-26T12:05:50.009 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:05:50.010 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.010 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:05:50.010 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.143:6806", 2024-04-26T12:05:50.010 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28597 2024-04-26T12:05:50.010 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.010 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.011 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:50.011 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.143:6807", 2024-04-26T12:05:50.011 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28597 2024-04-26T12:05:50.011 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:50.011 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:50.011 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.012 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-04-26T12:05:50.012 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:05:50.012 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.012 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:05:50.012 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.143:6804", 2024-04-26T12:05:50.012 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28597 2024-04-26T12:05:50.012 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.012 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.013 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:50.013 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.143:6805", 2024-04-26T12:05:50.013 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28597 2024-04-26T12:05:50.013 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:50.013 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:50.013 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.013 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.143:6801/28597", 2024-04-26T12:05:50.013 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.143:6803/28597", 2024-04-26T12:05:50.013 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.143:6807/28597", 2024-04-26T12:05:50.014 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.143:6805/28597", 2024-04-26T12:05:50.014 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-04-26T12:05:50.014 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-04-26T12:05:50.014 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-04-26T12:05:50.014 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:50.014 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.014 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.014 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 1, 2024-04-26T12:05:50.015 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "2abc8d1e-ad72-4643-ad1e-3566e5113c44", 2024-04-26T12:05:50.015 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-04-26T12:05:50.015 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-04-26T12:05:50.015 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-04-26T12:05:50.015 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-04-26T12:05:50.015 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-04-26T12:05:50.015 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-04-26T12:05:50.015 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-04-26T12:05:50.015 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 16, 2024-04-26T12:05:50.016 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-04-26T12:05:50.016 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-04-26T12:05:50.016 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-04-26T12:05:50.016 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:05:50.016 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.016 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:05:50.016 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6800", 2024-04-26T12:05:50.017 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28560 2024-04-26T12:05:50.017 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.017 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.017 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:50.017 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6801", 2024-04-26T12:05:50.017 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28560 2024-04-26T12:05:50.018 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:50.018 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:50.018 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.018 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-04-26T12:05:50.018 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:05:50.018 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.019 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:05:50.019 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6802", 2024-04-26T12:05:50.019 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28560 2024-04-26T12:05:50.019 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.019 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.019 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:50.020 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6803", 2024-04-26T12:05:50.020 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28560 2024-04-26T12:05:50.020 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:50.020 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:50.020 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.020 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-04-26T12:05:50.020 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:05:50.021 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.021 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:05:50.021 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6806", 2024-04-26T12:05:50.021 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28560 2024-04-26T12:05:50.021 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.021 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.021 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:50.021 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6807", 2024-04-26T12:05:50.021 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28560 2024-04-26T12:05:50.021 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:50.022 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:50.022 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.022 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-04-26T12:05:50.022 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:05:50.022 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.022 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:05:50.022 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6804", 2024-04-26T12:05:50.022 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28560 2024-04-26T12:05:50.022 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.022 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.022 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:50.022 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6805", 2024-04-26T12:05:50.022 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28560 2024-04-26T12:05:50.022 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:50.022 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:50.023 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.023 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.154:6801/28560", 2024-04-26T12:05:50.023 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.154:6803/28560", 2024-04-26T12:05:50.023 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.154:6807/28560", 2024-04-26T12:05:50.023 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.154:6805/28560", 2024-04-26T12:05:50.023 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-04-26T12:05:50.023 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-04-26T12:05:50.023 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-04-26T12:05:50.023 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:50.023 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.023 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.023 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-04-26T12:05:50.023 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "d2ebc562-cb9b-4089-a19b-1788b70b57dc", 2024-04-26T12:05:50.023 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-04-26T12:05:50.023 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-04-26T12:05:50.024 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-04-26T12:05:50.024 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-04-26T12:05:50.024 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-04-26T12:05:50.024 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-04-26T12:05:50.024 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-04-26T12:05:50.024 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 16, 2024-04-26T12:05:50.024 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-04-26T12:05:50.024 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-04-26T12:05:50.024 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-04-26T12:05:50.024 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:05:50.024 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.024 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:05:50.025 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6800", 2024-04-26T12:05:50.025 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28709 2024-04-26T12:05:50.025 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.025 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.025 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:50.025 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6801", 2024-04-26T12:05:50.025 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28709 2024-04-26T12:05:50.025 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:50.025 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:50.025 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.025 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-04-26T12:05:50.025 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:05:50.025 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.026 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:05:50.026 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6802", 2024-04-26T12:05:50.026 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28709 2024-04-26T12:05:50.026 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.026 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.026 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:50.026 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6803", 2024-04-26T12:05:50.026 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28709 2024-04-26T12:05:50.026 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:50.026 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:50.026 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.026 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-04-26T12:05:50.026 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:05:50.027 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.027 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:05:50.027 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6806", 2024-04-26T12:05:50.027 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28709 2024-04-26T12:05:50.027 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.027 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.027 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:50.027 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6807", 2024-04-26T12:05:50.027 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28709 2024-04-26T12:05:50.027 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:50.027 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:50.027 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.027 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-04-26T12:05:50.027 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:05:50.028 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.028 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:05:50.028 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6804", 2024-04-26T12:05:50.028 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28709 2024-04-26T12:05:50.028 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.028 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.028 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:50.028 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6805", 2024-04-26T12:05:50.028 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28709 2024-04-26T12:05:50.028 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:50.028 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:50.028 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.028 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.164:6801/28709", 2024-04-26T12:05:50.028 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.164:6803/28709", 2024-04-26T12:05:50.029 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.164:6807/28709", 2024-04-26T12:05:50.029 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.164:6805/28709", 2024-04-26T12:05:50.029 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-04-26T12:05:50.029 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-04-26T12:05:50.029 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-04-26T12:05:50.029 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:50.029 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:50.029 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-04-26T12:05:50.029 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_xinfo": [ 2024-04-26T12:05:50.029 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.029 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-04-26T12:05:50.029 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-04-26T12:05:50.029 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-04-26T12:05:50.029 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-04-26T12:05:50.030 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540138322906710015, 2024-04-26T12:05:50.030 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-04-26T12:05:50.030 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-04-26T12:04:48.573478+0000", 2024-04-26T12:05:50.030 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-04-26T12:05:50.030 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.030 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.030 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 1, 2024-04-26T12:05:50.030 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-04-26T12:05:50.030 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-04-26T12:05:50.030 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-04-26T12:05:50.030 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540138322906710015, 2024-04-26T12:05:50.030 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-04-26T12:05:50.030 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-04-26T12:04:48.624482+0000", 2024-04-26T12:05:50.030 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-04-26T12:05:50.031 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.031 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:50.031 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-04-26T12:05:50.031 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-04-26T12:05:50.031 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-04-26T12:05:50.031 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-04-26T12:05:50.031 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540138322906710015, 2024-04-26T12:05:50.031 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-04-26T12:05:50.031 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-04-26T12:04:48.615449+0000", 2024-04-26T12:05:50.031 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-04-26T12:05:50.031 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:50.031 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-04-26T12:05:50.031 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap": [], 2024-04-26T12:05:50.031 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap_items": [], 2024-04-26T12:05:50.031 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap_primaries": [], 2024-04-26T12:05:50.032 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_temp": [], 2024-04-26T12:05:50.032 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_temp": [], 2024-04-26T12:05:50.032 INFO:teuthology.orchestra.run.smithi052.stdout: "blocklist": {}, 2024-04-26T12:05:50.032 INFO:teuthology.orchestra.run.smithi052.stdout: "range_blocklist": {}, 2024-04-26T12:05:50.032 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profiles": { 2024-04-26T12:05:50.032 INFO:teuthology.orchestra.run.smithi052.stdout: "default": { 2024-04-26T12:05:50.032 INFO:teuthology.orchestra.run.smithi052.stdout: "crush-failure-domain": "osd", 2024-04-26T12:05:50.032 INFO:teuthology.orchestra.run.smithi052.stdout: "k": "2", 2024-04-26T12:05:50.032 INFO:teuthology.orchestra.run.smithi052.stdout: "m": "1", 2024-04-26T12:05:50.032 INFO:teuthology.orchestra.run.smithi052.stdout: "plugin": "jerasure", 2024-04-26T12:05:50.032 INFO:teuthology.orchestra.run.smithi052.stdout: "technique": "reed_sol_van" 2024-04-26T12:05:50.032 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:50.032 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:50.032 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps_queue": [], 2024-04-26T12:05:50.032 INFO:teuthology.orchestra.run.smithi052.stdout: "new_removed_snaps": [], 2024-04-26T12:05:50.033 INFO:teuthology.orchestra.run.smithi052.stdout: "new_purged_snaps": [], 2024-04-26T12:05:50.033 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_node_flags": {}, 2024-04-26T12:05:50.033 INFO:teuthology.orchestra.run.smithi052.stdout: "device_class_flags": {}, 2024-04-26T12:05:50.033 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode": { 2024-04-26T12:05:50.033 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode_enabled": false, 2024-04-26T12:05:50.033 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_bucket_count": 0, 2024-04-26T12:05:50.033 INFO:teuthology.orchestra.run.smithi052.stdout: "degraded_stretch_mode": 0, 2024-04-26T12:05:50.033 INFO:teuthology.orchestra.run.smithi052.stdout: "recovering_stretch_mode": 0, 2024-04-26T12:05:50.033 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode_bucket": 0 2024-04-26T12:05:50.033 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:50.033 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-26T12:05:50.035 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:50.033+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:50.035 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:50.036 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:05:50.036 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-04-26T12:05:50.036 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:50.036 INFO:tasks.thrashosds.thrasher:j is {'epoch': 29, 'fsid': '5bc300ae-e948-4ce3-81bb-5abae8c06799', 'created': '2024-04-26T12:04:41.919527+0000', 'modified': '2024-04-26T12:05:49.883881+0000', 'last_up_change': '2024-04-26T12:04:51.084680+0000', 'last_in_change': '2024-04-26T12:04:43.540390+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:04:52.376506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:04:57.775333+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:05:02.226064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:05:02.758806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '638cfa85-e921-4403-9bcb-a7f4653cc3b2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6800', 'nonce': 28597}, {'type': 'v1', 'addr': '172.21.15.143:6801', 'nonce': 28597}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6802', 'nonce': 28597}, {'type': 'v1', 'addr': '172.21.15.143:6803', 'nonce': 28597}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6806', 'nonce': 28597}, {'type': 'v1', 'addr': '172.21.15.143:6807', 'nonce': 28597}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6804', 'nonce': 28597}, {'type': 'v1', 'addr': '172.21.15.143:6805', 'nonce': 28597}]}, 'public_addr': '172.21.15.143:6801/28597', 'cluster_addr': '172.21.15.143:6803/28597', 'heartbeat_back_addr': '172.21.15.143:6807/28597', 'heartbeat_front_addr': '172.21.15.143:6805/28597', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '2abc8d1e-ad72-4643-ad1e-3566e5113c44', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6800', 'nonce': 28560}, {'type': 'v1', 'addr': '172.21.15.154:6801', 'nonce': 28560}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6802', 'nonce': 28560}, {'type': 'v1', 'addr': '172.21.15.154:6803', 'nonce': 28560}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6806', 'nonce': 28560}, {'type': 'v1', 'addr': '172.21.15.154:6807', 'nonce': 28560}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6804', 'nonce': 28560}, {'type': 'v1', 'addr': '172.21.15.154:6805', 'nonce': 28560}]}, 'public_addr': '172.21.15.154:6801/28560', 'cluster_addr': '172.21.15.154:6803/28560', 'heartbeat_back_addr': '172.21.15.154:6807/28560', 'heartbeat_front_addr': '172.21.15.154:6805/28560', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'd2ebc562-cb9b-4089-a19b-1788b70b57dc', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6800', 'nonce': 28709}, {'type': 'v1', 'addr': '172.21.15.164:6801', 'nonce': 28709}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6802', 'nonce': 28709}, {'type': 'v1', 'addr': '172.21.15.164:6803', 'nonce': 28709}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6806', 'nonce': 28709}, {'type': 'v1', 'addr': '172.21.15.164:6807', 'nonce': 28709}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6804', 'nonce': 28709}, {'type': 'v1', 'addr': '172.21.15.164:6805', 'nonce': 28709}]}, 'public_addr': '172.21.15.164:6801/28709', 'cluster_addr': '172.21.15.164:6803/28709', 'heartbeat_back_addr': '172.21.15.164:6807/28709', 'heartbeat_front_addr': '172.21.15.164:6805/28709', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:04:48.573478+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:04:48.624482+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:04:48.615449+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T12:05:50.037 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-04-26T12:05:50.037 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:50.136 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:50.134+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:50.138 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:50.138 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:05:50.138 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T12:05:50.138 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T12:05:50.139 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:50.147 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:50.237 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:50.236+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:50.290 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:50.291 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T12:05:50.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T12:05:50.291 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T12:05:50.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.291 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:50.291 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:50.291 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.508172235000004, 2024-04-26T12:05:50.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017255857999999999, 2024-04-26T12:05:50.291 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:50.291 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.291 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:50.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:50.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:50.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:50.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:50.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:50.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780340+0000", 2024-04-26T12:05:50.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:50.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:50.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780351+0000", 2024-04-26T12:05:50.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0898e-05 2024-04-26T12:05:50.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:50.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:50.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1671999999999999e-05 2024-04-26T12:05:50.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780374+0000", 2024-04-26T12:05:50.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1117999999999999e-05 2024-04-26T12:05:50.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780423+0000", 2024-04-26T12:05:50.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9066000000000001e-05 2024-04-26T12:05:50.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:50.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780428+0000", 2024-04-26T12:05:50.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1320000000000002e-06 2024-04-26T12:05:50.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788902+0000", 2024-04-26T12:05:50.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084738560000000001 2024-04-26T12:05:50.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:50.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789167+0000", 2024-04-26T12:05:50.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026521100000000001 2024-04-26T12:05:50.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:50.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789279+0000", 2024-04-26T12:05:50.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111616 2024-04-26T12:05:50.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792335+0000", 2024-04-26T12:05:50.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030556419999999999 2024-04-26T12:05:50.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:50.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797519+0000", 2024-04-26T12:05:50.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051841550000000002 2024-04-26T12:05:50.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:50.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797559+0000", 2024-04-26T12:05:50.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0451999999999998e-05 2024-04-26T12:05:50.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:50.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797598+0000", 2024-04-26T12:05:50.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8500000000000001e-05 2024-04-26T12:05:50.297 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.297 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:50.297 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.297 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:50.297 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:50.297 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.508123928000003, 2024-04-26T12:05:50.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017668725, 2024-04-26T12:05:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780395+0000", 2024-04-26T12:05:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.198e-06 2024-04-26T12:05:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780402+0000", 2024-04-26T12:05:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:05:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780408+0000", 2024-04-26T12:05:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780481+0000", 2024-04-26T12:05:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3239999999999997e-05 2024-04-26T12:05:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780485+0000", 2024-04-26T12:05:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4039999999999999e-06 2024-04-26T12:05:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789518+0000", 2024-04-26T12:05:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090335480000000006 2024-04-26T12:05:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789585+0000", 2024-04-26T12:05:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6469000000000003e-05 2024-04-26T12:05:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789699+0000", 2024-04-26T12:05:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114613 2024-04-26T12:05:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793308+0000", 2024-04-26T12:05:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036088520000000001 2024-04-26T12:05:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797887+0000", 2024-04-26T12:05:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0045792790000000003 2024-04-26T12:05:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797955+0000", 2024-04-26T12:05:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T12:05:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798059+0000", 2024-04-26T12:05:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103874 2024-04-26T12:05:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.508093656, 2024-04-26T12:05:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017735145000000001, 2024-04-26T12:05:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780424+0000", 2024-04-26T12:05:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4519999999999999e-06 2024-04-26T12:05:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780431+0000", 2024-04-26T12:05:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0690000000000004e-06 2024-04-26T12:05:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780438+0000", 2024-04-26T12:05:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5719999999999999e-06 2024-04-26T12:05:50.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780468+0000", 2024-04-26T12:05:50.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.993e-05 2024-04-26T12:05:50.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:50.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780472+0000", 2024-04-26T12:05:50.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-04-26T12:05:50.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789916+0000", 2024-04-26T12:05:50.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094434940000000002 2024-04-26T12:05:50.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:50.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790004+0000", 2024-04-26T12:05:50.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8085999999999997e-05 2024-04-26T12:05:50.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:50.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790125+0000", 2024-04-26T12:05:50.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012186200000000001 2024-04-26T12:05:50.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793402+0000", 2024-04-26T12:05:50.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00327685 2024-04-26T12:05:50.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:50.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798068+0000", 2024-04-26T12:05:50.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046652150000000003 2024-04-26T12:05:50.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:50.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798108+0000", 2024-04-26T12:05:50.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0911000000000002e-05 2024-04-26T12:05:50.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:50.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798156+0000", 2024-04-26T12:05:50.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7128e-05 2024-04-26T12:05:50.309 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.309 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:50.309 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.309 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:50.309 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:50.309 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.508070637000003, 2024-04-26T12:05:50.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017792624, 2024-04-26T12:05:50.309 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:50.309 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.309 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:50.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:50.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:50.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:50.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:50.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:50.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:50.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:50.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780447+0000", 2024-04-26T12:05:50.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8519999999999997e-06 2024-04-26T12:05:50.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:50.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780453+0000", 2024-04-26T12:05:50.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2999999999999998e-06 2024-04-26T12:05:50.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:50.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0760000000000002e-06 2024-04-26T12:05:50.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780502+0000", 2024-04-26T12:05:50.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4079999999999998e-05 2024-04-26T12:05:50.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:50.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:50.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5450000000000002e-06 2024-04-26T12:05:50.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790390+0000", 2024-04-26T12:05:50.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098850759999999996 2024-04-26T12:05:50.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:50.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790447+0000", 2024-04-26T12:05:50.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6752999999999997e-05 2024-04-26T12:05:50.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:50.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790547+0000", 2024-04-26T12:05:50.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100344 2024-04-26T12:05:50.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793864+0000", 2024-04-26T12:05:50.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033169749999999998 2024-04-26T12:05:50.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:50.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798164+0000", 2024-04-26T12:05:50.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043000690000000001 2024-04-26T12:05:50.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:50.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798204+0000", 2024-04-26T12:05:50.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9478999999999999e-05 2024-04-26T12:05:50.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:50.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798236+0000", 2024-04-26T12:05:50.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2478999999999999e-05 2024-04-26T12:05:50.315 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.315 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:50.315 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.315 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:50.315 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:50.315 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.508030294000001, 2024-04-26T12:05:50.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016989500000000001, 2024-04-26T12:05:50.315 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:50.315 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.315 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:50.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:50.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:50.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:50.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:50.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:50.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780483+0000", 2024-04-26T12:05:50.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:50.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780488+0000", 2024-04-26T12:05:50.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6260000000000003e-06 2024-04-26T12:05:50.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:50.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780499+0000", 2024-04-26T12:05:50.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1236000000000001e-05 2024-04-26T12:05:50.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:50.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4569999999999996e-06 2024-04-26T12:05:50.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780529+0000", 2024-04-26T12:05:50.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4579e-05 2024-04-26T12:05:50.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:50.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780532+0000", 2024-04-26T12:05:50.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.74e-06 2024-04-26T12:05:50.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788868+0000", 2024-04-26T12:05:50.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0083357650000000002 2024-04-26T12:05:50.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:50.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789142+0000", 2024-04-26T12:05:50.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027472 2024-04-26T12:05:50.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:50.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789241+0000", 2024-04-26T12:05:50.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8394999999999996e-05 2024-04-26T12:05:50.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792096+0000", 2024-04-26T12:05:50.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002855677 2024-04-26T12:05:50.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:50.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797379+0000", 2024-04-26T12:05:50.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052822379999999999 2024-04-26T12:05:50.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:50.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797433+0000", 2024-04-26T12:05:50.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4109e-05 2024-04-26T12:05:50.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:50.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797473+0000", 2024-04-26T12:05:50.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0533e-05 2024-04-26T12:05:50.320 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.321 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:50.321 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.321 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:50.321 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:50.321 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.507990679999999, 2024-04-26T12:05:50.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017295965, 2024-04-26T12:05:50.321 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:50.321 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.321 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:50.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:50.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:50.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:50.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:50.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:50.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780513+0000", 2024-04-26T12:05:50.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999895 2024-04-26T12:05:50.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:50.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780528+0000", 2024-04-26T12:05:50.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5089000000000001e-05 2024-04-26T12:05:50.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:50.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780537+0000", 2024-04-26T12:05:50.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8400000000000001e-06 2024-04-26T12:05:50.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780544+0000", 2024-04-26T12:05:50.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.917e-06 2024-04-26T12:05:50.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780571+0000", 2024-04-26T12:05:50.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7032000000000001e-05 2024-04-26T12:05:50.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:50.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780574+0000", 2024-04-26T12:05:50.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:05:50.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789436+0000", 2024-04-26T12:05:50.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088622240000000001 2024-04-26T12:05:50.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:50.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789525+0000", 2024-04-26T12:05:50.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8549999999999998e-05 2024-04-26T12:05:50.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:50.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789642+0000", 2024-04-26T12:05:50.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011772100000000001 2024-04-26T12:05:50.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792129+0000", 2024-04-26T12:05:50.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024871709999999998 2024-04-26T12:05:50.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:50.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797732+0000", 2024-04-26T12:05:50.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056027580000000002 2024-04-26T12:05:50.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:50.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797777+0000", 2024-04-26T12:05:50.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4620999999999999e-05 2024-04-26T12:05:50.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:50.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797819+0000", 2024-04-26T12:05:50.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2536000000000001e-05 2024-04-26T12:05:50.326 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.326 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:50.327 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.327 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:50.327 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:50.327 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.507961729999998, 2024-04-26T12:05:50.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017840163999999999, 2024-04-26T12:05:50.327 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:50.327 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.327 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:50.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:50.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:50.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:50.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:50.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:50.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:50.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:50.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:50.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5419999999999999e-06 2024-04-26T12:05:50.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:50.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780563+0000", 2024-04-26T12:05:50.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:05:50.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780569+0000", 2024-04-26T12:05:50.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1479999999999997e-06 2024-04-26T12:05:50.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780594+0000", 2024-04-26T12:05:50.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5585e-05 2024-04-26T12:05:50.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:50.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780596+0000", 2024-04-26T12:05:50.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2630000000000002e-06 2024-04-26T12:05:50.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789932+0000", 2024-04-26T12:05:50.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093360479999999996 2024-04-26T12:05:50.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:50.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790070+0000", 2024-04-26T12:05:50.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013771399999999999 2024-04-26T12:05:50.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:50.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790219+0000", 2024-04-26T12:05:50.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014872299999999999 2024-04-26T12:05:50.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793632+0000", 2024-04-26T12:05:50.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003413368 2024-04-26T12:05:50.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:50.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798244+0000", 2024-04-26T12:05:50.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046113819999999998 2024-04-26T12:05:50.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:50.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798361+0000", 2024-04-26T12:05:50.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117726 2024-04-26T12:05:50.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:50.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798393+0000", 2024-04-26T12:05:50.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1099999999999997e-05 2024-04-26T12:05:50.332 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.332 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:50.332 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.333 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:50.333 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:50.333 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.507936805, 2024-04-26T12:05:50.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016645943, 2024-04-26T12:05:50.333 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:50.333 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:50.333 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:50.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:50.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:50.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:50.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:50.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:50.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:50.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:50.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780580+0000", 2024-04-26T12:05:50.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1549999999999999e-06 2024-04-26T12:05:50.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:50.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780588+0000", 2024-04-26T12:05:50.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:05:50.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780593+0000", 2024-04-26T12:05:50.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2399999999999998e-06 2024-04-26T12:05:50.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780628+0000", 2024-04-26T12:05:50.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5426000000000003e-05 2024-04-26T12:05:50.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:50.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780632+0000", 2024-04-26T12:05:50.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:05:50.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788288+0000", 2024-04-26T12:05:50.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076555879999999996 2024-04-26T12:05:50.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:50.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788570+0000", 2024-04-26T12:05:50.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028233700000000002 2024-04-26T12:05:50.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:50.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797223+0000", 2024-04-26T12:05:50.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086529150000000006 2024-04-26T12:05:50.337 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.337 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:50.337 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.337 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:50.337 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:50.337 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.507912836000003, 2024-04-26T12:05:50.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016536068000000001, 2024-04-26T12:05:50.337 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:50.338 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:50.338 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:50.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:50.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:50.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:50.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:50.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:50.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:50.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:50.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780609+0000", 2024-04-26T12:05:50.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8280000000000003e-06 2024-04-26T12:05:50.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:50.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780616+0000", 2024-04-26T12:05:50.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4939999999999997e-06 2024-04-26T12:05:50.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780621+0000", 2024-04-26T12:05:50.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6040000000000003e-06 2024-04-26T12:05:50.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780647+0000", 2024-04-26T12:05:50.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6441999999999999e-05 2024-04-26T12:05:50.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:50.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780650+0000", 2024-04-26T12:05:50.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4430000000000002e-06 2024-04-26T12:05:50.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788163+0000", 2024-04-26T12:05:50.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007513774 2024-04-26T12:05:50.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:50.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788307+0000", 2024-04-26T12:05:50.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014374400000000001 2024-04-26T12:05:50.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:50.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797137+0000", 2024-04-26T12:05:50.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088302160000000001 2024-04-26T12:05:50.341 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.341 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:50.342 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.342 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:50.342 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:50.342 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.505036564000001, 2024-04-26T12:05:50.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012911448000000001, 2024-04-26T12:05:50.342 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:50.342 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.342 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:50.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:50.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:50.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:50.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:50.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:50.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783477+0000", 2024-04-26T12:05:50.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:50.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783482+0000", 2024-04-26T12:05:50.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5709999999999999e-06 2024-04-26T12:05:50.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:50.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783491+0000", 2024-04-26T12:05:50.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3610000000000007e-06 2024-04-26T12:05:50.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783498+0000", 2024-04-26T12:05:50.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4209999999999998e-06 2024-04-26T12:05:50.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786045+0000", 2024-04-26T12:05:50.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0025465739999999998 2024-04-26T12:05:50.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:50.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786061+0000", 2024-04-26T12:05:50.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6348999999999999e-05 2024-04-26T12:05:50.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:50.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796342+0000", 2024-04-26T12:05:50.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010280643000000001 2024-04-26T12:05:50.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:50.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796389+0000", 2024-04-26T12:05:50.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6912000000000001e-05 2024-04-26T12:05:50.346 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.346 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:50.346 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.346 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:50.346 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:50.346 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.505008257999997, 2024-04-26T12:05:50.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013376469, 2024-04-26T12:05:50.346 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:50.346 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.346 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:50.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:50.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:50.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:50.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:50.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:50.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:50.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:50.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783516+0000", 2024-04-26T12:05:50.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.041e-05 2024-04-26T12:05:50.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:50.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783523+0000", 2024-04-26T12:05:50.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5749999999999997e-06 2024-04-26T12:05:50.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783528+0000", 2024-04-26T12:05:50.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5029999999999997e-06 2024-04-26T12:05:50.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787662+0000", 2024-04-26T12:05:50.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041336230000000003 2024-04-26T12:05:50.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:50.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787687+0000", 2024-04-26T12:05:50.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5769999999999999e-05 2024-04-26T12:05:50.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:50.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796817+0000", 2024-04-26T12:05:50.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091296750000000003 2024-04-26T12:05:50.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:50.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796882+0000", 2024-04-26T12:05:50.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5180999999999998e-05 2024-04-26T12:05:50.350 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.350 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:50.350 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.350 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:50.350 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:50.350 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.504939716999999, 2024-04-26T12:05:50.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013457291999999999, 2024-04-26T12:05:50.350 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:50.350 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.351 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:50.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:50.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:50.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:50.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:50.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:50.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:50.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:50.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783578+0000", 2024-04-26T12:05:50.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.659e-06 2024-04-26T12:05:50.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:50.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783584+0000", 2024-04-26T12:05:50.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:50.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783588+0000", 2024-04-26T12:05:50.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6190000000000002e-06 2024-04-26T12:05:50.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787834+0000", 2024-04-26T12:05:50.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042460529999999996 2024-04-26T12:05:50.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:50.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787854+0000", 2024-04-26T12:05:50.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9658999999999999e-05 2024-04-26T12:05:50.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:50.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:50.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009107604 2024-04-26T12:05:50.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:50.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797032+0000", 2024-04-26T12:05:50.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9987000000000006e-05 2024-04-26T12:05:50.354 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.354 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:50.354 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.354 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:50.354 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:50.354 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.503093337999999, 2024-04-26T12:05:50.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011003015999999999, 2024-04-26T12:05:50.355 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:50.355 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.355 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:50.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:50.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:50.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:50.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:50.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:50.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785420+0000", 2024-04-26T12:05:50.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:50.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785427+0000", 2024-04-26T12:05:50.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:05:50.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:50.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785438+0000", 2024-04-26T12:05:50.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069e-05 2024-04-26T12:05:50.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785457+0000", 2024-04-26T12:05:50.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8617000000000001e-05 2024-04-26T12:05:50.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786628+0000", 2024-04-26T12:05:50.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001171418 2024-04-26T12:05:50.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:50.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786651+0000", 2024-04-26T12:05:50.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3289e-05 2024-04-26T12:05:50.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:50.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796393+0000", 2024-04-26T12:05:50.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097413269999999993 2024-04-26T12:05:50.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:50.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796424+0000", 2024-04-26T12:05:50.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1188e-05 2024-04-26T12:05:50.358 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.358 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:50.358 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.358 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:50.358 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:50.358 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.502546592000002, 2024-04-26T12:05:50.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010561432000000001, 2024-04-26T12:05:50.359 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:50.359 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.359 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:50.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:50.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:50.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:50.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:50.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:50.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:50.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:50.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785973+0000", 2024-04-26T12:05:50.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4910000000000002e-06 2024-04-26T12:05:50.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:50.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785991+0000", 2024-04-26T12:05:50.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7663e-05 2024-04-26T12:05:50.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785998+0000", 2024-04-26T12:05:50.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1239999999999999e-06 2024-04-26T12:05:50.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786792+0000", 2024-04-26T12:05:50.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079334800000000003 2024-04-26T12:05:50.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:50.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786810+0000", 2024-04-26T12:05:50.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8746999999999999e-05 2024-04-26T12:05:50.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:50.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796500+0000", 2024-04-26T12:05:50.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096897619999999993 2024-04-26T12:05:50.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:50.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796529+0000", 2024-04-26T12:05:50.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8873999999999998e-05 2024-04-26T12:05:50.362 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.362 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:50.362 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.363 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:50.363 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:50.363 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.502467506000002, 2024-04-26T12:05:50.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010219911, 2024-04-26T12:05:50.363 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:50.363 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.363 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:50.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:50.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:50.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:50.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:50.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:50.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786046+0000", 2024-04-26T12:05:50.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:50.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786053+0000", 2024-04-26T12:05:50.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0360000000000001e-06 2024-04-26T12:05:50.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:50.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786064+0000", 2024-04-26T12:05:50.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1202999999999999e-05 2024-04-26T12:05:50.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786091+0000", 2024-04-26T12:05:50.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6859000000000002e-05 2024-04-26T12:05:50.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786212+0000", 2024-04-26T12:05:50.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120975 2024-04-26T12:05:50.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:50.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786236+0000", 2024-04-26T12:05:50.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4358999999999998e-05 2024-04-26T12:05:50.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:50.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796236+0000", 2024-04-26T12:05:50.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099998050000000005 2024-04-26T12:05:50.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:50.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796266+0000", 2024-04-26T12:05:50.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0278e-05 2024-04-26T12:05:50.366 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.366 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:50.367 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.367 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:3 3.14 e17/15 3:287034c4:::1.00000000.inode:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:50.367 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:50.367 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.501678544999997, 2024-04-26T12:05:50.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009764712, 2024-04-26T12:05:50.367 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:50.367 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.367 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:50.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:50.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:50.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:50.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:50.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:50.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786835+0000", 2024-04-26T12:05:50.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T12:05:50.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:50.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786844+0000", 2024-04-26T12:05:50.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6500000000000008e-06 2024-04-26T12:05:50.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:50.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786855+0000", 2024-04-26T12:05:50.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0932e-05 2024-04-26T12:05:50.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786864+0000", 2024-04-26T12:05:50.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2150000000000007e-06 2024-04-26T12:05:50.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787242+0000", 2024-04-26T12:05:50.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037708300000000001 2024-04-26T12:05:50.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:50.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787259+0000", 2024-04-26T12:05:50.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7258999999999999e-05 2024-04-26T12:05:50.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:50.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796579+0000", 2024-04-26T12:05:50.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093201099999999995 2024-04-26T12:05:50.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:50.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796600+0000", 2024-04-26T12:05:50.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1330000000000001e-05 2024-04-26T12:05:50.371 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.371 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:50.371 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.371 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:50.371 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:50.371 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.501634523, 2024-04-26T12:05:50.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096431940000000008, 2024-04-26T12:05:50.371 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:50.371 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.371 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:50.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:50.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:50.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:50.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:50.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:50.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786879+0000", 2024-04-26T12:05:50.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:50.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786887+0000", 2024-04-26T12:05:50.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9300000000000003e-06 2024-04-26T12:05:50.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:50.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786894+0000", 2024-04-26T12:05:50.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:05:50.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786899+0000", 2024-04-26T12:05:50.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8400000000000002e-06 2024-04-26T12:05:50.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786932+0000", 2024-04-26T12:05:50.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3031999999999998e-05 2024-04-26T12:05:50.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:50.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786945+0000", 2024-04-26T12:05:50.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3421000000000001e-05 2024-04-26T12:05:50.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:50.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796469+0000", 2024-04-26T12:05:50.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095236130000000002 2024-04-26T12:05:50.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:50.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796523+0000", 2024-04-26T12:05:50.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4089999999999999e-05 2024-04-26T12:05:50.375 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.375 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:50.375 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.375 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "pg_update_log_missing(3.14 epoch 17/15 rep_tid 169 entries 17'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:05:50.375 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:50.375 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.501571368, 2024-04-26T12:05:50.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097257639999999996, 2024-04-26T12:05:50.375 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:50.375 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-04-26T12:05:50.375 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:50.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:50.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:50.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:50.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:50.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:50.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786942+0000", 2024-04-26T12:05:50.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:50.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786951+0000", 2024-04-26T12:05:50.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:05:50.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:50.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786965+0000", 2024-04-26T12:05:50.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4268e-05 2024-04-26T12:05:50.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786977+0000", 2024-04-26T12:05:50.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1667e-05 2024-04-26T12:05:50.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787667+0000", 2024-04-26T12:05:50.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00069057400000000001 2024-04-26T12:05:50.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:50.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796668+0000", 2024-04-26T12:05:50.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090013309999999996 2024-04-26T12:05:50.378 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.378 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:50.378 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.378 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:50.379 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:50.379 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.501518224999998, 2024-04-26T12:05:50.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095908309999999993, 2024-04-26T12:05:50.379 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:50.379 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.379 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:50.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:50.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:50.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:50.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:50.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:50.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786995+0000", 2024-04-26T12:05:50.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:50.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787001+0000", 2024-04-26T12:05:50.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5099999999999998e-06 2024-04-26T12:05:50.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:50.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787009+0000", 2024-04-26T12:05:50.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9100000000000005e-06 2024-04-26T12:05:50.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787019+0000", 2024-04-26T12:05:50.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8109999999999997e-06 2024-04-26T12:05:50.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787136+0000", 2024-04-26T12:05:50.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011749899999999999 2024-04-26T12:05:50.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:50.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787154+0000", 2024-04-26T12:05:50.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8278999999999999e-05 2024-04-26T12:05:50.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:50.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796561+0000", 2024-04-26T12:05:50.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094064379999999996 2024-04-26T12:05:50.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:50.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796587+0000", 2024-04-26T12:05:50.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5856000000000001e-05 2024-04-26T12:05:50.382 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.382 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:50.382 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.382 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:50.383 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:50.383 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.500801168000002, 2024-04-26T12:05:50.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096460160000000003, 2024-04-26T12:05:50.383 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:50.383 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.383 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:50.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:50.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:50.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:50.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:50.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:50.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:50.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787712+0000", 2024-04-26T12:05:50.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:50.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787718+0000", 2024-04-26T12:05:50.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:05:50.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:50.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787727+0000", 2024-04-26T12:05:50.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.123e-06 2024-04-26T12:05:50.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787734+0000", 2024-04-26T12:05:50.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.391e-06 2024-04-26T12:05:50.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:50.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788867+0000", 2024-04-26T12:05:50.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001133207 2024-04-26T12:05:50.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:50.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788899+0000", 2024-04-26T12:05:50.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1526000000000003e-05 2024-04-26T12:05:50.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:50.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797328+0000", 2024-04-26T12:05:50.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084295389999999998 2024-04-26T12:05:50.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:50.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:50.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:50.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797359+0000", 2024-04-26T12:05:50.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0660999999999997e-05 2024-04-26T12:05:50.386 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.386 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:50.386 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.386 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:50.386 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:50.387 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:50.388 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:50.387+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:50.388 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:50.489 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:50.488+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:50.502 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:50.502 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:05:50.503 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:05:50.503 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:50.512 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:50.590 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:50.589+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:50.614 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:50.614 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:05:50.614 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:05:50.614 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:05:50.614 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:50.624 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:50.691 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:50.691+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:50.727 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:50.727 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:05:50.728 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:05:50.728 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:05:50.728 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.728 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:50.728 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:50.728 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 56.870294887, 2024-04-26T12:05:50.728 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:05:50.728 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:50.728 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.728 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:50.728 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:50.728 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:50.729 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:05:50.729 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.729 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:50.729 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.729 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:50.729 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:50.729 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.729 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.729 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.729 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:50.729 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:50.729 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.730 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.730 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.730 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:50.730 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:50.730 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.730 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:50.731 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:05:50.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:05:50.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:50.731 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:05:50.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:05:50.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.732 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:05:50.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:05:50.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.732 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:50.732 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:05:50.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:05:50.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.732 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:50.732 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:05:50.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:05:50.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:50.733 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:05:50.733 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:05:50.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:50.733 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:05:50.733 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:05:50.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.734 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:05:50.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:05:50.734 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.734 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.734 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:50.734 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:05:50.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:05:50.734 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.734 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.734 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:50.734 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:05:50.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:05:50.735 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.735 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:50.735 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.735 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.735 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:50.735 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:50.735 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 56.870188990999999, 2024-04-26T12:05:50.735 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:05:50.735 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:50.735 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.735 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:50.736 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:50.736 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:50.736 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:05:50.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.736 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:50.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.736 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:50.736 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:50.736 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.736 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:50.736 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:50.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:50.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:50.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:50.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:05:50.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:05:50.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.738 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:50.738 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:05:50.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:05:50.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.738 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.738 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.738 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:05:50.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:05:50.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.739 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.739 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:50.739 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:05:50.739 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:05:50.739 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.739 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.739 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:50.739 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:05:50.739 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:05:50.739 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.739 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.739 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:50.740 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:05:50.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:05:50.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.740 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.740 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:50.740 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:05:50.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:05:50.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.740 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.740 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.740 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:05:50.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:05:50.741 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.741 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.741 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:50.741 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:05:50.741 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:05:50.741 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.741 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.741 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:50.741 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:05:50.741 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:05:50.741 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.741 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:50.741 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.742 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.742 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.742 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:50.742 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:50.742 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 56.870174011000003, 2024-04-26T12:05:50.742 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:05:50.742 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:50.742 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.742 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:50.742 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:50.742 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:50.742 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:05:50.742 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.743 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:50.743 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.743 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:50.743 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:50.743 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.743 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.743 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.743 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:50.743 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:50.743 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.743 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.743 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.744 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:50.744 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:50.744 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.744 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.744 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.744 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:50.744 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:05:50.744 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:05:50.744 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.744 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.745 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:50.745 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:05:50.745 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:05:50.745 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.745 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.745 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.745 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:05:50.745 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:05:50.745 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.745 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.745 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:50.746 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:05:50.746 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:05:50.746 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.746 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.746 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:50.746 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:05:50.746 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:05:50.746 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.746 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.746 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:50.746 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:05:50.746 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:05:50.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.747 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:50.747 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:05:50.747 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:05:50.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.747 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.747 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:05:50.747 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:05:50.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.748 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:50.748 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:05:50.748 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:05:50.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.748 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.748 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:50.748 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:05:50.748 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:05:50.748 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.748 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:50.748 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.748 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.749 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:50.749 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:50.749 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 56.870130136, 2024-04-26T12:05:50.749 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:05:50.749 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:50.749 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.749 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:50.749 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:50.749 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:50.749 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:05:50.749 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.749 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:50.750 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.750 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:50.750 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:50.750 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.750 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.750 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.750 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:50.750 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:50.750 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.750 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.750 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.750 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:50.750 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:50.751 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.751 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.751 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:50.751 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:05:50.751 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:05:50.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.751 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.751 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:50.751 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:05:50.751 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:05:50.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.751 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.752 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.752 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:05:50.752 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:05:50.752 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.752 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.752 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:50.752 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:05:50.752 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:05:50.752 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.752 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.752 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:50.752 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:05:50.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:05:50.753 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.753 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:50.753 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:05:50.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:05:50.753 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.753 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:50.753 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:05:50.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:05:50.753 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.754 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.754 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:05:50.754 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:05:50.754 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.754 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.754 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:50.754 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:05:50.754 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:05:50.754 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.754 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.754 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:50.754 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:05:50.754 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:05:50.755 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.755 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:50.755 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.755 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.755 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:50.755 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:50.755 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 56.870044472000004, 2024-04-26T12:05:50.755 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:05:50.755 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:50.755 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.755 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:50.755 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:50.756 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:50.756 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:05:50.756 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.756 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:50.756 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.756 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:50.756 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:50.756 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.756 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.756 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.756 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:50.756 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:50.756 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.757 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.757 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.757 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:50.757 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:50.757 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.757 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.757 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.757 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:50.757 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:05:50.757 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:05:50.757 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.757 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.758 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:50.758 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:05:50.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:05:50.758 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.758 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.758 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.758 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:05:50.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:05:50.758 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.758 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.758 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:50.758 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:05:50.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:05:50.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.759 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:50.759 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:05:50.759 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:05:50.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.759 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:50.759 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:05:50.759 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:05:50.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:50.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:05:50.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:05:50.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:05:50.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:05:50.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:50.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:05:50.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:05:50.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.761 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:50.761 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:05:50.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:05:50.761 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.761 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:50.761 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.761 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:50.761 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:50.761 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 46.944140185999998, 2024-04-26T12:05:50.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:05:50.762 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:50.762 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.762 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:50.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.762 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:50.762 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:50.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.762 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.762 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:50.762 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:50.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.763 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.763 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:50.763 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:50.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:50.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.763 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.763 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:50.763 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:05:50.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:05:50.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.763 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.764 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:50.764 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:05:50.764 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:05:50.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.764 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.764 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:05:50.764 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:05:50.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.764 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:50.764 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:05:50.764 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:05:50.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:50.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:05:50.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:05:50.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:50.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:05:50.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:05:50.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:50.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:05:50.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:05:50.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:05:50.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:05:50.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:50.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:05:50.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:05:50.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:50.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:05:50.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:05:50.767 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.767 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:50.767 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.767 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:50.767 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:50.767 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 46.944104091, 2024-04-26T12:05:50.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:05:50.768 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:50.768 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.768 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:50.768 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.768 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:50.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:50.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.768 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.768 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:50.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:50.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.769 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:50.769 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:05:50.769 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:50.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.769 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:50.769 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:05:50.769 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:05:50.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.769 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:50.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:05:50.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:05:50.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:05:50.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:05:50.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:50.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:05:50.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:05:50.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:50.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:05:50.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:05:50.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:50.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:05:50.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:05:50.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:50.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:05:50.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:05:50.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:05:50.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:05:50.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:50.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:05:50.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:05:50.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:50.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:05:50.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:05:50.773 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.773 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:50.773 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.773 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:50.773 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:50.773 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 46.944066407000001, 2024-04-26T12:05:50.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:05:50.774 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:50.774 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.774 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:50.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:50.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:50.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:50.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:50.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:50.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:05:50.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:50.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:05:50.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:05:50.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:50.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:05:50.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:05:50.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:05:50.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:05:50.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:50.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:05:50.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:05:50.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:50.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:50.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:05:50.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:50.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:05:50.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:05:50.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:50.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:05:50.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:05:50.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:05:50.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:05:50.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:50.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:05:50.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:05:50.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.779 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:50.779 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:05:50.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:05:50.779 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.779 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:50.779 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.779 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.779 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:50.779 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:50.779 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 46.944045066999998, 2024-04-26T12:05:50.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:05:50.779 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:50.780 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.780 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:50.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.780 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:50.780 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:50.780 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.780 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.780 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:50.780 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:50.780 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.780 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:50.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:50.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:50.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:05:50.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:50.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:50.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:05:50.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:05:50.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:05:50.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:05:50.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:50.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:05:50.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:05:50.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:50.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:05:50.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:05:50.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:50.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:05:50.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:05:50.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:50.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:05:50.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:05:50.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.784 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.784 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:05:50.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:05:50.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.784 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:50.784 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:05:50.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:05:50.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.784 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:50.784 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:05:50.785 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:05:50.785 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.785 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:50.785 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.785 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.785 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.785 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:50.785 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:50.785 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 46.944022801000003, 2024-04-26T12:05:50.785 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:05:50.785 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:50.785 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.786 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:50.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.786 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:50.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:50.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.786 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.786 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:50.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:50.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.786 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.786 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:50.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:50.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:50.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:05:50.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:50.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:50.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:05:50.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:05:50.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:05:50.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:05:50.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:50.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:05:50.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:05:50.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:50.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:05:50.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:05:50.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.789 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.789 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:50.789 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:05:50.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:05:50.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.789 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.789 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:50.789 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:05:50.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:05:50.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.789 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.790 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.790 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:05:50.790 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:05:50.790 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.790 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.790 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:50.790 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:05:50.790 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:05:50.790 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.790 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.790 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:50.790 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:05:50.791 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:05:50.791 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.791 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:50.791 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.791 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.791 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.791 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:50.791 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:50.791 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 46.944001178999997, 2024-04-26T12:05:50.791 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:05:50.791 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:50.791 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.791 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:50.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:50.792 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:50.792 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.792 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:50.792 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:50.792 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.792 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:50.792 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:50.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:50.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:05:50.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:05:50.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:50.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:05:50.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:05:50.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.794 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.794 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:05:50.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:05:50.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.794 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:50.794 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:05:50.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:05:50.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.794 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:50.794 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:05:50.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:05:50.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.795 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.795 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:50.795 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:05:50.795 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:05:50.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.795 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.795 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:50.795 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:05:50.795 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:05:50.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.795 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.795 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.796 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:05:50.796 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:05:50.796 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.796 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.796 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:50.796 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:05:50.796 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:05:50.796 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.796 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.796 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:50.796 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:05:50.796 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:05:50.796 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.797 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:50.797 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.797 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.797 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:50.797 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:50.797 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 46.943974613000002, 2024-04-26T12:05:50.797 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:05:50.797 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:50.797 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.797 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:50.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.797 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:50.798 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:50.798 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.798 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.798 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.798 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:50.798 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:50.798 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.798 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.798 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.798 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:50.798 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:05:50.798 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.799 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.799 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.799 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:50.799 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:05:50.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:05:50.799 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.799 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.799 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:50.799 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:05:50.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:05:50.799 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.799 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.799 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:05:50.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:05:50.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:50.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:05:50.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:05:50.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:50.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:05:50.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:05:50.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:50.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:05:50.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:05:50.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:50.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:05:50.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:05:50.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:05:50.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:05:50.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:50.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:05:50.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:05:50.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:50.803 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:05:50.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:05:50.803 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.803 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:50.803 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.803 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.803 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.803 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:50.803 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:50.803 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 46.943936100999998, 2024-04-26T12:05:50.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:05:50.803 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:50.804 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.804 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:50.804 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.804 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:50.804 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:50.804 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.804 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.804 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.804 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:50.804 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:50.804 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.804 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.804 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.805 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:50.805 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:50.805 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.805 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.805 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.805 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:50.805 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:05:50.805 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:05:50.805 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.805 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.805 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:50.805 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:05:50.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:05:50.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:05:50.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:05:50.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:50.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:05:50.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:05:50.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:50.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:05:50.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:05:50.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:50.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:05:50.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:05:50.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:50.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:05:50.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:05:50.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.808 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.808 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.808 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:05:50.808 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:05:50.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.808 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.808 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:50.808 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:05:50.808 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:05:50.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.808 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.808 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:50.809 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:05:50.809 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:05:50.809 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.809 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:50.809 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.809 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.809 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.809 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:50.809 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:50.809 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 46.943907928000002, 2024-04-26T12:05:50.809 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:05:50.809 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:50.809 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.810 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:50.810 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.810 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:50.810 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:50.810 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.810 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.810 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.810 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:50.810 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:50.810 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.810 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.810 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.811 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:50.811 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:50.811 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.811 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.811 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.811 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:50.811 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:05:50.811 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:05:50.811 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.811 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.811 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:50.811 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:05:50.811 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:05:50.812 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:05:50.812 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:05:50.812 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:50.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:05:50.812 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:05:50.812 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:50.813 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:05:50.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:05:50.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:50.813 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:05:50.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:05:50.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:50.813 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:05:50.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:05:50.814 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.814 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.814 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.814 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:05:50.814 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:05:50.814 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.814 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.814 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:50.814 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:05:50.814 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:05:50.814 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.814 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.815 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:50.815 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:05:50.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:05:50.815 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.815 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:50.815 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.815 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.815 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.815 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:50.815 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:50.815 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 46.943873363999998, 2024-04-26T12:05:50.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:05:50.816 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:50.816 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.816 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:50.816 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.816 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:50.816 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:50.816 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.816 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.816 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.817 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:50.817 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:50.817 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.817 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.817 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.817 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:50.817 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:05:50.817 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.817 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.817 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.817 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:50.817 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:05:50.818 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:05:50.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.818 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.818 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:50.818 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:05:50.818 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:05:50.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.818 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.818 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.818 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:05:50.818 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:05:50.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:50.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:05:50.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:05:50.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:50.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:05:50.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:05:50.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.820 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:50.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:05:50.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:05:50.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.820 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:50.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:05:50.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:05:50.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:05:50.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:05:50.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.821 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:50.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:50.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:05:50.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.821 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:50.822 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:05:50.822 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:05:50.822 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.822 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:50.822 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.822 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.822 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:50.822 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:50.822 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 46.942998584000001, 2024-04-26T12:05:50.822 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:05:50.822 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:50.823 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.823 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:50.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.823 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:50.823 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:50.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.823 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:50.823 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:50.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:50.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:05:50.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:50.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:50.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:05:50.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:05:50.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:50.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:05:50.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:05:50.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:05:50.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:05:50.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:50.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:05:50.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:05:50.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:50.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:05:50.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:05:50.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:50.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:05:50.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:05:50.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:50.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:05:50.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:05:50.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:05:50.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:05:50.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:50.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:05:50.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:05:50.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.828 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.828 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:50.828 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:05:50.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:05:50.828 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.828 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:50.828 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.828 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.828 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:50.828 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:50.829 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 46.942959625, 2024-04-26T12:05:50.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:05:50.829 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:50.829 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.829 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:50.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.829 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:50.829 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:50.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:50.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:50.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:50.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:05:50.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:50.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:05:50.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:05:50.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:50.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:05:50.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:05:50.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:05:50.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:05:50.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:50.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:05:50.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:05:50.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:50.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:05:50.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:05:50.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:50.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:05:50.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:05:50.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:50.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:05:50.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:05:50.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:05:50.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:05:50.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.834 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:50.834 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:05:50.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:05:50.834 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.834 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:50.834 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:05:50.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:05:50.834 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.834 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:50.834 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.835 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.835 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.835 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:50.835 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:50.835 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 46.942924153, 2024-04-26T12:05:50.835 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:05:50.835 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:50.835 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.835 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:50.835 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.835 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:50.835 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:50.836 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.836 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.836 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.836 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:50.836 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:50.836 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.836 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.836 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.836 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:50.836 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:50.836 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:50.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:50.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:05:50.837 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:05:50.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:50.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:05:50.837 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:05:50.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:05:50.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:05:50.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.838 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.838 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:50.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:05:50.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:05:50.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.838 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.838 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:50.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:05:50.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:05:50.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.839 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:50.839 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:05:50.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:05:50.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.839 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:50.839 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:05:50.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:05:50.840 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.840 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:05:50.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:05:50.840 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:50.840 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:05:50.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:05:50.840 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.841 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:50.841 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:05:50.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:05:50.841 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.841 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:50.841 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.841 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:50.841 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:50.841 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 46.942845464000001, 2024-04-26T12:05:50.842 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:05:50.842 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:50.842 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:50.842 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:50.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.842 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:50.842 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:50.842 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.842 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.842 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:50.842 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:50.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.843 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:50.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:05:50.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:50.843 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:50.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:05:50.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:05:50.843 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:50.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:05:50.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:05:50.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:05:50.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:05:50.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:50.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:05:50.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:05:50.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:50.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:05:50.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:05:50.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:50.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:05:50.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:05:50.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:50.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:05:50.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:05:50.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:50.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:05:50.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:05:50.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.847 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:50.847 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:05:50.847 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:05:50.847 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.847 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.847 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:50.847 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:05:50.847 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:05:50.847 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.847 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:50.847 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.847 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.848 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:50.848 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:50.848 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 46.942694615999997, 2024-04-26T12:05:50.848 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:05:50.848 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:50.848 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:05:50.848 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:50.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.848 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:50.848 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:50.848 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:50.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:50.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:50.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:50.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:05:50.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:50.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.850 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:50.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:05:50.850 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:05:50.850 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.850 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:50.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:05:50.850 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:05:50.850 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.850 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:50.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:05:50.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:05:50.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.851 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.851 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:50.851 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:05:50.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:05:50.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.851 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.851 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:50.851 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:50.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:05:50.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:50.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:50.852 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:50.852 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:05:50.852 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:05:50.852 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.852 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:50.852 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.852 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:50.852 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:50.852 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:50.854 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:50.853+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:50.854 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:50.954 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:50.954+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:50.969 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:50.969 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:50.969 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:05:50.969 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:50.978 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:51.055 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:51.054+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:51.079 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:51.079 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:51.079 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:05:51.079 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:05:51.079 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:51.087 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:51.156 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:51.155+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:51.190 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:51.191 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:05:51.191 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:05:51.191 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:05:51.191 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.191 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:51.191 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:51.191 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 47.408434634999999, 2024-04-26T12:05:51.191 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:05:51.191 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:51.191 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:51.191 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:51.191 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:05:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.193 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:51.193 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:05:51.193 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:05:51.193 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.193 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.193 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:51.193 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:05:51.193 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:05:51.193 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.193 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.193 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:51.193 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:05:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:05:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:05:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:05:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:05:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:05:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:05:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:05:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:05:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:05:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:05:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.196 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:51.196 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:05:51.196 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:05:51.196 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.196 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.197 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:51.197 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:05:51.197 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:05:51.197 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.197 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:51.197 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.197 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.197 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 47.408379314999998, 2024-04-26T12:05:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:05:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:51.199 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:51.199 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.199 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.199 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.199 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:51.199 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:05:51.199 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:51.199 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.199 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.199 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:05:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:05:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:05:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:05:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:05:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:05:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:05:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:05:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:05:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:05:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:05:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:05:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:05:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:05:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:05:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:05:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:05:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:05:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:05:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:05:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 47.408329297000002, 2024-04-26T12:05:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:05:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:05:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:05:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:05:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:05:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:05:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:05:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:05:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:05:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:05:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:05:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:05:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:05:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:05:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:05:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:05:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:05:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:05:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:05:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:05:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:05:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:05:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.209 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.209 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:51.209 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:51.209 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 47.408294660000003, 2024-04-26T12:05:51.209 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:05:51.209 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:51.209 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:51.209 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:51.209 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.209 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:51.210 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:51.210 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.210 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.210 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.210 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:51.210 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:51.210 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.210 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.210 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.210 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:51.211 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:05:51.211 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:51.211 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.211 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.211 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:51.211 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:05:51.211 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:05:51.211 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.211 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.211 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:05:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:05:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:05:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:05:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:05:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:05:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:05:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:05:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:05:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:05:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:05:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:05:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:05:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:05:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:05:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:05:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:05:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.215 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:51.215 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.215 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.215 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.215 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:51.215 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:51.215 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 47.408256148, 2024-04-26T12:05:51.215 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:05:51.215 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:51.215 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:51.215 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:51.215 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.215 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:51.215 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:05:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:05:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:05:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:05:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:05:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:05:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:05:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:05:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:05:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:05:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:05:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:05:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:05:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:05:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:05:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:05:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:05:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.220 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:51.220 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:05:51.220 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:05:51.220 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.220 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:51.220 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.220 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.220 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.220 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:51.220 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 47.408225825000002, 2024-04-26T12:05:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:05:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:05:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:05:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:05:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:05:51.223 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.223 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.223 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:51.223 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:05:51.223 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:05:51.223 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.223 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.223 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:51.223 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:05:51.223 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:05:51.223 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.223 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.223 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:05:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:05:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:05:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:05:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:05:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:05:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:05:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:05:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:05:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:05:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:05:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:05:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 47.408199123000003, 2024-04-26T12:05:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:05:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:05:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:05:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:05:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:05:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:05:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:05:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:05:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:05:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:05:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:05:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:05:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:05:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 47.408156833, 2024-04-26T12:05:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:05:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:05:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:05:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:05:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:05:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:05:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:05:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:05:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:05:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:05:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:05:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:05:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:05:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:51.234 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:51.234 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 47.408128755, 2024-04-26T12:05:51.234 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:05:51.234 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:51.234 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:51.234 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:51.234 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.234 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:51.234 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:51.234 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:05:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:05:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:05:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:05:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:05:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:05:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:05:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:05:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:05:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:05:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:05:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 47.402133405000001, 2024-04-26T12:05:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:05:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:05:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:05:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:05:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:05:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:05:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:05:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:05:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:05:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:05:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:05:51.241 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:05:51.241 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.241 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.241 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:51.241 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:05:51.241 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:05:51.241 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.241 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.241 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:51.241 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:05:51.241 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:05:51.242 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.242 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:51.242 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.242 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.242 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.242 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:51.242 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:51.242 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 47.402064439, 2024-04-26T12:05:51.242 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:05:51.242 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:51.242 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:51.243 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:51.243 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.243 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:51.243 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:51.243 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.243 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.243 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.243 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:51.243 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:51.243 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.243 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:05:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:05:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:05:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:05:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:05:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:05:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:05:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:05:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:05:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:05:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.246 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.246 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:51.246 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:05:51.246 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:05:51.246 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.246 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.246 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:51.246 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:05:51.246 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:05:51.246 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.246 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:51.246 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.246 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 47.401570075999999, 2024-04-26T12:05:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:05:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:05:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:05:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:05:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:05:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:05:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:05:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:05:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:05:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:05:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:05:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:05:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:05:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:05:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:05:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 47.401531810999998, 2024-04-26T12:05:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:05:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:51.252 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:51.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.252 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:51.252 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:51.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.252 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:51.252 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:51.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:51.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:05:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:05:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:05:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:05:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:05:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:05:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:05:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:05:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:05:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:05:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:05:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:05:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:05:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:05:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:05:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 47.400851926000001, 2024-04-26T12:05:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:05:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:05:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:05:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:05:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:05:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:05:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:05:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:05:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:05:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:05:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:05:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 47.400822746999999, 2024-04-26T12:05:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:05:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:05:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:05:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:05:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:05:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:05:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:05:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:05:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:05:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:05:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:05:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:05:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:05:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:05:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 47.400790936, 2024-04-26T12:05:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:05:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:05:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:05:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:05:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:05:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:05:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:05:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:05:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:05:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:05:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:05:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:05:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:05:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:05:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 47.400769580000002, 2024-04-26T12:05:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:05:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:05:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:05:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:05:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:05:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:05:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:05:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:05:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:05:51.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:05:51.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:51.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:05:51.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:05:51.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:51.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:05:51.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:05:51.270 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.270 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:51.271 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.271 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:05:51.271 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:51.271 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 47.400741127000003, 2024-04-26T12:05:51.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:05:51.271 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:51.272 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:51.272 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:51.272 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.272 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:51.272 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:51.273 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.273 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.273 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.273 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:51.273 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:51.273 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.274 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.274 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.274 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:51.274 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:51.274 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:51.274 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.275 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.278 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:51.278 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:05:51.278 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:05:51.278 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.278 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.278 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:51.278 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:05:51.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:05:51.279 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.279 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.279 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:51.279 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:05:51.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:05:51.279 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.279 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.279 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:51.279 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:05:51.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:05:51.280 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.280 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.280 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:51.280 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:05:51.280 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:05:51.280 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.280 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:51.280 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.280 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.280 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.280 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:05:51.280 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:51.280 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 47.400019321000002, 2024-04-26T12:05:51.280 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:05:51.280 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:51.281 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:51.281 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:51.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.281 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:51.281 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:51.281 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.281 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.281 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:51.281 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:51.281 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.281 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.281 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:51.281 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:05:51.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:51.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:51.282 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:05:51.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:05:51.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:51.282 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:05:51.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:05:51.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:51.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:05:51.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:05:51.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:51.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:05:51.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:05:51.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:51.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:05:51.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:05:51.283 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.283 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:51.284 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.284 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.284 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:05:51.284 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:51.284 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 41.683092717999997, 2024-04-26T12:05:51.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:05:51.284 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:51.284 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:51.284 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:51.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.284 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:51.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:51.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.284 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.285 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:51.285 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:51.285 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:51.285 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.285 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:51.285 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:05:51.285 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:05:51.285 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.285 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:51.285 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:05:51.285 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:05:51.286 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.286 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.286 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:51.286 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:05:51.286 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:05:51.286 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.286 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.286 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:51.286 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:05:51.286 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:05:51.286 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.286 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.286 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:51.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:05:51.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:05:51.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:51.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:05:51.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:05:51.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:51.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:05:51.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:05:51.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:51.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:05:51.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:05:51.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:51.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:05:51.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:05:51.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:51.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:05:51.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:05:51.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:51.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:51.289 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:51.289 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:05:51.289 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:05:51.289 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.289 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:51.289 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.289 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:51.289 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:51.289 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:51.290 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:05:51.292 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:51.291+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:51.293 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:51.393 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:51.392+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:51.407 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:51.408 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:05:51.408 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-04-26T12:05:51.408 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:51.417 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:51.427 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:05:51.427 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:05:51.445 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T12:05:51.445 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:05:51.463 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:05:51.463 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:05:51.494 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:51.493+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:51.520 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:51.520 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:51.529 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:51.595 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:51.595+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:51.670 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:51.670 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:51.680 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:51.696 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:51.695+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:51.797 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:51.796+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:51.797 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:51.797 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:51.807 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:51.898 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:51.897+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:51.906 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:05:51.950 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:51.950 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:51.958 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:51.999 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:51.998+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:52.060 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:52.060 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:52.069 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:52.100 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:52.099+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:52.179 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:52.179 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:52.189 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:52.201 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:52.200+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:52.289 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:52.289 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:52.299 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:52.302 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:52.300+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:52.400 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:52.401 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:52.403 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:52.402+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:52.409 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:52.504 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:52.503+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:52.513 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:52.513 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:52.521 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:52.605 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:52.604+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:52.623 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:52.623 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:52.632 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:52.707 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:52.706+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:52.733 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:52.733 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:52.742 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:52.808 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:52.807+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:52.851 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:52.851 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:52.860 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:52.902 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-26T12:05:52.908 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:52.907+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:52.962 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:52.962 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:52.970 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:53.014 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:53.013+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:53.072 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:53.072 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:53.081 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:53.124 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:53.123+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:53.185 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:53.186 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:53.194 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:53.212 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:53.211+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:53.312 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:53.311+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:53.335 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:53.336 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:53.344 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:53.429 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:53.428+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:53.474 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:05:53.487 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:53.488 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:53.496 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:53.541 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:53.540+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:53.602 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:53.602 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:53.609 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:05:53.610 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:05:53.611 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:53.616 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:53.614+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:53.628 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T12:05:53.628 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:05:53.645 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:05:53.645 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:05:53.717 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:53.716+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:53.752 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:53.752 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:05:53.752 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T12:05:53.752 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T12:05:53.752 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:53.761 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:53.817 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:53.817+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:53.863 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:53.864 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T12:05:53.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T12:05:53.864 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T12:05:53.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.864 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:53.864 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:53.864 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.081220551999998, 2024-04-26T12:05:53.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017255857999999999, 2024-04-26T12:05:53.864 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:53.864 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:53.864 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:53.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.864 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:53.864 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:53.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:53.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:53.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:53.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780340+0000", 2024-04-26T12:05:53.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:53.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:53.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780351+0000", 2024-04-26T12:05:53.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0898e-05 2024-04-26T12:05:53.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:53.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:53.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1671999999999999e-05 2024-04-26T12:05:53.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:53.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780374+0000", 2024-04-26T12:05:53.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1117999999999999e-05 2024-04-26T12:05:53.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780423+0000", 2024-04-26T12:05:53.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9066000000000001e-05 2024-04-26T12:05:53.867 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:53.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780428+0000", 2024-04-26T12:05:53.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1320000000000002e-06 2024-04-26T12:05:53.867 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788902+0000", 2024-04-26T12:05:53.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084738560000000001 2024-04-26T12:05:53.867 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.868 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:53.868 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789167+0000", 2024-04-26T12:05:53.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026521100000000001 2024-04-26T12:05:53.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.868 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:53.868 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789279+0000", 2024-04-26T12:05:53.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111616 2024-04-26T12:05:53.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.868 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:53.868 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792335+0000", 2024-04-26T12:05:53.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030556419999999999 2024-04-26T12:05:53.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:53.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797519+0000", 2024-04-26T12:05:53.869 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051841550000000002 2024-04-26T12:05:53.869 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:53.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797559+0000", 2024-04-26T12:05:53.869 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0451999999999998e-05 2024-04-26T12:05:53.869 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:53.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797598+0000", 2024-04-26T12:05:53.869 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8500000000000001e-05 2024-04-26T12:05:53.869 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.869 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:53.870 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.870 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:53.870 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:53.870 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.081172244999998, 2024-04-26T12:05:53.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017668725, 2024-04-26T12:05:53.870 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:53.870 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:53.870 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:53.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.870 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:53.870 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:53.871 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.871 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:53.871 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:53.871 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.871 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:53.871 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:53.871 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:53.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.871 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:53.871 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780395+0000", 2024-04-26T12:05:53.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.198e-06 2024-04-26T12:05:53.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.872 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:53.872 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780402+0000", 2024-04-26T12:05:53.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:05:53.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.872 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:53.872 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780408+0000", 2024-04-26T12:05:53.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:53.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.872 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.873 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780481+0000", 2024-04-26T12:05:53.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3239999999999997e-05 2024-04-26T12:05:53.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.873 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:53.873 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780485+0000", 2024-04-26T12:05:53.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4039999999999999e-06 2024-04-26T12:05:53.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.873 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.873 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789518+0000", 2024-04-26T12:05:53.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090335480000000006 2024-04-26T12:05:53.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.873 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:53.874 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789585+0000", 2024-04-26T12:05:53.874 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6469000000000003e-05 2024-04-26T12:05:53.874 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.874 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.874 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:53.874 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789699+0000", 2024-04-26T12:05:53.874 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114613 2024-04-26T12:05:53.874 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.874 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.874 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:53.874 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793308+0000", 2024-04-26T12:05:53.874 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036088520000000001 2024-04-26T12:05:53.874 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.874 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.875 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:53.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797887+0000", 2024-04-26T12:05:53.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0045792790000000003 2024-04-26T12:05:53.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.875 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:53.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797955+0000", 2024-04-26T12:05:53.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T12:05:53.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.875 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:53.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798059+0000", 2024-04-26T12:05:53.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103874 2024-04-26T12:05:53.876 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.876 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:53.876 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.876 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:53.876 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:53.877 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.081141973000001, 2024-04-26T12:05:53.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017735145000000001, 2024-04-26T12:05:53.877 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:53.877 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:53.877 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:53.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:53.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:53.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:53.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:53.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:53.879 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:53.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:53.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:53.880 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780424+0000", 2024-04-26T12:05:53.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4519999999999999e-06 2024-04-26T12:05:53.880 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.880 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.880 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:53.880 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780431+0000", 2024-04-26T12:05:53.881 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0690000000000004e-06 2024-04-26T12:05:53.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.881 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.881 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:53.881 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780438+0000", 2024-04-26T12:05:53.881 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5719999999999999e-06 2024-04-26T12:05:53.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.882 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.882 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780468+0000", 2024-04-26T12:05:53.882 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.993e-05 2024-04-26T12:05:53.882 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.882 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:53.883 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780472+0000", 2024-04-26T12:05:53.883 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-04-26T12:05:53.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.883 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.883 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789916+0000", 2024-04-26T12:05:53.883 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094434940000000002 2024-04-26T12:05:53.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:53.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790004+0000", 2024-04-26T12:05:53.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8085999999999997e-05 2024-04-26T12:05:53.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:53.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790125+0000", 2024-04-26T12:05:53.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012186200000000001 2024-04-26T12:05:53.885 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:53.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793402+0000", 2024-04-26T12:05:53.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00327685 2024-04-26T12:05:53.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.886 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:53.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798068+0000", 2024-04-26T12:05:53.886 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046652150000000003 2024-04-26T12:05:53.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.887 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:53.887 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798108+0000", 2024-04-26T12:05:53.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0911000000000002e-05 2024-04-26T12:05:53.887 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.887 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:53.887 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798156+0000", 2024-04-26T12:05:53.888 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7128e-05 2024-04-26T12:05:53.888 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.888 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:53.888 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.888 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:53.888 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:53.888 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.081118953999997, 2024-04-26T12:05:53.888 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017792624, 2024-04-26T12:05:53.889 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:53.889 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:53.889 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:53.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.889 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:53.889 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:53.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.889 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:53.889 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:53.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:53.890 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:53.890 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:53.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:53.890 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780447+0000", 2024-04-26T12:05:53.890 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8519999999999997e-06 2024-04-26T12:05:53.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:53.890 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780453+0000", 2024-04-26T12:05:53.890 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2999999999999998e-06 2024-04-26T12:05:53.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.891 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:53.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:53.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0760000000000002e-06 2024-04-26T12:05:53.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.891 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780502+0000", 2024-04-26T12:05:53.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4079999999999998e-05 2024-04-26T12:05:53.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.892 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.892 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:53.892 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:53.892 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5450000000000002e-06 2024-04-26T12:05:53.892 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.892 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.892 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.892 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790390+0000", 2024-04-26T12:05:53.892 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098850759999999996 2024-04-26T12:05:53.892 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.892 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.892 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:53.892 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790447+0000", 2024-04-26T12:05:53.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6752999999999997e-05 2024-04-26T12:05:53.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:53.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790547+0000", 2024-04-26T12:05:53.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100344 2024-04-26T12:05:53.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:53.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793864+0000", 2024-04-26T12:05:53.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033169749999999998 2024-04-26T12:05:53.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:53.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798164+0000", 2024-04-26T12:05:53.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043000690000000001 2024-04-26T12:05:53.894 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:53.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798204+0000", 2024-04-26T12:05:53.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9478999999999999e-05 2024-04-26T12:05:53.894 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:53.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798236+0000", 2024-04-26T12:05:53.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2478999999999999e-05 2024-04-26T12:05:53.894 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.894 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:53.894 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.895 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:53.895 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:53.895 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.081078611000002, 2024-04-26T12:05:53.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016989500000000001, 2024-04-26T12:05:53.895 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:53.895 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:53.895 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:53.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.895 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:53.895 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:53.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.896 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:53.896 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:53.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.896 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.896 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.896 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:53.896 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780483+0000", 2024-04-26T12:05:53.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:53.896 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.896 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.896 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:53.896 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780488+0000", 2024-04-26T12:05:53.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6260000000000003e-06 2024-04-26T12:05:53.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:53.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780499+0000", 2024-04-26T12:05:53.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1236000000000001e-05 2024-04-26T12:05:53.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:53.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:53.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4569999999999996e-06 2024-04-26T12:05:53.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780529+0000", 2024-04-26T12:05:53.898 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4579e-05 2024-04-26T12:05:53.898 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.898 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:53.898 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780532+0000", 2024-04-26T12:05:53.898 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.74e-06 2024-04-26T12:05:53.898 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.898 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.898 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788868+0000", 2024-04-26T12:05:53.898 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0083357650000000002 2024-04-26T12:05:53.898 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.899 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:53.899 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789142+0000", 2024-04-26T12:05:53.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027472 2024-04-26T12:05:53.899 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.899 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:53.899 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789241+0000", 2024-04-26T12:05:53.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8394999999999996e-05 2024-04-26T12:05:53.899 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.899 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:53.899 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792096+0000", 2024-04-26T12:05:53.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002855677 2024-04-26T12:05:53.900 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.900 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.900 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:53.900 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797379+0000", 2024-04-26T12:05:53.900 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052822379999999999 2024-04-26T12:05:53.900 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.900 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.900 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:53.900 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797433+0000", 2024-04-26T12:05:53.900 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4109e-05 2024-04-26T12:05:53.900 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.900 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.900 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:53.900 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797473+0000", 2024-04-26T12:05:53.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0533e-05 2024-04-26T12:05:53.901 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.901 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:53.901 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.901 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.901 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:53.901 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:53.901 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.081038997, 2024-04-26T12:05:53.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017295965, 2024-04-26T12:05:53.901 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:53.901 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:53.901 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:53.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.901 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:53.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:53.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:53.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:53.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:53.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780513+0000", 2024-04-26T12:05:53.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999895 2024-04-26T12:05:53.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.903 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:53.903 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780528+0000", 2024-04-26T12:05:53.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5089000000000001e-05 2024-04-26T12:05:53.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.903 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:53.903 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780537+0000", 2024-04-26T12:05:53.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8400000000000001e-06 2024-04-26T12:05:53.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.903 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:53.904 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780544+0000", 2024-04-26T12:05:53.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.917e-06 2024-04-26T12:05:53.904 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.904 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.904 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780571+0000", 2024-04-26T12:05:53.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7032000000000001e-05 2024-04-26T12:05:53.904 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.904 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:53.904 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780574+0000", 2024-04-26T12:05:53.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:05:53.904 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.904 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.905 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789436+0000", 2024-04-26T12:05:53.905 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088622240000000001 2024-04-26T12:05:53.905 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.905 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:53.905 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789525+0000", 2024-04-26T12:05:53.905 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8549999999999998e-05 2024-04-26T12:05:53.905 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.905 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:53.905 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789642+0000", 2024-04-26T12:05:53.905 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011772100000000001 2024-04-26T12:05:53.905 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:53.906 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792129+0000", 2024-04-26T12:05:53.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024871709999999998 2024-04-26T12:05:53.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:53.906 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797732+0000", 2024-04-26T12:05:53.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056027580000000002 2024-04-26T12:05:53.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:53.906 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797777+0000", 2024-04-26T12:05:53.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4620999999999999e-05 2024-04-26T12:05:53.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:53.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797819+0000", 2024-04-26T12:05:53.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2536000000000001e-05 2024-04-26T12:05:53.907 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.907 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:53.907 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.907 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:53.907 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:53.907 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.081010046999999, 2024-04-26T12:05:53.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017840163999999999, 2024-04-26T12:05:53.907 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:53.908 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:53.908 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:53.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:53.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:53.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:53.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:53.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:53.909 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:53.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:53.909 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.909 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:53.909 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:53.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5419999999999999e-06 2024-04-26T12:05:53.909 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.909 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:53.909 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780563+0000", 2024-04-26T12:05:53.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:05:53.909 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:53.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780569+0000", 2024-04-26T12:05:53.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1479999999999997e-06 2024-04-26T12:05:53.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780594+0000", 2024-04-26T12:05:53.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5585e-05 2024-04-26T12:05:53.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:53.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780596+0000", 2024-04-26T12:05:53.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2630000000000002e-06 2024-04-26T12:05:53.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789932+0000", 2024-04-26T12:05:53.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093360479999999996 2024-04-26T12:05:53.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:53.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790070+0000", 2024-04-26T12:05:53.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013771399999999999 2024-04-26T12:05:53.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:53.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790219+0000", 2024-04-26T12:05:53.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014872299999999999 2024-04-26T12:05:53.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:53.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793632+0000", 2024-04-26T12:05:53.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003413368 2024-04-26T12:05:53.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:53.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798244+0000", 2024-04-26T12:05:53.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046113819999999998 2024-04-26T12:05:53.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:53.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798361+0000", 2024-04-26T12:05:53.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117726 2024-04-26T12:05:53.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:53.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798393+0000", 2024-04-26T12:05:53.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1099999999999997e-05 2024-04-26T12:05:53.913 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.913 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:53.913 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.913 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:53.914 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:53.914 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.080985122000001, 2024-04-26T12:05:53.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016645943, 2024-04-26T12:05:53.914 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:53.914 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:53.914 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:53.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:53.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:53.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:53.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:53.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.915 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:53.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:53.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:53.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.915 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:53.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780580+0000", 2024-04-26T12:05:53.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1549999999999999e-06 2024-04-26T12:05:53.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.915 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:53.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780588+0000", 2024-04-26T12:05:53.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:05:53.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:53.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780593+0000", 2024-04-26T12:05:53.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2399999999999998e-06 2024-04-26T12:05:53.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780628+0000", 2024-04-26T12:05:53.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5426000000000003e-05 2024-04-26T12:05:53.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:53.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780632+0000", 2024-04-26T12:05:53.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:05:53.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788288+0000", 2024-04-26T12:05:53.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076555879999999996 2024-04-26T12:05:53.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:53.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788570+0000", 2024-04-26T12:05:53.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028233700000000002 2024-04-26T12:05:53.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:53.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797223+0000", 2024-04-26T12:05:53.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086529150000000006 2024-04-26T12:05:53.918 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.918 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:53.918 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.918 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:53.918 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:53.918 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.080961152999997, 2024-04-26T12:05:53.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016536068000000001, 2024-04-26T12:05:53.918 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:53.919 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:53.919 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:53.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:53.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:53.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:53.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:53.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:53.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:53.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:53.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:53.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780609+0000", 2024-04-26T12:05:53.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8280000000000003e-06 2024-04-26T12:05:53.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:53.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780616+0000", 2024-04-26T12:05:53.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4939999999999997e-06 2024-04-26T12:05:53.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:53.921 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780621+0000", 2024-04-26T12:05:53.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6040000000000003e-06 2024-04-26T12:05:53.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.921 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.921 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780647+0000", 2024-04-26T12:05:53.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6441999999999999e-05 2024-04-26T12:05:53.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.921 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:53.921 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780650+0000", 2024-04-26T12:05:53.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4430000000000002e-06 2024-04-26T12:05:53.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.921 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.921 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788163+0000", 2024-04-26T12:05:53.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007513774 2024-04-26T12:05:53.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:53.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788307+0000", 2024-04-26T12:05:53.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014374400000000001 2024-04-26T12:05:53.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:53.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797137+0000", 2024-04-26T12:05:53.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088302160000000001 2024-04-26T12:05:53.922 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.922 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:53.922 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.923 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:53.923 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:53.923 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.078084881000002, 2024-04-26T12:05:53.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012911448000000001, 2024-04-26T12:05:53.923 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:53.923 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:53.923 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:53.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:53.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:53.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:53.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:53.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:53.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783477+0000", 2024-04-26T12:05:53.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:53.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:53.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783482+0000", 2024-04-26T12:05:53.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5709999999999999e-06 2024-04-26T12:05:53.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:53.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783491+0000", 2024-04-26T12:05:53.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3610000000000007e-06 2024-04-26T12:05:53.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:53.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783498+0000", 2024-04-26T12:05:53.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4209999999999998e-06 2024-04-26T12:05:53.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786045+0000", 2024-04-26T12:05:53.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0025465739999999998 2024-04-26T12:05:53.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:53.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786061+0000", 2024-04-26T12:05:53.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6348999999999999e-05 2024-04-26T12:05:53.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:53.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796342+0000", 2024-04-26T12:05:53.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010280643000000001 2024-04-26T12:05:53.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:53.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796389+0000", 2024-04-26T12:05:53.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6912000000000001e-05 2024-04-26T12:05:53.927 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.927 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:53.927 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.927 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:53.927 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:53.927 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.078056574999998, 2024-04-26T12:05:53.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013376469, 2024-04-26T12:05:53.927 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:53.927 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:53.927 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:53.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:53.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:53.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:53.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:53.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:53.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:53.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:53.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:53.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783516+0000", 2024-04-26T12:05:53.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.041e-05 2024-04-26T12:05:53.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:53.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783523+0000", 2024-04-26T12:05:53.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5749999999999997e-06 2024-04-26T12:05:53.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:53.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783528+0000", 2024-04-26T12:05:53.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5029999999999997e-06 2024-04-26T12:05:53.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787662+0000", 2024-04-26T12:05:53.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041336230000000003 2024-04-26T12:05:53.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:53.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787687+0000", 2024-04-26T12:05:53.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5769999999999999e-05 2024-04-26T12:05:53.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:53.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796817+0000", 2024-04-26T12:05:53.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091296750000000003 2024-04-26T12:05:53.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:53.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796882+0000", 2024-04-26T12:05:53.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5180999999999998e-05 2024-04-26T12:05:53.934 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.934 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:53.934 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.934 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:53.934 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:53.934 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.077988034000001, 2024-04-26T12:05:53.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013457291999999999, 2024-04-26T12:05:53.934 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:53.935 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:53.935 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:53.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:53.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:53.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:53.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:53.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:53.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:53.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:53.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:53.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783578+0000", 2024-04-26T12:05:53.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.659e-06 2024-04-26T12:05:53.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:53.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783584+0000", 2024-04-26T12:05:53.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:53.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:53.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783588+0000", 2024-04-26T12:05:53.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6190000000000002e-06 2024-04-26T12:05:53.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787834+0000", 2024-04-26T12:05:53.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042460529999999996 2024-04-26T12:05:53.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:53.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787854+0000", 2024-04-26T12:05:53.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9658999999999999e-05 2024-04-26T12:05:53.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:53.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:53.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009107604 2024-04-26T12:05:53.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:53.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797032+0000", 2024-04-26T12:05:53.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9987000000000006e-05 2024-04-26T12:05:53.938 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.938 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:53.938 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.938 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:53.938 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:53.939 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.076141655000001, 2024-04-26T12:05:53.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011003015999999999, 2024-04-26T12:05:53.939 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:53.939 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:53.939 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:53.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:53.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:53.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:53.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:53.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:53.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785420+0000", 2024-04-26T12:05:53.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:53.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:53.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785427+0000", 2024-04-26T12:05:53.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:05:53.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:53.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785438+0000", 2024-04-26T12:05:53.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069e-05 2024-04-26T12:05:53.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:53.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785457+0000", 2024-04-26T12:05:53.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8617000000000001e-05 2024-04-26T12:05:53.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786628+0000", 2024-04-26T12:05:53.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001171418 2024-04-26T12:05:53.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:53.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786651+0000", 2024-04-26T12:05:53.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3289e-05 2024-04-26T12:05:53.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:53.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796393+0000", 2024-04-26T12:05:53.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097413269999999993 2024-04-26T12:05:53.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:53.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796424+0000", 2024-04-26T12:05:53.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1188e-05 2024-04-26T12:05:53.942 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.942 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:53.942 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.943 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:53.943 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:53.943 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.075594909000003, 2024-04-26T12:05:53.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010561432000000001, 2024-04-26T12:05:53.943 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:53.943 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:53.943 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:53.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:53.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:53.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:53.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:53.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:53.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:53.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:53.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:53.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785973+0000", 2024-04-26T12:05:53.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4910000000000002e-06 2024-04-26T12:05:53.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:53.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785991+0000", 2024-04-26T12:05:53.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7663e-05 2024-04-26T12:05:53.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:53.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785998+0000", 2024-04-26T12:05:53.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1239999999999999e-06 2024-04-26T12:05:53.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786792+0000", 2024-04-26T12:05:53.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079334800000000003 2024-04-26T12:05:53.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:53.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786810+0000", 2024-04-26T12:05:53.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8746999999999999e-05 2024-04-26T12:05:53.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:53.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796500+0000", 2024-04-26T12:05:53.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096897619999999993 2024-04-26T12:05:53.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:53.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796529+0000", 2024-04-26T12:05:53.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8873999999999998e-05 2024-04-26T12:05:53.947 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.947 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:53.947 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.947 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:53.947 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:53.947 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.075515823000003, 2024-04-26T12:05:53.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010219911, 2024-04-26T12:05:53.947 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:53.947 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:53.947 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:53.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:53.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:53.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:53.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:53.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:53.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786046+0000", 2024-04-26T12:05:53.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:53.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:53.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786053+0000", 2024-04-26T12:05:53.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0360000000000001e-06 2024-04-26T12:05:53.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:53.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786064+0000", 2024-04-26T12:05:53.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1202999999999999e-05 2024-04-26T12:05:53.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:53.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786091+0000", 2024-04-26T12:05:53.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6859000000000002e-05 2024-04-26T12:05:53.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786212+0000", 2024-04-26T12:05:53.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120975 2024-04-26T12:05:53.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:53.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786236+0000", 2024-04-26T12:05:53.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4358999999999998e-05 2024-04-26T12:05:53.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:53.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796236+0000", 2024-04-26T12:05:53.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099998050000000005 2024-04-26T12:05:53.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:53.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796266+0000", 2024-04-26T12:05:53.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0278e-05 2024-04-26T12:05:53.951 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.951 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:53.951 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.951 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:3 3.14 e17/15 3:287034c4:::1.00000000.inode:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:53.951 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:53.951 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.074726861999999, 2024-04-26T12:05:53.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009764712, 2024-04-26T12:05:53.951 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:53.952 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:53.952 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:53.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:53.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:53.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:53.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:53.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:53.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786835+0000", 2024-04-26T12:05:53.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T12:05:53.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:53.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786844+0000", 2024-04-26T12:05:53.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6500000000000008e-06 2024-04-26T12:05:53.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:53.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786855+0000", 2024-04-26T12:05:53.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0932e-05 2024-04-26T12:05:53.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:53.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786864+0000", 2024-04-26T12:05:53.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2150000000000007e-06 2024-04-26T12:05:53.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787242+0000", 2024-04-26T12:05:53.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037708300000000001 2024-04-26T12:05:53.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:53.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787259+0000", 2024-04-26T12:05:53.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7258999999999999e-05 2024-04-26T12:05:53.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:53.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796579+0000", 2024-04-26T12:05:53.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093201099999999995 2024-04-26T12:05:53.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:53.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796600+0000", 2024-04-26T12:05:53.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1330000000000001e-05 2024-04-26T12:05:53.955 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.955 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:53.955 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.956 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:53.956 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:53.956 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.074682840000001, 2024-04-26T12:05:53.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096431940000000008, 2024-04-26T12:05:53.956 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:53.956 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:53.956 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:53.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:53.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:53.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:53.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:53.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:53.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786879+0000", 2024-04-26T12:05:53.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:53.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:53.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786887+0000", 2024-04-26T12:05:53.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9300000000000003e-06 2024-04-26T12:05:53.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:53.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786894+0000", 2024-04-26T12:05:53.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:05:53.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:53.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786899+0000", 2024-04-26T12:05:53.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8400000000000002e-06 2024-04-26T12:05:53.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786932+0000", 2024-04-26T12:05:53.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3031999999999998e-05 2024-04-26T12:05:53.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:53.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786945+0000", 2024-04-26T12:05:53.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3421000000000001e-05 2024-04-26T12:05:53.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:53.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796469+0000", 2024-04-26T12:05:53.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095236130000000002 2024-04-26T12:05:53.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:53.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796523+0000", 2024-04-26T12:05:53.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4089999999999999e-05 2024-04-26T12:05:53.960 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.960 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:53.960 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.960 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "pg_update_log_missing(3.14 epoch 17/15 rep_tid 169 entries 17'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:05:53.960 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:53.960 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.074619685000002, 2024-04-26T12:05:53.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097257639999999996, 2024-04-26T12:05:53.960 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:53.960 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-04-26T12:05:53.960 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:53.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:53.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:53.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:53.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:53.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:53.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786942+0000", 2024-04-26T12:05:53.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:53.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:53.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786951+0000", 2024-04-26T12:05:53.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:05:53.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:53.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786965+0000", 2024-04-26T12:05:53.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4268e-05 2024-04-26T12:05:53.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:53.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786977+0000", 2024-04-26T12:05:53.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1667e-05 2024-04-26T12:05:53.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787667+0000", 2024-04-26T12:05:53.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00069057400000000001 2024-04-26T12:05:53.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:53.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796668+0000", 2024-04-26T12:05:53.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090013309999999996 2024-04-26T12:05:53.963 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.963 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:53.963 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.963 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:53.963 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:53.964 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.074566541999999, 2024-04-26T12:05:53.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095908309999999993, 2024-04-26T12:05:53.964 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:53.964 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:53.964 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:53.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:53.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:53.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:53.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:53.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:53.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786995+0000", 2024-04-26T12:05:53.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:53.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:53.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787001+0000", 2024-04-26T12:05:53.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5099999999999998e-06 2024-04-26T12:05:53.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:53.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787009+0000", 2024-04-26T12:05:53.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9100000000000005e-06 2024-04-26T12:05:53.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:53.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787019+0000", 2024-04-26T12:05:53.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8109999999999997e-06 2024-04-26T12:05:53.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787136+0000", 2024-04-26T12:05:53.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011749899999999999 2024-04-26T12:05:53.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:53.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787154+0000", 2024-04-26T12:05:53.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8278999999999999e-05 2024-04-26T12:05:53.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:53.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796561+0000", 2024-04-26T12:05:53.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094064379999999996 2024-04-26T12:05:53.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:53.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796587+0000", 2024-04-26T12:05:53.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5856000000000001e-05 2024-04-26T12:05:53.967 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.967 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:53.967 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.968 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:53.968 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:53.968 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.073849484999997, 2024-04-26T12:05:53.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096460160000000003, 2024-04-26T12:05:53.968 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:53.968 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:53.968 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:53.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:53.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:53.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:53.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:53.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:53.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:53.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787712+0000", 2024-04-26T12:05:53.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:53.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:53.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787718+0000", 2024-04-26T12:05:53.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:05:53.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:53.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787727+0000", 2024-04-26T12:05:53.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.123e-06 2024-04-26T12:05:53.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:53.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787734+0000", 2024-04-26T12:05:53.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.391e-06 2024-04-26T12:05:53.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:53.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788867+0000", 2024-04-26T12:05:53.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001133207 2024-04-26T12:05:53.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:53.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788899+0000", 2024-04-26T12:05:53.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1526000000000003e-05 2024-04-26T12:05:53.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:53.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797328+0000", 2024-04-26T12:05:53.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084295389999999998 2024-04-26T12:05:53.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:53.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:53.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:53.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797359+0000", 2024-04-26T12:05:53.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0660999999999997e-05 2024-04-26T12:05:53.972 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.972 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:53.972 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.972 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:53.972 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:53.972 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:53.974 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:53.974 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:53.973+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:54.075 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:54.074+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:54.089 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:54.089 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:05:54.089 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:05:54.089 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:54.099 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:54.176 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:54.175+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:54.202 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:54.202 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:05:54.202 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:05:54.202 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:05:54.203 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:54.211 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:54.277 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:54.276+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:54.355 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:54.356 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:05:54.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:05:54.356 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:05:54.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.356 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:54.356 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:54.356 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 60.498337732000003, 2024-04-26T12:05:54.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:05:54.356 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:54.357 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.357 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:54.357 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:54.357 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:54.357 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:05:54.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.357 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:54.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.357 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:54.357 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:54.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.357 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:54.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:54.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:54.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:54.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:54.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:05:54.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:05:54.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:54.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:05:54.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:05:54.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:05:54.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:05:54.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:54.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:05:54.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:05:54.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:54.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:05:54.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:05:54.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:54.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:05:54.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:05:54.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:54.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:05:54.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:05:54.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:05:54.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:05:54.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:54.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:05:54.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:05:54.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:54.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:05:54.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:05:54.361 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.361 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:54.361 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.362 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:54.362 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:54.362 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 60.498231836000002, 2024-04-26T12:05:54.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:05:54.362 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:54.362 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.362 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:54.362 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:54.362 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:54.362 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:05:54.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.362 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:54.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:54.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:54.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:54.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:54.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:54.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:54.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:54.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:05:54.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:05:54.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:54.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:05:54.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:05:54.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:05:54.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:05:54.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:54.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:05:54.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:05:54.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:54.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:05:54.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:05:54.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:54.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:05:54.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:05:54.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:54.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:05:54.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:05:54.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:05:54.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:05:54.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:54.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:05:54.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:05:54.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:54.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:05:54.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:05:54.367 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.367 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:54.367 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.367 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:54.367 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:54.367 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 60.498216855999999, 2024-04-26T12:05:54.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:05:54.367 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:54.368 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.368 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:54.368 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:54.368 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:54.368 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:05:54.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.368 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:54.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:54.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:54.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:54.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:54.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:54.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:54.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:54.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:05:54.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:05:54.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:54.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:05:54.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:05:54.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.370 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:05:54.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:05:54.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:54.370 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:05:54.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:05:54.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:54.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:05:54.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:05:54.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:54.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:05:54.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:05:54.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:54.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:05:54.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:05:54.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:05:54.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:05:54.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:54.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:05:54.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:05:54.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:54.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:05:54.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:05:54.372 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.372 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:54.373 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.373 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:54.373 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:54.373 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 60.498172981000003, 2024-04-26T12:05:54.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:05:54.373 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:54.373 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.373 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:54.373 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:54.373 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:54.373 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:05:54.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.373 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:54.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:54.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:54.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:54.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:54.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:54.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:54.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.375 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.375 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:54.375 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:05:54.375 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:05:54.375 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.375 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.375 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:54.375 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:05:54.375 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:05:54.375 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.375 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.375 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.375 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:05:54.375 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:05:54.375 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.376 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.376 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:54.376 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:05:54.376 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:05:54.376 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.376 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.376 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:54.376 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:05:54.376 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:05:54.376 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.376 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.376 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:54.376 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:05:54.376 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:05:54.376 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.376 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.377 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:54.377 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:05:54.377 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:05:54.377 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.377 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.377 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.377 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:05:54.377 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:05:54.377 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.377 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.377 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:54.377 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:05:54.377 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:05:54.377 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.377 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.378 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:54.378 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:05:54.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:05:54.378 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.378 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:54.378 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.378 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.378 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:54.378 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:54.378 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 60.498087317, 2024-04-26T12:05:54.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:05:54.378 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:54.378 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.379 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:54.379 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:54.379 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:54.379 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:05:54.379 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.379 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:54.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.379 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:54.379 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:54.379 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.379 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.379 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:54.379 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:54.379 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.380 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.380 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:54.380 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:54.380 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.380 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.380 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:54.380 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:05:54.380 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:05:54.380 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.380 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:54.380 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:05:54.380 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:05:54.380 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.381 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.381 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.381 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:05:54.381 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:05:54.381 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.381 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.381 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:54.381 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:05:54.381 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:05:54.381 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.381 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.381 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:54.381 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:05:54.381 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:05:54.381 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.382 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.382 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:54.382 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:05:54.382 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:05:54.382 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.382 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.382 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:54.382 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:05:54.382 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:05:54.382 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.382 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.382 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.382 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:05:54.382 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:05:54.383 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.383 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.383 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:54.383 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:05:54.383 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:05:54.383 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.383 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.383 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:54.383 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:05:54.383 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:05:54.383 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.383 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:54.383 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.383 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.383 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.384 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:54.384 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:54.384 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 50.572183031000002, 2024-04-26T12:05:54.384 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:05:54.384 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:54.384 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.384 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:54.384 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.384 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:54.384 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:54.384 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.384 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.384 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.384 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:54.384 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:54.385 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.385 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.385 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.385 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:54.385 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:54.385 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:54.385 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.385 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.385 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:54.385 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:05:54.385 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:05:54.385 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.385 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.385 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:54.385 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:05:54.386 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:05:54.386 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.386 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.386 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.386 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:05:54.386 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:05:54.386 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.386 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.386 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:54.386 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:05:54.386 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:05:54.386 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.386 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.386 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:54.387 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:05:54.387 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:05:54.387 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.387 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.387 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:54.387 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:05:54.387 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:05:54.387 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.387 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.387 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:54.387 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:05:54.387 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:05:54.387 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.387 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.387 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.388 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:05:54.388 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:05:54.388 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.388 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.388 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:54.388 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:05:54.388 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:05:54.388 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.388 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.388 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:54.388 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:05:54.388 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:05:54.388 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.388 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:54.388 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.389 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.389 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.389 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:54.389 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:54.389 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 50.572146936000003, 2024-04-26T12:05:54.389 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:05:54.389 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:54.389 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.389 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:54.389 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.389 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:54.389 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:54.389 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.389 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.389 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.389 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:54.390 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:54.390 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.390 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.390 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.390 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:54.390 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:05:54.390 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:54.390 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.390 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.390 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:54.390 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:05:54.390 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:05:54.390 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.390 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.391 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:54.391 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:05:54.391 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:05:54.391 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.391 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.391 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.391 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:05:54.391 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:05:54.391 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.391 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.391 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:54.391 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:05:54.391 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:05:54.391 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.391 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.391 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:54.392 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:05:54.392 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:05:54.392 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.392 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.392 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:54.392 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:05:54.392 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:05:54.392 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.392 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.392 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:54.392 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:05:54.392 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:05:54.392 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.392 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.392 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.393 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:05:54.393 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:05:54.393 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.393 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.393 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:54.393 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:05:54.393 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:05:54.393 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.393 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.393 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:54.393 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:05:54.393 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:05:54.393 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.393 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:54.393 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.394 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.394 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.394 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:54.394 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:54.394 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 50.572109251999997, 2024-04-26T12:05:54.394 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:05:54.394 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:54.394 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.394 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:54.394 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.394 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:54.394 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:54.394 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.395 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.395 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.395 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:54.395 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:54.395 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.395 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.395 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.395 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:54.395 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:05:54.395 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.395 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.395 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.395 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:54.395 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:05:54.395 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:05:54.396 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.396 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.396 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:54.396 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:05:54.396 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:05:54.396 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.396 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.396 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.396 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:05:54.396 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:05:54.396 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.396 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.396 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:54.396 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:05:54.396 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:05:54.397 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.397 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.397 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:54.397 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:54.397 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:05:54.397 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.397 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.397 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:54.397 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:05:54.397 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:05:54.397 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.397 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.397 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:54.397 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:05:54.397 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:05:54.398 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.398 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.398 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.398 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:05:54.398 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:05:54.398 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.398 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.398 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:54.398 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:05:54.398 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:05:54.398 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.398 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.398 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:54.398 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:05:54.399 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:05:54.399 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.399 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:54.399 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.399 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.399 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.399 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:54.399 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:54.399 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 50.572087912000001, 2024-04-26T12:05:54.399 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:05:54.399 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:54.399 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.399 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:54.399 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.399 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:54.400 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:54.400 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.400 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.400 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.400 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:54.400 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:54.400 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.400 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.400 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.400 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:54.400 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:54.400 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.400 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.400 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.401 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:54.401 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:05:54.401 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:54.401 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.401 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.401 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:54.401 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:05:54.401 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:05:54.401 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.401 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.401 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.401 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:05:54.401 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:05:54.401 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.401 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.402 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:54.402 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:05:54.402 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:05:54.402 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.402 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.402 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:54.402 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:05:54.402 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:05:54.402 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.402 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.402 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:54.402 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:05:54.402 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:05:54.402 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.402 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.403 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:54.403 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:05:54.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:05:54.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.403 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.403 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:05:54.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:05:54.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.403 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:54.403 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:05:54.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:05:54.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:54.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:05:54.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:05:54.404 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.404 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:54.404 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.404 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:54.404 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:54.404 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 50.572065645999999, 2024-04-26T12:05:54.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:05:54.404 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:54.404 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.404 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:54.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:54.405 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:54.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.405 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:54.405 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:54.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.405 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:54.405 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:54.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.405 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:54.405 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:05:54.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:54.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:54.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:05:54.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:05:54.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:05:54.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:05:54.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:54.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:05:54.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:05:54.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.407 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:54.407 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:05:54.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:05:54.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.407 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:54.407 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:05:54.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:05:54.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.407 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:54.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:05:54.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:05:54.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:05:54.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:05:54.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:54.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:05:54.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:05:54.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:54.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:05:54.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:05:54.409 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.409 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:54.409 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.409 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:54.409 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:54.409 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 50.572044024, 2024-04-26T12:05:54.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:05:54.409 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:54.409 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.409 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:54.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.410 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:54.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:54.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.410 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:54.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:54.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.410 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:54.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:54.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:54.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:05:54.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:05:54.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:54.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:05:54.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:05:54.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:05:54.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:05:54.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:54.412 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:05:54.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:05:54.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:54.412 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:05:54.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:05:54.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:54.412 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:05:54.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:05:54.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:54.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:05:54.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:05:54.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:05:54.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:05:54.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:54.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:05:54.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:05:54.414 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.414 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.414 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:54.414 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:05:54.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:05:54.414 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.414 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:54.414 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.414 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.414 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.414 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:54.414 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:54.414 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 50.572017457999998, 2024-04-26T12:05:54.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:05:54.415 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:54.415 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.415 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:54.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:54.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:54.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:54.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:54.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:54.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:05:54.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:54.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:05:54.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:05:54.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:54.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:05:54.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:05:54.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.417 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:05:54.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:05:54.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:54.417 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:05:54.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:05:54.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:54.417 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:05:54.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:05:54.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:54.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:05:54.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:05:54.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:54.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:05:54.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:05:54.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:05:54.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:05:54.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:54.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:05:54.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:05:54.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:54.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:05:54.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:05:54.419 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.419 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:54.419 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.419 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:54.420 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:54.420 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 50.571978946000002, 2024-04-26T12:05:54.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:05:54.420 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:54.420 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.420 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:54.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:54.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:54.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:54.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:54.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:54.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:54.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:54.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:05:54.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:05:54.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:54.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:05:54.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:05:54.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:05:54.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:05:54.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:54.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:05:54.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:05:54.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.423 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:54.423 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:05:54.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:05:54.423 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.423 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:54.423 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:05:54.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:05:54.423 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.423 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:54.423 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:05:54.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:05:54.423 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:05:54.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:05:54.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:54.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:05:54.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:05:54.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:54.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:05:54.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:05:54.424 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.425 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:54.425 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.425 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:54.425 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:54.425 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 50.571950772999998, 2024-04-26T12:05:54.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:05:54.425 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:54.425 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.425 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:54.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:54.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:54.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.426 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:54.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:54.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.426 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:54.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:54.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.426 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:54.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:05:54.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:05:54.427 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.427 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.427 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:54.427 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:05:54.427 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:05:54.427 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.427 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.427 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.427 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:05:54.427 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:05:54.427 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.427 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.427 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:54.427 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:05:54.427 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:05:54.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:54.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:05:54.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:05:54.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:54.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:05:54.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:05:54.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:54.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:05:54.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:05:54.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:05:54.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:05:54.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:54.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:05:54.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:05:54.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:54.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:05:54.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:05:54.430 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.430 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:54.430 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.430 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.430 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.430 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:54.430 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:54.430 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 50.571916209000001, 2024-04-26T12:05:54.430 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:05:54.430 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:54.430 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.430 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:54.430 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.430 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:54.430 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:54.431 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.431 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.431 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.431 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:54.431 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:54.431 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.431 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.431 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.431 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:54.431 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:05:54.431 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.431 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.431 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.431 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:54.431 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:05:54.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:05:54.432 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.432 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.432 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:54.432 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:05:54.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:05:54.432 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.432 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.432 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.432 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:05:54.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:05:54.432 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.432 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.432 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:54.432 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:05:54.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:05:54.433 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.433 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.433 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:54.433 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:05:54.433 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:05:54.433 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.433 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.433 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:54.433 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:05:54.433 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:05:54.433 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.433 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.433 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:54.433 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:05:54.434 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:05:54.434 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.434 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.434 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.434 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:05:54.434 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:05:54.434 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.434 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.434 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:54.434 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:54.434 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:05:54.434 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.434 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.434 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:54.434 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:05:54.435 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:05:54.435 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.435 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:54.435 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.435 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.435 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.435 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:54.435 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:54.435 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 50.571041428999997, 2024-04-26T12:05:54.435 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:05:54.435 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:54.435 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.435 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:54.435 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.435 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:54.436 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:54.436 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.436 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.436 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.436 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:54.436 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:54.436 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.436 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.436 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.436 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:54.436 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:05:54.436 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:54.436 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.436 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.436 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:54.437 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:05:54.437 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:05:54.437 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.437 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.437 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:54.437 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:05:54.437 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:05:54.437 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.437 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.437 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.437 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:05:54.437 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:05:54.437 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.437 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.437 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:54.438 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:05:54.438 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:05:54.438 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.438 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.438 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:54.438 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:05:54.438 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:05:54.438 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.438 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.438 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:54.438 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:05:54.438 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:05:54.438 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.438 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.438 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:54.439 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:05:54.439 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:05:54.439 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.439 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.439 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.439 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:05:54.439 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:05:54.439 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.439 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.439 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:54.439 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:05:54.439 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:05:54.439 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.439 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.440 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:54.440 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:05:54.440 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:05:54.440 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.440 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:54.440 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.440 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.440 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.440 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:54.440 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:54.440 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 50.571002470000003, 2024-04-26T12:05:54.440 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:05:54.440 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:54.440 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.440 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:54.440 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.441 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:54.441 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:54.441 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.441 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.441 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.441 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:54.441 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:54.441 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.441 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.441 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.441 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:54.441 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:05:54.441 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.441 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.441 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.442 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:54.442 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:05:54.442 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:05:54.442 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.442 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.442 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:54.442 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:05:54.442 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:05:54.442 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.442 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.442 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.442 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:05:54.442 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:05:54.442 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.442 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.443 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:54.443 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:05:54.443 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:05:54.443 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.443 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.443 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:54.443 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:05:54.443 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:05:54.443 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.443 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.443 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:54.443 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:05:54.443 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:05:54.443 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.443 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.444 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:54.444 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:05:54.444 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:05:54.444 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.444 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.444 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.444 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:05:54.444 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:05:54.444 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.444 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.444 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:54.444 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:05:54.444 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:05:54.444 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.444 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.444 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:54.445 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:05:54.445 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:05:54.445 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.445 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:54.445 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.445 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.445 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.445 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:54.445 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:54.445 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 50.570966998000003, 2024-04-26T12:05:54.445 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:05:54.445 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:54.445 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.445 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:54.446 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.446 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:54.446 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:54.446 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.446 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.446 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.446 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:54.446 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:54.446 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.446 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.446 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.446 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:54.446 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:54.446 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.447 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.447 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.447 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:54.447 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:05:54.447 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:05:54.447 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.447 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.447 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:54.447 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:05:54.447 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:05:54.447 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.447 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.447 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.447 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:05:54.447 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:05:54.448 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.448 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.448 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:54.448 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:05:54.448 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:05:54.448 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.448 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.448 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:54.448 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:05:54.448 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:05:54.448 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.448 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.448 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:54.448 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:05:54.448 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:05:54.449 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.449 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.449 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:54.449 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:05:54.449 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:05:54.449 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.449 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.449 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.449 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:05:54.449 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:05:54.449 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.449 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.449 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:54.449 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:05:54.450 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:05:54.450 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.450 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.450 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:54.450 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:05:54.450 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:05:54.450 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.450 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:54.450 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.450 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.450 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.450 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:54.450 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:54.450 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 50.570888308999997, 2024-04-26T12:05:54.450 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:05:54.451 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:54.451 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.451 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:54.451 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.451 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:54.451 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:54.451 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.451 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.451 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.451 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:54.451 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:54.451 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.451 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.451 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.451 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:54.452 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:05:54.452 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:54.452 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.452 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.452 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:54.452 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:05:54.452 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:05:54.452 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.452 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.452 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:54.452 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:05:54.452 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:05:54.452 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.452 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.452 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.453 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:05:54.453 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:05:54.453 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.453 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.453 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:54.453 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:05:54.453 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:05:54.453 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.453 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.453 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:54.453 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:05:54.453 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:05:54.453 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.453 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.453 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:54.454 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:05:54.454 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:05:54.454 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.454 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.454 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:54.454 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:05:54.454 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:05:54.454 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.454 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.454 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.454 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:05:54.454 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:05:54.454 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.454 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.455 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:54.455 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:05:54.455 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:05:54.455 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.455 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.455 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:54.455 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:05:54.455 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:05:54.455 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.455 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:54.455 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.455 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.455 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.455 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:54.455 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:54.456 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 50.570737461, 2024-04-26T12:05:54.456 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:05:54.456 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:54.456 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:05:54.456 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:54.456 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.456 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:54.456 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:54.456 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.456 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.456 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.456 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:54.456 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:54.456 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:54.456 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.457 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.457 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:54.457 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:05:54.457 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:54.457 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.457 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.457 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:54.457 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:05:54.457 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:05:54.457 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.457 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.457 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:54.457 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:05:54.457 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:05:54.457 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.458 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.458 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.458 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:05:54.458 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:05:54.458 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.458 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.458 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:54.458 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:05:54.458 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:05:54.458 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.458 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.458 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:54.458 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:54.458 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:05:54.459 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:54.459 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:54.459 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:54.459 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:05:54.459 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:05:54.459 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.459 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:54.459 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.459 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:54.459 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:54.459 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:54.461 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:54.461 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:54.460+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:54.562 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:54.560+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:54.573 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:54.573 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:54.573 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:05:54.573 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:54.583 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:54.667 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:54.666+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:54.726 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:54.726 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:54.726 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:05:54.726 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:05:54.726 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:54.734 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:54.764 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:54.763+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:54.865 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:54.864+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:54.878 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:54.878 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:05:54.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:05:54.878 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:05:54.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.878 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:54.879 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:54.879 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 51.096332885999999, 2024-04-26T12:05:54.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:05:54.879 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:54.879 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.879 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:54.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:54.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:54.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:54.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:54.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:54.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:05:54.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:54.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:54.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:05:54.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:05:54.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:54.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:05:54.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:05:54.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:05:54.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:05:54.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:54.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:05:54.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:05:54.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:54.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:54.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:05:54.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.882 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:54.882 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:05:54.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:05:54.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.882 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:54.882 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:05:54.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:05:54.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.882 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.882 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:05:54.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:05:54.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.883 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.883 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:54.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:05:54.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:05:54.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.883 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.883 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:54.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:05:54.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:05:54.883 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.883 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:54.883 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.884 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:54.884 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:54.884 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 51.096277565999998, 2024-04-26T12:05:54.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:05:54.884 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:54.884 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.884 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:54.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:54.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:54.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:54.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:54.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:54.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:05:54.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:54.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:54.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:05:54.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:05:54.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:54.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:05:54.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:05:54.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:05:54.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:05:54.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:54.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:05:54.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:05:54.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:54.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:05:54.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:05:54.887 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:54.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:05:54.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:05:54.887 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:54.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:05:54.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:05:54.887 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:05:54.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:05:54.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:54.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:05:54.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:05:54.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:54.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:05:54.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:05:54.888 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.888 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:54.888 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.889 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.889 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.889 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:54.889 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:54.889 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 51.096227548000002, 2024-04-26T12:05:54.889 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:05:54.889 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:54.889 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.889 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:54.889 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.889 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:54.889 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:54.889 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.889 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.889 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:54.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:54.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:54.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:05:54.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:54.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:05:54.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:05:54.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:54.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:05:54.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:05:54.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:05:54.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:05:54.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:54.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:05:54.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:05:54.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:54.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:05:54.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:05:54.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:54.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:05:54.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:05:54.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:54.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:05:54.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:05:54.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:05:54.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:05:54.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:54.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:05:54.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:05:54.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:54.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:05:54.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:05:54.893 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.894 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:54.894 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.894 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:54.894 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:54.894 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 51.096192911000003, 2024-04-26T12:05:54.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:05:54.894 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:54.894 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.894 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:54.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.894 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:54.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:54.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.895 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.895 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:54.895 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:54.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.895 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.895 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:54.895 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:05:54.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.895 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.895 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:54.895 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:05:54.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:05:54.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:54.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:54.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:05:54.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:05:54.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:05:54.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:54.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:05:54.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:05:54.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:54.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:05:54.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:05:54.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:54.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:05:54.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:05:54.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:05:54.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:05:54.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:54.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:05:54.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:05:54.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:54.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:05:54.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:05:54.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:54.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:05:54.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:05:54.899 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.899 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:54.899 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.899 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:54.899 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:54.899 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 51.096154399, 2024-04-26T12:05:54.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:05:54.899 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:54.899 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.899 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:54.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:54.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:54.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:54.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:54.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:54.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:54.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:54.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:54.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:54.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:05:54.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:54.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:05:54.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:05:54.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:05:54.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:05:54.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:54.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:05:54.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:05:54.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:54.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:05:54.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:05:54.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:54.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:05:54.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:05:54.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:05:54.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:05:54.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:54.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:05:54.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:05:54.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:54.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:05:54.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:05:54.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:54.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:05:54.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:05:54.904 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.904 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:54.904 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.904 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:54.904 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:54.904 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 51.096124076000002, 2024-04-26T12:05:54.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:05:54.905 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:54.905 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.905 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:54.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:54.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:54.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:54.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:54.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:54.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:54.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:54.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:05:54.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:05:54.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:54.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:05:54.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:05:54.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:05:54.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:05:54.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:54.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:05:54.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:05:54.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:54.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:05:54.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:05:54.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:54.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:05:54.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:05:54.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:54.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:05:54.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:05:54.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:05:54.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:05:54.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:54.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:05:54.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:05:54.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:54.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:05:54.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:05:54.910 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.910 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:54.910 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.910 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:54.910 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:54.910 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 51.096097374000003, 2024-04-26T12:05:54.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:05:54.910 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:54.910 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:54.910 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:54.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:54.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:54.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:54.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:54.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:54.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:54.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:54.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:05:54.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:05:54.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:54.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:05:54.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:05:54.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:05:54.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:05:54.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:54.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:05:54.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:05:54.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:54.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:05:54.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:05:54.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:54.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:05:54.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:05:54.913 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.913 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:54.913 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.914 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:54.914 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:54.914 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 51.096055084, 2024-04-26T12:05:54.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:05:54.914 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:54.914 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:54.914 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:54.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:54.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:54.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:54.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:54.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:54.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:54.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:54.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:05:54.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:05:54.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:54.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:05:54.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:05:54.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:05:54.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:05:54.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:54.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:05:54.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:05:54.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:54.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:05:54.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:05:54.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:54.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:05:54.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:05:54.917 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.917 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:54.917 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.917 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:54.917 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:54.918 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 51.096027006, 2024-04-26T12:05:54.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:05:54.918 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:54.918 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:54.918 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:54.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:54.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:54.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:54.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:54.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:05:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:05:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:05:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:05:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:05:54.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:54.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:05:54.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:54.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:54.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:05:54.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:54.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:05:54.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:05:54.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:54.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:05:54.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:05:54.921 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.921 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:54.921 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.921 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:54.921 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:54.922 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 51.090031656000001, 2024-04-26T12:05:54.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:05:54.922 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:54.922 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.922 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:54.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:54.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:54.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:54.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:54.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:54.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:05:54.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:54.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:05:54.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:05:54.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:54.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:05:54.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:05:54.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:05:54.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:05:54.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:54.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:05:54.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:05:54.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:54.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:05:54.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:05:54.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:54.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:05:54.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:05:54.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:54.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:05:54.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:05:54.927 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.927 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:54.927 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.927 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:54.927 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:54.927 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 51.08996269, 2024-04-26T12:05:54.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:05:54.927 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:54.927 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.927 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:54.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:54.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:54.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:54.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:54.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:54.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:05:54.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:54.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:05:54.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:05:54.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:54.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:05:54.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:05:54.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:05:54.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:05:54.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:54.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:05:54.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:05:54.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:54.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:54.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:05:54.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:54.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:05:54.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:05:54.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:54.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:05:54.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:05:54.931 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.931 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:54.932 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.932 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:54.932 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:54.932 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 51.089468326999999, 2024-04-26T12:05:54.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:05:54.932 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:54.932 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.932 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:54.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:54.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:54.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:54.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:54.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:54.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:54.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:54.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:05:54.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:05:54.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:54.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:05:54.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:05:54.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:05:54.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:05:54.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:54.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:05:54.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:05:54.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:54.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:05:54.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:05:54.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:54.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:05:54.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:05:54.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:54.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:05:54.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:05:54.936 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.936 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:54.936 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.936 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:54.936 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:54.936 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 51.089430061999998, 2024-04-26T12:05:54.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:05:54.937 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:54.937 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.937 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:54.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:54.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:54.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:54.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:54.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:54.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:54.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:54.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:05:54.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:05:54.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:54.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:05:54.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:05:54.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:05:54.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:05:54.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:54.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:05:54.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:05:54.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:54.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:05:54.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:05:54.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:54.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:05:54.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:05:54.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:54.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:05:54.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:05:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:05:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 51.088750177000001, 2024-04-26T12:05:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:05:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:05:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:05:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:05:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:05:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:05:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:05:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:05:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:05:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:05:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:05:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 51.088720997999999, 2024-04-26T12:05:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:05:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:05:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:05:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:05:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:05:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:05:54.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:05:54.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:05:54.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:54.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:05:54.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:05:54.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:05:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:05:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:05:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:05:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:54.949 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:54.949 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 51.088689187, 2024-04-26T12:05:54.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:05:54.949 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:54.949 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:54.949 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:54.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:54.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:54.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:05:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:05:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:05:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:54.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:05:54.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:05:54.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:05:54.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:05:54.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:54.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:05:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:05:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:05:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:05:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:05:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:05:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.953 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:54.953 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:54.953 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 51.088667831000002, 2024-04-26T12:05:54.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:05:54.953 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:54.953 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:54.953 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:54.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:54.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:54.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:54.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:54.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:54.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:54.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:05:54.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:05:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:05:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:05:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:05:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:05:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:05:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:05:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:05:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:05:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:05:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:05:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:05:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:05:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 51.088639378000003, 2024-04-26T12:05:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:05:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:54.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:54.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:54.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:54.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:54.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:54.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:05:54.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:05:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:05:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:05:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:05:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:05:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:05:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:05:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:05:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:05:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:05:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 51.087917572000002, 2024-04-26T12:05:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:05:54.961 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:54.961 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:54.961 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:54.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:54.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:54.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:54.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:54.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:54.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:05:54.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:54.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:54.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:05:54.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:05:54.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:54.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:05:54.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:05:54.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:05:54.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:05:54.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:54.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:05:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:05:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:05:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:05:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:05:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 45.370990968999998, 2024-04-26T12:05:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:05:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:05:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:05:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:05:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:05:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:05:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:05:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:05:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:05:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:05:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:05:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:05:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:05:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:05:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:05:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:05:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:05:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:05:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:05:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:05:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:05:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:05:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:05:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:54.969 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:54.970 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:05:54.972 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:54.970+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:54.972 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:55.037 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:05:55.037 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:05:55.038 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-26T12:05:55.038 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T12:05:55.072 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:55.071+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:55.087 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:55.087 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:05:55.087 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-04-26T12:05:55.087 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:55.097 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:55.173 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:55.172+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:55.201 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:55.201 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:05:55.201 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T12:05:55.201 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T12:05:55.202 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:55.210 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:55.274 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:55.273+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:55.340 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:55.340 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-26T12:05:55.340 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 30, 2024-04-26T12:05:55.340 INFO:teuthology.orchestra.run.smithi052.stdout: "fsid": "5bc300ae-e948-4ce3-81bb-5abae8c06799", 2024-04-26T12:05:55.340 INFO:teuthology.orchestra.run.smithi052.stdout: "created": "2024-04-26T12:04:41.919527+0000", 2024-04-26T12:05:55.340 INFO:teuthology.orchestra.run.smithi052.stdout: "modified": "2024-04-26T12:05:52.894742+0000", 2024-04-26T12:05:55.341 INFO:teuthology.orchestra.run.smithi052.stdout: "last_up_change": "2024-04-26T12:04:51.084680+0000", 2024-04-26T12:05:55.341 INFO:teuthology.orchestra.run.smithi052.stdout: "last_in_change": "2024-04-26T12:04:43.540390+0000", 2024-04-26T12:05:55.341 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T12:05:55.341 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_num": 5806080, 2024-04-26T12:05:55.341 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_set": [ 2024-04-26T12:05:55.341 INFO:teuthology.orchestra.run.smithi052.stdout: "nodeep-scrub", 2024-04-26T12:05:55.341 INFO:teuthology.orchestra.run.smithi052.stdout: "noscrub", 2024-04-26T12:05:55.341 INFO:teuthology.orchestra.run.smithi052.stdout: "pglog_hardlimit", 2024-04-26T12:05:55.341 INFO:teuthology.orchestra.run.smithi052.stdout: "purged_snapdirs", 2024-04-26T12:05:55.341 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_deletes", 2024-04-26T12:05:55.341 INFO:teuthology.orchestra.run.smithi052.stdout: "sortbitwise" 2024-04-26T12:05:55.341 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-04-26T12:05:55.341 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_version": 4, 2024-04-26T12:05:55.342 INFO:teuthology.orchestra.run.smithi052.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T12:05:55.342 INFO:teuthology.orchestra.run.smithi052.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T12:05:55.342 INFO:teuthology.orchestra.run.smithi052.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T12:05:55.342 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_snapshot": "", 2024-04-26T12:05:55.342 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_max": 4, 2024-04-26T12:05:55.342 INFO:teuthology.orchestra.run.smithi052.stdout: "max_osd": 3, 2024-04-26T12:05:55.342 INFO:teuthology.orchestra.run.smithi052.stdout: "require_min_compat_client": "luminous", 2024-04-26T12:05:55.342 INFO:teuthology.orchestra.run.smithi052.stdout: "min_compat_client": "jewel", 2024-04-26T12:05:55.342 INFO:teuthology.orchestra.run.smithi052.stdout: "require_osd_release": "reef", 2024-04-26T12:05:55.342 INFO:teuthology.orchestra.run.smithi052.stdout: "allow_crimson": false, 2024-04-26T12:05:55.342 INFO:teuthology.orchestra.run.smithi052.stdout: "pools": [ 2024-04-26T12:05:55.342 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.342 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 1, 2024-04-26T12:05:55.343 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": ".mgr", 2024-04-26T12:05:55.343 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-04-26T12:04:52.376506+0000", 2024-04-26T12:05:55.343 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-04-26T12:05:55.343 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-04-26T12:05:55.343 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-04-26T12:05:55.343 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-04-26T12:05:55.343 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-04-26T12:05:55.343 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-04-26T12:05:55.343 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:05:55.343 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:05:55.343 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:05:55.343 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:05:55.343 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-04-26T12:05:55.343 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:05:55.343 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 1, 2024-04-26T12:05:55.344 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 1, 2024-04-26T12:05:55.344 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 1, 2024-04-26T12:05:55.344 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 1, 2024-04-26T12:05:55.344 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 1, 2024-04-26T12:05:55.344 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-04-26T12:05:55.344 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-04-26T12:05:55.344 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-04-26T12:05:55.344 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-04-26T12:05:55.344 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-04-26T12:05:55.344 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-04-26T12:05:55.344 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-04-26T12:05:55.344 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.344 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "11", 2024-04-26T12:05:55.344 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-04-26T12:05:55.345 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:05:55.345 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:05:55.345 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-04-26T12:05:55.345 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:05:55.345 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-04-26T12:05:55.345 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-04-26T12:05:55.345 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-04-26T12:05:55.345 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-04-26T12:05:55.345 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-04-26T12:05:55.345 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-04-26T12:05:55.345 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-04-26T12:05:55.345 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-04-26T12:05:55.345 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-04-26T12:05:55.346 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-04-26T12:05:55.346 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-04-26T12:05:55.346 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-04-26T12:05:55.346 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-04-26T12:05:55.346 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:05:55.346 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:05:55.346 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:05:55.346 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-04-26T12:05:55.347 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-04-26T12:05:55.347 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-04-26T12:05:55.347 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-04-26T12:05:55.347 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-04-26T12:05:55.347 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.347 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-04-26T12:05:55.347 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-04-26T12:05:55.347 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-04-26T12:05:55.347 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:05:55.347 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:05:55.347 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:05:55.347 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:05:55.347 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-04-26T12:05:55.347 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-04-26T12:05:55.348 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-04-26T12:05:55.348 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-04-26T12:05:55.348 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-04-26T12:05:55.348 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_max": 32, 2024-04-26T12:05:55.348 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 1 2024-04-26T12:05:55.348 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.348 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-04-26T12:05:55.348 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": {} 2024-04-26T12:05:55.348 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.348 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-04-26T12:05:55.348 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 2.9900000095367432, 2024-04-26T12:05:55.348 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 2.9900000095367432, 2024-04-26T12:05:55.349 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T12:05:55.349 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 2, 2024-04-26T12:05:55.349 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 2, 2024-04-26T12:05:55.349 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:05:55.349 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-04-26T12:05:55.349 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:05:55.349 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:55.349 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.349 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.349 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 2, 2024-04-26T12:05:55.349 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "rbd", 2024-04-26T12:05:55.350 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-04-26T12:04:57.775333+0000", 2024-04-26T12:05:55.350 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-04-26T12:05:55.350 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-04-26T12:05:55.350 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-04-26T12:05:55.350 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-04-26T12:05:55.350 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-04-26T12:05:55.350 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-04-26T12:05:55.350 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:05:55.350 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:05:55.350 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:05:55.350 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:05:55.350 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-04-26T12:05:55.351 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:05:55.351 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 8, 2024-04-26T12:05:55.351 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 8, 2024-04-26T12:05:55.351 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 8, 2024-04-26T12:05:55.351 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 8, 2024-04-26T12:05:55.351 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 8, 2024-04-26T12:05:55.351 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-04-26T12:05:55.351 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-04-26T12:05:55.351 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-04-26T12:05:55.351 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-04-26T12:05:55.351 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-04-26T12:05:55.352 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-04-26T12:05:55.352 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-04-26T12:05:55.352 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.352 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "14", 2024-04-26T12:05:55.352 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-04-26T12:05:55.352 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:05:55.352 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:05:55.352 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-04-26T12:05:55.352 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:05:55.352 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-04-26T12:05:55.352 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-04-26T12:05:55.352 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-04-26T12:05:55.352 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-04-26T12:05:55.353 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-04-26T12:05:55.353 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-04-26T12:05:55.353 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-04-26T12:05:55.353 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-04-26T12:05:55.353 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-04-26T12:05:55.353 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-04-26T12:05:55.353 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-04-26T12:05:55.353 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-04-26T12:05:55.353 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-04-26T12:05:55.354 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:05:55.354 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:05:55.354 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:05:55.354 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-04-26T12:05:55.354 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-04-26T12:05:55.354 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-04-26T12:05:55.354 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-04-26T12:05:55.354 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-04-26T12:05:55.354 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.354 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-04-26T12:05:55.354 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-04-26T12:05:55.355 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-04-26T12:05:55.355 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:05:55.355 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:05:55.355 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:05:55.355 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:05:55.355 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-04-26T12:05:55.355 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-04-26T12:05:55.355 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-04-26T12:05:55.355 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-04-26T12:05:55.355 INFO:teuthology.orchestra.run.smithi052.stdout: "options": {}, 2024-04-26T12:05:55.355 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-04-26T12:05:55.355 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd": {} 2024-04-26T12:05:55.356 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.356 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-04-26T12:05:55.356 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.5, 2024-04-26T12:05:55.356 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.5, 2024-04-26T12:05:55.356 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-04-26T12:05:55.356 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.5, 2024-04-26T12:05:55.356 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.5, 2024-04-26T12:05:55.356 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:05:55.356 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-04-26T12:05:55.356 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:05:55.357 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:55.357 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.357 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.357 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 3, 2024-04-26T12:05:55.357 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "cephfs_metadata", 2024-04-26T12:05:55.357 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-04-26T12:05:02.226064+0000", 2024-04-26T12:05:55.357 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-04-26T12:05:55.357 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-04-26T12:05:55.357 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-04-26T12:05:55.357 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-04-26T12:05:55.357 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-04-26T12:05:55.358 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-04-26T12:05:55.358 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:05:55.358 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:05:55.358 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:05:55.358 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:05:55.358 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-04-26T12:05:55.358 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:05:55.358 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 32, 2024-04-26T12:05:55.358 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 32, 2024-04-26T12:05:55.358 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 32, 2024-04-26T12:05:55.358 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 32, 2024-04-26T12:05:55.359 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 32, 2024-04-26T12:05:55.359 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-04-26T12:05:55.359 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-04-26T12:05:55.359 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-04-26T12:05:55.359 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-04-26T12:05:55.359 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-04-26T12:05:55.359 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-04-26T12:05:55.359 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-04-26T12:05:55.359 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.359 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "17", 2024-04-26T12:05:55.359 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-04-26T12:05:55.359 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:05:55.359 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:05:55.359 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-04-26T12:05:55.359 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:05:55.360 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-04-26T12:05:55.360 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-04-26T12:05:55.360 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-04-26T12:05:55.360 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-04-26T12:05:55.360 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-04-26T12:05:55.360 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-04-26T12:05:55.360 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-04-26T12:05:55.360 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-04-26T12:05:55.360 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-04-26T12:05:55.360 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-04-26T12:05:55.360 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-04-26T12:05:55.360 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-04-26T12:05:55.360 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-04-26T12:05:55.360 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:05:55.361 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:05:55.361 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:05:55.361 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-04-26T12:05:55.361 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-04-26T12:05:55.361 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-04-26T12:05:55.361 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-04-26T12:05:55.361 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-04-26T12:05:55.361 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.361 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-04-26T12:05:55.361 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-04-26T12:05:55.361 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-04-26T12:05:55.361 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:05:55.361 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:05:55.361 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:05:55.362 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:05:55.362 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-04-26T12:05:55.362 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-04-26T12:05:55.362 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-04-26T12:05:55.362 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-04-26T12:05:55.362 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-04-26T12:05:55.362 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_bias": 4, 2024-04-26T12:05:55.362 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 16, 2024-04-26T12:05:55.362 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_priority": 5 2024-04-26T12:05:55.362 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.362 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-04-26T12:05:55.362 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs": { 2024-04-26T12:05:55.362 INFO:teuthology.orchestra.run.smithi052.stdout: "metadata": "cephfs" 2024-04-26T12:05:55.362 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:55.362 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.363 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-04-26T12:05:55.363 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.1299999952316284, 2024-04-26T12:05:55.363 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.1299999952316284, 2024-04-26T12:05:55.363 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-04-26T12:05:55.363 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T12:05:55.363 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T12:05:55.363 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:05:55.363 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-04-26T12:05:55.363 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:05:55.363 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:55.363 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.363 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.363 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 4, 2024-04-26T12:05:55.363 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "cephfs_data", 2024-04-26T12:05:55.363 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-04-26T12:05:02.758806+0000", 2024-04-26T12:05:55.364 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-04-26T12:05:55.364 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-04-26T12:05:55.364 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-04-26T12:05:55.364 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-04-26T12:05:55.364 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-04-26T12:05:55.364 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-04-26T12:05:55.364 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:05:55.364 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:05:55.364 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:05:55.364 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:05:55.364 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-04-26T12:05:55.364 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:05:55.364 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 64, 2024-04-26T12:05:55.364 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 64, 2024-04-26T12:05:55.365 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 64, 2024-04-26T12:05:55.365 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 64, 2024-04-26T12:05:55.365 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 64, 2024-04-26T12:05:55.365 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-04-26T12:05:55.365 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-04-26T12:05:55.365 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-04-26T12:05:55.365 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-04-26T12:05:55.365 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-04-26T12:05:55.365 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-04-26T12:05:55.365 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-04-26T12:05:55.365 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.365 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "18", 2024-04-26T12:05:55.365 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-04-26T12:05:55.365 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:05:55.365 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:05:55.366 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-04-26T12:05:55.366 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:05:55.366 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-04-26T12:05:55.366 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-04-26T12:05:55.366 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-04-26T12:05:55.366 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-04-26T12:05:55.366 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-04-26T12:05:55.366 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-04-26T12:05:55.366 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-04-26T12:05:55.366 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-04-26T12:05:55.366 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-04-26T12:05:55.366 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-04-26T12:05:55.366 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-04-26T12:05:55.366 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-04-26T12:05:55.367 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-04-26T12:05:55.367 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:05:55.367 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:05:55.367 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:05:55.367 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-04-26T12:05:55.367 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-04-26T12:05:55.367 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-04-26T12:05:55.367 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-04-26T12:05:55.367 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-04-26T12:05:55.367 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.367 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-04-26T12:05:55.367 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-04-26T12:05:55.367 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-04-26T12:05:55.369 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:05:55.369 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:05:55.369 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:05:55.369 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:05:55.369 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-04-26T12:05:55.369 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-04-26T12:05:55.369 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-04-26T12:05:55.369 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-04-26T12:05:55.370 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-04-26T12:05:55.370 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 64, 2024-04-26T12:05:55.370 INFO:teuthology.orchestra.run.smithi052.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T12:05:55.370 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.370 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-04-26T12:05:55.370 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs": { 2024-04-26T12:05:55.370 INFO:teuthology.orchestra.run.smithi052.stdout: "data": "cephfs" 2024-04-26T12:05:55.370 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:55.370 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.370 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-04-26T12:05:55.370 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.1299999952316284, 2024-04-26T12:05:55.370 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.1299999952316284, 2024-04-26T12:05:55.370 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-04-26T12:05:55.370 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T12:05:55.371 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T12:05:55.371 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:05:55.371 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-04-26T12:05:55.371 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:05:55.371 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:55.371 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:55.371 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-04-26T12:05:55.371 INFO:teuthology.orchestra.run.smithi052.stdout: "osds": [ 2024-04-26T12:05:55.371 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.371 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-04-26T12:05:55.371 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "638cfa85-e921-4403-9bcb-a7f4653cc3b2", 2024-04-26T12:05:55.371 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-04-26T12:05:55.371 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-04-26T12:05:55.371 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-04-26T12:05:55.372 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-04-26T12:05:55.372 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-04-26T12:05:55.372 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-04-26T12:05:55.372 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-04-26T12:05:55.372 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 16, 2024-04-26T12:05:55.372 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-04-26T12:05:55.372 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-04-26T12:05:55.372 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-04-26T12:05:55.372 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:05:55.372 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.372 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:05:55.372 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.143:6800", 2024-04-26T12:05:55.372 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28597 2024-04-26T12:05:55.372 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.373 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.373 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:55.373 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.143:6801", 2024-04-26T12:05:55.373 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28597 2024-04-26T12:05:55.373 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:55.373 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:55.373 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.373 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-04-26T12:05:55.373 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:05:55.373 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.373 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:05:55.373 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.143:6802", 2024-04-26T12:05:55.373 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28597 2024-04-26T12:05:55.373 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.374 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.374 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:55.374 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.143:6803", 2024-04-26T12:05:55.374 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28597 2024-04-26T12:05:55.374 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:55.374 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:55.374 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.374 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-04-26T12:05:55.374 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:05:55.374 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.374 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:05:55.374 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.143:6806", 2024-04-26T12:05:55.374 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28597 2024-04-26T12:05:55.374 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.375 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.375 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:55.375 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.143:6807", 2024-04-26T12:05:55.375 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28597 2024-04-26T12:05:55.375 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:55.375 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:55.375 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.375 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-04-26T12:05:55.375 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:05:55.375 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.375 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:05:55.375 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.143:6804", 2024-04-26T12:05:55.375 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28597 2024-04-26T12:05:55.375 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.376 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.376 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:55.376 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.143:6805", 2024-04-26T12:05:55.376 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28597 2024-04-26T12:05:55.376 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:55.376 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:55.376 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.376 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.143:6801/28597", 2024-04-26T12:05:55.376 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.143:6803/28597", 2024-04-26T12:05:55.376 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.143:6807/28597", 2024-04-26T12:05:55.376 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.143:6805/28597", 2024-04-26T12:05:55.376 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-04-26T12:05:55.376 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-04-26T12:05:55.376 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-04-26T12:05:55.376 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:55.377 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.377 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.377 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 1, 2024-04-26T12:05:55.377 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "2abc8d1e-ad72-4643-ad1e-3566e5113c44", 2024-04-26T12:05:55.377 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-04-26T12:05:55.377 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-04-26T12:05:55.377 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-04-26T12:05:55.377 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-04-26T12:05:55.377 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-04-26T12:05:55.377 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-04-26T12:05:55.377 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-04-26T12:05:55.377 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 16, 2024-04-26T12:05:55.377 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-04-26T12:05:55.378 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-04-26T12:05:55.378 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-04-26T12:05:55.378 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:05:55.378 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.378 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:05:55.378 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6800", 2024-04-26T12:05:55.378 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28560 2024-04-26T12:05:55.378 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.378 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.378 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:55.378 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6801", 2024-04-26T12:05:55.378 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28560 2024-04-26T12:05:55.378 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:55.378 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:55.379 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.379 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-04-26T12:05:55.379 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:05:55.379 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.379 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:05:55.379 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6802", 2024-04-26T12:05:55.379 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28560 2024-04-26T12:05:55.379 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.379 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.379 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:55.379 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6803", 2024-04-26T12:05:55.379 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28560 2024-04-26T12:05:55.379 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:55.379 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:55.379 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.380 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-04-26T12:05:55.380 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:05:55.380 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.380 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:05:55.380 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6806", 2024-04-26T12:05:55.380 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28560 2024-04-26T12:05:55.380 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.380 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.380 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:55.380 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6807", 2024-04-26T12:05:55.380 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28560 2024-04-26T12:05:55.380 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:55.380 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:55.380 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.380 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-04-26T12:05:55.381 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:05:55.381 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.381 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:05:55.381 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6804", 2024-04-26T12:05:55.381 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28560 2024-04-26T12:05:55.381 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.381 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.381 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:55.381 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6805", 2024-04-26T12:05:55.381 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28560 2024-04-26T12:05:55.381 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:55.381 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:55.381 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.381 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.154:6801/28560", 2024-04-26T12:05:55.381 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.154:6803/28560", 2024-04-26T12:05:55.382 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.154:6807/28560", 2024-04-26T12:05:55.382 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.154:6805/28560", 2024-04-26T12:05:55.382 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-04-26T12:05:55.382 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-04-26T12:05:55.382 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-04-26T12:05:55.382 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:55.382 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.382 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.382 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-04-26T12:05:55.382 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "d2ebc562-cb9b-4089-a19b-1788b70b57dc", 2024-04-26T12:05:55.382 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-04-26T12:05:55.382 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-04-26T12:05:55.382 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-04-26T12:05:55.382 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-04-26T12:05:55.382 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-04-26T12:05:55.383 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-04-26T12:05:55.383 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-04-26T12:05:55.383 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 16, 2024-04-26T12:05:55.383 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-04-26T12:05:55.383 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-04-26T12:05:55.383 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-04-26T12:05:55.383 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:05:55.383 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.384 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:05:55.384 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6800", 2024-04-26T12:05:55.384 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28709 2024-04-26T12:05:55.384 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.384 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.384 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:55.384 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6801", 2024-04-26T12:05:55.384 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28709 2024-04-26T12:05:55.384 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:55.384 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:55.384 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.384 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-04-26T12:05:55.384 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:05:55.384 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.384 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:05:55.385 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6802", 2024-04-26T12:05:55.385 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28709 2024-04-26T12:05:55.385 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.385 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.385 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:55.385 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6803", 2024-04-26T12:05:55.385 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28709 2024-04-26T12:05:55.385 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:55.385 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:55.385 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.385 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-04-26T12:05:55.386 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:05:55.386 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.386 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:05:55.386 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6806", 2024-04-26T12:05:55.386 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28709 2024-04-26T12:05:55.386 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.386 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.386 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:55.386 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6807", 2024-04-26T12:05:55.386 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28709 2024-04-26T12:05:55.386 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:55.386 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:55.386 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.386 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-04-26T12:05:55.387 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:05:55.387 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.387 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:05:55.387 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6804", 2024-04-26T12:05:55.387 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28709 2024-04-26T12:05:55.387 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.387 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.387 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:05:55.387 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6805", 2024-04-26T12:05:55.387 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28709 2024-04-26T12:05:55.388 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:55.388 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:55.388 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.388 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.164:6801/28709", 2024-04-26T12:05:55.388 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.164:6803/28709", 2024-04-26T12:05:55.388 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.164:6807/28709", 2024-04-26T12:05:55.388 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.164:6805/28709", 2024-04-26T12:05:55.388 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-04-26T12:05:55.388 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-04-26T12:05:55.388 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-04-26T12:05:55.388 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:05:55.388 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:55.388 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-04-26T12:05:55.388 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_xinfo": [ 2024-04-26T12:05:55.389 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.389 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-04-26T12:05:55.389 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-04-26T12:05:55.389 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-04-26T12:05:55.389 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-04-26T12:05:55.389 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540138322906710015, 2024-04-26T12:05:55.389 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-04-26T12:05:55.389 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-04-26T12:04:48.573478+0000", 2024-04-26T12:05:55.389 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-04-26T12:05:55.389 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.389 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.389 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 1, 2024-04-26T12:05:55.390 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-04-26T12:05:55.390 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-04-26T12:05:55.390 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-04-26T12:05:55.390 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540138322906710015, 2024-04-26T12:05:55.390 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-04-26T12:05:55.390 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-04-26T12:04:48.624482+0000", 2024-04-26T12:05:55.390 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-04-26T12:05:55.390 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.390 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:05:55.390 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-04-26T12:05:55.390 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-04-26T12:05:55.390 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-04-26T12:05:55.391 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-04-26T12:05:55.391 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540138322906710015, 2024-04-26T12:05:55.391 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-04-26T12:05:55.391 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-04-26T12:04:48.615449+0000", 2024-04-26T12:05:55.391 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-04-26T12:05:55.391 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:55.391 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-04-26T12:05:55.391 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap": [], 2024-04-26T12:05:55.391 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap_items": [], 2024-04-26T12:05:55.391 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap_primaries": [], 2024-04-26T12:05:55.392 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_temp": [], 2024-04-26T12:05:55.392 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_temp": [], 2024-04-26T12:05:55.392 INFO:teuthology.orchestra.run.smithi052.stdout: "blocklist": {}, 2024-04-26T12:05:55.392 INFO:teuthology.orchestra.run.smithi052.stdout: "range_blocklist": {}, 2024-04-26T12:05:55.392 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profiles": { 2024-04-26T12:05:55.392 INFO:teuthology.orchestra.run.smithi052.stdout: "default": { 2024-04-26T12:05:55.392 INFO:teuthology.orchestra.run.smithi052.stdout: "crush-failure-domain": "osd", 2024-04-26T12:05:55.392 INFO:teuthology.orchestra.run.smithi052.stdout: "k": "2", 2024-04-26T12:05:55.392 INFO:teuthology.orchestra.run.smithi052.stdout: "m": "1", 2024-04-26T12:05:55.392 INFO:teuthology.orchestra.run.smithi052.stdout: "plugin": "jerasure", 2024-04-26T12:05:55.392 INFO:teuthology.orchestra.run.smithi052.stdout: "technique": "reed_sol_van" 2024-04-26T12:05:55.393 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:55.393 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:05:55.393 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps_queue": [], 2024-04-26T12:05:55.393 INFO:teuthology.orchestra.run.smithi052.stdout: "new_removed_snaps": [], 2024-04-26T12:05:55.393 INFO:teuthology.orchestra.run.smithi052.stdout: "new_purged_snaps": [], 2024-04-26T12:05:55.393 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_node_flags": {}, 2024-04-26T12:05:55.393 INFO:teuthology.orchestra.run.smithi052.stdout: "device_class_flags": {}, 2024-04-26T12:05:55.393 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode": { 2024-04-26T12:05:55.393 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode_enabled": false, 2024-04-26T12:05:55.393 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_bucket_count": 0, 2024-04-26T12:05:55.393 INFO:teuthology.orchestra.run.smithi052.stdout: "degraded_stretch_mode": 0, 2024-04-26T12:05:55.393 INFO:teuthology.orchestra.run.smithi052.stdout: "recovering_stretch_mode": 0, 2024-04-26T12:05:55.394 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode_bucket": 0 2024-04-26T12:05:55.394 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:05:55.394 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-26T12:05:55.397 INFO:tasks.thrashosds.thrasher:j is {'epoch': 30, 'fsid': '5bc300ae-e948-4ce3-81bb-5abae8c06799', 'created': '2024-04-26T12:04:41.919527+0000', 'modified': '2024-04-26T12:05:52.894742+0000', 'last_up_change': '2024-04-26T12:04:51.084680+0000', 'last_in_change': '2024-04-26T12:04:43.540390+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:04:52.376506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:04:57.775333+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:05:02.226064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:05:02.758806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '638cfa85-e921-4403-9bcb-a7f4653cc3b2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6800', 'nonce': 28597}, {'type': 'v1', 'addr': '172.21.15.143:6801', 'nonce': 28597}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6802', 'nonce': 28597}, {'type': 'v1', 'addr': '172.21.15.143:6803', 'nonce': 28597}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6806', 'nonce': 28597}, {'type': 'v1', 'addr': '172.21.15.143:6807', 'nonce': 28597}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6804', 'nonce': 28597}, {'type': 'v1', 'addr': '172.21.15.143:6805', 'nonce': 28597}]}, 'public_addr': '172.21.15.143:6801/28597', 'cluster_addr': '172.21.15.143:6803/28597', 'heartbeat_back_addr': '172.21.15.143:6807/28597', 'heartbeat_front_addr': '172.21.15.143:6805/28597', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '2abc8d1e-ad72-4643-ad1e-3566e5113c44', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6800', 'nonce': 28560}, {'type': 'v1', 'addr': '172.21.15.154:6801', 'nonce': 28560}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6802', 'nonce': 28560}, {'type': 'v1', 'addr': '172.21.15.154:6803', 'nonce': 28560}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6806', 'nonce': 28560}, {'type': 'v1', 'addr': '172.21.15.154:6807', 'nonce': 28560}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6804', 'nonce': 28560}, {'type': 'v1', 'addr': '172.21.15.154:6805', 'nonce': 28560}]}, 'public_addr': '172.21.15.154:6801/28560', 'cluster_addr': '172.21.15.154:6803/28560', 'heartbeat_back_addr': '172.21.15.154:6807/28560', 'heartbeat_front_addr': '172.21.15.154:6805/28560', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'd2ebc562-cb9b-4089-a19b-1788b70b57dc', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6800', 'nonce': 28709}, {'type': 'v1', 'addr': '172.21.15.164:6801', 'nonce': 28709}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6802', 'nonce': 28709}, {'type': 'v1', 'addr': '172.21.15.164:6803', 'nonce': 28709}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6806', 'nonce': 28709}, {'type': 'v1', 'addr': '172.21.15.164:6807', 'nonce': 28709}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6804', 'nonce': 28709}, {'type': 'v1', 'addr': '172.21.15.164:6805', 'nonce': 28709}]}, 'public_addr': '172.21.15.164:6801/28709', 'cluster_addr': '172.21.15.164:6803/28709', 'heartbeat_back_addr': '172.21.15.164:6807/28709', 'heartbeat_front_addr': '172.21.15.164:6805/28709', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:04:48.573478+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:04:48.624482+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:04:48.615449+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T12:05:55.397 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:05:55.398 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:55.398 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T12:05:55.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T12:05:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T12:05:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.571684562000002, 2024-04-26T12:05:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017255857999999999, 2024-04-26T12:05:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780340+0000", 2024-04-26T12:05:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780351+0000", 2024-04-26T12:05:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0898e-05 2024-04-26T12:05:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1671999999999999e-05 2024-04-26T12:05:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780374+0000", 2024-04-26T12:05:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1117999999999999e-05 2024-04-26T12:05:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780423+0000", 2024-04-26T12:05:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9066000000000001e-05 2024-04-26T12:05:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780428+0000", 2024-04-26T12:05:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1320000000000002e-06 2024-04-26T12:05:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788902+0000", 2024-04-26T12:05:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084738560000000001 2024-04-26T12:05:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789167+0000", 2024-04-26T12:05:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026521100000000001 2024-04-26T12:05:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789279+0000", 2024-04-26T12:05:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111616 2024-04-26T12:05:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792335+0000", 2024-04-26T12:05:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030556419999999999 2024-04-26T12:05:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797519+0000", 2024-04-26T12:05:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051841550000000002 2024-04-26T12:05:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797559+0000", 2024-04-26T12:05:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0451999999999998e-05 2024-04-26T12:05:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797598+0000", 2024-04-26T12:05:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8500000000000001e-05 2024-04-26T12:05:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.571636255000001, 2024-04-26T12:05:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017668725, 2024-04-26T12:05:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780395+0000", 2024-04-26T12:05:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.198e-06 2024-04-26T12:05:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780402+0000", 2024-04-26T12:05:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:05:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780408+0000", 2024-04-26T12:05:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780481+0000", 2024-04-26T12:05:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3239999999999997e-05 2024-04-26T12:05:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:55.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780485+0000", 2024-04-26T12:05:55.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4039999999999999e-06 2024-04-26T12:05:55.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789518+0000", 2024-04-26T12:05:55.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090335480000000006 2024-04-26T12:05:55.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:55.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789585+0000", 2024-04-26T12:05:55.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6469000000000003e-05 2024-04-26T12:05:55.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:55.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789699+0000", 2024-04-26T12:05:55.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114613 2024-04-26T12:05:55.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:55.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793308+0000", 2024-04-26T12:05:55.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036088520000000001 2024-04-26T12:05:55.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:55.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797887+0000", 2024-04-26T12:05:55.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0045792790000000003 2024-04-26T12:05:55.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:55.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797955+0000", 2024-04-26T12:05:55.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T12:05:55.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:55.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798059+0000", 2024-04-26T12:05:55.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103874 2024-04-26T12:05:55.410 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.410 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:55.410 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.410 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:55.410 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:55.411 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.571605982999998, 2024-04-26T12:05:55.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017735145000000001, 2024-04-26T12:05:55.411 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:55.411 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:55.411 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:55.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:55.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:55.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:55.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:55.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:55.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:55.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:55.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:55.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780424+0000", 2024-04-26T12:05:55.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4519999999999999e-06 2024-04-26T12:05:55.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:55.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780431+0000", 2024-04-26T12:05:55.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0690000000000004e-06 2024-04-26T12:05:55.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:55.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780438+0000", 2024-04-26T12:05:55.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5719999999999999e-06 2024-04-26T12:05:55.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780468+0000", 2024-04-26T12:05:55.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.993e-05 2024-04-26T12:05:55.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:55.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780472+0000", 2024-04-26T12:05:55.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-04-26T12:05:55.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789916+0000", 2024-04-26T12:05:55.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094434940000000002 2024-04-26T12:05:55.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:55.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790004+0000", 2024-04-26T12:05:55.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8085999999999997e-05 2024-04-26T12:05:55.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:55.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790125+0000", 2024-04-26T12:05:55.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012186200000000001 2024-04-26T12:05:55.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:55.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793402+0000", 2024-04-26T12:05:55.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00327685 2024-04-26T12:05:55.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:55.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798068+0000", 2024-04-26T12:05:55.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046652150000000003 2024-04-26T12:05:55.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:55.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798108+0000", 2024-04-26T12:05:55.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0911000000000002e-05 2024-04-26T12:05:55.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:55.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798156+0000", 2024-04-26T12:05:55.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7128e-05 2024-04-26T12:05:55.416 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.416 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:55.416 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.416 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:55.416 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:55.416 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.571582964000001, 2024-04-26T12:05:55.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017792624, 2024-04-26T12:05:55.416 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:55.416 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:55.417 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:55.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:55.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:55.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:55.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:55.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:55.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:55.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:55.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:55.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780447+0000", 2024-04-26T12:05:55.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8519999999999997e-06 2024-04-26T12:05:55.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:55.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780453+0000", 2024-04-26T12:05:55.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2999999999999998e-06 2024-04-26T12:05:55.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:55.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:55.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0760000000000002e-06 2024-04-26T12:05:55.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780502+0000", 2024-04-26T12:05:55.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4079999999999998e-05 2024-04-26T12:05:55.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:55.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:55.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5450000000000002e-06 2024-04-26T12:05:55.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790390+0000", 2024-04-26T12:05:55.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098850759999999996 2024-04-26T12:05:55.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:55.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790447+0000", 2024-04-26T12:05:55.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6752999999999997e-05 2024-04-26T12:05:55.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:55.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790547+0000", 2024-04-26T12:05:55.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100344 2024-04-26T12:05:55.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:55.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793864+0000", 2024-04-26T12:05:55.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033169749999999998 2024-04-26T12:05:55.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:55.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798164+0000", 2024-04-26T12:05:55.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043000690000000001 2024-04-26T12:05:55.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:55.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798204+0000", 2024-04-26T12:05:55.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9478999999999999e-05 2024-04-26T12:05:55.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:55.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798236+0000", 2024-04-26T12:05:55.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2478999999999999e-05 2024-04-26T12:05:55.422 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.422 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:55.422 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.422 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:55.422 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:55.422 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.571542620999999, 2024-04-26T12:05:55.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016989500000000001, 2024-04-26T12:05:55.423 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:55.423 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:55.423 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:55.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:55.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:55.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:55.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:55.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:55.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780483+0000", 2024-04-26T12:05:55.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:55.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:55.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780488+0000", 2024-04-26T12:05:55.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6260000000000003e-06 2024-04-26T12:05:55.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:55.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780499+0000", 2024-04-26T12:05:55.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1236000000000001e-05 2024-04-26T12:05:55.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:55.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:55.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4569999999999996e-06 2024-04-26T12:05:55.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780529+0000", 2024-04-26T12:05:55.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4579e-05 2024-04-26T12:05:55.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:55.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780532+0000", 2024-04-26T12:05:55.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.74e-06 2024-04-26T12:05:55.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788868+0000", 2024-04-26T12:05:55.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0083357650000000002 2024-04-26T12:05:55.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:55.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789142+0000", 2024-04-26T12:05:55.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027472 2024-04-26T12:05:55.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:55.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789241+0000", 2024-04-26T12:05:55.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8394999999999996e-05 2024-04-26T12:05:55.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:55.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792096+0000", 2024-04-26T12:05:55.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002855677 2024-04-26T12:05:55.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:55.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797379+0000", 2024-04-26T12:05:55.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052822379999999999 2024-04-26T12:05:55.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:55.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797433+0000", 2024-04-26T12:05:55.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4109e-05 2024-04-26T12:05:55.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:55.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797473+0000", 2024-04-26T12:05:55.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0533e-05 2024-04-26T12:05:55.429 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.429 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:55.429 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.429 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:55.429 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:55.430 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.571503006999997, 2024-04-26T12:05:55.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017295965, 2024-04-26T12:05:55.430 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:55.430 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:55.430 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:55.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:55.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:55.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:55.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:55.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:55.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780513+0000", 2024-04-26T12:05:55.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999895 2024-04-26T12:05:55.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:55.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780528+0000", 2024-04-26T12:05:55.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5089000000000001e-05 2024-04-26T12:05:55.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:55.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780537+0000", 2024-04-26T12:05:55.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8400000000000001e-06 2024-04-26T12:05:55.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:55.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780544+0000", 2024-04-26T12:05:55.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.917e-06 2024-04-26T12:05:55.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780571+0000", 2024-04-26T12:05:55.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7032000000000001e-05 2024-04-26T12:05:55.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:55.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780574+0000", 2024-04-26T12:05:55.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:05:55.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789436+0000", 2024-04-26T12:05:55.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088622240000000001 2024-04-26T12:05:55.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:55.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789525+0000", 2024-04-26T12:05:55.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8549999999999998e-05 2024-04-26T12:05:55.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:55.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789642+0000", 2024-04-26T12:05:55.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011772100000000001 2024-04-26T12:05:55.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:55.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792129+0000", 2024-04-26T12:05:55.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024871709999999998 2024-04-26T12:05:55.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:55.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797732+0000", 2024-04-26T12:05:55.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056027580000000002 2024-04-26T12:05:55.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:55.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797777+0000", 2024-04-26T12:05:55.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4620999999999999e-05 2024-04-26T12:05:55.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:55.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797819+0000", 2024-04-26T12:05:55.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2536000000000001e-05 2024-04-26T12:05:55.436 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.436 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:55.436 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.436 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:55.436 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:55.436 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.571474057000003, 2024-04-26T12:05:55.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017840163999999999, 2024-04-26T12:05:55.437 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:55.437 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:55.437 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:55.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:55.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:55.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:55.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:55.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:55.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:55.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:55.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:55.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:55.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5419999999999999e-06 2024-04-26T12:05:55.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:55.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780563+0000", 2024-04-26T12:05:55.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:05:55.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:55.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780569+0000", 2024-04-26T12:05:55.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1479999999999997e-06 2024-04-26T12:05:55.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780594+0000", 2024-04-26T12:05:55.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5585e-05 2024-04-26T12:05:55.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:55.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780596+0000", 2024-04-26T12:05:55.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2630000000000002e-06 2024-04-26T12:05:55.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789932+0000", 2024-04-26T12:05:55.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093360479999999996 2024-04-26T12:05:55.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:55.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790070+0000", 2024-04-26T12:05:55.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013771399999999999 2024-04-26T12:05:55.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:55.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790219+0000", 2024-04-26T12:05:55.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014872299999999999 2024-04-26T12:05:55.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:55.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793632+0000", 2024-04-26T12:05:55.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003413368 2024-04-26T12:05:55.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:55.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798244+0000", 2024-04-26T12:05:55.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046113819999999998 2024-04-26T12:05:55.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:55.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798361+0000", 2024-04-26T12:05:55.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117726 2024-04-26T12:05:55.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:55.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798393+0000", 2024-04-26T12:05:55.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1099999999999997e-05 2024-04-26T12:05:55.442 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.442 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:55.442 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.442 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:55.442 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:55.442 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.571449131999998, 2024-04-26T12:05:55.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016645943, 2024-04-26T12:05:55.443 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:55.443 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:55.443 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:55.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:55.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:55.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:55.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:55.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:55.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:55.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:55.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:55.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780580+0000", 2024-04-26T12:05:55.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1549999999999999e-06 2024-04-26T12:05:55.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:55.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780588+0000", 2024-04-26T12:05:55.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:05:55.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:55.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780593+0000", 2024-04-26T12:05:55.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2399999999999998e-06 2024-04-26T12:05:55.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780628+0000", 2024-04-26T12:05:55.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5426000000000003e-05 2024-04-26T12:05:55.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:55.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780632+0000", 2024-04-26T12:05:55.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:05:55.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788288+0000", 2024-04-26T12:05:55.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076555879999999996 2024-04-26T12:05:55.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:55.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788570+0000", 2024-04-26T12:05:55.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028233700000000002 2024-04-26T12:05:55.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:55.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797223+0000", 2024-04-26T12:05:55.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086529150000000006 2024-04-26T12:05:55.446 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.446 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:55.447 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.447 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:55.447 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:55.447 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.571425163000001, 2024-04-26T12:05:55.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016536068000000001, 2024-04-26T12:05:55.447 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:55.447 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:55.447 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:55.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:55.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:55.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:55.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:55.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:55.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:55.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:55.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:55.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780609+0000", 2024-04-26T12:05:55.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8280000000000003e-06 2024-04-26T12:05:55.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:55.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780616+0000", 2024-04-26T12:05:55.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4939999999999997e-06 2024-04-26T12:05:55.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:55.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780621+0000", 2024-04-26T12:05:55.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6040000000000003e-06 2024-04-26T12:05:55.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780647+0000", 2024-04-26T12:05:55.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6441999999999999e-05 2024-04-26T12:05:55.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:55.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780650+0000", 2024-04-26T12:05:55.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4430000000000002e-06 2024-04-26T12:05:55.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788163+0000", 2024-04-26T12:05:55.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007513774 2024-04-26T12:05:55.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:55.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788307+0000", 2024-04-26T12:05:55.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014374400000000001 2024-04-26T12:05:55.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:55.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797137+0000", 2024-04-26T12:05:55.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088302160000000001 2024-04-26T12:05:55.451 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.451 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:55.451 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.451 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:55.451 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:55.451 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.568548890999999, 2024-04-26T12:05:55.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012911448000000001, 2024-04-26T12:05:55.451 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:55.452 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:55.452 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:55.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:55.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:55.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:55.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:55.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:55.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783477+0000", 2024-04-26T12:05:55.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:55.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:55.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783482+0000", 2024-04-26T12:05:55.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5709999999999999e-06 2024-04-26T12:05:55.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:55.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783491+0000", 2024-04-26T12:05:55.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3610000000000007e-06 2024-04-26T12:05:55.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:55.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783498+0000", 2024-04-26T12:05:55.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4209999999999998e-06 2024-04-26T12:05:55.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786045+0000", 2024-04-26T12:05:55.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0025465739999999998 2024-04-26T12:05:55.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:55.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786061+0000", 2024-04-26T12:05:55.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6348999999999999e-05 2024-04-26T12:05:55.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:55.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796342+0000", 2024-04-26T12:05:55.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010280643000000001 2024-04-26T12:05:55.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:55.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796389+0000", 2024-04-26T12:05:55.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6912000000000001e-05 2024-04-26T12:05:55.455 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.455 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:55.455 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.455 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:55.455 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:55.455 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.568520585000002, 2024-04-26T12:05:55.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013376469, 2024-04-26T12:05:55.456 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:55.456 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:55.456 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:55.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:55.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:55.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:55.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:55.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:55.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:55.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:55.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:55.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783516+0000", 2024-04-26T12:05:55.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.041e-05 2024-04-26T12:05:55.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:55.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783523+0000", 2024-04-26T12:05:55.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5749999999999997e-06 2024-04-26T12:05:55.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:55.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783528+0000", 2024-04-26T12:05:55.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5029999999999997e-06 2024-04-26T12:05:55.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787662+0000", 2024-04-26T12:05:55.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041336230000000003 2024-04-26T12:05:55.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:55.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787687+0000", 2024-04-26T12:05:55.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5769999999999999e-05 2024-04-26T12:05:55.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:55.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796817+0000", 2024-04-26T12:05:55.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091296750000000003 2024-04-26T12:05:55.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:55.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796882+0000", 2024-04-26T12:05:55.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5180999999999998e-05 2024-04-26T12:05:55.459 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.460 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:55.460 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.460 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:55.460 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:55.460 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.568452043999997, 2024-04-26T12:05:55.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013457291999999999, 2024-04-26T12:05:55.460 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:55.460 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:55.460 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:55.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:55.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:55.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:55.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:55.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:55.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:55.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:55.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:55.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783578+0000", 2024-04-26T12:05:55.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.659e-06 2024-04-26T12:05:55.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:55.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783584+0000", 2024-04-26T12:05:55.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:55.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:55.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783588+0000", 2024-04-26T12:05:55.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6190000000000002e-06 2024-04-26T12:05:55.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787834+0000", 2024-04-26T12:05:55.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042460529999999996 2024-04-26T12:05:55.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:55.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787854+0000", 2024-04-26T12:05:55.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9658999999999999e-05 2024-04-26T12:05:55.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:55.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:55.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009107604 2024-04-26T12:05:55.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:55.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797032+0000", 2024-04-26T12:05:55.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9987000000000006e-05 2024-04-26T12:05:55.464 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.464 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:55.465 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.465 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:55.465 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:55.465 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.566605664999997, 2024-04-26T12:05:55.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011003015999999999, 2024-04-26T12:05:55.465 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:55.465 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:55.465 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:55.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:55.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:55.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:55.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:55.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:55.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785420+0000", 2024-04-26T12:05:55.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:55.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:55.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785427+0000", 2024-04-26T12:05:55.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:05:55.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:55.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785438+0000", 2024-04-26T12:05:55.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069e-05 2024-04-26T12:05:55.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:55.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785457+0000", 2024-04-26T12:05:55.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8617000000000001e-05 2024-04-26T12:05:55.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786628+0000", 2024-04-26T12:05:55.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001171418 2024-04-26T12:05:55.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:55.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786651+0000", 2024-04-26T12:05:55.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3289e-05 2024-04-26T12:05:55.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:55.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796393+0000", 2024-04-26T12:05:55.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097413269999999993 2024-04-26T12:05:55.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:55.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796424+0000", 2024-04-26T12:05:55.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1188e-05 2024-04-26T12:05:55.470 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.470 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:55.470 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.470 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:55.470 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:55.470 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.566058919, 2024-04-26T12:05:55.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010561432000000001, 2024-04-26T12:05:55.471 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:55.471 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:55.471 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:55.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:55.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:55.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:55.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:55.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:55.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:55.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:55.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:55.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785973+0000", 2024-04-26T12:05:55.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4910000000000002e-06 2024-04-26T12:05:55.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:55.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785991+0000", 2024-04-26T12:05:55.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7663e-05 2024-04-26T12:05:55.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:55.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785998+0000", 2024-04-26T12:05:55.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1239999999999999e-06 2024-04-26T12:05:55.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786792+0000", 2024-04-26T12:05:55.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079334800000000003 2024-04-26T12:05:55.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:55.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786810+0000", 2024-04-26T12:05:55.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8746999999999999e-05 2024-04-26T12:05:55.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:55.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796500+0000", 2024-04-26T12:05:55.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096897619999999993 2024-04-26T12:05:55.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:55.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796529+0000", 2024-04-26T12:05:55.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8873999999999998e-05 2024-04-26T12:05:55.474 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.474 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:55.474 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.475 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:55.475 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:55.475 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.565979833, 2024-04-26T12:05:55.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010219911, 2024-04-26T12:05:55.475 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:55.475 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:55.475 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:55.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:55.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:55.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:55.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:55.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:55.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786046+0000", 2024-04-26T12:05:55.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:55.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:55.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786053+0000", 2024-04-26T12:05:55.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0360000000000001e-06 2024-04-26T12:05:55.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:55.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786064+0000", 2024-04-26T12:05:55.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1202999999999999e-05 2024-04-26T12:05:55.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:55.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786091+0000", 2024-04-26T12:05:55.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6859000000000002e-05 2024-04-26T12:05:55.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786212+0000", 2024-04-26T12:05:55.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120975 2024-04-26T12:05:55.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:55.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786236+0000", 2024-04-26T12:05:55.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4358999999999998e-05 2024-04-26T12:05:55.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:55.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796236+0000", 2024-04-26T12:05:55.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099998050000000005 2024-04-26T12:05:55.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:55.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796266+0000", 2024-04-26T12:05:55.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0278e-05 2024-04-26T12:05:55.479 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.479 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:55.479 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.479 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:3 3.14 e17/15 3:287034c4:::1.00000000.inode:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:55.479 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:55.479 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.565190872000002, 2024-04-26T12:05:55.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009764712, 2024-04-26T12:05:55.479 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:55.479 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:55.479 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:55.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:55.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:55.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:55.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:55.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:55.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786835+0000", 2024-04-26T12:05:55.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T12:05:55.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:55.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786844+0000", 2024-04-26T12:05:55.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6500000000000008e-06 2024-04-26T12:05:55.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:55.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786855+0000", 2024-04-26T12:05:55.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0932e-05 2024-04-26T12:05:55.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:55.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786864+0000", 2024-04-26T12:05:55.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2150000000000007e-06 2024-04-26T12:05:55.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787242+0000", 2024-04-26T12:05:55.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037708300000000001 2024-04-26T12:05:55.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:55.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787259+0000", 2024-04-26T12:05:55.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7258999999999999e-05 2024-04-26T12:05:55.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:55.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796579+0000", 2024-04-26T12:05:55.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093201099999999995 2024-04-26T12:05:55.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:55.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796600+0000", 2024-04-26T12:05:55.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1330000000000001e-05 2024-04-26T12:05:55.483 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.483 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:55.483 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.483 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:55.483 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:55.483 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.565146849999998, 2024-04-26T12:05:55.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096431940000000008, 2024-04-26T12:05:55.483 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:55.483 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:55.484 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:55.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:55.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:55.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:55.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:55.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:55.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786879+0000", 2024-04-26T12:05:55.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:55.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:55.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786887+0000", 2024-04-26T12:05:55.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9300000000000003e-06 2024-04-26T12:05:55.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:55.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786894+0000", 2024-04-26T12:05:55.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:05:55.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:55.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786899+0000", 2024-04-26T12:05:55.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8400000000000002e-06 2024-04-26T12:05:55.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786932+0000", 2024-04-26T12:05:55.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3031999999999998e-05 2024-04-26T12:05:55.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:55.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786945+0000", 2024-04-26T12:05:55.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3421000000000001e-05 2024-04-26T12:05:55.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:55.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796469+0000", 2024-04-26T12:05:55.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095236130000000002 2024-04-26T12:05:55.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:55.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796523+0000", 2024-04-26T12:05:55.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4089999999999999e-05 2024-04-26T12:05:55.487 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.487 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:55.487 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.487 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "pg_update_log_missing(3.14 epoch 17/15 rep_tid 169 entries 17'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:05:55.487 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:55.487 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.565083694999998, 2024-04-26T12:05:55.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097257639999999996, 2024-04-26T12:05:55.488 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:55.488 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-04-26T12:05:55.488 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:55.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:55.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:55.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:55.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:55.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:55.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786942+0000", 2024-04-26T12:05:55.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:55.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:55.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786951+0000", 2024-04-26T12:05:55.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:05:55.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:55.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786965+0000", 2024-04-26T12:05:55.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4268e-05 2024-04-26T12:05:55.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:55.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786977+0000", 2024-04-26T12:05:55.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1667e-05 2024-04-26T12:05:55.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787667+0000", 2024-04-26T12:05:55.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00069057400000000001 2024-04-26T12:05:55.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:55.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796668+0000", 2024-04-26T12:05:55.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090013309999999996 2024-04-26T12:05:55.490 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.490 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:55.490 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.491 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:55.491 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:55.491 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.565030552000003, 2024-04-26T12:05:55.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095908309999999993, 2024-04-26T12:05:55.491 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:55.491 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:55.491 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:55.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:55.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:55.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:55.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:55.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:55.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786995+0000", 2024-04-26T12:05:55.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:55.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:55.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787001+0000", 2024-04-26T12:05:55.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5099999999999998e-06 2024-04-26T12:05:55.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:55.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787009+0000", 2024-04-26T12:05:55.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9100000000000005e-06 2024-04-26T12:05:55.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:55.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787019+0000", 2024-04-26T12:05:55.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8109999999999997e-06 2024-04-26T12:05:55.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787136+0000", 2024-04-26T12:05:55.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011749899999999999 2024-04-26T12:05:55.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:55.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787154+0000", 2024-04-26T12:05:55.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8278999999999999e-05 2024-04-26T12:05:55.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:55.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796561+0000", 2024-04-26T12:05:55.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094064379999999996 2024-04-26T12:05:55.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:55.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796587+0000", 2024-04-26T12:05:55.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5856000000000001e-05 2024-04-26T12:05:55.495 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.495 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:55.495 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.495 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:55.495 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:55.495 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.564313495, 2024-04-26T12:05:55.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096460160000000003, 2024-04-26T12:05:55.496 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:55.496 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:55.496 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:55.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:55.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:55.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:55.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:55.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:55.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:55.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787712+0000", 2024-04-26T12:05:55.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:55.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:55.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787718+0000", 2024-04-26T12:05:55.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:05:55.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:55.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787727+0000", 2024-04-26T12:05:55.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.123e-06 2024-04-26T12:05:55.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:55.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787734+0000", 2024-04-26T12:05:55.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.391e-06 2024-04-26T12:05:55.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:55.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788867+0000", 2024-04-26T12:05:55.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001133207 2024-04-26T12:05:55.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:55.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788899+0000", 2024-04-26T12:05:55.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1526000000000003e-05 2024-04-26T12:05:55.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:55.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797328+0000", 2024-04-26T12:05:55.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084295389999999998 2024-04-26T12:05:55.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:55.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:55.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:55.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797359+0000", 2024-04-26T12:05:55.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0660999999999997e-05 2024-04-26T12:05:55.500 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.500 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:55.500 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.500 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:55.500 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:55.500 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:55.501 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:55.503 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:55.394+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:55.503 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:55.501+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:55.603 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:55.602+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:55.614 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:55.614 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:05:55.614 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:05:55.614 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:55.623 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:55.657 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:05:55.704 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:55.703+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:55.726 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:55.726 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:05:55.727 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:05:55.727 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:05:55.727 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:55.735 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:55.780 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:05:55.780 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:05:55.797 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T12:05:55.798 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:05:55.804 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:55.803+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:55.809 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:05:55.810 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:05:55.815 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:05:55.815 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:05:55.820 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-04-26T12:05:54.341698+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597673,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90156,"kb_used_data":904,"kb_used_omap":4,"kb_used_meta":89211,"kb_avail":283025364,"statfs":{"total":289910292480,"available":289817972736,"internally_reserved":0,"allocated":925696,"data_stored":1499642,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":91352402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.455697"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630720+0000","last_change":"2024-04-26T12:05:03.796038+0000","last_active":"2024-04-26T12:05:47.630720+0000","last_peered":"2024-04-26T12:05:47.630720+0000","last_clean":"2024-04-26T12:05:47.630720+0000","last_became_active":"2024-04-26T12:05:03.795539+0000","last_became_peered":"2024-04-26T12:05:03.795539+0000","last_unstale":"2024-04-26T12:05:47.630720+0000","last_undegraded":"2024-04-26T12:05:47.630720+0000","last_fullsized":"2024-04-26T12:05:47.630720+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630553+0000","last_change":"2024-04-26T12:05:03.795955+0000","last_active":"2024-04-26T12:05:47.630553+0000","last_peered":"2024-04-26T12:05:47.630553+0000","last_clean":"2024-04-26T12:05:47.630553+0000","last_became_active":"2024-04-26T12:05:03.795303+0000","last_became_peered":"2024-04-26T12:05:03.795303+0000","last_unstale":"2024-04-26T12:05:47.630553+0000","last_undegraded":"2024-04-26T12:05:47.630553+0000","last_fullsized":"2024-04-26T12:05:47.630553+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888054+0000","last_change":"2024-04-26T12:05:03.797557+0000","last_active":"2024-04-26T12:05:46.888054+0000","last_peered":"2024-04-26T12:05:46.888054+0000","last_clean":"2024-04-26T12:05:46.888054+0000","last_became_active":"2024-04-26T12:05:03.797122+0000","last_became_peered":"2024-04-26T12:05:03.797122+0000","last_unstale":"2024-04-26T12:05:46.888054+0000","last_undegraded":"2024-04-26T12:05:46.888054+0000","last_fullsized":"2024-04-26T12:05:46.888054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888035+0000","last_change":"2024-04-26T12:05:03.791234+0000","last_active":"2024-04-26T12:05:46.888035+0000","last_peered":"2024-04-26T12:05:46.888035+0000","last_clean":"2024-04-26T12:05:46.888035+0000","last_became_active":"2024-04-26T12:05:03.790717+0000","last_became_peered":"2024-04-26T12:05:03.790717+0000","last_unstale":"2024-04-26T12:05:46.888035+0000","last_undegraded":"2024-04-26T12:05:46.888035+0000","last_fullsized":"2024-04-26T12:05:46.888035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:52.358881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630366+0000","last_change":"2024-04-26T12:05:03.792885+0000","last_active":"2024-04-26T12:05:47.630366+0000","last_peered":"2024-04-26T12:05:47.630366+0000","last_clean":"2024-04-26T12:05:47.630366+0000","last_became_active":"2024-04-26T12:05:03.792354+0000","last_became_peered":"2024-04-26T12:05:03.792354+0000","last_unstale":"2024-04-26T12:05:47.630366+0000","last_undegraded":"2024-04-26T12:05:47.630366+0000","last_fullsized":"2024-04-26T12:05:47.630366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.887753+0000","last_change":"2024-04-26T12:05:03.791560+0000","last_active":"2024-04-26T12:05:46.887753+0000","last_peered":"2024-04-26T12:05:46.887753+0000","last_clean":"2024-04-26T12:05:46.887753+0000","last_became_active":"2024-04-26T12:05:03.790578+0000","last_became_peered":"2024-04-26T12:05:03.790578+0000","last_unstale":"2024-04-26T12:05:46.887753+0000","last_undegraded":"2024-04-26T12:05:46.887753+0000","last_fullsized":"2024-04-26T12:05:46.887753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.887927+0000","last_change":"2024-04-26T12:05:03.791215+0000","last_active":"2024-04-26T12:05:46.887927+0000","last_peered":"2024-04-26T12:05:46.887927+0000","last_clean":"2024-04-26T12:05:46.887927+0000","last_became_active":"2024-04-26T12:05:03.790615+0000","last_became_peered":"2024-04-26T12:05:03.790615+0000","last_unstale":"2024-04-26T12:05:46.887927+0000","last_undegraded":"2024-04-26T12:05:46.887927+0000","last_fullsized":"2024-04-26T12:05:46.887927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:55.388027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.887623+0000","last_change":"2024-04-26T12:05:03.785861+0000","last_active":"2024-04-26T12:05:46.887623+0000","last_peered":"2024-04-26T12:05:46.887623+0000","last_clean":"2024-04-26T12:05:46.887623+0000","last_became_active":"2024-04-26T12:05:03.785382+0000","last_became_peered":"2024-04-26T12:05:03.785382+0000","last_unstale":"2024-04-26T12:05:46.887623+0000","last_undegraded":"2024-04-26T12:05:46.887623+0000","last_fullsized":"2024-04-26T12:05:46.887623+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:51.870183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888450+0000","last_change":"2024-04-26T12:05:03.797218+0000","last_active":"2024-04-26T12:05:46.888450+0000","last_peered":"2024-04-26T12:05:46.888450+0000","last_clean":"2024-04-26T12:05:46.888450+0000","last_became_active":"2024-04-26T12:05:03.796902+0000","last_became_peered":"2024-04-26T12:05:03.796902+0000","last_unstale":"2024-04-26T12:05:46.888450+0000","last_undegraded":"2024-04-26T12:05:46.888450+0000","last_fullsized":"2024-04-26T12:05:46.888450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:27.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630501+0000","last_change":"2024-04-26T12:05:03.795919+0000","last_active":"2024-04-26T12:05:47.630501+0000","last_peered":"2024-04-26T12:05:47.630501+0000","last_clean":"2024-04-26T12:05:47.630501+0000","last_became_active":"2024-04-26T12:05:03.795268+0000","last_became_peered":"2024-04-26T12:05:03.795268+0000","last_unstale":"2024-04-26T12:05:47.630501+0000","last_undegraded":"2024-04-26T12:05:47.630501+0000","last_fullsized":"2024-04-26T12:05:47.630501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888136+0000","last_change":"2024-04-26T12:05:03.791046+0000","last_active":"2024-04-26T12:05:46.888136+0000","last_peered":"2024-04-26T12:05:46.888136+0000","last_clean":"2024-04-26T12:05:46.888136+0000","last_became_active":"2024-04-26T12:05:03.790662+0000","last_became_peered":"2024-04-26T12:05:03.790662+0000","last_unstale":"2024-04-26T12:05:46.888136+0000","last_undegraded":"2024-04-26T12:05:46.888136+0000","last_fullsized":"2024-04-26T12:05:46.888136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:35.458663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630368+0000","last_change":"2024-04-26T12:05:03.795250+0000","last_active":"2024-04-26T12:05:47.630368+0000","last_peered":"2024-04-26T12:05:47.630368+0000","last_clean":"2024-04-26T12:05:47.630368+0000","last_became_active":"2024-04-26T12:05:03.794632+0000","last_became_peered":"2024-04-26T12:05:03.794632+0000","last_unstale":"2024-04-26T12:05:47.630368+0000","last_undegraded":"2024-04-26T12:05:47.630368+0000","last_fullsized":"2024-04-26T12:05:47.630368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:59.873501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630280+0000","last_change":"2024-04-26T12:05:03.794090+0000","last_active":"2024-04-26T12:05:47.630280+0000","last_peered":"2024-04-26T12:05:47.630280+0000","last_clean":"2024-04-26T12:05:47.630280+0000","last_became_active":"2024-04-26T12:05:03.793681+0000","last_became_peered":"2024-04-26T12:05:03.793681+0000","last_unstale":"2024-04-26T12:05:47.630280+0000","last_undegraded":"2024-04-26T12:05:47.630280+0000","last_fullsized":"2024-04-26T12:05:47.630280+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.887825+0000","last_change":"2024-04-26T12:05:03.795539+0000","last_active":"2024-04-26T12:05:46.887825+0000","last_peered":"2024-04-26T12:05:46.887825+0000","last_clean":"2024-04-26T12:05:46.887825+0000","last_became_active":"2024-04-26T12:05:03.795281+0000","last_became_peered":"2024-04-26T12:05:03.795281+0000","last_unstale":"2024-04-26T12:05:46.887825+0000","last_undegraded":"2024-04-26T12:05:46.887825+0000","last_fullsized":"2024-04-26T12:05:46.887825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:27.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.887888+0000","last_change":"2024-04-26T12:05:03.793487+0000","last_active":"2024-04-26T12:05:46.887888+0000","last_peered":"2024-04-26T12:05:46.887888+0000","last_clean":"2024-04-26T12:05:46.887888+0000","last_became_active":"2024-04-26T12:05:03.793242+0000","last_became_peered":"2024-04-26T12:05:03.793242+0000","last_unstale":"2024-04-26T12:05:46.887888+0000","last_undegraded":"2024-04-26T12:05:46.887888+0000","last_fullsized":"2024-04-26T12:05:46.887888+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:53.331006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.887675+0000","last_change":"2024-04-26T12:05:03.786360+0000","last_active":"2024-04-26T12:05:46.887675+0000","last_peered":"2024-04-26T12:05:46.887675+0000","last_clean":"2024-04-26T12:05:46.887675+0000","last_became_active":"2024-04-26T12:05:03.785991+0000","last_became_peered":"2024-04-26T12:05:03.785991+0000","last_unstale":"2024-04-26T12:05:46.887675+0000","last_undegraded":"2024-04-26T12:05:46.887675+0000","last_fullsized":"2024-04-26T12:05:46.887675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:17.702068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888678+0000","last_change":"2024-04-26T12:05:03.797390+0000","last_active":"2024-04-26T12:05:46.888678+0000","last_peered":"2024-04-26T12:05:46.888678+0000","last_clean":"2024-04-26T12:05:46.888678+0000","last_became_active":"2024-04-26T12:05:03.796969+0000","last_became_peered":"2024-04-26T12:05:03.796969+0000","last_unstale":"2024-04-26T12:05:46.888678+0000","last_undegraded":"2024-04-26T12:05:46.888678+0000","last_fullsized":"2024-04-26T12:05:46.888678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:57.461628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630642+0000","last_change":"2024-04-26T12:05:03.794013+0000","last_active":"2024-04-26T12:05:47.630642+0000","last_peered":"2024-04-26T12:05:47.630642+0000","last_clean":"2024-04-26T12:05:47.630642+0000","last_became_active":"2024-04-26T12:05:03.793512+0000","last_became_peered":"2024-04-26T12:05:03.793512+0000","last_unstale":"2024-04-26T12:05:47.630642+0000","last_undegraded":"2024-04-26T12:05:47.630642+0000","last_fullsized":"2024-04-26T12:05:47.630642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888334+0000","last_change":"2024-04-26T12:05:03.798195+0000","last_active":"2024-04-26T12:05:46.888334+0000","last_peered":"2024-04-26T12:05:46.888334+0000","last_clean":"2024-04-26T12:05:46.888334+0000","last_became_active":"2024-04-26T12:05:03.797935+0000","last_became_peered":"2024-04-26T12:05:03.797935+0000","last_unstale":"2024-04-26T12:05:46.888334+0000","last_undegraded":"2024-04-26T12:05:46.888334+0000","last_fullsized":"2024-04-26T12:05:46.888334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:58.872589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.887979+0000","last_change":"2024-04-26T12:05:03.792219+0000","last_active":"2024-04-26T12:05:46.887979+0000","last_peered":"2024-04-26T12:05:46.887979+0000","last_clean":"2024-04-26T12:05:46.887979+0000","last_became_active":"2024-04-26T12:05:03.791061+0000","last_became_peered":"2024-04-26T12:05:03.791061+0000","last_unstale":"2024-04-26T12:05:46.887979+0000","last_undegraded":"2024-04-26T12:05:46.887979+0000","last_fullsized":"2024-04-26T12:05:46.887979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888261+0000","last_change":"2024-04-26T12:05:03.792073+0000","last_active":"2024-04-26T12:05:46.888261+0000","last_peered":"2024-04-26T12:05:46.888261+0000","last_clean":"2024-04-26T12:05:46.888261+0000","last_became_active":"2024-04-26T12:05:03.791693+0000","last_became_peered":"2024-04-26T12:05:03.791693+0000","last_unstale":"2024-04-26T12:05:46.888261+0000","last_undegraded":"2024-04-26T12:05:46.888261+0000","last_fullsized":"2024-04-26T12:05:46.888261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630059+0000","last_change":"2024-04-26T12:05:03.794027+0000","last_active":"2024-04-26T12:05:47.630059+0000","last_peered":"2024-04-26T12:05:47.630059+0000","last_clean":"2024-04-26T12:05:47.630059+0000","last_became_active":"2024-04-26T12:05:03.793660+0000","last_became_peered":"2024-04-26T12:05:03.793660+0000","last_unstale":"2024-04-26T12:05:47.630059+0000","last_undegraded":"2024-04-26T12:05:47.630059+0000","last_fullsized":"2024-04-26T12:05:47.630059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:53.331006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.887674+0000","last_change":"2024-04-26T12:05:03.788658+0000","last_active":"2024-04-26T12:05:46.887674+0000","last_peered":"2024-04-26T12:05:46.887674+0000","last_clean":"2024-04-26T12:05:46.887674+0000","last_became_active":"2024-04-26T12:05:03.788050+0000","last_became_peered":"2024-04-26T12:05:03.788050+0000","last_unstale":"2024-04-26T12:05:46.887674+0000","last_undegraded":"2024-04-26T12:05:46.887674+0000","last_fullsized":"2024-04-26T12:05:46.887674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.629876+0000","last_change":"2024-04-26T12:05:03.793554+0000","last_active":"2024-04-26T12:05:47.629876+0000","last_peered":"2024-04-26T12:05:47.629876+0000","last_clean":"2024-04-26T12:05:47.629876+0000","last_became_active":"2024-04-26T12:05:03.792588+0000","last_became_peered":"2024-04-26T12:05:03.792588+0000","last_unstale":"2024-04-26T12:05:47.629876+0000","last_undegraded":"2024-04-26T12:05:47.629876+0000","last_fullsized":"2024-04-26T12:05:47.629876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630758+0000","last_change":"2024-04-26T12:05:03.795510+0000","last_active":"2024-04-26T12:05:47.630758+0000","last_peered":"2024-04-26T12:05:47.630758+0000","last_clean":"2024-04-26T12:05:47.630758+0000","last_became_active":"2024-04-26T12:05:03.794639+0000","last_became_peered":"2024-04-26T12:05:03.794639+0000","last_unstale":"2024-04-26T12:05:47.630758+0000","last_undegraded":"2024-04-26T12:05:47.630758+0000","last_fullsized":"2024-04-26T12:05:47.630758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:57.461628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888533+0000","last_change":"2024-04-26T12:05:03.787909+0000","last_active":"2024-04-26T12:05:46.888533+0000","last_peered":"2024-04-26T12:05:46.888533+0000","last_clean":"2024-04-26T12:05:46.888533+0000","last_became_active":"2024-04-26T12:05:03.787562+0000","last_became_peered":"2024-04-26T12:05:03.787562+0000","last_unstale":"2024-04-26T12:05:46.888533+0000","last_undegraded":"2024-04-26T12:05:46.888533+0000","last_fullsized":"2024-04-26T12:05:46.888533+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888322+0000","last_change":"2024-04-26T12:05:03.796836+0000","last_active":"2024-04-26T12:05:46.888322+0000","last_peered":"2024-04-26T12:05:46.888322+0000","last_clean":"2024-04-26T12:05:46.888322+0000","last_became_active":"2024-04-26T12:05:03.796524+0000","last_became_peered":"2024-04-26T12:05:03.796524+0000","last_unstale":"2024-04-26T12:05:46.888322+0000","last_undegraded":"2024-04-26T12:05:46.888322+0000","last_fullsized":"2024-04-26T12:05:46.888322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630576+0000","last_change":"2024-04-26T12:05:03.792400+0000","last_active":"2024-04-26T12:05:47.630576+0000","last_peered":"2024-04-26T12:05:47.630576+0000","last_clean":"2024-04-26T12:05:47.630576+0000","last_became_active":"2024-04-26T12:05:03.792079+0000","last_became_peered":"2024-04-26T12:05:03.792079+0000","last_unstale":"2024-04-26T12:05:47.630576+0000","last_undegraded":"2024-04-26T12:05:47.630576+0000","last_fullsized":"2024-04-26T12:05:47.630576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:24.434355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888205+0000","last_change":"2024-04-26T12:05:03.797172+0000","last_active":"2024-04-26T12:05:46.888205+0000","last_peered":"2024-04-26T12:05:46.888205+0000","last_clean":"2024-04-26T12:05:46.888205+0000","last_became_active":"2024-04-26T12:05:03.796879+0000","last_became_peered":"2024-04-26T12:05:03.796879+0000","last_unstale":"2024-04-26T12:05:46.888205+0000","last_undegraded":"2024-04-26T12:05:46.888205+0000","last_fullsized":"2024-04-26T12:05:46.888205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:24.434355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630129+0000","last_change":"2024-04-26T12:05:03.793269+0000","last_active":"2024-04-26T12:05:47.630129+0000","last_peered":"2024-04-26T12:05:47.630129+0000","last_clean":"2024-04-26T12:05:47.630129+0000","last_became_active":"2024-04-26T12:05:03.792698+0000","last_became_peered":"2024-04-26T12:05:03.792698+0000","last_unstale":"2024-04-26T12:05:47.630129+0000","last_undegraded":"2024-04-26T12:05:47.630129+0000","last_fullsized":"2024-04-26T12:05:47.630129+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:58.579861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.887766+0000","last_change":"2024-04-26T12:05:03.796871+0000","last_active":"2024-04-26T12:05:46.887766+0000","last_peered":"2024-04-26T12:05:46.887766+0000","last_clean":"2024-04-26T12:05:46.887766+0000","last_became_active":"2024-04-26T12:05:03.796546+0000","last_became_peered":"2024-04-26T12:05:03.796546+0000","last_unstale":"2024-04-26T12:05:46.887766+0000","last_undegraded":"2024-04-26T12:05:46.887766+0000","last_fullsized":"2024-04-26T12:05:46.887766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:53.331006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.887720+0000","last_change":"2024-04-26T12:05:03.791605+0000","last_active":"2024-04-26T12:05:46.887720+0000","last_peered":"2024-04-26T12:05:46.887720+0000","last_clean":"2024-04-26T12:05:46.887720+0000","last_became_active":"2024-04-26T12:05:03.791251+0000","last_became_peered":"2024-04-26T12:05:03.791251+0000","last_unstale":"2024-04-26T12:05:46.887720+0000","last_undegraded":"2024-04-26T12:05:46.887720+0000","last_fullsized":"2024-04-26T12:05:46.887720+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:27.239868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630458+0000","last_change":"2024-04-26T12:05:03.793791+0000","last_active":"2024-04-26T12:05:47.630458+0000","last_peered":"2024-04-26T12:05:47.630458+0000","last_clean":"2024-04-26T12:05:47.630458+0000","last_became_active":"2024-04-26T12:05:03.793468+0000","last_became_peered":"2024-04-26T12:05:03.793468+0000","last_unstale":"2024-04-26T12:05:47.630458+0000","last_undegraded":"2024-04-26T12:05:47.630458+0000","last_fullsized":"2024-04-26T12:05:47.630458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:01.289069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888188+0000","last_change":"2024-04-26T12:05:03.430021+0000","last_active":"2024-04-26T12:05:46.888188+0000","last_peered":"2024-04-26T12:05:46.888188+0000","last_clean":"2024-04-26T12:05:46.888188+0000","last_became_active":"2024-04-26T12:05:03.429695+0000","last_became_peered":"2024-04-26T12:05:03.429695+0000","last_unstale":"2024-04-26T12:05:46.888188+0000","last_undegraded":"2024-04-26T12:05:46.888188+0000","last_fullsized":"2024-04-26T12:05:46.888188+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630731+0000","last_change":"2024-04-26T12:05:03.796189+0000","last_active":"2024-04-26T12:05:47.630731+0000","last_peered":"2024-04-26T12:05:47.630731+0000","last_clean":"2024-04-26T12:05:47.630731+0000","last_became_active":"2024-04-26T12:05:03.795438+0000","last_became_peered":"2024-04-26T12:05:03.795438+0000","last_unstale":"2024-04-26T12:05:47.630731+0000","last_undegraded":"2024-04-26T12:05:47.630731+0000","last_fullsized":"2024-04-26T12:05:47.630731+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:22.814807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.887970+0000","last_change":"2024-04-26T12:05:03.428605+0000","last_active":"2024-04-26T12:05:46.887970+0000","last_peered":"2024-04-26T12:05:46.887970+0000","last_clean":"2024-04-26T12:05:46.887970+0000","last_became_active":"2024-04-26T12:05:03.428098+0000","last_became_peered":"2024-04-26T12:05:03.428098+0000","last_unstale":"2024-04-26T12:05:46.887970+0000","last_undegraded":"2024-04-26T12:05:46.887970+0000","last_fullsized":"2024-04-26T12:05:46.887970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888619+0000","last_change":"2024-04-26T12:05:03.788568+0000","last_active":"2024-04-26T12:05:46.888619+0000","last_peered":"2024-04-26T12:05:46.888619+0000","last_clean":"2024-04-26T12:05:46.888619+0000","last_became_active":"2024-04-26T12:05:03.788039+0000","last_became_peered":"2024-04-26T12:05:03.788039+0000","last_unstale":"2024-04-26T12:05:46.888619+0000","last_undegraded":"2024-04-26T12:05:46.888619+0000","last_fullsized":"2024-04-26T12:05:46.888619+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630157+0000","last_change":"2024-04-26T12:05:03.422773+0000","last_active":"2024-04-26T12:05:47.630157+0000","last_peered":"2024-04-26T12:05:47.630157+0000","last_clean":"2024-04-26T12:05:47.630157+0000","last_became_active":"2024-04-26T12:05:03.422412+0000","last_became_peered":"2024-04-26T12:05:03.422412+0000","last_unstale":"2024-04-26T12:05:47.630157+0000","last_undegraded":"2024-04-26T12:05:47.630157+0000","last_fullsized":"2024-04-26T12:05:47.630157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:06.758253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888461+0000","last_change":"2024-04-26T12:05:03.788505+0000","last_active":"2024-04-26T12:05:46.888461+0000","last_peered":"2024-04-26T12:05:46.888461+0000","last_clean":"2024-04-26T12:05:46.888461+0000","last_became_active":"2024-04-26T12:05:03.788184+0000","last_became_peered":"2024-04-26T12:05:03.788184+0000","last_unstale":"2024-04-26T12:05:46.888461+0000","last_undegraded":"2024-04-26T12:05:46.888461+0000","last_fullsized":"2024-04-26T12:05:46.888461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.887760+0000","last_change":"2024-04-26T12:05:03.425495+0000","last_active":"2024-04-26T12:05:46.887760+0000","last_peered":"2024-04-26T12:05:46.887760+0000","last_clean":"2024-04-26T12:05:46.887760+0000","last_became_active":"2024-04-26T12:05:03.424963+0000","last_became_peered":"2024-04-26T12:05:03.424963+0000","last_unstale":"2024-04-26T12:05:46.887760+0000","last_undegraded":"2024-04-26T12:05:46.887760+0000","last_fullsized":"2024-04-26T12:05:46.887760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:55.660897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888446+0000","last_change":"2024-04-26T12:05:03.426142+0000","last_active":"2024-04-26T12:05:46.888446+0000","last_peered":"2024-04-26T12:05:46.888446+0000","last_clean":"2024-04-26T12:05:46.888446+0000","last_became_active":"2024-04-26T12:05:03.425699+0000","last_became_peered":"2024-04-26T12:05:03.425699+0000","last_unstale":"2024-04-26T12:05:46.888446+0000","last_undegraded":"2024-04-26T12:05:46.888446+0000","last_fullsized":"2024-04-26T12:05:46.888446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:41.279426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.629911+0000","last_change":"2024-04-26T12:05:03.794778+0000","last_active":"2024-04-26T12:05:47.629911+0000","last_peered":"2024-04-26T12:05:47.629911+0000","last_clean":"2024-04-26T12:05:47.629911+0000","last_became_active":"2024-04-26T12:05:03.794192+0000","last_became_peered":"2024-04-26T12:05:03.794192+0000","last_unstale":"2024-04-26T12:05:47.629911+0000","last_undegraded":"2024-04-26T12:05:47.629911+0000","last_fullsized":"2024-04-26T12:05:47.629911+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:16.372597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630711+0000","last_change":"2024-04-26T12:05:03.426530+0000","last_active":"2024-04-26T12:05:47.630711+0000","last_peered":"2024-04-26T12:05:47.630711+0000","last_clean":"2024-04-26T12:05:47.630711+0000","last_became_active":"2024-04-26T12:05:03.426113+0000","last_became_peered":"2024-04-26T12:05:03.426113+0000","last_unstale":"2024-04-26T12:05:47.630711+0000","last_undegraded":"2024-04-26T12:05:47.630711+0000","last_fullsized":"2024-04-26T12:05:47.630711+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:21.029311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.629941+0000","last_change":"2024-04-26T12:05:03.793000+0000","last_active":"2024-04-26T12:05:47.629941+0000","last_peered":"2024-04-26T12:05:47.629941+0000","last_clean":"2024-04-26T12:05:47.629941+0000","last_became_active":"2024-04-26T12:05:03.792480+0000","last_became_peered":"2024-04-26T12:05:03.792480+0000","last_unstale":"2024-04-26T12:05:47.629941+0000","last_undegraded":"2024-04-26T12:05:47.629941+0000","last_fullsized":"2024-04-26T12:05:47.629941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888493+0000","last_change":"2024-04-26T12:05:03.426039+0000","last_active":"2024-04-26T12:05:46.888493+0000","last_peered":"2024-04-26T12:05:46.888493+0000","last_clean":"2024-04-26T12:05:46.888493+0000","last_became_active":"2024-04-26T12:05:03.425666+0000","last_became_peered":"2024-04-26T12:05:03.425666+0000","last_unstale":"2024-04-26T12:05:46.888493+0000","last_undegraded":"2024-04-26T12:05:46.888493+0000","last_fullsized":"2024-04-26T12:05:46.888493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:00.998013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.887876+0000","last_change":"2024-04-26T12:05:03.791809+0000","last_active":"2024-04-26T12:05:46.887876+0000","last_peered":"2024-04-26T12:05:46.887876+0000","last_clean":"2024-04-26T12:05:46.887876+0000","last_became_active":"2024-04-26T12:05:03.791272+0000","last_became_peered":"2024-04-26T12:05:03.791272+0000","last_unstale":"2024-04-26T12:05:46.887876+0000","last_undegraded":"2024-04-26T12:05:46.887876+0000","last_fullsized":"2024-04-26T12:05:46.887876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888256+0000","last_change":"2024-04-26T12:05:03.430224+0000","last_active":"2024-04-26T12:05:46.888256+0000","last_peered":"2024-04-26T12:05:46.888256+0000","last_clean":"2024-04-26T12:05:46.888256+0000","last_became_active":"2024-04-26T12:05:03.429291+0000","last_became_peered":"2024-04-26T12:05:03.429291+0000","last_unstale":"2024-04-26T12:05:46.888256+0000","last_undegraded":"2024-04-26T12:05:46.888256+0000","last_fullsized":"2024-04-26T12:05:46.888256+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.887988+0000","last_change":"2024-04-26T12:05:03.788174+0000","last_active":"2024-04-26T12:05:46.887988+0000","last_peered":"2024-04-26T12:05:46.887988+0000","last_clean":"2024-04-26T12:05:46.887988+0000","last_became_active":"2024-04-26T12:05:03.787772+0000","last_became_peered":"2024-04-26T12:05:03.787772+0000","last_unstale":"2024-04-26T12:05:46.887988+0000","last_undegraded":"2024-04-26T12:05:46.887988+0000","last_fullsized":"2024-04-26T12:05:46.887988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888216+0000","last_change":"2024-04-26T12:05:03.431162+0000","last_active":"2024-04-26T12:05:46.888216+0000","last_peered":"2024-04-26T12:05:46.888216+0000","last_clean":"2024-04-26T12:05:46.888216+0000","last_became_active":"2024-04-26T12:05:03.430855+0000","last_became_peered":"2024-04-26T12:05:03.430855+0000","last_unstale":"2024-04-26T12:05:46.888216+0000","last_undegraded":"2024-04-26T12:05:46.888216+0000","last_fullsized":"2024-04-26T12:05:46.888216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:41.279426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888104+0000","last_change":"2024-04-26T12:05:03.792357+0000","last_active":"2024-04-26T12:05:46.888104+0000","last_peered":"2024-04-26T12:05:46.888104+0000","last_clean":"2024-04-26T12:05:46.888104+0000","last_became_active":"2024-04-26T12:05:03.792119+0000","last_became_peered":"2024-04-26T12:05:03.792119+0000","last_unstale":"2024-04-26T12:05:46.888104+0000","last_undegraded":"2024-04-26T12:05:46.888104+0000","last_fullsized":"2024-04-26T12:05:46.888104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888062+0000","last_change":"2024-04-26T12:05:03.429811+0000","last_active":"2024-04-26T12:05:46.888062+0000","last_peered":"2024-04-26T12:05:46.888062+0000","last_clean":"2024-04-26T12:05:46.888062+0000","last_became_active":"2024-04-26T12:05:03.429469+0000","last_became_peered":"2024-04-26T12:05:03.429469+0000","last_unstale":"2024-04-26T12:05:46.888062+0000","last_undegraded":"2024-04-26T12:05:46.888062+0000","last_fullsized":"2024-04-26T12:05:46.888062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888417+0000","last_change":"2024-04-26T12:05:03.795646+0000","last_active":"2024-04-26T12:05:46.888417+0000","last_peered":"2024-04-26T12:05:46.888417+0000","last_clean":"2024-04-26T12:05:46.888417+0000","last_became_active":"2024-04-26T12:05:03.795354+0000","last_became_peered":"2024-04-26T12:05:03.795354+0000","last_unstale":"2024-04-26T12:05:46.888417+0000","last_undegraded":"2024-04-26T12:05:46.888417+0000","last_fullsized":"2024-04-26T12:05:46.888417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:22.814807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630041+0000","last_change":"2024-04-26T12:05:03.427908+0000","last_active":"2024-04-26T12:05:47.630041+0000","last_peered":"2024-04-26T12:05:47.630041+0000","last_clean":"2024-04-26T12:05:47.630041+0000","last_became_active":"2024-04-26T12:05:03.426718+0000","last_became_peered":"2024-04-26T12:05:03.426718+0000","last_unstale":"2024-04-26T12:05:47.630041+0000","last_undegraded":"2024-04-26T12:05:47.630041+0000","last_fullsized":"2024-04-26T12:05:47.630041+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:40.538058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888306+0000","last_change":"2024-04-26T12:05:03.797113+0000","last_active":"2024-04-26T12:05:46.888306+0000","last_peered":"2024-04-26T12:05:46.888306+0000","last_clean":"2024-04-26T12:05:46.888306+0000","last_became_active":"2024-04-26T12:05:03.796739+0000","last_became_peered":"2024-04-26T12:05:03.796739+0000","last_unstale":"2024-04-26T12:05:46.888306+0000","last_undegraded":"2024-04-26T12:05:46.888306+0000","last_fullsized":"2024-04-26T12:05:46.888306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:59.873501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.629955+0000","last_change":"2024-04-26T12:05:03.428262+0000","last_active":"2024-04-26T12:05:47.629955+0000","last_peered":"2024-04-26T12:05:47.629955+0000","last_clean":"2024-04-26T12:05:47.629955+0000","last_became_active":"2024-04-26T12:05:03.426588+0000","last_became_peered":"2024-04-26T12:05:03.426588+0000","last_unstale":"2024-04-26T12:05:47.629955+0000","last_undegraded":"2024-04-26T12:05:47.629955+0000","last_fullsized":"2024-04-26T12:05:47.629955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:42.674797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888505+0000","last_change":"2024-04-26T12:05:03.797633+0000","last_active":"2024-04-26T12:05:46.888505+0000","last_peered":"2024-04-26T12:05:46.888505+0000","last_clean":"2024-04-26T12:05:46.888505+0000","last_became_active":"2024-04-26T12:05:03.797338+0000","last_became_peered":"2024-04-26T12:05:03.797338+0000","last_unstale":"2024-04-26T12:05:46.888505+0000","last_undegraded":"2024-04-26T12:05:46.888505+0000","last_fullsized":"2024-04-26T12:05:46.888505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:22.814807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":224,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888027+0000","last_change":"2024-04-26T12:04:53.388840+0000","last_active":"2024-04-26T12:05:46.888027+0000","last_peered":"2024-04-26T12:05:46.888027+0000","last_clean":"2024-04-26T12:05:46.888027+0000","last_became_active":"2024-04-26T12:04:53.388568+0000","last_became_peered":"2024-04-26T12:04:53.388568+0000","last_unstale":"2024-04-26T12:05:46.888027+0000","last_undegraded":"2024-04-26T12:05:46.888027+0000","last_fullsized":"2024-04-26T12:05:46.888027+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_clean_scrub_stamp":"2024-04-26T12:04:52.376986+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:04.970330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888332+0000","last_change":"2024-04-26T12:04:59.403711+0000","last_active":"2024-04-26T12:05:46.888332+0000","last_peered":"2024-04-26T12:05:46.888332+0000","last_clean":"2024-04-26T12:05:46.888332+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:05:46.888332+0000","last_undegraded":"2024-04-26T12:05:46.888332+0000","last_fullsized":"2024-04-26T12:05:46.888332+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:45.779614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888056+0000","last_change":"2024-04-26T12:05:03.429674+0000","last_active":"2024-04-26T12:05:46.888056+0000","last_peered":"2024-04-26T12:05:46.888056+0000","last_clean":"2024-04-26T12:05:46.888056+0000","last_became_active":"2024-04-26T12:05:03.429266+0000","last_became_peered":"2024-04-26T12:05:03.429266+0000","last_unstale":"2024-04-26T12:05:46.888056+0000","last_undegraded":"2024-04-26T12:05:46.888056+0000","last_fullsized":"2024-04-26T12:05:46.888056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:55.660897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888420+0000","last_change":"2024-04-26T12:05:03.797640+0000","last_active":"2024-04-26T12:05:46.888420+0000","last_peered":"2024-04-26T12:05:46.888420+0000","last_clean":"2024-04-26T12:05:46.888420+0000","last_became_active":"2024-04-26T12:05:03.797302+0000","last_became_peered":"2024-04-26T12:05:03.797302+0000","last_unstale":"2024-04-26T12:05:46.888420+0000","last_undegraded":"2024-04-26T12:05:46.888420+0000","last_fullsized":"2024-04-26T12:05:46.888420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:16.372597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888230+0000","last_change":"2024-04-26T12:04:59.405437+0000","last_active":"2024-04-26T12:05:46.888230+0000","last_peered":"2024-04-26T12:05:46.888230+0000","last_clean":"2024-04-26T12:05:46.888230+0000","last_became_active":"2024-04-26T12:04:59.405193+0000","last_became_peered":"2024-04-26T12:04:59.405193+0000","last_unstale":"2024-04-26T12:05:46.888230+0000","last_undegraded":"2024-04-26T12:05:46.888230+0000","last_fullsized":"2024-04-26T12:05:46.888230+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:20.977569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888313+0000","last_change":"2024-04-26T12:05:03.428547+0000","last_active":"2024-04-26T12:05:46.888313+0000","last_peered":"2024-04-26T12:05:46.888313+0000","last_clean":"2024-04-26T12:05:46.888313+0000","last_became_active":"2024-04-26T12:05:03.427985+0000","last_became_peered":"2024-04-26T12:05:03.427985+0000","last_unstale":"2024-04-26T12:05:46.888313+0000","last_undegraded":"2024-04-26T12:05:46.888313+0000","last_fullsized":"2024-04-26T12:05:46.888313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:19.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630628+0000","last_change":"2024-04-26T12:05:03.793800+0000","last_active":"2024-04-26T12:05:47.630628+0000","last_peered":"2024-04-26T12:05:47.630628+0000","last_clean":"2024-04-26T12:05:47.630628+0000","last_became_active":"2024-04-26T12:05:03.792932+0000","last_became_peered":"2024-04-26T12:05:03.792932+0000","last_unstale":"2024-04-26T12:05:47.630628+0000","last_undegraded":"2024-04-26T12:05:47.630628+0000","last_fullsized":"2024-04-26T12:05:47.630628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888417+0000","last_change":"2024-04-26T12:04:59.405617+0000","last_active":"2024-04-26T12:05:46.888417+0000","last_peered":"2024-04-26T12:05:46.888417+0000","last_clean":"2024-04-26T12:05:46.888417+0000","last_became_active":"2024-04-26T12:04:59.405328+0000","last_became_peered":"2024-04-26T12:04:59.405328+0000","last_unstale":"2024-04-26T12:05:46.888417+0000","last_undegraded":"2024-04-26T12:05:46.888417+0000","last_fullsized":"2024-04-26T12:05:46.888417+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:39.317039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630016+0000","last_change":"2024-04-26T12:05:03.424576+0000","last_active":"2024-04-26T12:05:47.630016+0000","last_peered":"2024-04-26T12:05:47.630016+0000","last_clean":"2024-04-26T12:05:47.630016+0000","last_became_active":"2024-04-26T12:05:03.424289+0000","last_became_peered":"2024-04-26T12:05:03.424289+0000","last_unstale":"2024-04-26T12:05:47.630016+0000","last_undegraded":"2024-04-26T12:05:47.630016+0000","last_fullsized":"2024-04-26T12:05:47.630016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:10.759772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888546+0000","last_change":"2024-04-26T12:05:03.798238+0000","last_active":"2024-04-26T12:05:46.888546+0000","last_peered":"2024-04-26T12:05:46.888546+0000","last_clean":"2024-04-26T12:05:46.888546+0000","last_became_active":"2024-04-26T12:05:03.797924+0000","last_became_peered":"2024-04-26T12:05:03.797924+0000","last_unstale":"2024-04-26T12:05:46.888546+0000","last_undegraded":"2024-04-26T12:05:46.888546+0000","last_fullsized":"2024-04-26T12:05:46.888546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:01.289069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888165+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:05:46.888165+0000","last_peered":"2024-04-26T12:05:46.888165+0000","last_clean":"2024-04-26T12:05:46.888165+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:05:46.888165+0000","last_undegraded":"2024-04-26T12:05:46.888165+0000","last_fullsized":"2024-04-26T12:05:46.888165+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:12.939539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888267+0000","last_change":"2024-04-26T12:05:03.430140+0000","last_active":"2024-04-26T12:05:46.888267+0000","last_peered":"2024-04-26T12:05:46.888267+0000","last_clean":"2024-04-26T12:05:46.888267+0000","last_became_active":"2024-04-26T12:05:03.429838+0000","last_became_peered":"2024-04-26T12:05:03.429838+0000","last_unstale":"2024-04-26T12:05:46.888267+0000","last_undegraded":"2024-04-26T12:05:46.888267+0000","last_fullsized":"2024-04-26T12:05:46.888267+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888191+0000","last_change":"2024-04-26T12:05:03.796731+0000","last_active":"2024-04-26T12:05:46.888191+0000","last_peered":"2024-04-26T12:05:46.888191+0000","last_clean":"2024-04-26T12:05:46.888191+0000","last_became_active":"2024-04-26T12:05:03.796432+0000","last_became_peered":"2024-04-26T12:05:03.796432+0000","last_unstale":"2024-04-26T12:05:46.888191+0000","last_undegraded":"2024-04-26T12:05:46.888191+0000","last_fullsized":"2024-04-26T12:05:46.888191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:58.579861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888512+0000","last_change":"2024-04-26T12:05:03.429673+0000","last_active":"2024-04-26T12:05:46.888512+0000","last_peered":"2024-04-26T12:05:46.888512+0000","last_clean":"2024-04-26T12:05:46.888512+0000","last_became_active":"2024-04-26T12:05:03.429146+0000","last_became_peered":"2024-04-26T12:05:03.429146+0000","last_unstale":"2024-04-26T12:05:46.888512+0000","last_undegraded":"2024-04-26T12:05:46.888512+0000","last_fullsized":"2024-04-26T12:05:46.888512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888281+0000","last_change":"2024-04-26T12:04:59.405766+0000","last_active":"2024-04-26T12:05:46.888281+0000","last_peered":"2024-04-26T12:05:46.888281+0000","last_clean":"2024-04-26T12:05:46.888281+0000","last_became_active":"2024-04-26T12:04:59.405406+0000","last_became_peered":"2024-04-26T12:04:59.405406+0000","last_unstale":"2024-04-26T12:05:46.888281+0000","last_undegraded":"2024-04-26T12:05:46.888281+0000","last_fullsized":"2024-04-26T12:05:46.888281+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:13.860871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630086+0000","last_change":"2024-04-26T12:05:03.792534+0000","last_active":"2024-04-26T12:05:47.630086+0000","last_peered":"2024-04-26T12:05:47.630086+0000","last_clean":"2024-04-26T12:05:47.630086+0000","last_became_active":"2024-04-26T12:05:03.792160+0000","last_became_peered":"2024-04-26T12:05:03.792160+0000","last_unstale":"2024-04-26T12:05:47.630086+0000","last_undegraded":"2024-04-26T12:05:47.630086+0000","last_fullsized":"2024-04-26T12:05:47.630086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:41.930005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888218+0000","last_change":"2024-04-26T12:05:03.429642+0000","last_active":"2024-04-26T12:05:46.888218+0000","last_peered":"2024-04-26T12:05:46.888218+0000","last_clean":"2024-04-26T12:05:46.888218+0000","last_became_active":"2024-04-26T12:05:03.429197+0000","last_became_peered":"2024-04-26T12:05:03.429197+0000","last_unstale":"2024-04-26T12:05:46.888218+0000","last_undegraded":"2024-04-26T12:05:46.888218+0000","last_fullsized":"2024-04-26T12:05:46.888218+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:40.538058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.629695+0000","last_change":"2024-04-26T12:04:59.405294+0000","last_active":"2024-04-26T12:05:47.629695+0000","last_peered":"2024-04-26T12:05:47.629695+0000","last_clean":"2024-04-26T12:05:47.629695+0000","last_became_active":"2024-04-26T12:04:59.405044+0000","last_became_peered":"2024-04-26T12:04:59.405044+0000","last_unstale":"2024-04-26T12:05:47.629695+0000","last_undegraded":"2024-04-26T12:05:47.629695+0000","last_fullsized":"2024-04-26T12:05:47.629695+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:47.042833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630281+0000","last_change":"2024-04-26T12:05:03.793408+0000","last_active":"2024-04-26T12:05:47.630281+0000","last_peered":"2024-04-26T12:05:47.630281+0000","last_clean":"2024-04-26T12:05:47.630281+0000","last_became_active":"2024-04-26T12:05:03.793019+0000","last_became_peered":"2024-04-26T12:05:03.793019+0000","last_unstale":"2024-04-26T12:05:47.630281+0000","last_undegraded":"2024-04-26T12:05:47.630281+0000","last_fullsized":"2024-04-26T12:05:47.630281+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:25.062114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888706+0000","last_change":"2024-04-26T12:05:03.430008+0000","last_active":"2024-04-26T12:05:46.888706+0000","last_peered":"2024-04-26T12:05:46.888706+0000","last_clean":"2024-04-26T12:05:46.888706+0000","last_became_active":"2024-04-26T12:05:03.429362+0000","last_became_peered":"2024-04-26T12:05:03.429362+0000","last_unstale":"2024-04-26T12:05:46.888706+0000","last_undegraded":"2024-04-26T12:05:46.888706+0000","last_fullsized":"2024-04-26T12:05:46.888706+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888705+0000","last_change":"2024-04-26T12:04:59.405667+0000","last_active":"2024-04-26T12:05:46.888705+0000","last_peered":"2024-04-26T12:05:46.888705+0000","last_clean":"2024-04-26T12:05:46.888705+0000","last_became_active":"2024-04-26T12:04:59.405328+0000","last_became_peered":"2024-04-26T12:04:59.405328+0000","last_unstale":"2024-04-26T12:05:46.888705+0000","last_undegraded":"2024-04-26T12:05:46.888705+0000","last_fullsized":"2024-04-26T12:05:46.888705+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:20.977569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.887899+0000","last_change":"2024-04-26T12:05:03.789623+0000","last_active":"2024-04-26T12:05:46.887899+0000","last_peered":"2024-04-26T12:05:46.887899+0000","last_clean":"2024-04-26T12:05:46.887899+0000","last_became_active":"2024-04-26T12:05:03.789390+0000","last_became_peered":"2024-04-26T12:05:03.789390+0000","last_unstale":"2024-04-26T12:05:46.887899+0000","last_undegraded":"2024-04-26T12:05:46.887899+0000","last_fullsized":"2024-04-26T12:05:46.887899+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"23'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888704+0000","last_change":"2024-04-26T12:05:03.429222+0000","last_active":"2024-04-26T12:05:46.888704+0000","last_peered":"2024-04-26T12:05:46.888704+0000","last_clean":"2024-04-26T12:05:46.888704+0000","last_became_active":"2024-04-26T12:05:03.428803+0000","last_became_peered":"2024-04-26T12:05:03.428803+0000","last_unstale":"2024-04-26T12:05:46.888704+0000","last_undegraded":"2024-04-26T12:05:46.888704+0000","last_fullsized":"2024-04-26T12:05:46.888704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:31.305644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888438+0000","last_change":"2024-04-26T12:04:59.408078+0000","last_active":"2024-04-26T12:05:46.888438+0000","last_peered":"2024-04-26T12:05:46.888438+0000","last_clean":"2024-04-26T12:05:46.888438+0000","last_became_active":"2024-04-26T12:04:59.407804+0000","last_became_peered":"2024-04-26T12:04:59.407804+0000","last_unstale":"2024-04-26T12:05:46.888438+0000","last_undegraded":"2024-04-26T12:05:46.888438+0000","last_fullsized":"2024-04-26T12:05:46.888438+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:56.449518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.629955+0000","last_change":"2024-04-26T12:05:03.792547+0000","last_active":"2024-04-26T12:05:47.629955+0000","last_peered":"2024-04-26T12:05:47.629955+0000","last_clean":"2024-04-26T12:05:47.629955+0000","last_became_active":"2024-04-26T12:05:03.792078+0000","last_became_peered":"2024-04-26T12:05:03.792078+0000","last_unstale":"2024-04-26T12:05:47.629955+0000","last_undegraded":"2024-04-26T12:05:47.629955+0000","last_fullsized":"2024-04-26T12:05:47.629955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:45.563923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888033+0000","last_change":"2024-04-26T12:05:03.795500+0000","last_active":"2024-04-26T12:05:46.888033+0000","last_peered":"2024-04-26T12:05:46.888033+0000","last_clean":"2024-04-26T12:05:46.888033+0000","last_became_active":"2024-04-26T12:05:03.795173+0000","last_became_peered":"2024-04-26T12:05:03.795173+0000","last_unstale":"2024-04-26T12:05:46.888033+0000","last_undegraded":"2024-04-26T12:05:46.888033+0000","last_fullsized":"2024-04-26T12:05:46.888033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:01.289069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"23'10","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888203+0000","last_change":"2024-04-26T12:05:03.426261+0000","last_active":"2024-04-26T12:05:46.888203+0000","last_peered":"2024-04-26T12:05:46.888203+0000","last_clean":"2024-04-26T12:05:46.888203+0000","last_became_active":"2024-04-26T12:05:03.425897+0000","last_became_peered":"2024-04-26T12:05:03.425897+0000","last_unstale":"2024-04-26T12:05:46.888203+0000","last_undegraded":"2024-04-26T12:05:46.888203+0000","last_fullsized":"2024-04-26T12:05:46.888203+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:31.305644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6507,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.887766+0000","last_change":"2024-04-26T12:05:03.795443+0000","last_active":"2024-04-26T12:05:46.887766+0000","last_peered":"2024-04-26T12:05:46.887766+0000","last_clean":"2024-04-26T12:05:46.887766+0000","last_became_active":"2024-04-26T12:05:03.795190+0000","last_became_peered":"2024-04-26T12:05:03.795190+0000","last_unstale":"2024-04-26T12:05:46.887766+0000","last_undegraded":"2024-04-26T12:05:46.887766+0000","last_fullsized":"2024-04-26T12:05:46.887766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:59.873501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630826+0000","last_change":"2024-04-26T12:05:03.425106+0000","last_active":"2024-04-26T12:05:47.630826+0000","last_peered":"2024-04-26T12:05:47.630826+0000","last_clean":"2024-04-26T12:05:47.630826+0000","last_became_active":"2024-04-26T12:05:03.424753+0000","last_became_peered":"2024-04-26T12:05:03.424753+0000","last_unstale":"2024-04-26T12:05:47.630826+0000","last_undegraded":"2024-04-26T12:05:47.630826+0000","last_fullsized":"2024-04-26T12:05:47.630826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:10.741652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888383+0000","last_change":"2024-04-26T12:05:03.429257+0000","last_active":"2024-04-26T12:05:46.888383+0000","last_peered":"2024-04-26T12:05:46.888383+0000","last_clean":"2024-04-26T12:05:46.888383+0000","last_became_active":"2024-04-26T12:05:03.428921+0000","last_became_peered":"2024-04-26T12:05:03.428921+0000","last_unstale":"2024-04-26T12:05:46.888383+0000","last_undegraded":"2024-04-26T12:05:46.888383+0000","last_fullsized":"2024-04-26T12:05:46.888383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:49.774845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.887884+0000","last_change":"2024-04-26T12:05:03.788141+0000","last_active":"2024-04-26T12:05:46.887884+0000","last_peered":"2024-04-26T12:05:46.887884+0000","last_clean":"2024-04-26T12:05:46.887884+0000","last_became_active":"2024-04-26T12:05:03.787533+0000","last_became_peered":"2024-04-26T12:05:03.787533+0000","last_unstale":"2024-04-26T12:05:46.887884+0000","last_undegraded":"2024-04-26T12:05:46.887884+0000","last_fullsized":"2024-04-26T12:05:46.887884+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888610+0000","last_change":"2024-04-26T12:05:03.428971+0000","last_active":"2024-04-26T12:05:46.888610+0000","last_peered":"2024-04-26T12:05:46.888610+0000","last_clean":"2024-04-26T12:05:46.888610+0000","last_became_active":"2024-04-26T12:05:03.428445+0000","last_became_peered":"2024-04-26T12:05:03.428445+0000","last_unstale":"2024-04-26T12:05:46.888610+0000","last_undegraded":"2024-04-26T12:05:46.888610+0000","last_fullsized":"2024-04-26T12:05:46.888610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.887751+0000","last_change":"2024-04-26T12:05:03.795318+0000","last_active":"2024-04-26T12:05:46.887751+0000","last_peered":"2024-04-26T12:05:46.887751+0000","last_clean":"2024-04-26T12:05:46.887751+0000","last_became_active":"2024-04-26T12:05:03.795053+0000","last_became_peered":"2024-04-26T12:05:03.795053+0000","last_unstale":"2024-04-26T12:05:46.887751+0000","last_undegraded":"2024-04-26T12:05:46.887751+0000","last_fullsized":"2024-04-26T12:05:46.887751+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:16.372597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630801+0000","last_change":"2024-04-26T12:05:03.795109+0000","last_active":"2024-04-26T12:05:47.630801+0000","last_peered":"2024-04-26T12:05:47.630801+0000","last_clean":"2024-04-26T12:05:47.630801+0000","last_became_active":"2024-04-26T12:05:03.794392+0000","last_became_peered":"2024-04-26T12:05:03.794392+0000","last_unstale":"2024-04-26T12:05:47.630801+0000","last_undegraded":"2024-04-26T12:05:47.630801+0000","last_fullsized":"2024-04-26T12:05:47.630801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:05.327938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888035+0000","last_change":"2024-04-26T12:05:03.429889+0000","last_active":"2024-04-26T12:05:46.888035+0000","last_peered":"2024-04-26T12:05:46.888035+0000","last_clean":"2024-04-26T12:05:46.888035+0000","last_became_active":"2024-04-26T12:05:03.429370+0000","last_became_peered":"2024-04-26T12:05:03.429370+0000","last_unstale":"2024-04-26T12:05:46.888035+0000","last_undegraded":"2024-04-26T12:05:46.888035+0000","last_fullsized":"2024-04-26T12:05:46.888035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:26.791180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888440+0000","last_change":"2024-04-26T12:05:03.788754+0000","last_active":"2024-04-26T12:05:46.888440+0000","last_peered":"2024-04-26T12:05:46.888440+0000","last_clean":"2024-04-26T12:05:46.888440+0000","last_became_active":"2024-04-26T12:05:03.788311+0000","last_became_peered":"2024-04-26T12:05:03.788311+0000","last_unstale":"2024-04-26T12:05:46.888440+0000","last_undegraded":"2024-04-26T12:05:46.888440+0000","last_fullsized":"2024-04-26T12:05:46.888440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888146+0000","last_change":"2024-04-26T12:05:03.428810+0000","last_active":"2024-04-26T12:05:46.888146+0000","last_peered":"2024-04-26T12:05:46.888146+0000","last_clean":"2024-04-26T12:05:46.888146+0000","last_became_active":"2024-04-26T12:05:03.428191+0000","last_became_peered":"2024-04-26T12:05:03.428191+0000","last_unstale":"2024-04-26T12:05:46.888146+0000","last_undegraded":"2024-04-26T12:05:46.888146+0000","last_fullsized":"2024-04-26T12:05:46.888146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630647+0000","last_change":"2024-04-26T12:05:03.796880+0000","last_active":"2024-04-26T12:05:47.630647+0000","last_peered":"2024-04-26T12:05:47.630647+0000","last_clean":"2024-04-26T12:05:47.630647+0000","last_became_active":"2024-04-26T12:05:03.796419+0000","last_became_peered":"2024-04-26T12:05:03.796419+0000","last_unstale":"2024-04-26T12:05:47.630647+0000","last_undegraded":"2024-04-26T12:05:47.630647+0000","last_fullsized":"2024-04-26T12:05:47.630647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:58.872589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630188+0000","last_change":"2024-04-26T12:05:03.428084+0000","last_active":"2024-04-26T12:05:47.630188+0000","last_peered":"2024-04-26T12:05:47.630188+0000","last_clean":"2024-04-26T12:05:47.630188+0000","last_became_active":"2024-04-26T12:05:03.426982+0000","last_became_peered":"2024-04-26T12:05:03.426982+0000","last_unstale":"2024-04-26T12:05:47.630188+0000","last_undegraded":"2024-04-26T12:05:47.630188+0000","last_fullsized":"2024-04-26T12:05:47.630188+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:19.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630459+0000","last_change":"2024-04-26T12:05:03.793470+0000","last_active":"2024-04-26T12:05:47.630459+0000","last_peered":"2024-04-26T12:05:47.630459+0000","last_clean":"2024-04-26T12:05:47.630459+0000","last_became_active":"2024-04-26T12:05:03.792869+0000","last_became_peered":"2024-04-26T12:05:03.792869+0000","last_unstale":"2024-04-26T12:05:47.630459+0000","last_undegraded":"2024-04-26T12:05:47.630459+0000","last_fullsized":"2024-04-26T12:05:47.630459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:27.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630374+0000","last_change":"2024-04-26T12:05:03.426947+0000","last_active":"2024-04-26T12:05:47.630374+0000","last_peered":"2024-04-26T12:05:47.630374+0000","last_clean":"2024-04-26T12:05:47.630374+0000","last_became_active":"2024-04-26T12:05:03.426211+0000","last_became_peered":"2024-04-26T12:05:03.426211+0000","last_unstale":"2024-04-26T12:05:47.630374+0000","last_undegraded":"2024-04-26T12:05:47.630374+0000","last_fullsized":"2024-04-26T12:05:47.630374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:11.959244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.887995+0000","last_change":"2024-04-26T12:05:03.791986+0000","last_active":"2024-04-26T12:05:46.887995+0000","last_peered":"2024-04-26T12:05:46.887995+0000","last_clean":"2024-04-26T12:05:46.887995+0000","last_became_active":"2024-04-26T12:05:03.790823+0000","last_became_peered":"2024-04-26T12:05:03.790823+0000","last_unstale":"2024-04-26T12:05:46.887995+0000","last_undegraded":"2024-04-26T12:05:46.887995+0000","last_fullsized":"2024-04-26T12:05:46.887995+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888121+0000","last_change":"2024-04-26T12:05:03.429469+0000","last_active":"2024-04-26T12:05:46.888121+0000","last_peered":"2024-04-26T12:05:46.888121+0000","last_clean":"2024-04-26T12:05:46.888121+0000","last_became_active":"2024-04-26T12:05:03.429015+0000","last_became_peered":"2024-04-26T12:05:03.429015+0000","last_unstale":"2024-04-26T12:05:46.888121+0000","last_undegraded":"2024-04-26T12:05:46.888121+0000","last_fullsized":"2024-04-26T12:05:46.888121+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.887971+0000","last_change":"2024-04-26T12:05:03.791929+0000","last_active":"2024-04-26T12:05:46.887971+0000","last_peered":"2024-04-26T12:05:46.887971+0000","last_clean":"2024-04-26T12:05:46.887971+0000","last_became_active":"2024-04-26T12:05:03.791540+0000","last_became_peered":"2024-04-26T12:05:03.791540+0000","last_unstale":"2024-04-26T12:05:46.887971+0000","last_undegraded":"2024-04-26T12:05:46.887971+0000","last_fullsized":"2024-04-26T12:05:46.887971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630767+0000","last_change":"2024-04-26T12:05:03.426210+0000","last_active":"2024-04-26T12:05:47.630767+0000","last_peered":"2024-04-26T12:05:47.630767+0000","last_clean":"2024-04-26T12:05:47.630767+0000","last_became_active":"2024-04-26T12:05:03.425782+0000","last_became_peered":"2024-04-26T12:05:03.425782+0000","last_unstale":"2024-04-26T12:05:47.630767+0000","last_undegraded":"2024-04-26T12:05:47.630767+0000","last_fullsized":"2024-04-26T12:05:47.630767+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:26.791180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:47.630114+0000","last_change":"2024-04-26T12:05:03.795264+0000","last_active":"2024-04-26T12:05:47.630114+0000","last_peered":"2024-04-26T12:05:47.630114+0000","last_clean":"2024-04-26T12:05:47.630114+0000","last_became_active":"2024-04-26T12:05:03.794448+0000","last_became_peered":"2024-04-26T12:05:03.794448+0000","last_unstale":"2024-04-26T12:05:47.630114+0000","last_undegraded":"2024-04-26T12:05:47.630114+0000","last_fullsized":"2024-04-26T12:05:47.630114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888603+0000","last_change":"2024-04-26T12:05:03.429872+0000","last_active":"2024-04-26T12:05:46.888603+0000","last_peered":"2024-04-26T12:05:46.888603+0000","last_clean":"2024-04-26T12:05:46.888603+0000","last_became_active":"2024-04-26T12:05:03.429401+0000","last_became_peered":"2024-04-26T12:05:03.429401+0000","last_unstale":"2024-04-26T12:05:46.888603+0000","last_undegraded":"2024-04-26T12:05:46.888603+0000","last_fullsized":"2024-04-26T12:05:46.888603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.887807+0000","last_change":"2024-04-26T12:05:03.791827+0000","last_active":"2024-04-26T12:05:46.887807+0000","last_peered":"2024-04-26T12:05:46.887807+0000","last_clean":"2024-04-26T12:05:46.887807+0000","last_became_active":"2024-04-26T12:05:03.791442+0000","last_became_peered":"2024-04-26T12:05:03.791442+0000","last_unstale":"2024-04-26T12:05:46.887807+0000","last_undegraded":"2024-04-26T12:05:46.887807+0000","last_fullsized":"2024-04-26T12:05:46.887807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T12:05:46.888561+0000","last_change":"2024-04-26T12:05:03.430659+0000","last_active":"2024-04-26T12:05:46.888561+0000","last_peered":"2024-04-26T12:05:46.888561+0000","last_clean":"2024-04-26T12:05:46.888561+0000","last_became_active":"2024-04-26T12:05:03.430164+0000","last_became_peered":"2024-04-26T12:05:03.430164+0000","last_unstale":"2024-04-26T12:05:46.888561+0000","last_undegraded":"2024-04-26T12:05:46.888561+0000","last_fullsized":"2024-04-26T12:05:46.888561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7305,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738384,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":339968,"data_stored":699105,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]}]},{"osd":1,"up_from":8,"seq":34359738383,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":331776,"data_stored":698489,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738384,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":102048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:05:55.824 INFO:tasks.thrashosds.thrasher:Setting 2.6 to [0, 1] 2024-04-26T12:05:55.824 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '2.6', '0', '1'] 2024-04-26T12:05:55.824 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 2.6 0 1 2024-04-26T12:05:55.837 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:55.837 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:55.847 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:55.905 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:55.904+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:55.906 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-26T12:05:55.957 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:55.958 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:55.967 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:56.006 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:56.005+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:56.107 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:56.106+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:56.108 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:56.109 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:56.117 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:56.208 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:56.206+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:56.259 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:56.259 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:56.268 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:56.308 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:56.308+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:56.380 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:56.380 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:56.389 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:56.409 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:56.409+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:56.491 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:56.491 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:56.500 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:56.511 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:56.510+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:56.601 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:56.601 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:56.610 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:56.611 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:56.611+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:56.712 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:56.712+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:56.715 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:56.715 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:56.724 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:56.814 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:56.813+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:56.827 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:56.827 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:56.839 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:56.913 INFO:teuthology.orchestra.run.smithi052.stderr:set 2.6 pg_upmap mapping to [0,1] 2024-04-26T12:05:56.914 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:56.914+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:56.983 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:56.983 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:56.992 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:57.015 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:57.014+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:57.099 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:57.099 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:57.107 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:57.116 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:57.115+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:57.209 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:57.210 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:57.217 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:57.216+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:57.219 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:57.317 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:57.317+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:57.319 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:57.320 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:57.328 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:57.419 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:57.418+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:57.433 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:57.433 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:57.441 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:57.525 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:57.524+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:57.584 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:57.585 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:57.594 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:57.621 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:57.620+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:57.722 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:57.721+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:57.735 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:57.735 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:57.743 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:57.823 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:57.823+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:57.826 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:05:57.852 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:57.853 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:57.862 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:57.921 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:05:57.924 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:57.922+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:57.961 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:05:57.961 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:05:57.963 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:05:57.963 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:05:57.972 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:57.995 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T12:05:57.996 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:05:58.013 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:05:58.013 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:05:58.025 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:58.023+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:58.116 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:58.116 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:05:58.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:05:58.116 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:05:58.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.116 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:58.116 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:58.117 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 64.259148619000001, 2024-04-26T12:05:58.117 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:05:58.117 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:58.117 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.117 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:58.117 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:58.117 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:58.117 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:05:58.117 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.117 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:58.117 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.117 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:58.117 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:58.117 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.117 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:58.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:58.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:58.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:58.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:58.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:05:58.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:05:58.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.119 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:58.119 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:05:58.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:05:58.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.119 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.119 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:05:58.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:05:58.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.119 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:58.119 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:05:58.120 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:05:58.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.120 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:58.120 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:05:58.120 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:05:58.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.120 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:58.120 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:05:58.120 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:05:58.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.120 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:58.120 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:05:58.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:05:58.121 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.121 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:05:58.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:05:58.121 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.121 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:58.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:05:58.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:05:58.121 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.121 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:58.122 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:05:58.122 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:05:58.122 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.122 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:58.122 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.122 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.122 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.122 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:58.122 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:58.122 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 64.259042722999993, 2024-04-26T12:05:58.122 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:05:58.122 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:58.122 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.122 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:58.122 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:58.123 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:58.123 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:05:58.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.123 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:58.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.123 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:58.123 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:58.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.123 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:58.123 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:58.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.124 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:58.124 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:58.124 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.124 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.124 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.124 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:58.124 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:05:58.124 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:05:58.124 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.124 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.124 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:58.124 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:05:58.124 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:05:58.124 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.124 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.125 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.125 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:05:58.125 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:05:58.125 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.125 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.125 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:58.125 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:05:58.125 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:05:58.125 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.125 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.125 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:58.125 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:05:58.125 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:05:58.125 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.125 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.126 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:58.126 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:05:58.126 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:05:58.126 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.126 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.126 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:58.126 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:05:58.126 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:05:58.126 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.126 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.126 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.126 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:05:58.126 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:05:58.126 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.127 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.127 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:58.127 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:05:58.127 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:05:58.127 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.127 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.127 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:58.127 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:05:58.127 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:05:58.127 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.127 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:58.127 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.127 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.127 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.128 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:58.128 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:58.128 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 64.259027743000004, 2024-04-26T12:05:58.128 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:05:58.128 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:58.128 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.128 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:58.128 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:58.128 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:58.128 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:05:58.128 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.128 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:58.128 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.128 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:58.128 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:58.129 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.129 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.129 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.129 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:58.129 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:58.129 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.129 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.129 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.129 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:58.129 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:58.129 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.129 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.129 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.129 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:58.129 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:05:58.130 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:05:58.130 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.130 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.130 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:58.130 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:05:58.130 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:05:58.130 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.130 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.130 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.130 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:05:58.130 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:05:58.130 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.130 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.130 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:58.131 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:05:58.131 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:05:58.131 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.131 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.131 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:58.131 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:05:58.131 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:05:58.131 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.131 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.131 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:58.131 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:05:58.131 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:05:58.131 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.131 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.131 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:58.132 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:05:58.132 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:05:58.132 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.132 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.132 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.132 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:05:58.132 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:05:58.132 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.132 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.132 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:58.132 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:05:58.132 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:05:58.132 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.132 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.133 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:58.133 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:05:58.133 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:05:58.133 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.133 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:58.133 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.133 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.133 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.133 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:58.133 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:58.133 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 64.258983868000001, 2024-04-26T12:05:58.133 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:05:58.133 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:58.133 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.133 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:58.133 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:58.134 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:58.134 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:05:58.134 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.134 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:58.134 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.134 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:58.134 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:58.134 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.134 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.134 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.134 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:58.134 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:58.134 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.134 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.135 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.135 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:58.135 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:58.135 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.135 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.135 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.135 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:58.135 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:05:58.135 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:05:58.135 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.135 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.135 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:58.135 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:05:58.135 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:05:58.135 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.135 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.136 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.136 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:05:58.136 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:05:58.136 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.136 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.136 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:58.136 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:05:58.136 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:05:58.136 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.136 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.136 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:58.136 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:05:58.136 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:05:58.136 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.137 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.137 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:58.137 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:05:58.137 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:05:58.137 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.137 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.137 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:58.137 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:05:58.137 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:05:58.137 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.137 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.137 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.138 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:05:58.138 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:05:58.138 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.138 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.138 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:58.138 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:05:58.138 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:05:58.138 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.138 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.138 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:58.138 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:05:58.138 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:05:58.138 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.138 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:58.138 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.139 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.139 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.139 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:58.139 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:58.139 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 64.258898204000005, 2024-04-26T12:05:58.139 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:05:58.139 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:58.139 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.139 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:58.139 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:58.139 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:58.139 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:05:58.139 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.139 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:58.140 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.140 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:58.140 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:58.140 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.140 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.140 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.140 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:58.140 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:58.140 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.140 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.140 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.140 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:58.140 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:58.140 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.140 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.141 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.141 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:58.141 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:05:58.141 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:05:58.141 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.141 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.141 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:58.141 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:05:58.141 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:05:58.141 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.141 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.141 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.141 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:05:58.141 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:05:58.142 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.142 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.142 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:58.142 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:05:58.142 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:05:58.142 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.142 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.142 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:58.142 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:05:58.142 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:05:58.142 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.142 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.142 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:58.142 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:05:58.143 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:05:58.143 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.143 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.143 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:58.143 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:05:58.143 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:05:58.143 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.143 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.143 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.143 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:05:58.143 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:05:58.143 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.143 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.143 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:58.144 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:05:58.144 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:05:58.144 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.144 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.144 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:58.144 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:05:58.144 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:05:58.144 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.144 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:58.144 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.144 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.144 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.144 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:58.144 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:58.145 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 54.332993918, 2024-04-26T12:05:58.145 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:05:58.145 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:58.145 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.145 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:58.145 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.145 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:58.145 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:58.145 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.145 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.145 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.145 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:58.145 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:58.145 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.145 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.146 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.146 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:58.146 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:58.146 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:58.146 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.146 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.146 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:58.146 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:05:58.146 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:05:58.146 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.146 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.146 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:58.146 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:05:58.147 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:05:58.147 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.147 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.147 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.147 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:05:58.147 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:05:58.147 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.147 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.147 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:58.147 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:05:58.147 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:05:58.147 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.147 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.147 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:58.147 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:05:58.147 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:05:58.148 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.148 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.148 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:58.148 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:05:58.148 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:05:58.148 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.148 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.148 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:58.148 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:05:58.148 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:05:58.148 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.148 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.148 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.148 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:05:58.149 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:05:58.149 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.149 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.149 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:58.149 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:05:58.149 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:05:58.149 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.149 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.149 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:58.149 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:05:58.149 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:05:58.149 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.149 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:58.149 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.150 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.150 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.150 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:58.150 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:58.150 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 54.332957823000001, 2024-04-26T12:05:58.150 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:05:58.150 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:58.150 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.150 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:58.150 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.150 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:58.150 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:58.150 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.150 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.151 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.151 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:58.151 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:58.151 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.151 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.151 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.151 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:58.151 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:05:58.151 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:58.151 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.151 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.151 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:58.151 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:05:58.151 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:05:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:05:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:05:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:05:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:05:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:05:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:05:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:05:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:05:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:05:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:05:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:05:58.154 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:05:58.154 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.154 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.154 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.154 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:05:58.154 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:05:58.154 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.154 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.154 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:58.154 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:05:58.154 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:05:58.154 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.154 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.154 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:05:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:05:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 54.332920139000002, 2024-04-26T12:05:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:05:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.156 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:58.156 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:58.156 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.156 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.156 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.156 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:58.156 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:58.156 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.156 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.156 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.156 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:58.156 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:05:58.156 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.156 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.157 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.157 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:58.157 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:05:58.157 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:05:58.157 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.157 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.157 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:58.157 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:05:58.157 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:05:58.157 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:05:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:05:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.160 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.160 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:58.160 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:05:58.160 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:05:58.160 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.160 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.160 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:58.160 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:58.161 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:05:58.161 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.161 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.161 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:58.161 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:05:58.161 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:05:58.162 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.162 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.162 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:58.162 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:05:58.162 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:05:58.162 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.163 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.163 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.163 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:05:58.163 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:05:58.163 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.163 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.163 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:58.164 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:05:58.164 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:05:58.164 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.164 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.164 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:58.164 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:05:58.164 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:05:58.164 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.165 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:58.165 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.165 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.165 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.165 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:58.165 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:58.165 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 54.332898798999999, 2024-04-26T12:05:58.165 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:05:58.166 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:58.167 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.167 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:58.167 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.167 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:58.167 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:58.167 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.168 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.168 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.168 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:58.168 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:58.169 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.169 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.169 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.169 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:58.169 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:58.169 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.169 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.169 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.170 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:58.170 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:05:58.170 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:58.170 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.170 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.170 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:58.170 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:05:58.170 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:05:58.170 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.170 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.170 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.170 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:05:58.171 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:05:58.171 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.171 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.171 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:58.171 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:05:58.171 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:05:58.171 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.171 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.171 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:58.171 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:05:58.171 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:05:58.172 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.172 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.172 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:58.172 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:05:58.172 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:05:58.173 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.173 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.173 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:58.173 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:05:58.173 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:05:58.173 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.173 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.173 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.173 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:05:58.173 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:05:58.173 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.173 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.173 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:58.173 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:05:58.174 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:05:58.174 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.174 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.174 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:58.174 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:05:58.174 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:05:58.174 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.174 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:58.174 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.174 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.174 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.174 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:58.175 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:58.175 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 54.332876532999997, 2024-04-26T12:05:58.175 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:05:58.175 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:58.175 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.175 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:58.175 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.175 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:58.175 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:58.175 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.175 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.175 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.175 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:58.176 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:58.176 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.176 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.176 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.176 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:58.176 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:58.176 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.176 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.176 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.176 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:58.176 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:05:58.176 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:58.176 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.176 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.177 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:58.177 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:05:58.177 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:05:58.177 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.177 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.177 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.177 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:05:58.177 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:05:58.177 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.177 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.177 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:58.177 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:05:58.177 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:05:58.177 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.178 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.178 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:58.178 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:05:58.178 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:05:58.178 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.178 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.178 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:58.178 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:05:58.178 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:05:58.178 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.178 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.178 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:58.178 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:05:58.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:05:58.179 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.179 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.179 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.179 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:05:58.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:05:58.179 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.179 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.179 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:58.179 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:05:58.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:05:58.179 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.179 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.179 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:58.180 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:05:58.180 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:05:58.180 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.180 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:58.180 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.180 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.180 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.180 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:58.180 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:58.180 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 54.332854910999998, 2024-04-26T12:05:58.180 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:05:58.180 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:58.180 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.181 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:58.181 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.181 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:58.181 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:58.181 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.181 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.181 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.181 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:58.181 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:58.181 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.181 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.181 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.181 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:58.181 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:58.182 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.182 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.182 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.182 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:58.182 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:05:58.182 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:05:58.182 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.182 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.182 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:58.182 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:05:58.182 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:05:58.182 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.182 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.183 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.183 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:05:58.183 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:05:58.183 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.183 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.183 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:58.183 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:05:58.184 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:05:58.184 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.184 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.184 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:58.184 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:05:58.184 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:05:58.184 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.184 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.184 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:58.184 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:05:58.184 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:05:58.184 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.184 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.184 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:58.185 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:05:58.185 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:05:58.185 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.185 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.185 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.185 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:05:58.185 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:05:58.185 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.185 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.185 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:58.185 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:05:58.185 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:05:58.185 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.185 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.185 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:58.186 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:05:58.186 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:05:58.186 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.186 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:58.186 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.186 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.186 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.186 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:58.186 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:58.186 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 54.332828345000003, 2024-04-26T12:05:58.186 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:05:58.186 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:58.186 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.186 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:58.187 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.187 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:58.187 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:58.187 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.187 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.187 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.187 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:58.187 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:58.187 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.187 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.187 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.187 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:58.187 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:05:58.187 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.188 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.188 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.188 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:58.188 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:05:58.188 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:05:58.188 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.188 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.188 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:58.188 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:05:58.188 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:05:58.188 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.188 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.189 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.189 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:05:58.189 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:05:58.189 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.189 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.189 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:58.189 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:05:58.189 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:05:58.189 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.189 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.189 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:58.189 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:05:58.189 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:05:58.189 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.189 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.190 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:58.190 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:05:58.190 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:05:58.190 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.190 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.190 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:58.190 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:05:58.190 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:05:58.190 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.190 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.190 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.190 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:05:58.190 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:05:58.191 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.191 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.191 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:58.191 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:05:58.191 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:05:58.191 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.191 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.191 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:58.191 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:05:58.191 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:05:58.191 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.191 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:58.192 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.192 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.192 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.192 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:58.192 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:58.192 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 54.332789833, 2024-04-26T12:05:58.192 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:05:58.192 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:58.192 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.192 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:58.192 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.192 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:58.193 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:58.193 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.193 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.193 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.193 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:58.193 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:58.194 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.194 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.194 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.194 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:58.194 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:58.194 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.195 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.195 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.195 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:58.195 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:05:58.195 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:05:58.195 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.196 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.196 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:58.196 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:05:58.196 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:05:58.196 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.196 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.197 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.197 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:05:58.197 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:05:58.197 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.197 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.198 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:58.198 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:05:58.198 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:05:58.198 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.198 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.198 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:58.199 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:05:58.199 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:05:58.199 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.199 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.199 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:58.199 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:05:58.200 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:05:58.200 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.200 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.200 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:58.200 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:05:58.200 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:05:58.200 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.200 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.201 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.201 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:05:58.201 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:05:58.201 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.201 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.201 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:58.201 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:05:58.201 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:05:58.201 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.201 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.202 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:58.202 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:05:58.202 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:05:58.202 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.202 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:58.202 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.202 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.202 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.202 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:58.202 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:58.202 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 54.332761660000003, 2024-04-26T12:05:58.202 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:05:58.202 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:58.203 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.203 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:58.203 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.203 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:58.203 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:58.203 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.203 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.203 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.203 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:58.203 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:58.203 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.203 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.203 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.203 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:58.204 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:58.204 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.204 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.204 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.204 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:58.204 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:05:58.204 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:05:58.204 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.204 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.204 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:58.204 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:05:58.204 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:05:58.204 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.204 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.205 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.205 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:05:58.205 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:05:58.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.205 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.205 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:58.205 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:05:58.205 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:05:58.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.205 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.205 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:58.205 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:05:58.205 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:05:58.206 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.206 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.206 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:58.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:05:58.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:05:58.206 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.206 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.206 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:58.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:05:58.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:05:58.206 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.206 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.206 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:05:58.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:05:58.207 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.207 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.207 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:58.207 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:05:58.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:05:58.207 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.208 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.208 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:58.208 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:05:58.208 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:05:58.208 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.208 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:58.208 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.208 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.208 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.208 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:58.208 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:58.208 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 54.332727095999999, 2024-04-26T12:05:58.208 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:05:58.209 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:58.209 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.209 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:58.209 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.209 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:58.209 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:58.209 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.209 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.209 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.209 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:58.209 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:58.209 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.209 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.209 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.210 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:58.210 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:05:58.210 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.210 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.210 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.210 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:58.210 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:05:58.210 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:05:58.210 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.210 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.210 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:58.210 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:05:58.210 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:05:58.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.211 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.211 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.211 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:05:58.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:05:58.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.211 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.211 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:58.211 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:05:58.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:05:58.212 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.212 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.212 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:58.212 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:05:58.212 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:05:58.212 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.212 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.212 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:58.212 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:05:58.212 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:05:58.212 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.213 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.213 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:58.213 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:05:58.213 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:05:58.213 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.213 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.213 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.213 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:05:58.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:05:58.214 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.214 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.214 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:58.214 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:58.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:05:58.214 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.214 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.214 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:58.214 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:05:58.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:05:58.214 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.215 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:58.215 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.215 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.215 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.216 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:58.216 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:58.216 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 54.331852316000003, 2024-04-26T12:05:58.216 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:05:58.216 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:58.216 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.216 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:58.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.216 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:58.216 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:58.216 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:58.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:58.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.217 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.217 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:58.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:05:58.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:58.217 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.217 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:58.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:05:58.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:05:58.217 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.218 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.218 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:58.218 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:05:58.218 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:05:58.218 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.218 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.218 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.218 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:05:58.218 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:05:58.219 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.219 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.219 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:58.219 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:05:58.219 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:05:58.219 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.219 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.219 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:58.219 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:05:58.219 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:05:58.220 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.220 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.220 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:58.220 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:05:58.220 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:05:58.220 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.220 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.220 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:58.220 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:05:58.221 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:05:58.221 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.221 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.221 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.221 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:05:58.221 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:05:58.221 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.221 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.221 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:58.222 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:05:58.222 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:05:58.222 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.222 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.222 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:58.222 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:05:58.222 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:05:58.222 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.222 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:58.222 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.222 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.223 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.223 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:58.223 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:58.223 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 54.331813357000001, 2024-04-26T12:05:58.223 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:05:58.223 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:58.223 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.223 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:58.223 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.223 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:58.223 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:58.223 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.223 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.223 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.224 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:58.224 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:58.224 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.224 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.224 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.224 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:58.224 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:05:58.224 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.224 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.224 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.224 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:58.224 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:05:58.224 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:05:58.224 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.224 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.225 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:58.225 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:05:58.225 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:05:58.225 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.225 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.225 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.225 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:05:58.225 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:05:58.225 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.225 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.226 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:58.226 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:05:58.226 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:05:58.226 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.226 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.226 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:58.226 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:05:58.226 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:05:58.226 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.226 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.226 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:58.226 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:05:58.226 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:05:58.227 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.227 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.227 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:58.227 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:05:58.227 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:05:58.227 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.227 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.227 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.227 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:05:58.227 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:05:58.227 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.227 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.227 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:58.228 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:05:58.228 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:05:58.228 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.228 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.228 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:58.228 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:05:58.228 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:05:58.229 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.229 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:58.229 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.229 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.229 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.229 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:58.229 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:58.229 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 54.331777885000001, 2024-04-26T12:05:58.229 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:05:58.229 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:58.229 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.229 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:58.229 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.229 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:58.230 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:58.230 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.230 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.230 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.230 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:58.230 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:58.230 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.230 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.230 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.230 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:58.230 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:58.230 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.230 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.230 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.231 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:58.231 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:05:58.231 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:05:58.231 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.231 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.231 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:58.231 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:05:58.231 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:05:58.231 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.231 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.231 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.231 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:05:58.231 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:05:58.231 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.231 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.232 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:58.232 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:05:58.232 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:05:58.232 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.232 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.232 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:58.232 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:05:58.232 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:05:58.232 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.232 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.232 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:58.232 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:05:58.232 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:05:58.232 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.233 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.233 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:58.233 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:05:58.233 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:05:58.233 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.233 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.233 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.234 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:05:58.234 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:05:58.234 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.234 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:58.234 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:05:58.234 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:05:58.234 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.234 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:58.235 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:05:58.235 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:05:58.235 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.235 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:58.235 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.238 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.238 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.238 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:58.238 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:58.239 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 54.331699196000002, 2024-04-26T12:05:58.239 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:05:58.239 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:58.239 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.239 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:58.239 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.239 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:58.240 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:58.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.240 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:58.240 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:58.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.240 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:58.240 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:05:58.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:58.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:58.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:05:58.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:05:58.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:58.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:05:58.242 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:05:58.242 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.242 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.242 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.242 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:05:58.242 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:05:58.243 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.243 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.243 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:58.243 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:05:58.243 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:05:58.243 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.243 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.244 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:58.244 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:05:58.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:05:58.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.244 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:58.244 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:05:58.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:05:58.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:58.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:05:58.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:05:58.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:05:58.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:05:58.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:58.246 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:05:58.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:05:58.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.246 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:58.246 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:05:58.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:05:58.246 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.246 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:58.246 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.247 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:58.247 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:58.247 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 54.331548347999998, 2024-04-26T12:05:58.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:05:58.247 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:58.247 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:05:58.247 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:58.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:58.247 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:58.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.247 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.248 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:58.248 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:58.248 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:58.248 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.248 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:58.248 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:05:58.248 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:58.248 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.248 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:58.248 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:05:58.248 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:05:58.248 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.249 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:58.249 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:05:58.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:05:58.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.249 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.249 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:05:58.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:05:58.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.249 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:58.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:05:58.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:05:58.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:58.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:58.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:05:58.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:58.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:58.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:58.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:05:58.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:05:58.251 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.251 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:58.251 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.251 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:58.251 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:58.251 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:58.252 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:58.253 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:58.252+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:58.353 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:58.352+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:58.366 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:58.366 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:58.366 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:05:58.366 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:58.376 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:58.454 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:58.453+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:58.478 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:58.478 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:58.478 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:05:58.478 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:05:58.478 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:58.486 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:58.554 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:58.553+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:58.590 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:58.590 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:05:58.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:05:58.590 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:05:58.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.590 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:58.590 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:58.590 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 54.807848583999998, 2024-04-26T12:05:58.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:05:58.590 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:58.590 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.591 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:58.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:58.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:58.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:58.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:58.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:58.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:05:58.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:58.592 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.592 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.592 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:58.592 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:05:58.592 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:05:58.592 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.592 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.592 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:58.592 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:05:58.592 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:05:58.592 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.592 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.592 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.592 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:05:58.593 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:05:58.593 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.593 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.593 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:58.593 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:05:58.593 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:05:58.593 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.593 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.593 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:58.593 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:58.593 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:05:58.593 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.593 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.593 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:58.594 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:05:58.594 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:05:58.594 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.594 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.594 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:58.594 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:05:58.594 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:05:58.594 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.594 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.594 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.594 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:05:58.594 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:05:58.594 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.594 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.595 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:58.595 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:05:58.595 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:05:58.595 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.595 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.595 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:58.595 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:05:58.595 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:05:58.595 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.595 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:58.595 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.595 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.595 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.595 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:58.595 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:58.595 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 54.807793263999997, 2024-04-26T12:05:58.596 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:05:58.596 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:58.596 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.596 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:58.596 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.596 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:58.596 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:58.596 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.596 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.596 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.596 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:58.596 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:58.596 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.596 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.597 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.597 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:58.597 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:05:58.597 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:58.597 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.597 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.597 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:58.597 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:05:58.597 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:05:58.597 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.597 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.597 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:58.597 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:05:58.597 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:05:58.598 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.598 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.598 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.598 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:05:58.598 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:05:58.598 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.598 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.598 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:58.598 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:05:58.598 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:05:58.598 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.598 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.598 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:58.598 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:05:58.599 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:05:58.599 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.599 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.599 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:58.599 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:05:58.599 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:05:58.599 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.599 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.599 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:58.599 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:05:58.599 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:05:58.599 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.599 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.599 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.600 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:05:58.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:05:58.600 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.600 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.600 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:58.600 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:05:58.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:05:58.600 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.600 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.600 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:58.600 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:05:58.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:05:58.600 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.600 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:58.600 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.600 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.601 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.601 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:58.601 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:58.601 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 54.807743246000001, 2024-04-26T12:05:58.601 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:05:58.601 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:58.601 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.601 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:58.601 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.601 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:58.601 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:58.601 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.601 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.601 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.601 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:58.601 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:58.601 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.602 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.602 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.602 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:58.602 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:05:58.602 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.602 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.602 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.602 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:58.602 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:05:58.602 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:05:58.602 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.602 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.602 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:58.602 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:05:58.602 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:05:58.603 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.603 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.603 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.603 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:05:58.603 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:05:58.603 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.603 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.603 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:58.603 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:05:58.603 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:05:58.603 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.603 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.603 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:58.603 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:05:58.603 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:05:58.604 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.604 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.604 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:58.604 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:05:58.604 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:05:58.604 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.604 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.604 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:58.604 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:05:58.604 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:05:58.604 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.604 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.604 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.604 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:05:58.604 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:05:58.604 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.605 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.605 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:58.605 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:05:58.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:05:58.605 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.605 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.605 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:58.605 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:05:58.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:05:58.605 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.605 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:58.605 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.605 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.605 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.605 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:58.605 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:58.606 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 54.807708609000002, 2024-04-26T12:05:58.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:05:58.606 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:58.606 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.606 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:58.606 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:58.606 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:58.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.606 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.606 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:58.606 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:58.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.606 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.607 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.607 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:58.607 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:05:58.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.607 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.607 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.607 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:58.607 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:05:58.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:05:58.607 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.607 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.607 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:58.607 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:58.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:05:58.607 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.608 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.608 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.608 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:05:58.608 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:05:58.608 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.608 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.608 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:58.608 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:05:58.608 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:05:58.608 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.608 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.608 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:58.608 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:05:58.608 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:05:58.608 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.608 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.609 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:58.609 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:05:58.609 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:05:58.609 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.609 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.609 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.609 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:05:58.609 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:05:58.609 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.609 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.609 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:58.609 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:05:58.609 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:05:58.609 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.609 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.610 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:58.610 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:05:58.610 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:05:58.610 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.610 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.610 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:58.610 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:05:58.610 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:05:58.610 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.610 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:58.610 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.610 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.610 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.611 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:58.611 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:58.611 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 54.807670096999999, 2024-04-26T12:05:58.611 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:05:58.611 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:58.611 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.611 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:58.611 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.611 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:58.611 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:58.611 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.611 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.611 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.611 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:58.611 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:58.612 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.612 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.612 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.612 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:58.612 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:58.612 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:58.612 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.612 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.612 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:58.612 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:58.612 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:05:58.612 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.612 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.612 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:58.612 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:05:58.612 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:05:58.613 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.613 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.613 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.613 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:05:58.613 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:05:58.613 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.613 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.613 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:58.613 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:05:58.613 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:05:58.613 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.613 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.613 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:58.613 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:05:58.613 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:05:58.613 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.614 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.614 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:58.614 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:05:58.614 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:05:58.614 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.614 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.614 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.614 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:05:58.614 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:05:58.614 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.614 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.614 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:58.614 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:05:58.614 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:05:58.614 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.615 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.615 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:58.615 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:05:58.615 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:05:58.615 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.615 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.615 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:58.615 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:05:58.615 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:05:58.615 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.615 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:58.615 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.615 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.615 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.616 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:58.616 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:58.616 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 54.807639774000002, 2024-04-26T12:05:58.616 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:05:58.616 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:58.616 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.616 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:58.616 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.616 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:58.616 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:58.616 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.616 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.616 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.616 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:58.616 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:58.616 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.617 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.617 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.617 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:58.617 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:58.617 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.617 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.617 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.617 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:58.617 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:05:58.617 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:05:58.617 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.617 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.617 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:58.617 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:05:58.617 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:05:58.617 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.618 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.618 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.618 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:05:58.618 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:05:58.618 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.618 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.618 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:58.618 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:05:58.618 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:05:58.618 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.618 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.618 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:58.618 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:05:58.618 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:05:58.619 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.619 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.619 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:58.619 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:05:58.619 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:05:58.619 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.619 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.619 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:58.619 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:05:58.619 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:05:58.619 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.619 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.619 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.619 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:05:58.619 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:05:58.620 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.620 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.620 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:58.620 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:05:58.620 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:05:58.620 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.620 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.620 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:58.620 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:05:58.620 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:05:58.620 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.620 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:58.620 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.620 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.621 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.621 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:58.621 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:58.621 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 54.807613072000002, 2024-04-26T12:05:58.621 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:05:58.621 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:58.621 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:58.621 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:58.621 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.621 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:58.621 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:58.621 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.621 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.621 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.621 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:58.622 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:58.622 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.622 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.622 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.622 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:58.622 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:58.622 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.622 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.622 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.622 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:58.622 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:05:58.622 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:05:58.622 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.622 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.623 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:58.623 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:05:58.623 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:05:58.623 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.623 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.623 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.623 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:05:58.623 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:05:58.623 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.623 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.623 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:58.623 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:05:58.623 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:05:58.623 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.623 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.624 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:58.624 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:05:58.624 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:05:58.624 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.624 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.624 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:58.624 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:05:58.624 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:05:58.624 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.624 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:58.624 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.624 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.624 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.624 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:58.625 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:58.625 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 54.807570781999999, 2024-04-26T12:05:58.625 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:05:58.625 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:58.625 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:58.625 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:58.625 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.625 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:58.625 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:58.625 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.625 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.625 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.625 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:58.625 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:58.625 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.626 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.626 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.626 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:58.626 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:58.626 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.626 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.626 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.626 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:58.626 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:05:58.626 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:05:58.626 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.626 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.626 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:58.626 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:05:58.627 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:05:58.627 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.627 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.627 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.627 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:05:58.627 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:05:58.627 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.627 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.627 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:58.627 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:05:58.627 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:05:58.627 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.627 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.627 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:58.627 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:05:58.628 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:05:58.628 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.628 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.628 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:58.628 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:05:58.628 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:05:58.628 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.628 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:58.628 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.628 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.628 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.628 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:58.628 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:58.628 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 54.807542703999999, 2024-04-26T12:05:58.629 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:05:58.629 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:58.629 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:58.629 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:58.629 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.629 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:58.629 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:58.629 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.629 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.629 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.629 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:58.629 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:58.629 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.629 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.629 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.630 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:58.630 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:05:58.630 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.630 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.630 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.630 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:58.630 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:05:58.630 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:05:58.630 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.630 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.630 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:58.630 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:05:58.630 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:05:58.630 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.630 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.631 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.631 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:58.631 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:05:58.631 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.631 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.631 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:58.631 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:58.631 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:05:58.631 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.631 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.631 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:58.631 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:05:58.631 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:05:58.631 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.631 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.632 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:58.632 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:05:58.632 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:05:58.632 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.632 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:58.632 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.632 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.632 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.632 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:58.632 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:58.632 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 54.801547354, 2024-04-26T12:05:58.632 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:05:58.632 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:58.632 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.632 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:58.633 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.633 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:58.633 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:58.633 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.633 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.633 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.633 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:58.633 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:58.633 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.633 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.633 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.633 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:58.633 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:05:58.633 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.633 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.634 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.634 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:58.634 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:05:58.634 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:05:58.634 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.634 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.634 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:58.634 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:05:58.634 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:05:58.634 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.634 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.634 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.634 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:05:58.634 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:05:58.634 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.635 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.635 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:58.635 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:05:58.635 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:05:58.635 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.635 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.635 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:58.635 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:05:58.635 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:05:58.635 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.635 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.635 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:58.635 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:05:58.635 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:05:58.636 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.636 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.636 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:58.636 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:05:58.636 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:05:58.636 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.636 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:58.636 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.636 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.636 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.636 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:58.636 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:58.636 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 54.801478388, 2024-04-26T12:05:58.636 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:05:58.636 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:58.636 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.637 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:58.637 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.637 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:58.637 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:58.637 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.637 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.637 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.637 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:58.637 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:58.637 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.637 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.637 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.637 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:58.637 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:05:58.637 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.637 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.638 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.638 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:58.638 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:05:58.638 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:05:58.638 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.638 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.638 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:58.638 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:05:58.638 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:05:58.638 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.638 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.638 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.638 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:05:58.638 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:05:58.639 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.639 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.639 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:58.639 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:05:58.639 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:05:58.639 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.639 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.639 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:58.639 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:58.639 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:05:58.639 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.639 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.639 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:58.639 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:05:58.640 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:05:58.640 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.640 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.640 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:58.640 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:05:58.640 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:05:58.640 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.640 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:58.640 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.640 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.640 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.640 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:58.640 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:58.640 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 54.800984024999998, 2024-04-26T12:05:58.640 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:05:58.640 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:58.641 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.641 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:58.641 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.641 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:58.641 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:58.641 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.641 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.641 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.641 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:58.641 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:58.641 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.641 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.641 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.641 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:58.642 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:58.642 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.642 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.642 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.642 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:58.642 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:05:58.642 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:05:58.642 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.642 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.642 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:58.642 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:05:58.642 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:05:58.642 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.642 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.643 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.643 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:05:58.643 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:05:58.643 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.643 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.643 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:58.643 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:05:58.643 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:05:58.643 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.643 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.643 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:58.643 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:05:58.643 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:05:58.645 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.645 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.645 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:58.645 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:05:58.646 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:05:58.646 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.646 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.646 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:58.646 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:05:58.646 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:05:58.646 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.646 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:58.646 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.647 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.647 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.647 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:58.647 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:58.647 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 54.800945759999998, 2024-04-26T12:05:58.647 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:05:58.647 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:58.647 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.647 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:58.647 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.647 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:58.647 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:58.647 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.647 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.648 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.648 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:58.648 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:58.648 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.648 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.648 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.648 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:58.648 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:58.648 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.648 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.648 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.648 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:58.648 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:05:58.648 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:05:58.649 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.649 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.649 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:58.649 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:05:58.649 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:05:58.649 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.649 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.649 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.649 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:05:58.649 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:05:58.649 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.649 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.649 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:58.649 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:05:58.649 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:05:58.649 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.650 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.650 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:58.650 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:05:58.650 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:05:58.650 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.650 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.650 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:58.650 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:05:58.650 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:05:58.650 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.650 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.650 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:58.650 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:05:58.650 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:05:58.651 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.651 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:58.651 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.651 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.651 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.651 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:05:58.651 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:58.651 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 54.800265875000001, 2024-04-26T12:05:58.651 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:05:58.651 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:58.651 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:58.651 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:58.651 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.651 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:58.651 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:58.652 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.652 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.652 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.652 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:58.652 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:58.652 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.652 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.652 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.652 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:58.652 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:58.652 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.652 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.652 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.652 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:58.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:05:58.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:05:58.653 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:58.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:05:58.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:05:58.653 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:05:58.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:05:58.653 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:58.654 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:05:58.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:05:58.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.654 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.654 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:58.654 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:05:58.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:05:58.654 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.654 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:58.654 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.654 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.654 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:58.654 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:58.654 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 54.800236695999999, 2024-04-26T12:05:58.655 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:05:58.655 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:58.655 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:58.655 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:58.655 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.655 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:58.655 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:58.655 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.655 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.655 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.655 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:58.655 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:58.655 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.655 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.656 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.656 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:58.656 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:05:58.656 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.656 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.656 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.656 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:58.656 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:05:58.656 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:05:58.656 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.656 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.656 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:58.656 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:05:58.656 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:05:58.656 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.657 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.657 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.657 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:05:58.657 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:05:58.657 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.657 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.657 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:58.657 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:05:58.657 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:05:58.657 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.657 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.657 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:58.657 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:05:58.657 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:05:58.657 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.658 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.658 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:58.658 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:05:58.658 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:05:58.658 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.658 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:58.658 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.658 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.658 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.658 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:58.658 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:58.658 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 54.800204884999999, 2024-04-26T12:05:58.658 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:05:58.658 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:58.659 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:58.659 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:58.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.659 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:58.659 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:58.659 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.659 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.659 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:58.659 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:58.659 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.659 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.659 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:58.660 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:58.660 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:05:58.660 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.660 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.660 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:58.660 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:05:58.660 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:05:58.660 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.660 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.660 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:58.660 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:05:58.660 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:05:58.660 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.660 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.660 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.661 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:05:58.661 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:05:58.661 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.661 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.661 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:58.661 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:05:58.661 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:05:58.661 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.661 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.661 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:58.661 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:05:58.661 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:05:58.661 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.661 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.661 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:58.662 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:05:58.662 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:05:58.662 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.662 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:58.662 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.662 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.662 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.662 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:58.662 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:58.662 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 54.800183529000002, 2024-04-26T12:05:58.662 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:05:58.662 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:58.662 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:58.662 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:58.663 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.663 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:58.663 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:58.663 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.663 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.663 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.663 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:58.663 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:58.663 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.663 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.663 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.663 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:58.663 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:05:58.663 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:05:58.663 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.664 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.664 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:58.664 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:05:58.664 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:05:58.664 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.664 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.664 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:58.664 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:05:58.664 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:05:58.664 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.664 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.664 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.664 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:05:58.664 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:05:58.664 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.664 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.665 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:58.665 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:05:58.665 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:05:58.665 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.665 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.665 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:58.665 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:05:58.665 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:05:58.665 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.665 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.665 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:58.665 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:05:58.665 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:05:58.665 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.665 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:58.666 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.666 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.666 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.666 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:05:58.666 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:58.666 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 54.800155076000003, 2024-04-26T12:05:58.666 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:05:58.666 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:58.666 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:58.666 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:58.666 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.666 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:58.666 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:58.666 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.666 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.667 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:58.667 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:58.667 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.667 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.667 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:58.667 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:05:58.667 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:58.667 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.667 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:58.667 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:05:58.667 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:05:58.667 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.668 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.668 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:58.668 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:05:58.668 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:05:58.668 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.668 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.668 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.668 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:05:58.668 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:05:58.668 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.668 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.668 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:58.668 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:05:58.668 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:05:58.669 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.669 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.669 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:58.669 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:05:58.669 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:05:58.669 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.669 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:58.669 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.669 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.669 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.669 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:05:58.669 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:58.669 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 54.799433270000002, 2024-04-26T12:05:58.669 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:05:58.670 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:58.670 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:58.670 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:58.670 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.670 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:58.670 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:58.670 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.670 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.670 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.670 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:58.670 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:05:58.670 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.670 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.670 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.670 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:58.671 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:05:58.671 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:58.671 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.671 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.671 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:58.671 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:05:58.671 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:05:58.671 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.671 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.671 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:58.671 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:05:58.671 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:05:58.671 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.671 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.672 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.672 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:05:58.672 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:05:58.672 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.672 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.672 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:58.672 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:05:58.672 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:05:58.672 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.672 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.672 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:58.672 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:05:58.672 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:05:58.672 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.673 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:58.673 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.673 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.673 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.673 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:05:58.673 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:58.673 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 49.082506666999997, 2024-04-26T12:05:58.673 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:05:58.673 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:58.673 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:58.673 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:58.673 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.673 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:58.673 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:58.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.674 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.674 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:58.674 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:05:58.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:58.674 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.674 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:58.674 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:05:58.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:05:58.674 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.674 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:58.674 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:05:58.675 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:05:58.675 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.675 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.675 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:58.675 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:05:58.675 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:05:58.675 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.675 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.675 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:58.675 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:05:58.675 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:05:58.675 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.675 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.675 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:58.675 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:05:58.676 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:05:58.676 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.676 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.676 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:58.676 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:05:58.676 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:05:58.676 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.676 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.676 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:58.676 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:05:58.676 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:05:58.676 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.676 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.676 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:58.676 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:05:58.677 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:05:58.677 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.677 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.677 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:58.677 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:05:58.677 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:05:58.677 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.677 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.677 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:58.677 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:05:58.677 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:05:58.677 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:58.677 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:58.677 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:58.677 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:05:58.677 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:05:58.678 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.678 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:58.678 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.678 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:58.678 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:58.678 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:58.680 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:05:58.680 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:58.678+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:58.780 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:58.779+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:58.788 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:58.788 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:05:58.788 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-04-26T12:05:58.788 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:58.797 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:05:58.881 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:58.881+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:58.917 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-26T12:05:58.938 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:58.938 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:05:58.938 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T12:05:58.938 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T12:05:58.938 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:58.947 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:05:58.991 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:58.990+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:59.050 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:05:59.050 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T12:05:59.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T12:05:59.050 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T12:05:59.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.051 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.051 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:59.051 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.267901268000003, 2024-04-26T12:05:59.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017255857999999999, 2024-04-26T12:05:59.051 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:59.051 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.051 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:59.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:59.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:59.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:59.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:59.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:59.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780340+0000", 2024-04-26T12:05:59.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:59.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:59.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780351+0000", 2024-04-26T12:05:59.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0898e-05 2024-04-26T12:05:59.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:59.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:59.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1671999999999999e-05 2024-04-26T12:05:59.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780374+0000", 2024-04-26T12:05:59.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1117999999999999e-05 2024-04-26T12:05:59.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780423+0000", 2024-04-26T12:05:59.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9066000000000001e-05 2024-04-26T12:05:59.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:59.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780428+0000", 2024-04-26T12:05:59.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1320000000000002e-06 2024-04-26T12:05:59.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788902+0000", 2024-04-26T12:05:59.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084738560000000001 2024-04-26T12:05:59.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:59.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789167+0000", 2024-04-26T12:05:59.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026521100000000001 2024-04-26T12:05:59.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:59.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789279+0000", 2024-04-26T12:05:59.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111616 2024-04-26T12:05:59.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792335+0000", 2024-04-26T12:05:59.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030556419999999999 2024-04-26T12:05:59.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:59.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797519+0000", 2024-04-26T12:05:59.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051841550000000002 2024-04-26T12:05:59.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:59.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797559+0000", 2024-04-26T12:05:59.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0451999999999998e-05 2024-04-26T12:05:59.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:59.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797598+0000", 2024-04-26T12:05:59.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8500000000000001e-05 2024-04-26T12:05:59.056 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.056 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:59.056 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.056 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.056 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:59.057 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.267852961000003, 2024-04-26T12:05:59.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017668725, 2024-04-26T12:05:59.057 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:59.057 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.057 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:59.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:59.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:59.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:59.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:59.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:59.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:59.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:59.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780395+0000", 2024-04-26T12:05:59.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.198e-06 2024-04-26T12:05:59.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:59.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780402+0000", 2024-04-26T12:05:59.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:05:59.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780408+0000", 2024-04-26T12:05:59.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:59.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780481+0000", 2024-04-26T12:05:59.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3239999999999997e-05 2024-04-26T12:05:59.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:59.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780485+0000", 2024-04-26T12:05:59.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4039999999999999e-06 2024-04-26T12:05:59.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789518+0000", 2024-04-26T12:05:59.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090335480000000006 2024-04-26T12:05:59.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:59.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789585+0000", 2024-04-26T12:05:59.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6469000000000003e-05 2024-04-26T12:05:59.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:59.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789699+0000", 2024-04-26T12:05:59.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114613 2024-04-26T12:05:59.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793308+0000", 2024-04-26T12:05:59.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036088520000000001 2024-04-26T12:05:59.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:59.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797887+0000", 2024-04-26T12:05:59.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0045792790000000003 2024-04-26T12:05:59.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:59.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797955+0000", 2024-04-26T12:05:59.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T12:05:59.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:59.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798059+0000", 2024-04-26T12:05:59.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103874 2024-04-26T12:05:59.062 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.062 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:59.062 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.062 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.062 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:59.062 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.267822688999999, 2024-04-26T12:05:59.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017735145000000001, 2024-04-26T12:05:59.063 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:59.063 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.063 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:59.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:59.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:59.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:59.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:59.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:59.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:05:59.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:59.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780424+0000", 2024-04-26T12:05:59.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4519999999999999e-06 2024-04-26T12:05:59.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:59.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780431+0000", 2024-04-26T12:05:59.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0690000000000004e-06 2024-04-26T12:05:59.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780438+0000", 2024-04-26T12:05:59.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5719999999999999e-06 2024-04-26T12:05:59.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780468+0000", 2024-04-26T12:05:59.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.993e-05 2024-04-26T12:05:59.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:59.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780472+0000", 2024-04-26T12:05:59.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-04-26T12:05:59.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789916+0000", 2024-04-26T12:05:59.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094434940000000002 2024-04-26T12:05:59.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:59.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790004+0000", 2024-04-26T12:05:59.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8085999999999997e-05 2024-04-26T12:05:59.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:59.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790125+0000", 2024-04-26T12:05:59.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012186200000000001 2024-04-26T12:05:59.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793402+0000", 2024-04-26T12:05:59.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00327685 2024-04-26T12:05:59.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:59.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798068+0000", 2024-04-26T12:05:59.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046652150000000003 2024-04-26T12:05:59.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:59.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798108+0000", 2024-04-26T12:05:59.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0911000000000002e-05 2024-04-26T12:05:59.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:59.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798156+0000", 2024-04-26T12:05:59.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7128e-05 2024-04-26T12:05:59.069 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.069 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:59.069 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.069 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.069 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:59.069 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.267799670000002, 2024-04-26T12:05:59.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017792624, 2024-04-26T12:05:59.070 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:59.070 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.070 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:59.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:59.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:59.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:59.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:59.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:59.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:05:59.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:59.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780447+0000", 2024-04-26T12:05:59.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8519999999999997e-06 2024-04-26T12:05:59.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:59.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780453+0000", 2024-04-26T12:05:59.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2999999999999998e-06 2024-04-26T12:05:59.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:59.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0760000000000002e-06 2024-04-26T12:05:59.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780502+0000", 2024-04-26T12:05:59.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4079999999999998e-05 2024-04-26T12:05:59.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:59.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:59.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5450000000000002e-06 2024-04-26T12:05:59.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790390+0000", 2024-04-26T12:05:59.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098850759999999996 2024-04-26T12:05:59.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:59.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790447+0000", 2024-04-26T12:05:59.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6752999999999997e-05 2024-04-26T12:05:59.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:59.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790547+0000", 2024-04-26T12:05:59.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100344 2024-04-26T12:05:59.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793864+0000", 2024-04-26T12:05:59.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033169749999999998 2024-04-26T12:05:59.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:59.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798164+0000", 2024-04-26T12:05:59.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043000690000000001 2024-04-26T12:05:59.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:59.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798204+0000", 2024-04-26T12:05:59.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9478999999999999e-05 2024-04-26T12:05:59.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:59.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798236+0000", 2024-04-26T12:05:59.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2478999999999999e-05 2024-04-26T12:05:59.075 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.075 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:59.075 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.075 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.075 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:59.075 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.267759327, 2024-04-26T12:05:59.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016989500000000001, 2024-04-26T12:05:59.075 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:59.075 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.076 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:59.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:59.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:59.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:59.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:05:59.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:59.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780483+0000", 2024-04-26T12:05:59.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:59.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780488+0000", 2024-04-26T12:05:59.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6260000000000003e-06 2024-04-26T12:05:59.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:59.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780499+0000", 2024-04-26T12:05:59.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1236000000000001e-05 2024-04-26T12:05:59.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:59.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4569999999999996e-06 2024-04-26T12:05:59.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780529+0000", 2024-04-26T12:05:59.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4579e-05 2024-04-26T12:05:59.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:59.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780532+0000", 2024-04-26T12:05:59.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.74e-06 2024-04-26T12:05:59.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788868+0000", 2024-04-26T12:05:59.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0083357650000000002 2024-04-26T12:05:59.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:59.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789142+0000", 2024-04-26T12:05:59.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027472 2024-04-26T12:05:59.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:59.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789241+0000", 2024-04-26T12:05:59.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8394999999999996e-05 2024-04-26T12:05:59.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792096+0000", 2024-04-26T12:05:59.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002855677 2024-04-26T12:05:59.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:59.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797379+0000", 2024-04-26T12:05:59.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052822379999999999 2024-04-26T12:05:59.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:59.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797433+0000", 2024-04-26T12:05:59.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4109e-05 2024-04-26T12:05:59.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:59.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797473+0000", 2024-04-26T12:05:59.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0533e-05 2024-04-26T12:05:59.081 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.081 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:59.081 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.081 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.081 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:59.081 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.267719712999998, 2024-04-26T12:05:59.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017295965, 2024-04-26T12:05:59.081 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:59.081 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.081 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:59.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:59.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:59.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:59.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:05:59.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:59.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780513+0000", 2024-04-26T12:05:59.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999895 2024-04-26T12:05:59.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:59.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780528+0000", 2024-04-26T12:05:59.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5089000000000001e-05 2024-04-26T12:05:59.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:59.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780537+0000", 2024-04-26T12:05:59.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8400000000000001e-06 2024-04-26T12:05:59.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780544+0000", 2024-04-26T12:05:59.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.917e-06 2024-04-26T12:05:59.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780571+0000", 2024-04-26T12:05:59.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7032000000000001e-05 2024-04-26T12:05:59.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:59.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780574+0000", 2024-04-26T12:05:59.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:05:59.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789436+0000", 2024-04-26T12:05:59.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088622240000000001 2024-04-26T12:05:59.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:59.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789525+0000", 2024-04-26T12:05:59.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8549999999999998e-05 2024-04-26T12:05:59.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:59.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789642+0000", 2024-04-26T12:05:59.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011772100000000001 2024-04-26T12:05:59.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792129+0000", 2024-04-26T12:05:59.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024871709999999998 2024-04-26T12:05:59.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:59.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797732+0000", 2024-04-26T12:05:59.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056027580000000002 2024-04-26T12:05:59.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:59.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797777+0000", 2024-04-26T12:05:59.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4620999999999999e-05 2024-04-26T12:05:59.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:59.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797819+0000", 2024-04-26T12:05:59.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2536000000000001e-05 2024-04-26T12:05:59.086 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.086 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:59.087 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.087 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.087 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:59.087 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.267690762999997, 2024-04-26T12:05:59.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017840163999999999, 2024-04-26T12:05:59.087 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:59.087 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.087 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:59.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:59.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:59.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:59.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:59.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:59.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:05:59.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:59.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:59.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5419999999999999e-06 2024-04-26T12:05:59.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:59.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780563+0000", 2024-04-26T12:05:59.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:05:59.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780569+0000", 2024-04-26T12:05:59.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1479999999999997e-06 2024-04-26T12:05:59.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780594+0000", 2024-04-26T12:05:59.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5585e-05 2024-04-26T12:05:59.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:05:59.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780596+0000", 2024-04-26T12:05:59.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2630000000000002e-06 2024-04-26T12:05:59.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789932+0000", 2024-04-26T12:05:59.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093360479999999996 2024-04-26T12:05:59.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:59.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790070+0000", 2024-04-26T12:05:59.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013771399999999999 2024-04-26T12:05:59.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:59.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790219+0000", 2024-04-26T12:05:59.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014872299999999999 2024-04-26T12:05:59.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793632+0000", 2024-04-26T12:05:59.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003413368 2024-04-26T12:05:59.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:05:59.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798244+0000", 2024-04-26T12:05:59.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046113819999999998 2024-04-26T12:05:59.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:59.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798361+0000", 2024-04-26T12:05:59.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117726 2024-04-26T12:05:59.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:59.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798393+0000", 2024-04-26T12:05:59.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1099999999999997e-05 2024-04-26T12:05:59.092 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.092 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:59.093 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.093 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.093 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:59.093 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.267665837999999, 2024-04-26T12:05:59.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016645943, 2024-04-26T12:05:59.093 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:59.093 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:59.093 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:59.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:59.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:59.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:59.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:59.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:59.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:05:59.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:59.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780580+0000", 2024-04-26T12:05:59.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1549999999999999e-06 2024-04-26T12:05:59.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:59.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780588+0000", 2024-04-26T12:05:59.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:05:59.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780593+0000", 2024-04-26T12:05:59.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2399999999999998e-06 2024-04-26T12:05:59.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780628+0000", 2024-04-26T12:05:59.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5426000000000003e-05 2024-04-26T12:05:59.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:59.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780632+0000", 2024-04-26T12:05:59.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:05:59.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788288+0000", 2024-04-26T12:05:59.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076555879999999996 2024-04-26T12:05:59.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:59.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788570+0000", 2024-04-26T12:05:59.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028233700000000002 2024-04-26T12:05:59.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:59.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797223+0000", 2024-04-26T12:05:59.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086529150000000006 2024-04-26T12:05:59.097 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.097 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:59.097 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.097 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.097 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:59.097 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.267641869000002, 2024-04-26T12:05:59.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016536068000000001, 2024-04-26T12:05:59.097 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:59.097 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:05:59.098 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:59.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:59.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:59.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:59.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:59.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:59.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:05:59.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:59.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780609+0000", 2024-04-26T12:05:59.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8280000000000003e-06 2024-04-26T12:05:59.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:59.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780616+0000", 2024-04-26T12:05:59.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4939999999999997e-06 2024-04-26T12:05:59.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780621+0000", 2024-04-26T12:05:59.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6040000000000003e-06 2024-04-26T12:05:59.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780647+0000", 2024-04-26T12:05:59.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6441999999999999e-05 2024-04-26T12:05:59.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:05:59.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780650+0000", 2024-04-26T12:05:59.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4430000000000002e-06 2024-04-26T12:05:59.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788163+0000", 2024-04-26T12:05:59.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007513774 2024-04-26T12:05:59.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:59.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788307+0000", 2024-04-26T12:05:59.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014374400000000001 2024-04-26T12:05:59.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:59.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797137+0000", 2024-04-26T12:05:59.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088302160000000001 2024-04-26T12:05:59.101 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.101 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:59.101 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.102 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:59.102 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:59.102 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.264765597, 2024-04-26T12:05:59.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012911448000000001, 2024-04-26T12:05:59.102 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:59.102 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.102 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:59.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:59.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:59.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:05:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783477+0000", 2024-04-26T12:05:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783482+0000", 2024-04-26T12:05:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5709999999999999e-06 2024-04-26T12:05:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783491+0000", 2024-04-26T12:05:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3610000000000007e-06 2024-04-26T12:05:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783498+0000", 2024-04-26T12:05:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4209999999999998e-06 2024-04-26T12:05:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786045+0000", 2024-04-26T12:05:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0025465739999999998 2024-04-26T12:05:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786061+0000", 2024-04-26T12:05:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6348999999999999e-05 2024-04-26T12:05:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796342+0000", 2024-04-26T12:05:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010280643000000001 2024-04-26T12:05:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796389+0000", 2024-04-26T12:05:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6912000000000001e-05 2024-04-26T12:05:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.264737291000003, 2024-04-26T12:05:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013376469, 2024-04-26T12:05:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:05:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783516+0000", 2024-04-26T12:05:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.041e-05 2024-04-26T12:05:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783523+0000", 2024-04-26T12:05:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5749999999999997e-06 2024-04-26T12:05:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783528+0000", 2024-04-26T12:05:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5029999999999997e-06 2024-04-26T12:05:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787662+0000", 2024-04-26T12:05:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041336230000000003 2024-04-26T12:05:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787687+0000", 2024-04-26T12:05:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5769999999999999e-05 2024-04-26T12:05:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796817+0000", 2024-04-26T12:05:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091296750000000003 2024-04-26T12:05:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796882+0000", 2024-04-26T12:05:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5180999999999998e-05 2024-04-26T12:05:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.264668749999998, 2024-04-26T12:05:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013457291999999999, 2024-04-26T12:05:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:05:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783578+0000", 2024-04-26T12:05:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.659e-06 2024-04-26T12:05:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783584+0000", 2024-04-26T12:05:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:05:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783588+0000", 2024-04-26T12:05:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6190000000000002e-06 2024-04-26T12:05:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787834+0000", 2024-04-26T12:05:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042460529999999996 2024-04-26T12:05:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787854+0000", 2024-04-26T12:05:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9658999999999999e-05 2024-04-26T12:05:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009107604 2024-04-26T12:05:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797032+0000", 2024-04-26T12:05:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9987000000000006e-05 2024-04-26T12:05:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.262822370999999, 2024-04-26T12:05:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011003015999999999, 2024-04-26T12:05:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:05:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785420+0000", 2024-04-26T12:05:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785427+0000", 2024-04-26T12:05:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:05:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785438+0000", 2024-04-26T12:05:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069e-05 2024-04-26T12:05:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785457+0000", 2024-04-26T12:05:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8617000000000001e-05 2024-04-26T12:05:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786628+0000", 2024-04-26T12:05:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001171418 2024-04-26T12:05:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786651+0000", 2024-04-26T12:05:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3289e-05 2024-04-26T12:05:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796393+0000", 2024-04-26T12:05:59.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097413269999999993 2024-04-26T12:05:59.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:59.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796424+0000", 2024-04-26T12:05:59.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1188e-05 2024-04-26T12:05:59.118 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.118 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:59.118 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.262275625000001, 2024-04-26T12:05:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010561432000000001, 2024-04-26T12:05:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:05:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785973+0000", 2024-04-26T12:05:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4910000000000002e-06 2024-04-26T12:05:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785991+0000", 2024-04-26T12:05:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7663e-05 2024-04-26T12:05:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785998+0000", 2024-04-26T12:05:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1239999999999999e-06 2024-04-26T12:05:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786792+0000", 2024-04-26T12:05:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079334800000000003 2024-04-26T12:05:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786810+0000", 2024-04-26T12:05:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8746999999999999e-05 2024-04-26T12:05:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796500+0000", 2024-04-26T12:05:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096897619999999993 2024-04-26T12:05:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796529+0000", 2024-04-26T12:05:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8873999999999998e-05 2024-04-26T12:05:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.262196539000001, 2024-04-26T12:05:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010219911, 2024-04-26T12:05:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:05:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786046+0000", 2024-04-26T12:05:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786053+0000", 2024-04-26T12:05:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0360000000000001e-06 2024-04-26T12:05:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786064+0000", 2024-04-26T12:05:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1202999999999999e-05 2024-04-26T12:05:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786091+0000", 2024-04-26T12:05:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6859000000000002e-05 2024-04-26T12:05:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786212+0000", 2024-04-26T12:05:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120975 2024-04-26T12:05:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786236+0000", 2024-04-26T12:05:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4358999999999998e-05 2024-04-26T12:05:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796236+0000", 2024-04-26T12:05:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099998050000000005 2024-04-26T12:05:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796266+0000", 2024-04-26T12:05:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0278e-05 2024-04-26T12:05:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:3 3.14 e17/15 3:287034c4:::1.00000000.inode:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.261407577999996, 2024-04-26T12:05:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009764712, 2024-04-26T12:05:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:05:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786835+0000", 2024-04-26T12:05:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T12:05:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786844+0000", 2024-04-26T12:05:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6500000000000008e-06 2024-04-26T12:05:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786855+0000", 2024-04-26T12:05:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0932e-05 2024-04-26T12:05:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786864+0000", 2024-04-26T12:05:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2150000000000007e-06 2024-04-26T12:05:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787242+0000", 2024-04-26T12:05:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037708300000000001 2024-04-26T12:05:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787259+0000", 2024-04-26T12:05:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7258999999999999e-05 2024-04-26T12:05:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796579+0000", 2024-04-26T12:05:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093201099999999995 2024-04-26T12:05:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:59.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796600+0000", 2024-04-26T12:05:59.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1330000000000001e-05 2024-04-26T12:05:59.131 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.131 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:59.131 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.131 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:59.131 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:59.131 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.261363555999999, 2024-04-26T12:05:59.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096431940000000008, 2024-04-26T12:05:59.131 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:59.131 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.132 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:59.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:59.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:59.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:59.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:05:59.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:59.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786879+0000", 2024-04-26T12:05:59.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:59.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786887+0000", 2024-04-26T12:05:59.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9300000000000003e-06 2024-04-26T12:05:59.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:59.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786894+0000", 2024-04-26T12:05:59.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:05:59.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786899+0000", 2024-04-26T12:05:59.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8400000000000002e-06 2024-04-26T12:05:59.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786932+0000", 2024-04-26T12:05:59.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3031999999999998e-05 2024-04-26T12:05:59.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:59.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786945+0000", 2024-04-26T12:05:59.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3421000000000001e-05 2024-04-26T12:05:59.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:59.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796469+0000", 2024-04-26T12:05:59.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095236130000000002 2024-04-26T12:05:59.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:59.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796523+0000", 2024-04-26T12:05:59.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4089999999999999e-05 2024-04-26T12:05:59.135 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.135 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:59.136 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.136 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "pg_update_log_missing(3.14 epoch 17/15 rep_tid 169 entries 17'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:05:59.136 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:59.136 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.261300401, 2024-04-26T12:05:59.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097257639999999996, 2024-04-26T12:05:59.136 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:59.136 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-04-26T12:05:59.136 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:59.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:59.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:59.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:59.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:05:59.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:59.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786942+0000", 2024-04-26T12:05:59.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:59.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786951+0000", 2024-04-26T12:05:59.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:05:59.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:59.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786965+0000", 2024-04-26T12:05:59.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4268e-05 2024-04-26T12:05:59.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786977+0000", 2024-04-26T12:05:59.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1667e-05 2024-04-26T12:05:59.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787667+0000", 2024-04-26T12:05:59.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00069057400000000001 2024-04-26T12:05:59.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:59.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796668+0000", 2024-04-26T12:05:59.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090013309999999996 2024-04-26T12:05:59.139 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.139 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:59.139 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.139 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:05:59.139 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:59.139 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.261247257999997, 2024-04-26T12:05:59.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095908309999999993, 2024-04-26T12:05:59.139 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:59.139 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.139 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:59.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:59.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:59.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:59.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:05:59.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:59.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786995+0000", 2024-04-26T12:05:59.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:59.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787001+0000", 2024-04-26T12:05:59.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5099999999999998e-06 2024-04-26T12:05:59.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:59.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787009+0000", 2024-04-26T12:05:59.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9100000000000005e-06 2024-04-26T12:05:59.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787019+0000", 2024-04-26T12:05:59.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8109999999999997e-06 2024-04-26T12:05:59.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787136+0000", 2024-04-26T12:05:59.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011749899999999999 2024-04-26T12:05:59.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:59.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787154+0000", 2024-04-26T12:05:59.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8278999999999999e-05 2024-04-26T12:05:59.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:59.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796561+0000", 2024-04-26T12:05:59.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094064379999999996 2024-04-26T12:05:59.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:59.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796587+0000", 2024-04-26T12:05:59.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5856000000000001e-05 2024-04-26T12:05:59.143 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.143 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:59.143 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.143 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-26T12:05:59.143 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:59.143 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.260530201000002, 2024-04-26T12:05:59.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096460160000000003, 2024-04-26T12:05:59.143 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:05:59.143 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.143 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:05:59.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:05:59.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:59.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:05:59.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:05:59.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:05:59.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:05:59.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787712+0000", 2024-04-26T12:05:59.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:05:59.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787718+0000", 2024-04-26T12:05:59.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:05:59.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:05:59.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787727+0000", 2024-04-26T12:05:59.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.123e-06 2024-04-26T12:05:59.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787734+0000", 2024-04-26T12:05:59.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.391e-06 2024-04-26T12:05:59.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:05:59.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788867+0000", 2024-04-26T12:05:59.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001133207 2024-04-26T12:05:59.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:05:59.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788899+0000", 2024-04-26T12:05:59.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1526000000000003e-05 2024-04-26T12:05:59.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:05:59.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797328+0000", 2024-04-26T12:05:59.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084295389999999998 2024-04-26T12:05:59.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:05:59.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:05:59.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:05:59.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797359+0000", 2024-04-26T12:05:59.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0660999999999997e-05 2024-04-26T12:05:59.147 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.147 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:59.147 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.147 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:05:59.147 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:05:59.147 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:05:59.149 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:05:59.149 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:59.148+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:59.250 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:59.249+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:59.258 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:59.258 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:05:59.258 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:05:59.258 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:59.268 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:05:59.350 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:59.350+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:59.369 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:59.369 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:05:59.369 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:05:59.369 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:05:59.369 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:59.378 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:05:59.451 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:05:59.451+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:05:59.482 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:05:59.482 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:05:59.482 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:05:59.482 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:05:59.482 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.482 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:59.482 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:59.482 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 65.624556569000006, 2024-04-26T12:05:59.482 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:05:59.482 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:59.482 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.483 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:59.483 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:59.483 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:59.483 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:05:59.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.483 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:59.483 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.483 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:59.483 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:59.483 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.483 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.483 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:59.483 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:59.483 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.484 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.484 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:59.484 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:05:59.484 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.484 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.484 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.484 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:59.484 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:05:59.484 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:05:59.484 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.484 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.484 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:59.484 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:05:59.484 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:05:59.484 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.485 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.485 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.485 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:05:59.485 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:05:59.485 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.485 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.485 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:59.485 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:05:59.485 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:05:59.485 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.485 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.485 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:59.485 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:05:59.485 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:05:59.485 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.486 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.486 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:59.486 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:05:59.486 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:05:59.486 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.486 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.486 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:59.486 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:05:59.486 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:05:59.486 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.486 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.486 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.486 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:05:59.486 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:05:59.487 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.487 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.487 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:59.487 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:05:59.487 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:05:59.487 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.487 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.487 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:59.487 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:05:59.487 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:05:59.487 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.487 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:59.487 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.487 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.487 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.488 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:59.488 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:59.488 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 65.624450672999998, 2024-04-26T12:05:59.488 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:05:59.488 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:59.488 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.488 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:59.488 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:59.488 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:59.488 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:05:59.488 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.488 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:59.488 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.489 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:59.489 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:59.489 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.489 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.489 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:59.489 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:59.489 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.489 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.489 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:59.489 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:05:59.489 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.490 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.490 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:59.490 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:05:59.490 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:05:59.490 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.490 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.490 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:59.490 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:05:59.490 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:05:59.490 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.490 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.490 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.490 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:05:59.490 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:05:59.490 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.491 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.491 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:59.491 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:05:59.491 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:05:59.491 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.491 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.491 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:59.491 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:05:59.491 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:05:59.491 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.491 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.491 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:59.491 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:05:59.491 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:05:59.491 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.492 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.492 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:59.492 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:05:59.492 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:05:59.492 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.492 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.492 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.492 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:05:59.492 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:05:59.492 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.492 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.492 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:59.492 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:05:59.492 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:05:59.492 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.493 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.493 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:59.493 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:05:59.493 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:05:59.493 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.493 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:59.493 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.493 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.493 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.493 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:59.493 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:59.493 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 65.624435692999995, 2024-04-26T12:05:59.493 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:05:59.493 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:59.493 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.494 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:59.494 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:59.494 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:59.494 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:05:59.494 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.494 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:59.494 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.494 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:59.494 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:59.494 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.494 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.494 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.494 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:59.494 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:59.494 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.495 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.495 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.495 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:59.495 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:05:59.495 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.495 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.495 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.495 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:59.495 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:05:59.495 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:05:59.495 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.495 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.495 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:59.495 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:05:59.496 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:05:59.496 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.496 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.496 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.496 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:05:59.496 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:05:59.496 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.496 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.496 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:59.496 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:05:59.496 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:05:59.496 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.496 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.496 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:59.496 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:05:59.497 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:05:59.497 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.497 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.497 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:59.497 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:05:59.497 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:05:59.497 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.497 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.497 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:59.497 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:05:59.497 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:05:59.497 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.497 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.498 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.498 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:05:59.498 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:05:59.498 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.498 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.498 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:59.498 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:05:59.498 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:05:59.498 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.498 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.498 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:59.498 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:05:59.498 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:05:59.498 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.498 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:59.499 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.499 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.499 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.499 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:59.499 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:59.499 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 65.624391818000007, 2024-04-26T12:05:59.499 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:05:59.499 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:59.499 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.499 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:59.499 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:59.499 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:59.499 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:05:59.499 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.499 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:59.500 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.500 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:59.500 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:59.500 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.500 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.500 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.500 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:59.500 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:59.500 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.500 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.500 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.500 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:59.500 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:05:59.500 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.500 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.501 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.501 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:59.501 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:05:59.501 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:05:59.501 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.501 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.501 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:59.501 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:05:59.501 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:05:59.501 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.501 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.501 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.501 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:05:59.501 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:05:59.501 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.502 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.502 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:59.502 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:05:59.502 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:05:59.502 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.502 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.502 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:59.502 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:05:59.502 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:05:59.502 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.502 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.502 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:59.502 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:05:59.502 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:05:59.503 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.503 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.503 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:59.503 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:05:59.503 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:05:59.503 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.503 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.503 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.503 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:05:59.503 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:05:59.503 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.503 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.503 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:59.503 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:05:59.503 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:05:59.504 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.504 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.504 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:59.504 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:05:59.504 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:05:59.504 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.504 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:59.504 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.504 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.504 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.504 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:05:59.504 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:59.504 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 65.624306153999996, 2024-04-26T12:05:59.504 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:05:59.504 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:59.505 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.505 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:05:59.505 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:05:59.505 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:05:59.505 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:05:59.505 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.505 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:59.505 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.505 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:59.505 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:59.505 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.505 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.505 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.505 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:59.505 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:59.505 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.505 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.506 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.506 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:59.506 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:05:59.506 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.506 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.506 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.506 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:59.506 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:05:59.506 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:05:59.506 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.506 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.506 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:59.506 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:05:59.506 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:05:59.507 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.507 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.507 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.507 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:05:59.507 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:05:59.507 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.507 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.507 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:59.507 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:05:59.507 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:05:59.507 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.507 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.507 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:59.507 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:05:59.507 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:05:59.507 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.508 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.508 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:59.508 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:05:59.508 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:05:59.508 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.508 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.508 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:59.508 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:05:59.508 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:05:59.508 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.508 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.508 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.508 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:05:59.508 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:05:59.508 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.509 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:59.509 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:05:59.509 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:05:59.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.509 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:59.509 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:05:59.509 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:05:59.509 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.509 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:59.509 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.509 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.509 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:59.510 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 55.698401867999998, 2024-04-26T12:05:59.510 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:05:59.510 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:59.510 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.510 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:59.510 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.510 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:59.510 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:59.510 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.510 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.510 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.510 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:59.510 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:05:59.510 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.510 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.511 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.511 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:59.511 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:59.511 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:59.511 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.511 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.511 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:59.511 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:05:59.511 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:05:59.511 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.511 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.511 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:59.511 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:05:59.511 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:05:59.511 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.511 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.512 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.512 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:05:59.512 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:05:59.512 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.512 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.512 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:59.512 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:05:59.512 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:05:59.512 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.512 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.512 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:59.512 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:05:59.512 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:05:59.512 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.512 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.512 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:59.513 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:05:59.513 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:05:59.513 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.513 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.513 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:59.513 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:05:59.513 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:05:59.513 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.513 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.513 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.513 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:05:59.513 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:05:59.513 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.513 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.513 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:59.514 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:05:59.514 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:05:59.514 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.514 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.514 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:59.514 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:05:59.514 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:05:59.514 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.514 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:59.514 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.514 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.514 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.514 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.514 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:59.514 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 55.698365772999999, 2024-04-26T12:05:59.515 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:05:59.515 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:59.515 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.515 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:59.515 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.515 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:59.515 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:59.515 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.515 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.515 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.515 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:59.515 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:05:59.515 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.515 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.515 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.516 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:59.516 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:05:59.516 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:59.516 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.516 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.516 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:59.516 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:05:59.516 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:05:59.516 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.516 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.516 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:59.516 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:05:59.516 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:05:59.516 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.516 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.517 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.517 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:05:59.517 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:05:59.517 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.517 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.517 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:59.517 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:05:59.517 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:05:59.517 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.517 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.517 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:59.517 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:05:59.517 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:05:59.517 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.518 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.518 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:59.518 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:05:59.518 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:05:59.518 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.518 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.518 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:59.518 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:05:59.518 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:05:59.518 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.518 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.518 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.518 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:05:59.518 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:05:59.519 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.519 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.519 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:59.519 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:05:59.519 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:05:59.519 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.519 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.519 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:59.519 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:05:59.519 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:05:59.519 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.519 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:59.519 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.519 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.520 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.520 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.520 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:59.520 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 55.698328089, 2024-04-26T12:05:59.520 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:05:59.520 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:59.520 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.520 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:59.520 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.520 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:59.520 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:59.520 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.520 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.520 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.521 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:59.521 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:05:59.521 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.521 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.521 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.521 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:59.521 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:05:59.521 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.521 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.521 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.521 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:59.521 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:05:59.521 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:05:59.521 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.521 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.521 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:59.521 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:05:59.522 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:05:59.522 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.522 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.522 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.522 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:05:59.522 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:05:59.522 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.522 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.522 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:59.522 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:05:59.522 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:05:59.522 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.522 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.522 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:59.523 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:59.523 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:05:59.523 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.523 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.523 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:59.523 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:05:59.523 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:05:59.523 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.523 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.523 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:59.523 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:05:59.523 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:05:59.523 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.523 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.523 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.524 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:05:59.524 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:05:59.524 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.524 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.524 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:59.524 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:05:59.524 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:05:59.524 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.524 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.524 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:59.524 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:05:59.524 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:05:59.524 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.524 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:59.525 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.525 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.525 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.525 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.525 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:59.525 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 55.698306748999997, 2024-04-26T12:05:59.525 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:05:59.525 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:59.525 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.525 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:59.525 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.525 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:59.525 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:59.525 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.525 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.526 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.526 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:59.526 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:59.526 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.526 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.526 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.526 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:59.526 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:05:59.526 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.526 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.526 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.526 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:59.526 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:05:59.526 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:59.526 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.527 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.527 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:59.527 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:05:59.527 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:05:59.527 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.527 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.527 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.527 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:05:59.527 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:05:59.527 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.527 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.527 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:59.527 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:05:59.527 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:05:59.527 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.527 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.528 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:59.528 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:05:59.528 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:05:59.528 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.528 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.528 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:59.528 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:05:59.528 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:05:59.528 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.528 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.528 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:59.528 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:05:59.528 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:05:59.528 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.528 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.528 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.529 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:05:59.529 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:05:59.529 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.529 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.529 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:59.529 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:05:59.529 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:05:59.529 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.529 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.529 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:59.529 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:05:59.529 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:05:59.530 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.530 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:59.530 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.530 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.530 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.530 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.530 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:59.530 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 55.698284483000002, 2024-04-26T12:05:59.530 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:05:59.530 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:59.530 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.530 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:59.530 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.530 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:59.531 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:59.531 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.531 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.531 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.531 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:59.531 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:59.531 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.531 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.531 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.531 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:59.531 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:05:59.531 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.531 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.531 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.532 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:59.532 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:05:59.532 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:05:59.532 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.532 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.532 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:59.532 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:05:59.532 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:05:59.532 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.532 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.532 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.532 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:05:59.532 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:05:59.532 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.532 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.532 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:59.533 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:05:59.533 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:05:59.533 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.533 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.533 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:59.533 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:05:59.533 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:05:59.533 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.533 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.533 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:59.533 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:05:59.533 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:05:59.533 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.533 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.534 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:59.534 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:05:59.534 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:05:59.534 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.534 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.534 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.534 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:05:59.534 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:05:59.534 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.534 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.534 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:59.534 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:05:59.534 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:05:59.534 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.535 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.535 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:59.535 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:05:59.535 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:05:59.535 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.535 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:59.535 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.535 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.535 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.535 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.535 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:59.535 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 55.698262861000003, 2024-04-26T12:05:59.535 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:05:59.535 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:59.535 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.535 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:59.536 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.536 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:59.536 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:59.536 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.536 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.536 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.536 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:59.536 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:59.536 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.536 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.536 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.536 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:59.536 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:05:59.536 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.536 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.536 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.537 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:59.537 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:05:59.537 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:05:59.537 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.537 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.537 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:59.537 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:05:59.537 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:05:59.537 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.537 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.537 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.537 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:05:59.537 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:05:59.537 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.537 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.538 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:59.538 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:05:59.538 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:05:59.538 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.538 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.538 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:59.538 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:05:59.538 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:05:59.538 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.538 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.538 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:59.538 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:05:59.538 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:05:59.538 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.538 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.539 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:59.539 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:05:59.539 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:05:59.539 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.539 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.539 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.539 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:05:59.539 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:05:59.539 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.539 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.539 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:59.539 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:05:59.539 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:05:59.539 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.539 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.539 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:59.540 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:05:59.540 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:05:59.540 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.540 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:59.540 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.540 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.540 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.540 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.540 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:59.540 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 55.698236295000001, 2024-04-26T12:05:59.540 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:05:59.540 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:59.540 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.540 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:59.540 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.541 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:59.541 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:59.541 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.541 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.541 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.541 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:59.541 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:05:59.541 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.541 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.541 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.541 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:59.541 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:05:59.541 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.541 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.541 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.542 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:59.542 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:05:59.542 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:05:59.542 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.542 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.542 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:59.542 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:05:59.542 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:05:59.542 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.542 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.542 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.542 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:05:59.543 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:05:59.543 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.543 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.543 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:59.543 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:05:59.543 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:05:59.543 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.543 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.543 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:59.543 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:05:59.543 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:05:59.543 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.543 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.543 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:59.543 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:05:59.543 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:05:59.544 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.544 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.544 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:59.544 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:05:59.544 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:05:59.544 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.544 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.544 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.544 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:05:59.544 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:05:59.544 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.544 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.544 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:59.544 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:05:59.544 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:05:59.544 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.544 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.545 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:59.545 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:05:59.545 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:05:59.545 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.545 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:59.545 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.545 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.545 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.545 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.545 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:59.545 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 55.698197782999998, 2024-04-26T12:05:59.545 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:05:59.545 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:59.545 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.545 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:59.546 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.546 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:59.546 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:59.546 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.546 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.546 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.546 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:59.546 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:59.546 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.546 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.546 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.546 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:59.546 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:05:59.546 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.546 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.547 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.547 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:59.547 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:05:59.547 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:05:59.547 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.547 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.547 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:59.547 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:05:59.547 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:05:59.547 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.547 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.547 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.547 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:05:59.547 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:05:59.548 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.548 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.548 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:59.548 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:05:59.548 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:05:59.548 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.548 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.548 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:59.548 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:05:59.548 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:05:59.548 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.548 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.548 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:59.548 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:05:59.548 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:05:59.548 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.549 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.549 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:59.549 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:05:59.549 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:05:59.549 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.549 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.549 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.549 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:05:59.549 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:05:59.549 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.550 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.550 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:59.550 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:05:59.550 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:05:59.550 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.550 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.550 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:59.550 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:05:59.550 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:05:59.550 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.550 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:59.550 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.550 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.550 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.551 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.551 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:59.551 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 55.698169610000001, 2024-04-26T12:05:59.551 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:05:59.551 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:59.551 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.551 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:59.551 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.551 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:59.551 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:59.551 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.551 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.551 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.551 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:59.551 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:59.551 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.552 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.552 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.552 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:59.552 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:05:59.552 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.552 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.552 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.552 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:59.552 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:05:59.552 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:05:59.552 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.552 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.552 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:59.552 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:05:59.552 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:05:59.552 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.553 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.553 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.553 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:05:59.553 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:05:59.553 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.553 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.553 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:59.553 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:05:59.553 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:05:59.553 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.553 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.553 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:59.553 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:05:59.553 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:05:59.553 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.553 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.553 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:59.554 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:05:59.554 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:05:59.554 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.554 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.554 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:59.554 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:05:59.554 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:05:59.554 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.554 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.554 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.554 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:05:59.554 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:05:59.554 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.554 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.555 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:59.555 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:05:59.555 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:05:59.555 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.555 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.555 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:59.555 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:05:59.555 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:05:59.555 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.555 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:59.555 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.555 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.555 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.555 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.555 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:59.555 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 55.698135045999997, 2024-04-26T12:05:59.556 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:05:59.556 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:59.556 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.556 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:59.556 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.556 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:59.556 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:59.556 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.556 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.556 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.556 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:59.556 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:05:59.556 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.556 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.556 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.557 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:59.557 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:05:59.557 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.557 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.557 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.557 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:59.557 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:05:59.557 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:05:59.557 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.557 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.557 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:59.557 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:05:59.557 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:05:59.557 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.557 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.558 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.558 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:05:59.558 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:05:59.558 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.558 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.558 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:59.558 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:05:59.558 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:05:59.558 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.558 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.558 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:59.558 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:05:59.558 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:05:59.558 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.558 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.559 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:59.559 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:05:59.559 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:05:59.559 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.559 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.559 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:59.559 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:05:59.559 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:05:59.559 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.559 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.559 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.559 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:05:59.559 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:05:59.559 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.560 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.560 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:59.560 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:05:59.560 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:05:59.560 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.560 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.560 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:59.560 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:05:59.560 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:05:59.560 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.560 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:59.560 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.560 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.560 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.560 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.561 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:59.561 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 55.697260266000001, 2024-04-26T12:05:59.561 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:05:59.561 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:59.561 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.561 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:59.561 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.561 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:59.561 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:59.561 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.561 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.561 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.561 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:59.561 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:05:59.561 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.562 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.562 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.562 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:59.562 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:05:59.562 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:59.562 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.562 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.562 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:59.562 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:05:59.562 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:05:59.562 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.562 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.562 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:59.562 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:05:59.563 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:05:59.563 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.563 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.563 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.563 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:05:59.563 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:05:59.563 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.563 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.563 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:59.563 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:05:59.563 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:05:59.563 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.563 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.563 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:59.563 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:05:59.564 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:05:59.564 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.564 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.564 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:59.564 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:05:59.564 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:05:59.564 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.564 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.564 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:59.564 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:05:59.564 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:05:59.564 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.564 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.564 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.564 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:05:59.565 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:05:59.565 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.565 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.565 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:59.565 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:05:59.565 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:05:59.565 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.565 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.565 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:59.565 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:05:59.565 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:05:59.565 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.565 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:59.565 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.565 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.566 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.566 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.566 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:59.566 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 55.697221307, 2024-04-26T12:05:59.566 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:05:59.566 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:59.566 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.566 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:59.566 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.566 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:59.566 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:59.566 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.566 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.566 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.567 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:59.567 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:05:59.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.567 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:59.567 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:05:59.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.567 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:59.567 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:05:59.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:05:59.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.568 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:59.568 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:05:59.568 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:05:59.568 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.568 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.568 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:05:59.568 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:05:59.568 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.568 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:59.568 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:05:59.568 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:05:59.568 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.569 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:59.569 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:05:59.569 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:05:59.569 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.569 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:59.569 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:05:59.569 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:05:59.569 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.569 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:59.569 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:05:59.569 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:05:59.569 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.570 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.570 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:05:59.570 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:05:59.570 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.570 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.570 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:59.570 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:05:59.570 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:05:59.570 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.570 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.570 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:59.570 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:05:59.570 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:05:59.570 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.570 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:59.571 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.571 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.571 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.571 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.571 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:59.571 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 55.697185834999999, 2024-04-26T12:05:59.571 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:05:59.571 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:59.571 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.571 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:59.571 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.571 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:59.571 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:59.571 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.572 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.572 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.572 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:59.572 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:59.572 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.572 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.572 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.572 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:59.572 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:05:59.572 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.572 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.572 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.572 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:59.572 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:05:59.572 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:05:59.573 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.573 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.573 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:59.573 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:05:59.573 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:05:59.573 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.573 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.573 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.573 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:05:59.573 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:05:59.573 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.573 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.573 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:59.573 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:05:59.574 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:05:59.574 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.574 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.574 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:59.574 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:05:59.574 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:05:59.574 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.574 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.574 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:59.574 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:05:59.574 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:05:59.574 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.574 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.574 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:59.574 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:05:59.575 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:05:59.575 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.575 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.575 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.575 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:05:59.575 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:05:59.575 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.575 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.575 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:59.575 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:05:59.575 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:05:59.575 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.575 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.575 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:59.576 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:05:59.576 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:05:59.576 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.576 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:59.576 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.576 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.576 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.576 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.576 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:59.577 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 55.697107146, 2024-04-26T12:05:59.577 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:05:59.577 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:59.577 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.577 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:59.577 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.577 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:59.577 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:59.577 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.577 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.577 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.577 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:59.577 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:05:59.577 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.577 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.578 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.578 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:59.578 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:05:59.578 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:59.578 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.578 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.578 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:59.578 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:05:59.578 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:05:59.578 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.578 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.578 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:59.578 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:05:59.578 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:05:59.579 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.579 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.579 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.579 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:05:59.579 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:05:59.579 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.579 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.579 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:59.579 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:05:59.579 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:05:59.579 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.579 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.579 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:59.579 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:05:59.579 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:05:59.579 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.580 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.580 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:59.580 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:05:59.580 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:05:59.580 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.580 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.580 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:05:59.580 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:05:59.580 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:05:59.580 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.580 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.580 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.580 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:05:59.580 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:05:59.581 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.581 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.581 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:05:59.581 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:05:59.581 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:05:59.581 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.581 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.581 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:59.581 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:05:59.581 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:05:59.581 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.581 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:59.581 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.582 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.582 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.582 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.582 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:59.582 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 55.696956298000003, 2024-04-26T12:05:59.582 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:05:59.582 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:05:59.582 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:05:59.582 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:05:59.582 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.582 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:05:59.582 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:59.582 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.582 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.583 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.583 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:05:59.583 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:05:59.583 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:05:59.583 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.583 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.583 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:05:59.583 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:05:59.583 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:05:59.583 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.583 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.583 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:05:59.583 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:05:59.583 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:05:59.583 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.584 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.584 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:05:59.584 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:05:59.584 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:05:59.584 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.584 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.584 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.584 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:05:59.584 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:05:59.584 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.584 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.584 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:05:59.584 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:05:59.584 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:05:59.584 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.585 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.585 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:05:59.585 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:05:59.585 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:05:59.585 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:05:59.585 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:05:59.585 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:05:59.585 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:05:59.585 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:05:59.585 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.585 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:59.585 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.585 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:05:59.585 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:05:59.585 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:05:59.587 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:59.586+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:59.587 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:05:59.687 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:59.687+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:59.700 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:59.701 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:59.701 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:05:59.701 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:59.711 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:05:59.788 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:05:59.787+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:05:59.813 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:59.813 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:05:59.813 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:05:59.813 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:05:59.814 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:05:59.822 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:05:59.890 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:05:59.889+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:05:59.926 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:05:59.926 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:05:59.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:05:59.926 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:05:59.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.926 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.926 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:59.926 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 56.143724032000002, 2024-04-26T12:05:59.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:05:59.926 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:59.927 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.927 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:59.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:59.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:59.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:59.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:05:59.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:05:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:05:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:05:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:05:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:05:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:05:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:05:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:05:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:05:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:05:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:05:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:05:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:05:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:05:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:05:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:05:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:05:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:05:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:05:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:05:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:05:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:05:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.932 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.932 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:59.932 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 56.143668712, 2024-04-26T12:05:59.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:05:59.932 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:59.932 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.932 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:59.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:59.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:59.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:05:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:05:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:05:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:05:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:05:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:05:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:05:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:05:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:05:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:05:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:05:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:05:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:05:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:05:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:05:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:05:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:05:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:05:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:05:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:05:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:05:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:05:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 56.143618693999997, 2024-04-26T12:05:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:05:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:05:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:05:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:05:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:05:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:05:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:05:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:05:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:05:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:05:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:05:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:05:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:05:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:05:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:05:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:05:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:05:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:05:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:05:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:05:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:05:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:05:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:05:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 56.143584056999998, 2024-04-26T12:05:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:05:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:05:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:05:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:05:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:05:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:05:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:05:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:05:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:05:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:05:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:05:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:05:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:05:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:05:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:05:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:05:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:05:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:05:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:05:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:05:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:05:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:05:59.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:59.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:05:59.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:05:59.947 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.947 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:59.947 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.947 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.947 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:59.947 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 56.143545545000002, 2024-04-26T12:05:59.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:05:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:05:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:05:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:05:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:05:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:05:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:05:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:05:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:05:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:05:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:05:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:05:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:05:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:05:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:05:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:05:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:05:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:05:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:05:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:05:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:05:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:05:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:05:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 56.143515221999998, 2024-04-26T12:05:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:05:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:05:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:05:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:05:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:05:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:05:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:05:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:05:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:05:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:05:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:05:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:05:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:05:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:05:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:05:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:05:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:05:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:05:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:05:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:05:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:05:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:05:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:05:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:05:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:05:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:05:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 56.143488519999998, 2024-04-26T12:05:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:05:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:59.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:59.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:59.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:05:59.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:59.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:05:59.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:05:59.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:59.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:05:59.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:05:59.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:05:59.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:05:59.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:59.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:05:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:05:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:05:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:05:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:05:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:05:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 56.143446230000002, 2024-04-26T12:05:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:05:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:59.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:05:59.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:59.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:05:59.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:59.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:05:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:05:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:05:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:05:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:05:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:05:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:05:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:05:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:05:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:05:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:05:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:05:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:05:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 56.143418152000002, 2024-04-26T12:05:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:05:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:05:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:05:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:05:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:05:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:05:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:05:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:05:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:05:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:05:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:05:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:05:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:05:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:05:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:05:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 56.137422802000003, 2024-04-26T12:05:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:05:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:05:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:05:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:05:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:05:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:59.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:05:59.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:05:59.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:05:59.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:05:59.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:59.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:05:59.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:05:59.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:59.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:05:59.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:05:59.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:59.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:05:59.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:05:59.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:59.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:05:59.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:05:59.975 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.975 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:59.975 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.975 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:05:59.975 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:59.975 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 56.137353836000003, 2024-04-26T12:05:59.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:05:59.975 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:59.975 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.975 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:59.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:59.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:59.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:59.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:05:59.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:59.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:05:59.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:59.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:05:59.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:05:59.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:59.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:05:59.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:05:59.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:05:59.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:05:59.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:59.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:05:59.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:05:59.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:59.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:59.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:05:59.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:59.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:05:59.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:05:59.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:59.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:05:59.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:05:59.979 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.979 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:59.979 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.979 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:59.979 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:59.979 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 56.136859473000001, 2024-04-26T12:05:59.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:05:59.979 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:59.980 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.980 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:59.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:59.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:59.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:59.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:59.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:59.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:05:59.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:59.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:05:59.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:05:59.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:59.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:05:59.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:05:59.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:05:59.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:05:59.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:59.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:05:59.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:05:59.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:59.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:05:59.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:05:59.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:59.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:05:59.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:05:59.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:59.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:05:59.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:05:59.983 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.983 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:59.983 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.983 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:05:59.983 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:59.984 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 56.136821208000001, 2024-04-26T12:05:59.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:05:59.984 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:59.984 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:05:59.984 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:59.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:59.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:59.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:59.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:05:59.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:59.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:05:59.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:59.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:05:59.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:05:59.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:59.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:05:59.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:05:59.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:05:59.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:05:59.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:59.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:05:59.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:05:59.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:59.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:05:59.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:05:59.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:05:59.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:05:59.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:05:59.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:59.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:05:59.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:05:59.987 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.988 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:59.988 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.988 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:05:59.988 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:59.988 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 56.136141322999997, 2024-04-26T12:05:59.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:05:59.988 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:59.988 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:05:59.988 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:59.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:59.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:59.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:59.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:59.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:59.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:05:59.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:59.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:05:59.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:05:59.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:59.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:05:59.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:05:59.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:05:59.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:05:59.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:59.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:05:59.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:05:59.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.992 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:59.992 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:05:59.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:05:59.992 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.992 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:59.992 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.992 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:59.992 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:59.993 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 56.136112144000002, 2024-04-26T12:05:59.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:05:59.993 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:59.993 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:59.993 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:59.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:59.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:59.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:59.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:05:59.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:59.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:05:59.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:05:59.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:59.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:05:59.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:05:59.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:05:59.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:05:59.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:05:59.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:05:59.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:05:59.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:05:59.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:05:59.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:05:59.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:05:59.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:05:59.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:05:59.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:05:59.997 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.997 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:05:59.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:05:59.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:05:59.997 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.997 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:05:59.997 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:05:59.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.998 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:05:59.998 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:59.998 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 56.136080333000002, 2024-04-26T12:05:59.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:05:59.998 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:05:59.998 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:05:59.998 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:05:59.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:05:59.998 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:59.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:05:59.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:59.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:05:59.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:05:59.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:05:59.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:05:59.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:05:59.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:05:59.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:05:59.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:06:00.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:06:00.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:00.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:06:00.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:06:00.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:00.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:06:00.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:06:00.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:00.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:06:00.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:06:00.001 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.001 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:00.001 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:06:00.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:06:00.001 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.001 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:00.001 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:06:00.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:06:00.001 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:00.001 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:00.001 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:00.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.002 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:00.002 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:00.002 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 56.136058976999998, 2024-04-26T12:06:00.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:06:00.002 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:00.002 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:00.002 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:00.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:00.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:00.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:00.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:00.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:00.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:00.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:00.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:00.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:00.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:00.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:06:00.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:06:00.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:00.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:06:00.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:06:00.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:00.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:06:00.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:06:00.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:00.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:06:00.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:06:00.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.005 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:00.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:06:00.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:06:00.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.005 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:00.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:06:00.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:06:00.005 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:00.005 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:00.005 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:00.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.005 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:06:00.006 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:00.006 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 56.136030523999999, 2024-04-26T12:06:00.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:06:00.006 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:00.006 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:00.006 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:00.006 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.006 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:00.006 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:00.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:00.006 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.006 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.006 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:00.006 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:00.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:00.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:00.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:00.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:00.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:00.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:06:00.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:06:00.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:00.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:06:00.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:06:00.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.008 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:00.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:06:00.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:06:00.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.008 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:00.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:06:00.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:06:00.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.008 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:00.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:06:00.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:06:00.009 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:00.009 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:00.009 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:00.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.009 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:06:00.009 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:00.009 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 56.135308717999997, 2024-04-26T12:06:00.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:06:00.009 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:00.009 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:00.009 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:00.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:00.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:00.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:00.010 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.010 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:00.010 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:00.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:00.010 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.010 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:00.010 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:06:00.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:00.010 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.010 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:00.010 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:06:00.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:06:00.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.011 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:00.011 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:06:00.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:06:00.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.011 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:00.011 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:06:00.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:06:00.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.011 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:00.011 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:06:00.012 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:06:00.012 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.012 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:00.012 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:06:00.012 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:06:00.012 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:00.012 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:00.012 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:00.012 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.012 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:06:00.012 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:00.012 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 50.418382115, 2024-04-26T12:06:00.012 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:06:00.013 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:00.013 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:00.013 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:00.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.013 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:00.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:00.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:00.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.013 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:00.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:00.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:00.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:00.014 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:06:00.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:06:00.014 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:00.014 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:06:00.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:06:00.014 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:00.014 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:06:00.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:06:00.014 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:00.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:06:00.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:06:00.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:00.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:06:00.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:06:00.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:00.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:06:00.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:06:00.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:00.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:06:00.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:06:00.016 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:00.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:06:00.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:06:00.016 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:00.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:06:00.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:06:00.016 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:00.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:06:00.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:06:00.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:00.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:00.017 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:00.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:06:00.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:06:00.017 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:00.017 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:00.017 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:00.017 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:00.017 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:00.017 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:00.019 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:06:00.020 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:00.018+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:00.025 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:06:00.119 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:00.118+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:00.123 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:06:00.123 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:06:00.123 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-04-26T12:06:00.123 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:06:00.132 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:06:00.149 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:00.149 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:00.166 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T12:06:00.167 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:06:00.184 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:00.184 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:00.220 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:00.219+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:00.273 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:00.273 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:00.282 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:06:00.322 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:00.321+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:00.423 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:00.422+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:00.423 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:00.423 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:00.432 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:00.524 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:00.523+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:00.537 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:00.537 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:00.546 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:00.625 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:00.624+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:00.648 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:00.648 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:00.657 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:00.726 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:00.725+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:00.760 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:00.760 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:00.769 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:00.827 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:00.827+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:00.877 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:00.877 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:00.886 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:00.929 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:00.928+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:00.931 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:06:00.988 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:00.988 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:00.997 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:01.038 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:01.037+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:01.130 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:01.129+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:01.138 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:01.138 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:01.147 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:06:01.231 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:01.230+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:01.255 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:01.255 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:01.264 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:06:01.332 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:01.331+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:01.365 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:01.365 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:01.374 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:06:01.433 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:01.432+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:01.476 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:01.476 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:01.485 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:01.534 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:01.533+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:01.589 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:01.589 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:01.598 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:01.635 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:01.634+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:01.736 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:01.735+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:01.740 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:01.740 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:01.749 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:01.837 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:01.836+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:01.850 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:01.851 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:01.860 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:01.927 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:06:01.927 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:06:01.927 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-26T12:06:01.927 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T12:06:01.928 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-26T12:06:01.938 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:01.937+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:01.969 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:01.969 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:01.978 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:02.039 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:02.038+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:02.079 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:02.080 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:02.088 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:02.141 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:02.139+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:02.195 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:06:02.230 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:02.230 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:02.237 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:06:02.237 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-26T12:06:02.237 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 34, 2024-04-26T12:06:02.237 INFO:teuthology.orchestra.run.smithi052.stdout: "fsid": "5bc300ae-e948-4ce3-81bb-5abae8c06799", 2024-04-26T12:06:02.237 INFO:teuthology.orchestra.run.smithi052.stdout: "created": "2024-04-26T12:04:41.919527+0000", 2024-04-26T12:06:02.237 INFO:teuthology.orchestra.run.smithi052.stdout: "modified": "2024-04-26T12:06:01.920121+0000", 2024-04-26T12:06:02.237 INFO:teuthology.orchestra.run.smithi052.stdout: "last_up_change": "2024-04-26T12:04:51.084680+0000", 2024-04-26T12:06:02.237 INFO:teuthology.orchestra.run.smithi052.stdout: "last_in_change": "2024-04-26T12:04:43.540390+0000", 2024-04-26T12:06:02.237 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T12:06:02.238 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_num": 5801984, 2024-04-26T12:06:02.238 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_set": [ 2024-04-26T12:06:02.238 INFO:teuthology.orchestra.run.smithi052.stdout: "noscrub", 2024-04-26T12:06:02.238 INFO:teuthology.orchestra.run.smithi052.stdout: "pglog_hardlimit", 2024-04-26T12:06:02.238 INFO:teuthology.orchestra.run.smithi052.stdout: "purged_snapdirs", 2024-04-26T12:06:02.238 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_deletes", 2024-04-26T12:06:02.238 INFO:teuthology.orchestra.run.smithi052.stdout: "sortbitwise" 2024-04-26T12:06:02.238 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-04-26T12:06:02.238 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_version": 4, 2024-04-26T12:06:02.239 INFO:teuthology.orchestra.run.smithi052.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T12:06:02.239 INFO:teuthology.orchestra.run.smithi052.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T12:06:02.239 INFO:teuthology.orchestra.run.smithi052.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T12:06:02.239 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_snapshot": "", 2024-04-26T12:06:02.239 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_max": 4, 2024-04-26T12:06:02.239 INFO:teuthology.orchestra.run.smithi052.stdout: "max_osd": 3, 2024-04-26T12:06:02.239 INFO:teuthology.orchestra.run.smithi052.stdout: "require_min_compat_client": "luminous", 2024-04-26T12:06:02.239 INFO:teuthology.orchestra.run.smithi052.stdout: "min_compat_client": "jewel", 2024-04-26T12:06:02.239 INFO:teuthology.orchestra.run.smithi052.stdout: "require_osd_release": "reef", 2024-04-26T12:06:02.239 INFO:teuthology.orchestra.run.smithi052.stdout: "allow_crimson": false, 2024-04-26T12:06:02.239 INFO:teuthology.orchestra.run.smithi052.stdout: "pools": [ 2024-04-26T12:06:02.239 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.239 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 1, 2024-04-26T12:06:02.239 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": ".mgr", 2024-04-26T12:06:02.240 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-04-26T12:04:52.376506+0000", 2024-04-26T12:06:02.240 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-04-26T12:06:02.240 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-04-26T12:06:02.240 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-04-26T12:06:02.240 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-04-26T12:06:02.240 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-04-26T12:06:02.240 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-04-26T12:06:02.240 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:06:02.240 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:06:02.240 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:06:02.240 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:06:02.240 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-04-26T12:06:02.240 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:06:02.240 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 1, 2024-04-26T12:06:02.241 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 1, 2024-04-26T12:06:02.241 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 1, 2024-04-26T12:06:02.241 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 1, 2024-04-26T12:06:02.241 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 1, 2024-04-26T12:06:02.241 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-04-26T12:06:02.241 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-04-26T12:06:02.241 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-04-26T12:06:02.241 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-04-26T12:06:02.241 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-04-26T12:06:02.241 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-04-26T12:06:02.241 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-04-26T12:06:02.241 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.241 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "11", 2024-04-26T12:06:02.241 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-04-26T12:06:02.241 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:06:02.242 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:06:02.242 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-04-26T12:06:02.242 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:06:02.242 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-04-26T12:06:02.242 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-04-26T12:06:02.242 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-04-26T12:06:02.242 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-04-26T12:06:02.242 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-04-26T12:06:02.242 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-04-26T12:06:02.242 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-04-26T12:06:02.242 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-04-26T12:06:02.242 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-04-26T12:06:02.242 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-04-26T12:06:02.243 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-04-26T12:06:02.243 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-04-26T12:06:02.243 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-04-26T12:06:02.243 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:06:02.243 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:06:02.243 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:06:02.243 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-04-26T12:06:02.243 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-04-26T12:06:02.243 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-04-26T12:06:02.243 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-04-26T12:06:02.243 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-04-26T12:06:02.243 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.243 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-04-26T12:06:02.243 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-04-26T12:06:02.244 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-04-26T12:06:02.244 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:06:02.244 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:06:02.244 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:06:02.244 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:06:02.244 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-04-26T12:06:02.244 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-04-26T12:06:02.244 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-04-26T12:06:02.244 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-04-26T12:06:02.244 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-04-26T12:06:02.244 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_max": 32, 2024-04-26T12:06:02.244 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 1 2024-04-26T12:06:02.244 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.244 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-04-26T12:06:02.245 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": {} 2024-04-26T12:06:02.245 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.245 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-04-26T12:06:02.245 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 2.9900000095367432, 2024-04-26T12:06:02.245 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 2.9900000095367432, 2024-04-26T12:06:02.245 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T12:06:02.245 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 2, 2024-04-26T12:06:02.245 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 2, 2024-04-26T12:06:02.245 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:06:02.245 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-04-26T12:06:02.245 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:06:02.245 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:06:02.245 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.245 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.245 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 2, 2024-04-26T12:06:02.246 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "rbd", 2024-04-26T12:06:02.246 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-04-26T12:04:57.775333+0000", 2024-04-26T12:06:02.246 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-04-26T12:06:02.246 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-04-26T12:06:02.246 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-04-26T12:06:02.246 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-04-26T12:06:02.246 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-04-26T12:06:02.246 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-04-26T12:06:02.246 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:06:02.246 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:06:02.246 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:06:02.246 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:06:02.246 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-04-26T12:06:02.246 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:06:02.247 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 8, 2024-04-26T12:06:02.247 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 8, 2024-04-26T12:06:02.247 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 8, 2024-04-26T12:06:02.247 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 8, 2024-04-26T12:06:02.247 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 8, 2024-04-26T12:06:02.247 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-04-26T12:06:02.247 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-04-26T12:06:02.247 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-04-26T12:06:02.247 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-04-26T12:06:02.247 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-04-26T12:06:02.247 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-04-26T12:06:02.247 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-04-26T12:06:02.247 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.247 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "14", 2024-04-26T12:06:02.247 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-04-26T12:06:02.248 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:06:02.248 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:06:02.248 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-04-26T12:06:02.248 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:06:02.248 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-04-26T12:06:02.248 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-04-26T12:06:02.248 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-04-26T12:06:02.248 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-04-26T12:06:02.248 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-04-26T12:06:02.248 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-04-26T12:06:02.248 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-04-26T12:06:02.248 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-04-26T12:06:02.248 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-04-26T12:06:02.248 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-04-26T12:06:02.248 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-04-26T12:06:02.249 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-04-26T12:06:02.249 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-04-26T12:06:02.249 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:06:02.249 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:06:02.249 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:06:02.249 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-04-26T12:06:02.249 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-04-26T12:06:02.249 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-04-26T12:06:02.249 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-04-26T12:06:02.249 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-04-26T12:06:02.249 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.249 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-04-26T12:06:02.249 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-04-26T12:06:02.249 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-04-26T12:06:02.249 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:06:02.250 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:06:02.250 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:06:02.250 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:06:02.250 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-04-26T12:06:02.250 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-04-26T12:06:02.250 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-04-26T12:06:02.250 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-04-26T12:06:02.250 INFO:teuthology.orchestra.run.smithi052.stdout: "options": {}, 2024-04-26T12:06:02.250 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-04-26T12:06:02.250 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd": {} 2024-04-26T12:06:02.250 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.250 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-04-26T12:06:02.250 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.5, 2024-04-26T12:06:02.250 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.5, 2024-04-26T12:06:02.250 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-04-26T12:06:02.251 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.5, 2024-04-26T12:06:02.251 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.5, 2024-04-26T12:06:02.251 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:06:02.251 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-04-26T12:06:02.251 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:06:02.251 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:06:02.251 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.251 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.251 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 3, 2024-04-26T12:06:02.251 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "cephfs_metadata", 2024-04-26T12:06:02.251 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-04-26T12:05:02.226064+0000", 2024-04-26T12:06:02.251 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-04-26T12:06:02.252 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-04-26T12:06:02.252 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-04-26T12:06:02.252 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-04-26T12:06:02.252 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-04-26T12:06:02.252 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-04-26T12:06:02.252 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:06:02.252 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:06:02.252 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:06:02.252 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:06:02.252 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-04-26T12:06:02.252 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:06:02.252 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 32, 2024-04-26T12:06:02.252 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 32, 2024-04-26T12:06:02.253 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 32, 2024-04-26T12:06:02.253 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 32, 2024-04-26T12:06:02.253 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 32, 2024-04-26T12:06:02.253 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-04-26T12:06:02.253 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-04-26T12:06:02.253 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-04-26T12:06:02.253 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-04-26T12:06:02.253 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-04-26T12:06:02.253 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-04-26T12:06:02.253 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-04-26T12:06:02.253 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.253 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "17", 2024-04-26T12:06:02.253 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-04-26T12:06:02.253 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:06:02.254 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:06:02.254 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-04-26T12:06:02.254 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:06:02.254 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-04-26T12:06:02.254 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-04-26T12:06:02.254 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-04-26T12:06:02.254 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-04-26T12:06:02.254 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-04-26T12:06:02.254 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-04-26T12:06:02.254 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-04-26T12:06:02.254 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-04-26T12:06:02.254 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-04-26T12:06:02.254 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-04-26T12:06:02.254 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-04-26T12:06:02.255 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-04-26T12:06:02.255 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-04-26T12:06:02.255 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:06:02.255 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:06:02.255 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:06:02.255 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-04-26T12:06:02.255 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-04-26T12:06:02.255 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-04-26T12:06:02.255 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-04-26T12:06:02.255 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-04-26T12:06:02.255 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.255 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-04-26T12:06:02.255 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-04-26T12:06:02.255 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-04-26T12:06:02.256 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:06:02.256 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:06:02.256 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:06:02.256 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:06:02.256 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-04-26T12:06:02.256 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-04-26T12:06:02.256 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-04-26T12:06:02.256 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-04-26T12:06:02.256 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-04-26T12:06:02.256 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_bias": 4, 2024-04-26T12:06:02.256 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 16, 2024-04-26T12:06:02.256 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_priority": 5 2024-04-26T12:06:02.257 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.257 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-04-26T12:06:02.257 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs": { 2024-04-26T12:06:02.257 INFO:teuthology.orchestra.run.smithi052.stdout: "metadata": "cephfs" 2024-04-26T12:06:02.257 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:06:02.257 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.257 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-04-26T12:06:02.257 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.1299999952316284, 2024-04-26T12:06:02.257 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.1299999952316284, 2024-04-26T12:06:02.257 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-04-26T12:06:02.257 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T12:06:02.257 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T12:06:02.257 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:06:02.257 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-04-26T12:06:02.258 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:06:02.258 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:06:02.258 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.258 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.258 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 4, 2024-04-26T12:06:02.258 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "cephfs_data", 2024-04-26T12:06:02.258 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-04-26T12:05:02.758806+0000", 2024-04-26T12:06:02.258 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-04-26T12:06:02.258 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-04-26T12:06:02.258 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-04-26T12:06:02.258 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-04-26T12:06:02.258 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-04-26T12:06:02.258 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-04-26T12:06:02.259 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:06:02.259 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:06:02.259 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:06:02.259 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:06:02.259 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-04-26T12:06:02.259 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:06:02.259 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 64, 2024-04-26T12:06:02.259 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 64, 2024-04-26T12:06:02.259 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 64, 2024-04-26T12:06:02.259 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 64, 2024-04-26T12:06:02.259 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 64, 2024-04-26T12:06:02.259 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-04-26T12:06:02.259 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-04-26T12:06:02.259 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-04-26T12:06:02.259 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-04-26T12:06:02.260 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-04-26T12:06:02.260 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-04-26T12:06:02.260 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-04-26T12:06:02.260 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.260 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "18", 2024-04-26T12:06:02.260 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-04-26T12:06:02.260 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:06:02.260 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:06:02.260 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-04-26T12:06:02.260 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:06:02.260 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-04-26T12:06:02.260 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-04-26T12:06:02.260 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-04-26T12:06:02.260 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-04-26T12:06:02.260 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-04-26T12:06:02.261 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-04-26T12:06:02.261 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-04-26T12:06:02.261 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-04-26T12:06:02.261 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-04-26T12:06:02.261 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-04-26T12:06:02.261 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-04-26T12:06:02.261 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-04-26T12:06:02.261 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-04-26T12:06:02.261 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:06:02.261 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:06:02.262 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:06:02.262 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-04-26T12:06:02.262 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-04-26T12:06:02.262 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-04-26T12:06:02.262 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-04-26T12:06:02.262 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-04-26T12:06:02.262 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.262 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-04-26T12:06:02.262 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-04-26T12:06:02.262 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-04-26T12:06:02.262 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:06:02.262 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:06:02.262 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:06:02.263 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:06:02.263 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-04-26T12:06:02.263 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-04-26T12:06:02.263 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-04-26T12:06:02.263 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-04-26T12:06:02.263 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-04-26T12:06:02.263 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 64, 2024-04-26T12:06:02.263 INFO:teuthology.orchestra.run.smithi052.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T12:06:02.263 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.263 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-04-26T12:06:02.263 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs": { 2024-04-26T12:06:02.263 INFO:teuthology.orchestra.run.smithi052.stdout: "data": "cephfs" 2024-04-26T12:06:02.263 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:06:02.264 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.264 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-04-26T12:06:02.264 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.1299999952316284, 2024-04-26T12:06:02.264 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.1299999952316284, 2024-04-26T12:06:02.264 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-04-26T12:06:02.264 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T12:06:02.264 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T12:06:02.264 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:06:02.264 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-04-26T12:06:02.264 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:06:02.264 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:06:02.264 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:06:02.264 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-04-26T12:06:02.265 INFO:teuthology.orchestra.run.smithi052.stdout: "osds": [ 2024-04-26T12:06:02.265 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.265 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-04-26T12:06:02.265 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "638cfa85-e921-4403-9bcb-a7f4653cc3b2", 2024-04-26T12:06:02.265 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-04-26T12:06:02.265 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-04-26T12:06:02.265 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-04-26T12:06:02.265 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-04-26T12:06:02.265 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-04-26T12:06:02.265 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-04-26T12:06:02.265 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-04-26T12:06:02.265 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 16, 2024-04-26T12:06:02.265 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-04-26T12:06:02.265 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-04-26T12:06:02.266 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-04-26T12:06:02.266 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:06:02.266 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.266 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:06:02.266 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.143:6800", 2024-04-26T12:06:02.266 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28597 2024-04-26T12:06:02.266 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.266 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.266 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:06:02.266 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.143:6801", 2024-04-26T12:06:02.266 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28597 2024-04-26T12:06:02.267 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:06:02.267 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:06:02.267 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.267 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-04-26T12:06:02.267 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:06:02.267 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.267 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:06:02.267 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.143:6802", 2024-04-26T12:06:02.267 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28597 2024-04-26T12:06:02.267 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.267 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.268 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:06:02.268 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.143:6803", 2024-04-26T12:06:02.268 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28597 2024-04-26T12:06:02.268 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:06:02.268 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:06:02.268 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.268 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-04-26T12:06:02.268 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:06:02.268 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.268 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:06:02.268 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.143:6806", 2024-04-26T12:06:02.268 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28597 2024-04-26T12:06:02.268 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.268 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.268 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:06:02.269 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.143:6807", 2024-04-26T12:06:02.269 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28597 2024-04-26T12:06:02.269 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:06:02.269 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:06:02.269 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.269 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-04-26T12:06:02.269 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:06:02.269 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.269 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:06:02.269 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.143:6804", 2024-04-26T12:06:02.269 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28597 2024-04-26T12:06:02.269 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.270 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.270 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:06:02.270 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.143:6805", 2024-04-26T12:06:02.270 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28597 2024-04-26T12:06:02.270 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:06:02.270 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:06:02.270 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.270 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.143:6801/28597", 2024-04-26T12:06:02.270 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.143:6803/28597", 2024-04-26T12:06:02.270 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.143:6807/28597", 2024-04-26T12:06:02.271 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.143:6805/28597", 2024-04-26T12:06:02.271 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-04-26T12:06:02.271 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-04-26T12:06:02.271 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-04-26T12:06:02.271 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:06:02.271 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.271 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.271 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 1, 2024-04-26T12:06:02.271 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "2abc8d1e-ad72-4643-ad1e-3566e5113c44", 2024-04-26T12:06:02.271 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-04-26T12:06:02.271 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-04-26T12:06:02.272 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-04-26T12:06:02.272 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-04-26T12:06:02.272 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-04-26T12:06:02.272 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-04-26T12:06:02.272 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-04-26T12:06:02.273 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 16, 2024-04-26T12:06:02.273 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-04-26T12:06:02.273 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-04-26T12:06:02.273 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-04-26T12:06:02.274 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:06:02.274 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.274 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:06:02.274 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6800", 2024-04-26T12:06:02.274 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28560 2024-04-26T12:06:02.274 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.274 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.274 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:06:02.274 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6801", 2024-04-26T12:06:02.274 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28560 2024-04-26T12:06:02.275 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:06:02.275 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:06:02.275 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.275 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-04-26T12:06:02.275 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:06:02.275 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.275 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:06:02.275 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6802", 2024-04-26T12:06:02.275 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28560 2024-04-26T12:06:02.275 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.275 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.275 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:06:02.276 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6803", 2024-04-26T12:06:02.276 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28560 2024-04-26T12:06:02.276 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:06:02.276 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:06:02.276 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.276 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-04-26T12:06:02.276 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:06:02.276 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.276 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:06:02.276 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6806", 2024-04-26T12:06:02.276 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28560 2024-04-26T12:06:02.276 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.276 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.277 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:06:02.277 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6807", 2024-04-26T12:06:02.277 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28560 2024-04-26T12:06:02.277 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:06:02.277 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:06:02.277 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.277 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-04-26T12:06:02.277 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:06:02.277 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.277 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:06:02.277 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6804", 2024-04-26T12:06:02.277 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28560 2024-04-26T12:06:02.278 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.278 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.278 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:06:02.278 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6805", 2024-04-26T12:06:02.278 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28560 2024-04-26T12:06:02.278 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:06:02.278 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:06:02.278 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.278 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.154:6801/28560", 2024-04-26T12:06:02.278 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.154:6803/28560", 2024-04-26T12:06:02.278 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.154:6807/28560", 2024-04-26T12:06:02.279 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.154:6805/28560", 2024-04-26T12:06:02.279 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-04-26T12:06:02.279 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-04-26T12:06:02.279 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-04-26T12:06:02.279 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:06:02.279 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.279 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.279 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-04-26T12:06:02.279 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "d2ebc562-cb9b-4089-a19b-1788b70b57dc", 2024-04-26T12:06:02.279 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-04-26T12:06:02.279 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-04-26T12:06:02.279 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-04-26T12:06:02.281 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-04-26T12:06:02.281 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-04-26T12:06:02.281 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-04-26T12:06:02.281 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-04-26T12:06:02.281 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 16, 2024-04-26T12:06:02.281 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-04-26T12:06:02.281 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-04-26T12:06:02.281 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-04-26T12:06:02.282 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:06:02.282 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.282 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:06:02.282 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6800", 2024-04-26T12:06:02.282 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28709 2024-04-26T12:06:02.282 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.282 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.282 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:06:02.282 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6801", 2024-04-26T12:06:02.282 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28709 2024-04-26T12:06:02.282 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:06:02.283 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:06:02.283 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.283 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-04-26T12:06:02.283 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:06:02.284 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.284 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:06:02.284 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6802", 2024-04-26T12:06:02.284 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28709 2024-04-26T12:06:02.284 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.284 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.284 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:06:02.284 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6803", 2024-04-26T12:06:02.284 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28709 2024-04-26T12:06:02.284 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:06:02.284 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:06:02.284 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.285 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-04-26T12:06:02.285 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:06:02.285 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.285 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:06:02.285 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6806", 2024-04-26T12:06:02.285 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28709 2024-04-26T12:06:02.285 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.285 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.285 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:06:02.285 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6807", 2024-04-26T12:06:02.285 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28709 2024-04-26T12:06:02.285 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:06:02.285 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:06:02.286 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.286 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-04-26T12:06:02.286 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T12:06:02.286 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.286 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T12:06:02.286 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6804", 2024-04-26T12:06:02.286 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28709 2024-04-26T12:06:02.286 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.286 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.286 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T12:06:02.286 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6805", 2024-04-26T12:06:02.287 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 28709 2024-04-26T12:06:02.287 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:06:02.287 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:06:02.287 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.287 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.164:6801/28709", 2024-04-26T12:06:02.287 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.164:6803/28709", 2024-04-26T12:06:02.287 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.164:6807/28709", 2024-04-26T12:06:02.287 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.164:6805/28709", 2024-04-26T12:06:02.287 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-04-26T12:06:02.287 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-04-26T12:06:02.287 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-04-26T12:06:02.287 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T12:06:02.287 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:06:02.288 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-04-26T12:06:02.288 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_xinfo": [ 2024-04-26T12:06:02.288 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.288 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-04-26T12:06:02.288 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-04-26T12:06:02.288 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-04-26T12:06:02.288 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-04-26T12:06:02.288 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540138322906710015, 2024-04-26T12:06:02.288 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-04-26T12:06:02.288 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-04-26T12:04:48.573478+0000", 2024-04-26T12:06:02.288 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-04-26T12:06:02.288 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.288 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.289 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 1, 2024-04-26T12:06:02.289 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-04-26T12:06:02.289 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-04-26T12:06:02.289 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-04-26T12:06:02.289 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540138322906710015, 2024-04-26T12:06:02.289 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-04-26T12:06:02.289 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-04-26T12:04:48.624482+0000", 2024-04-26T12:06:02.289 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-04-26T12:06:02.289 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.289 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T12:06:02.289 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-04-26T12:06:02.289 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-04-26T12:06:02.290 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-04-26T12:06:02.290 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-04-26T12:06:02.290 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540138322906710015, 2024-04-26T12:06:02.290 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-04-26T12:06:02.290 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-04-26T12:04:48.615449+0000", 2024-04-26T12:06:02.290 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-04-26T12:06:02.290 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:06:02.290 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-04-26T12:06:02.290 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap": [], 2024-04-26T12:06:02.290 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap_items": [], 2024-04-26T12:06:02.290 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap_primaries": [], 2024-04-26T12:06:02.290 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_temp": [], 2024-04-26T12:06:02.291 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_temp": [], 2024-04-26T12:06:02.291 INFO:teuthology.orchestra.run.smithi052.stdout: "blocklist": {}, 2024-04-26T12:06:02.291 INFO:teuthology.orchestra.run.smithi052.stdout: "range_blocklist": {}, 2024-04-26T12:06:02.291 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profiles": { 2024-04-26T12:06:02.291 INFO:teuthology.orchestra.run.smithi052.stdout: "default": { 2024-04-26T12:06:02.291 INFO:teuthology.orchestra.run.smithi052.stdout: "crush-failure-domain": "osd", 2024-04-26T12:06:02.291 INFO:teuthology.orchestra.run.smithi052.stdout: "k": "2", 2024-04-26T12:06:02.291 INFO:teuthology.orchestra.run.smithi052.stdout: "m": "1", 2024-04-26T12:06:02.291 INFO:teuthology.orchestra.run.smithi052.stdout: "plugin": "jerasure", 2024-04-26T12:06:02.291 INFO:teuthology.orchestra.run.smithi052.stdout: "technique": "reed_sol_van" 2024-04-26T12:06:02.291 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:06:02.291 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T12:06:02.291 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps_queue": [], 2024-04-26T12:06:02.292 INFO:teuthology.orchestra.run.smithi052.stdout: "new_removed_snaps": [], 2024-04-26T12:06:02.292 INFO:teuthology.orchestra.run.smithi052.stdout: "new_purged_snaps": [], 2024-04-26T12:06:02.292 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_node_flags": {}, 2024-04-26T12:06:02.292 INFO:teuthology.orchestra.run.smithi052.stdout: "device_class_flags": {}, 2024-04-26T12:06:02.292 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode": { 2024-04-26T12:06:02.292 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode_enabled": false, 2024-04-26T12:06:02.292 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_bucket_count": 0, 2024-04-26T12:06:02.292 INFO:teuthology.orchestra.run.smithi052.stdout: "degraded_stretch_mode": 0, 2024-04-26T12:06:02.292 INFO:teuthology.orchestra.run.smithi052.stdout: "recovering_stretch_mode": 0, 2024-04-26T12:06:02.292 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode_bucket": 0 2024-04-26T12:06:02.292 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T12:06:02.292 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-26T12:06:02.295 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:06:02.296 INFO:tasks.thrashosds.thrasher:j is {'epoch': 34, 'fsid': '5bc300ae-e948-4ce3-81bb-5abae8c06799', 'created': '2024-04-26T12:04:41.919527+0000', 'modified': '2024-04-26T12:06:01.920121+0000', 'last_up_change': '2024-04-26T12:04:51.084680+0000', 'last_in_change': '2024-04-26T12:04:43.540390+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:04:52.376506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:04:57.775333+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:05:02.226064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:05:02.758806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '638cfa85-e921-4403-9bcb-a7f4653cc3b2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6800', 'nonce': 28597}, {'type': 'v1', 'addr': '172.21.15.143:6801', 'nonce': 28597}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6802', 'nonce': 28597}, {'type': 'v1', 'addr': '172.21.15.143:6803', 'nonce': 28597}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6806', 'nonce': 28597}, {'type': 'v1', 'addr': '172.21.15.143:6807', 'nonce': 28597}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6804', 'nonce': 28597}, {'type': 'v1', 'addr': '172.21.15.143:6805', 'nonce': 28597}]}, 'public_addr': '172.21.15.143:6801/28597', 'cluster_addr': '172.21.15.143:6803/28597', 'heartbeat_back_addr': '172.21.15.143:6807/28597', 'heartbeat_front_addr': '172.21.15.143:6805/28597', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '2abc8d1e-ad72-4643-ad1e-3566e5113c44', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6800', 'nonce': 28560}, {'type': 'v1', 'addr': '172.21.15.154:6801', 'nonce': 28560}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6802', 'nonce': 28560}, {'type': 'v1', 'addr': '172.21.15.154:6803', 'nonce': 28560}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6806', 'nonce': 28560}, {'type': 'v1', 'addr': '172.21.15.154:6807', 'nonce': 28560}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6804', 'nonce': 28560}, {'type': 'v1', 'addr': '172.21.15.154:6805', 'nonce': 28560}]}, 'public_addr': '172.21.15.154:6801/28560', 'cluster_addr': '172.21.15.154:6803/28560', 'heartbeat_back_addr': '172.21.15.154:6807/28560', 'heartbeat_front_addr': '172.21.15.154:6805/28560', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'd2ebc562-cb9b-4089-a19b-1788b70b57dc', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6800', 'nonce': 28709}, {'type': 'v1', 'addr': '172.21.15.164:6801', 'nonce': 28709}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6802', 'nonce': 28709}, {'type': 'v1', 'addr': '172.21.15.164:6803', 'nonce': 28709}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6806', 'nonce': 28709}, {'type': 'v1', 'addr': '172.21.15.164:6807', 'nonce': 28709}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6804', 'nonce': 28709}, {'type': 'v1', 'addr': '172.21.15.164:6805', 'nonce': 28709}]}, 'public_addr': '172.21.15.164:6801/28709', 'cluster_addr': '172.21.15.164:6803/28709', 'heartbeat_back_addr': '172.21.15.164:6807/28709', 'heartbeat_front_addr': '172.21.15.164:6805/28709', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:04:48.573478+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:04:48.624482+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:04:48.615449+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T12:06:02.296 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-04-26T12:06:02.297 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:02.293+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:02.324 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:02.324 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:02.344 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T12:06:02.344 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:06:02.363 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:02.363 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:02.395 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:02.393+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:02.403 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:06:02.403 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:06:02.403 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-04-26T12:06:02.403 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:06:02.412 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:06:02.495 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:02.495+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:02.556 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:06:02.556 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:06:02.556 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T12:06:02.556 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T12:06:02.557 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:06:02.565 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:06:02.596 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:02.595+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:02.668 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:06:02.669 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T12:06:02.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T12:06:02.669 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T12:06:02.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.669 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:02.669 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:02.669 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.886015254, 2024-04-26T12:06:02.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017255857999999999, 2024-04-26T12:06:02.669 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:02.670 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:02.670 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:02.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:02.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:02.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:02.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:02.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:02.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780340+0000", 2024-04-26T12:06:02.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:02.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:02.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780351+0000", 2024-04-26T12:06:02.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0898e-05 2024-04-26T12:06:02.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:02.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:02.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1671999999999999e-05 2024-04-26T12:06:02.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:02.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780374+0000", 2024-04-26T12:06:02.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1117999999999999e-05 2024-04-26T12:06:02.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780423+0000", 2024-04-26T12:06:02.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9066000000000001e-05 2024-04-26T12:06:02.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:06:02.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780428+0000", 2024-04-26T12:06:02.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1320000000000002e-06 2024-04-26T12:06:02.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788902+0000", 2024-04-26T12:06:02.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084738560000000001 2024-04-26T12:06:02.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:02.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789167+0000", 2024-04-26T12:06:02.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026521100000000001 2024-04-26T12:06:02.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:02.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789279+0000", 2024-04-26T12:06:02.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111616 2024-04-26T12:06:02.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:02.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792335+0000", 2024-04-26T12:06:02.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030556419999999999 2024-04-26T12:06:02.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:06:02.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797519+0000", 2024-04-26T12:06:02.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051841550000000002 2024-04-26T12:06:02.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:02.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797559+0000", 2024-04-26T12:06:02.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0451999999999998e-05 2024-04-26T12:06:02.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:02.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797598+0000", 2024-04-26T12:06:02.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8500000000000001e-05 2024-04-26T12:06:02.677 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.677 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:02.677 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.678 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:02.678 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:02.678 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.885966947, 2024-04-26T12:06:02.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017668725, 2024-04-26T12:06:02.678 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:02.678 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:02.678 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:02.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:02.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:02.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:02.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:02.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:02.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:06:02.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:02.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:02.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780395+0000", 2024-04-26T12:06:02.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.198e-06 2024-04-26T12:06:02.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:02.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780402+0000", 2024-04-26T12:06:02.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:06:02.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:02.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780408+0000", 2024-04-26T12:06:02.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:06:02.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780481+0000", 2024-04-26T12:06:02.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3239999999999997e-05 2024-04-26T12:06:02.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:06:02.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780485+0000", 2024-04-26T12:06:02.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4039999999999999e-06 2024-04-26T12:06:02.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789518+0000", 2024-04-26T12:06:02.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090335480000000006 2024-04-26T12:06:02.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:02.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789585+0000", 2024-04-26T12:06:02.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6469000000000003e-05 2024-04-26T12:06:02.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:02.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789699+0000", 2024-04-26T12:06:02.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114613 2024-04-26T12:06:02.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:02.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793308+0000", 2024-04-26T12:06:02.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036088520000000001 2024-04-26T12:06:02.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:06:02.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797887+0000", 2024-04-26T12:06:02.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0045792790000000003 2024-04-26T12:06:02.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:02.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797955+0000", 2024-04-26T12:06:02.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T12:06:02.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:02.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798059+0000", 2024-04-26T12:06:02.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103874 2024-04-26T12:06:02.684 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.684 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:02.684 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.684 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:02.684 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:06:02.684 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.885936674999996, 2024-04-26T12:06:02.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017735145000000001, 2024-04-26T12:06:02.684 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:02.684 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:02.684 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:02.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:02.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:06:02.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:02.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:06:02.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:02.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:06:02.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:02.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:02.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780424+0000", 2024-04-26T12:06:02.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4519999999999999e-06 2024-04-26T12:06:02.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:02.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780431+0000", 2024-04-26T12:06:02.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0690000000000004e-06 2024-04-26T12:06:02.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:02.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780438+0000", 2024-04-26T12:06:02.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5719999999999999e-06 2024-04-26T12:06:02.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780468+0000", 2024-04-26T12:06:02.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.993e-05 2024-04-26T12:06:02.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:06:02.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780472+0000", 2024-04-26T12:06:02.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-04-26T12:06:02.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789916+0000", 2024-04-26T12:06:02.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094434940000000002 2024-04-26T12:06:02.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:02.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790004+0000", 2024-04-26T12:06:02.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8085999999999997e-05 2024-04-26T12:06:02.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:02.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790125+0000", 2024-04-26T12:06:02.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012186200000000001 2024-04-26T12:06:02.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:02.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793402+0000", 2024-04-26T12:06:02.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00327685 2024-04-26T12:06:02.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:06:02.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798068+0000", 2024-04-26T12:06:02.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046652150000000003 2024-04-26T12:06:02.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:02.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798108+0000", 2024-04-26T12:06:02.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0911000000000002e-05 2024-04-26T12:06:02.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:02.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798156+0000", 2024-04-26T12:06:02.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7128e-05 2024-04-26T12:06:02.690 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.690 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:02.690 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.690 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:02.690 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:06:02.690 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.885913656, 2024-04-26T12:06:02.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017792624, 2024-04-26T12:06:02.690 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:02.690 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:02.690 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:02.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:02.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:06:02.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:02.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:06:02.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:02.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:06:02.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:02.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:02.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780447+0000", 2024-04-26T12:06:02.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8519999999999997e-06 2024-04-26T12:06:02.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:02.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780453+0000", 2024-04-26T12:06:02.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2999999999999998e-06 2024-04-26T12:06:02.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:02.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:02.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0760000000000002e-06 2024-04-26T12:06:02.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780502+0000", 2024-04-26T12:06:02.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4079999999999998e-05 2024-04-26T12:06:02.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:06:02.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:06:02.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5450000000000002e-06 2024-04-26T12:06:02.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790390+0000", 2024-04-26T12:06:02.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098850759999999996 2024-04-26T12:06:02.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:02.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790447+0000", 2024-04-26T12:06:02.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6752999999999997e-05 2024-04-26T12:06:02.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:02.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790547+0000", 2024-04-26T12:06:02.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100344 2024-04-26T12:06:02.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:02.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793864+0000", 2024-04-26T12:06:02.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033169749999999998 2024-04-26T12:06:02.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:06:02.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798164+0000", 2024-04-26T12:06:02.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043000690000000001 2024-04-26T12:06:02.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:02.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798204+0000", 2024-04-26T12:06:02.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9478999999999999e-05 2024-04-26T12:06:02.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:02.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798236+0000", 2024-04-26T12:06:02.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2478999999999999e-05 2024-04-26T12:06:02.695 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.696 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:02.696 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.696 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:02.696 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:06:02.696 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.885873312999998, 2024-04-26T12:06:02.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016989500000000001, 2024-04-26T12:06:02.696 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:02.696 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:02.696 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:02.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:02.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:06:02.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:02.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:06:02.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:02.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780483+0000", 2024-04-26T12:06:02.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:02.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:02.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780488+0000", 2024-04-26T12:06:02.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6260000000000003e-06 2024-04-26T12:06:02.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:02.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780499+0000", 2024-04-26T12:06:02.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1236000000000001e-05 2024-04-26T12:06:02.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:02.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:06:02.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4569999999999996e-06 2024-04-26T12:06:02.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780529+0000", 2024-04-26T12:06:02.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4579e-05 2024-04-26T12:06:02.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:06:02.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780532+0000", 2024-04-26T12:06:02.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.74e-06 2024-04-26T12:06:02.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788868+0000", 2024-04-26T12:06:02.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0083357650000000002 2024-04-26T12:06:02.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:02.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789142+0000", 2024-04-26T12:06:02.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027472 2024-04-26T12:06:02.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:02.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789241+0000", 2024-04-26T12:06:02.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8394999999999996e-05 2024-04-26T12:06:02.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:02.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792096+0000", 2024-04-26T12:06:02.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002855677 2024-04-26T12:06:02.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:06:02.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797379+0000", 2024-04-26T12:06:02.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052822379999999999 2024-04-26T12:06:02.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:02.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797433+0000", 2024-04-26T12:06:02.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4109e-05 2024-04-26T12:06:02.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:02.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797473+0000", 2024-04-26T12:06:02.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0533e-05 2024-04-26T12:06:02.702 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.702 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:02.702 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.702 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:02.702 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:06:02.702 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.885833699000003, 2024-04-26T12:06:02.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017295965, 2024-04-26T12:06:02.703 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:02.703 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:02.703 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:02.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:02.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:06:02.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:02.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:06:02.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:02.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780513+0000", 2024-04-26T12:06:02.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999895 2024-04-26T12:06:02.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:02.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780528+0000", 2024-04-26T12:06:02.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5089000000000001e-05 2024-04-26T12:06:02.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:02.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780537+0000", 2024-04-26T12:06:02.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8400000000000001e-06 2024-04-26T12:06:02.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:02.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780544+0000", 2024-04-26T12:06:02.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.917e-06 2024-04-26T12:06:02.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780571+0000", 2024-04-26T12:06:02.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7032000000000001e-05 2024-04-26T12:06:02.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:06:02.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780574+0000", 2024-04-26T12:06:02.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:06:02.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789436+0000", 2024-04-26T12:06:02.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088622240000000001 2024-04-26T12:06:02.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:02.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789525+0000", 2024-04-26T12:06:02.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8549999999999998e-05 2024-04-26T12:06:02.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:02.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789642+0000", 2024-04-26T12:06:02.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011772100000000001 2024-04-26T12:06:02.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:02.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792129+0000", 2024-04-26T12:06:02.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024871709999999998 2024-04-26T12:06:02.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:06:02.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797732+0000", 2024-04-26T12:06:02.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056027580000000002 2024-04-26T12:06:02.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:02.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797777+0000", 2024-04-26T12:06:02.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4620999999999999e-05 2024-04-26T12:06:02.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:02.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797819+0000", 2024-04-26T12:06:02.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2536000000000001e-05 2024-04-26T12:06:02.709 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.709 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:02.709 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.710 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:02.710 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:06:02.710 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.885804749000002, 2024-04-26T12:06:02.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017840163999999999, 2024-04-26T12:06:02.710 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:02.710 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:02.710 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:02.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:02.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:06:02.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:02.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:06:02.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:02.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:06:02.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:02.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:02.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:06:02.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5419999999999999e-06 2024-04-26T12:06:02.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:02.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780563+0000", 2024-04-26T12:06:02.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:06:02.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:02.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780569+0000", 2024-04-26T12:06:02.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1479999999999997e-06 2024-04-26T12:06:02.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780594+0000", 2024-04-26T12:06:02.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5585e-05 2024-04-26T12:06:02.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:06:02.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780596+0000", 2024-04-26T12:06:02.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2630000000000002e-06 2024-04-26T12:06:02.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789932+0000", 2024-04-26T12:06:02.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093360479999999996 2024-04-26T12:06:02.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:02.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790070+0000", 2024-04-26T12:06:02.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013771399999999999 2024-04-26T12:06:02.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:02.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790219+0000", 2024-04-26T12:06:02.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014872299999999999 2024-04-26T12:06:02.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:02.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793632+0000", 2024-04-26T12:06:02.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003413368 2024-04-26T12:06:02.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:06:02.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798244+0000", 2024-04-26T12:06:02.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046113819999999998 2024-04-26T12:06:02.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:02.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798361+0000", 2024-04-26T12:06:02.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117726 2024-04-26T12:06:02.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:02.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798393+0000", 2024-04-26T12:06:02.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1099999999999997e-05 2024-04-26T12:06:02.717 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.717 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:02.717 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.717 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:02.717 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:06:02.718 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.885779823999997, 2024-04-26T12:06:02.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016645943, 2024-04-26T12:06:02.718 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:02.718 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:06:02.718 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:02.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:02.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:06:02.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:02.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:06:02.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:02.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:06:02.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:02.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:02.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780580+0000", 2024-04-26T12:06:02.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1549999999999999e-06 2024-04-26T12:06:02.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:02.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780588+0000", 2024-04-26T12:06:02.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:06:02.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:02.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780593+0000", 2024-04-26T12:06:02.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2399999999999998e-06 2024-04-26T12:06:02.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780628+0000", 2024-04-26T12:06:02.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5426000000000003e-05 2024-04-26T12:06:02.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:06:02.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780632+0000", 2024-04-26T12:06:02.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:06:02.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788288+0000", 2024-04-26T12:06:02.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076555879999999996 2024-04-26T12:06:02.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:02.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788570+0000", 2024-04-26T12:06:02.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028233700000000002 2024-04-26T12:06:02.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:02.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797223+0000", 2024-04-26T12:06:02.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086529150000000006 2024-04-26T12:06:02.722 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.722 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:02.722 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.722 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:02.722 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:06:02.722 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.885755854999999, 2024-04-26T12:06:02.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016536068000000001, 2024-04-26T12:06:02.723 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:02.723 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:06:02.723 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:02.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:02.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:06:02.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:02.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:06:02.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:02.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:06:02.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:02.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:02.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780609+0000", 2024-04-26T12:06:02.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8280000000000003e-06 2024-04-26T12:06:02.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:02.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780616+0000", 2024-04-26T12:06:02.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4939999999999997e-06 2024-04-26T12:06:02.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:02.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780621+0000", 2024-04-26T12:06:02.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6040000000000003e-06 2024-04-26T12:06:02.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780647+0000", 2024-04-26T12:06:02.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6441999999999999e-05 2024-04-26T12:06:02.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:06:02.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780650+0000", 2024-04-26T12:06:02.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4430000000000002e-06 2024-04-26T12:06:02.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788163+0000", 2024-04-26T12:06:02.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007513774 2024-04-26T12:06:02.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:02.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788307+0000", 2024-04-26T12:06:02.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014374400000000001 2024-04-26T12:06:02.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:02.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797137+0000", 2024-04-26T12:06:02.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088302160000000001 2024-04-26T12:06:02.727 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.727 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:02.727 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.727 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:02.727 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:06:02.727 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.882879582999998, 2024-04-26T12:06:02.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012911448000000001, 2024-04-26T12:06:02.728 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:02.728 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:02.728 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:02.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:02.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:06:02.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:02.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:06:02.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:02.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783477+0000", 2024-04-26T12:06:02.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:02.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:02.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783482+0000", 2024-04-26T12:06:02.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5709999999999999e-06 2024-04-26T12:06:02.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:02.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783491+0000", 2024-04-26T12:06:02.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3610000000000007e-06 2024-04-26T12:06:02.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:02.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783498+0000", 2024-04-26T12:06:02.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4209999999999998e-06 2024-04-26T12:06:02.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786045+0000", 2024-04-26T12:06:02.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0025465739999999998 2024-04-26T12:06:02.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:02.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786061+0000", 2024-04-26T12:06:02.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6348999999999999e-05 2024-04-26T12:06:02.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:02.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796342+0000", 2024-04-26T12:06:02.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010280643000000001 2024-04-26T12:06:02.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:02.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796389+0000", 2024-04-26T12:06:02.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6912000000000001e-05 2024-04-26T12:06:02.731 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.731 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:02.732 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.732 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:02.732 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:06:02.732 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.882851277, 2024-04-26T12:06:02.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013376469, 2024-04-26T12:06:02.732 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:02.732 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:02.732 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:02.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:02.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:06:02.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:02.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:06:02.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:02.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:06:02.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:02.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:02.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783516+0000", 2024-04-26T12:06:02.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.041e-05 2024-04-26T12:06:02.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:02.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783523+0000", 2024-04-26T12:06:02.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5749999999999997e-06 2024-04-26T12:06:02.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:02.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783528+0000", 2024-04-26T12:06:02.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5029999999999997e-06 2024-04-26T12:06:02.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787662+0000", 2024-04-26T12:06:02.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041336230000000003 2024-04-26T12:06:02.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:02.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787687+0000", 2024-04-26T12:06:02.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5769999999999999e-05 2024-04-26T12:06:02.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:02.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796817+0000", 2024-04-26T12:06:02.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091296750000000003 2024-04-26T12:06:02.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:02.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796882+0000", 2024-04-26T12:06:02.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5180999999999998e-05 2024-04-26T12:06:02.736 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.736 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:02.736 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.736 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:02.736 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:06:02.736 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.882782736000003, 2024-04-26T12:06:02.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013457291999999999, 2024-04-26T12:06:02.736 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:02.736 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:02.736 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:02.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:02.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:06:02.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:02.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:06:02.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:02.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:06:02.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:02.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:02.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783578+0000", 2024-04-26T12:06:02.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.659e-06 2024-04-26T12:06:02.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:02.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783584+0000", 2024-04-26T12:06:02.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:06:02.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:02.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783588+0000", 2024-04-26T12:06:02.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6190000000000002e-06 2024-04-26T12:06:02.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787834+0000", 2024-04-26T12:06:02.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042460529999999996 2024-04-26T12:06:02.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:02.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787854+0000", 2024-04-26T12:06:02.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9658999999999999e-05 2024-04-26T12:06:02.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:02.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:02.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009107604 2024-04-26T12:06:02.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:02.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797032+0000", 2024-04-26T12:06:02.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9987000000000006e-05 2024-04-26T12:06:02.740 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.740 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:02.740 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.740 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:02.741 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:06:02.741 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.880936357000003, 2024-04-26T12:06:02.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011003015999999999, 2024-04-26T12:06:02.741 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:02.741 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:02.741 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:02.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:02.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:06:02.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:02.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:06:02.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:02.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785420+0000", 2024-04-26T12:06:02.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:02.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:02.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785427+0000", 2024-04-26T12:06:02.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:06:02.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:02.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785438+0000", 2024-04-26T12:06:02.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069e-05 2024-04-26T12:06:02.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:02.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785457+0000", 2024-04-26T12:06:02.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8617000000000001e-05 2024-04-26T12:06:02.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786628+0000", 2024-04-26T12:06:02.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001171418 2024-04-26T12:06:02.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:02.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786651+0000", 2024-04-26T12:06:02.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3289e-05 2024-04-26T12:06:02.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:02.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796393+0000", 2024-04-26T12:06:02.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097413269999999993 2024-04-26T12:06:02.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:02.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796424+0000", 2024-04-26T12:06:02.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1188e-05 2024-04-26T12:06:02.745 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.745 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:02.745 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.746 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:06:02.746 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:06:02.746 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.880389610999998, 2024-04-26T12:06:02.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010561432000000001, 2024-04-26T12:06:02.746 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:02.746 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:02.746 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:02.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:02.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:06:02.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:02.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:06:02.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:02.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:06:02.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:02.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:02.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785973+0000", 2024-04-26T12:06:02.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4910000000000002e-06 2024-04-26T12:06:02.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:02.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785991+0000", 2024-04-26T12:06:02.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7663e-05 2024-04-26T12:06:02.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:02.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785998+0000", 2024-04-26T12:06:02.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1239999999999999e-06 2024-04-26T12:06:02.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786792+0000", 2024-04-26T12:06:02.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079334800000000003 2024-04-26T12:06:02.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:02.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786810+0000", 2024-04-26T12:06:02.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8746999999999999e-05 2024-04-26T12:06:02.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:02.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796500+0000", 2024-04-26T12:06:02.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096897619999999993 2024-04-26T12:06:02.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:02.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796529+0000", 2024-04-26T12:06:02.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8873999999999998e-05 2024-04-26T12:06:02.751 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.751 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:02.751 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.751 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:02.751 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:06:02.752 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.880310524999999, 2024-04-26T12:06:02.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010219911, 2024-04-26T12:06:02.752 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:02.752 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:02.752 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:02.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:02.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:06:02.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.753 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:02.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:06:02.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.753 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:02.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786046+0000", 2024-04-26T12:06:02.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:02.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:02.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786053+0000", 2024-04-26T12:06:02.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0360000000000001e-06 2024-04-26T12:06:02.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:02.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786064+0000", 2024-04-26T12:06:02.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1202999999999999e-05 2024-04-26T12:06:02.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:02.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786091+0000", 2024-04-26T12:06:02.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6859000000000002e-05 2024-04-26T12:06:02.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786212+0000", 2024-04-26T12:06:02.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120975 2024-04-26T12:06:02.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:02.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786236+0000", 2024-04-26T12:06:02.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4358999999999998e-05 2024-04-26T12:06:02.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:02.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796236+0000", 2024-04-26T12:06:02.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099998050000000005 2024-04-26T12:06:02.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:02.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796266+0000", 2024-04-26T12:06:02.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0278e-05 2024-04-26T12:06:02.756 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.756 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:02.756 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.756 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:3 3.14 e17/15 3:287034c4:::1.00000000.inode:head v 17'4, mlcod=0'0)", 2024-04-26T12:06:02.756 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:06:02.756 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.879521564000001, 2024-04-26T12:06:02.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009764712, 2024-04-26T12:06:02.757 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:02.757 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:02.757 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:02.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:02.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:06:02.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:02.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:06:02.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:02.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786835+0000", 2024-04-26T12:06:02.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T12:06:02.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:02.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786844+0000", 2024-04-26T12:06:02.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6500000000000008e-06 2024-04-26T12:06:02.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:02.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786855+0000", 2024-04-26T12:06:02.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0932e-05 2024-04-26T12:06:02.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:02.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786864+0000", 2024-04-26T12:06:02.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2150000000000007e-06 2024-04-26T12:06:02.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787242+0000", 2024-04-26T12:06:02.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037708300000000001 2024-04-26T12:06:02.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:02.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787259+0000", 2024-04-26T12:06:02.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7258999999999999e-05 2024-04-26T12:06:02.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:02.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796579+0000", 2024-04-26T12:06:02.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093201099999999995 2024-04-26T12:06:02.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:02.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796600+0000", 2024-04-26T12:06:02.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1330000000000001e-05 2024-04-26T12:06:02.761 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.761 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:02.761 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.761 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:02.761 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:06:02.761 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.879477541999997, 2024-04-26T12:06:02.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096431940000000008, 2024-04-26T12:06:02.761 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:02.761 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:02.761 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:02.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:02.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:06:02.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:02.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:06:02.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:02.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786879+0000", 2024-04-26T12:06:02.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:02.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:02.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786887+0000", 2024-04-26T12:06:02.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9300000000000003e-06 2024-04-26T12:06:02.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:02.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786894+0000", 2024-04-26T12:06:02.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:06:02.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:02.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786899+0000", 2024-04-26T12:06:02.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8400000000000002e-06 2024-04-26T12:06:02.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786932+0000", 2024-04-26T12:06:02.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3031999999999998e-05 2024-04-26T12:06:02.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:02.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786945+0000", 2024-04-26T12:06:02.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3421000000000001e-05 2024-04-26T12:06:02.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:02.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796469+0000", 2024-04-26T12:06:02.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095236130000000002 2024-04-26T12:06:02.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:02.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796523+0000", 2024-04-26T12:06:02.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4089999999999999e-05 2024-04-26T12:06:02.765 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.765 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:02.765 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.766 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "pg_update_log_missing(3.14 epoch 17/15 rep_tid 169 entries 17'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:06:02.766 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:06:02.766 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.879414386999997, 2024-04-26T12:06:02.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097257639999999996, 2024-04-26T12:06:02.766 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:02.766 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-04-26T12:06:02.766 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:02.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:02.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:06:02.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:02.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:06:02.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:02.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786942+0000", 2024-04-26T12:06:02.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:02.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:02.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786951+0000", 2024-04-26T12:06:02.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:06:02.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:02.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786965+0000", 2024-04-26T12:06:02.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4268e-05 2024-04-26T12:06:02.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:02.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786977+0000", 2024-04-26T12:06:02.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1667e-05 2024-04-26T12:06:02.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787667+0000", 2024-04-26T12:06:02.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00069057400000000001 2024-04-26T12:06:02.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:02.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796668+0000", 2024-04-26T12:06:02.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090013309999999996 2024-04-26T12:06:02.769 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.769 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:02.769 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.770 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:06:02.770 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:06:02.770 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.879361244000002, 2024-04-26T12:06:02.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095908309999999993, 2024-04-26T12:06:02.770 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:02.770 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:02.770 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:02.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:02.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:06:02.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:02.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:06:02.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:02.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786995+0000", 2024-04-26T12:06:02.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:02.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:02.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787001+0000", 2024-04-26T12:06:02.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5099999999999998e-06 2024-04-26T12:06:02.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:02.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787009+0000", 2024-04-26T12:06:02.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9100000000000005e-06 2024-04-26T12:06:02.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:02.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787019+0000", 2024-04-26T12:06:02.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8109999999999997e-06 2024-04-26T12:06:02.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787136+0000", 2024-04-26T12:06:02.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011749899999999999 2024-04-26T12:06:02.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:02.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787154+0000", 2024-04-26T12:06:02.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8278999999999999e-05 2024-04-26T12:06:02.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:02.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796561+0000", 2024-04-26T12:06:02.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094064379999999996 2024-04-26T12:06:02.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:02.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796587+0000", 2024-04-26T12:06:02.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5856000000000001e-05 2024-04-26T12:06:02.774 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.774 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:02.774 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.774 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-26T12:06:02.774 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:06:02.774 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.878644186999999, 2024-04-26T12:06:02.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096460160000000003, 2024-04-26T12:06:02.775 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:02.775 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:02.775 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:02.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:02.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:06:02.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:02.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:06:02.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:02.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:02.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787712+0000", 2024-04-26T12:06:02.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:02.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:02.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787718+0000", 2024-04-26T12:06:02.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:06:02.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:02.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787727+0000", 2024-04-26T12:06:02.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.123e-06 2024-04-26T12:06:02.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:02.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787734+0000", 2024-04-26T12:06:02.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.391e-06 2024-04-26T12:06:02.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:02.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788867+0000", 2024-04-26T12:06:02.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001133207 2024-04-26T12:06:02.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:02.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788899+0000", 2024-04-26T12:06:02.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1526000000000003e-05 2024-04-26T12:06:02.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:02.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797328+0000", 2024-04-26T12:06:02.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084295389999999998 2024-04-26T12:06:02.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:02.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:02.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:02.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797359+0000", 2024-04-26T12:06:02.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0660999999999997e-05 2024-04-26T12:06:02.779 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.779 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:02.779 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.779 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:02.779 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:02.779 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:06:02.781 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:02.780+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:02.781 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:02.882 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:02.881+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:02.895 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:02.896 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:02.896 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:06:02.896 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:02.905 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:02.989 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:02.988+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:03.048 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:03.049 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:03.049 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:03.049 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:03.049 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:03.058 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:03.084 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:03.083+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:03.185 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:03.184+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:03.203 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:03.204 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:03.204 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:03.204 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:03.204 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.204 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:03.204 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:03.204 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 69.346704858999999, 2024-04-26T12:06:03.204 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:03.204 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:03.204 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.204 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:03.204 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:03.204 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:03.205 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:03.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.205 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:03.205 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.205 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:03.205 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:03.205 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.205 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.205 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:03.205 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:03.205 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.205 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.205 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:03.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:03.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.206 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.206 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.206 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:03.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:03.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:03.206 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.206 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.206 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:03.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:03.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:03.206 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.207 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.207 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.207 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:03.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:03.207 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.207 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.207 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:03.207 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:03.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:03.207 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.207 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.207 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:03.207 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:03.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:03.207 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.208 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.208 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:03.208 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:03.208 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:03.208 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.208 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.208 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:03.208 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:03.208 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:03.208 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.208 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.208 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.208 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:03.208 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:03.208 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.209 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.209 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:03.209 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:03.209 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:03.209 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.209 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.209 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:03.209 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:03.209 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:03.209 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.209 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:03.209 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.209 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.209 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.209 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:03.210 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:03.210 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 69.346598963000005, 2024-04-26T12:06:03.210 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:03.210 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:03.210 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.210 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:03.210 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:03.210 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:03.210 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:03.210 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.210 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:03.210 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.210 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:03.210 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:03.210 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.211 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.211 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:03.211 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:03.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.211 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.211 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:03.211 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:03.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.211 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.211 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:03.211 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:03.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:03.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.212 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.212 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:03.212 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:03.212 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:03.212 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.212 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.212 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.212 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:03.212 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:03.212 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.212 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.212 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:03.212 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:03.212 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:03.213 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.213 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.213 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:03.213 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:03.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:03.214 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.214 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.214 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:03.214 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:03.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:03.214 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.214 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.214 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:03.214 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:03.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:03.214 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.214 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.214 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.215 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:03.215 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:03.215 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.215 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.215 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:03.215 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:03.215 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:03.215 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.215 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.215 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:03.215 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:03.215 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:03.215 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.215 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:03.215 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.216 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:03.216 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:03.216 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 69.346583983000002, 2024-04-26T12:06:03.216 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:03.216 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:03.216 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.216 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:03.216 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:03.216 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:03.216 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:03.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.216 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:03.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:03.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:03.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.217 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.217 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:03.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:03.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.217 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.217 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:03.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:03.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.217 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.217 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.218 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:03.218 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:03.218 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:03.218 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.218 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.218 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:03.218 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:03.218 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:03.218 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.218 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.218 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.218 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:03.218 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:03.218 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.219 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.219 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:03.219 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:03.219 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:03.219 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.219 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.219 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:03.219 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:03.219 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:03.219 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.219 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.219 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:03.219 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:03.219 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:03.220 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.220 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.220 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:03.220 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:03.220 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:03.220 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.220 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.220 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.220 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:03.220 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:03.220 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.220 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.220 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:03.220 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:03.220 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:03.221 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.221 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.221 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:03.221 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:03.221 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:03.221 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.221 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:03.221 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.221 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.221 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.221 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:03.221 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:03.221 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 69.346540107999999, 2024-04-26T12:06:03.221 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:03.221 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:03.222 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.222 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:03.222 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:03.222 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:03.222 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:03.222 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.222 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:03.222 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.222 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:03.222 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:03.222 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.222 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.222 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.222 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:03.222 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:03.223 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.223 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.223 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.223 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:03.223 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:03.223 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.223 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.223 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.223 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:03.223 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:03.223 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:03.223 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.223 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.224 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:03.224 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:03.224 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:03.224 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.224 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.224 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.224 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:03.224 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:03.224 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.224 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.224 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:03.224 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:03.224 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:03.224 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.224 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.224 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:03.225 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:03.225 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:03.225 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.225 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.225 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:03.225 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:03.225 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:03.225 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.225 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.225 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:03.225 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:03.225 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:03.225 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.225 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.226 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.226 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:03.226 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:03.226 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.226 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.226 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:03.226 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:03.226 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:03.226 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.226 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.226 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:03.226 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:03.226 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:03.226 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.226 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:03.227 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.227 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.227 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.227 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:03.227 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:03.227 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 69.346454444000003, 2024-04-26T12:06:03.227 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:03.227 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:03.227 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.227 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:03.227 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:03.227 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:03.227 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:03.227 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.228 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:03.228 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.228 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:03.228 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:03.228 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.228 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.228 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.228 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:03.228 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:03.228 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.228 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.228 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.228 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:03.228 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:03.228 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.229 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.229 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.229 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:03.229 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:03.229 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:03.229 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.229 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.229 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:03.229 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:03.229 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:03.229 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.229 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.229 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.229 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:03.229 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:03.230 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.230 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.230 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:03.230 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:03.230 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:03.230 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.230 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.230 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:03.230 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:03.230 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:03.230 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.230 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.230 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:03.230 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:03.231 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:03.231 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.231 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.231 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:03.231 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:03.231 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:03.231 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.231 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.231 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.231 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:03.231 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:03.231 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.231 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.231 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:03.232 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:03.232 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:03.232 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.232 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.232 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:03.232 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:03.232 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:03.232 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.232 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:03.232 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.232 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.232 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.232 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:03.232 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:03.232 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 59.420550157999998, 2024-04-26T12:06:03.233 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:03.233 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:03.233 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.233 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:03.233 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.233 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:03.233 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:03.233 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.233 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.233 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.233 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:03.233 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:03.233 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.233 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.233 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.234 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:03.234 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:03.234 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:03.234 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.234 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:03.234 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:03.234 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:03.234 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.234 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:03.234 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:03.234 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:03.234 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.235 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.235 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:03.235 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:03.235 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.235 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.235 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:03.235 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:03.235 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:03.235 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.235 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.235 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:03.235 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:03.235 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:03.235 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.235 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.236 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:03.236 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:03.236 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:03.236 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.236 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.236 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:03.236 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:03.236 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:03.236 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.236 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.236 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.236 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:03.236 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:03.236 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.236 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.237 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:03.237 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:03.237 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:03.237 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.237 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.237 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:03.237 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:03.237 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:03.237 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.237 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:03.237 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.237 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.237 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.237 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:03.237 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:03.238 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 59.420514062999999, 2024-04-26T12:06:03.238 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:03.238 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:03.238 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.238 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:03.238 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.238 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:03.238 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:03.238 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.238 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.238 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.238 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:03.238 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:03.238 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.239 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.239 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.239 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:03.239 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:03.239 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:03.239 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.239 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.239 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:03.239 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:03.239 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:03.239 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.240 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:03.240 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:03.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:03.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.240 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.240 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:03.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:03.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.240 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:03.240 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:03.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:03.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:03.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:03.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:03.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:03.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:03.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:03.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:03.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:03.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:03.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.242 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.242 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.242 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:03.242 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:03.242 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.242 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.242 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:03.242 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:03.242 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:03.242 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.242 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.242 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:03.242 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:03.242 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:03.242 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.243 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:03.243 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.243 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.243 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.243 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:03.243 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:03.243 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 59.420476379, 2024-04-26T12:06:03.243 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:03.243 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:03.243 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.243 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:03.243 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.243 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:03.243 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:03.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.244 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:03.244 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:03.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.244 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:03.244 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:03.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.244 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:03.244 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:03.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:03.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:03.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:03.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:03.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:03.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:03.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:03.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:03.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:03.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.246 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:03.246 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:03.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:03.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.246 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:03.246 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:03.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:03.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.246 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:03.247 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:03.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:03.247 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.247 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:03.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:03.247 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:03.247 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:03.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:03.247 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:03.248 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:03.248 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:03.248 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.248 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:03.248 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.248 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.248 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:03.248 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:03.248 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 59.420455038999997, 2024-04-26T12:06:03.248 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:03.248 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:03.248 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.248 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:03.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.249 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:03.249 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:03.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.249 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:03.249 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:03.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.249 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:03.249 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:03.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.249 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:03.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:03.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:03.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:03.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:03.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:03.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:03.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:03.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:03.251 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:03.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:03.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:03.251 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:03.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:03.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:03.251 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:03.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:03.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:03.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:03.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:03.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:03.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:03.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:03.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:03.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:03.253 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.253 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.253 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:03.253 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:03.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:03.253 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.253 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:03.253 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.253 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.253 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.253 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:03.253 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:03.253 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 59.420432773000002, 2024-04-26T12:06:03.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:03.253 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:03.254 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.254 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:03.254 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.254 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:03.254 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:03.254 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.254 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.254 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:03.254 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:03.254 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.254 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.254 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:03.254 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:03.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.255 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.255 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.255 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:03.255 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:03.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:03.255 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.255 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.255 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:03.255 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:03.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:03.255 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.255 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.255 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.255 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:03.256 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:03.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.256 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:03.256 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:03.256 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:03.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.256 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:03.256 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:03.256 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:03.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.256 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:03.256 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:03.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:03.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:03.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:03.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:03.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:03.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:03.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:03.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:03.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:03.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.258 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:03.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:03.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:03.258 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.258 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:03.258 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.258 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:03.258 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:03.258 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 59.420411151000003, 2024-04-26T12:06:03.259 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:03.259 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:03.259 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.259 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:03.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.259 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:03.259 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:03.259 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.259 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.259 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:03.259 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:03.259 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.259 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:03.260 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:03.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:03.260 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:03.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:03.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:03.260 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:03.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:03.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.261 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:03.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:03.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.261 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:03.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:03.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:03.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.261 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:03.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:03.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:03.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:03.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:03.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:03.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:03.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:03.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:03.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:03.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:03.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.263 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:03.263 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:03.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:03.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.263 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:03.263 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:03.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:03.263 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.263 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:03.263 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.263 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:03.263 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:03.264 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 59.420384585000001, 2024-04-26T12:06:03.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:03.264 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:03.264 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.264 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:03.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:03.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:03.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:03.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:03.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:03.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:03.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:03.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:03.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:03.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:03.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:03.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:03.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:03.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:03.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:03.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:03.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:03.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:03.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:03.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:03.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.267 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:03.267 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:03.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:03.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.267 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:03.267 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:03.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:03.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.267 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.267 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:03.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:03.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:03.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:03.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:03.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:03.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:03.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:03.268 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.268 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:03.268 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.269 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:03.269 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:03.269 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 59.420346072999997, 2024-04-26T12:06:03.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:03.269 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:03.269 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.269 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:03.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:03.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:03.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:03.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:03.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:03.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:03.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:03.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:03.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:03.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:03.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:03.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:03.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:03.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:03.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:03.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:03.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:03.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:03.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:03.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:03.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:03.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:03.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:03.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:03.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:03.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:03.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.273 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.273 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:03.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:03.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.273 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:03.273 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:03.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:03.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.273 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:03.273 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:03.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:03.273 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.274 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:03.274 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.274 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:03.274 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:03.274 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 59.420317900000001, 2024-04-26T12:06:03.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:03.274 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:03.274 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.274 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:03.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.274 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:03.274 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:03.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:03.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:03.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:03.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:03.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:03.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:03.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:03.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:03.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:03.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:03.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:03.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:03.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:03.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:03.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:03.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:03.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:03.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:03.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:03.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:03.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:03.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:03.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:03.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:03.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:03.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:03.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:03.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:03.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:03.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:03.279 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:03.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:03.279 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.279 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:03.279 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.279 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:03.279 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:03.279 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 59.420283335999997, 2024-04-26T12:06:03.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:03.279 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:03.279 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.279 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:03.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:03.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:03.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:03.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:03.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:03.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:03.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:03.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:03.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:03.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:03.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:03.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:03.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:03.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:03.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:03.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:03.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:03.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:03.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:03.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:03.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:03.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:03.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:03.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:03.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:03.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:03.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:03.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:03.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:03.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:03.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:03.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:03.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:03.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:03.284 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.284 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:03.284 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.284 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:03.284 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:03.284 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 59.419408556, 2024-04-26T12:06:03.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:03.284 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:03.285 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.285 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:03.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:03.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:03.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:03.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:03.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:03.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:03.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:03.286 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:03.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:03.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:03.286 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:03.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:03.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:03.286 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:03.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:03.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:03.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:03.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:03.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:03.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:03.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:03.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:03.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:03.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:03.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:03.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:03.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:03.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:03.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:03.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:03.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:03.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:03.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:03.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:03.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:03.289 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.289 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:03.289 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.289 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:03.289 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:03.289 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 59.419369596999999, 2024-04-26T12:06:03.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:03.290 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:03.290 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.290 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:03.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.290 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:03.290 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:03.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.290 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:03.290 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:03.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:03.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:03.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:03.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:03.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:03.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:03.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:03.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:03.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:03.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:03.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:03.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:03.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:03.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:03.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:03.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:03.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:03.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:03.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:03.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:03.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:03.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:03.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:03.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:03.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:03.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:03.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:03.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:03.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:03.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:03.294 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.294 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:03.294 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.295 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:03.295 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:03.295 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 59.419334124999999, 2024-04-26T12:06:03.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:03.295 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:03.295 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.295 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:03.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:03.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:03.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:03.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:03.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:03.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:03.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:03.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:03.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:03.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:03.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:03.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:03.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:03.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:03.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:03.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:03.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:03.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:03.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:03.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:03.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:03.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:03.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:03.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:03.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:03.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:03.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:03.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:03.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:03.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:03.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:03.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:03.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:03.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:03.300 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.300 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:03.300 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.300 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:03.300 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:03.300 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 59.419255436, 2024-04-26T12:06:03.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:03.300 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:03.300 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.300 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:03.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:03.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:03.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:03.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:03.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:03.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:03.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:03.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:03.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:03.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:03.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:03.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:03.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:03.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:03.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:03.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:03.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:03.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:03.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:03.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:03.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:03.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:03.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:03.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:03.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:03.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:03.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:03.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:03.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:03.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:03.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:03.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:03.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:03.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:03.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:03.305 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.305 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:03.305 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.305 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:03.305 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:03.305 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 59.419104588000003, 2024-04-26T12:06:03.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:03.306 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:03.306 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:03.306 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:03.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:03.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:03.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:03.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:03.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:03.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:03.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:03.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:03.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:03.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:03.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:03.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:03.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:03.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:03.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:03.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:03.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:03.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:03.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:03.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:03.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:03.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:03.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:03.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:03.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:03.309 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:03.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:03.309 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.309 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:03.309 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.309 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:03.309 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:03.309 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:03.311 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:03.310+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:03.311 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:03.412 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:03.411+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:03.425 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:03.425 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:03.425 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:06:03.425 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:03.435 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:03.513 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:03.513+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:03.538 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:03.538 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:03.538 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:03.538 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:03.538 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:03.547 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:03.613 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:03.612+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:03.650 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:03.650 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:03.650 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:03.650 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:03.650 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.650 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:03.650 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:03.651 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 59.868026022999999, 2024-04-26T12:06:03.651 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:06:03.651 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:03.651 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.651 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:03.651 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.651 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:03.651 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:03.651 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.651 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.651 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.651 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:03.651 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:03.651 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.651 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.652 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.652 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:03.652 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:06:03.652 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:03.652 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.652 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.652 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:03.652 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:06:03.652 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:06:03.652 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.652 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.652 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:03.652 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:06:03.652 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:06:03.652 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:06:03.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:06:03.653 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:03.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:06:03.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:06:03.653 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:03.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:03.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:06:03.653 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.654 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:03.654 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:06:03.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:06:03.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.654 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.654 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:03.654 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:06:03.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:06:03.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.654 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.654 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.654 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:06:03.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:06:03.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.655 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.655 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:03.655 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:06:03.655 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:06:03.655 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.655 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.655 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:03.655 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:06:03.655 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:06:03.655 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.655 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:03.655 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.655 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.655 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.655 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:03.656 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:03.656 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 59.867970702999997, 2024-04-26T12:06:03.656 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:06:03.656 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:03.656 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.656 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:03.656 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.656 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:03.656 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:03.656 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.656 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.656 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.656 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:03.656 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:03.656 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.657 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.657 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.657 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:03.657 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:06:03.657 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:03.657 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.657 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.657 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:03.657 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:06:03.657 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:06:03.657 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.657 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.657 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:03.657 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:06:03.657 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:06:03.658 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.658 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.658 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.658 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:06:03.658 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:06:03.658 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.658 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.658 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:03.658 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:06:03.658 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:06:03.659 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.659 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:03.659 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:06:03.659 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:06:03.659 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.659 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:03.659 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:06:03.659 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:06:03.659 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.659 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:03.659 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:06:03.659 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:06:03.660 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.660 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.660 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.660 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:06:03.660 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:06:03.660 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.660 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.660 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:03.660 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:06:03.660 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:06:03.660 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.660 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.660 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:03.660 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:06:03.661 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:06:03.661 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.661 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:03.661 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.661 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.661 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.661 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:03.661 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:03.661 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 59.867920685000001, 2024-04-26T12:06:03.661 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:06:03.661 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:03.661 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.661 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:03.661 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.662 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:03.662 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:03.662 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.662 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.662 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.662 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:03.662 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:03.662 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.662 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.662 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.662 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:03.662 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:06:03.662 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.662 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.663 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.663 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:03.663 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:06:03.663 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:06:03.663 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.663 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.663 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:03.663 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:06:03.663 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:06:03.663 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.663 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.663 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.663 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:06:03.663 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:06:03.664 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.664 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.664 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:03.664 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:06:03.664 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:06:03.664 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.664 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.664 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:03.664 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:06:03.664 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:06:03.664 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.664 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.664 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:03.664 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:06:03.665 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:06:03.665 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.665 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.665 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:03.665 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:06:03.665 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:06:03.665 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.665 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.665 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.665 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:06:03.665 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:06:03.665 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.665 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.665 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:03.665 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:06:03.666 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:06:03.666 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.666 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.666 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:03.666 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:06:03.666 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:06:03.666 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.666 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:03.666 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.666 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.666 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.666 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:03.666 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:03.666 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 59.867886048000003, 2024-04-26T12:06:03.667 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:06:03.667 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:03.667 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.667 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:03.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.667 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:03.667 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:03.667 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.667 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.667 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:03.667 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:03.667 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.667 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.668 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:03.668 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:06:03.668 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.668 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.668 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.668 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:03.668 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:06:03.668 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:06:03.668 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.668 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.668 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:03.668 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:03.668 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:06:03.668 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.668 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.669 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.669 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:06:03.669 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:06:03.669 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.669 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.669 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:03.669 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:06:03.669 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:06:03.669 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.669 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.669 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:03.669 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:06:03.669 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:06:03.669 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.669 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.670 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:03.670 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:06:03.670 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:06:03.670 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.670 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.670 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.670 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:06:03.670 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:06:03.670 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.670 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.670 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:03.670 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:06:03.670 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:06:03.670 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.671 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.671 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:03.671 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:06:03.671 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:06:03.671 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.671 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.671 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:03.671 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:06:03.671 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:06:03.671 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.671 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:03.671 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.671 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.671 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.672 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:03.672 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:03.672 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 59.867847535999999, 2024-04-26T12:06:03.672 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:06:03.672 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:03.672 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.672 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:03.672 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.672 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:03.672 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:03.672 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.672 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.672 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.672 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:03.672 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:03.673 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.673 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.673 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.673 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:03.673 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:03.673 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:03.673 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.673 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.673 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:03.673 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:03.673 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:06:03.673 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.673 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.673 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:03.673 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:06:03.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:06:03.674 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.674 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.674 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:06:03.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:06:03.674 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.674 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:03.674 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:06:03.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:06:03.674 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.674 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:03.675 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:06:03.675 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:06:03.675 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.675 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.675 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:03.675 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:06:03.675 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:06:03.675 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.675 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.675 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.675 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:06:03.675 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:06:03.675 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.675 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.675 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:03.676 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:06:03.676 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:06:03.676 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.676 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.676 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:03.676 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:06:03.676 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:06:03.676 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.676 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.676 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:03.676 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:06:03.676 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:06:03.676 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.676 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:03.677 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.677 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.677 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.677 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:03.677 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:03.677 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 59.867817213000002, 2024-04-26T12:06:03.677 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:06:03.677 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:03.677 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.677 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:03.677 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.677 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:03.677 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:03.677 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.677 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.678 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.678 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:03.678 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:03.678 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.678 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.678 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.678 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:03.678 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:06:03.678 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.678 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.678 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.678 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:03.678 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:06:03.678 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:06:03.679 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.679 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.679 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:03.679 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:06:03.679 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:06:03.679 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.679 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.679 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.679 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:06:03.679 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:06:03.679 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.679 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.679 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:03.679 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:06:03.679 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:06:03.680 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.680 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.680 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:03.680 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:06:03.680 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:06:03.680 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.680 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.680 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:03.680 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:06:03.680 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:06:03.680 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.680 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.680 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:03.680 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:06:03.680 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:06:03.681 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.681 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.681 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.681 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:06:03.681 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:06:03.681 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.681 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.681 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:03.681 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:06:03.681 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:06:03.681 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.681 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.681 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:03.681 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:06:03.682 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:06:03.682 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.682 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:03.682 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.682 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.682 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.682 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:03.682 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:03.682 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 59.867790511000003, 2024-04-26T12:06:03.682 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:06:03.682 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:03.682 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:03.682 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:03.682 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.682 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:03.683 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:03.683 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.683 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.683 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.683 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:03.683 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:03.683 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.683 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.683 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.683 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:03.683 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:03.683 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.683 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.683 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.684 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:03.684 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:06:03.684 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:06:03.684 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.684 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.684 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:03.684 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:06:03.684 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:06:03.684 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.684 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.684 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.684 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:06:03.684 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:06:03.684 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.685 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.685 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:03.685 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:06:03.685 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:06:03.685 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.685 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.685 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:03.685 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:06:03.685 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:06:03.685 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.685 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.685 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:03.685 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:06:03.685 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:06:03.685 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.686 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:03.686 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.686 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.686 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.686 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:03.686 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:03.686 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 59.867748220999999, 2024-04-26T12:06:03.686 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:06:03.686 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:03.686 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:03.686 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:03.686 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.686 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:03.686 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:03.686 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.687 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.687 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.687 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:03.687 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:03.687 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.687 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.687 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.687 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:03.687 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:03.687 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.687 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.687 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.687 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:03.687 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:06:03.687 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:06:03.688 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.688 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.688 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:03.688 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:06:03.688 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:06:03.688 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.688 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.688 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.688 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:06:03.688 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:06:03.688 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.688 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.688 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:03.688 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:06:03.689 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:06:03.689 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.689 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.689 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:03.689 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:06:03.689 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:06:03.689 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.689 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.689 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:03.689 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:06:03.689 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:06:03.689 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.689 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:03.689 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.689 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.690 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.690 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:03.690 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:03.690 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 59.867720143, 2024-04-26T12:06:03.690 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:06:03.690 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:03.690 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:03.690 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:03.690 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.690 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:03.690 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:03.690 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.690 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.690 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.691 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:03.691 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:03.691 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.691 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.691 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.691 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:03.691 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:06:03.691 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.691 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.691 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.691 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:03.691 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:06:03.691 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:06:03.691 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.692 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.692 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:03.692 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:06:03.692 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:06:03.692 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.692 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.692 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.692 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:06:03.692 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:06:03.692 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.692 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.692 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:03.692 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:06:03.692 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:06:03.692 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.693 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.693 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:03.693 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:06:03.693 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:06:03.693 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.693 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.693 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:03.693 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:06:03.693 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:06:03.693 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.693 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:03.693 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.693 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.693 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.693 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:03.694 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:03.694 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 59.861724793, 2024-04-26T12:06:03.694 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:06:03.694 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:03.694 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.694 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:03.694 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.694 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:03.694 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:03.694 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.694 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.694 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.694 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:03.694 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:03.695 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.695 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.695 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.695 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:03.695 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:06:03.695 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.695 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.695 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.695 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:03.695 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:06:03.695 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:06:03.695 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.695 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.695 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:03.696 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:06:03.696 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:06:03.696 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.696 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.696 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.696 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:06:03.696 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:06:03.696 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.696 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.696 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:03.696 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:06:03.696 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:06:03.696 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.696 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.696 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:03.697 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:06:03.697 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:06:03.697 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.697 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.697 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:03.697 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:06:03.697 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:06:03.697 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.697 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.697 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:03.697 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:06:03.697 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:06:03.697 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.697 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:03.698 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.698 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.698 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.698 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:03.698 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:03.698 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 59.861655827, 2024-04-26T12:06:03.698 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:06:03.698 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:03.698 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.698 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:03.698 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.698 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:03.698 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:03.699 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.699 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.699 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.699 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:03.699 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:03.699 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.699 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.699 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.699 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:03.699 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:06:03.699 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.699 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.699 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.699 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:03.699 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:06:03.700 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:06:03.700 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.700 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.700 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:03.700 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:06:03.700 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:06:03.700 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.700 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.700 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.700 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:06:03.700 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:06:03.700 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.700 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.700 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:03.700 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:06:03.701 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:06:03.701 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.701 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.701 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:03.701 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:03.701 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:06:03.701 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.701 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.701 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:03.701 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:06:03.701 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:06:03.701 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.701 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.701 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:03.702 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:06:03.702 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:06:03.702 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.702 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:03.702 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.702 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.702 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.702 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:03.702 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:03.702 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 59.861161463999998, 2024-04-26T12:06:03.702 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:06:03.702 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:03.702 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.702 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:03.703 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.703 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:03.703 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:03.703 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.703 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.703 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.703 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:03.703 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:03.703 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.703 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.703 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.703 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:03.703 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:03.703 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.703 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.704 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.704 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:03.704 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:06:03.704 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:06:03.704 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.704 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.704 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:03.704 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:06:03.704 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:06:03.704 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.704 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.704 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.704 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:06:03.704 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:06:03.705 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.705 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.705 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:03.705 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:06:03.705 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:06:03.705 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.705 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.705 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:03.705 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:06:03.705 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:06:03.705 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.705 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.705 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:03.705 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:06:03.706 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:06:03.706 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.706 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.706 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:03.706 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:06:03.706 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:06:03.706 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.706 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:03.706 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.706 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.706 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.706 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:03.706 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:03.706 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 59.861123198999998, 2024-04-26T12:06:03.706 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:06:03.707 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:03.707 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.707 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:03.707 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.707 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:03.707 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:03.707 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.707 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.707 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.707 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:03.707 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:03.707 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.707 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.707 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.708 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:03.708 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:03.708 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.708 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.708 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.708 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:03.708 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:06:03.708 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:06:03.708 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.708 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.708 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:03.708 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:06:03.708 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:06:03.708 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.708 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.709 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.709 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:06:03.709 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:06:03.709 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.709 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.709 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:03.709 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:06:03.709 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:06:03.709 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.709 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.709 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:03.709 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:06:03.709 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:06:03.709 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.709 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.710 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:03.710 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:06:03.710 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:06:03.710 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.710 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.710 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:03.710 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:06:03.710 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:06:03.710 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.710 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:03.710 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.710 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.710 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.710 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:06:03.711 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:03.711 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 59.860443314000001, 2024-04-26T12:06:03.711 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:06:03.711 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:03.711 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:03.711 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:03.711 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.711 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:03.711 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:03.711 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.711 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.711 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.711 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:03.711 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:03.711 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.712 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.712 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.712 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:03.712 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:03.712 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.712 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.712 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.712 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:03.712 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:06:03.712 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:06:03.712 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.712 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.712 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:03.712 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:06:03.712 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:06:03.713 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.713 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.713 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.713 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:06:03.713 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:06:03.713 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.713 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.713 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:03.713 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:06:03.713 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:06:03.713 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.713 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.713 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:03.713 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:06:03.713 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:06:03.714 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.714 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:03.714 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.714 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.714 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.714 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:03.714 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:03.714 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 59.860414134999999, 2024-04-26T12:06:03.714 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:06:03.714 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:03.714 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:03.714 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:03.714 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.714 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:03.714 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:03.715 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.715 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.715 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.715 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:03.715 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:03.715 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.715 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.715 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.715 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:03.715 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:06:03.715 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.715 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.715 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.715 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:03.715 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:06:03.716 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:06:03.716 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.716 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.716 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:03.716 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:06:03.716 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:06:03.716 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.716 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.716 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.716 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:06:03.716 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:06:03.716 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.716 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.716 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:03.716 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:06:03.717 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:06:03.717 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.717 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.717 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:03.717 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:06:03.717 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:06:03.717 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.717 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.717 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:03.717 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:06:03.717 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:06:03.717 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.717 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:03.717 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.717 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.718 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.718 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:03.718 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:03.718 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 59.860382324, 2024-04-26T12:06:03.718 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:06:03.718 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:03.718 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:03.718 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:03.718 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.718 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:03.718 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:03.718 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.718 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.718 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.719 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:03.719 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:03.719 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.719 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.719 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.719 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:03.719 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:03.719 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:03.719 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.719 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.719 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:03.719 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:06:03.719 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:06:03.719 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.720 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.720 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:03.720 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:06:03.720 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:06:03.720 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.720 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.720 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.720 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:06:03.720 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:06:03.720 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.720 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.720 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:03.720 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:06:03.720 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:06:03.720 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.721 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.721 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:03.721 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:06:03.721 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:06:03.721 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.721 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.721 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:03.721 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:06:03.721 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:06:03.721 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.721 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:03.721 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.721 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.721 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.721 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:03.722 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:03.722 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 59.860360968000002, 2024-04-26T12:06:03.722 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:06:03.722 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:03.722 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:03.722 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:03.722 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.722 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:03.722 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:03.722 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.722 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.722 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.722 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:03.722 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:03.723 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.723 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.723 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.723 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:03.723 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:03.723 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:03.723 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.723 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.723 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:03.723 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:06:03.723 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:06:03.723 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.723 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.723 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:03.723 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:06:03.724 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:06:03.724 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.724 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.724 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.724 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:06:03.724 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:06:03.724 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.724 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.724 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:03.724 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:06:03.724 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:06:03.724 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.724 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.724 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:03.724 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:06:03.725 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:06:03.725 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.725 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.725 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:03.725 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:06:03.725 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:06:03.725 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.725 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:03.725 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.725 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.725 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.725 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:06:03.725 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:03.725 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 59.860332515000003, 2024-04-26T12:06:03.725 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:06:03.726 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:03.726 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:03.726 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:03.726 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.726 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:03.726 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:03.726 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.726 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.726 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.726 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:03.726 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:03.726 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.726 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.726 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.727 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:03.727 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:03.727 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:03.727 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.727 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.727 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:03.727 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:06:03.727 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:06:03.727 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.727 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.727 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:03.727 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:06:03.727 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:06:03.727 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.727 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.728 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.728 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:06:03.728 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:06:03.728 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.728 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.728 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:03.728 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:06:03.728 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:06:03.728 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.728 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.728 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:03.728 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:06:03.728 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:06:03.728 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.728 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:03.729 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.729 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.729 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.729 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:06:03.729 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:03.729 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 59.859610709000002, 2024-04-26T12:06:03.729 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:06:03.729 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:03.729 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:03.729 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:03.729 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.729 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:03.729 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:03.729 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.730 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.730 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.730 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:03.730 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:03.730 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.730 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.730 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.730 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:03.730 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:06:03.730 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:03.730 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.730 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.730 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:03.730 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:06:03.731 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:06:03.731 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.731 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.731 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:03.731 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:06:03.731 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:06:03.731 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.731 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.731 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.731 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:06:03.731 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:06:03.731 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.731 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.731 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:03.731 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:06:03.732 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:06:03.732 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.732 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.732 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:03.732 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:06:03.732 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:06:03.732 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.732 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:03.732 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.732 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.732 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.732 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:06:03.732 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:03.732 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 54.142684105999997, 2024-04-26T12:06:03.732 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:06:03.733 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:03.733 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:03.733 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:03.733 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.733 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:03.733 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:03.733 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.733 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.733 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.733 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:03.733 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:03.733 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:03.733 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.733 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.734 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:03.734 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:06:03.734 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:06:03.734 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.734 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.734 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:03.734 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:06:03.734 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:06:03.734 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.734 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.734 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:03.734 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:06:03.734 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:06:03.734 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.734 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.735 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:03.735 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:06:03.735 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:06:03.735 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.735 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.735 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:03.735 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:06:03.735 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:06:03.735 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.735 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.735 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:03.735 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:06:03.735 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:06:03.735 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.736 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.736 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:03.736 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:06:03.736 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:06:03.736 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.736 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.736 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:03.736 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:06:03.736 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:06:03.736 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.736 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.736 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:03.736 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:06:03.736 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:06:03.736 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.737 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.737 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:03.737 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:06:03.737 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:06:03.737 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:03.737 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:03.737 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:03.737 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:06:03.737 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:06:03.737 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.737 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:03.737 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.737 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:03.737 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:03.738 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:03.739 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:06:03.740 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:03.738+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:03.839 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:03.838+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:03.853 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:06:03.853 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:06:03.853 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-04-26T12:06:03.853 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:06:03.862 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:06:03.942 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:06:03.946 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:03.945+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:04.004 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:06:04.004 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:06:04.004 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T12:06:04.004 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T12:06:04.004 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:06:04.013 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:06:04.041 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:04.040+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:04.141 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:04.140+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:04.157 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:06:04.157 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T12:06:04.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T12:06:04.157 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T12:06:04.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.157 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:04.157 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:04.157 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.374620131, 2024-04-26T12:06:04.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017255857999999999, 2024-04-26T12:06:04.158 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:04.158 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:04.158 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:04.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:04.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:04.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:04.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:04.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:04.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780340+0000", 2024-04-26T12:06:04.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:04.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:04.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780351+0000", 2024-04-26T12:06:04.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0898e-05 2024-04-26T12:06:04.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:04.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:04.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1671999999999999e-05 2024-04-26T12:06:04.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:04.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780374+0000", 2024-04-26T12:06:04.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1117999999999999e-05 2024-04-26T12:06:04.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780423+0000", 2024-04-26T12:06:04.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9066000000000001e-05 2024-04-26T12:06:04.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:06:04.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780428+0000", 2024-04-26T12:06:04.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1320000000000002e-06 2024-04-26T12:06:04.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788902+0000", 2024-04-26T12:06:04.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084738560000000001 2024-04-26T12:06:04.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:04.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789167+0000", 2024-04-26T12:06:04.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026521100000000001 2024-04-26T12:06:04.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:04.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789279+0000", 2024-04-26T12:06:04.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111616 2024-04-26T12:06:04.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:04.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792335+0000", 2024-04-26T12:06:04.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030556419999999999 2024-04-26T12:06:04.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:06:04.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797519+0000", 2024-04-26T12:06:04.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051841550000000002 2024-04-26T12:06:04.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:04.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797559+0000", 2024-04-26T12:06:04.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0451999999999998e-05 2024-04-26T12:06:04.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:04.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797598+0000", 2024-04-26T12:06:04.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8500000000000001e-05 2024-04-26T12:06:04.163 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.163 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:04.163 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.163 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:04.163 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:04.163 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.374571824, 2024-04-26T12:06:04.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017668725, 2024-04-26T12:06:04.164 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:04.164 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:04.164 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:04.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:04.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:04.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:04.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:04.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:04.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:06:04.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:04.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:04.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780395+0000", 2024-04-26T12:06:04.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.198e-06 2024-04-26T12:06:04.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:04.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780402+0000", 2024-04-26T12:06:04.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:06:04.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:04.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780408+0000", 2024-04-26T12:06:04.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:06:04.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780481+0000", 2024-04-26T12:06:04.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3239999999999997e-05 2024-04-26T12:06:04.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:06:04.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780485+0000", 2024-04-26T12:06:04.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4039999999999999e-06 2024-04-26T12:06:04.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789518+0000", 2024-04-26T12:06:04.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090335480000000006 2024-04-26T12:06:04.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:04.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789585+0000", 2024-04-26T12:06:04.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6469000000000003e-05 2024-04-26T12:06:04.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:04.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789699+0000", 2024-04-26T12:06:04.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114613 2024-04-26T12:06:04.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:04.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793308+0000", 2024-04-26T12:06:04.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036088520000000001 2024-04-26T12:06:04.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:06:04.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797887+0000", 2024-04-26T12:06:04.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0045792790000000003 2024-04-26T12:06:04.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:04.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797955+0000", 2024-04-26T12:06:04.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T12:06:04.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:04.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798059+0000", 2024-04-26T12:06:04.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103874 2024-04-26T12:06:04.169 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.169 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:04.169 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.169 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:04.169 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:06:04.169 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.374541551999997, 2024-04-26T12:06:04.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017735145000000001, 2024-04-26T12:06:04.169 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:04.169 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:04.169 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:04.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:04.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:06:04.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:04.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:06:04.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:04.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780420+0000", 2024-04-26T12:06:04.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:04.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:04.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780424+0000", 2024-04-26T12:06:04.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4519999999999999e-06 2024-04-26T12:06:04.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:04.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780431+0000", 2024-04-26T12:06:04.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0690000000000004e-06 2024-04-26T12:06:04.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:04.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780438+0000", 2024-04-26T12:06:04.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5719999999999999e-06 2024-04-26T12:06:04.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780468+0000", 2024-04-26T12:06:04.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.993e-05 2024-04-26T12:06:04.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:06:04.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780472+0000", 2024-04-26T12:06:04.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-04-26T12:06:04.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789916+0000", 2024-04-26T12:06:04.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094434940000000002 2024-04-26T12:06:04.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:04.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790004+0000", 2024-04-26T12:06:04.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8085999999999997e-05 2024-04-26T12:06:04.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:04.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790125+0000", 2024-04-26T12:06:04.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012186200000000001 2024-04-26T12:06:04.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:04.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793402+0000", 2024-04-26T12:06:04.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00327685 2024-04-26T12:06:04.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:06:04.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798068+0000", 2024-04-26T12:06:04.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046652150000000003 2024-04-26T12:06:04.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:04.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798108+0000", 2024-04-26T12:06:04.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0911000000000002e-05 2024-04-26T12:06:04.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:04.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798156+0000", 2024-04-26T12:06:04.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7128e-05 2024-04-26T12:06:04.175 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.175 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:04.175 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.175 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:04.175 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:06:04.175 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.374518533, 2024-04-26T12:06:04.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017792624, 2024-04-26T12:06:04.175 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:04.175 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:04.175 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:04.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:04.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:06:04.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:04.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:06:04.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:04.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780443+0000", 2024-04-26T12:06:04.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:04.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:04.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780447+0000", 2024-04-26T12:06:04.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8519999999999997e-06 2024-04-26T12:06:04.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:04.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780453+0000", 2024-04-26T12:06:04.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2999999999999998e-06 2024-04-26T12:06:04.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:04.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:04.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0760000000000002e-06 2024-04-26T12:06:04.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780502+0000", 2024-04-26T12:06:04.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4079999999999998e-05 2024-04-26T12:06:04.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:06:04.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:06:04.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5450000000000002e-06 2024-04-26T12:06:04.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790390+0000", 2024-04-26T12:06:04.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098850759999999996 2024-04-26T12:06:04.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:04.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790447+0000", 2024-04-26T12:06:04.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6752999999999997e-05 2024-04-26T12:06:04.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:04.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790547+0000", 2024-04-26T12:06:04.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100344 2024-04-26T12:06:04.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:04.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793864+0000", 2024-04-26T12:06:04.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033169749999999998 2024-04-26T12:06:04.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:06:04.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798164+0000", 2024-04-26T12:06:04.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043000690000000001 2024-04-26T12:06:04.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:04.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798204+0000", 2024-04-26T12:06:04.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9478999999999999e-05 2024-04-26T12:06:04.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:04.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798236+0000", 2024-04-26T12:06:04.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2478999999999999e-05 2024-04-26T12:06:04.180 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.180 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:04.180 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.181 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:04.181 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:06:04.181 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.374478189999998, 2024-04-26T12:06:04.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016989500000000001, 2024-04-26T12:06:04.181 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:04.181 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:04.181 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:04.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:04.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:06:04.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:04.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780484+0000", 2024-04-26T12:06:04.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:04.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780483+0000", 2024-04-26T12:06:04.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:04.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:04.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780488+0000", 2024-04-26T12:06:04.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6260000000000003e-06 2024-04-26T12:06:04.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:04.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780499+0000", 2024-04-26T12:06:04.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1236000000000001e-05 2024-04-26T12:06:04.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:04.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:06:04.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4569999999999996e-06 2024-04-26T12:06:04.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780529+0000", 2024-04-26T12:06:04.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4579e-05 2024-04-26T12:06:04.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:06:04.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780532+0000", 2024-04-26T12:06:04.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.74e-06 2024-04-26T12:06:04.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788868+0000", 2024-04-26T12:06:04.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0083357650000000002 2024-04-26T12:06:04.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:04.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789142+0000", 2024-04-26T12:06:04.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027472 2024-04-26T12:06:04.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:04.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789241+0000", 2024-04-26T12:06:04.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8394999999999996e-05 2024-04-26T12:06:04.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:04.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792096+0000", 2024-04-26T12:06:04.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002855677 2024-04-26T12:06:04.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:06:04.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797379+0000", 2024-04-26T12:06:04.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052822379999999999 2024-04-26T12:06:04.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:04.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797433+0000", 2024-04-26T12:06:04.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4109e-05 2024-04-26T12:06:04.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:04.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797473+0000", 2024-04-26T12:06:04.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0533e-05 2024-04-26T12:06:04.187 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.187 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:04.187 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.187 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:04.187 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:06:04.187 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.374438576000003, 2024-04-26T12:06:04.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017295965, 2024-04-26T12:06:04.187 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:04.187 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:04.187 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:04.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:04.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:06:04.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:04.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780523+0000", 2024-04-26T12:06:04.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:04.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780513+0000", 2024-04-26T12:06:04.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999895 2024-04-26T12:06:04.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:04.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780528+0000", 2024-04-26T12:06:04.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5089000000000001e-05 2024-04-26T12:06:04.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:04.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780537+0000", 2024-04-26T12:06:04.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8400000000000001e-06 2024-04-26T12:06:04.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:04.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780544+0000", 2024-04-26T12:06:04.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.917e-06 2024-04-26T12:06:04.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780571+0000", 2024-04-26T12:06:04.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7032000000000001e-05 2024-04-26T12:06:04.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:06:04.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780574+0000", 2024-04-26T12:06:04.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:06:04.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789436+0000", 2024-04-26T12:06:04.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088622240000000001 2024-04-26T12:06:04.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:04.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789525+0000", 2024-04-26T12:06:04.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8549999999999998e-05 2024-04-26T12:06:04.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:04.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789642+0000", 2024-04-26T12:06:04.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011772100000000001 2024-04-26T12:06:04.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:04.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.792129+0000", 2024-04-26T12:06:04.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024871709999999998 2024-04-26T12:06:04.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:06:04.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797732+0000", 2024-04-26T12:06:04.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056027580000000002 2024-04-26T12:06:04.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:04.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797777+0000", 2024-04-26T12:06:04.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4620999999999999e-05 2024-04-26T12:06:04.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:04.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797819+0000", 2024-04-26T12:06:04.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2536000000000001e-05 2024-04-26T12:06:04.193 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.193 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:04.193 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.193 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:04.193 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:06:04.193 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.374409626000002, 2024-04-26T12:06:04.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017840163999999999, 2024-04-26T12:06:04.193 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:04.193 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:04.193 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:04.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:04.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:06:04.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:04.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:06:04.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:04.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780552+0000", 2024-04-26T12:06:04.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:04.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:04.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:06:04.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5419999999999999e-06 2024-04-26T12:06:04.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:04.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780563+0000", 2024-04-26T12:06:04.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:06:04.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:04.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780569+0000", 2024-04-26T12:06:04.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1479999999999997e-06 2024-04-26T12:06:04.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780594+0000", 2024-04-26T12:06:04.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5585e-05 2024-04-26T12:06:04.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:06:04.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780596+0000", 2024-04-26T12:06:04.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2630000000000002e-06 2024-04-26T12:06:04.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.789932+0000", 2024-04-26T12:06:04.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093360479999999996 2024-04-26T12:06:04.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:04.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790070+0000", 2024-04-26T12:06:04.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013771399999999999 2024-04-26T12:06:04.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:04.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.790219+0000", 2024-04-26T12:06:04.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014872299999999999 2024-04-26T12:06:04.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:04.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.793632+0000", 2024-04-26T12:06:04.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003413368 2024-04-26T12:06:04.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T12:06:04.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798244+0000", 2024-04-26T12:06:04.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046113819999999998 2024-04-26T12:06:04.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:04.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798361+0000", 2024-04-26T12:06:04.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117726 2024-04-26T12:06:04.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:04.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.798393+0000", 2024-04-26T12:06:04.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1099999999999997e-05 2024-04-26T12:06:04.199 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.199 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:04.199 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.199 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:04.199 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:06:04.199 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.374384700999997, 2024-04-26T12:06:04.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016645943, 2024-04-26T12:06:04.199 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:04.199 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:06:04.199 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:04.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:04.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:06:04.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:04.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:06:04.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:04.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780577+0000", 2024-04-26T12:06:04.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:04.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:04.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780580+0000", 2024-04-26T12:06:04.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1549999999999999e-06 2024-04-26T12:06:04.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:04.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780588+0000", 2024-04-26T12:06:04.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:06:04.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:04.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780593+0000", 2024-04-26T12:06:04.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2399999999999998e-06 2024-04-26T12:06:04.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780628+0000", 2024-04-26T12:06:04.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5426000000000003e-05 2024-04-26T12:06:04.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:06:04.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780632+0000", 2024-04-26T12:06:04.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:06:04.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788288+0000", 2024-04-26T12:06:04.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076555879999999996 2024-04-26T12:06:04.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:04.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788570+0000", 2024-04-26T12:06:04.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028233700000000002 2024-04-26T12:06:04.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:04.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797223+0000", 2024-04-26T12:06:04.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086529150000000006 2024-04-26T12:06:04.203 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.203 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:04.203 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.203 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:04.203 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:06:04.204 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.374360732, 2024-04-26T12:06:04.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016536068000000001, 2024-04-26T12:06:04.204 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:04.204 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T12:06:04.204 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:04.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:04.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:06:04.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:04.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:06:04.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:04.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780601+0000", 2024-04-26T12:06:04.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:04.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:04.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780609+0000", 2024-04-26T12:06:04.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8280000000000003e-06 2024-04-26T12:06:04.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:04.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780616+0000", 2024-04-26T12:06:04.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4939999999999997e-06 2024-04-26T12:06:04.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:04.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780621+0000", 2024-04-26T12:06:04.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6040000000000003e-06 2024-04-26T12:06:04.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780647+0000", 2024-04-26T12:06:04.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6441999999999999e-05 2024-04-26T12:06:04.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T12:06:04.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.780650+0000", 2024-04-26T12:06:04.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4430000000000002e-06 2024-04-26T12:06:04.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788163+0000", 2024-04-26T12:06:04.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007513774 2024-04-26T12:06:04.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:04.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788307+0000", 2024-04-26T12:06:04.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014374400000000001 2024-04-26T12:06:04.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:04.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797137+0000", 2024-04-26T12:06:04.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088302160000000001 2024-04-26T12:06:04.207 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.208 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:04.208 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.208 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:04.208 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:06:04.208 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.371484459999998, 2024-04-26T12:06:04.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012911448000000001, 2024-04-26T12:06:04.208 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:04.208 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:04.208 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:04.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:04.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:06:04.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:04.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783478+0000", 2024-04-26T12:06:04.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:04.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783477+0000", 2024-04-26T12:06:04.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:04.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:04.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783482+0000", 2024-04-26T12:06:04.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5709999999999999e-06 2024-04-26T12:06:04.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:04.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783491+0000", 2024-04-26T12:06:04.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3610000000000007e-06 2024-04-26T12:06:04.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:04.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783498+0000", 2024-04-26T12:06:04.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4209999999999998e-06 2024-04-26T12:06:04.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786045+0000", 2024-04-26T12:06:04.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0025465739999999998 2024-04-26T12:06:04.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:04.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786061+0000", 2024-04-26T12:06:04.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6348999999999999e-05 2024-04-26T12:06:04.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:04.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796342+0000", 2024-04-26T12:06:04.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010280643000000001 2024-04-26T12:06:04.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:04.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796389+0000", 2024-04-26T12:06:04.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6912000000000001e-05 2024-04-26T12:06:04.212 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.212 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:04.212 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.212 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:04.212 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:06:04.212 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.371456154000001, 2024-04-26T12:06:04.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013376469, 2024-04-26T12:06:04.212 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:04.213 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:04.213 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:04.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:04.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:06:04.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:04.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:06:04.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:04.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783506+0000", 2024-04-26T12:06:04.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:04.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:04.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783516+0000", 2024-04-26T12:06:04.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.041e-05 2024-04-26T12:06:04.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:04.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783523+0000", 2024-04-26T12:06:04.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5749999999999997e-06 2024-04-26T12:06:04.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:04.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783528+0000", 2024-04-26T12:06:04.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5029999999999997e-06 2024-04-26T12:06:04.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787662+0000", 2024-04-26T12:06:04.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041336230000000003 2024-04-26T12:06:04.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:04.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787687+0000", 2024-04-26T12:06:04.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5769999999999999e-05 2024-04-26T12:06:04.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:04.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796817+0000", 2024-04-26T12:06:04.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091296750000000003 2024-04-26T12:06:04.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:04.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796882+0000", 2024-04-26T12:06:04.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5180999999999998e-05 2024-04-26T12:06:04.216 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.216 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:04.216 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.216 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:04.216 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:06:04.216 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.371387613000003, 2024-04-26T12:06:04.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013457291999999999, 2024-04-26T12:06:04.217 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:04.217 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:04.217 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:04.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:04.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:06:04.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:04.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:06:04.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:04.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783574+0000", 2024-04-26T12:06:04.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:04.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:04.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783578+0000", 2024-04-26T12:06:04.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.659e-06 2024-04-26T12:06:04.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:04.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783584+0000", 2024-04-26T12:06:04.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:06:04.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:04.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.783588+0000", 2024-04-26T12:06:04.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6190000000000002e-06 2024-04-26T12:06:04.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787834+0000", 2024-04-26T12:06:04.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042460529999999996 2024-04-26T12:06:04.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:04.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787854+0000", 2024-04-26T12:06:04.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9658999999999999e-05 2024-04-26T12:06:04.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:04.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:04.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009107604 2024-04-26T12:06:04.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:04.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797032+0000", 2024-04-26T12:06:04.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9987000000000006e-05 2024-04-26T12:06:04.220 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.220 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:04.220 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.220 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:04.220 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:06:04.221 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.369541234000003, 2024-04-26T12:06:04.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011003015999999999, 2024-04-26T12:06:04.221 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:04.221 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:04.221 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:04.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:04.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:06:04.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:04.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785421+0000", 2024-04-26T12:06:04.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:04.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785420+0000", 2024-04-26T12:06:04.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:04.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:04.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785427+0000", 2024-04-26T12:06:04.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:06:04.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:04.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785438+0000", 2024-04-26T12:06:04.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069e-05 2024-04-26T12:06:04.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:04.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785457+0000", 2024-04-26T12:06:04.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8617000000000001e-05 2024-04-26T12:06:04.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786628+0000", 2024-04-26T12:06:04.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001171418 2024-04-26T12:06:04.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:04.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786651+0000", 2024-04-26T12:06:04.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3289e-05 2024-04-26T12:06:04.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:04.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796393+0000", 2024-04-26T12:06:04.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097413269999999993 2024-04-26T12:06:04.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:04.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796424+0000", 2024-04-26T12:06:04.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1188e-05 2024-04-26T12:06:04.224 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.224 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:04.224 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.224 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:06:04.225 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:06:04.225 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.368994487999998, 2024-04-26T12:06:04.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010561432000000001, 2024-04-26T12:06:04.225 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:04.225 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:04.225 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:04.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:04.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:06:04.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:04.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:06:04.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:04.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785967+0000", 2024-04-26T12:06:04.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:04.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:04.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785973+0000", 2024-04-26T12:06:04.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4910000000000002e-06 2024-04-26T12:06:04.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:04.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785991+0000", 2024-04-26T12:06:04.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7663e-05 2024-04-26T12:06:04.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:04.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.785998+0000", 2024-04-26T12:06:04.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1239999999999999e-06 2024-04-26T12:06:04.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786792+0000", 2024-04-26T12:06:04.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079334800000000003 2024-04-26T12:06:04.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:04.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786810+0000", 2024-04-26T12:06:04.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8746999999999999e-05 2024-04-26T12:06:04.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:04.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796500+0000", 2024-04-26T12:06:04.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096897619999999993 2024-04-26T12:06:04.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:04.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796529+0000", 2024-04-26T12:06:04.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8873999999999998e-05 2024-04-26T12:06:04.228 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.228 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:04.228 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.229 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:04.229 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:06:04.229 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.368915401999999, 2024-04-26T12:06:04.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010219911, 2024-04-26T12:06:04.229 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:04.229 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:04.229 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:04.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:04.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:06:04.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:04.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786047+0000", 2024-04-26T12:06:04.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:04.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786046+0000", 2024-04-26T12:06:04.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:04.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:04.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786053+0000", 2024-04-26T12:06:04.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0360000000000001e-06 2024-04-26T12:06:04.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:04.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786064+0000", 2024-04-26T12:06:04.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1202999999999999e-05 2024-04-26T12:06:04.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:04.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786091+0000", 2024-04-26T12:06:04.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6859000000000002e-05 2024-04-26T12:06:04.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786212+0000", 2024-04-26T12:06:04.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120975 2024-04-26T12:06:04.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:04.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786236+0000", 2024-04-26T12:06:04.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4358999999999998e-05 2024-04-26T12:06:04.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:04.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796236+0000", 2024-04-26T12:06:04.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099998050000000005 2024-04-26T12:06:04.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:04.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796266+0000", 2024-04-26T12:06:04.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0278e-05 2024-04-26T12:06:04.232 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.232 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:04.232 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.233 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:3 3.14 e17/15 3:287034c4:::1.00000000.inode:head v 17'4, mlcod=0'0)", 2024-04-26T12:06:04.233 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:06:04.233 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.368126441000001, 2024-04-26T12:06:04.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009764712, 2024-04-26T12:06:04.233 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:04.233 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:04.233 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:04.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:04.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:06:04.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:04.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786836+0000", 2024-04-26T12:06:04.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:04.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786835+0000", 2024-04-26T12:06:04.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T12:06:04.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:04.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786844+0000", 2024-04-26T12:06:04.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6500000000000008e-06 2024-04-26T12:06:04.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:04.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786855+0000", 2024-04-26T12:06:04.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0932e-05 2024-04-26T12:06:04.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:04.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786864+0000", 2024-04-26T12:06:04.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2150000000000007e-06 2024-04-26T12:06:04.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787242+0000", 2024-04-26T12:06:04.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037708300000000001 2024-04-26T12:06:04.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:04.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787259+0000", 2024-04-26T12:06:04.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7258999999999999e-05 2024-04-26T12:06:04.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:04.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796579+0000", 2024-04-26T12:06:04.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093201099999999995 2024-04-26T12:06:04.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:04.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796600+0000", 2024-04-26T12:06:04.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1330000000000001e-05 2024-04-26T12:06:04.236 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.237 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:04.237 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.237 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:04.237 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:06:04.237 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.368082418999997, 2024-04-26T12:06:04.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096431940000000008, 2024-04-26T12:06:04.237 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:04.237 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:04.237 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:04.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:04.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:06:04.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.238 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.238 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.238 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:04.238 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786880+0000", 2024-04-26T12:06:04.238 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.238 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.238 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.238 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:04.238 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786879+0000", 2024-04-26T12:06:04.238 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:04.238 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.238 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.238 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:04.238 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786887+0000", 2024-04-26T12:06:04.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9300000000000003e-06 2024-04-26T12:06:04.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:04.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786894+0000", 2024-04-26T12:06:04.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:06:04.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:04.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786899+0000", 2024-04-26T12:06:04.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8400000000000002e-06 2024-04-26T12:06:04.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786932+0000", 2024-04-26T12:06:04.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3031999999999998e-05 2024-04-26T12:06:04.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:04.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786945+0000", 2024-04-26T12:06:04.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3421000000000001e-05 2024-04-26T12:06:04.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:04.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796469+0000", 2024-04-26T12:06:04.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095236130000000002 2024-04-26T12:06:04.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:04.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796523+0000", 2024-04-26T12:06:04.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4089999999999999e-05 2024-04-26T12:06:04.241 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.241 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:04.241 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.241 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "pg_update_log_missing(3.14 epoch 17/15 rep_tid 169 entries 17'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:06:04.241 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:06:04.241 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.368019263999997, 2024-04-26T12:06:04.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097257639999999996, 2024-04-26T12:06:04.241 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:04.242 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-04-26T12:06:04.242 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:04.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:04.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:06:04.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:04.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786943+0000", 2024-04-26T12:06:04.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:04.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786942+0000", 2024-04-26T12:06:04.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:04.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:04.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786951+0000", 2024-04-26T12:06:04.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:06:04.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:04.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786965+0000", 2024-04-26T12:06:04.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4268e-05 2024-04-26T12:06:04.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:04.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786977+0000", 2024-04-26T12:06:04.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1667e-05 2024-04-26T12:06:04.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.244 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787667+0000", 2024-04-26T12:06:04.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00069057400000000001 2024-04-26T12:06:04.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.244 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:04.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796668+0000", 2024-04-26T12:06:04.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090013309999999996 2024-04-26T12:06:04.244 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.244 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:04.244 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.245 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T12:06:04.245 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:06:04.245 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.367966121000002, 2024-04-26T12:06:04.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095908309999999993, 2024-04-26T12:06:04.245 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:04.245 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:04.245 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:04.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:04.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:06:04.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:04.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786996+0000", 2024-04-26T12:06:04.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:04.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.786995+0000", 2024-04-26T12:06:04.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:04.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:04.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787001+0000", 2024-04-26T12:06:04.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5099999999999998e-06 2024-04-26T12:06:04.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:04.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787009+0000", 2024-04-26T12:06:04.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9100000000000005e-06 2024-04-26T12:06:04.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:04.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787019+0000", 2024-04-26T12:06:04.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8109999999999997e-06 2024-04-26T12:06:04.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787136+0000", 2024-04-26T12:06:04.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011749899999999999 2024-04-26T12:06:04.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:04.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787154+0000", 2024-04-26T12:06:04.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8278999999999999e-05 2024-04-26T12:06:04.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:04.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796561+0000", 2024-04-26T12:06:04.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094064379999999996 2024-04-26T12:06:04.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:04.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.796587+0000", 2024-04-26T12:06:04.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5856000000000001e-05 2024-04-26T12:06:04.249 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.249 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:04.249 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.249 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-26T12:06:04.249 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:06:04.249 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.367249063999999, 2024-04-26T12:06:04.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096460160000000003, 2024-04-26T12:06:04.249 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T12:06:04.249 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:04.249 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T12:06:04.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T12:06:04.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:06:04.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.250 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T12:06:04.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787713+0000", 2024-04-26T12:06:04.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T12:06:04.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.250 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T12:06:04.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787712+0000", 2024-04-26T12:06:04.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:04.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T12:06:04.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787718+0000", 2024-04-26T12:06:04.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:06:04.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T12:06:04.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787727+0000", 2024-04-26T12:06:04.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.123e-06 2024-04-26T12:06:04.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T12:06:04.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.787734+0000", 2024-04-26T12:06:04.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.391e-06 2024-04-26T12:06:04.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T12:06:04.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788867+0000", 2024-04-26T12:06:04.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001133207 2024-04-26T12:06:04.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T12:06:04.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.788899+0000", 2024-04-26T12:06:04.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1526000000000003e-05 2024-04-26T12:06:04.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T12:06:04.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797328+0000", 2024-04-26T12:06:04.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084295389999999998 2024-04-26T12:06:04.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T12:06:04.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T12:06:04.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T12:06:04.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T12:05:03.797359+0000", 2024-04-26T12:06:04.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0660999999999997e-05 2024-04-26T12:06:04.253 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.253 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:04.253 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.253 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T12:06:04.253 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T12:06:04.253 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:06:04.255 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:04.255 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:04.254+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:04.356 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:04.355+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:04.368 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:04.368 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:04.368 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:06:04.368 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:04.374 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:06:04.378 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:04.456 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:04.455+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:04.480 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:04.480 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:04.480 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:04.480 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:04.480 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:04.488 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:04.498 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:04.498 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:04.516 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T12:06:04.516 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:06:04.534 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:04.534 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:04.557 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:04.556+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:04.590 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:04.590 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:04.598 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:04.658 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:04.657+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:04.712 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:04.712 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:04.721 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:04.759 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:04.758+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:04.821 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:04.821 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:04.830 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:04.874 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:04.873+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:04.932 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:04.932 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:04.933 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-26T12:06:04.941 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:06:04.986 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:04.984+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:05.046 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:05.046 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:05.055 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:06:05.096 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:05.095+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:05.163 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:05.162+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:05.201 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:05.202 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:05.207 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:06:05.264 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:05.263+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:05.349 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:05.349 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:05.357 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:05.365 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:05.363+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:05.463 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:05.463 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:05.466 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:05.465+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:05.471 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:05.567 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:05.567+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:05.572 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:05.572 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:05.581 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:05.668 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:05.667+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:05.682 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:05.683 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:05.692 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:05.769 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:05.768+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:05.802 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:05.803 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:05.813 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:05.870 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:05.870+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:05.955 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:05.955 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:05.964 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:06.007 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:06.006+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:06.066 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:06.066 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:06.072 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:06.071+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:06.074 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:06:06.173 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:06.172+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:06.184 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:06.184 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:06.193 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:06:06.275 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:06.272+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:06.295 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:06.295 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:06.304 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:06:06.376 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:06.374+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:06.406 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:06.406 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:06.415 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:06.477 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:06.476+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:06.522 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:06.522 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:06.531 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:06.546 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:06:06.578 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:06.577+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:06.634 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:06.635 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:06.641 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:06.679 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:06:06.677+0000 7f87cf2d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28558) UID: 0 2024-04-26T12:06:06.680 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:06.681 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:06.698 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T12:06:06.699 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:06:06.715 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:06.716 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:06.744 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:06.745 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:06.745 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:06.745 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:06.745 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.745 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:06.745 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:06.745 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 72.887626210999997, 2024-04-26T12:06:06.745 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:06.745 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:06.745 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:06.746 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:06.746 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:06.746 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:06.746 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:06.746 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.746 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:06.746 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.746 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:06.746 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:06.746 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.747 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:06.747 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:06.747 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.747 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:06.747 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:06.747 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:06.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.747 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:06.747 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:06.747 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:06.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.748 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.748 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:06.748 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:06.748 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:06.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.748 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.748 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:06.748 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:06.748 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:06.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.748 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.748 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:06.749 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:06.749 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:06.749 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.749 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.749 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:06.749 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:06.749 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:06.750 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.750 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.750 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:06.750 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:06.750 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:06.750 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.750 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.750 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:06.750 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:06.750 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:06.750 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.750 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.750 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:06.750 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:06.751 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:06.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.751 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.751 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:06.751 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:06.751 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:06.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.751 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.751 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:06.751 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:06.751 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:06.751 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.751 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:06.751 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.752 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.752 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:06.752 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:06.752 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 72.887520315000003, 2024-04-26T12:06:06.752 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:06.752 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:06.752 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:06.752 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:06.752 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:06.752 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:06.752 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:06.752 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.752 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:06.752 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.753 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:06.753 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:06.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.753 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.753 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:06.753 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:06.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.753 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.753 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:06.753 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:06.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:06.753 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.754 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:06.754 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:06.754 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:06.754 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.754 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.754 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:06.754 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:06.754 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:06.754 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.754 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.754 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:06.754 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:06.754 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:06.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.755 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.755 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:06.755 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:06.755 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:06.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.755 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.755 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:06.755 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:06.755 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:06.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.755 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.755 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:06.755 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:06.755 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:06.756 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.756 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.756 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:06.756 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:06.756 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:06.756 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.756 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.756 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:06.756 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:06.756 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:06.756 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.756 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.756 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:06.756 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:06.756 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:06.757 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.757 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.757 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:06.757 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:06.757 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:06.757 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.757 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:06.757 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.757 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.757 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.757 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:06.757 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:06.757 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 72.887505335, 2024-04-26T12:06:06.757 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:06.757 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:06.758 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:06.758 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:06.758 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:06.758 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:06.758 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:06.758 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.758 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:06.758 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.758 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:06.758 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:06.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.758 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.758 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.758 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:06.759 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:06.759 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.759 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:06.759 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:06.759 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:06.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.759 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:06.759 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:06.759 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:06.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:06.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:06.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:06.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:06.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:06.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:06.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:06.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:06.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:06.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.761 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:06.761 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:06.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:06.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.761 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:06.761 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:06.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:06.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.761 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:06.761 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:06.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:06.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.762 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:06.762 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:06.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:06.762 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.762 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:06.762 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:06.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:06.762 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.762 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:06.762 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:06.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:06.762 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.763 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:06.763 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.763 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.763 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:06.763 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:06.763 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 72.887461459999997, 2024-04-26T12:06:06.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:06.763 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:06.763 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:06.764 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:06.764 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:06.764 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:06.764 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:06.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.764 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:06.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.764 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:06.764 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:06.764 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.764 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:06.764 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:06.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:06.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:06.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:06.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:06.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:06.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:06.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:06.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:06.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:06.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:06.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:06.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:06.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:06.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:06.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:06.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:06.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:06.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:06.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:06.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:06.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:06.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:06.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:06.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:06.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:06.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:06.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:06.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.768 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.768 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:06.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:06.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:06.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.768 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.768 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:06.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:06.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:06.768 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.768 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:06.768 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.769 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:06.769 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:06.769 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 72.887375796000001, 2024-04-26T12:06:06.769 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:06.769 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:06.769 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:06.769 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:06.769 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:06.769 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:06.769 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:06.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.769 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:06.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:06.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:06.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:06.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:06.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:06.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:06.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:06.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:06.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:06.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:06.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:06.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:06.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:06.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:06.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:06.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:06.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:06.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:06.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:06.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:06.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:06.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:06.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:06.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:06.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:06.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:06.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:06.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:06.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:06.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:06.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:06.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:06.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:06.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:06.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:06.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:06.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:06.774 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.774 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:06.774 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.774 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:06.774 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:06.775 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 62.961471510000003, 2024-04-26T12:06:06.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:06.775 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:06.775 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:06.775 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:06.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:06.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:06.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:06.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:06.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:06.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:06.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:06.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:06.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:06.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:06.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:06.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:06.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:06.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:06.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:06.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:06.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:06.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:06.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:06.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:06.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:06.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:06.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:06.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:06.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:06.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:06.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:06.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:06.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:06.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:06.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:06.779 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.779 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:06.779 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:06.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:06.779 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.779 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:06.779 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:06.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:06.779 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.779 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:06.779 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.779 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.780 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:06.780 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:06.780 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 62.961435414999997, 2024-04-26T12:06:06.780 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:06.780 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:06.780 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:06.780 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:06.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.780 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:06.780 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:06.780 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.780 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:06.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:06.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:06.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:06.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:06.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:06.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:06.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:06.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:06.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:06.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:06.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:06.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:06.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:06.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:06.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:06.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:06.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:06.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:06.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:06.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:06.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:06.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:06.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:06.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:06.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:06.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.784 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:06.784 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:06.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:06.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.784 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:06.784 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:06.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:06.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.784 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:06.784 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:06.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:06.785 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.785 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:06.785 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.785 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.785 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.785 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:06.785 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:06.785 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 62.961397730999998, 2024-04-26T12:06:06.785 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:06.785 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:06.785 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:06.785 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:06.785 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.785 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:06.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:06.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.786 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.786 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:06.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:06.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.786 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.786 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:06.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:06.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:06.786 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:06.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:06.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:06.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:06.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:06.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:06.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:06.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:06.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:06.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:06.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:06.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:06.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:06.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:06.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:06.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:06.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:06.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:06.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.789 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.789 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:06.789 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:06.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:06.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.789 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.789 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:06.789 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:06.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:06.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.789 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.789 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:06.789 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:06.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:06.790 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.790 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.790 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:06.790 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:06.790 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:06.790 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.790 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:06.790 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.790 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.790 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.790 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:06.790 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:06.790 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 62.961376391000002, 2024-04-26T12:06:06.790 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:06.791 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:06.791 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:06.791 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:06.791 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.791 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:06.791 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:06.791 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.791 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.791 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.791 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:06.791 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:06.791 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.791 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.791 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.791 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:06.792 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:06.792 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:06.792 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:06.792 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:06.792 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:06.792 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:06.792 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:06.792 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:06.792 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:06.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:06.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:06.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:06.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:06.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:06.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:06.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:06.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:06.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:06.794 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:06.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:06.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.794 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:06.794 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:06.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:06.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.794 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:06.794 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:06.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:06.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.795 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:06.795 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:06.795 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:06.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.795 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.795 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:06.795 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:06.795 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:06.795 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.795 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:06.795 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.795 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.795 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:06.796 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:06.796 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 62.961354125, 2024-04-26T12:06:06.796 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:06.796 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:06.796 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:06.796 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:06.796 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.796 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:06.796 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:06.796 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.796 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.796 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.796 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:06.796 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:06.796 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.797 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.797 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:06.797 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:06.797 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:06.797 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.797 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:06.797 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:06.797 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:06.797 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.797 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:06.797 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:06.797 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:06.798 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.798 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.798 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:06.798 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:06.798 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:06.798 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.798 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.798 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:06.798 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:06.798 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:06.799 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.799 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.799 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:06.799 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:06.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:06.799 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.799 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.799 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:06.799 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:06.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:06.799 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.799 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.799 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:06.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:06.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:06.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:06.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:06.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:06.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:06.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:06.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:06.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:06.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:06.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:06.801 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.801 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:06.801 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.801 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:06.801 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:06.801 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 62.961332503000001, 2024-04-26T12:06:06.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:06.801 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:06.801 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:06.802 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:06.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:06.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:06.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:06.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:06.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:06.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:06.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:06.803 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.803 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.803 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:06.803 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:06.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:06.803 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.803 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.803 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:06.803 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:06.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:06.803 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.803 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.803 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:06.803 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:06.804 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:06.804 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.804 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.804 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:06.804 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:06.804 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:06.804 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.804 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.804 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:06.804 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:06.804 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:06.804 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.804 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.804 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:06.804 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:06.805 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:06.805 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.805 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.805 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:06.805 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:06.805 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:06.805 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.805 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.805 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:06.805 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:06.805 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:06.805 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.805 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.805 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:06.805 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:06.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:06.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:06.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:06.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:06.806 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.806 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:06.806 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.806 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:06.806 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:06.806 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 62.961305936999999, 2024-04-26T12:06:06.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:06.807 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:06.807 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:06.807 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:06.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:06.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:06.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:06.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:06.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:06.808 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:06.808 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:06.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.808 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.808 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:06.808 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:06.808 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:06.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.808 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.808 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:06.808 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:06.808 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:06.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.808 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.809 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:06.809 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:06.809 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:06.809 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.809 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.809 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:06.809 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:06.809 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:06.809 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.809 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.809 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:06.809 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:06.809 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:06.809 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.809 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.810 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:06.810 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:06.810 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:06.810 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.810 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.810 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:06.810 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:06.810 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:06.810 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.810 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.810 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:06.810 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:06.810 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:06.810 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.811 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.811 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:06.811 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:06.811 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:06.811 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.811 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.811 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:06.811 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:06.811 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:06.811 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.811 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:06.811 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.811 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.811 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.811 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:06.812 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:06.812 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 62.961267425000003, 2024-04-26T12:06:06.812 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:06.812 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:06.812 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:06.812 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:06.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:06.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:06.812 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.812 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:06.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:06.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:06.813 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:06.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:06.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:06.813 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:06.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:06.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:06.814 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:06.814 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:06.814 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.814 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.814 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:06.814 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:06.814 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:06.814 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.814 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.814 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:06.814 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:06.814 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:06.814 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.814 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.815 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:06.815 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:06.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:06.815 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.815 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.815 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:06.815 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:06.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:06.815 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.815 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.815 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:06.815 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:06.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:06.815 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.815 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.815 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:06.816 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:06.816 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:06.816 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.816 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.816 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:06.816 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:06.816 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:06.816 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.816 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.816 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:06.816 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:06.816 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:06.816 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.816 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:06.816 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.817 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.817 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.817 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:06.817 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:06.817 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 62.961239251999999, 2024-04-26T12:06:06.817 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:06.817 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:06.817 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:06.817 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:06.817 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.817 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:06.817 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:06.817 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.817 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.817 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.818 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:06.818 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:06.818 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.818 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.818 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:06.818 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:06.818 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:06.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:06.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:06.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:06.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:06.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:06.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:06.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.820 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:06.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:06.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:06.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.820 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:06.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:06.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:06.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.820 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:06.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:06.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:06.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.821 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:06.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:06.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:06.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.821 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:06.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:06.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:06.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.821 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:06.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:06.822 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:06.822 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.822 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:06.822 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:06.822 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:06.822 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.822 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:06.822 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:06.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:06.823 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.823 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:06.823 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.823 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:06.823 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:06.823 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 62.961204688000002, 2024-04-26T12:06:06.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:06.823 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:06.823 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:06.823 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:06.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:06.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:06.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:06.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:06.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:06.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:06.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:06.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:06.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:06.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:06.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:06.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:06.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:06.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:06.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:06.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:06.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:06.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:06.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:06.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:06.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:06.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:06.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:06.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:06.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:06.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:06.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:06.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:06.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:06.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:06.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:06.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:06.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:06.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:06.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.828 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:06.828 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:06.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:06.828 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.828 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:06.828 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.829 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:06.829 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:06.829 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 62.960329907999999, 2024-04-26T12:06:06.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:06.829 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:06.829 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:06.829 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:06.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.829 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:06.829 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:06.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:06.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:06.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:06.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:06.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:06.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:06.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:06.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:06.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:06.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:06.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:06.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:06.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:06.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:06.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:06.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:06.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:06.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:06.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:06.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:06.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:06.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:06.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:06.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:06.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:06.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:06.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:06.834 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:06.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:06.834 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.834 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:06.834 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:06.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:06.834 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.834 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:06.834 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:06.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:06.834 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.834 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:06.834 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.835 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.835 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.835 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:06.835 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:06.835 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 62.960290948999997, 2024-04-26T12:06:06.835 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:06.835 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:06.835 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:06.835 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:06.835 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.835 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:06.835 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:06.835 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.835 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.836 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:06.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:06.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.838 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.838 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:06.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:06.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:06.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.838 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.838 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:06.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:06.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:06.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.838 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.838 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:06.839 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:06.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:06.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.839 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:06.839 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:06.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:06.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.839 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:06.839 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:06.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:06.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:06.840 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:06.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:06.840 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:06.840 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:06.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:06.840 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:06.840 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:06.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:06.840 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.841 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:06.841 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:06.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:06.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.841 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:06.841 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:06.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:06.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.841 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:06.841 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:06.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:06.841 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.842 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:06.842 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.842 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.842 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:06.842 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:06.842 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 62.960255476999997, 2024-04-26T12:06:06.842 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:06.842 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:06.842 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:06.843 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:06.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:06.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:06.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.843 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:06.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:06.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.843 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:06.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:06.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:06.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:06.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:06.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:06.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:06.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:06.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:06.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:06.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:06.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:06.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:06.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:06.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:06.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:06.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:06.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:06.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:06.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:06.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:06.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:06.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:06.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:06.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:06.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:06.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:06.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:06.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:06.847 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:06.847 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.847 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.847 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:06.847 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:06.847 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:06.847 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.847 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:06.847 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.847 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.847 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.847 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:06.847 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:06.847 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 62.960176787999998, 2024-04-26T12:06:06.847 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:06.848 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:06.848 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:06.848 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:06.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.848 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:06.848 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:06.848 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.848 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.848 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:06.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:06.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:06.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:06.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:06.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:06.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:06.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:06.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.850 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:06.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:06.850 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:06.850 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.850 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:06.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:06.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:06.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.851 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.851 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:06.851 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:06.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:06.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.851 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.851 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:06.851 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:06.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:06.852 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.852 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:06.852 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:06.852 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:06.852 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.852 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:06.852 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:06.852 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:06.852 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.852 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:06.852 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:06.853 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:06.853 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.853 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:06.853 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:06.853 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:06.853 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.853 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:06.854 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:06.854 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:06.854 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.854 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:06.854 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.854 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.854 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.854 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:06.854 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:06.854 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 62.960025940000001, 2024-04-26T12:06:06.854 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:06.855 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:06.855 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:06.855 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:06.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:06.855 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:06.855 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:06.855 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:06.855 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:06.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.856 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:06.856 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:06.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:06.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.856 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.856 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:06.856 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:06.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:06.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.856 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.856 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:06.856 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:06.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:06.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.857 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:06.857 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:06.857 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:06.857 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.857 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:06.857 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:06.857 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:06.857 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.857 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:06.857 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:06.857 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:06.857 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:06.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:06.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:06.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:06.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:06.858 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.858 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:06.858 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.858 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:06.858 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:06.858 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:06.860 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:06.860 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:06.859+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:06.947 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:06:06.960 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:06.959+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:06.968 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:06.968 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:06.968 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:06:06.968 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:06.977 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:07.061 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:07.060+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:07.078 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:07.079 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:07.079 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:07.079 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:07.079 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:07.087 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:07.171 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:07.170+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:07.230 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:07.230 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:07.230 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:07.230 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:07.231 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.231 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:07.231 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:07.231 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 63.448044608000004, 2024-04-26T12:06:07.231 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:06:07.231 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:07.231 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.231 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:07.231 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.231 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:07.231 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:07.231 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.231 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.231 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.232 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:07.232 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:07.232 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.232 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.232 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.232 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:07.232 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:06:07.232 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:07.232 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.232 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.232 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:07.232 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:06:07.232 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:06:07.233 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.233 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.233 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:07.233 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:06:07.233 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:06:07.233 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.233 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.233 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.233 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:06:07.233 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:06:07.233 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.233 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.233 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:07.233 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:06:07.233 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:06:07.234 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.234 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.234 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:07.234 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:07.234 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:06:07.234 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.234 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.234 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:07.234 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:06:07.234 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:06:07.234 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.234 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.234 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:07.234 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:06:07.234 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:06:07.235 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.235 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.235 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.235 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:06:07.235 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:06:07.235 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.235 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.235 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:07.235 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:06:07.235 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:06:07.235 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.235 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.235 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:07.235 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:06:07.236 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:06:07.236 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.236 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:07.236 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.236 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.236 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.236 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:07.236 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:07.236 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 63.447989288000002, 2024-04-26T12:06:07.236 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:06:07.236 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:07.236 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.236 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:07.236 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.236 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:07.237 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:07.237 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.237 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.237 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.237 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:07.237 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:07.237 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.237 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.237 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.237 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:07.238 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:06:07.238 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:07.238 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.238 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.238 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:07.238 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:06:07.238 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:06:07.238 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.238 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.238 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:07.238 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:06:07.238 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:06:07.238 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.238 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.239 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.239 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:06:07.239 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:06:07.239 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.239 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.239 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:07.239 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:06:07.239 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:06:07.239 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.239 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.239 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:07.239 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:06:07.239 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:06:07.240 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.240 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.240 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:07.240 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:06:07.240 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:06:07.240 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.240 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.240 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:07.240 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:06:07.240 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:06:07.241 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.241 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.241 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.241 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:06:07.241 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:06:07.241 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.241 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.241 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:07.241 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:06:07.241 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:06:07.241 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.241 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.241 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:07.241 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:06:07.242 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:06:07.242 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.242 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:07.242 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.242 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.242 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.242 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:07.242 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:07.242 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 63.447939269999999, 2024-04-26T12:06:07.242 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:06:07.242 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:07.246 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.246 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:07.246 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.246 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:07.246 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:07.246 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.246 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.247 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:07.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:07.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.247 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:07.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:06:07.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.247 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:07.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:06:07.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:06:07.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:07.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:06:07.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:06:07.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:06:07.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:06:07.249 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.249 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:07.249 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:06:07.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:06:07.249 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.249 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:07.249 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:06:07.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:06:07.249 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.249 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:07.249 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:06:07.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:06:07.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.250 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:07.250 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:06:07.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:06:07.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.250 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.250 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:06:07.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:06:07.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:07.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:06:07.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:06:07.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:07.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:06:07.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:06:07.251 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.251 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:07.252 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.252 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:07.252 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:07.252 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 63.447904633, 2024-04-26T12:06:07.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:06:07.252 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:07.252 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.252 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:07.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.252 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:07.252 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:07.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.253 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:07.253 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:07.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.253 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:07.253 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:06:07.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.253 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:07.253 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:06:07.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:06:07.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:07.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:07.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:06:07.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:06:07.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:06:07.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:07.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:06:07.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:06:07.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:07.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:06:07.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:06:07.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:07.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:06:07.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:06:07.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:06:07.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:06:07.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:07.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:06:07.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:06:07.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:07.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:06:07.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:06:07.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:07.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:06:07.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:06:07.258 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.258 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:07.258 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.258 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:07.258 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:07.258 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 63.447866120999997, 2024-04-26T12:06:07.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:06:07.258 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:07.258 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.258 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:07.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:07.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:07.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:07.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:07.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:07.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:07.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:07.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:07.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:07.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:06:07.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:07.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:06:07.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:06:07.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:06:07.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:06:07.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:07.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:06:07.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:06:07.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:07.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:06:07.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:06:07.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:07.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:06:07.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:06:07.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:06:07.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:06:07.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:07.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:06:07.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:06:07.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:07.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:06:07.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:06:07.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:07.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:06:07.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:06:07.263 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.263 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:07.263 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.263 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:07.263 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:07.263 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 63.447835798, 2024-04-26T12:06:07.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:06:07.263 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:07.264 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.264 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:07.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:07.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:07.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:07.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:07.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:07.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:06:07.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:06:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:06:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:06:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:06:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:06:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:06:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:06:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:06:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:06:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:06:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:07.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:06:07.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:06:07.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:07.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:06:07.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:06:07.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:06:07.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:06:07.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:06:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:06:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:06:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:06:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 63.447809096, 2024-04-26T12:06:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:06:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:06:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:06:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:06:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:06:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:06:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:06:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:06:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:06:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:06:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:06:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:06:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:06:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 63.447766805999997, 2024-04-26T12:06:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:06:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.274 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.274 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:07.274 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:07.274 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.274 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.274 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.274 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:07.274 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:06:07.274 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:06:07.274 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.274 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.274 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:07.274 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:06:07.275 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:06:07.275 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.276 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.276 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.276 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:06:07.276 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:06:07.276 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.276 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.276 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:07.276 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:06:07.276 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:06:07.276 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.276 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.276 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:07.276 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:06:07.277 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:06:07.277 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.277 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.277 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:07.277 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:06:07.277 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:06:07.277 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.277 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:07.277 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.277 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.277 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.277 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:07.277 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:07.278 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 63.447738727999997, 2024-04-26T12:06:07.278 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:06:07.278 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:07.278 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:07.278 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:07.278 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.278 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:07.278 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:07.278 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.278 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.278 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.278 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:07.278 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:07.278 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.279 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.279 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.279 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:07.279 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:06:07.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.279 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.279 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.279 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:07.279 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:06:07.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:06:07.279 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.279 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.279 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:07.279 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:06:07.280 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:06:07.280 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.280 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.280 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.280 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:06:07.280 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:06:07.280 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.280 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.280 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:07.280 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:06:07.280 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:06:07.280 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.280 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.280 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:07.281 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:06:07.281 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:06:07.281 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.281 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:07.281 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:06:07.281 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:06:07.281 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.281 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:07.281 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.281 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.281 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:07.281 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:07.281 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 63.441743377999998, 2024-04-26T12:06:07.281 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:06:07.282 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:07.282 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.282 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:07.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:07.282 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:07.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:07.282 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:07.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:07.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:06:07.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:07.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:06:07.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:06:07.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:07.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:06:07.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:06:07.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:06:07.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:06:07.284 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.284 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:07.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:06:07.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:06:07.284 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.284 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:07.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:06:07.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:06:07.284 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.284 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:07.285 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:06:07.285 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:06:07.285 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.285 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:07.285 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:06:07.285 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:06:07.285 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.285 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:07.285 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.285 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.285 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:07.285 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:07.286 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 63.441674411999998, 2024-04-26T12:06:07.286 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:06:07.286 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:07.286 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.286 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:07.286 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.286 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:07.286 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:07.286 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.286 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.286 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.286 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:07.286 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:07.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:07.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:06:07.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:07.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:06:07.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:06:07.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:07.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:06:07.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:06:07.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:06:07.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:06:07.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:07.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:06:07.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:06:07.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:07.289 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:07.289 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:06:07.289 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.289 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.289 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:07.289 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:06:07.289 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:06:07.289 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.289 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.289 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:07.289 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:06:07.289 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:06:07.289 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.289 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:07.290 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.290 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.290 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.290 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:07.290 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:07.290 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 63.441180049000003, 2024-04-26T12:06:07.290 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:06:07.290 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:07.290 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.290 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:07.290 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.290 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:07.290 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:07.290 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.290 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.291 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:07.291 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:07.291 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.291 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.291 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:07.291 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:07.291 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.291 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.291 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:07.291 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:06:07.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:06:07.292 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.292 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.292 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:07.292 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:06:07.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:06:07.292 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.292 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.292 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.292 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:06:07.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:06:07.292 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.292 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.292 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:07.293 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:06:07.293 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:06:07.293 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.293 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.293 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:07.293 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:06:07.293 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:06:07.293 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.293 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.293 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:07.293 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:06:07.293 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:06:07.293 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.293 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.293 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:07.294 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:06:07.294 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:06:07.294 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.294 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:07.294 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.294 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.294 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.294 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:07.294 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:07.294 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 63.441141784000003, 2024-04-26T12:06:07.294 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:06:07.294 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:07.294 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.294 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:07.294 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:07.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:07.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:07.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:07.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:07.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:07.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:07.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:06:07.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:06:07.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:07.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:06:07.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:06:07.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:06:07.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:06:07.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:07.297 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:06:07.297 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:06:07.297 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.297 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.297 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:07.297 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:06:07.297 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:06:07.297 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.297 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.297 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:07.297 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:06:07.297 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:06:07.298 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.298 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.298 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:07.298 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:06:07.298 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:06:07.298 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.298 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:07.298 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.298 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.298 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.298 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:06:07.298 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:07.298 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 63.440461898999999, 2024-04-26T12:06:07.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:06:07.299 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:07.299 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:07.299 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:07.299 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.299 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:07.299 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:07.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.299 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.299 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.299 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:07.299 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:07.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.299 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:07.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:07.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:07.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:06:07.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:06:07.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:07.301 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:06:07.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:06:07.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.301 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.301 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:06:07.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:06:07.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.301 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:07.301 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:06:07.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:06:07.302 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.302 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:07.302 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:06:07.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:06:07.302 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.302 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:07.302 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.302 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.302 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:07.302 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:07.303 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 63.440432719999997, 2024-04-26T12:06:07.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:06:07.303 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:07.303 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:07.303 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:07.303 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:07.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:07.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.303 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.303 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:07.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:07.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.303 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.304 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.304 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:07.304 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:06:07.304 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.304 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.304 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.304 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:07.304 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:06:07.304 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:06:07.304 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.304 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.304 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:07.304 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:06:07.305 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:06:07.305 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.305 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.305 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.305 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:06:07.305 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:06:07.305 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.305 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.305 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:07.305 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:06:07.305 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:06:07.305 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.305 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.305 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:07.306 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:06:07.306 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:06:07.306 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.306 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.306 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:07.306 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:06:07.306 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:06:07.306 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.306 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:07.306 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.306 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.306 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.307 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:07.307 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:07.307 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 63.440400908999997, 2024-04-26T12:06:07.307 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:06:07.307 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:07.307 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:07.307 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:07.307 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.307 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:07.307 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:07.307 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.307 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.307 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.308 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:07.308 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:07.308 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.308 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.308 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.308 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:07.308 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:07.308 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:07.308 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.308 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.308 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:07.309 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:06:07.309 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:06:07.309 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.309 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.309 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:07.309 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:06:07.309 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:06:07.309 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.309 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.309 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.309 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:06:07.309 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:06:07.309 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:07.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:06:07.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:06:07.310 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:07.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:06:07.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:06:07.310 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:07.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:06:07.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:06:07.311 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.311 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:07.311 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.311 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:07.311 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:07.311 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 63.440379553, 2024-04-26T12:06:07.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:06:07.311 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:07.311 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:07.311 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:07.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.312 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:07.312 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:07.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.312 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.312 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:07.312 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:07.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.312 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.312 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:07.312 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:07.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:07.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:07.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:06:07.313 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:06:07.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:07.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:06:07.313 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:06:07.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.314 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.314 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:06:07.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:06:07.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.314 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:07.314 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:06:07.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:06:07.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:07.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:06:07.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:06:07.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:07.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:06:07.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:06:07.315 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.315 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:07.316 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.316 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:06:07.316 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:07.316 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 63.440351100000001, 2024-04-26T12:06:07.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:06:07.316 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:07.316 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:07.316 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:07.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:07.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:07.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:07.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:07.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:07.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:07.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:07.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:06:07.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:06:07.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:07.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:06:07.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:06:07.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:06:07.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:06:07.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:07.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:06:07.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:06:07.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:07.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:06:07.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:06:07.319 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.320 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:07.320 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.320 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:06:07.320 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:07.320 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 63.439629294, 2024-04-26T12:06:07.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:06:07.320 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:07.320 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:07.320 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:07.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:07.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:07.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:07.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:07.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:07.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:06:07.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:07.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:07.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:06:07.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:06:07.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:07.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:06:07.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:06:07.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:06:07.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:06:07.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:07.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:06:07.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:06:07.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:07.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:06:07.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:06:07.323 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.323 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:07.323 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.323 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:06:07.324 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:07.324 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 57.722702691000002, 2024-04-26T12:06:07.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:06:07.324 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:07.324 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.324 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:07.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:07.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:07.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:07.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:07.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:07.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:07.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:06:07.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:06:07.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:07.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:06:07.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:06:07.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:07.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:06:07.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:06:07.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:06:07.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:06:07.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:07.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:06:07.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:06:07.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:07.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:06:07.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:06:07.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:07.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:06:07.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:06:07.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:07.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:06:07.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:06:07.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:06:07.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:06:07.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:07.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:06:07.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:06:07.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:07.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:07.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:07.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:06:07.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:06:07.328 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.328 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:07.328 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.328 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:07.328 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:07.329 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:07.329 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:06:07.329 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:06:07.329 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [0, 1, 2] 2024-04-26T12:06:07.329 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi154.front.sepia.ceph.com 2024-04-26T12:06:07.330 INFO:teuthology.orchestra.console.smithi154:Power off 2024-04-26T12:06:07.330 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T12:06:07.342 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:07.328+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:07.343 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:07.355 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2024-04-26T12:06:07.356 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:06:07.383 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-04-26T12:06:07.431 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:07.429+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:07.453 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:07.453 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:07.453 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:06:07.454 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:07.463 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:07.548 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:07.546+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:07.605 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:07.605 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:07.605 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:07.605 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:07.605 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:07.614 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:07.633 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:07.633+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:07.734 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:07.732+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:07.758 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:07.758 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:07.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:07.758 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:07.758 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.758 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:07.759 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:07.759 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 73.900719863000006, 2024-04-26T12:06:07.759 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:07.759 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:07.759 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.759 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:07.759 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:07.759 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:07.759 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:07.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.759 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:07.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.759 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:07.759 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:07.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:07.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:07.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:07.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:07.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:07.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:07.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:07.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.761 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:07.761 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:07.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:07.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.761 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.761 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:07.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:07.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.761 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:07.761 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:07.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:07.762 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.762 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:07.762 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:07.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:07.762 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.762 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:07.762 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:07.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:07.762 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.762 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:07.762 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:07.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:07.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.763 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.763 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.763 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:07.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:07.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.763 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.763 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:07.763 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:07.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:07.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.763 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.763 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:07.763 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:07.764 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:07.764 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.764 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:07.764 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.764 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:07.764 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:07.764 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 73.900613966999998, 2024-04-26T12:06:07.764 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:07.764 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:07.764 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.764 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:07.764 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:07.764 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:07.765 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:07.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.765 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:07.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:07.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:07.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:07.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:07.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:07.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:07.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:07.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:07.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:07.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:07.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:07.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:07.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:07.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:07.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:07.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:07.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:07.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:07.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:07.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:07.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:07.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:07.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:07.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.768 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.768 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:07.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:07.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:07.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.768 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.768 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:07.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:07.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.768 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.768 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:07.769 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:07.769 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:07.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.769 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:07.769 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:07.769 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:07.769 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.769 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:07.769 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.769 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:07.769 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:07.770 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 73.900598986999995, 2024-04-26T12:06:07.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:07.770 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:07.770 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.770 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:07.770 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:07.770 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:07.770 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:07.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.770 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:07.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:07.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:07.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:07.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:07.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:07.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:07.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:07.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:07.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:07.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:07.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:07.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:07.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:07.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:07.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:07.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:07.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:07.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:07.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:07.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:07.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:07.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:07.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:07.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:07.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:07.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:07.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:07.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:07.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:07.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:07.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:07.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:07.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:07.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:07.775 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.775 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:07.775 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.775 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:07.775 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:07.775 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 73.900555112000006, 2024-04-26T12:06:07.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:07.775 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:07.775 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.775 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:07.775 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:07.776 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:07.776 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:07.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.776 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:07.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:07.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:07.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:07.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:07.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:07.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:07.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:07.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:07.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:07.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:07.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:07.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:07.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:07.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:07.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:07.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:07.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:07.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:07.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:07.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:07.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.779 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:07.779 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:07.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:07.779 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.779 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:07.779 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:07.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:07.779 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.779 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.779 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:07.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:07.780 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.780 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:07.780 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:07.780 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:07.780 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.780 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:07.780 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:07.780 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:07.780 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.780 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:07.780 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.780 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.781 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:07.781 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:07.781 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 73.900469447999996, 2024-04-26T12:06:07.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:07.781 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:07.781 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.781 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:07.781 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:07.781 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:07.781 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:07.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.781 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:07.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:07.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:07.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:07.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:07.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:07.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:07.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:07.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:07.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:07.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:07.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:07.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:07.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:07.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:07.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.784 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:07.784 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:07.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:07.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.784 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:07.784 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:07.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:07.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.785 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:07.785 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:07.785 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:07.785 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.785 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.785 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:07.785 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:07.785 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:07.785 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.785 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.785 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.785 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:07.785 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:07.785 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.786 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:07.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:07.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:07.786 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.786 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:07.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:07.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:07.786 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.786 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:07.786 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.786 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.787 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:07.787 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:07.787 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 63.974565161999998, 2024-04-26T12:06:07.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:07.787 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:07.787 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.787 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:07.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:07.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:07.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:07.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:07.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:07.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:07.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:07.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:07.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:07.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:07.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:07.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:07.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:07.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.789 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.789 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.789 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:07.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:07.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.789 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.789 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:07.789 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:07.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:07.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.789 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.789 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:07.790 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:07.790 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:07.790 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.790 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.790 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:07.790 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:07.790 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:07.790 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.790 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.790 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:07.790 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:07.790 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:07.790 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.791 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.791 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.791 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:07.791 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:07.791 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.791 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.791 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:07.791 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:07.791 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:07.791 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.791 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.791 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:07.791 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:07.791 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:07.792 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.792 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:07.792 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.792 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.792 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:07.792 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:07.792 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 63.974529066999999, 2024-04-26T12:06:07.792 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:07.792 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:07.792 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.792 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:07.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:07.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:07.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:07.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:07.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:07.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:07.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:07.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:07.794 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:07.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:07.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.794 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:07.794 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:07.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:07.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.794 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.794 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:07.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:07.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.795 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:07.795 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:07.795 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:07.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.795 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.795 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:07.795 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:07.795 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:07.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.795 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.795 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:07.795 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:07.795 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:07.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.795 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.796 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:07.796 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:07.796 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:07.796 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.796 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.796 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.796 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:07.796 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:07.796 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.796 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.796 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:07.796 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:07.796 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:07.796 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.797 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:07.797 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:07.797 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:07.797 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.797 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:07.797 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.797 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.797 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:07.797 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:07.797 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 63.974491383, 2024-04-26T12:06:07.797 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:07.797 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:07.797 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.798 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:07.798 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.798 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:07.798 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:07.798 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.798 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.798 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.798 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:07.798 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:07.798 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.798 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.798 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.798 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:07.799 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:07.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.799 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.799 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.799 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:07.799 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:07.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:07.799 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.799 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.799 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:07.799 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:07.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:07.799 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.799 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.799 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:07.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:07.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:07.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:07.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:07.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:07.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:07.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:07.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:07.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:07.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:07.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:07.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:07.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:07.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:07.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:07.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:07.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:07.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:07.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:07.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:07.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:07.802 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.802 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:07.802 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.802 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:07.802 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:07.802 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 63.974470042999997, 2024-04-26T12:06:07.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:07.803 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:07.803 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.803 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:07.803 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.803 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:07.803 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:07.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.803 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.803 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.803 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:07.803 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:07.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.803 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.803 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.804 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:07.804 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:07.804 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.804 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.804 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.804 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:07.804 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:07.804 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:07.804 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.804 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.804 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:07.804 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:07.804 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:07.804 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.804 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.805 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.805 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:07.805 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:07.805 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.805 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.805 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:07.805 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:07.805 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:07.805 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.805 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.805 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:07.805 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:07.805 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:07.805 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.805 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:07.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:07.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:07.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:07.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:07.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:07.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:07.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:07.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:07.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:07.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:07.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:07.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:07.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:07.807 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.807 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:07.807 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.807 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:07.807 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:07.808 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 63.974447777000002, 2024-04-26T12:06:07.808 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:07.808 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:07.808 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.808 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:07.808 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.808 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:07.808 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:07.810 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.810 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.810 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.811 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:07.811 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:07.811 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.811 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.811 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.811 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:07.811 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:07.811 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.811 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.811 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.811 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:07.811 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:07.811 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:07.811 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:07.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:07.812 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:07.812 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:07.812 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:07.812 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:07.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:07.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:07.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:07.813 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:07.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:07.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:07.813 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:07.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:07.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:07.814 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:07.814 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:07.814 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.814 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.814 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.814 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:07.814 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:07.814 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.814 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.814 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:07.814 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:07.814 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:07.814 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.815 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.815 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:07.815 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:07.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:07.815 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.815 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:07.815 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.815 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.815 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.815 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:07.815 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:07.816 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 63.974426155000003, 2024-04-26T12:06:07.816 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:07.816 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:07.816 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.816 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:07.816 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.816 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:07.816 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:07.816 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.816 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.816 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.816 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:07.816 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:07.817 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.817 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.817 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.817 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:07.817 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:07.817 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.817 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.817 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.817 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:07.817 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:07.817 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:07.817 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.817 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.817 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:07.817 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:07.817 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:07.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.818 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.818 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.818 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:07.818 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:07.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.818 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.818 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:07.818 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:07.818 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:07.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.818 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:07.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:07.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:07.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:07.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:07.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:07.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:07.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:07.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:07.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.820 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:07.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:07.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.820 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:07.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:07.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:07.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.821 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:07.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:07.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:07.821 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.821 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:07.821 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.822 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.822 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:07.822 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:07.822 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 63.974399589000001, 2024-04-26T12:06:07.822 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:07.822 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:07.822 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.822 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:07.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.822 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:07.823 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:07.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.823 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:07.823 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:07.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:07.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:07.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:07.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:07.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:07.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:07.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:07.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:07.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:07.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:07.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:07.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:07.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:07.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:07.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:07.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:07.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:07.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:07.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:07.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:07.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:07.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:07.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:07.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:07.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:07.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:07.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:07.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:07.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:07.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:07.827 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.827 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:07.827 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.828 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.828 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:07.828 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:07.828 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 63.974361076999998, 2024-04-26T12:06:07.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:07.828 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:07.828 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.828 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:07.828 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.828 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:07.828 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:07.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.829 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:07.829 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:07.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.829 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:07.829 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:07.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.829 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:07.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:07.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:07.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:07.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:07.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:07.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:07.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:07.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:07.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:07.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:07.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:07.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:07.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:07.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:07.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:07.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:07.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:07.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:07.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:07.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:07.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:07.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:07.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:07.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:07.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:07.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:07.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:07.833 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.833 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:07.833 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.833 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:07.833 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:07.833 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 63.974332904000001, 2024-04-26T12:06:07.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:07.834 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:07.834 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.834 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:07.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.834 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:07.834 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:07.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.834 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.834 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:07.834 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:07.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.835 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.835 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.835 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:07.835 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:07.835 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.835 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.835 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.835 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:07.835 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:07.835 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:07.835 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.835 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.835 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:07.835 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:07.836 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:07.836 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.836 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.836 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.836 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:07.836 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:07.836 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.836 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.836 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:07.836 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:07.836 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:07.836 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.836 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.836 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:07.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:07.837 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:07.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:07.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:07.837 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:07.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:07.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:07.837 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:07.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.838 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:07.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:07.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.838 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.838 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:07.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:07.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:07.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.838 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.838 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:07.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:07.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:07.838 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.839 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:07.839 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.839 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:07.839 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:07.839 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 63.974298339999997, 2024-04-26T12:06:07.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:07.839 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:07.839 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.839 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:07.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.839 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:07.839 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:07.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.840 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:07.840 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:07.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.840 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:07.840 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:07.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.840 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:07.840 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:07.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:07.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.841 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:07.841 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:07.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:07.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.841 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.841 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:07.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:07.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.841 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:07.842 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:07.842 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:07.842 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.842 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:07.842 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:07.842 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:07.842 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.842 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:07.842 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:07.842 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:07.842 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:07.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:07.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:07.843 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:07.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:07.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:07.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:07.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:07.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:07.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:07.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:07.844 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.844 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:07.844 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.845 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:07.845 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:07.845 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 63.973423560000001, 2024-04-26T12:06:07.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:07.845 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:07.845 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.845 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:07.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:07.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:07.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:07.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:07.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:07.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:07.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:07.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:07.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:07.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:07.847 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.847 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.847 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:07.847 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:07.847 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:07.847 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.847 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.847 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.847 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:07.847 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:07.847 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.847 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.847 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:07.847 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:07.847 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:07.848 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.848 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:07.848 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:07.848 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:07.848 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.848 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:07.848 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:07.848 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:07.848 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.848 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:07.848 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:07.848 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:07.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:07.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:07.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:07.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:07.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:07.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:07.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:07.850 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:07.850 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.850 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:07.850 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.850 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.850 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:07.850 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:07.850 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 63.973384600999999, 2024-04-26T12:06:07.850 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:07.850 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:07.850 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.850 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:07.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.851 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:07.851 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:07.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.851 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.851 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:07.851 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:07.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.851 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.851 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:07.851 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:07.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.852 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:07.852 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:07.852 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:07.852 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.852 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:07.852 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:07.852 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:07.852 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.853 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.853 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:07.853 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:07.853 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.853 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:07.853 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:07.853 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:07.853 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.853 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:07.853 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:07.854 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:07.854 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.854 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.854 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:07.854 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:07.854 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:07.854 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.854 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.854 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:07.854 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:07.855 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:07.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.855 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:07.855 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:07.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.856 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:07.856 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:07.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:07.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.856 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.856 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:07.856 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:07.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:07.856 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.856 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:07.856 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.856 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.856 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:07.857 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:07.857 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 63.973349128999999, 2024-04-26T12:06:07.857 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:07.857 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:07.857 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.857 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:07.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.857 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:07.857 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:07.857 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.857 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.857 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:07.857 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:07.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:07.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:07.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:07.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:07.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:07.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:07.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:07.859 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:07.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:07.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.859 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.859 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.859 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:07.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:07.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.859 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.859 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:07.859 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:07.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:07.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.860 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:07.860 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:07.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:07.860 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.860 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:07.860 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:07.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:07.860 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.860 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:07.860 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:07.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:07.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:07.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:07.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:07.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:07.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:07.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:07.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:07.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:07.861 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.862 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:07.862 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.862 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:07.862 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:07.862 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 63.97327044, 2024-04-26T12:06:07.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:07.862 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:07.862 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:07.862 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:07.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.862 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:07.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:07.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:07.863 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:07.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:07.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:07.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:07.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:07.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:07.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:07.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:07.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:07.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:07.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.865 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.865 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:07.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:07.865 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.865 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.865 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:07.865 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:07.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:07.865 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.865 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.865 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:07.865 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:07.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:07.865 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.866 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:07.866 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:07.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:07.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.866 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:07.866 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:07.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:07.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.866 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:07.866 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:07.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:07.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:07.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:07.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:07.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:07.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:07.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:07.867 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.867 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:07.867 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.868 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:07.868 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:07.868 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 63.973119592000003, 2024-04-26T12:06:07.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:07.868 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:07.868 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:07.868 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:07.868 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:07.868 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:07.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.868 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.868 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:07.868 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:07.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:07.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:07.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:07.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:07.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:07.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:07.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:07.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:07.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:07.870 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:07.870 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.870 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.870 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:07.870 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:07.870 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:07.870 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.870 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.870 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:07.870 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:07.870 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:07.870 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.870 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.870 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:07.871 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:07.871 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:07.871 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:07.871 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:07.871 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:07.871 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:07.871 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:07.871 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.871 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:07.871 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.871 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:07.871 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:07.871 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:07.873 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:07.871+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:07.873 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:07.938 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-26T12:06:07.974 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:07.972+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:07.976 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:07.976 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:07.976 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:06:07.976 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:07.985 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:08.074 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:08.072+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:08.126 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:08.127 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:08.127 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:08.127 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:08.127 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:08.136 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:08.179 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:08.178+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:08.238 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:08.239 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:08.239 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:08.239 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:08.239 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.239 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:08.239 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:08.239 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 64.456414238999997, 2024-04-26T12:06:08.239 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:06:08.239 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:08.239 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.239 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:08.240 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.240 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:08.240 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:08.240 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.240 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.240 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.240 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:08.240 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:08.240 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.240 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.240 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.241 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:08.241 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:06:08.241 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:08.241 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.241 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.241 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:08.241 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:06:08.241 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:06:08.241 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.241 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.241 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:08.241 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:06:08.241 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:06:08.241 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.242 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.242 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.242 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:06:08.242 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:06:08.242 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.242 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.242 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:08.242 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:06:08.242 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:06:08.242 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.242 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.242 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:08.243 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:08.243 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:06:08.243 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.243 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.243 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:08.243 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:06:08.243 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:06:08.243 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.243 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.243 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:08.243 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:06:08.243 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:06:08.243 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.243 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.244 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.244 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:06:08.244 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:06:08.244 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.244 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.244 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:08.244 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:06:08.244 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:06:08.244 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.244 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.244 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:08.245 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:06:08.245 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:06:08.245 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.245 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:08.245 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.245 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.245 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.245 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:08.245 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:08.245 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 64.456358918999996, 2024-04-26T12:06:08.245 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:06:08.245 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:08.246 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.246 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:08.246 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.246 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:08.246 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:08.246 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.246 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.246 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.246 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:08.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:08.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.247 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:08.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:06:08.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:08.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.247 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:08.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:06:08.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:06:08.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:08.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:06:08.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:06:08.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:06:08.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:06:08.249 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.249 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:08.249 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:06:08.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:06:08.249 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.249 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:08.249 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:06:08.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:06:08.249 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.249 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:08.249 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:06:08.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:06:08.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.250 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:08.250 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:06:08.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:06:08.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.250 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.250 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:06:08.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:06:08.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:08.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:06:08.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:06:08.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:08.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:06:08.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:06:08.252 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.252 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:08.252 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.252 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:08.252 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:08.252 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 64.456308901, 2024-04-26T12:06:08.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:06:08.252 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:08.252 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.252 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:08.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.253 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:08.253 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:08.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.253 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:08.253 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:08.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:08.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:06:08.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:08.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:06:08.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:06:08.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:08.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:06:08.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:06:08.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:06:08.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:06:08.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:08.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:06:08.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:06:08.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:08.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:06:08.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:06:08.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:08.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:06:08.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:06:08.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:08.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:06:08.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:06:08.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:06:08.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:06:08.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:08.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:06:08.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:06:08.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:08.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:06:08.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:06:08.258 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.258 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:08.258 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.258 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:08.258 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:08.258 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 64.456274264000001, 2024-04-26T12:06:08.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:06:08.259 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:08.259 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.259 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:08.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:08.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:08.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:08.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:08.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:08.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:06:08.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:08.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:06:08.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:06:08.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:08.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:08.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:06:08.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:06:08.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:06:08.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:08.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:06:08.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:06:08.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:08.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:06:08.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:06:08.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:08.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:06:08.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:06:08.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:06:08.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:06:08.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:08.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:06:08.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:06:08.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:08.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:06:08.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:06:08.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:08.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:06:08.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:06:08.266 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.266 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:08.266 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.266 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:08.266 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:08.266 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 64.456235751999998, 2024-04-26T12:06:08.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:06:08.267 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:08.267 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.267 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:08.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:08.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:08.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.268 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:08.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:08.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:08.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:08.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:08.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:08.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:08.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:06:08.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.274 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:08.274 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:06:08.274 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:06:08.274 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.274 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.274 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.275 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:06:08.275 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:06:08.275 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.275 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.275 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:08.275 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:06:08.275 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:06:08.276 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.276 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.276 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:08.276 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:06:08.276 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:06:08.276 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.276 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.277 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:08.277 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:06:08.277 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:06:08.277 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.277 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.277 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.277 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:06:08.277 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:06:08.278 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.278 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.278 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:08.278 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:06:08.278 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:06:08.278 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.278 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.278 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:08.278 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:06:08.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:06:08.279 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.279 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.279 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:08.279 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:06:08.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:06:08.279 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.280 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:08.280 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.280 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.280 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.280 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:08.280 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:08.280 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 64.456205428999994, 2024-04-26T12:06:08.280 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:06:08.281 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:08.281 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.281 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:08.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.281 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:08.281 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:08.281 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.281 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:08.282 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:08.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:08.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:06:08.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:08.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:06:08.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:06:08.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.284 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:08.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:06:08.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:06:08.284 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.284 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:06:08.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:06:08.285 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.285 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:08.285 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:06:08.285 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:06:08.285 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.285 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:08.285 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:06:08.286 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:06:08.286 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.286 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.286 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:08.286 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:06:08.286 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:06:08.286 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.286 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:08.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:06:08.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:06:08.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:06:08.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:06:08.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:08.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:06:08.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:06:08.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:08.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:06:08.289 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:06:08.289 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.289 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:08.289 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.289 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.289 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.289 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:08.290 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:08.290 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 64.456178726999994, 2024-04-26T12:06:08.290 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:06:08.290 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:08.290 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:08.290 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:08.290 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.291 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:08.291 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:08.291 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.291 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.291 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:08.291 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:08.291 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.291 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.291 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:08.291 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:08.291 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.292 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.292 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.292 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:08.292 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:06:08.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:06:08.292 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.292 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.292 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:08.292 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:06:08.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:06:08.292 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.292 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.292 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.292 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:06:08.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:06:08.293 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.293 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.293 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:08.293 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:06:08.293 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:06:08.293 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.293 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.293 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:08.293 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:06:08.293 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:06:08.293 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.293 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.293 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:08.293 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:06:08.293 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:06:08.294 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.294 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:08.294 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.294 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.294 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.294 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:08.294 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:08.294 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 64.456136436999998, 2024-04-26T12:06:08.294 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:06:08.294 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:08.294 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:08.294 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:08.294 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:08.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:08.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:08.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:08.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:08.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:08.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:08.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:06:08.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:06:08.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:08.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:06:08.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:06:08.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:06:08.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:06:08.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.297 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.297 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:08.297 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:06:08.297 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:06:08.297 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.297 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.297 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:08.297 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:06:08.297 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:06:08.297 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.297 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.297 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:08.298 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:06:08.298 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:06:08.298 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.298 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:08.298 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.298 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.298 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.298 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:08.299 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:08.299 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 64.456108358999998, 2024-04-26T12:06:08.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:06:08.299 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:08.299 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:08.299 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:08.299 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.299 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:08.299 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:08.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:08.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:08.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.301 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:08.301 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:06:08.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.301 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:08.301 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:06:08.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:06:08.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.302 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:08.302 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:06:08.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:06:08.302 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.302 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.302 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:06:08.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:06:08.302 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.302 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:08.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:06:08.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:06:08.303 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.303 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:08.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:06:08.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:06:08.303 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.303 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:08.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:06:08.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:06:08.303 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.304 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:08.304 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.304 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.304 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.304 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:08.304 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:08.304 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 64.450113009000006, 2024-04-26T12:06:08.304 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:06:08.304 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:08.304 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.304 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:08.304 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.304 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:08.304 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:08.305 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.305 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.305 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.305 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:08.305 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:08.305 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.305 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.305 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.305 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:08.305 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:06:08.305 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.305 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.305 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.306 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:08.306 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:06:08.306 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:06:08.306 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.306 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.306 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:08.306 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:06:08.306 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:06:08.306 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.306 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.306 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.306 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:06:08.306 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:06:08.307 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.307 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.307 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:08.307 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:06:08.307 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:06:08.307 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.307 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.307 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:08.307 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:06:08.307 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:06:08.307 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.307 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.307 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:08.307 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:06:08.308 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:06:08.308 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.308 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.308 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:08.308 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:06:08.308 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:06:08.308 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.308 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:08.309 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.309 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.309 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.309 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:08.309 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:08.309 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 64.450044043000005, 2024-04-26T12:06:08.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:06:08.310 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:08.310 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.310 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:08.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:08.311 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:08.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.311 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:08.311 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:08.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.312 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.312 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:08.312 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:06:08.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:08.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:06:08.313 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:06:08.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:08.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:06:08.313 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:06:08.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.314 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:06:08.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:06:08.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.314 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:08.314 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:06:08.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:06:08.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.314 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:08.314 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:08.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:06:08.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:08.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:06:08.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:06:08.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:08.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:06:08.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:06:08.315 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.315 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:08.315 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.316 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:08.316 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:08.316 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 64.449549680000004, 2024-04-26T12:06:08.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:06:08.316 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:08.316 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.316 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:08.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:08.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:08.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:08.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:08.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:08.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:08.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:08.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:06:08.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:06:08.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:08.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:06:08.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:06:08.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:06:08.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:06:08.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:08.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:06:08.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:06:08.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:08.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:06:08.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:06:08.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:08.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:06:08.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:06:08.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:08.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:06:08.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:06:08.320 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.320 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:08.320 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.321 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:08.321 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:08.321 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 64.449511415000003, 2024-04-26T12:06:08.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:06:08.321 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:08.321 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.321 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:08.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:08.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:08.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:08.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:08.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:08.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:08.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:08.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:06:08.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:06:08.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:08.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:06:08.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:06:08.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:06:08.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:06:08.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:08.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:06:08.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:06:08.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:08.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:06:08.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:06:08.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:08.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:06:08.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:06:08.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:08.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:06:08.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:06:08.325 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.325 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:08.325 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.325 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:06:08.325 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:08.325 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 64.448831530000007, 2024-04-26T12:06:08.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:06:08.325 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:08.326 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:08.326 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:08.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:08.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:08.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:08.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:08.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:08.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:08.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:08.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:06:08.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:06:08.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:08.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:06:08.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:06:08.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:06:08.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:06:08.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:08.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:06:08.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:06:08.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:08.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:06:08.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:06:08.329 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.329 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:08.329 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.329 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:08.329 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:08.330 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 64.448802350999998, 2024-04-26T12:06:08.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:06:08.330 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:08.330 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:08.330 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:08.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:08.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:08.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:08.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:08.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:08.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:06:08.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:08.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:06:08.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:06:08.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:08.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:06:08.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:06:08.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:06:08.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:06:08.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:08.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:06:08.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:06:08.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.334 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:08.334 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:06:08.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:06:08.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.334 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:08.334 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:06:08.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:06:08.334 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.334 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:08.335 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.335 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.335 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:08.335 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:08.335 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 64.448770539999998, 2024-04-26T12:06:08.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:06:08.335 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:08.335 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:08.335 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:08.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.335 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:08.335 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:08.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:08.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:08.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:08.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:08.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:08.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:08.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:06:08.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:06:08.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:08.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:06:08.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:06:08.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:06:08.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:06:08.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:08.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:06:08.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:06:08.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:08.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:06:08.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:06:08.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.339 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:08.339 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:06:08.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:06:08.339 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.339 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:08.339 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.339 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:08.339 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:08.339 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 64.448749183999993, 2024-04-26T12:06:08.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:06:08.339 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:08.340 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:08.340 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:08.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:08.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:08.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:08.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:08.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:08.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:08.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:08.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:08.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:06:08.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:06:08.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:08.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:06:08.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:06:08.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:06:08.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:06:08.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:08.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:06:08.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:06:08.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.343 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:08.343 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:06:08.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:06:08.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.343 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:08.343 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:06:08.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:06:08.343 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.343 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:08.344 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.344 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:06:08.344 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:08.344 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 64.448720730999995, 2024-04-26T12:06:08.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:06:08.344 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:08.345 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:08.345 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:08.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:08.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:08.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:08.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:08.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:08.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:08.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:08.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:06:08.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:06:08.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:08.347 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:06:08.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:06:08.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.347 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:06:08.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:06:08.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:08.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:06:08.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:06:08.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:08.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:06:08.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:06:08.348 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.348 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:08.348 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.348 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:06:08.349 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:08.349 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 64.447998924999993, 2024-04-26T12:06:08.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:06:08.349 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:08.349 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:08.349 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:08.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:08.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:08.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:08.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:08.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:08.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:06:08.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:08.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:08.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:06:08.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:06:08.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:08.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:06:08.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:06:08.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:06:08.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:06:08.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.352 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:08.352 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:06:08.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:06:08.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.352 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:08.352 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:06:08.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:06:08.352 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.352 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:08.352 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.352 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:06:08.353 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:08.353 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 58.731072322000003, 2024-04-26T12:06:08.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:06:08.353 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:08.353 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.353 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:08.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:08.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:08.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:08.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:08.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:08.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:08.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:06:08.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:06:08.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:08.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:06:08.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:06:08.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:08.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:06:08.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:06:08.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:06:08.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:06:08.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:08.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:06:08.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:06:08.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.356 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:08.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:06:08.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:06:08.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.356 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:08.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:06:08.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:06:08.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.356 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:08.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:06:08.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:06:08.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:06:08.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:06:08.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:08.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:06:08.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:06:08.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:08.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:08.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:08.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:06:08.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:06:08.358 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.358 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:08.358 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.358 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:08.358 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:08.358 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:08.360 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:08.358+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:08.361 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:08.461 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:08.459+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:08.466 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:08.466 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:08.466 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:06:08.466 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:08.478 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:08.561 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:08.559+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:08.579 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:08.580 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:08.580 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:08.580 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:08.580 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:08.588 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:08.662 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:08.662+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:08.727 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:06:08.732 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:08.732 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:08.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:08.732 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:08.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.732 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:08.732 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:08.732 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 74.874983674999996, 2024-04-26T12:06:08.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:08.732 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:08.732 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.732 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:08.738 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:08.738 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 74.874877779000002, 2024-04-26T12:06:08.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:08.738 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:08.738 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.738 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:08.738 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:08.738 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:08.738 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:08.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.738 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:08.738 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.738 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:08.738 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:08.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.739 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.739 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.739 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:08.739 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:08.739 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.739 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.739 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.739 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:08.739 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:08.739 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.739 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.739 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.739 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:08.739 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:08.739 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:08.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.740 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.740 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:08.740 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:08.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:08.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.740 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.740 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.740 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:08.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:08.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.740 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.740 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:08.740 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:08.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:08.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.741 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.741 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:08.741 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:08.741 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:08.741 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.741 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.741 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:08.741 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:08.741 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:08.741 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.741 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.741 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:08.741 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:08.741 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:08.741 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.742 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.742 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.742 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:08.742 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:08.742 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.742 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.742 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:08.742 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:08.742 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:08.742 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.742 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.742 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:08.742 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:08.742 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:08.742 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.743 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:08.743 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.743 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.743 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.743 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:08.743 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:08.743 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 74.874862798999999, 2024-04-26T12:06:08.743 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:08.743 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:08.743 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.743 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:08.743 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:08.743 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:08.743 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:08.744 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.744 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:08.744 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.744 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:08.744 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:08.744 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.744 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.744 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.744 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:08.744 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:08.744 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.744 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.744 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.745 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:08.745 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:08.745 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.745 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.745 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.745 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:08.745 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:08.745 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:08.745 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.745 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.745 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:08.745 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:08.745 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:08.745 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.746 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.746 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.746 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:08.746 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:08.746 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.746 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.746 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:08.746 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:08.746 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:08.746 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.746 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.746 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:08.746 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:08.746 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:08.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.747 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:08.747 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:08.747 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:08.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.747 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:08.747 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:08.747 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:08.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.747 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.747 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:08.747 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:08.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.748 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.748 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:08.748 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:08.748 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:08.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.748 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.748 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:08.748 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:08.748 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:08.748 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.748 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:08.748 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.748 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.748 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:08.749 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:08.749 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 74.874818923999996, 2024-04-26T12:06:08.749 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:08.749 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:08.749 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.749 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:08.749 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:08.749 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:08.749 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:08.749 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.749 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:08.749 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.749 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:08.749 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:08.749 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.749 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.750 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.750 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:08.750 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:08.750 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.750 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.750 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.750 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:08.750 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:08.750 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.750 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.750 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.750 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:08.750 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:08.750 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:08.750 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.751 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.751 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:08.751 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:08.751 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:08.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.751 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.751 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.751 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:08.751 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:08.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.751 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.751 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:08.751 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:08.751 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:08.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.752 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.752 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:08.752 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:08.752 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:08.752 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.752 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.752 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:08.752 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:08.752 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:08.752 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.752 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.752 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:08.752 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:08.752 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:08.752 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.752 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.753 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.753 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:08.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:08.753 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.753 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:08.753 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:08.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:08.753 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.753 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:08.753 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:08.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:08.753 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.753 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:08.754 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.754 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.754 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.754 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:08.754 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:08.754 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 74.874733259999999, 2024-04-26T12:06:08.754 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:08.754 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:08.754 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.754 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:08.754 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:08.754 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:08.754 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:08.754 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.754 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:08.755 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.755 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:08.755 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:08.755 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.755 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.755 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:08.755 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:08.755 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.755 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.755 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:08.755 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:08.755 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.756 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.756 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:08.756 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:08.756 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:08.756 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.756 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.756 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:08.756 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:08.756 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:08.756 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.756 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.756 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.756 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:08.756 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:08.756 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.757 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.757 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:08.757 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:08.757 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:08.757 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.757 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.757 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:08.757 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:08.757 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:08.757 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.757 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.757 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:08.757 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:08.757 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:08.757 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.758 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.758 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:08.758 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:08.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:08.758 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.758 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.758 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.758 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:08.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:08.758 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.758 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.758 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:08.758 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:08.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:08.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.759 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:08.759 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:08.759 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:08.759 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.759 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:08.759 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.759 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:08.759 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:08.759 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 64.948828973999994, 2024-04-26T12:06:08.759 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:08.759 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:08.760 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.760 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:08.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:08.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:08.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:08.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:08.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:08.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:08.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:08.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.761 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:08.761 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:08.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:08.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.761 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:08.761 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:08.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:08.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.761 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.761 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:08.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:08.762 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.762 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:08.762 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:08.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:08.762 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.762 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:08.762 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:08.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:08.762 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.762 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:08.762 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:08.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:08.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.763 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.763 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:08.763 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:08.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:08.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.763 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.763 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.763 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:08.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:08.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.763 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.763 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:08.763 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:08.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:08.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.764 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:08.764 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:08.764 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:08.764 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.764 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:08.764 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.764 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:08.764 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:08.764 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 64.948792878999996, 2024-04-26T12:06:08.764 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:08.764 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:08.764 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.765 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:08.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:08.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:08.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:08.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:08.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:08.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:08.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:08.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:08.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:08.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:08.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:08.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:08.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:08.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:08.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:08.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:08.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:08.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:08.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:08.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:08.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:08.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:08.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:08.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:08.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.768 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.768 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:08.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:08.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:08.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.768 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.768 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:08.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:08.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.768 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.768 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:08.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:08.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:08.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.769 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:08.769 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:08.769 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:08.769 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.769 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:08.769 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.769 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:08.769 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:08.769 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 64.948755195000004, 2024-04-26T12:06:08.769 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:08.769 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:08.769 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.770 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:08.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:08.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:08.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:08.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:08.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:08.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:08.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:08.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:08.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:08.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:08.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:08.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:08.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:08.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:08.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:08.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:08.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:08.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:08.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:08.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:08.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:08.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:08.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:08.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:08.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:08.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:08.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:08.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:08.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:08.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:08.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:08.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:08.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:08.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:08.774 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.774 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:08.774 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.774 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:08.774 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:08.774 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 64.948733855, 2024-04-26T12:06:08.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:08.775 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:08.775 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.775 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:08.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:08.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:08.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:08.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:08.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:08.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:08.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:08.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:08.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:08.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:08.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:08.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:08.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:08.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:08.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:08.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:08.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:08.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:08.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:08.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:08.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:08.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:08.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:08.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:08.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:08.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:08.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:08.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:08.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:08.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:08.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:08.779 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.779 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:08.779 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:08.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:08.779 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.779 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:08.779 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.779 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.779 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:08.779 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:08.779 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 64.948711588999998, 2024-04-26T12:06:08.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:08.779 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:08.780 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.780 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:08.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.780 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:08.780 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:08.780 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.780 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.780 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:08.780 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:08.780 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.780 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.780 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:08.780 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:08.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:08.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:08.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:08.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:08.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:08.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:08.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:08.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:08.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:08.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:08.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:08.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:08.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:08.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:08.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:08.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:08.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:08.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:08.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:08.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:08.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:08.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:08.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:08.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:08.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:08.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.784 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:08.784 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:08.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:08.784 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.784 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:08.784 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.784 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:08.784 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:08.784 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 64.948689967000007, 2024-04-26T12:06:08.785 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:08.785 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:08.785 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.785 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:08.785 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.785 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:08.785 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:08.785 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.785 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.785 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.785 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:08.785 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:08.785 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.785 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.785 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.785 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:08.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:08.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.786 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.786 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:08.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:08.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:08.786 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.786 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:08.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:08.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:08.786 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:08.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:08.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:08.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:08.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:08.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:08.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:08.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:08.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:08.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:08.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:08.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:08.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:08.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:08.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:08.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:08.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:08.789 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:08.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:08.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.789 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.789 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:08.789 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:08.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:08.789 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.789 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:08.789 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.789 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.789 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:08.789 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:08.789 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 64.948663401000005, 2024-04-26T12:06:08.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:08.790 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:08.790 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.790 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:08.790 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.790 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:08.790 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:08.790 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.790 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.790 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.790 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:08.790 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:08.790 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.790 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.790 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.790 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:08.791 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:08.791 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.791 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.791 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.791 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:08.791 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:08.791 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:08.791 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.791 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.791 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:08.791 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:08.791 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:08.791 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.791 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.791 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.791 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:08.792 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:08.792 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:08.792 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:08.792 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:08.792 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:08.792 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:08.792 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:08.792 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:08.792 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:08.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:08.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:08.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:08.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:08.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:08.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:08.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:08.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:08.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:08.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.794 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:08.794 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:08.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:08.794 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.794 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:08.794 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.794 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:08.794 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:08.794 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 64.948624889000001, 2024-04-26T12:06:08.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:08.795 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:08.795 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.795 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:08.795 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.795 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:08.795 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:08.795 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.795 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.795 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:08.795 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:08.795 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.795 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.796 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:08.796 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:08.796 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.796 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.796 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.796 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:08.796 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:08.796 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:08.796 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.796 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.796 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:08.796 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:08.796 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:08.796 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.796 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.797 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.797 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:08.797 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:08.797 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.797 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:08.797 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:08.797 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:08.797 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.797 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:08.797 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:08.797 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:08.797 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.798 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:08.798 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:08.798 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:08.798 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.798 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.798 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:08.798 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:08.798 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:08.798 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.798 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.798 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.798 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:08.798 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:08.798 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.798 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.799 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:08.799 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:08.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:08.799 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.799 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.799 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:08.799 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:08.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:08.799 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.799 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:08.799 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.799 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.799 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.799 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:08.799 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:08.800 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 64.948596715999997, 2024-04-26T12:06:08.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:08.800 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:08.800 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.800 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:08.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:08.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:08.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:08.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:08.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:08.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:08.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:08.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:08.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:08.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:08.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:08.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:08.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:08.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:08.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:08.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:08.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:08.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:08.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:08.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:08.803 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.803 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.803 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:08.803 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:08.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:08.803 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.803 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.803 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:08.803 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:08.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:08.803 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.803 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.803 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.803 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:08.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:08.804 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.804 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.804 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:08.804 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:08.804 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:08.804 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.804 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.804 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:08.804 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:08.804 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:08.804 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.804 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:08.804 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.804 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.805 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.805 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:08.805 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:08.805 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 64.948562151999994, 2024-04-26T12:06:08.805 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:08.805 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:08.805 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.805 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:08.805 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.805 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:08.805 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:08.805 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.805 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.805 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.805 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:08.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:08.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:08.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:08.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:08.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:08.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:08.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.809 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.809 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:08.809 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:08.809 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.809 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.809 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:08.809 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:08.809 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:08.809 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.809 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.809 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:08.809 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:08.809 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:08.809 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.809 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:08.810 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.810 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.810 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.810 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:08.810 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:08.810 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 64.947687372000004, 2024-04-26T12:06:08.810 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:08.810 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:08.810 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.810 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:08.810 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.810 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:08.810 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:08.810 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.810 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.811 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.811 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:08.811 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:08.811 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.811 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.811 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.811 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:08.811 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:08.811 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:08.811 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.811 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.811 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:08.811 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:08.811 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:08.811 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:08.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:08.812 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:08.812 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:08.812 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:08.812 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:08.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:08.812 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:08.812 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:08.813 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:08.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:08.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:08.813 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:08.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:08.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:08.813 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:08.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:08.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.814 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.814 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.814 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:08.814 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:08.814 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.814 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.814 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:08.814 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:08.814 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:08.814 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.814 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.814 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:08.814 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:08.814 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:08.814 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.815 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:08.815 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.815 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.815 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.815 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:08.815 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:08.815 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 64.947648412999996, 2024-04-26T12:06:08.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:08.815 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:08.815 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.815 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:08.815 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.815 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:08.815 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:08.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.816 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.816 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.816 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:08.816 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:08.816 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.816 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.816 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.816 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:08.816 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:08.816 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.816 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.816 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.816 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:08.816 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:08.816 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:08.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.818 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.818 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:08.818 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:08.818 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:08.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.818 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.818 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:08.818 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:08.818 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:08.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 64.947612941000003, 2024-04-26T12:06:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 64.947534251999997, 2024-04-26T12:06:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:08.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:08.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:08.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:08.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:08.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:08.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:08.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:08.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:08.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.828 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.828 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.828 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:08.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:08.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.828 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.828 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:08.828 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:08.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:08.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.828 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.828 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:08.828 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:08.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:08.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.829 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:08.829 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:08.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:08.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.829 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:08.829 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:08.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:08.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.829 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:08.829 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:08.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:08.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:08.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:08.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:08.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:08.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:08.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:08.830 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.830 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:08.830 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.830 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:08.831 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:08.831 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 64.947383403999993, 2024-04-26T12:06:08.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:08.831 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:08.831 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:08.831 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:08.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:08.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:08.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:08.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:08.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:08.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:08.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:08.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:08.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:08.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:08.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:08.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:08.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:08.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:08.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:08.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:08.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:08.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:08.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:08.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:08.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:08.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:08.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:08.834 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:08.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:08.834 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:08.834 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:08.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:08.834 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.834 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:08.834 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.834 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:08.834 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:08.834 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:08.836 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:08.836 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:08.835+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:08.855 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:08.856 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:08.874 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T12:06:08.874 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:06:08.898 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:08.898 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:08.936 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:08.935+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:08.944 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:08.944 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:08.953 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:09.037 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:09.035+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:09.094 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:09.095 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:09.103 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:09.138 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:09.136+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:09.205 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:09.205 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:09.214 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:09.260 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:09.258+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:09.318 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:09.318 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:09.327 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:09.368 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:09.366+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:09.440 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:09.438+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:09.469 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:09.469 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:09.477 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:09.543 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:09.541+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:09.620 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:09.620 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:09.629 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:09.673 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:09.671+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:09.734 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:09.734 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:09.743 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:09.784 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:09.783+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:09.845 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:09.844+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:09.885 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:09.886 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:09.895 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:09.946 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:09.944+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:09.954 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:06:10.036 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:10.036 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:10.045 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:10.046 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:10.045+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:10.147 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:10.146+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:10.148 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:10.148 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:10.157 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:10.248 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:10.247+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:10.258 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:10.258 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:10.267 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:10.350 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:10.348+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:10.370 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:10.370 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:10.379 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:10.451 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:10.449+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:10.484 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:10.484 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:10.492 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:10.552 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:10.551+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:10.594 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:10.594 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:10.603 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:10.653 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:10.652+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:10.705 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:10.706 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:10.715 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:10.753 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:10.752+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:10.818 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:10.818 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:10.827 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:10.870 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:10.869+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:10.912 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:06:10.929 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:10.929 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:10.938 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:10.951 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-26T12:06:10.979 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:10.978+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:11.048 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:11.049 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:11.056 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:11.055+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:11.077 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T12:06:11.077 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:06:11.080 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:11.080 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:11.089 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:11.094 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:11.094 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:11.157 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:11.156+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:11.193 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:11.193 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:11.194 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:06:11.194 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:11.203 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:11.258 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:11.257+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:11.303 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:11.303 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:11.304 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:11.304 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:11.304 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:11.312 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:11.385 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:06:11.396 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:11.395+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:11.456 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:11.456 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:11.456 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:11.456 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:11.456 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.456 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:11.456 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:11.456 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 67.673663089000001, 2024-04-26T12:06:11.457 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:06:11.457 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:11.457 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.457 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:11.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.457 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:11.457 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:11.457 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.457 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.457 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:11.457 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:11.457 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.457 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.458 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:11.458 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:06:11.458 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:11.458 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.458 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.458 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:11.458 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:06:11.458 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:06:11.458 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.458 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.458 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:11.458 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:06:11.458 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:06:11.459 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.459 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.459 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:06:11.459 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:06:11.459 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.459 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:11.459 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:06:11.459 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:06:11.459 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.459 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:11.459 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:11.460 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:06:11.460 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.460 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.460 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:11.460 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:06:11.460 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:06:11.460 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.460 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.460 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:11.460 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:06:11.460 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:06:11.460 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.460 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.461 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:11.461 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:06:11.461 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:06:11.461 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.461 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.461 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:11.461 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:06:11.461 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:06:11.461 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.461 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.461 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:11.461 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:06:11.461 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:06:11.461 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.462 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:11.462 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.462 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.462 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.462 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:11.462 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:11.462 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 67.673607769, 2024-04-26T12:06:11.462 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:06:11.462 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:11.462 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.462 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:11.462 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.462 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:11.462 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:11.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.463 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.463 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:11.463 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:11.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.463 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.463 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:11.463 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:06:11.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:11.463 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.463 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:11.463 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:06:11.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:06:11.464 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:11.464 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:06:11.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:06:11.464 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.464 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:06:11.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:06:11.464 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:11.464 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:06:11.465 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:06:11.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.465 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:11.465 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:06:11.465 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:06:11.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.465 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:11.465 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:06:11.465 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:06:11.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.465 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:11.466 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:06:11.466 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:06:11.466 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.466 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:11.466 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:06:11.466 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:06:11.466 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.466 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:11.466 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:06:11.466 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:06:11.466 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.467 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:11.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:06:11.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:06:11.467 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.467 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:11.467 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.467 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.467 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:11.467 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:11.467 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 67.673557751000004, 2024-04-26T12:06:11.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:06:11.467 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:11.467 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.467 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:11.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.468 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:11.468 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:11.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.468 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.468 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:11.468 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:11.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.468 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.468 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:11.468 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:06:11.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.469 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.469 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.469 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:11.469 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:06:11.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:06:11.469 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.469 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.469 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:11.469 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:06:11.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:06:11.469 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.469 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:06:11.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:06:11.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:11.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:06:11.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:06:11.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:11.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:06:11.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:06:11.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.471 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:11.471 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:06:11.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:06:11.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.471 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:11.471 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:06:11.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:06:11.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.471 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:11.471 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:06:11.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:06:11.472 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.472 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.472 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:11.472 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:06:11.472 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:06:11.472 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.472 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.472 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:11.472 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:06:11.472 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:06:11.472 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.472 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:11.472 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.472 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.473 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.473 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:11.473 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:11.473 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 67.673523114000005, 2024-04-26T12:06:11.473 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:06:11.473 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:11.473 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.473 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:11.473 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.473 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:11.473 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:11.473 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.473 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.473 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.473 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:11.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:11.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.474 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:11.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:06:11.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.474 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:11.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:06:11.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:06:11.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.474 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:11.475 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:11.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:06:11.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.475 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:06:11.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:06:11.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:11.475 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:06:11.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:06:11.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:11.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:06:11.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:06:11.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.476 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:11.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:06:11.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:06:11.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.476 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:11.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:06:11.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:06:11.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.476 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:11.477 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:06:11.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:06:11.477 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.477 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:11.477 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:06:11.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:06:11.477 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.477 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:11.477 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:06:11.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:06:11.477 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.477 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:11.477 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.478 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.478 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:11.478 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:11.478 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 67.673484602000002, 2024-04-26T12:06:11.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:06:11.478 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:11.478 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.478 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:11.478 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.478 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:11.478 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:11.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.479 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.479 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.479 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:11.479 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:11.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.479 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.479 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.479 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:11.479 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:11.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:11.479 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.479 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.479 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:11.479 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:11.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:06:11.480 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.480 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:11.480 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:06:11.480 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:06:11.480 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.480 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.480 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:06:11.480 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:06:11.480 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.480 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:11.480 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:06:11.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:06:11.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:11.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:06:11.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:06:11.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:11.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:06:11.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:06:11.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:11.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:06:11.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:06:11.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:11.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:06:11.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:06:11.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:11.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:06:11.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:06:11.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.483 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:11.483 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:06:11.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:06:11.483 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.483 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:11.483 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.483 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.483 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:11.483 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:11.483 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 67.673454278999998, 2024-04-26T12:06:11.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:06:11.484 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:11.484 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.484 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:11.484 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.484 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:11.484 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:11.484 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.484 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.484 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.484 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:11.484 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:11.484 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.484 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.485 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.485 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:11.485 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:06:11.485 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.485 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.485 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.485 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:11.485 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:06:11.485 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:06:11.485 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.485 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.485 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:11.485 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:06:11.486 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:06:11.486 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.486 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.486 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.486 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:06:11.486 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:06:11.486 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.486 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.486 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:11.486 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:06:11.486 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:06:11.486 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.486 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.486 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:11.486 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:06:11.487 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:06:11.487 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.487 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.487 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:11.487 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:06:11.487 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:06:11.487 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.487 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.487 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:11.487 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:06:11.487 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:06:11.487 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.487 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.487 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:11.488 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:06:11.488 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:06:11.488 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.488 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.488 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:11.488 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:06:11.488 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:06:11.488 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.488 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.488 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:11.488 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:06:11.488 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:06:11.488 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.488 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:11.489 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.489 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.489 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.489 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:11.489 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:11.489 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 67.673427576999998, 2024-04-26T12:06:11.489 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:06:11.489 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:11.489 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:11.489 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:11.489 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.489 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:11.489 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:11.489 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.489 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.490 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.490 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:11.490 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:11.490 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.490 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.490 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:11.490 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:11.490 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.490 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.490 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:11.490 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:06:11.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:06:11.491 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.491 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:11.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:06:11.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:06:11.491 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.491 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:06:11.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:06:11.491 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.491 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:11.492 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:06:11.492 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:06:11.492 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.492 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.492 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:11.492 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:06:11.492 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:06:11.492 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.492 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.492 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:11.492 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:06:11.492 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:06:11.492 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.492 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:11.493 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.493 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.493 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.493 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:11.493 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:11.493 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 67.673385287000002, 2024-04-26T12:06:11.493 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:06:11.493 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:11.493 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:11.493 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:11.493 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.493 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:11.493 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:11.493 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.494 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.494 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.494 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:11.494 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:11.494 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.494 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.494 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.494 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:11.494 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:11.494 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.494 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.494 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.494 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:11.494 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:06:11.494 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:06:11.495 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.495 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.495 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:11.495 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:06:11.495 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:06:11.495 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.495 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.495 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.495 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:06:11.495 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:06:11.495 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.495 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.495 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:11.496 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:06:11.496 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:06:11.496 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.496 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.496 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:11.496 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:06:11.496 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:06:11.496 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.496 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.496 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:11.496 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:06:11.496 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:06:11.496 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.497 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:11.497 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.497 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.497 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.497 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:11.497 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:11.497 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 67.673357209000002, 2024-04-26T12:06:11.497 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:06:11.497 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:11.497 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:11.497 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:11.497 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.497 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:11.498 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:11.498 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.498 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.498 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.498 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:11.498 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:11.498 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.498 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.498 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.498 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:11.498 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:06:11.498 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.498 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.498 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.499 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:11.499 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:06:11.499 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:06:11.499 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.499 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.499 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:11.499 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:06:11.499 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:06:11.499 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.499 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.499 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.499 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:06:11.499 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:06:11.499 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.500 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.500 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:11.500 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:06:11.500 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:06:11.500 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.500 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.500 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:11.500 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:06:11.500 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:06:11.500 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.500 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.500 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:11.500 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:06:11.500 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:06:11.501 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.501 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:11.501 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.501 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.501 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.501 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:11.501 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:11.501 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 67.667361858999996, 2024-04-26T12:06:11.501 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:06:11.501 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:11.501 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.501 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:11.501 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.501 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:11.502 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:11.502 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.502 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.502 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.502 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:11.502 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:11.502 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.502 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.502 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.502 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:11.502 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:06:11.502 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.502 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.502 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.502 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:11.503 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:06:11.503 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:06:11.503 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.503 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.503 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:11.503 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:06:11.503 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:06:11.503 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.503 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.503 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.503 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:06:11.503 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:06:11.503 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.503 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.504 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:11.504 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:06:11.504 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:06:11.504 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.504 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.504 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:11.504 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:06:11.504 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:06:11.504 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.504 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.504 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:11.504 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:06:11.504 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:06:11.504 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.504 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.505 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:11.505 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:06:11.505 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:06:11.505 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.505 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:11.505 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.505 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.505 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.505 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:11.505 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:11.505 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 67.667292892999996, 2024-04-26T12:06:11.505 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:06:11.505 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:11.505 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.506 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:11.506 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.506 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:11.506 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:11.506 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.506 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.506 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.506 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:11.506 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:11.506 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.506 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.506 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.506 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:11.506 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:06:11.507 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.507 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.507 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.507 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:11.507 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:06:11.507 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:06:11.507 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.507 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.507 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:11.507 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:06:11.507 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:06:11.507 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.507 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.507 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.507 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:06:11.508 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:06:11.508 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.508 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.508 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:11.508 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:06:11.508 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:06:11.508 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.508 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.508 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:11.508 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:11.508 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:06:11.508 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.508 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.508 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:11.508 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:06:11.509 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:06:11.509 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.509 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.509 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:11.509 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:06:11.509 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:06:11.509 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.509 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:11.509 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.509 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.509 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.509 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:11.509 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:11.509 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 67.666798529999994, 2024-04-26T12:06:11.509 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:06:11.510 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:11.510 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.510 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:11.510 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.510 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:11.510 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:11.510 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.510 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.510 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.510 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:11.510 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:11.510 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.510 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.511 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.511 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:11.511 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:11.511 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.511 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.511 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.511 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:11.511 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:06:11.511 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:06:11.511 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.511 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.511 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:11.511 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:06:11.511 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:06:11.512 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.512 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.512 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.512 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:06:11.512 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:06:11.512 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.512 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.512 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:11.512 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:06:11.512 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:06:11.512 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.512 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.512 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:11.512 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:06:11.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:06:11.513 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.513 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:11.513 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:06:11.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:06:11.513 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.513 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:11.513 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:06:11.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:06:11.513 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.513 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:11.513 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.513 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.514 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:11.514 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:11.514 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 67.666760264999994, 2024-04-26T12:06:11.514 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:06:11.514 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:11.514 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.514 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:11.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.514 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:11.514 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:11.514 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.514 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.515 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:11.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:11.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.515 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:11.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:11.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.515 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:11.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:06:11.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:06:11.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.516 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:11.516 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:06:11.516 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:06:11.516 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.516 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.516 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:06:11.516 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:06:11.516 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.516 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:11.516 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:06:11.516 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:06:11.516 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.517 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:11.517 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:06:11.517 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:06:11.517 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.517 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.517 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:11.517 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:06:11.517 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:06:11.517 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.517 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.517 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:11.517 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:06:11.517 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:06:11.517 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.517 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:11.518 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.518 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.518 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.518 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:06:11.518 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:11.518 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 67.666080379999997, 2024-04-26T12:06:11.518 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:06:11.518 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:11.518 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:11.518 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:11.518 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.518 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:11.518 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:11.518 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.518 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:11.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:11.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:11.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:11.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:11.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:06:11.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:06:11.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:11.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:06:11.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:06:11.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:06:11.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:06:11.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:11.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:06:11.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:06:11.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:11.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:06:11.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:06:11.521 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.521 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:11.521 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.521 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:11.521 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:11.521 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 67.666051201000002, 2024-04-26T12:06:11.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:06:11.522 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:11.522 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:11.522 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:11.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.522 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:11.522 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:11.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.522 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:11.522 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:11.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.523 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:11.523 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:06:11.523 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.523 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.523 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.523 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:11.523 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:06:11.523 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:06:11.523 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.523 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.523 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:11.523 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:06:11.523 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:06:11.523 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.523 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.524 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.524 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:06:11.524 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:06:11.524 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.524 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.524 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:11.524 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:06:11.524 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:06:11.524 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.524 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.524 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:11.524 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:06:11.524 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:06:11.524 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.525 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.525 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:11.525 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:06:11.525 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:06:11.525 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.525 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:11.525 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.525 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.525 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:11.525 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:11.525 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 67.666019390000002, 2024-04-26T12:06:11.525 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:06:11.525 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:11.526 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:11.526 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:11.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:11.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:11.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:11.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:11.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:11.527 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:11.527 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:11.527 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.527 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.527 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:11.527 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:06:11.527 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:06:11.527 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.527 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.527 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:11.527 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:06:11.527 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:06:11.527 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.527 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:06:11.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:06:11.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:11.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:06:11.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:06:11.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:11.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:06:11.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:06:11.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.529 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:11.529 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:06:11.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:06:11.529 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.529 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:11.529 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.529 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:11.529 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:11.529 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 67.665998033999998, 2024-04-26T12:06:11.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:06:11.529 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:11.529 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:11.530 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:11.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.530 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:11.530 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:11.530 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.530 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.530 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:11.530 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:11.530 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.530 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.530 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:11.530 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:11.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:11.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:11.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:06:11.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:06:11.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:11.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:06:11.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:06:11.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.532 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:06:11.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:06:11.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:11.532 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:06:11.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:06:11.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:11.532 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:06:11.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:06:11.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:11.533 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:06:11.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:06:11.533 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.533 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:11.533 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.533 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.533 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.533 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:06:11.533 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:11.533 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 67.665969580999999, 2024-04-26T12:06:11.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:06:11.533 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:11.533 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:11.533 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:11.533 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:11.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:11.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.534 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:11.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:11.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.534 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:11.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:11.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:11.535 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:06:11.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:06:11.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:11.535 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:06:11.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:06:11.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.535 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:06:11.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:06:11.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:11.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:06:11.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:06:11.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:11.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:06:11.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:06:11.536 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.536 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:11.536 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.536 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:06:11.537 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:11.537 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 67.665247774999997, 2024-04-26T12:06:11.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:06:11.537 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:11.537 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:11.537 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:11.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.537 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:11.537 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:11.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.537 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.537 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:11.537 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:11.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:11.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:06:11.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:11.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:11.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:06:11.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:06:11.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:11.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:06:11.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:06:11.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.539 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.539 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:06:11.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:06:11.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.539 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:11.539 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:06:11.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:06:11.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.539 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:11.539 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:06:11.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:06:11.540 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.540 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:11.540 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.540 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:06:11.540 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:11.540 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 61.948321172, 2024-04-26T12:06:11.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:06:11.540 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:11.540 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.540 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:11.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:11.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:11.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:11.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:11.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:11.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:11.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:06:11.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:06:11.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:11.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:06:11.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:06:11.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:11.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:06:11.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:06:11.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:06:11.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:06:11.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:11.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:06:11.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:06:11.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:11.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:06:11.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:06:11.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:11.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:06:11.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:06:11.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.544 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:11.544 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:06:11.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:06:11.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.544 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:11.544 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:06:11.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:06:11.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.544 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:11.544 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:06:11.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:06:11.545 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:11.545 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:11.545 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:11.545 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:06:11.545 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:06:11.545 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.545 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:11.545 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.545 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:11.545 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:11.545 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:11.547 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:11.545+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:11.548 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:11.549 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-04-26T12:06:11.647 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:11.646+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:11.651 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:11.652 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:11.652 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:06:11.652 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:11.661 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:11.748 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:11.746+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:11.763 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:11.763 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:11.763 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:11.763 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:11.763 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:11.772 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:11.856 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:11.855+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:11.916 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:11.916 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:11.916 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:11.917 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:11.917 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.917 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:11.917 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:11.917 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 78.059352867000001, 2024-04-26T12:06:11.917 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:11.917 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:11.917 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.917 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:11.917 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:11.917 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:11.917 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:11.917 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.917 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:11.917 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.918 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:11.918 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:11.918 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.918 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.918 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.918 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:11.918 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:11.918 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.918 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.918 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.918 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:11.918 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:11.918 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.918 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.919 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.919 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:11.919 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:11.919 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:11.919 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.919 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.919 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:11.919 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:11.919 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:11.919 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.919 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.919 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.919 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:11.919 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:11.920 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.920 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.920 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:11.920 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:11.920 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:11.920 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.920 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.920 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:11.920 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:11.920 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:11.920 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.920 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.920 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:11.920 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:11.921 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:11.921 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.921 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.921 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:11.921 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:11.921 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:11.921 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.921 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.921 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:11.921 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:11.921 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:11.921 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.921 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.921 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:11.922 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:11.922 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:11.922 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.922 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.922 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:11.922 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:11.922 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:11.922 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.922 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:11.922 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.922 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.922 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.922 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:11.922 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:11.923 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 78.059246970999993, 2024-04-26T12:06:11.923 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:11.923 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:11.923 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.923 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:11.923 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:11.923 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:11.923 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:11.923 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.923 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:11.923 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.923 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:11.923 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:11.923 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.923 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.924 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.924 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:11.924 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:11.924 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.924 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.924 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.924 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:11.924 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:11.924 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.924 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.924 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.924 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:11.924 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:11.924 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:11.924 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.925 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.925 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:11.925 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:11.925 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:11.925 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.925 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.925 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.925 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:11.925 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:11.925 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.925 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.925 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:11.925 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:11.925 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:11.926 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.926 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.926 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:11.926 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:11.926 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:11.926 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.926 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.926 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:11.926 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:11.926 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:11.926 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.926 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.926 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:11.926 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:11.927 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:11.927 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.927 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.927 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:11.927 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:11.927 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:11.927 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.927 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.927 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:11.927 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:11.927 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:11.927 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.927 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.927 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:11.927 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:11.928 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:11.928 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.928 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:11.928 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.928 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.928 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.928 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:11.928 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:11.928 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 78.059231991000004, 2024-04-26T12:06:11.928 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:11.928 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:11.928 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.928 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:11.928 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:11.928 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:11.929 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:11.929 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.929 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:11.929 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.929 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:11.929 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:11.929 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.929 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.929 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.929 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:11.929 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:11.929 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.929 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.929 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.929 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:11.930 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:11.930 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.930 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.930 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.930 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:11.930 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:11.930 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:11.930 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.930 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.930 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:11.930 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:11.930 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:11.930 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.931 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.931 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.931 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:11.931 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:11.931 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.931 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.931 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:11.931 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:11.931 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:11.931 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.931 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.931 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:11.931 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:11.931 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:11.932 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.932 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.932 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:11.932 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:11.932 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:11.932 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.932 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.932 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:11.932 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:11.932 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:11.932 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.932 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.932 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:11.932 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:11.933 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:11.933 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.933 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.933 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:11.933 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:11.933 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:11.933 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.933 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.933 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:11.933 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:11.933 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:11.933 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.933 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:11.933 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.933 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.934 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.934 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:11.934 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:11.934 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 78.059188116000001, 2024-04-26T12:06:11.934 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:11.934 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:11.934 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.934 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:11.934 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:11.934 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:11.934 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:11.934 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.934 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:11.934 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.935 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:11.935 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:11.935 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.935 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.935 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.935 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:11.935 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:11.935 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.935 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.935 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.935 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:11.935 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:11.935 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.935 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.935 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.936 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:11.936 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:11.936 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:11.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.936 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.936 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:11.936 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:11.936 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:11.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.936 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.936 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.936 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:11.936 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:11.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.936 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.937 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:11.937 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:11.937 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:11.937 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.937 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.937 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:11.937 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:11.937 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:11.937 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.937 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.937 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:11.937 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:11.937 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:11.937 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.937 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.938 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:11.938 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:11.938 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:11.938 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.938 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.938 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:11.938 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:11.938 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:11.938 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.938 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.938 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:11.938 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:11.938 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:11.938 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.939 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.939 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:11.939 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:11.939 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:11.939 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.939 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:11.939 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.939 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.939 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.939 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:11.939 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:11.939 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 78.059102452000005, 2024-04-26T12:06:11.939 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:11.939 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:11.939 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.940 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:11.940 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:11.940 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:11.940 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:11.940 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.940 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:11.940 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.940 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:11.940 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:11.940 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.940 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.940 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.940 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:11.940 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:11.940 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.941 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.941 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.941 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:11.941 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:11.941 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.941 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.941 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.941 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:11.941 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:11.941 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:11.941 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.941 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.941 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:11.941 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:11.941 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:11.942 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.942 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.942 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.942 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:11.942 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:11.942 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.942 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.942 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:11.942 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:11.942 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:11.942 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.942 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.942 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:11.942 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:11.943 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:11.943 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.943 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.943 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:11.943 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:11.943 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:11.943 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.943 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.943 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:11.943 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:11.943 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:11.943 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.943 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.943 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:11.944 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:11.944 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:11.944 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.944 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.944 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:11.944 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:11.944 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:11.944 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.944 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.944 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:11.944 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:11.944 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:11.944 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.944 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:11.944 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.945 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.945 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.945 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:11.945 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:11.945 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 68.133198166, 2024-04-26T12:06:11.945 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:11.945 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:11.945 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.945 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:11.945 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.945 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:11.945 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:11.945 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.945 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.946 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.946 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:11.946 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:11.946 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.946 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.946 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.946 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:11.946 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:11.946 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:11.946 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.946 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.946 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:11.946 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:11.946 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:11.947 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.947 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.947 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:11.947 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:11.947 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:11.947 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.947 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.947 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.947 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:11.947 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:11.947 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.947 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.947 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:11.947 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:11.947 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:11.948 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.948 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.948 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:11.948 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:11.948 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:11.948 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.948 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.948 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:11.948 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:11.948 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:11.948 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.948 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.948 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:11.948 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:11.948 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:11.949 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.949 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.949 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:11.949 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:11.949 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:11.949 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.949 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.949 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:11.949 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:11.949 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:11.949 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.949 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.949 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:11.949 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:11.950 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:11.950 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.950 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:11.950 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.950 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.950 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.950 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:11.950 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:11.950 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 68.133162071000001, 2024-04-26T12:06:11.950 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:11.950 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:11.950 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.950 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:11.950 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.950 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:11.951 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:11.951 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.951 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.951 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.951 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:11.951 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:11.951 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.951 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.951 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.951 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:11.951 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:11.951 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:11.951 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.951 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.952 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:11.952 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:11.952 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:11.952 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.952 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.952 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:11.952 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:11.952 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:11.952 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.952 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.952 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.952 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:11.952 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:11.952 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.952 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.952 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:11.953 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:11.953 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:11.953 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.953 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.953 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:11.953 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:11.953 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:11.953 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.953 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.953 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:11.953 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:11.953 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:11.953 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.953 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.954 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:11.954 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:11.954 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:11.954 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.954 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.954 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:11.954 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:11.954 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:11.954 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.954 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.954 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:11.954 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:11.954 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:11.954 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.954 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.955 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:11.955 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:11.955 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:11.955 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.955 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:11.955 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.955 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.955 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.955 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:11.955 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:11.955 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 68.133124386999995, 2024-04-26T12:06:11.955 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:11.955 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:11.955 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.956 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:11.956 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.956 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:11.956 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:11.956 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.956 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.956 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.956 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:11.956 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:11.956 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.956 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.956 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.956 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:11.956 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:11.957 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.957 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.957 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.957 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:11.957 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:11.957 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:11.957 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.957 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.957 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:11.957 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:11.957 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:11.957 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.957 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.957 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.957 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:11.958 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:11.958 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.958 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.958 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:11.958 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:11.958 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:11.958 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.958 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.958 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:11.958 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:11.958 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:11.958 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.958 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.959 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:11.959 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:11.959 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:11.959 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.959 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.959 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:11.959 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:11.959 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:11.959 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.959 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.959 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:11.959 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:11.959 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:11.959 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.959 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.960 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:11.960 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:11.960 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:11.960 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.960 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.960 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:11.960 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:11.960 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:11.960 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.960 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:11.960 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.960 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.960 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.960 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:11.960 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:11.961 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 68.133103047000006, 2024-04-26T12:06:11.961 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:11.961 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:11.961 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.961 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:11.961 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.961 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:11.961 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:11.961 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.961 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.961 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.961 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:11.961 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:11.961 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.962 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.962 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.962 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:11.962 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:11.962 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.962 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.962 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.962 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:11.962 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:11.962 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:11.962 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.962 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.966 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:11.966 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:11.966 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:11.966 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.966 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.966 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.966 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:11.966 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:11.967 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.967 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.967 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:11.967 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:11.967 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:11.967 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.967 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.967 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:11.967 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:11.967 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:11.967 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.967 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.967 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:11.967 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:11.967 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:11.968 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.968 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.968 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:11.968 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:11.968 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:11.968 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.968 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.968 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:11.968 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:11.968 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:11.968 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.968 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.968 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:11.968 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:11.968 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:11.969 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.969 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.969 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:11.969 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:11.969 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:11.969 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.969 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:11.969 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.969 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.969 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.969 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:11.969 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:11.969 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 68.133080781000004, 2024-04-26T12:06:11.969 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:11.970 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:11.970 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.970 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:11.970 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.970 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:11.970 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:11.970 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.970 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.970 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.970 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:11.970 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:11.970 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.970 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.970 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.971 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:11.971 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:11.971 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.971 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.971 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.971 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:11.971 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:11.971 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:11.971 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.971 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.971 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:11.971 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:11.971 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:11.971 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.971 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.972 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.972 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:11.972 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:11.972 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.972 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.972 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:11.972 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:11.972 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:11.972 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.972 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.972 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:11.972 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:11.972 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:11.972 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.973 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.973 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:11.973 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:11.973 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:11.973 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.973 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.973 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:11.973 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:11.973 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:11.973 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.973 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.973 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:11.973 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:11.973 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:11.973 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.974 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.974 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:11.974 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:11.974 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:11.974 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.974 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.974 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:11.974 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:11.974 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:11.974 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.974 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:11.974 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.974 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.974 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.975 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:11.975 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:11.975 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 68.133059158999998, 2024-04-26T12:06:11.975 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:11.975 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:11.975 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.975 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:11.975 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.975 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:11.975 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:11.976 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.976 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.976 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.976 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:11.976 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:11.976 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.976 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.976 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.976 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:11.976 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:11.976 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.976 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.976 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.976 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:11.976 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:11.977 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:11.977 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.977 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.977 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:11.977 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:11.977 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:11.977 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.977 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.977 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.977 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:11.977 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:11.977 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.977 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.977 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:11.978 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:11.978 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:11.978 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.978 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.978 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:11.978 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:11.978 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:11.978 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.978 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.978 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:11.978 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:11.978 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:11.978 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.978 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.978 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:11.979 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:11.979 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:11.979 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.979 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.979 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:11.979 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:11.979 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:11.979 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.979 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.979 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:11.979 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:11.979 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:11.979 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.979 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.980 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:11.980 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:11.980 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:11.980 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.980 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:11.980 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.980 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.980 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.980 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:11.980 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:11.980 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 68.133032592999996, 2024-04-26T12:06:11.980 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:11.980 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:11.980 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.980 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:11.981 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.981 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:11.981 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:11.981 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.981 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.981 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.981 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:11.981 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:11.981 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.981 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.981 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.981 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:11.981 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:11.981 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.981 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.982 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.982 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:11.982 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:11.982 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:11.982 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.982 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.982 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:11.982 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:11.982 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:11.982 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.982 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.982 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.982 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:11.982 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:11.982 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.983 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.983 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:11.983 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:11.983 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:11.983 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.983 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.983 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:11.983 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:11.983 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:11.983 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.983 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.983 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:11.983 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:11.983 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:11.983 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.984 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.984 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:11.984 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:11.984 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:11.984 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.984 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.984 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:11.984 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:11.984 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:11.984 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.984 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.984 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:11.985 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:11.985 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:11.985 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.985 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.985 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:11.985 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:11.985 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:11.985 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.985 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:11.985 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.985 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.985 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.985 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:11.985 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:11.985 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 68.132994081000007, 2024-04-26T12:06:11.986 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:11.986 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:11.986 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.986 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:11.986 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.986 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:11.986 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:11.986 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.986 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.986 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.986 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:11.986 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:11.986 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.987 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.987 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.987 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:11.987 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:11.987 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.987 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.987 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.987 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:11.987 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:11.987 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:11.987 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.987 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.987 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:11.987 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:11.988 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:11.988 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.988 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.988 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.988 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:11.988 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:11.988 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.988 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.988 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:11.988 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:11.988 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:11.988 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.988 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.988 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:11.988 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:11.989 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:11.989 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.989 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.989 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:11.989 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:11.989 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:11.989 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.989 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.989 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:11.989 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:11.989 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:11.989 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.989 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.989 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:11.990 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:11.990 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:11.990 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.990 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.990 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:11.990 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:11.990 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:11.990 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.990 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.990 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:11.990 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:11.990 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:11.990 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.990 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:11.991 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.991 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.991 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.991 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:11.991 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:11.991 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 68.132965908000003, 2024-04-26T12:06:11.991 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:11.991 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:11.991 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.991 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:11.991 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.991 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:11.991 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:11.991 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.991 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.992 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.992 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:11.992 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:11.992 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.992 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.992 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.992 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:11.992 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:11.992 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.992 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.992 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.992 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:11.992 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:11.992 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:11.992 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.993 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.993 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:11.993 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:11.993 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:11.993 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.993 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.993 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.993 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:11.993 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:11.993 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.993 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.993 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:11.993 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:11.993 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:11.993 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.994 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.994 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:11.994 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:11.994 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:11.994 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.994 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.994 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:11.994 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:11.994 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:11.994 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.994 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.994 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:11.994 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:11.994 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:11.995 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.995 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.995 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:11.995 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:11.995 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:11.995 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.995 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.995 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:11.995 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:11.995 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:11.995 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.995 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.995 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:11.995 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:11.995 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:11.996 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.996 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:11.996 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:11.996 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.996 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.996 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:11.996 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:11.996 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 68.132931343999999, 2024-04-26T12:06:11.996 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:11.996 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:11.996 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:11.996 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:11.996 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.996 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:11.996 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:11.997 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.997 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.997 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.997 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:11.997 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:11.997 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:11.997 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.997 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.997 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:11.997 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:11.997 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:11.997 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.997 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.997 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:11.997 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:11.998 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:11.998 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.998 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.998 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:11.998 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:11.998 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:11.998 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.998 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.998 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:11.998 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:11.998 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:11.998 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.998 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.999 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:11.999 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:11.999 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:11.999 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.999 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.999 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:11.999 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:11.999 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:11.999 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:11.999 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:11.999 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:11.999 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:11.999 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:11.999 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.000 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.000 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:12.000 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:12.000 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:12.000 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.000 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.000 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.000 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:12.000 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:12.000 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.000 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.000 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:12.000 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:12.000 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:12.001 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.001 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.001 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.001 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:12.001 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:12.001 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.001 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.001 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.001 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.001 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.001 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.001 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:12.001 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 68.132056563999996, 2024-04-26T12:06:12.001 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:12.001 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:12.002 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.002 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:12.002 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.002 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:12.002 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:12.002 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.002 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.002 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.002 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:12.002 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:12.002 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.002 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.002 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.002 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:12.003 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:12.003 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:12.003 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.003 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.003 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:12.003 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:12.003 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:12.003 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.003 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.003 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:12.003 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:12.003 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:12.003 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.003 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.003 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.004 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:12.004 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:12.004 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.004 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.004 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:12.004 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:12.004 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:12.004 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.004 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.004 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:12.004 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:12.004 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:12.004 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.004 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.004 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:12.005 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:12.005 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:12.005 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.005 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.005 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:12.005 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:12.005 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:12.005 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.005 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.005 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.005 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:12.005 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:12.005 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.005 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.005 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:12.006 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:12.006 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:12.006 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.006 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.006 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.006 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:12.006 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:12.006 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.006 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.006 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.006 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.006 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.006 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.006 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:12.006 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 68.132017605000001, 2024-04-26T12:06:12.007 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:12.007 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:12.007 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.007 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:12.007 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.007 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:12.007 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:12.007 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.007 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.007 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.007 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:12.007 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:12.007 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.007 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.008 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.008 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:12.008 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:12.008 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.008 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.008 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.008 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:12.008 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:12.008 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:12.008 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.008 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.008 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:12.008 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:12.008 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:12.008 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.009 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.009 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.009 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:12.009 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:12.009 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.009 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.009 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:12.009 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:12.009 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:12.009 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.009 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.009 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:12.009 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:12.009 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:12.009 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.010 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.010 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:12.010 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:12.010 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:12.010 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.010 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.010 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:12.010 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:12.010 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:12.010 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.010 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.010 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.010 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:12.010 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:12.011 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.011 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.011 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:12.011 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:12.011 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:12.011 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.011 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.011 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.011 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:12.011 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:12.011 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.011 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.011 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.011 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.011 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.012 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.012 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:12.012 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 68.131982132999994, 2024-04-26T12:06:12.012 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:12.012 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:12.012 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.012 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:12.012 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.012 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:12.012 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:12.012 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.012 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.012 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.012 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:12.013 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:12.013 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.013 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.013 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.013 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:12.013 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:12.013 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.013 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.013 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.013 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:12.013 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:12.013 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:12.013 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.013 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.013 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:12.014 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:12.014 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:12.014 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.014 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.014 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.014 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:12.014 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:12.014 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.014 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.014 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:12.014 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:12.014 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:12.014 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.015 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.015 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:12.015 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:12.015 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:12.015 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.015 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.015 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:12.015 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:12.015 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:12.015 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.015 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.015 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:12.015 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:12.015 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:12.015 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.016 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.016 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.016 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:12.016 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:12.016 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.016 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.016 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:12.016 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:12.016 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:12.016 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.016 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.016 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.016 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:12.016 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:12.016 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.017 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.017 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.017 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.017 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.017 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.017 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:12.017 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 68.131903444000002, 2024-04-26T12:06:12.017 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:12.017 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:12.017 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.017 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:12.017 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.017 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:12.017 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:12.017 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.018 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.018 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.018 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:12.018 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:12.018 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.018 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.018 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.018 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:12.018 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:12.018 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:12.018 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.018 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.018 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:12.018 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:12.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:12.019 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.019 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.019 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:12.019 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:12.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:12.019 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.019 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.019 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.019 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:12.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:12.019 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.019 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.019 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:12.019 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:12.020 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:12.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.020 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.020 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:12.020 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:12.020 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:12.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.020 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.020 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:12.020 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:12.020 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:12.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.020 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.020 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:12.020 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:12.021 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:12.021 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.021 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.021 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.021 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:12.021 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:12.021 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.021 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.021 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:12.021 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:12.021 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:12.021 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.021 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.021 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.022 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:12.022 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:12.022 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.022 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.022 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.022 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.022 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.022 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.022 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:12.022 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 68.131752595999998, 2024-04-26T12:06:12.022 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:12.022 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:12.022 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:12.022 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:12.023 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.023 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:12.023 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:12.023 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.023 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.023 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.023 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:12.023 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:12.023 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.023 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.023 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.023 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:12.023 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:12.023 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:12.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:12.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:12.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:12.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:12.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:12.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:12.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:12.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:12.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:12.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:12.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:12.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:12.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:12.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:12.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:12.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:12.026 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.026 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.026 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.026 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.026 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.026 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:12.027 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:12.026+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:12.028 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:12.128 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:12.127+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:12.133 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:12.133 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:12.134 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:06:12.134 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:12.143 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:12.229 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:12.228+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:12.244 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:12.244 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:12.245 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:12.245 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:12.245 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:12.253 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:12.338 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:12.337+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:12.397 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:12.398 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:12.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:12.398 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:12.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.398 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.398 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:12.398 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 68.615692315000004, 2024-04-26T12:06:12.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:06:12.398 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:12.398 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.398 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:12.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:12.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:12.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:12.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:12.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:12.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:06:12.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:12.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:06:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:06:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:06:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:06:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:06:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:06:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:12.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:06:12.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:06:12.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:12.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:12.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:06:12.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:12.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:06:12.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:06:12.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.402 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:12.402 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:06:12.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:06:12.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.402 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.402 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:06:12.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:06:12.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.402 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:12.402 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:06:12.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:06:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:06:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:06:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 68.615636995000003, 2024-04-26T12:06:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:06:12.404 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:12.404 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.404 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:12.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:12.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:12.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:12.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:12.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:12.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:06:12.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:12.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.405 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:12.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:06:12.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:06:12.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.405 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:12.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:06:12.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:06:12.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.405 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.406 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:06:12.406 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:06:12.406 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.406 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.406 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:12.406 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:06:12.406 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:06:12.406 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.406 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.406 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:12.406 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:06:12.406 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:06:12.406 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.406 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.406 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:12.407 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:06:12.407 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:06:12.407 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.407 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:12.407 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:06:12.407 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:06:12.407 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.407 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.407 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:06:12.407 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:06:12.407 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.408 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:12.408 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:06:12.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:06:12.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.408 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:12.408 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:06:12.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:06:12.408 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.408 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:12.408 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.408 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.408 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:12.409 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 68.615586977000007, 2024-04-26T12:06:12.409 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:06:12.409 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:12.409 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.409 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:12.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.409 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:12.409 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:12.409 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.409 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.409 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:12.409 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:12.409 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.409 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:12.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:06:12.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:12.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:06:12.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:06:12.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:12.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:06:12.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:06:12.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.411 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.411 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:06:12.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:06:12.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.411 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:12.411 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:06:12.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:06:12.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.411 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:12.411 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:06:12.412 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:06:12.412 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.412 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.412 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:12.412 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:06:12.412 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:06:12.412 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.412 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.412 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:12.412 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:06:12.412 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:06:12.412 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.412 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.412 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.412 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:06:12.412 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:06:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:06:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:06:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:06:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:06:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 68.615552339999994, 2024-04-26T12:06:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:06:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:06:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:06:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:06:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:06:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:06:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:06:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:06:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:06:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:12.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:06:12.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:06:12.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:12.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:06:12.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:06:12.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:06:12.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:06:12.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:06:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:06:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:06:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:06:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:06:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:06:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:12.419 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.419 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.419 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.419 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:12.419 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 68.615513828000005, 2024-04-26T12:06:12.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:06:12.419 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:12.419 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.419 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:12.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.419 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:12.419 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:12.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.419 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:12.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:12.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:12.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:12.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:12.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:12.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:12.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:06:12.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:06:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:06:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:06:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:06:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:06:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:06:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.422 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:12.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:06:12.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:06:12.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.422 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.422 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:12.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:06:12.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:06:12.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.422 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.422 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:06:12.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:06:12.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:12.423 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:06:12.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:06:12.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:12.423 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:06:12.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:06:12.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:12.423 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:06:12.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:06:12.424 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.424 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:12.424 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.424 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.424 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.424 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.424 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:12.424 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 68.615483505, 2024-04-26T12:06:12.424 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:06:12.424 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:12.424 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.424 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:12.424 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.424 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:12.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:12.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.425 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.425 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:12.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:12.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.425 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.425 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:12.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:06:12.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.425 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.425 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:12.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:06:12.426 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:06:12.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:12.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:06:12.426 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:06:12.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:06:12.426 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:06:12.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.427 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:12.427 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:06:12.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:06:12.427 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.427 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:12.427 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:06:12.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:06:12.427 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.427 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:12.427 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:06:12.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:06:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:06:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:06:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:06:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:06:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:06:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:06:12.429 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.429 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.429 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:12.429 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:06:12.429 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:06:12.429 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.429 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:12.429 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.429 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.429 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.429 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.429 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:12.429 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 68.615456803000001, 2024-04-26T12:06:12.429 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:06:12.429 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:12.430 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:12.430 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:12.430 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.430 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:12.430 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:12.430 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.430 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.430 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.430 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:12.431 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:12.431 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.431 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.431 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.431 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:12.431 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:12.431 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.431 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.431 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.431 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:12.431 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:06:12.431 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:06:12.431 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.431 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.431 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:12.432 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:06:12.432 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:06:12.432 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.432 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.432 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.432 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:06:12.432 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:06:12.432 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.432 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.432 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:12.432 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:06:12.432 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:06:12.432 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.432 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.433 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:12.433 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:06:12.433 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:06:12.433 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.433 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.433 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:12.433 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:06:12.433 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:06:12.433 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.433 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:12.433 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.433 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.433 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.433 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.433 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:12.434 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 68.615414513000005, 2024-04-26T12:06:12.434 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:06:12.434 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:12.434 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:12.434 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:12.434 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.434 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:12.434 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:12.434 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.434 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.434 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.434 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:12.434 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:12.435 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.435 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.435 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.435 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:12.435 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:12.435 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.435 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.435 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.435 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:12.435 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:06:12.435 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:06:12.435 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.435 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.435 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:12.436 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:06:12.436 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:06:12.436 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.436 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.436 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.436 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:06:12.436 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:06:12.436 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.436 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.436 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:12.436 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:06:12.436 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:06:12.436 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.436 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.437 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:12.437 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:06:12.437 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:06:12.437 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.437 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.437 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:12.437 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:06:12.437 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:06:12.437 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.437 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:12.437 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.437 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.437 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.437 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.438 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:12.438 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 68.615386435000005, 2024-04-26T12:06:12.438 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:06:12.438 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:12.438 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:12.438 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:12.438 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.438 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:12.438 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:12.438 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.438 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.438 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.438 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:12.438 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:06:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:06:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:06:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:12.440 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:06:12.440 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:06:12.440 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.440 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.440 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.440 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:06:12.440 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:06:12.440 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.440 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.440 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:12.440 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:06:12.440 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:06:12.440 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.440 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.440 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:12.440 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:06:12.441 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:06:12.441 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.441 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.441 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:12.441 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:06:12.441 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:06:12.441 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.441 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:12.441 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.441 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.441 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.441 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:12.441 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:12.441 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 68.609391084999999, 2024-04-26T12:06:12.442 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:06:12.442 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:12.442 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.442 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:12.442 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.442 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:12.442 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:12.442 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.442 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.442 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.442 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:12.442 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:12.442 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.442 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.443 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.443 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:12.443 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:06:12.443 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.443 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.443 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.443 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:12.443 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:06:12.443 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:06:12.443 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.443 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.443 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:12.443 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:06:12.443 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:06:12.443 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.444 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.444 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.444 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:06:12.444 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:06:12.444 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.444 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.444 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:12.444 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:06:12.444 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:06:12.444 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.444 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.444 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:12.444 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:06:12.444 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:06:12.444 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.445 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.445 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:12.445 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:06:12.445 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:06:12.445 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.445 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.445 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:12.445 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:06:12.445 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:06:12.445 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.445 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:12.445 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.445 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.445 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.445 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 68.609322118999998, 2024-04-26T12:06:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:06:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.447 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.447 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.447 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:12.447 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:06:12.447 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.447 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.447 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.447 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:12.447 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:06:12.447 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:06:12.447 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.447 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.447 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:12.447 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:06:12.447 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:06:12.447 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.448 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.448 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.448 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:06:12.448 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:06:12.448 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.448 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.448 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:12.448 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:06:12.448 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:06:12.448 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.448 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.448 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:12.448 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:12.448 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:06:12.448 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.449 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.449 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:12.449 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:06:12.449 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:06:12.449 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.449 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.449 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:12.449 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:06:12.449 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:06:12.449 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.449 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:12.449 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.449 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.449 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.450 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:12.450 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:12.450 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 68.608827755999997, 2024-04-26T12:06:12.450 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:06:12.450 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:12.450 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.450 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:12.450 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.450 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:12.450 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:12.450 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.450 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.450 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.450 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:12.451 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:12.451 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.451 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.451 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.451 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:12.451 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:12.451 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.451 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.451 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.451 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:12.451 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:06:12.451 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:06:12.451 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.451 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.452 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:12.452 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:06:12.452 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:06:12.452 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.452 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.452 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.452 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:06:12.452 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:06:12.452 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.452 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.452 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:12.452 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:06:12.452 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:06:12.452 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.453 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.453 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:12.453 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:06:12.453 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:06:12.453 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.453 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.453 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:12.453 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:06:12.453 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:06:12.453 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.453 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.453 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:12.453 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:06:12.453 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:06:12.453 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.453 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:12.454 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.454 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.454 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.454 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:12.454 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:12.454 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 68.608789490999996, 2024-04-26T12:06:12.454 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:06:12.454 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:12.454 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.454 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:12.454 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.454 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:12.454 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:12.454 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.455 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.455 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.455 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:12.455 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:12.455 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.455 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.455 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.455 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:12.455 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:12.455 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.455 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.455 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.455 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:12.455 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:06:12.456 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:06:12.456 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.456 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.456 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:12.456 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:06:12.456 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:06:12.456 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.456 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.456 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.456 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:06:12.456 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:06:12.456 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.456 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.456 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:12.456 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:06:12.457 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:06:12.457 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.457 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:12.457 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:06:12.457 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:06:12.457 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.457 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:12.457 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:06:12.457 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:06:12.457 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.457 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:12.457 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:06:12.458 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:06:12.458 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.458 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:12.458 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.458 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.458 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.458 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:06:12.458 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:12.458 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 68.608109605999999, 2024-04-26T12:06:12.458 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:06:12.458 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:12.458 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:12.458 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:12.458 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.458 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:12.459 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:12.459 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.459 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.459 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:12.459 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:12.459 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.459 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.459 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:12.459 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:12.459 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.459 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.459 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:12.460 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:06:12.460 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:06:12.460 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.460 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.460 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:12.460 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:06:12.460 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:06:12.460 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.460 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.460 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.460 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:06:12.460 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:06:12.460 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.460 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.460 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:12.461 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:06:12.461 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:06:12.461 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.461 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.461 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:12.461 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:06:12.461 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:06:12.461 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.461 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:12.461 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.461 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.461 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.461 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:12.461 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:12.461 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 68.608080427000004, 2024-04-26T12:06:12.461 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:06:12.462 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:12.462 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:12.462 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:12.462 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.462 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:12.462 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:12.462 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.462 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.462 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.462 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:12.462 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:12.462 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.462 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.462 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.463 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:12.463 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:06:12.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.463 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.463 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:12.463 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:06:12.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:06:12.463 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.463 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:12.463 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:06:12.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:06:12.463 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.464 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:06:12.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:06:12.464 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:12.464 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:06:12.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:06:12.464 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:12.464 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:06:12.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:06:12.464 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.465 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:12.465 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:06:12.465 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:06:12.465 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.465 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:12.465 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.465 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:12.465 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:12.465 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 68.608048616000005, 2024-04-26T12:06:12.465 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:06:12.465 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:12.465 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:12.466 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:12.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.466 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:12.466 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:12.466 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.466 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.466 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:12.466 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:12.466 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.466 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.466 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:12.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:12.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:12.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.467 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.467 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:12.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:06:12.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:06:12.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.467 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.467 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:12.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:06:12.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:06:12.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.467 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.467 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.468 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:06:12.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:06:12.468 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.468 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:12.468 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:06:12.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:06:12.468 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.468 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:12.468 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:06:12.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:06:12.468 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.468 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:12.469 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:06:12.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:06:12.469 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.469 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:12.469 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.469 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.469 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.469 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:12.469 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:12.469 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 68.60802726, 2024-04-26T12:06:12.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:06:12.469 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:12.469 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:12.469 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:12.469 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:12.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:12.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:12.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:12.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:12.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:12.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:12.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.471 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:12.471 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:06:12.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:06:12.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.471 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:12.471 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:06:12.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:06:12.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.471 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.471 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:06:12.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:06:12.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.471 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:12.472 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:06:12.472 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:06:12.472 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.472 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.472 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:12.472 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:06:12.472 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:06:12.472 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.472 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.472 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:12.472 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:06:12.472 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:06:12.472 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.472 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:12.472 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.473 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.473 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.473 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:06:12.473 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:12.473 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 68.607998807000001, 2024-04-26T12:06:12.473 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:06:12.473 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:12.473 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:12.473 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:12.473 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.473 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:12.473 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:12.473 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.473 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.473 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.474 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:12.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:12.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.474 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:12.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:12.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.474 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:12.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:06:12.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:06:12.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:12.475 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:06:12.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:06:12.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.475 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:06:12.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:06:12.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:12.475 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:06:12.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:06:12.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.476 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:12.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:06:12.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:06:12.476 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.476 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:12.476 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.476 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:06:12.476 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:12.476 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 68.607277001, 2024-04-26T12:06:12.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:06:12.476 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:12.476 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:12.477 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:12.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.477 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:12.477 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:12.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.477 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.477 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:12.477 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:12.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.477 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.477 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:12.477 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:06:12.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:12.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.478 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.478 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:12.478 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:06:12.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:06:12.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.478 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.478 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:12.478 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:06:12.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:06:12.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.478 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.478 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.479 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:06:12.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:06:12.479 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.479 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.479 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:12.479 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:06:12.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:06:12.479 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.479 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.479 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:12.479 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:06:12.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:06:12.479 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.479 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:12.480 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.480 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.480 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:06:12.480 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:12.480 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 62.890350398000002, 2024-04-26T12:06:12.480 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:06:12.480 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:12.480 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.480 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:12.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.480 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:12.480 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:12.480 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.480 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:12.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:12.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:12.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:12.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:06:12.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:06:12.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:12.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:06:12.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:06:12.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:12.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:06:12.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:06:12.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:06:12.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:06:12.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:12.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:06:12.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:06:12.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.483 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:12.483 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:06:12.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:06:12.483 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.483 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:12.483 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:06:12.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:06:12.483 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.483 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:12.483 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:06:12.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:06:12.484 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.484 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.484 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.484 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:06:12.484 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:06:12.484 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.484 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.484 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:12.484 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:06:12.484 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:06:12.484 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:12.484 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:12.484 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:12.484 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:06:12.485 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:06:12.485 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.485 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:12.485 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.485 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:12.485 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:12.485 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:12.486 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:12.487 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:12.485+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:12.587 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:12.586+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:12.593 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:12.593 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:12.594 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:06:12.594 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:12.603 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:12.688 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:12.687+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:12.745 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:12.745 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:12.745 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:12.745 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:12.745 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:12.754 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:12.797 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:12.796+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:12.856 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:12.856 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:12.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 78.999251055000002, 2024-04-26T12:06:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:12.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:12.860 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.860 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:12.860 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:12.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:12.860 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.860 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:12.860 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 78.999145158999994, 2024-04-26T12:06:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:12.866 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:12.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:12.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.866 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.866 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:12.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:12.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.866 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:12.866 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:12.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:12.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 78.999130179000005, 2024-04-26T12:06:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 78.999086304000002, 2024-04-26T12:06:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.881 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.881 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.881 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:12.881 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:12.881 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 78.999000640000006, 2024-04-26T12:06:12.881 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:12.881 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:12.881 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.881 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:12.881 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:12.881 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:12.881 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:12.881 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.882 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:12.882 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.882 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:12.882 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:12.882 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.882 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.882 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.882 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:12.882 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:12.882 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.882 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.882 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.882 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:12.883 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:12.883 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.883 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.883 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:12.883 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:12.883 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:12.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.883 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.883 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:12.883 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:12.883 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:12.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.883 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.883 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.884 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:12.884 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:12.884 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.884 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.884 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:12.884 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:12.884 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:12.884 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.884 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.884 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:12.884 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:12.884 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:12.884 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.884 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 69.073096354, 2024-04-26T12:06:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 69.073060259000002, 2024-04-26T12:06:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 69.073022574999996, 2024-04-26T12:06:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.901 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.901 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:12.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:12.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:12.901 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.901 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.901 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:12.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:12.901 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.901 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.901 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:12.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:12.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 69.073001235000007, 2024-04-26T12:06:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 69.072978969000005, 2024-04-26T12:06:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 69.072957346999999, 2024-04-26T12:06:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 69.072930780999997, 2024-04-26T12:06:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 69.072892268999993, 2024-04-26T12:06:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:12.925 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.925 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.925 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:12.925 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:12.925 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:12.925 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.925 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.925 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.925 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:12.925 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:12.925 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.925 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.925 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:12.925 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:12.925 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:12.926 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.926 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.926 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:12.926 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:12.926 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:12.926 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.926 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.926 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:12.926 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:12.926 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:12.926 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.926 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.926 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:12.926 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:12.927 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:12.927 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.927 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.927 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.927 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:12.927 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:12.927 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.927 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.927 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:12.927 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:12.927 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:12.927 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.928 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.928 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.928 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:12.928 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:12.928 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.928 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.928 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.928 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.928 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.928 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.928 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:12.928 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 69.072864096000004, 2024-04-26T12:06:12.928 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:12.928 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:12.928 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.929 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:12.929 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.929 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:12.929 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:12.929 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.929 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.929 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.929 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:12.929 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:12.929 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.929 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.929 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.929 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:12.929 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:12.929 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.930 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.930 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.930 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:12.930 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:12.930 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:12.930 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.930 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.930 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:12.930 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:12.930 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:12.930 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.930 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.930 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.930 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:12.931 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:12.931 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.931 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.931 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:12.931 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:12.931 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:12.931 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.931 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.931 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:12.931 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:12.931 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:12.931 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.931 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.931 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:12.932 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:12.932 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:12.932 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.932 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.932 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:12.932 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:12.932 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:12.932 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.932 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.932 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.932 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:12.932 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:12.932 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.932 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.933 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:12.933 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:12.933 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:12.933 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.933 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.933 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.933 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:12.933 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:12.933 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.933 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.933 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.933 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.933 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.933 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.933 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:12.934 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 69.072829532, 2024-04-26T12:06:12.934 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:12.934 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:12.934 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.934 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:12.934 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.934 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:12.934 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:12.934 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.934 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.934 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.934 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:12.934 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:12.934 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.935 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.935 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.935 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:12.935 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:12.935 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.935 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.935 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.935 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:12.935 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:12.935 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:12.935 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.935 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.935 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:12.935 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:12.936 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:12.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.936 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.936 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.936 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:12.936 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:12.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.936 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.936 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:12.936 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:12.936 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:12.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.936 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.936 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:12.936 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:12.937 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:12.937 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.937 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.937 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:12.937 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:12.937 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:12.937 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.937 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.937 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:12.937 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:12.937 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:12.937 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.937 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.937 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.937 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:12.938 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:12.938 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.938 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.938 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:12.938 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:12.938 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:12.938 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.938 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.938 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.938 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:12.938 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:12.938 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.938 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.938 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.939 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.939 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.939 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.939 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:12.939 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 69.071954751999996, 2024-04-26T12:06:12.939 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:12.939 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:12.939 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.939 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:12.939 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.939 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:12.939 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:12.939 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.939 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.939 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.940 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:12.940 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:12.940 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.940 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.940 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.940 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:12.940 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:12.940 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:12.940 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.940 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.940 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:12.940 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:12.940 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:12.940 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.940 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.941 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:12.941 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:12.941 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:12.941 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.941 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.941 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.941 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:12.941 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:12.941 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.941 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.941 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:12.941 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:12.941 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:12.941 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.941 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.942 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:12.942 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:12.942 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:12.942 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.942 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.942 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:12.942 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:12.942 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:12.942 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.942 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.942 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:12.942 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:12.942 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:12.942 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.943 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.943 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.943 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:12.943 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:12.943 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.943 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.943 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:12.943 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:12.943 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:12.943 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.943 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.943 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.943 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:12.943 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:12.943 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.944 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.944 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.944 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.944 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.944 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.944 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:12.944 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 69.071915793000002, 2024-04-26T12:06:12.944 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:12.944 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:12.944 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.944 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:12.944 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.944 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:12.944 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:12.944 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.944 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.945 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.945 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:12.945 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:12.945 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.945 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.945 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.945 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:12.945 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:12.945 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.945 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.945 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.945 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:12.945 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:12.945 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:12.946 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.946 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.946 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:12.946 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:12.946 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:12.946 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.946 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.946 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.946 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:12.946 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:12.946 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.946 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.946 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:12.946 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:12.946 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:12.947 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.947 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.947 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:12.947 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:12.947 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:12.947 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.947 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.947 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:12.947 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:12.947 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:12.947 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.947 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.947 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:12.947 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:12.947 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:12.948 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.948 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.948 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.948 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:12.948 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:12.948 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.948 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.948 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:12.948 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:12.948 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:12.948 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.948 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.948 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.948 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:12.948 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:12.948 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.949 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.949 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.949 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.949 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.949 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.949 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:12.949 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 69.071880320999995, 2024-04-26T12:06:12.949 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:12.949 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:12.949 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.949 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:12.949 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.949 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:12.949 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:12.950 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.950 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.950 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.950 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:12.950 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:12.950 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.950 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.950 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.950 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:12.950 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:12.950 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:12.950 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.950 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.950 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:12.951 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:12.951 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:12.951 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.951 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.951 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:12.951 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:12.951 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:12.951 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.951 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.951 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.951 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:12.951 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:12.951 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.951 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.951 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:12.952 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:12.952 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:12.952 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.952 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.952 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:12.952 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:12.952 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:12.952 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.952 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.952 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:12.952 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:12.952 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:12.952 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.952 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.953 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:12.953 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:12.953 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:12.953 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.953 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.953 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.953 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:12.953 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:12.953 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.953 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.953 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:12.953 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:12.953 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:12.953 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.954 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.954 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.954 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:12.954 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:12.954 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.954 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.954 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.954 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.954 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.954 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.954 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:12.954 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 69.071801632000003, 2024-04-26T12:06:12.954 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:12.954 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:12.955 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:12.955 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:12.955 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.955 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:12.955 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:12.955 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.955 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.955 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.955 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:12.955 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:12.955 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.955 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.955 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.955 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:12.955 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:12.955 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:12.956 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.956 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.956 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:12.956 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:12.956 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:12.956 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.956 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.956 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:12.956 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:12.956 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:12.956 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.956 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.956 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.956 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:12.956 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:12.956 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.957 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.957 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:12.957 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:12.957 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:12.957 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.957 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.957 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:12.957 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:12.957 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:12.957 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.957 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.957 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:12.957 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:12.957 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:12.957 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.958 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.958 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:12.958 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:12.958 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:12.958 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.958 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.958 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:12.958 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:12.958 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:12.958 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.958 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.958 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:12.958 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:12.958 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:12.959 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.959 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.959 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.959 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:12.959 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:12.959 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.959 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.959 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.959 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.959 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.959 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:12.959 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:12.959 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 69.071650783999999, 2024-04-26T12:06:12.959 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:12.959 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:12.960 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:12.960 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:12.960 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.960 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:12.960 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:12.960 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.960 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.960 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.960 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:12.960 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:12.960 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:12.960 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.960 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.961 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:12.961 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:12.961 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:12.961 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.961 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.961 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:12.961 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:12.961 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:12.961 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.961 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.961 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:12.961 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:12.961 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:12.961 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.961 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.962 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:12.962 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:12.962 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:12.962 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.962 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.962 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:12.962 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:12.962 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:12.962 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.962 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.962 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:12.962 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:12.962 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:12.962 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:12.963 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:12.963 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:12.963 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:12.963 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:12.963 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.963 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.963 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.963 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:12.963 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:12.963 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:12.964 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:12.963+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:12.965 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:12.971 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:06:13.065 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:13.064+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:13.067 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:13.067 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:13.068 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:06:13.068 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:13.076 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:13.109 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:06:13.166 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:13.165+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:13.219 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:13.219 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:13.219 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:13.219 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:13.219 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:13.228 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:13.253 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:13.253 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:13.253 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:06:13.269 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:13.268+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:13.282 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:13.282 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:13.286 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:06:13.287 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:06:13.368 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:13.367+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:13.370 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:13.370 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:13.379 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:13.469 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:13.468+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:13.485 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:13.486 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:13.494 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:13.570 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:13.569+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:13.636 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:13.636 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:13.645 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:13.689 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:13.688+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:13.747 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:13.747 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:13.756 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:13.797 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:13.796+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:13.859 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:13.860 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:13.869 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:13.872 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:13.871+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:13.958 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-26T12:06:13.972 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:13.972 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:13.973 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:13.971+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:13.983 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:14.074 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:14.072+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:14.124 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:14.124 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:14.133 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:14.177 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:14.176+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:14.237 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:14.237 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:14.246 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:14.287 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:14.286+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:14.375 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:14.374+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:14.388 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:14.388 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:14.397 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:14.481 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:14.480+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:14.539 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:14.539 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:14.548 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:14.592 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:14.591+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:14.651 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:14.652 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:14.661 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:14.702 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:14.701+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:14.778 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:14.777+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:14.803 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:14.804 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:14.813 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:14.879 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:14.878+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:14.954 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:14.955 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:14.964 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:14.980 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:14.979+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:15.069 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:15.069 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:15.078 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:15.081 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:15.080+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:15.177 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:15.178 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:15.181 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:15.180+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:15.186 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:15.282 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:15.281+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:15.287 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:06:15.288 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:15.288 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:15.297 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:15.383 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:15.382+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:15.401 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:15.402 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:15.410 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:15.415 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:15.415 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:15.419 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:06:15.440 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:15.441 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:15.444 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:06:15.446 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:06:15.488 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:15.485+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:15.551 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:06:15.572 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:15.572 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:15.572 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:15.573 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:15.573 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:15.575 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:15.584 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:15.583+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:15.664 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2024-04-26T12:06:15.678 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:15.678 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:15.678 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:15.678 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:15.679 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.679 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:15.679 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:15.679 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 71.896022688000002, 2024-04-26T12:06:15.679 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:06:15.680 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:15.680 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:15.680 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:15.680 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.680 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:15.680 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:15.680 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.680 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.680 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.680 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:15.680 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:15.680 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.681 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.681 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.681 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:15.681 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:06:15.681 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:15.681 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.681 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.681 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:15.681 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:06:15.681 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:06:15.681 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.682 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.682 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:15.682 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:06:15.682 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:06:15.682 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.682 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.682 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:15.682 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:06:15.682 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:06:15.682 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.682 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.682 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:15.682 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:06:15.683 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:06:15.683 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.683 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.683 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:15.683 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:15.683 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:06:15.683 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.683 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.683 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:15.683 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:06:15.683 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:06:15.683 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.683 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.683 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:15.684 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:06:15.684 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:06:15.684 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.684 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.684 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:15.684 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:06:15.684 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:06:15.684 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.684 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.684 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:15.684 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:06:15.684 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:06:15.684 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.684 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.685 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:15.685 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:06:15.685 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:06:15.685 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.685 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:15.685 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.685 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.685 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.685 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:15.685 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:15.685 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 71.895967368000001, 2024-04-26T12:06:15.685 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:06:15.685 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:15.686 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:15.686 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:15.686 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.686 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:15.686 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:15.686 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.686 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.686 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.686 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:15.686 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:15.686 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.687 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.687 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.687 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:15.687 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:06:15.687 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:15.687 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.687 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.687 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:15.687 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:06:15.687 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:06:15.687 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.688 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.688 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:15.688 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:06:15.688 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:06:15.688 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.688 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.688 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:15.688 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:06:15.688 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:06:15.688 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.688 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.688 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:15.688 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:06:15.689 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:06:15.689 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.689 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.689 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:15.689 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:06:15.689 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:06:15.689 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.689 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.689 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:15.689 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:06:15.689 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:06:15.689 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.690 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.690 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:15.690 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:06:15.690 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:06:15.690 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.690 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.690 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:15.690 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:06:15.690 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:06:15.690 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.690 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.690 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:15.690 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:06:15.691 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:06:15.691 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.691 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.691 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:15.691 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:06:15.691 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:06:15.691 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.691 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:15.691 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.691 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.691 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.691 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:15.692 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:15.692 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 71.895917350000005, 2024-04-26T12:06:15.692 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:06:15.692 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:15.692 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:15.692 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:15.692 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.692 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:15.692 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:15.692 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.692 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.692 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.692 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:15.692 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:15.693 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.693 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.693 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.693 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:15.693 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:06:15.693 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:15.693 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.693 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.693 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:15.693 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:06:15.693 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:06:15.693 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.693 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.693 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:15.694 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:06:15.694 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:06:15.694 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.694 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.694 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:15.694 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:06:15.694 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:06:15.695 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.695 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.695 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:15.695 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:06:15.696 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:06:15.696 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.696 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.696 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:15.696 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:06:15.696 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:06:15.696 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.696 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.696 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:15.696 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:06:15.696 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:06:15.696 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.696 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.697 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:15.697 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:06:15.697 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:06:15.697 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.697 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.697 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:15.697 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:06:15.697 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:06:15.697 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.697 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.697 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:15.697 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:06:15.698 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:06:15.698 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.698 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.698 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:15.698 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:06:15.698 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:06:15.698 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.698 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:15.698 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.698 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.698 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.698 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:15.699 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:15.699 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 71.895882713000006, 2024-04-26T12:06:15.699 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:06:15.699 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:15.699 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:15.699 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:15.699 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.699 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:15.699 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:15.700 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.700 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.700 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.700 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:15.700 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:15.700 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.700 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.700 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.700 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:15.700 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:06:15.700 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:15.700 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.700 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.700 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:15.701 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:06:15.701 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:06:15.701 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.701 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.701 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:15.701 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:15.701 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:06:15.701 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.701 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.701 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:15.701 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:06:15.701 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:06:15.701 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.701 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.702 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:15.702 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:06:15.702 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:06:15.702 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.702 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.702 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:15.702 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:06:15.702 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:06:15.702 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.702 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.702 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:15.703 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:06:15.703 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:06:15.703 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.703 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.703 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:15.703 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:06:15.703 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:06:15.703 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.703 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.703 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:15.703 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:06:15.704 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:06:15.704 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.704 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.704 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:15.704 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:06:15.704 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:06:15.704 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.704 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.704 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:15.704 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:06:15.704 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:06:15.704 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.704 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:15.705 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.705 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.705 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.705 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:15.705 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:15.705 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 71.895844201000003, 2024-04-26T12:06:15.705 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:06:15.705 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:15.705 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:15.705 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:15.705 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.705 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:15.705 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:15.706 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.706 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.706 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.706 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:15.706 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:15.706 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.706 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.706 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.706 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:15.706 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:15.707 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:15.707 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.707 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.707 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:15.707 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:15.707 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:06:15.707 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.707 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.707 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:15.707 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:06:15.708 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:06:15.708 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.708 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.708 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:15.708 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:06:15.708 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:06:15.708 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.708 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.708 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:15.708 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:06:15.709 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:06:15.709 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.709 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.709 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:15.709 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:06:15.709 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:06:15.709 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.709 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.709 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:15.709 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:06:15.710 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:06:15.710 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.710 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.710 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:15.710 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:06:15.710 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:06:15.710 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.710 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.710 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:15.710 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:06:15.711 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:06:15.711 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.711 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.711 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:15.711 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:06:15.711 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:06:15.711 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.711 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.711 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:15.711 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:06:15.714 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:06:15.714 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.714 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:15.714 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.714 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.714 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.714 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:15.714 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:15.714 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 71.895813877999998, 2024-04-26T12:06:15.715 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:06:15.715 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:15.715 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:15.715 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:15.715 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.715 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:15.715 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:15.715 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.715 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.715 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.716 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:15.716 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:15.716 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.716 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.716 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.716 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:15.716 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:06:15.716 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:15.716 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.716 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.717 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:15.717 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:06:15.717 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:06:15.717 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.717 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.717 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:15.717 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:06:15.717 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:06:15.717 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.718 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.718 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:15.718 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:06:15.718 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:06:15.718 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.718 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.718 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:15.718 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:06:15.718 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:06:15.718 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.719 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.719 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:15.719 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:06:15.719 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:06:15.719 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.719 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.719 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:15.719 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:06:15.719 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:06:15.719 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.720 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.720 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:15.720 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:06:15.720 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:06:15.720 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.720 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.720 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:15.720 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:06:15.720 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:06:15.720 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.721 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.721 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:15.721 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:06:15.721 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:06:15.721 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.721 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.721 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:15.721 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:06:15.721 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:06:15.721 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.722 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:15.722 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.722 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.722 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.722 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:15.722 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:15.722 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 71.895787175999999, 2024-04-26T12:06:15.722 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:06:15.722 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:15.722 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:15.723 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:15.723 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.723 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:15.723 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:15.723 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.723 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.723 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.723 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:15.723 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:15.723 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.723 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.723 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.723 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:15.723 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:15.723 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:15.724 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.724 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.724 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:15.724 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:06:15.724 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:06:15.724 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.724 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.724 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:15.724 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:06:15.724 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:06:15.724 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.724 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.724 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:15.724 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:06:15.724 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:06:15.725 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.725 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.725 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:15.725 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:06:15.725 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:06:15.725 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.725 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.725 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:15.725 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:06:15.725 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:06:15.725 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.725 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.725 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:15.725 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:06:15.725 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:06:15.726 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.726 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:15.726 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.726 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.726 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.726 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:15.726 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:15.726 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 71.895744886000003, 2024-04-26T12:06:15.726 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:06:15.726 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:15.726 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:15.726 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:15.726 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.726 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:15.727 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:15.727 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.727 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.727 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.727 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:15.727 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:15.727 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.727 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.727 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.727 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:15.727 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:15.727 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:15.727 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.727 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.727 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:15.728 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:06:15.728 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:06:15.728 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.728 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.728 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:15.728 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:06:15.728 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:06:15.728 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.728 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.728 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:15.728 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:06:15.728 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:06:15.728 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.729 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.729 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:15.729 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:06:15.729 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:06:15.729 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.729 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.729 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:15.729 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:06:15.729 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:06:15.729 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.729 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.729 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:15.729 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:06:15.729 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:06:15.729 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.730 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:15.730 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.730 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.730 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.730 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:15.730 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:15.730 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 71.895716808000003, 2024-04-26T12:06:15.730 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:06:15.730 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:15.730 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:15.730 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:15.730 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.730 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:15.731 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:15.731 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.731 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.731 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.731 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:15.731 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:15.731 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.731 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.731 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.731 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:15.731 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:06:15.731 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:15.731 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.731 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.731 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:15.732 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:06:15.732 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:06:15.732 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.732 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.732 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:15.732 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:06:15.732 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:06:15.732 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.732 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.732 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:15.732 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:06:15.732 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:06:15.732 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.732 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.732 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:15.733 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:06:15.733 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:06:15.733 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.733 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.733 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:15.733 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:06:15.733 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:06:15.733 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.733 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.733 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:15.733 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:06:15.733 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:06:15.733 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.733 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:15.733 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.734 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.734 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.734 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:15.734 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:15.734 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 71.889721457999997, 2024-04-26T12:06:15.734 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:06:15.734 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:15.734 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:15.734 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:15.734 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.734 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:15.734 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:15.734 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.734 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.735 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.735 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:15.735 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:15.735 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.735 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.735 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.735 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:15.735 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:06:15.735 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:15.735 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.735 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.735 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:15.735 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:06:15.735 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:06:15.735 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.736 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.736 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:15.736 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:06:15.736 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:06:15.736 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.736 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.736 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:15.736 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:06:15.736 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:06:15.736 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.736 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.736 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:15.736 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:06:15.736 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:06:15.736 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.737 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.737 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:15.737 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:06:15.737 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:06:15.737 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.737 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.737 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:15.737 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:06:15.737 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:06:15.737 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.737 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.737 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:15.737 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:06:15.737 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:06:15.737 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.738 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:15.738 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.738 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.738 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.738 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:15.738 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:15.738 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 71.889652491999996, 2024-04-26T12:06:15.738 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:06:15.738 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:15.739 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:15.739 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:15.739 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.739 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:15.739 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:15.739 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.739 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.739 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.739 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:15.739 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:15.740 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.740 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.740 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.740 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:15.740 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:06:15.740 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:15.740 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.740 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.740 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:15.741 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:06:15.741 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:06:15.741 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.741 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.741 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:15.741 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:06:15.741 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:06:15.741 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.741 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.741 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:15.741 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:06:15.742 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:06:15.742 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.742 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.742 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:15.742 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:06:15.742 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:06:15.743 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.743 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.743 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:15.743 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:15.743 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:06:15.743 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.743 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.743 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:15.743 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:06:15.743 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:06:15.743 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.743 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.744 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:15.744 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:06:15.744 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:06:15.744 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.744 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:15.744 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.744 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.744 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.744 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:15.744 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:15.744 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 71.889158128999995, 2024-04-26T12:06:15.744 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:06:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:15.746 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:15.746 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:15.746 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.746 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.746 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:15.746 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:06:15.746 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:06:15.746 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.746 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.746 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:06:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:06:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:06:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:06:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:06:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:06:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:06:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:06:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:06:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:06:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:06:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:06:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.749 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:15.749 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.749 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.749 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.749 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:15.749 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:15.749 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 71.889119863999994, 2024-04-26T12:06:15.749 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:06:15.749 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:15.749 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:15.749 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:15.750 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.750 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:15.750 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:15.750 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.750 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.750 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.750 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:15.750 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:15.750 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.750 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.750 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.750 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:15.750 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:06:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:06:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:06:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:06:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:06:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:06:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:06:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:06:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:06:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:06:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:06:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:06:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:06:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:06:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:06:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 71.888439978999997, 2024-04-26T12:06:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:06:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.756 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:15.756 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:06:15.756 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:06:15.756 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.756 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.756 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:15.756 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:06:15.756 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:06:15.756 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.756 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.756 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:15.756 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:06:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:06:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:06:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:06:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:06:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:06:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 71.888410800000003, 2024-04-26T12:06:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:06:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.759 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.759 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:15.759 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:15.759 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.759 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.759 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.759 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:15.759 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:06:15.759 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:15.759 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.759 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.759 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:06:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:06:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:06:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:06:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:06:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:06:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:06:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:06:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:06:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:06:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:06:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:06:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 71.888378989000003, 2024-04-26T12:06:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:06:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.764 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:15.764 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:15.764 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:15.764 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.764 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.764 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:15.764 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:06:15.764 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:06:15.764 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.764 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.764 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:15.764 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:06:15.765 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:06:15.765 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.765 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.765 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:15.765 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:06:15.765 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:06:15.765 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.765 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.765 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:15.765 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:06:15.765 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:06:15.765 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.765 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.765 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:06:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:06:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:06:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:06:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:15.767 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 71.888357632999998, 2024-04-26T12:06:15.767 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:06:15.767 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:15.767 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:15.767 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:15.767 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.767 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:15.767 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:15.767 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.767 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.767 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:06:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:06:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:06:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:06:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:06:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:06:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:06:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:06:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:06:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:06:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:06:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:06:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:06:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 71.888329179999999, 2024-04-26T12:06:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:06:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:06:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:06:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:06:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:06:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:06:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:06:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:06:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:06:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:06:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:06:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:06:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 71.887607373999998, 2024-04-26T12:06:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:06:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:06:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:15.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:15.776 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:06:15.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:06:15.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:15.776 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:06:15.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:06:15.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:06:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:06:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:06:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:06:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:06:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:06:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.778 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:06:15.778 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:15.778 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 66.170680770999994, 2024-04-26T12:06:15.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:06:15.778 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:15.778 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:15.778 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:15.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:06:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:06:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.780 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.780 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:15.780 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:06:15.780 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:06:15.780 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.780 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.780 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:15.780 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:06:15.780 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:06:15.780 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.780 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.780 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:06:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:06:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:06:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:06:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:06:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:06:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:06:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:06:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:06:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:06:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:06:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:06:15.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.783 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.783 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:15.783 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:06:15.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:06:15.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:15.783 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:15.783 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:15.783 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:06:15.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:06:15.783 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.783 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:15.784 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.784 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:15.784 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:15.784 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:15.784 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:15.785 INFO:teuthology.orchestra.console.smithi154:Power off completed 2024-04-26T12:06:15.785 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:15.712+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:15.814 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:15.813+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:15.894 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:15.894 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:15.894 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:06:15.894 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:15.903 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:15.956 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:15.953+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:15.971 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:06:16.005 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:16.006 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:16.006 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:16.006 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:16.006 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:16.014 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:16.015 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:16.014+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:16.117 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:16.116+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:16.163 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:16.163 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:16.163 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:16.163 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:16.163 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.164 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:16.164 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:16.164 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 82.304549191999996, 2024-04-26T12:06:16.164 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:16.164 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:16.165 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.165 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:16.165 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:16.165 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:16.165 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:16.165 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.165 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:16.166 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.166 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:16.166 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:16.166 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.166 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.166 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.166 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:16.166 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:16.167 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.167 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.167 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.167 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:16.168 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:16.168 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.168 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.168 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.168 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:16.168 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:16.168 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:16.168 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.168 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.169 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:16.169 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:16.169 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:16.169 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.169 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.169 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.169 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:16.169 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:16.169 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.169 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.169 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:16.170 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:16.170 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:16.170 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.170 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.170 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:16.170 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:16.170 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:16.170 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.170 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.170 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:16.170 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:16.170 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:16.170 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.171 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.171 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:16.171 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:16.171 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:16.171 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.171 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.171 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.171 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:16.171 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:16.171 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.171 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.172 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:16.172 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:16.172 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:16.172 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.172 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.172 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:16.172 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:16.172 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:16.172 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.172 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:16.172 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.172 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.173 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.173 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:16.173 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:16.173 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 82.304443296000002, 2024-04-26T12:06:16.173 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:16.173 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:16.173 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.173 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:16.173 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:16.174 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:16.174 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:16.174 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.174 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:16.174 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.174 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:16.174 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:16.174 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.174 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.174 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.174 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:16.174 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:16.175 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.175 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.175 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.175 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:16.175 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:16.175 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.175 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.175 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.175 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:16.175 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:16.175 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:16.177 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.177 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.177 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:16.177 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:16.177 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:16.178 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.178 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.178 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.178 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:16.178 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:16.178 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.178 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.178 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:16.178 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:16.178 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:16.178 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.178 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.179 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:16.179 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:16.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:16.179 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.179 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.179 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:16.179 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:16.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:16.179 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.179 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.179 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:16.179 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:16.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:16.179 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.179 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.180 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.180 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:16.180 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:16.180 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.180 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.180 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:16.180 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:16.180 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:16.181 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.181 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.182 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:16.182 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:16.183 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:16.183 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.183 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:16.183 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.184 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.184 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.184 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:16.184 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:16.184 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 82.304428315999999, 2024-04-26T12:06:16.184 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:16.184 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:16.184 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.184 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:16.184 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:16.184 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:16.185 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:16.185 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.185 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:16.185 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.185 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:16.185 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:16.185 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.185 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.185 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.186 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:16.186 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:16.186 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.186 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.186 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.186 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:16.186 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:16.186 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.186 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.187 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.187 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:16.187 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:16.187 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:16.187 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.187 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.187 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:16.187 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:16.187 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:16.187 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.187 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.187 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.187 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:16.187 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:16.188 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.188 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.188 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:16.188 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:16.188 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:16.188 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.188 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.188 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:16.188 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:16.188 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:16.188 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.188 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.188 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:16.188 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:16.189 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:16.189 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.189 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.189 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:16.189 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:16.189 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:16.189 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.189 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.189 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.189 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:16.189 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:16.189 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.189 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.189 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:16.190 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:16.190 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:16.190 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.190 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.190 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:16.190 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:16.190 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:16.190 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.190 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:16.190 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.190 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.190 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.190 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:16.190 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:16.190 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 82.304384440999996, 2024-04-26T12:06:16.191 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:16.191 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:16.191 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.191 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:16.191 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:16.191 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:16.191 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:16.191 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.191 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:16.191 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.191 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:16.191 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:16.191 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.191 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.192 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.192 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:16.192 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:16.192 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.192 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.193 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.193 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:16.193 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:16.193 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.193 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.193 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.193 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:16.193 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:16.193 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:16.193 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.193 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.193 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:16.193 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:16.193 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:16.194 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.194 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.194 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.194 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:16.194 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:16.194 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.194 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.194 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:16.194 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:16.194 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:16.194 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.194 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.194 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:16.194 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:16.195 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:16.195 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.195 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.195 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:16.195 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:16.195 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:16.195 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.195 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.195 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:16.195 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:16.195 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:16.195 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.195 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.195 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.195 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:16.196 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:16.196 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.196 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.196 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:16.196 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:16.196 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:16.196 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.196 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.196 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:16.196 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:16.196 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:16.196 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.196 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:16.196 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.197 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.197 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.197 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:16.197 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:16.197 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 82.304298777, 2024-04-26T12:06:16.197 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:16.197 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:16.197 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.197 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:16.197 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:16.197 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:16.197 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:16.197 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.197 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:16.197 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.198 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:16.198 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:16.198 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.198 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.198 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.198 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:16.198 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:16.198 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.198 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.198 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.198 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:16.198 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:16.198 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.198 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.198 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.199 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:16.199 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:16.199 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:16.199 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.199 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.199 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:16.199 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:16.199 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:16.199 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.199 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.199 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.199 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:16.199 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:16.199 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.200 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.200 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:16.200 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:16.200 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:16.200 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.200 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.200 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:16.200 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:16.200 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:16.200 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.200 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.200 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:16.200 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:16.201 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:16.201 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.201 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.201 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:16.201 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:16.201 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:16.201 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.201 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.201 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.201 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:16.201 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:16.201 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.201 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.201 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:16.201 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:16.202 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:16.202 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.202 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.202 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:16.202 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:16.202 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:16.202 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.202 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:16.202 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.202 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.202 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.202 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:16.202 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:16.202 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 72.378394490999995, 2024-04-26T12:06:16.203 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:16.203 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:16.203 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.203 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:16.203 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.203 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:16.203 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:16.203 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.203 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.203 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.203 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:16.203 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:16.203 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.203 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.203 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.204 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:16.204 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:16.204 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:16.204 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.204 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.204 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:16.204 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:16.204 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:16.204 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.204 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.204 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:16.204 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:16.204 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:16.204 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.204 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.205 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.205 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:16.205 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:16.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.205 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.205 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:16.205 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:16.205 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:16.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.205 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.205 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:16.205 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:16.205 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:16.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.205 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.206 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:16.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:16.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:16.206 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.206 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.206 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:16.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:16.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:16.206 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.206 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.206 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:16.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:16.206 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.207 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.207 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:16.207 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:16.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:16.207 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.207 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.207 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:16.207 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:16.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:16.207 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.207 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:16.207 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.207 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.207 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.208 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:16.208 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:16.208 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 72.378358395999996, 2024-04-26T12:06:16.208 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:16.208 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:16.208 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.208 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:16.208 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.208 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:16.208 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:16.208 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.208 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.208 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.208 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:16.208 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:16.209 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.209 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.209 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.209 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:16.209 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:16.209 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:16.209 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.209 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.209 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:16.209 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:16.209 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:16.209 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.209 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.209 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:16.209 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:16.210 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:16.210 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.210 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.210 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.210 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:16.210 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:16.210 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.210 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.210 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:16.210 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:16.210 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:16.210 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.210 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.210 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:16.211 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:16.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:16.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.211 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.211 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:16.211 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:16.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:16.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.211 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.211 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:16.211 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:16.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:16.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.211 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.211 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.212 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:16.212 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:16.212 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.212 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.212 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:16.212 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:16.212 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:16.212 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.212 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.212 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:16.212 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:16.212 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:16.212 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.212 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:16.212 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.213 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.213 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.213 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:16.213 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:16.213 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 72.378320712000004, 2024-04-26T12:06:16.213 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:16.213 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:16.213 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.213 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:16.213 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.213 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:16.213 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:16.213 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.213 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.214 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.214 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:16.214 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:16.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.214 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.214 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.214 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:16.214 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:16.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.214 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.214 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.215 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:16.215 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:16.215 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:16.215 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.215 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.215 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:16.215 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:16.215 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:16.215 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.215 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.215 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.215 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:16.215 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:16.215 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.216 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:16.216 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:16.216 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:16.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.216 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:16.216 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:16.216 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:16.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.216 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:16.216 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:16.216 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:16.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.217 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:16.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:16.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:16.217 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.217 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:16.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:16.217 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.217 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:16.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:16.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:16.217 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.218 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.218 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:16.218 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:16.218 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:16.218 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.218 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:16.218 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.218 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.218 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.218 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:16.218 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:16.218 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 72.378299372000001, 2024-04-26T12:06:16.218 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:16.218 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:16.218 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.219 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:16.219 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.219 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:16.219 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:16.219 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.219 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.219 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.219 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:16.219 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:16.219 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.219 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.219 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.219 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:16.219 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:16.219 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.220 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.220 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.220 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:16.220 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:16.220 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:16.220 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.220 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.220 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:16.220 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:16.220 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:16.220 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.220 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.220 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.220 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:16.221 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:16.221 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.221 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.221 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:16.221 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:16.221 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:16.221 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.221 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.221 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:16.221 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:16.221 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:16.221 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.221 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.221 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:16.221 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:16.222 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:16.222 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.222 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.222 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:16.222 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:16.222 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:16.222 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.222 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.222 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.222 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:16.222 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:16.222 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.222 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.222 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:16.222 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:16.223 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:16.223 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.223 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.223 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:16.223 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:16.223 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:16.223 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.223 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:16.223 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.223 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.223 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.223 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:16.223 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:16.223 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 72.378277105999999, 2024-04-26T12:06:16.223 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:16.224 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:16.224 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.224 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:16.224 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.224 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:16.224 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:16.224 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.224 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.224 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.224 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:16.224 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:16.224 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.224 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.224 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.224 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:16.225 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:16.225 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.225 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.225 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.225 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:16.225 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:16.225 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:16.225 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.225 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.225 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:16.225 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:16.225 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:16.225 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.225 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.225 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.226 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:16.226 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:16.226 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.226 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.226 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:16.226 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:16.226 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:16.226 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.226 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.226 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:16.226 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:16.226 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:16.226 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.227 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.227 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:16.227 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:16.227 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:16.227 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.227 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.227 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:16.227 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:16.227 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:16.227 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.227 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.227 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.227 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:16.227 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:16.228 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.228 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.228 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:16.228 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:16.228 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:16.228 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.228 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.228 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:16.228 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:16.228 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:16.228 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.228 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:16.228 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.228 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.228 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.229 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:16.229 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:16.229 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 72.378255483999993, 2024-04-26T12:06:16.229 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:16.229 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:16.229 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.229 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:16.229 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.229 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:16.229 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:16.229 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.229 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.229 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.229 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:16.230 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:16.230 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.230 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.230 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.230 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:16.230 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:16.230 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.230 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.230 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.230 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:16.230 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:16.230 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:16.231 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.231 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.231 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:16.231 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:16.231 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:16.231 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.231 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.231 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.231 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:16.231 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:16.232 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.232 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.232 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:16.232 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:16.232 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:16.232 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.232 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.232 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:16.232 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:16.232 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:16.232 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.233 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.233 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:16.233 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:16.233 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:16.233 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.233 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.233 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:16.233 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:16.233 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:16.233 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.234 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.234 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:16.234 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:16.234 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.234 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:16.234 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:16.234 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:16.234 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.234 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:16.234 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:16.235 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:16.235 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.235 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:16.235 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.235 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.235 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.235 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:16.235 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:16.235 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 72.378228918000005, 2024-04-26T12:06:16.235 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:16.236 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:16.236 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.236 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:16.236 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.236 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:16.236 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:16.236 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.236 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.236 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.236 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:16.236 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:16.237 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.237 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.237 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.237 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:16.237 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:16.237 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.237 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.237 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.237 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:16.237 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:16.237 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:16.237 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.238 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.238 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:16.238 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:16.238 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:16.238 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.238 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.238 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.238 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:16.238 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:16.239 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.239 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.239 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:16.239 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:16.239 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:16.239 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.239 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.239 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:16.239 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:16.239 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:16.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.240 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:16.240 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:16.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:16.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.240 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:16.240 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:16.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:16.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:16.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:16.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:16.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:16.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:16.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.242 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.242 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:16.242 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:16.242 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:16.242 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.242 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:16.242 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.242 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.242 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.242 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:16.242 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:16.242 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 72.378190406000002, 2024-04-26T12:06:16.243 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:16.243 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:16.243 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.243 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:16.243 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.243 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:16.243 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:16.243 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.243 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.243 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.243 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:16.243 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:16.243 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.244 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:16.244 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:16.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.244 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:16.244 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:16.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:16.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:16.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:16.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:16.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:16.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:16.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:16.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:16.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:16.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.246 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:16.246 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:16.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:16.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.246 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:16.246 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:16.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:16.247 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:16.247 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:16.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:16.247 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.247 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:16.248 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:16.248 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.248 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:16.248 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:16.248 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:16.248 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.248 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:16.248 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:16.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:16.249 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.249 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:16.249 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.249 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:16.249 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:16.249 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 72.378162232999998, 2024-04-26T12:06:16.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:16.249 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:16.249 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.250 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:16.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:16.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:16.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:16.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:16.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:16.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:16.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:16.251 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:16.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:16.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:16.251 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:16.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:16.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:16.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:16.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:16.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:16.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:16.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.253 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:16.253 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:16.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:16.253 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.253 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.253 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:16.253 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:16.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:16.253 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.253 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.253 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:16.253 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:16.254 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:16.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.254 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.254 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.254 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:16.254 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:16.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.254 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.255 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:16.255 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:16.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:16.255 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.255 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.255 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:16.255 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:16.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:16.255 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.255 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:16.255 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.256 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:16.256 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:16.256 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 72.378127668999994, 2024-04-26T12:06:16.256 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:16.256 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:16.256 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.256 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:16.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:16.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:16.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:16.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:16.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:16.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:16.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.258 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:16.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:16.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:16.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.258 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:16.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:16.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:16.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.258 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:16.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:16.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:16.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:16.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:16.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:16.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:16.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:16.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.263 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:16.263 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:16.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:16.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.263 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:16.263 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:16.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:16.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:16.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:16.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:16.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:16.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:16.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:16.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:16.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:16.265 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.265 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:16.265 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.265 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:16.265 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:16.265 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 72.377252889000005, 2024-04-26T12:06:16.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:16.266 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:16.266 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.266 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:16.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:16.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:16.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:16.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:16.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.267 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:16.267 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:16.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:16.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.267 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:16.267 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:16.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:16.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.267 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:16.267 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:16.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:16.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:16.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:16.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:16.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:16.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:16.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:16.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:16.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:16.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:16.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:16.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:16.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:16.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:16.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:16.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:16.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:16.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:16.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:16.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:16.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:16.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:16.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:16.270 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.270 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:16.270 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.271 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:16.271 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:16.271 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 72.377213929999996, 2024-04-26T12:06:16.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:16.271 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:16.271 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.271 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:16.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:16.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:16.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:16.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:16.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:16.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:16.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:16.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:16.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:16.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.273 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:16.273 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:16.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:16.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.273 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.273 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:16.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:16.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.273 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:16.274 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:16.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:16.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.274 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:16.274 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:16.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:16.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.274 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:16.274 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:16.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:16.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:16.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:16.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:16.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:16.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:16.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:16.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:16.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:16.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:16.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:16.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:16.276 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.276 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:16.276 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.276 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:16.276 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:16.277 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 72.377178458000003, 2024-04-26T12:06:16.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:16.277 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:16.277 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.277 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:16.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:16.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:16.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:16.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:16.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:16.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:16.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:16.279 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:16.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:16.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.279 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:16.279 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:16.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:16.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.279 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.279 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:16.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:16.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:16.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:16.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:16.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:16.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:16.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:16.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:16.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:16.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:16.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:16.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:16.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:16.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:16.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:16.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:16.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:16.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:16.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:16.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:16.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:16.283 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.283 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:16.283 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.284 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:16.284 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:16.284 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 72.377099768999997, 2024-04-26T12:06:16.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:16.284 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:16.284 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.284 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:16.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:16.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:16.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:16.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:16.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:16.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:16.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:16.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:16.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:16.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:16.286 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:16.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:16.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:16.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:16.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:16.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:16.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:16.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:16.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:16.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:16.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:16.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:16.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:16.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:16.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:16.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:16.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:16.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:16.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:16.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:16.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:16.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:16.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.290 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:16.290 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:16.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:16.290 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.290 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:16.290 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.290 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:16.290 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:16.290 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 72.376948920999993, 2024-04-26T12:06:16.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:16.290 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:16.290 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:16.291 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:16.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:16.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:16.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:16.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:16.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:16.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:16.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:16.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:16.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:16.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:16.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:16.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:16.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:16.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:16.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:16.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:16.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:16.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:16.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:16.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:16.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:16.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:16.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:16.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:16.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:16.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:16.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:16.294 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.294 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:16.294 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.294 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:16.294 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:16.294 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:16.295 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:16.294+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:16.296 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:16.396 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:16.395+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:16.405 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:16.405 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:16.405 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:06:16.406 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:16.414 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:16.498 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:16.496+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:16.515 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:16.515 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:16.515 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:16.515 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:16.515 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:16.527 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:16.603 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:16.600+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:16.630 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:16.630 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:16.630 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:16.630 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:16.631 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.631 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:16.631 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:16.631 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 72.848268504000004, 2024-04-26T12:06:16.631 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:06:16.631 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:16.631 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.631 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:16.631 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.631 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:16.631 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:16.631 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.631 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.631 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.632 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:16.632 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:16.632 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.632 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.632 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.632 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:16.632 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:06:16.632 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:16.632 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.632 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.632 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:16.632 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:06:16.632 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:06:16.632 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.632 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.633 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:16.633 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:06:16.633 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:06:16.633 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.633 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.633 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.633 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:06:16.633 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:06:16.633 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.633 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.633 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:16.633 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:06:16.633 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:06:16.633 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.634 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.634 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:16.634 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:16.634 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:06:16.634 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.634 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.634 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:16.634 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:06:16.634 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:06:16.634 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.634 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.634 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:16.634 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:06:16.634 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:06:16.634 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.635 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.635 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.635 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:06:16.635 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:06:16.635 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.635 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.635 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:16.635 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:06:16.635 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:06:16.635 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.635 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.635 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:16.635 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:06:16.635 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:06:16.635 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.636 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:16.636 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.636 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.636 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.636 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:16.636 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:16.636 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 72.848213184000002, 2024-04-26T12:06:16.636 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:06:16.636 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:16.636 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.636 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:16.636 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.636 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:16.636 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:16.637 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.637 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.637 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.637 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:16.637 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:16.637 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.637 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.637 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.637 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:16.637 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:06:16.637 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:16.637 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.637 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.637 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:16.637 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:06:16.638 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:06:16.638 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.638 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.638 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:16.638 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:06:16.638 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:06:16.638 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.638 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.638 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.638 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:06:16.638 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:06:16.638 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.638 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.639 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:16.639 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:06:16.639 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:06:16.639 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.639 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.639 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:16.639 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:06:16.639 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:06:16.639 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.639 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.639 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:16.639 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:06:16.639 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:06:16.639 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.639 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.640 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:16.640 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:06:16.640 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:06:16.640 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.640 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.640 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.640 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:06:16.640 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:06:16.640 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.640 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.640 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:16.640 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:06:16.640 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:06:16.640 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.640 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.641 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:16.641 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:06:16.641 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:06:16.641 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.641 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:16.641 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.641 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.641 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.641 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:16.641 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:16.641 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 72.848163166000006, 2024-04-26T12:06:16.641 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:06:16.641 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:16.641 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.641 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:16.642 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.642 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:16.642 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:16.642 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.642 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.642 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.642 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:16.642 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:16.642 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.642 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.642 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.642 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:16.642 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:06:16.642 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.643 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.643 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.643 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:16.643 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:06:16.643 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:06:16.643 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.643 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.643 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:16.643 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:06:16.643 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:06:16.643 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.643 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.644 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.644 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:06:16.644 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:06:16.644 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.644 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.644 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:16.644 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:06:16.644 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:06:16.644 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.644 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.644 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:16.644 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:06:16.644 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:06:16.644 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.645 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.645 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:16.645 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:06:16.645 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:06:16.645 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.645 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.645 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:16.645 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:06:16.645 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:06:16.645 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.646 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.646 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.646 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:06:16.646 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:06:16.646 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.646 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.646 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:16.646 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:06:16.646 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:06:16.646 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.646 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.646 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:16.646 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:06:16.646 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:06:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 72.848128528999993, 2024-04-26T12:06:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:06:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:16.648 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.648 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.648 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.648 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:16.648 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:16.648 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.648 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.648 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.648 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:16.648 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:06:16.648 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.648 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.648 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.648 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:16.649 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:06:16.649 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:06:16.649 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.649 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.649 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:16.649 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:16.649 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:06:16.649 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.649 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.649 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.649 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:06:16.649 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:06:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:06:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:06:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:06:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:06:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:06:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:06:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:06:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:06:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:06:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:06:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:06:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:06:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:06:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:06:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 72.848090017000004, 2024-04-26T12:06:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:06:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:16.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:16.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.654 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.654 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:16.654 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:16.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:06:16.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.654 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.654 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:16.654 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:06:16.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:06:16.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.654 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.654 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:06:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:06:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:06:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:06:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:06:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:06:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:06:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:06:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:06:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:06:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:06:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:06:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.657 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:16.657 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:06:16.657 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:06:16.657 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.657 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.657 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:16.657 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:06:16.657 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:06:16.657 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.657 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:16.657 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.657 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.657 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.657 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 72.848059694, 2024-04-26T12:06:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:06:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:06:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:06:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:06:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:06:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:06:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:06:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:06:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:06:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:06:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:06:16.661 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:06:16.661 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.661 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.661 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:16.661 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:06:16.661 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:06:16.661 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.661 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.661 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:16.661 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:06:16.661 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:06:16.661 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:06:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:06:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:06:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:06:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:06:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:06:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 72.848032992, 2024-04-26T12:06:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:06:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:06:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:06:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:06:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:06:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:06:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:06:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:06:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:06:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:06:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:06:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:06:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:06:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 72.847990702000004, 2024-04-26T12:06:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:06:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:16.668 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:16.668 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.668 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.668 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.668 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:16.668 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:16.668 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.670 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.670 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.670 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:16.670 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:06:16.670 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:06:16.670 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.670 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.670 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:16.670 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:06:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:06:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:06:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:06:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:06:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:06:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.672 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.672 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:16.672 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:06:16.672 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:06:16.672 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.672 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.672 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:16.672 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:06:16.672 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:06:16.672 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.672 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:16.672 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 72.847962624000004, 2024-04-26T12:06:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:06:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:06:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:06:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:06:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:06:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:06:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:06:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:06:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:06:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:06:16.676 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.683 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:06:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:06:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:06:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:06:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 72.841967273999998, 2024-04-26T12:06:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:06:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.686 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.686 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.686 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:16.686 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:06:16.686 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.686 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.686 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.686 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:16.686 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:06:16.686 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:06:16.686 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.686 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.686 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:16.686 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:06:16.686 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:06:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:06:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:06:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:06:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:06:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:06:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:06:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:06:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:06:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:06:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:06:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 72.841898307999998, 2024-04-26T12:06:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:06:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:06:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:06:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:06:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:06:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:06:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:06:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:06:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:06:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:06:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:06:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:06:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:06:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:06:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:06:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 72.841403944999996, 2024-04-26T12:06:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:06:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:16.694 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:16.694 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.694 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.694 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.694 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:16.695 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:16.695 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.695 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.695 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.695 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:16.695 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:06:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:06:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:06:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:06:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:06:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:06:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:06:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:06:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:06:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:06:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:06:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:06:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:06:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:06:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 72.841365679999996, 2024-04-26T12:06:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:06:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:06:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:06:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:06:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:06:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:06:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:06:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:06:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:06:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:06:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:06:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:06:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:06:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:06:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:06:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:06:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 72.840685794999999, 2024-04-26T12:06:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:06:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:06:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:06:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:06:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:06:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:06:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:06:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:06:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:06:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:06:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:06:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:16.706 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.706 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.706 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.706 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:16.706 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:16.706 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 72.840656616000004, 2024-04-26T12:06:16.706 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:06:16.706 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:06:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:06:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:06:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:06:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:06:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:06:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:06:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:06:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:06:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:06:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:06:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:06:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:06:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 72.840624805000004, 2024-04-26T12:06:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:06:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:06:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:06:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:06:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:06:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:06:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:06:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:06:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:06:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:06:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:06:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:06:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:06:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 72.840603449, 2024-04-26T12:06:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:06:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:06:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:06:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:06:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:06:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:06:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:06:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:06:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:06:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:06:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:06:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:06:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:06:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:06:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 72.840574996000001, 2024-04-26T12:06:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:06:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:06:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:06:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:06:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:06:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:06:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:06:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.722 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:16.722 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:06:16.722 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:06:16.722 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.722 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.722 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:16.722 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:06:16.722 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:06:16.722 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.723 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:16.723 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.723 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.723 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.723 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:06:16.723 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:16.723 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 72.839853189999999, 2024-04-26T12:06:16.723 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:06:16.724 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:16.724 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:16.724 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:16.724 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:06:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:06:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:06:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:06:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:06:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:06:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:06:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:06:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:06:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:16.728 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:06:16.728 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:06:16.728 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.728 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:16.728 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.728 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.728 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.728 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:06:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 67.122926586999995, 2024-04-26T12:06:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:06:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.730 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.730 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:16.730 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:16.730 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:16.730 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.730 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.730 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:16.730 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:06:16.730 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:06:16.730 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.730 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.730 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:06:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:06:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:06:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:06:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:06:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:06:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:06:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:06:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:06:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:06:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:06:16.733 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:06:16.733 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.733 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.733 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:16.733 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:06:16.733 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:06:16.734 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.734 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.734 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:16.734 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:06:16.734 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:06:16.734 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.734 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.735 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:16.735 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:06:16.735 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:06:16.735 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:16.735 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:16.735 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:16.735 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:06:16.735 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:06:16.736 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.736 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:16.736 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.736 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:16.736 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:16.736 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:16.736 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:16.737 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:16.736+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:16.838 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:16.837+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:16.839 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:16.839 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:16.839 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:06:16.839 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:16.848 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:16.939 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:16.938+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:16.957 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-26T12:06:16.992 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:16.993 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:16.993 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:16.993 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:16.993 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:17.001 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:17.042 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:17.041+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:17.141 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:17.140+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:17.144 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:17.144 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:17.144 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:17.144 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:17.144 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.144 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:17.144 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:17.144 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 83.287209089000001, 2024-04-26T12:06:17.144 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:17.144 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 83.287103192999993, 2024-04-26T12:06:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.152 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:17.152 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:17.152 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:17.152 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.152 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.152 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:17.152 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:17.152 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:17.152 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 83.287088213000004, 2024-04-26T12:06:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 83.287044338000001, 2024-04-26T12:06:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 83.286958674000005, 2024-04-26T12:06:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 73.361054387999999, 2024-04-26T12:06:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 73.361018293000001, 2024-04-26T12:06:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.180 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.180 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:17.180 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:17.180 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:17.180 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.180 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 73.360980608999995, 2024-04-26T12:06:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 73.360959269000006, 2024-04-26T12:06:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 73.360937003000004, 2024-04-26T12:06:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:17.197 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:17.197 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.197 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.197 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:17.197 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:17.197 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:17.197 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.197 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.197 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:17.197 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:17.197 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:17.198 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.198 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.198 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:17.198 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:17.198 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:17.198 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.198 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:17.198 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.198 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.198 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.198 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:17.198 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:17.198 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 73.360915380999998, 2024-04-26T12:06:17.198 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:17.198 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:17.199 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:17.199 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:17.199 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.199 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:17.199 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:17.199 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.199 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.199 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.199 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:17.199 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:17.199 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.199 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.199 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.199 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:17.199 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:17.200 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:17.200 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.200 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.200 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:17.200 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:17.200 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:17.200 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.200 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.200 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:17.200 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:17.200 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:17.200 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.200 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.200 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:17.200 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:17.201 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:17.201 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.201 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.201 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:17.201 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:17.201 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:17.201 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.201 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.201 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:17.201 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:17.201 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:17.201 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.201 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.201 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:17.201 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:17.202 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:17.202 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.202 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.202 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:17.202 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:17.202 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:17.202 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.202 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.202 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:17.202 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:17.202 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:17.202 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.202 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.202 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:17.202 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:17.203 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:17.203 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.203 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.203 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:17.203 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:17.203 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:17.203 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.203 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:17.203 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.203 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.203 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.203 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:17.203 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:17.203 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 73.360888814999996, 2024-04-26T12:06:17.203 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:17.204 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:17.204 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:17.204 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:17.204 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.204 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:17.204 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:17.204 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.204 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.204 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.204 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:17.204 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:17.204 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.204 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.204 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.205 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:17.205 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:17.205 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:17.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.205 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.205 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:17.205 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:17.205 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:17.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.205 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.205 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:17.205 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:17.205 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:17.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.205 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.206 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:17.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:17.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:17.206 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.206 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.206 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:17.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:17.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:17.206 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.206 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.206 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:17.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:17.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:17.206 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.206 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.207 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:17.207 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:17.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:17.207 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.207 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.207 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:17.207 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:17.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:17.207 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.207 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.207 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:17.207 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:17.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:17.207 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.207 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.208 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:17.208 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:17.208 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:17.208 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.208 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.208 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:17.208 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:17.208 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:17.208 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.208 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:17.208 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.208 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.208 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.208 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:17.208 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:17.208 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 73.360850303000007, 2024-04-26T12:06:17.209 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:17.209 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:17.209 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:17.209 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:17.209 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.209 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:17.209 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:17.209 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.209 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.209 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.209 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:17.209 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:17.209 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.209 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.210 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.210 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:17.210 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:17.210 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:17.210 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.210 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.210 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:17.210 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:17.210 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:17.210 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.210 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.210 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:17.210 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:17.210 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:17.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.211 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.211 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:17.211 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:17.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:17.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.211 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.211 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:17.211 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:17.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:17.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.211 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.211 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:17.211 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:17.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:17.212 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.212 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.212 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:17.212 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:17.212 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:17.212 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.212 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.212 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:17.212 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:17.212 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:17.212 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.212 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.212 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:17.212 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:17.212 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:17.213 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.213 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.213 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:17.213 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:17.213 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:17.213 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.213 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.213 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:17.213 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:17.213 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:17.213 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.213 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:17.213 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.213 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.213 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.213 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:17.214 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:17.214 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 73.360822130000003, 2024-04-26T12:06:17.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:17.214 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:17.214 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:17.214 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:17.214 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.214 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:17.214 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:17.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.214 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.214 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.214 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:17.214 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:17.215 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.215 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.215 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.215 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:17.215 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:17.215 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:17.215 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.215 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.215 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:17.215 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:17.215 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:17.215 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.215 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.215 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:17.215 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:17.216 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:17.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.216 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:17.216 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:17.216 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:17.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.216 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:17.216 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:17.216 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:17.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.216 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:17.216 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:17.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:17.217 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.217 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:17.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:17.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:17.217 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.217 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:17.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:17.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:17.217 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.217 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:17.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:17.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:17.218 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.218 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.218 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:17.218 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:17.218 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:17.218 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.218 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.218 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:17.218 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:17.218 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:17.218 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.218 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:17.218 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.218 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.218 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.219 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:17.219 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:17.219 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 73.360787565999999, 2024-04-26T12:06:17.219 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:17.219 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:17.219 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:17.219 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:17.219 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.219 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:17.219 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:17.219 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.219 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.219 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.219 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:17.220 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:17.220 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.220 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.220 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.220 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:17.220 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:17.220 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:17.220 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.220 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.220 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:17.220 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:17.220 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:17.220 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.220 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.220 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:17.221 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:17.221 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:17.221 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.221 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.221 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:17.221 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:17.221 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:17.221 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.221 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.221 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:17.221 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:17.221 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:17.221 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.221 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.221 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:17.222 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:17.222 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:17.222 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.222 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.222 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:17.222 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:17.222 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:17.222 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.222 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.222 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:17.222 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:17.222 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:17.222 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.222 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.222 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:17.223 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:17.223 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:17.223 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.223 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.223 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:17.223 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:17.223 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:17.223 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.223 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.223 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:17.223 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:17.223 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:17.223 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.223 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:17.223 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.224 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.224 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.224 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:17.224 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:17.224 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 73.359912785999995, 2024-04-26T12:06:17.224 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:17.224 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:17.224 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:17.224 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:17.224 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.224 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:17.224 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:17.224 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.224 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.224 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.224 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:17.225 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:17.225 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.225 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.225 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.225 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:17.225 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:17.225 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:17.225 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.225 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.225 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:17.225 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:17.225 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:17.225 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.225 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.225 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:17.226 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:17.226 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:17.226 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.226 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.226 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:17.226 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:17.226 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:17.226 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.226 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.226 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:17.226 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:17.226 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:17.226 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.226 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.226 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:17.227 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:17.227 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:17.227 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.227 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.227 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:17.227 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:17.227 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:17.227 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.227 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.227 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:17.227 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:17.227 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:17.227 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.227 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.227 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:17.228 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:17.228 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:17.228 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.228 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.228 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:17.228 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:17.228 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:17.228 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.228 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.228 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:17.228 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:17.228 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:17.228 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.228 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:17.228 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.229 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.229 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.229 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:17.229 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:17.229 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 73.359873827000001, 2024-04-26T12:06:17.229 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:17.229 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:17.229 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:17.229 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:17.229 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.229 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:17.229 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:17.229 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.229 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.229 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.230 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:17.230 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:17.230 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.230 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.230 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.230 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:17.230 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:17.230 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:17.230 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.230 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.230 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:17.230 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:17.230 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:17.230 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.230 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.231 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:17.231 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:17.231 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:17.231 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.231 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.231 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:17.231 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:17.231 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:17.231 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.231 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.231 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:17.231 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:17.231 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:17.231 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.231 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.232 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:17.232 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:17.232 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:17.232 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.232 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.232 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:17.232 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:17.232 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:17.232 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.232 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.232 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:17.232 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:17.232 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:17.232 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.232 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.232 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:17.233 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:17.233 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:17.233 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.233 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.233 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:17.233 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:17.233 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:17.233 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.233 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.233 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:17.233 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:17.233 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:17.233 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.233 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:17.233 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.234 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.234 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:17.234 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:17.234 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 73.359838354999994, 2024-04-26T12:06:17.234 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:17.234 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:17.234 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:17.234 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:17.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.234 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:17.234 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:17.234 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.234 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.235 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.235 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:17.235 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:17.235 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.235 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.235 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.235 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:17.235 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:17.235 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:17.235 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.235 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.235 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:17.235 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:17.235 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:17.235 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.236 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.236 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:17.236 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:17.236 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:17.236 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.236 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.236 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:17.236 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:17.236 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:17.236 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.236 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.236 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:17.236 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:17.236 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:17.236 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.237 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.237 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:17.237 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:17.237 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:17.237 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.237 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.237 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:17.237 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:17.237 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:17.237 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.237 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.237 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:17.237 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:17.237 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:17.237 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.237 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.238 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:17.238 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:17.238 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:17.238 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.238 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.238 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:17.238 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:17.238 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:17.238 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.238 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.238 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:17.238 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:17.238 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:17.238 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.239 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:17.239 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.239 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.239 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.239 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:17.239 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:17.239 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 73.359759666000002, 2024-04-26T12:06:17.239 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:17.239 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:17.239 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:17.239 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:17.239 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.239 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:17.239 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:17.239 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.239 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.240 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:17.240 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:17.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.240 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:17.240 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:17.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:17.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.240 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:17.240 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:17.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:17.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:17.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:17.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:17.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:17.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:17.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:17.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:17.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:17.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:17.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.242 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:17.242 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:17.242 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:17.242 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.242 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.242 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:17.242 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:17.242 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:17.242 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.242 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.242 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:17.242 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:17.242 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:17.242 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.242 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.243 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:17.243 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:17.243 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:17.243 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.243 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.243 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:17.243 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:17.243 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:17.243 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.243 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.243 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:17.243 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:17.243 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:17.243 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.243 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:17.244 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.244 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:17.244 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:17.244 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 73.359608817999998, 2024-04-26T12:06:17.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:17.244 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:17.244 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:17.244 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:17.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.244 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:17.244 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:17.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:17.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:17.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:17.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:17.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:17.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:17.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:17.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:17.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:17.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.246 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:17.246 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:17.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:17.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.246 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:17.246 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:17.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:17.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.246 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:17.246 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:17.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:17.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:17.247 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:17.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:17.247 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:17.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:17.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:17.247 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:17.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:17.247 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.247 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:17.247 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.247 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:17.247 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:17.247 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:17.249 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:17.247+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:17.249 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:17.351 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:17.349+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:17.353 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:17.353 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:17.353 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:06:17.353 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:17.363 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:17.447 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:06:17.451 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:17.450+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:17.506 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:17.506 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:17.506 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:17.506 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:17.506 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:17.514 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:17.559 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:17.558+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:17.575 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:17.575 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:17.576 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:06:17.594 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:17.594 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:17.597 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:06:17.598 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:06:17.616 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:17.616 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:17.625 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:17.670 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:17.669+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:17.728 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:17.729 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:17.737 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:17.753 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-26T12:06:17.778 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:17.777+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:17.854 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:17.853+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:17.879 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:17.879 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:17.889 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:17.956 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:17.955+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:18.030 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:18.030 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:18.039 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:18.084 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:18.083+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:18.141 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:18.141 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:18.149 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:18.158 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:18.157+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:18.259 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:18.258+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:18.291 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:18.292 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:18.301 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:18.360 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:18.359+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:18.402 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:18.402 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:18.411 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:18.461 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:18.460+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:18.515 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:18.516 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:18.524 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:18.568 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:18.567+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:18.625 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:18.625 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:18.634 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:18.675 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:18.674+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:18.763 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:18.762+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:18.776 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:18.776 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:18.785 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:18.864 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:18.863+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:18.888 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:18.888 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:18.898 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:18.965 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:18.964+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:18.972 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:06:19.002 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:19.002 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:19.009 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:19.066 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:19.065+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:19.110 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:19.111 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:19.120 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:19.167 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:19.165+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:19.225 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:19.225 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:19.233 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:19.275 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:19.274+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:19.370 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:19.368+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:19.377 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:19.377 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:19.385 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:19.470 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:19.469+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:19.488 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:19.488 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:19.496 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:19.571 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:19.570+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:19.598 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:06:19.599 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:19.599 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:19.607 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:19.691 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:19.690+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:19.726 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:06:19.745 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:19.745 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:19.748 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:06:19.748 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:06:19.749 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:19.749 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:19.749 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:19.749 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:19.749 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:19.758 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:19.772 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:19.771+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:19.874 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:19.872+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:19.901 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:19.901 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:19.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:19.902 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:19.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.902 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:19.902 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:19.902 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 76.118951850000002, 2024-04-26T12:06:19.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:06:19.902 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:19.902 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:19.902 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:19.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:19.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:19.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:19.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:19.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:19.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:06:19.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:19.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:19.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:06:19.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:06:19.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:19.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:06:19.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:06:19.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:19.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:06:19.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:06:19.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:19.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:06:19.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:06:19.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:19.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:19.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:06:19.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:19.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:06:19.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:06:19.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:19.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:06:19.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:06:19.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:19.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:06:19.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:06:19.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:19.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:06:19.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:06:19.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:19.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:06:19.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:06:19.907 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.907 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:19.907 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.908 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:19.908 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:19.908 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 76.118896530000001, 2024-04-26T12:06:19.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:06:19.908 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:19.908 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:19.909 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:19.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:19.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:19.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:19.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:19.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:19.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:06:19.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:19.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:19.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:06:19.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:06:19.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:19.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:06:19.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:06:19.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:19.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:06:19.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:06:19.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:19.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:06:19.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:06:19.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:19.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:06:19.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:06:19.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:19.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:06:19.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:06:19.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:19.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:06:19.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:06:19.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:19.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:06:19.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:06:19.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:19.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:06:19.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:06:19.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:19.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:06:19.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:06:19.914 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.914 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:19.914 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.914 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:19.914 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:19.914 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 76.118846512000005, 2024-04-26T12:06:19.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:06:19.914 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:19.914 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:19.914 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:19.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:19.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:19.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:19.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:19.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:19.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:06:19.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:19.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:19.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:06:19.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:06:19.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:19.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:06:19.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:06:19.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:19.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:06:19.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:06:19.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:19.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:06:19.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:06:19.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:19.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:06:19.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:06:19.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:19.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:06:19.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:06:19.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:19.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:06:19.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:06:19.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:19.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:06:19.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:06:19.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:19.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:06:19.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:06:19.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:19.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:06:19.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:06:19.919 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.919 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:19.919 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.920 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:19.920 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:19.920 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 76.118811875000006, 2024-04-26T12:06:19.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:06:19.920 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:19.920 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:19.920 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:19.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:19.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:19.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:19.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:19.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:19.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:06:19.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:19.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:19.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:06:19.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:06:19.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:19.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:19.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:06:19.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:19.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:06:19.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:06:19.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:19.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:06:19.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:06:19.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:19.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:06:19.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:06:19.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:19.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:06:19.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:06:19.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:19.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:06:19.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:06:19.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:19.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:06:19.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:06:19.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:19.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:06:19.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:06:19.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:19.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:06:19.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:06:19.924 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.925 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:19.925 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.925 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:19.925 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:19.925 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 76.118773363000003, 2024-04-26T12:06:19.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:06:19.925 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:19.925 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:19.925 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:19.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:19.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:19.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:19.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:19.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:19.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:19.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:19.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:19.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:19.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:06:19.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:19.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:06:19.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:06:19.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:19.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:06:19.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:06:19.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:19.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:06:19.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:06:19.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:19.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:06:19.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:06:19.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:19.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:06:19.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:06:19.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:19.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:06:19.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:06:19.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:19.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:06:19.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:06:19.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:19.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:06:19.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:06:19.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:19.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:06:19.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:06:19.931 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.931 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:19.931 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.931 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:19.932 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:19.932 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 76.118743039999998, 2024-04-26T12:06:19.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:06:19.932 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:19.932 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:19.932 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:19.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:19.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:19.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:19.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:19.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:19.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:06:19.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:19.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:19.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:06:19.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:06:19.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:19.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:06:19.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:06:19.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:19.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:06:19.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:06:19.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:19.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:06:19.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:06:19.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:19.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:06:19.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:06:19.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:19.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:06:19.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:06:19.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:19.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:06:19.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:06:19.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:19.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:06:19.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:06:19.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:19.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:06:19.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:06:19.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:19.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:06:19.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:06:19.937 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.937 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:19.938 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.938 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:19.938 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:19.938 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 76.118716337999999, 2024-04-26T12:06:19.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:06:19.938 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:19.938 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:19.938 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:19.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:19.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:19.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:19.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:19.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:19.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:19.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:19.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:19.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:06:19.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:06:19.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:19.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:06:19.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:06:19.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:19.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:06:19.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:06:19.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:19.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:06:19.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:06:19.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:19.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:06:19.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:06:19.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:19.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:06:19.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:06:19.942 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.942 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:19.942 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.943 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:19.943 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:19.943 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 76.118674048000003, 2024-04-26T12:06:19.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:06:19.943 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:19.943 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:19.943 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:19.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:19.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:19.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:19.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:19.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:19.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:19.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:19.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:19.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:06:19.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:06:19.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:19.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:06:19.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:06:19.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:19.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:06:19.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:06:19.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:19.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:06:19.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:06:19.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:19.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:06:19.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:06:19.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:19.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:06:19.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:06:19.946 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.946 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:19.946 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.946 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:19.946 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:19.946 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 76.118645970000003, 2024-04-26T12:06:19.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:06:19.947 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:19.947 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:19.947 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:19.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:19.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:19.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:19.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:19.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:19.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:06:19.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:19.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:19.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:06:19.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:06:19.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:19.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:06:19.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:06:19.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:19.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:06:19.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:06:19.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:19.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:06:19.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:06:19.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:19.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:06:19.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:06:19.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:19.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:06:19.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:06:19.950 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.950 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:19.950 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.950 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:19.950 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:19.950 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 76.112650619999997, 2024-04-26T12:06:19.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:06:19.950 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:19.950 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:19.950 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:19.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:19.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:19.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:19.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:19.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:19.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:06:19.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:19.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:19.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:06:19.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:06:19.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:19.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:06:19.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:06:19.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:19.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:06:19.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:06:19.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:19.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:06:19.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:06:19.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:19.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:06:19.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:06:19.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:19.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:06:19.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:06:19.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:19.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:06:19.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:06:19.954 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.954 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:19.954 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.954 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:19.954 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:19.954 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 76.112581653999996, 2024-04-26T12:06:19.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:06:19.954 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:19.954 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:19.954 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:19.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:19.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:19.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:19.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:19.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:19.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:06:19.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:19.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:19.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:06:19.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:06:19.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:19.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:06:19.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:06:19.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:19.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:06:19.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:06:19.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:19.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:06:19.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:06:19.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:19.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:19.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:06:19.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:19.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:06:19.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:06:19.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:19.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:06:19.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:06:19.958 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.958 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:19.958 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.958 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:19.958 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:19.959 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 76.112087290999995, 2024-04-26T12:06:19.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:06:19.959 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:19.959 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:19.959 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:19.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:19.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:19.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:19.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:19.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:19.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:19.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:19.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:19.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:06:19.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:06:19.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:19.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:06:19.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:06:19.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:19.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:06:19.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:06:19.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:19.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:06:19.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:06:19.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:19.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:06:19.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:06:19.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:19.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:06:19.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:06:19.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:19.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:06:19.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:06:19.963 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.963 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:19.963 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.963 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:19.963 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:19.963 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 76.112049025999994, 2024-04-26T12:06:19.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:06:19.963 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:19.963 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:19.963 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:19.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:19.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:19.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:19.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:19.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:19.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:19.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:19.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:19.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:06:19.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:06:19.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:19.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:06:19.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:06:19.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:19.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:06:19.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:06:19.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:19.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:06:19.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:06:19.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:19.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:06:19.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:06:19.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:19.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:06:19.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:06:19.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:19.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:06:19.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:06:19.968 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.968 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:19.968 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.969 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:06:19.969 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:19.969 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 76.111369140999997, 2024-04-26T12:06:19.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:06:19.969 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:19.969 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:19.969 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:19.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:19.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:19.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:19.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:19.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:19.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:19.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:19.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:19.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:06:19.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:06:19.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:19.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:06:19.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:06:19.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:19.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:06:19.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:06:19.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:19.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:06:19.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:06:19.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:19.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:06:19.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:06:19.973 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.973 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:19.973 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.973 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:19.973 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:19.973 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 76.111339962000002, 2024-04-26T12:06:19.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:06:19.973 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:19.973 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:19.973 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:19.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:19.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:19.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:19.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:19.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:19.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:06:19.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:19.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:19.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:06:19.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:06:19.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:19.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:06:19.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:06:19.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:19.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:06:19.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:06:19.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:19.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:06:19.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:06:19.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:19.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:06:19.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:06:19.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:19.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:06:19.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:06:19.977 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.977 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:19.977 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.977 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:19.977 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:19.977 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 76.111308151000003, 2024-04-26T12:06:19.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:06:19.978 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:19.978 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:19.978 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:19.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:19.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:19.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:19.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:19.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:19.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:19.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:19.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:19.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:06:19.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:06:19.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:19.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:06:19.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:06:19.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:19.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:06:19.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:06:19.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:19.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:06:19.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:06:19.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:19.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:06:19.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:06:19.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:19.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:06:19.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:06:19.981 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.981 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:19.981 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.981 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:19.981 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:19.981 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 76.111286794999998, 2024-04-26T12:06:19.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:06:19.981 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:19.981 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:19.981 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:19.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:19.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:19.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:19.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:19.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:19.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:19.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:19.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:19.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:06:19.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:06:19.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:19.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:06:19.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:06:19.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:19.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:06:19.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:06:19.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:19.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:06:19.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:06:19.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:19.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:06:19.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:06:19.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:19.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:06:19.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:06:19.990 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.990 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:19.990 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.990 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:06:19.990 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:19.990 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 76.111258341999999, 2024-04-26T12:06:19.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:06:19.990 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:19.990 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:19.990 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:19.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:19.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:19.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:19.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:19.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:19.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:19.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:19.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.992 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:19.992 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:06:19.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:06:19.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:19.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:06:19.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:06:19.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:19.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:06:19.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:06:19.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:19.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:06:19.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:06:19.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:19.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:06:19.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:06:19.994 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.994 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:19.994 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.994 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:06:19.994 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:19.994 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 76.110536535999998, 2024-04-26T12:06:19.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:06:19.994 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:19.995 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:19.995 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:19.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:19.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:19.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:19.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:19.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:19.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:06:19.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:19.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:19.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:06:19.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:06:19.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:19.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:06:19.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:06:19.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:19.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:06:19.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:06:19.997 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.997 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:19.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:06:19.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:06:19.997 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.997 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:19.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:06:19.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:06:19.997 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.997 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:19.998 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:19.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.998 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:06:19.998 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:19.998 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 70.393609932999993, 2024-04-26T12:06:19.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:06:19.998 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:19.998 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:19.998 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:19.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:19.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:19.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:19.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:19.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:19.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:19.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:19.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:19.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:06:19.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:06:19.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:20.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:06:20.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:06:20.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:20.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:06:20.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:06:20.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.001 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.001 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:06:20.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:06:20.001 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.001 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:20.001 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:06:20.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:06:20.001 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.001 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:20.001 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:06:20.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:06:20.001 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:20.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:06:20.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:06:20.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:20.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:06:20.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:06:20.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:06:20.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:06:20.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:20.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:06:20.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:06:20.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:20.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:06:20.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:06:20.004 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.004 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:20.004 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.004 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.004 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:20.004 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:20.006 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:20.004+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:20.007 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-26T12:06:20.007 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:20.106 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:20.105+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:20.111 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:20.112 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:20.112 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:06:20.112 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:20.120 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:20.207 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:20.206+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:20.262 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:20.263 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:20.263 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:20.263 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:20.263 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:20.271 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:20.308 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:20.307+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:20.409 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:20.408+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:20.415 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:20.415 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:20.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:20.415 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:20.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.416 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:20.416 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:20.416 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 86.557903839000005, 2024-04-26T12:06:20.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:20.416 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:20.416 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.416 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:20.416 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:20.416 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:20.417 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:20.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.417 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:20.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:20.417 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:20.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:20.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:20.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:20.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:20.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:20.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:20.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:20.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:20.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:20.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:20.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:20.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:20.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:20.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:20.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:20.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:20.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:20.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:20.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:20.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:20.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:20.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:20.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:20.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:20.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:20.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:20.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.423 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:20.423 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:20.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:20.423 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.423 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:20.423 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:20.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:20.423 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.423 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:20.423 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.423 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.424 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:20.424 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:20.424 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 86.557797942999997, 2024-04-26T12:06:20.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:20.424 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:20.424 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.424 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:20.424 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:20.424 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:20.424 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:20.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.424 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:20.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:20.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:20.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:20.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:20.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:20.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:20.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.426 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:20.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:20.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:20.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.426 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:20.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:20.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:20.427 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.427 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.427 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.427 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:20.427 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:20.427 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.427 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.427 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:20.427 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:20.427 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:20.427 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.427 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.427 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:20.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:20.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:20.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:20.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:20.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:20.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:20.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:20.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:20.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:20.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:20.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:20.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:20.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:20.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:20.430 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:20.430 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:20.430 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.430 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:20.430 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.430 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.430 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.430 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:20.430 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:20.430 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 86.557782962999994, 2024-04-26T12:06:20.430 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:20.430 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:20.430 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.431 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:20.431 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:20.431 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:20.431 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:20.431 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.431 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:20.431 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.431 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:20.431 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:20.431 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.431 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.431 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.432 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:20.432 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:20.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.432 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.432 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.432 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:20.432 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:20.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.432 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.432 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.432 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:20.432 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:20.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:20.433 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.433 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.433 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:20.433 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:20.433 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:20.433 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.433 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.433 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.433 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:20.433 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:20.433 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.433 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.434 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:20.434 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:20.434 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:20.434 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.434 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.434 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:20.434 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:20.434 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:20.434 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.434 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.434 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:20.434 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:20.435 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:20.435 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.435 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.435 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:20.435 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:20.435 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:20.435 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.435 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.435 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.435 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:20.435 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:20.435 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.435 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.436 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:20.436 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:20.436 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:20.436 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.436 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.436 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:20.436 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:20.436 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:20.436 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.436 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:20.436 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.436 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.436 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.437 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:20.437 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:20.437 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 86.557739088000005, 2024-04-26T12:06:20.437 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:20.437 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:20.437 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.437 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:20.437 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:20.437 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:20.437 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:20.437 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.437 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:20.438 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.438 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:20.438 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:20.438 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.438 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.438 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.438 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:20.438 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:20.438 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.438 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.438 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.439 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:20.439 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:20.439 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.439 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.439 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.439 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:20.439 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:20.439 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:20.439 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.439 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.439 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:20.440 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:20.440 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:20.440 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.440 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.440 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.440 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:20.440 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:20.440 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.440 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.440 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:20.440 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:20.440 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:20.440 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.441 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.441 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:20.441 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:20.441 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:20.441 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.441 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.441 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:20.441 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:20.441 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:20.441 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.441 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.441 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:20.442 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:20.442 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:20.442 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.442 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.442 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.442 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:20.442 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:20.442 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.442 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.442 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:20.442 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:20.443 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:20.443 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.443 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.443 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:20.443 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:20.443 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:20.443 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.443 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:20.443 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.444 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.444 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.444 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:20.444 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:20.444 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 86.557653423999994, 2024-04-26T12:06:20.444 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:20.444 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:20.444 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.444 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:20.444 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:20.444 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:20.444 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:20.445 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.445 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:20.445 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.445 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:20.445 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:20.445 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.445 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.445 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.445 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:20.446 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:20.446 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.446 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.446 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.446 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:20.446 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:20.446 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.446 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.446 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.446 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:20.446 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:20.447 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:20.447 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.447 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.447 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:20.447 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:20.447 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:20.447 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.447 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.447 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.448 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:20.448 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:20.448 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.448 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.448 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:20.448 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:20.448 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:20.448 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.448 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.448 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:20.448 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:20.449 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:20.449 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.449 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.449 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:20.449 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:20.449 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:20.449 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.449 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.449 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:20.450 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:20.450 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:20.450 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.450 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.450 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.450 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:20.450 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:20.450 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.450 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.450 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:20.451 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:20.451 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:20.451 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.451 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.451 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:20.451 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:20.451 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:20.451 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.451 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:20.451 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.452 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.452 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.452 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:20.452 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:20.452 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 76.631749138000004, 2024-04-26T12:06:20.452 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:20.452 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:20.452 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.452 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:20.452 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.453 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:20.453 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:20.453 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.453 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.453 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.453 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:20.453 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:20.453 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.453 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.454 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.454 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:20.454 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:20.454 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:20.454 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.454 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.454 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:20.454 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:20.454 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:20.455 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.455 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.455 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:20.455 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:20.455 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:20.455 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.455 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.455 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.455 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:20.455 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:20.455 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.455 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.455 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:20.456 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:20.456 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:20.456 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.456 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.456 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:20.456 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:20.456 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:20.456 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.456 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.456 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:20.456 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:20.456 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:20.457 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.457 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.457 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:20.457 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:20.457 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:20.457 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.457 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.457 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.457 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:20.457 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:20.458 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.458 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.458 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:20.458 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:20.458 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:20.459 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.459 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.459 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:20.459 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:20.459 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:20.459 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.459 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:20.459 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.459 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.459 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.460 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:20.460 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:20.460 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 76.631713043000005, 2024-04-26T12:06:20.460 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:20.460 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:20.460 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.460 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:20.460 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.460 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:20.460 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:20.460 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.460 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.461 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.461 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:20.461 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:20.461 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.461 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.461 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.461 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:20.461 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:20.461 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:20.462 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.462 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.462 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:20.462 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:20.462 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:20.462 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.463 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.463 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:20.463 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:20.463 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:20.463 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.463 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.463 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.463 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:20.463 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:20.463 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.463 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.463 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:20.463 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:20.464 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:20.464 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.464 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.464 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:20.464 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:20.464 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:20.464 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.464 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.464 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:20.464 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:20.464 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:20.464 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.464 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.465 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:20.465 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:20.465 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:20.465 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.465 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.465 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.465 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:20.465 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:20.465 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.465 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.465 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:20.466 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:20.466 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:20.466 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.466 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.466 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:20.466 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:20.466 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:20.466 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.466 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:20.466 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.466 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.466 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.466 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:20.467 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:20.467 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 76.631675358999999, 2024-04-26T12:06:20.467 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:20.467 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:20.467 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.467 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:20.467 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.467 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:20.467 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:20.467 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.467 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.468 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.468 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:20.468 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:20.468 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.468 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.468 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.468 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:20.468 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:20.468 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.468 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.468 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.468 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:20.469 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:20.469 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:20.469 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.469 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.469 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:20.469 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:20.469 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:20.469 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.469 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.469 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.469 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:20.469 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:20.469 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.470 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.470 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:20.470 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:20.470 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:20.471 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.471 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.471 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:20.471 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:20.471 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:20.471 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.471 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.471 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:20.471 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:20.471 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:20.471 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.471 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.472 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:20.472 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:20.472 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:20.472 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.472 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.472 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.472 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:20.472 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:20.472 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.472 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.472 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:20.472 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:20.473 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:20.473 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.473 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.473 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:20.473 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:20.473 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:20.473 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.473 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:20.473 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.473 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.473 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.473 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:20.473 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:20.474 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 76.631654018999996, 2024-04-26T12:06:20.474 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:20.474 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:20.474 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.474 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:20.474 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.474 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:20.474 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:20.474 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.474 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.474 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.475 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:20.475 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:20.475 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.475 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.475 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.475 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:20.475 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:20.475 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.475 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.475 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.475 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:20.475 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:20.476 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:20.476 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.476 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.476 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:20.476 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:20.476 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:20.476 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.476 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.476 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.476 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:20.476 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:20.476 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.477 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.477 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:20.477 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:20.477 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:20.477 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.477 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.477 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:20.477 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:20.477 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:20.477 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.477 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.477 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:20.477 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:20.478 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:20.478 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.478 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.478 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:20.478 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:20.478 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:20.478 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.478 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.478 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.478 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:20.478 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:20.478 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.479 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.479 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:20.479 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:20.479 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:20.479 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.479 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.479 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:20.479 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:20.479 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:20.479 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.479 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:20.479 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.480 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.480 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.480 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:20.480 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:20.480 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 76.631631752999994, 2024-04-26T12:06:20.480 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:20.480 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:20.480 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.480 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:20.481 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.481 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:20.481 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:20.481 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.481 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.481 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.481 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:20.481 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:20.481 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.481 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.481 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.482 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:20.482 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:20.482 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.482 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.482 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.482 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:20.482 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:20.482 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:20.482 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.482 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.482 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:20.483 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:20.483 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:20.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.483 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.483 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.483 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:20.483 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:20.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.484 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.484 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:20.484 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:20.484 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:20.484 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.484 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.484 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:20.484 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:20.484 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:20.484 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.484 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.485 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:20.485 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:20.485 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:20.485 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.485 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.485 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:20.485 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:20.485 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:20.485 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.486 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.486 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.486 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:20.486 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:20.486 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.486 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.486 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:20.486 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:20.486 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:20.486 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.486 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.487 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:20.487 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:20.487 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:20.487 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.487 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:20.487 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.487 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.487 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.487 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:20.487 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:20.488 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 76.631610131000002, 2024-04-26T12:06:20.488 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:20.488 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:20.488 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.488 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:20.488 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.488 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:20.488 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:20.488 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.489 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.489 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:20.489 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:20.489 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.489 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.489 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:20.489 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:20.489 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.490 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.490 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:20.490 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:20.490 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:20.490 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.490 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.490 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:20.490 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:20.491 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:20.491 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.491 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.491 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.491 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:20.491 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:20.491 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.491 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.492 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:20.492 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:20.492 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:20.492 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.492 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.492 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:20.492 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:20.492 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:20.493 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.493 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.493 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:20.493 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:20.493 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:20.493 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.493 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.493 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:20.493 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:20.493 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:20.493 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.493 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.494 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.494 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:20.494 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:20.494 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.494 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.494 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:20.494 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:20.494 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:20.494 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.494 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.494 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:20.494 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:20.495 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:20.495 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.495 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:20.495 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.495 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.495 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.495 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:20.495 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:20.495 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 76.631583565, 2024-04-26T12:06:20.495 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:20.495 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:20.495 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.496 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:20.496 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.496 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:20.496 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:20.496 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.496 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.496 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.496 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:20.496 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:20.496 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.496 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.496 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.497 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:20.497 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:20.497 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.497 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.497 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.497 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:20.497 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:20.497 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:20.497 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.497 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.497 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:20.497 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:20.498 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:20.498 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.498 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.498 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.498 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:20.498 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:20.498 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.498 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.498 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:20.498 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:20.498 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:20.498 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.499 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.499 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:20.499 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:20.499 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:20.499 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.499 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.499 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:20.499 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:20.499 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:20.499 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.499 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.499 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:20.499 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:20.500 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:20.500 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.500 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.500 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.500 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:20.500 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:20.500 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.500 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.500 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:20.500 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:20.500 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:20.500 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.500 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.501 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:20.501 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:20.501 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:20.501 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.501 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:20.501 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.501 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.501 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.501 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:20.501 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:20.501 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 76.631545052999996, 2024-04-26T12:06:20.501 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:20.501 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:20.502 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.502 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:20.502 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.502 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:20.502 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:20.502 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.502 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.502 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.502 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:20.502 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:20.502 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.503 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.503 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.503 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:20.503 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:20.503 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.503 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.503 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.503 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:20.503 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:20.503 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:20.503 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.503 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.503 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:20.504 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:20.504 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:20.504 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.504 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.504 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.504 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:20.504 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:20.504 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.504 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.504 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:20.504 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:20.504 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:20.504 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.505 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.505 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:20.505 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:20.505 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:20.505 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.505 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.505 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:20.505 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:20.505 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:20.505 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.505 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.505 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:20.505 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:20.506 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:20.506 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.506 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.506 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.506 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:20.506 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:20.506 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.506 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.506 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:20.506 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:20.506 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:20.506 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.507 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.507 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:20.507 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:20.507 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:20.507 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.507 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:20.507 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.507 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.507 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.507 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:20.507 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:20.507 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 76.631516880000007, 2024-04-26T12:06:20.507 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:20.508 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:20.508 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.508 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:20.508 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.508 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:20.508 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:20.508 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.508 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.508 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.508 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:20.508 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:20.509 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.509 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:20.509 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:20.509 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.509 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:20.509 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:20.509 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:20.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.510 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.510 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:20.510 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:20.510 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:20.510 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.510 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.510 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.510 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:20.510 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:20.510 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.510 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.511 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:20.511 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:20.511 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:20.511 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.511 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.511 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:20.511 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:20.511 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:20.511 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.511 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.511 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:20.511 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:20.511 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:20.512 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.512 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.512 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:20.512 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:20.512 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:20.512 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.512 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.512 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.512 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:20.512 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:20.512 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.512 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.513 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:20.513 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:20.513 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:20.513 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.513 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.513 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:20.513 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:20.513 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:20.513 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.513 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:20.513 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.514 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.514 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.514 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:20.514 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:20.514 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 76.631482316000003, 2024-04-26T12:06:20.514 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:20.514 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:20.514 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.514 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:20.514 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.514 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:20.515 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:20.515 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.515 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.515 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.515 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:20.515 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:20.515 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.515 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.515 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.516 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:20.516 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:20.516 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.516 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.516 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.516 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:20.516 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:20.516 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:20.516 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.516 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.517 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:20.517 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:20.517 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:20.517 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.517 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.517 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.517 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:20.517 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:20.517 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.517 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.517 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:20.517 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:20.518 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:20.518 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.518 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.518 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:20.518 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:20.518 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:20.518 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.518 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.519 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:20.519 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:20.519 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:20.519 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.519 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.519 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:20.519 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:20.519 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:20.519 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.519 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.519 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.519 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:20.520 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:20.520 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.520 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.520 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:20.520 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:20.520 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:20.520 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.520 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.520 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:20.521 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:20.521 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:20.521 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.521 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:20.521 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.521 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.521 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.521 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:20.521 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:20.521 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 76.630607535999999, 2024-04-26T12:06:20.521 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:20.522 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:20.522 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.522 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:20.522 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.522 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:20.522 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:20.522 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.522 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.522 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.523 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:20.523 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:20.523 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.523 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.523 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.523 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:20.523 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:20.523 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:20.523 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.524 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.524 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:20.524 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:20.524 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:20.524 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.524 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.524 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:20.524 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:20.524 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:20.524 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.525 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.525 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.525 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:20.525 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:20.525 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.525 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.525 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:20.525 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:20.525 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:20.526 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.526 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.526 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:20.526 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:20.526 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:20.526 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.526 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.526 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:20.527 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:20.527 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:20.527 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.527 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.527 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:20.527 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:20.527 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:20.527 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.528 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.528 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.528 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:20.528 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:20.528 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.528 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.528 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:20.528 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:20.528 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:20.528 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.528 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.529 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:20.529 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:20.529 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:20.529 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.529 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:20.529 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.529 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.529 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.529 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:20.529 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:20.529 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 76.630568577000005, 2024-04-26T12:06:20.529 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:20.529 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:20.530 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.530 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:20.530 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.530 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:20.530 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:20.530 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.530 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.530 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.530 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:20.530 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:20.530 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.530 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.531 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.531 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:20.531 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:20.531 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.531 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.531 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.531 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:20.531 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:20.531 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:20.531 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.531 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.531 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:20.531 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:20.532 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:20.532 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.532 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.532 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.532 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:20.532 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:20.532 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.532 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.532 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:20.532 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:20.532 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:20.532 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.532 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.533 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:20.533 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:20.533 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:20.533 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.533 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.533 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:20.533 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:20.533 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:20.533 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.533 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.533 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:20.533 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:20.533 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:20.534 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.534 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.534 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.534 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:20.534 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:20.534 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.534 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.534 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:20.534 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:20.534 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:20.534 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.534 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.535 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:20.535 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:20.535 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:20.535 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.535 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:20.535 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.535 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.535 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.535 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:20.535 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:20.535 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 76.630533104999998, 2024-04-26T12:06:20.535 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:20.535 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:20.536 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.536 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:20.536 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.536 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:20.536 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:20.536 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.536 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.536 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.536 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:20.536 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:20.536 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.536 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.537 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.537 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:20.537 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:20.537 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.537 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.537 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.537 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:20.537 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:20.537 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:20.537 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.537 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.537 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:20.538 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:20.538 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:20.538 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.538 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.538 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.538 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:20.538 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:20.538 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.538 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.538 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:20.538 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:20.538 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:20.539 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.539 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.539 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:20.539 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:20.539 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:20.539 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.539 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.539 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:20.539 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:20.539 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:20.539 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.539 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.539 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:20.540 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:20.540 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:20.540 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.540 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.540 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.540 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:20.540 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:20.540 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.540 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.540 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:20.540 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:20.540 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:20.540 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.541 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.541 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:20.541 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:20.541 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:20.541 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.541 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:20.541 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.541 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.541 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.541 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:20.541 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:20.542 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 76.630454416000006, 2024-04-26T12:06:20.542 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:20.542 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:20.542 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.542 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:20.542 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.542 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:20.542 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:20.542 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.542 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.542 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.542 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:20.543 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:20.543 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.543 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.543 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.543 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:20.543 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:20.543 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:20.543 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.543 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.543 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:20.543 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:20.543 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:20.543 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.544 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.544 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:20.544 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:20.544 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:20.544 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.544 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.544 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.544 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:20.544 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:20.544 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.544 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.544 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:20.544 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:20.545 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:20.545 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.545 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.545 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:20.545 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:20.545 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:20.545 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.545 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.545 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:20.545 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:20.545 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:20.545 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.545 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.546 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:20.546 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:20.546 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:20.546 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.546 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.546 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.546 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:20.546 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:20.546 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.546 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.546 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:20.546 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:20.547 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:20.547 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.547 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.547 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:20.547 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:20.547 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:20.547 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.547 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:20.547 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.547 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.547 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.547 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:20.547 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:20.548 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 76.630303568000002, 2024-04-26T12:06:20.548 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:20.548 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:20.548 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:20.548 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:20.548 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.548 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:20.548 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:20.548 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.548 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.548 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.548 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:20.548 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:20.549 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:20.549 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.549 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.549 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:20.549 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:20.549 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:20.549 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.549 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.549 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:20.549 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:20.549 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:20.549 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.549 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.550 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:20.550 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:20.550 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:20.550 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.550 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.550 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.550 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:20.550 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:20.551 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.551 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.551 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:20.551 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:20.551 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:20.551 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.551 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.551 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:20.551 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:20.551 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:20.551 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:20.551 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:20.552 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:20.552 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:20.552 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:20.552 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.552 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:20.552 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.552 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:20.552 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:20.552 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:20.554 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:20.552+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:20.554 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:20.654 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:20.653+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:20.658 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:20.658 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:20.658 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:06:20.658 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:20.668 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:20.755 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:20.754+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:20.790 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:20.790 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:20.790 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:20.790 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:20.791 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:20.791 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:20.856 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:20.855+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:20.887 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-26T12:06:20.887 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:06:20.887 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2024-04-26T12:06:20.887 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi154.front.sepia.ceph.com 2024-04-26T12:06:20.887 INFO:teuthology.orchestra.console.smithi154:Power on 2024-04-26T12:06:20.888 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-26T12:06:20.899 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:20.899 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:20.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:20.899 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:20.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.900 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:20.900 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:20.900 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.111641446999997, 2024-04-26T12:06:20.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:06:20.900 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:20.900 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.900 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:20.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:20.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:20.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:20.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:20.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:20.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:06:20.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:20.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:20.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:06:20.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:06:20.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:20.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:06:20.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:06:20.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:06:20.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:06:20.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:20.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:06:20.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:06:20.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:20.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:20.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:06:20.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:20.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:06:20.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:06:20.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:20.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:06:20.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:06:20.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:06:20.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:06:20.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:20.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:06:20.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:06:20.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:20.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:06:20.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:06:20.904 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.905 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:20.905 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.905 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:20.905 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:20.905 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.111586126999995, 2024-04-26T12:06:20.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:06:20.905 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:20.905 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.905 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:20.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:20.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:20.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:20.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:20.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:20.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:06:20.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:20.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:20.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:06:20.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:06:20.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:20.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:06:20.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:06:20.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:06:20.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:06:20.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:20.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:06:20.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:06:20.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:20.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:06:20.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:06:20.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:20.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:06:20.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:06:20.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:20.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:06:20.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:06:20.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:06:20.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:06:20.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:20.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:06:20.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:06:20.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:20.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:06:20.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:06:20.910 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.910 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:20.910 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.910 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:20.910 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:20.910 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.111536108999999, 2024-04-26T12:06:20.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:06:20.910 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:20.910 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.910 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:20.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:20.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:20.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:20.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:20.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:20.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:06:20.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:20.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:06:20.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:06:20.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:20.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:06:20.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:06:20.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:06:20.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:06:20.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:20.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:06:20.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:06:20.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:20.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:06:20.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:06:20.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:20.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:06:20.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:06:20.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:20.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:06:20.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:06:20.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:06:20.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:06:20.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:20.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:06:20.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:06:20.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:20.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:06:20.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:06:20.915 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.915 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:20.915 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.915 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:20.915 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:20.915 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.111501472, 2024-04-26T12:06:20.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:06:20.915 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:20.916 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.916 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:20.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:20.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:20.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:20.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:20.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:20.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:06:20.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:20.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:06:20.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:06:20.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:20.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:20.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:06:20.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:06:20.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:06:20.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:20.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:06:20.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:06:20.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:20.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:06:20.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:06:20.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:20.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:06:20.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:06:20.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:06:20.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:06:20.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:20.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:06:20.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:06:20.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:20.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:06:20.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:06:20.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:20.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:06:20.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:06:20.920 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.920 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:20.920 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.920 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:20.920 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:20.920 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.111462959999997, 2024-04-26T12:06:20.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:06:20.921 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:20.921 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.921 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:20.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:20.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:20.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:20.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:20.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:20.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:20.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:20.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:20.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:20.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:06:20.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:20.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:06:20.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:06:20.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:06:20.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:06:20.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:20.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:06:20.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:06:20.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:20.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:06:20.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:06:20.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:20.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:06:20.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:06:20.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:06:20.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:06:20.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:20.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:06:20.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:06:20.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:20.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:06:20.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:06:20.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:20.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:06:20.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:06:20.925 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.925 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:20.925 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.925 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:20.925 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:20.926 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.111432636999993, 2024-04-26T12:06:20.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:06:20.926 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:20.926 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.926 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:20.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:20.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:20.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:20.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:20.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:20.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:06:20.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:20.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:06:20.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:06:20.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:20.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:06:20.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:06:20.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:06:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:06:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:06:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:06:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:06:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:06:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:06:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:06:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:06:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:06:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:06:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:06:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:20.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:06:20.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:06:20.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:20.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:06:20.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:06:20.930 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.930 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:20.930 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.931 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:20.931 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:20.931 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.111405934999993, 2024-04-26T12:06:20.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:06:20.931 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:20.931 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:20.931 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:20.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:20.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:20.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:20.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:06:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:06:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:06:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:06:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:06:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:06:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:06:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:06:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:06:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:06:20.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:20.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:06:20.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:06:20.934 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.934 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:20.934 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.934 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:20.934 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:20.934 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.111363644999997, 2024-04-26T12:06:20.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:06:20.934 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:06:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:06:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:06:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:06:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:06:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:06:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:06:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:06:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:06:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:06:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:20.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:06:20.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:06:20.938 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.938 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:20.938 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.938 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:20.938 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:20.938 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.111335566999998, 2024-04-26T12:06:20.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:06:20.938 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:20.938 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:20.938 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:20.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:20.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:20.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:20.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:20.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:20.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:06:20.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:20.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:06:20.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:06:20.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:20.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:06:20.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:06:20.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:06:20.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:06:20.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:20.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:06:20.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:06:20.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:20.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:06:20.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:06:20.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:20.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:06:20.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:06:20.941 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.105340217000006, 2024-04-26T12:06:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:06:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:20.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:20.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:20.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:06:20.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:20.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:06:20.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:06:20.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:20.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:06:20.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:06:20.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:06:20.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:06:20.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:20.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:06:20.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:06:20.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:20.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:06:20.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:06:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:06:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:06:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:06:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:06:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.105271251000005, 2024-04-26T12:06:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:06:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:06:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:06:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:06:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:06:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:06:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:06:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:06:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:06:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:06:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:06:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:06:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:06:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:06:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:06:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.104776888000004, 2024-04-26T12:06:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:06:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:06:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:06:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:06:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:06:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:06:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:06:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:06:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:06:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:06:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:06:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:06:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:06:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:06:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:06:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.104738623000003, 2024-04-26T12:06:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:06:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:06:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:06:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:06:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:06:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:06:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:06:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:06:20.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:06:20.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:20.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:06:20.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:06:20.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:20.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:06:20.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:06:20.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:06:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:06:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:06:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.104058738000006, 2024-04-26T12:06:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:06:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:06:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:06:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:06:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:06:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:06:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:06:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:06:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:06:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:06:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:06:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.104029558999997, 2024-04-26T12:06:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:06:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:06:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:06:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:06:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:06:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:06:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:06:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:06:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:06:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:06:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:06:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:06:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:06:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:06:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.103997747999998, 2024-04-26T12:06:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:06:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:06:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:06:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:06:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:06:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:06:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:06:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:06:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:06:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:06:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:06:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:06:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:06:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.103976392000007, 2024-04-26T12:06:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:06:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:06:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:06:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:06:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:06:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:06:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:06:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:06:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:06:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:06:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:06:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:06:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:06:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:06:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.103947938999994, 2024-04-26T12:06:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:06:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:06:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:06:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:06:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:06:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:06:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:06:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:06:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:06:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:06:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:06:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:06:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.103226133000007, 2024-04-26T12:06:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:06:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:06:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:06:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:06:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:06:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:06:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:06:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:06:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:06:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:06:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:06:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:06:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:06:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 71.386299530000002, 2024-04-26T12:06:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:06:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:06:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:06:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:06:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:06:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:06:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:06:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:06:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:06:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:06:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:06:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:06:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:06:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:06:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:06:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:06:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:06:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:06:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:06:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:06:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:06:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:06:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:06:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:20.986 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:20.986 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:20.988 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:20.988 DEBUG:teuthology.orchestra.console.smithi154:power on output: Chassis Power Control: Up/On 2024-04-26T12:06:20.988 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:06:21.001 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:20.986+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:21.012 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2024-04-26T12:06:21.089 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:21.087+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:21.106 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:21.107 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:21.107 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:06:21.107 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:21.117 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:21.190 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:21.189+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:21.218 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:21.218 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:21.218 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:21.218 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:21.218 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:21.227 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:21.291 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:21.289+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:21.332 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:21.332 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:21.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:21.333 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:21.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.333 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:21.333 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:21.333 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 87.474884183, 2024-04-26T12:06:21.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:21.334 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:21.334 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.334 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:21.334 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:21.334 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:21.334 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:21.334 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.334 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:21.334 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.334 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:21.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:21.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:21.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:21.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:21.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:21.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:21.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:21.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:21.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:21.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:21.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:21.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:21.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:21.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:21.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:21.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:21.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:21.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:21.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:21.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:21.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:21.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:21.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:21.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:21.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:21.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:21.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:21.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.340 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:21.340 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:21.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:21.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.340 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:21.340 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:21.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:21.340 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.340 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:21.340 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.341 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:21.341 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:21.341 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 87.474778287000007, 2024-04-26T12:06:21.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:21.341 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:21.341 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.341 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:21.341 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:21.341 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:21.341 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:21.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.341 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:21.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:21.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:21.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:21.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:21.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:21.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:21.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:21.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:21.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:21.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:21.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:21.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:21.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:21.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:21.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:21.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:21.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:21.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:21.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:21.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:21.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:21.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:21.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:21.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:21.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:21.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:21.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:21.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:21.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:21.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:21.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:21.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:21.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:21.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:21.346 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.346 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:21.346 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.346 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.346 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:21.346 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:21.346 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 87.474763307000003, 2024-04-26T12:06:21.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:21.346 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:21.346 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.346 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:21.347 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:21.347 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:21.347 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:21.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.347 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:21.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:21.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:21.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:21.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:21.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.348 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:21.348 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:21.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.348 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:21.348 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:21.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:21.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.348 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:21.348 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:21.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:21.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:21.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:21.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:21.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:21.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:21.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:21.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:21.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:21.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:21.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:21.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:21.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:21.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:21.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:21.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:21.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:21.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:21.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:21.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:21.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:21.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:21.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:21.351 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.351 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:21.351 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.352 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:21.352 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:21.352 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 87.474719432000001, 2024-04-26T12:06:21.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:21.352 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:21.352 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.352 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:21.352 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:21.352 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:21.352 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:21.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.352 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:21.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:21.353 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:21.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.353 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.353 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:21.353 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:21.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.353 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.353 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:21.353 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:21.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.353 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.353 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:21.353 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:21.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:21.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:21.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:21.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:21.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:21.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:21.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:21.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:21.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:21.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:21.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:21.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:21.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:21.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:21.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:21.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:21.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:21.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:21.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:21.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:21.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:21.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:21.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:21.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:21.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:21.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:21.357 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.357 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:21.357 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.357 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:21.357 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:21.357 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 87.474633768000004, 2024-04-26T12:06:21.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:21.357 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:21.357 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.357 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:21.357 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:21.357 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:21.358 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:21.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.358 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:21.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:21.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:21.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:21.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:21.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:21.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:21.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:21.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:21.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:21.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:21.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:21.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:21.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:21.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:21.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:21.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:21.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:21.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:21.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:21.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:21.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:21.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:21.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:21.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:21.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:21.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:21.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:21.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:21.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.362 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:21.362 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:21.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:21.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.362 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:21.362 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:21.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:21.362 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.362 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:21.362 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.362 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:21.363 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:21.363 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 77.548729481999999, 2024-04-26T12:06:21.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:21.363 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:21.363 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.363 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:21.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:21.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:21.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:21.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:21.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:21.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:21.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:21.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:21.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:21.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:21.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:21.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:21.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:21.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:21.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:21.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:21.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:21.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:21.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:21.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:21.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:21.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:21.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:21.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:21.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:21.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:21.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:21.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:21.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:21.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:21.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:21.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:21.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:21.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:21.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:21.367 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.367 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:21.367 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.368 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:21.368 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:21.368 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 77.548693387, 2024-04-26T12:06:21.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:21.368 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:21.368 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.368 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:21.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:21.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:21.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:21.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:21.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:21.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:21.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:21.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:21.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:21.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:21.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:21.370 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:21.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:21.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.370 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:21.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:21.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:21.370 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:21.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:21.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:21.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:21.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:21.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:21.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:21.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:21.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:21.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:21.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:21.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:21.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:21.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:21.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:21.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:21.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:21.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:21.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:21.372 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.372 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:21.373 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.373 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:21.373 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:21.373 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 77.548655702999994, 2024-04-26T12:06:21.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:21.373 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:21.373 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.373 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:21.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.373 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:21.373 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:21.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:21.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:21.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:21.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:21.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:21.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:21.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:21.375 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.375 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.375 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:21.375 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:21.375 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:21.375 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.375 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.377 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.377 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:21.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:21.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.378 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.378 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:21.378 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:21.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:21.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.378 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.378 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:21.378 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:21.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:21.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.378 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.378 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:21.378 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:21.379 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:21.379 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.379 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:21.379 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:21.379 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:21.379 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.379 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.379 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:21.379 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:21.379 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.379 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:21.379 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:21.380 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:21.380 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.380 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:21.380 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:21.380 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:21.380 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.380 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:21.380 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.380 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.380 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:21.380 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:21.380 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 77.548634363000005, 2024-04-26T12:06:21.380 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:21.381 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:21.381 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.381 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:21.381 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.381 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:21.381 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:21.381 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.381 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.381 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.381 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:21.381 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:21.381 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.381 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.381 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.381 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:21.382 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:21.382 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.382 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.382 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.382 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:21.382 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:21.382 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:21.382 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.382 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.382 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:21.382 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:21.382 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:21.382 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.382 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.382 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.383 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:21.383 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:21.383 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.383 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.383 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:21.383 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:21.383 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:21.383 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.383 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.383 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:21.383 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:21.383 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:21.383 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.383 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.383 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:21.384 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:21.384 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:21.384 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.384 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.384 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:21.384 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:21.384 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:21.384 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.384 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.384 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.384 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:21.384 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:21.384 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.384 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.385 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:21.385 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:21.385 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:21.385 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.385 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.385 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:21.385 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:21.385 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:21.385 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.385 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:21.385 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.385 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.385 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.386 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:21.386 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:21.386 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 77.548612097000003, 2024-04-26T12:06:21.386 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:21.386 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:21.386 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.386 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:21.386 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.386 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:21.386 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:21.386 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.386 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.386 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.386 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:21.387 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:21.387 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.387 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.387 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.387 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:21.387 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:21.387 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.387 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.387 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.387 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:21.387 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:21.387 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:21.387 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.387 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.387 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:21.388 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:21.388 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:21.388 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.388 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.388 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.388 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:21.388 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:21.388 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.388 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.388 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:21.388 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:21.388 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:21.388 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.388 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.388 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:21.389 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:21.389 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:21.389 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.389 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.389 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:21.389 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:21.389 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:21.389 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.389 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.389 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:21.389 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:21.389 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:21.389 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.390 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.390 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.390 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:21.390 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:21.390 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.390 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.390 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:21.390 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:21.390 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:21.390 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.390 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.390 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:21.390 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:21.390 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:21.391 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.391 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:21.391 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.391 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.391 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.391 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:21.391 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:21.391 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 77.548590474999997, 2024-04-26T12:06:21.391 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:21.391 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:21.391 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.391 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:21.391 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.391 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:21.392 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:21.392 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.392 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.392 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.392 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:21.392 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:21.392 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.392 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.392 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.392 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:21.392 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:21.392 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.392 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.392 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.392 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:21.393 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:21.393 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:21.393 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.393 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.393 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:21.393 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:21.393 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:21.393 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.393 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.393 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.393 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:21.393 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:21.393 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.393 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.393 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:21.394 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:21.394 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:21.394 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.394 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.394 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:21.394 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:21.394 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:21.394 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.394 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.394 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:21.394 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:21.394 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:21.394 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.394 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.395 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:21.395 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:21.395 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:21.395 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.395 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.395 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.395 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:21.395 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:21.395 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.395 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.395 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:21.395 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:21.395 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:21.395 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.395 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.396 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:21.396 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:21.396 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:21.396 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.396 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:21.396 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.396 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.396 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.396 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:21.396 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:21.396 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 77.548563908999995, 2024-04-26T12:06:21.396 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:21.396 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:21.396 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.396 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:21.397 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.397 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:21.397 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:21.397 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.397 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.397 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.397 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:21.397 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:21.397 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.397 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.397 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.397 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:21.397 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:21.397 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.397 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.398 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.398 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:21.398 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:21.398 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:21.398 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.398 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.398 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:21.398 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:21.398 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:21.398 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.398 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.398 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.398 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:21.398 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:21.399 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.399 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.399 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:21.399 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:21.399 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:21.399 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.399 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.399 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:21.399 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:21.399 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:21.399 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.399 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.399 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:21.399 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:21.399 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:21.399 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.400 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.400 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:21.400 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:21.400 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:21.400 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.400 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.400 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.400 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:21.400 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:21.400 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.400 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.400 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:21.400 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:21.400 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:21.400 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.401 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.401 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:21.401 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:21.401 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:21.401 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.401 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:21.401 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.401 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.401 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.401 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:21.401 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:21.401 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 77.548525397000006, 2024-04-26T12:06:21.401 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:21.401 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:21.402 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.402 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:21.402 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.402 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:21.402 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:21.402 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.402 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.402 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.402 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:21.402 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:21.402 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.402 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.402 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.402 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 77.548497224000002, 2024-04-26T12:06:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 77.548462659999998, 2024-04-26T12:06:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 77.547587879999995, 2024-04-26T12:06:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 77.547548921000001, 2024-04-26T12:06:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 77.547513448999993, 2024-04-26T12:06:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 77.547434760000002, 2024-04-26T12:06:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 77.547283911999997, 2024-04-26T12:06:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:21.441 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:21.441 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:21.441 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.441 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:21.441 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.441 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:21.441 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:21.441 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:21.442 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:21.441+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:21.443 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:21.543 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:21.542+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:21.546 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:21.546 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:21.546 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:06:21.546 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:21.556 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:21.644 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:21.643+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:21.657 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:21.658 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:21.658 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:21.658 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:21.658 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:21.666 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:21.745 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:21.744+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:21.750 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:06:21.769 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:21.769 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:21.769 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:21.770 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:21.770 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.770 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:21.770 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:21.770 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.987090129999999, 2024-04-26T12:06:21.770 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:06:21.770 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:21.770 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.770 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:21.770 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.770 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:21.770 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:21.770 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.771 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.771 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:21.771 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:21.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.771 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.771 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:21.771 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:06:21.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:21.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:21.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:06:21.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:06:21.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:21.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:06:21.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:06:21.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.773 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.773 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:06:21.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:06:21.773 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.773 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.773 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:21.773 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:06:21.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:06:21.773 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.773 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.774 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:21.774 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:21.774 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:06:21.774 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.774 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.774 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:21.774 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:06:21.774 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:06:21.774 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.774 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.774 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:21.774 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:06:21.774 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:06:21.774 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.775 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:06:21.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:06:21.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:21.776 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:06:21.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:06:21.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:21.776 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:06:21.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:06:21.776 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.776 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:21.777 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.777 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:21.777 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:21.777 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.987034809999997, 2024-04-26T12:06:21.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:06:21.777 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:21.777 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.777 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:21.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:21.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:21.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:21.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:21.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:21.779 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:06:21.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:21.779 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.779 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.779 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:21.779 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:06:21.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:06:21.779 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.779 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.779 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:21.779 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:06:21.780 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:06:21.780 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.780 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.780 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.780 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:06:21.780 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:06:21.780 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.780 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.780 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:21.780 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:06:21.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:06:21.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:21.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:06:21.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:06:21.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:21.783 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:06:21.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:06:21.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.783 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.783 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:21.783 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:06:21.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:06:21.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.784 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:06:21.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:06:21.785 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.785 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.785 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:21.785 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:06:21.786 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:06:21.786 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.786 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.786 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:21.786 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:06:21.786 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:06:21.787 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.787 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:21.787 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.787 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.787 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:21.788 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:21.788 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.986984792000001, 2024-04-26T12:06:21.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:06:21.788 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:21.788 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.788 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:21.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:21.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:21.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:21.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:21.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.791 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:21.791 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:06:21.791 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:21.793 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:06:21.793 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:06:21.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:21.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:06:21.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:06:21.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:06:21.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:06:21.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:21.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:06:21.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:06:21.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:21.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:06:21.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:06:21.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:21.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:06:21.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:06:21.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:21.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:06:21.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:06:21.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.797 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.797 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:06:21.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:06:21.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.797 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:21.798 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:06:21.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:06:21.798 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.798 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:21.798 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:06:21.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:06:21.798 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.798 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:21.799 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.799 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:21.799 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:21.799 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.986950155000002, 2024-04-26T12:06:21.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:06:21.799 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:21.799 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.799 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:21.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:21.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:21.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:21.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:21.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:21.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:06:21.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:21.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:06:21.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:06:21.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:21.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:21.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:06:21.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:06:21.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:06:21.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:21.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:06:21.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:06:21.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:21.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:06:21.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:06:21.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.803 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:21.803 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:06:21.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:06:21.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.804 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:06:21.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:06:21.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:21.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:06:21.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:06:21.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:21.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:06:21.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:06:21.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:21.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:06:21.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:06:21.807 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.807 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:21.807 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.807 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:21.808 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:21.808 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.986911642999999, 2024-04-26T12:06:21.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:06:21.808 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:21.808 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.808 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:21.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.809 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:21.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:21.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.809 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:21.810 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:21.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:21.810 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:21.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:21.811 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.811 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:21.811 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:21.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:06:21.811 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:21.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:06:21.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:06:21.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:06:21.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:06:21.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:21.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:06:21.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:06:21.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:21.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:06:21.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:06:21.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.815 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:21.815 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:06:21.815 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:06:21.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.816 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.816 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:06:21.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:06:21.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.816 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:21.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:06:21.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:06:21.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.817 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:21.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:06:21.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:06:21.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:21.818 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:06:21.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:06:21.819 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.819 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:21.819 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.819 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.819 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.819 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:21.820 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:21.820 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.986881319999995, 2024-04-26T12:06:21.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:06:21.820 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:21.820 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.820 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:21.821 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.821 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:21.821 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:21.821 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.821 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.821 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.821 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:21.822 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:21.822 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.822 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:21.822 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:06:21.822 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.822 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:21.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:06:21.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:06:21.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:21.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:06:21.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:06:21.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:06:21.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:06:21.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:21.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:06:21.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:06:21.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:21.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:06:21.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:06:21.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:21.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:06:21.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:06:21.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:21.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:06:21.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:06:21.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:06:21.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:06:21.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:21.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:06:21.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:06:21.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:21.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:06:21.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:06:21.826 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.826 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:21.826 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.826 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:21.826 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:21.826 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.986854617999995, 2024-04-26T12:06:21.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:06:21.826 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:21.826 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:21.827 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:21.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:21.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:21.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:21.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:21.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:21.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:21.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.828 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.828 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:21.828 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:06:21.828 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:06:21.828 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.828 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.828 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:21.828 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:06:21.828 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:06:21.828 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.828 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.828 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.828 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:06:21.828 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:06:21.828 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:21.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:06:21.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:06:21.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:21.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:06:21.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:06:21.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:21.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:06:21.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:06:21.829 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.830 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:21.830 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.830 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:21.830 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:21.830 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.986812327999999, 2024-04-26T12:06:21.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:06:21.830 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:21.830 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:21.830 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:21.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:21.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:21.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.831 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:21.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:21.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.831 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:21.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:21.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.831 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:21.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:06:21.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:06:21.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:21.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:06:21.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:06:21.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:06:21.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:06:21.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:21.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:06:21.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:06:21.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.833 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:21.833 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:06:21.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:06:21.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.833 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:21.833 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:06:21.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:06:21.833 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.833 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:21.833 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.834 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:21.834 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:21.834 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.986784249999999, 2024-04-26T12:06:21.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:06:21.834 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:21.834 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:21.834 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:21.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.834 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:21.834 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:21.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.834 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:21.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:21.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:21.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:06:21.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:21.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:06:21.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:06:21.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:21.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:06:21.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:06:21.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:06:21.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:06:21.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:21.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:06:21.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:06:21.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:21.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:06:21.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:06:21.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:21.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:06:21.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:06:21.837 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.837 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:21.837 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.837 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:21.838 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:21.838 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.980788899999993, 2024-04-26T12:06:21.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:06:21.838 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:21.838 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.838 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:21.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.838 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:21.838 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:21.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.838 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.838 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:21.838 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:21.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:21.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:06:21.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:21.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:06:21.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:06:21.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:21.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:06:21.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:06:21.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:06:21.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:06:21.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:21.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:06:21.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:06:21.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:21.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:06:21.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:06:21.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:21.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:06:21.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:06:21.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:21.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:06:21.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:06:21.841 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.841 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:21.841 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.842 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:21.842 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:21.842 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.980719934000007, 2024-04-26T12:06:21.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:06:21.842 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:21.842 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.842 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:21.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:21.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:21.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:21.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:21.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:21.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:06:21.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:21.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:06:21.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:06:21.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:21.844 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:06:21.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:06:21.844 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.844 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.844 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:06:21.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:06:21.844 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.844 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:21.844 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:06:21.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:06:21.844 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.844 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:21.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:21.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:06:21.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:21.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:06:21.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:06:21.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:21.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:06:21.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:06:21.845 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.845 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:21.846 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.846 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:21.846 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:21.846 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.980225571000005, 2024-04-26T12:06:21.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:06:21.846 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:21.846 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.846 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:21.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.846 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:21.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:21.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:21.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:21.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:21.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:21.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:21.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:06:21.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:06:21.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:21.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:06:21.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:06:21.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:06:21.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:06:21.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:21.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:06:21.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:06:21.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:21.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:06:21.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:06:21.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:21.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:06:21.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:06:21.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:21.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:06:21.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:06:21.850 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.850 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:21.850 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.850 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:21.850 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:21.850 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.980187306000005, 2024-04-26T12:06:21.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:06:21.850 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:21.850 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.850 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:21.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:21.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:21.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:21.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:21.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:21.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:21.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:21.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:06:21.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:06:21.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:21.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:06:21.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:06:21.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:06:21.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:06:21.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:21.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:06:21.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:06:21.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:21.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:06:21.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:06:21.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:21.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:06:21.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:06:21.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:21.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:06:21.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:06:21.854 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.854 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:21.854 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.854 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:06:21.854 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:21.854 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.979507420999994, 2024-04-26T12:06:21.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:06:21.854 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:21.854 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:21.854 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:21.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:21.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:21.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:21.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:21.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:21.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:21.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:21.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:06:21.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:06:21.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:21.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:06:21.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:06:21.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:06:21.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:06:21.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:21.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:06:21.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:06:21.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:21.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:06:21.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:06:21.857 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.857 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:21.857 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.858 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:21.858 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:21.858 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.979478241999999, 2024-04-26T12:06:21.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:06:21.858 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:21.858 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:21.858 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:21.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:21.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:21.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:21.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:21.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:21.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:06:21.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:21.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:06:21.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:06:21.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:21.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:06:21.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:06:21.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:06:21.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:06:21.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:21.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:06:21.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:06:21.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:21.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:06:21.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:06:21.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:21.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:06:21.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:06:21.861 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.861 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:21.861 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.862 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:21.862 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:21.862 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.979446431, 2024-04-26T12:06:21.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:06:21.862 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:21.862 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:21.862 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:21.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:21.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:21.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:21.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:21.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:21.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:21.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:21.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:21.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:06:21.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:06:21.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:21.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:06:21.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:06:21.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:06:21.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:06:21.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:21.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:06:21.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:06:21.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:21.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:06:21.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:06:21.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:21.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:06:21.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:06:21.865 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.865 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:21.865 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.865 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:21.865 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:21.865 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.979425074999995, 2024-04-26T12:06:21.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:06:21.866 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:21.866 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:21.866 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:21.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:21.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:21.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:21.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:21.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:21.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:21.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:21.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:21.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:06:21.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:06:21.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:21.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:06:21.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:06:21.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:06:21.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:06:21.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:21.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:06:21.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:06:21.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:21.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:06:21.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:06:21.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.869 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:21.869 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:06:21.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:06:21.869 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.869 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:21.869 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.869 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:06:21.869 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:21.869 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.979396621999996, 2024-04-26T12:06:21.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:06:21.869 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:21.869 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:21.870 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:21.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.870 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:21.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:21.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.870 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.870 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:21.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:21.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.870 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.870 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:21.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:21.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:21.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:21.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:06:21.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:06:21.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:21.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:06:21.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:06:21.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:06:21.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:06:21.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.872 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:21.872 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:06:21.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:06:21.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.872 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:21.872 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:06:21.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:06:21.872 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.872 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:21.872 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.873 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:06:21.873 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:21.873 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.978674815999995, 2024-04-26T12:06:21.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:06:21.873 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:21.873 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:21.873 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:21.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:21.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:21.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:21.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:21.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:21.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:06:21.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:21.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:21.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:06:21.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:06:21.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:21.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:06:21.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:06:21.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:06:21.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:06:21.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:21.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:06:21.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:06:21.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:21.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:06:21.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:06:21.876 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.876 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:21.876 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.876 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:06:21.876 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:21.876 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 72.261748213000004, 2024-04-26T12:06:21.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:06:21.876 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:21.876 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:21.876 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:21.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:21.877 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:21.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:21.877 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:21.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:21.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:21.877 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:06:21.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:06:21.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.878 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:21.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:06:21.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:06:21.878 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.878 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:21.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:06:21.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:06:21.878 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.878 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:21.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:06:21.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:06:21.878 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:21.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:06:21.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:06:21.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:21.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:06:21.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:06:21.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:21.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:06:21.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:06:21.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:21.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:06:21.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:06:21.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:21.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:06:21.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:06:21.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:21.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:06:21.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:06:21.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:21.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:21.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:21.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:06:21.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:06:21.881 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.881 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:21.881 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.881 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:21.881 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:21.881 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:21.883 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:21.883 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:21.881+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:21.885 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:21.886 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:21.886 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:06:21.903 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:21.904 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:21.907 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:06:21.908 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:06:21.983 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:21.982+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:21.986 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:21.986 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:21.995 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:22.008 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:06:22.084 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:22.083+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:22.136 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:22.137 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:22.145 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:22.189 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:22.188+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:22.248 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:22.248 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:22.256 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:22.297 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:22.296+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:22.361 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:22.361 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:22.370 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:22.413 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:22.412+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:22.471 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:22.471 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:22.480 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:22.488 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:22.487+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:22.590 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:22.589+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:22.622 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:22.622 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:22.631 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:22.691 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:22.690+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:22.735 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:22.735 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:22.743 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:22.792 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:22.791+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:22.844 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:22.844 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:22.853 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:22.894 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:22.893+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:22.970 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-26T12:06:22.993 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:22.992+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:22.996 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:22.996 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:23.005 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:23.095 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:23.094+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:23.108 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:23.109 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:23.118 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:23.196 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:23.195+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:23.219 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:23.221 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:23.228 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:23.297 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:23.295+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:23.371 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:23.371 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:23.380 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:23.397 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:23.396+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:23.486 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:23.486 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:23.495 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:23.498 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:23.496+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:23.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~6s 2024-04-26T12:06:23.597 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:23.597 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:23.598 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:23.597+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:23.606 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:23.699 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:23.698+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:23.748 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:23.748 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:23.756 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:23.800 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:23.799+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:23.860 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:23.861 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:23.869 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:23.909 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:06:23.910 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:23.909+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:24.002 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:24.000+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:24.010 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:24.010 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:24.019 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:24.052 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:24.052 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:24.052 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:06:24.084 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:24.084 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:24.087 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:06:24.087 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:06:24.103 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:24.102+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:24.161 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:24.161 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:24.161 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:24.161 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:24.161 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.161 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:24.161 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:24.161 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 80.378840636999996, 2024-04-26T12:06:24.161 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:06:24.161 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:24.161 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.162 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:24.162 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.162 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:24.162 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:24.162 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.162 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.162 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.162 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:24.162 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:24.162 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.162 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.162 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.162 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:24.163 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:06:24.163 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:24.163 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.163 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.163 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:24.163 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:06:24.163 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:06:24.163 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.163 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.163 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:24.163 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:06:24.163 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:06:24.163 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.163 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.164 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.164 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:06:24.164 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:06:24.164 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.164 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.164 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:24.164 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:06:24.164 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:06:24.164 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.164 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.164 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:24.164 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:24.164 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:06:24.164 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.165 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.165 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:24.165 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:06:24.165 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:06:24.165 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.166 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.166 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:24.166 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:06:24.166 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:06:24.166 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.166 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.166 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.166 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:06:24.166 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:06:24.166 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.166 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.167 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:24.167 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:06:24.167 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:06:24.167 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.167 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.167 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:24.167 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:06:24.167 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:06:24.167 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.167 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:24.168 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.168 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.168 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.168 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:24.168 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:24.168 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 80.378785316999995, 2024-04-26T12:06:24.168 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:06:24.168 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:24.169 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.169 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:24.169 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.169 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:24.169 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:24.169 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.169 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.169 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.169 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:24.169 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:24.169 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.170 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.170 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.170 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:24.170 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:06:24.170 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:24.170 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.170 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.170 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:24.170 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:06:24.170 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:06:24.170 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.170 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.170 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:24.170 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:06:24.171 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:06:24.171 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.171 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.171 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.171 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:06:24.171 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:06:24.171 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.171 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.171 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:24.171 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:06:24.171 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:06:24.171 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.171 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.171 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:24.172 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:06:24.172 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:06:24.172 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.172 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.172 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:24.172 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:06:24.172 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:06:24.172 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.172 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.172 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:24.172 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:06:24.172 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:06:24.172 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.172 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.172 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.172 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:06:24.173 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:06:24.173 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.173 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.173 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:24.173 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:06:24.173 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:06:24.173 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.173 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.173 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:24.173 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:06:24.174 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:06:24.174 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.174 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:24.174 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.174 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.174 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.174 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:24.174 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:24.174 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 80.378735298999999, 2024-04-26T12:06:24.174 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:06:24.174 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:24.174 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.175 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:24.175 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.175 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:24.176 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:24.176 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.176 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.176 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.176 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:24.176 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:24.176 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.177 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.177 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.177 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:24.177 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:06:24.177 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.177 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.177 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.177 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:24.177 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:06:24.177 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:06:24.177 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.177 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.177 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:24.177 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:06:24.178 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:06:24.178 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.178 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.178 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.178 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:06:24.178 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:06:24.178 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.178 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.178 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:24.178 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:06:24.178 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:06:24.178 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.179 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.179 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:24.179 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:06:24.179 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:06:24.179 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.179 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.179 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:24.179 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:06:24.179 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:06:24.179 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.180 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.180 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:24.180 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:06:24.180 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:06:24.180 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.180 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.180 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.180 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:06:24.180 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:06:24.180 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.180 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.180 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:24.180 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:06:24.180 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:06:24.181 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.181 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.181 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:24.181 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:06:24.181 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:06:24.181 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.181 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:24.181 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.181 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.181 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.181 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:24.181 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:24.181 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 80.378700662, 2024-04-26T12:06:24.181 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:06:24.182 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:24.182 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.182 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:24.182 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.182 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:24.182 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:24.182 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.182 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.182 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.182 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:24.182 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:24.182 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.182 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.182 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.183 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:24.183 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:06:24.183 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.183 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.183 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.183 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:24.183 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:06:24.183 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:06:24.183 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.183 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.183 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:24.183 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:24.183 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:06:24.184 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.184 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.184 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.184 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:06:24.184 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:06:24.184 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.184 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.184 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:24.184 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:06:24.184 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:06:24.184 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.184 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.184 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:24.184 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:06:24.185 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:06:24.185 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.186 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.186 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:24.186 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:06:24.186 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:06:24.186 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.186 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.186 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.186 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:06:24.186 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:06:24.186 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.186 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.186 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:24.186 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:06:24.187 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:06:24.187 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.187 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.187 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:24.187 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:06:24.187 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:06:24.187 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.187 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.187 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:24.187 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:06:24.187 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:06:24.187 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.187 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:24.188 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.188 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.188 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.188 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:24.188 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:24.188 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 80.378662149999997, 2024-04-26T12:06:24.188 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:06:24.188 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:24.188 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.188 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:24.188 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.188 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:24.188 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:24.189 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.189 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.189 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.189 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:24.189 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:24.189 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.189 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.189 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.189 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:24.189 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:24.189 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:24.189 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.190 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.190 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:24.190 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:24.190 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:06:24.190 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.190 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.190 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:24.190 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:06:24.190 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:06:24.190 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.190 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.190 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.191 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:06:24.191 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:06:24.191 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.191 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.191 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:24.191 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:06:24.191 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:06:24.191 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.191 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.191 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:24.191 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:06:24.191 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:06:24.191 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.192 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.192 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:24.192 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:06:24.192 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:06:24.192 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.192 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.192 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.192 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:06:24.192 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:06:24.192 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.192 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.192 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:24.192 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:06:24.192 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:06:24.193 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.193 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.193 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:24.193 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:06:24.193 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:06:24.193 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.193 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.193 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:24.193 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:06:24.193 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:06:24.193 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.193 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:24.193 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.194 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.194 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.194 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:24.194 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:24.194 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 80.378631827000007, 2024-04-26T12:06:24.194 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:06:24.194 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:24.194 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.194 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:24.194 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.194 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:24.194 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:24.195 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.195 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.195 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.195 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:24.195 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:24.195 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.195 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.195 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.195 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:24.195 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:06:24.195 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.195 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.195 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.196 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:24.196 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:06:24.196 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:06:24.196 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.196 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.196 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:24.196 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:06:24.196 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:06:24.196 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.196 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.196 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.196 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:06:24.197 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:06:24.197 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.197 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.197 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:24.197 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:06:24.197 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:06:24.197 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.197 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.197 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:24.197 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:06:24.197 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:06:24.197 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.198 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.198 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:24.198 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:06:24.198 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:06:24.198 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.198 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.198 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:24.198 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:06:24.198 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:06:24.199 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.199 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.199 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.199 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:06:24.199 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:06:24.199 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.199 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.199 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:24.199 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:06:24.199 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:06:24.199 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.199 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.200 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:24.200 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:06:24.200 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:06:24.200 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.200 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:24.200 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.200 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.200 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.200 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:24.200 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:24.200 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 80.378605125000007, 2024-04-26T12:06:24.200 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:06:24.200 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:24.200 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:24.200 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:24.201 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.201 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:24.201 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:24.201 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.201 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.201 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.201 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:24.201 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:24.201 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.201 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.201 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.201 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:24.202 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:24.202 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.202 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.202 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.202 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:24.202 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:06:24.202 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:06:24.202 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.202 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.202 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:24.202 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:06:24.202 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:06:24.202 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.203 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.203 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.203 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:06:24.203 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:06:24.203 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.203 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.203 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:24.203 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:06:24.203 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:06:24.203 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.203 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.203 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:24.203 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:06:24.203 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:06:24.204 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.204 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.204 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:24.204 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:06:24.204 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:06:24.204 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.204 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:24.204 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.204 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.204 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.204 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:24.204 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:24.204 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 80.378562834999997, 2024-04-26T12:06:24.204 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:06:24.205 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:24.205 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:24.205 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:24.205 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.205 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:24.205 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:24.205 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.205 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.205 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.205 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:24.205 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:24.205 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.205 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.205 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.205 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:24.206 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:24.206 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.206 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.206 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.206 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:24.206 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:06:24.206 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:06:24.206 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.206 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.206 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:24.206 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:06:24.206 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:06:24.207 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.207 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.207 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.207 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:06:24.207 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:06:24.207 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.207 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.207 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:24.207 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:06:24.207 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:06:24.207 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.207 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.207 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:24.207 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:06:24.207 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:06:24.208 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.208 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.208 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:24.209 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:06:24.209 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:06:24.209 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.209 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:24.209 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.209 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.209 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.209 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:24.209 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:24.210 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 80.378534756999997, 2024-04-26T12:06:24.210 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:06:24.210 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:24.210 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:24.210 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:24.210 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.210 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:24.210 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:24.210 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.210 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.210 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.210 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:24.211 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:24.211 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.211 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.211 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.211 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:24.211 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:06:24.211 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.211 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.211 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.212 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:24.212 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:06:24.212 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:06:24.212 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.212 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.212 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:24.212 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:06:24.212 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:06:24.212 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.212 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.212 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.212 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:06:24.212 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:06:24.212 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.213 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.213 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:24.213 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:06:24.213 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:06:24.213 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.213 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.213 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:24.213 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:06:24.213 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:06:24.213 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.213 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.213 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:24.213 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:06:24.213 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:06:24.214 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.214 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:24.214 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.214 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.214 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.214 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:24.214 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:24.214 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 80.372539407000005, 2024-04-26T12:06:24.214 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:06:24.214 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:24.214 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.214 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:24.215 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.215 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:24.215 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:24.215 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.215 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.215 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.215 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:24.215 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:24.215 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.215 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.215 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.215 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:24.215 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:06:24.215 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.216 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.216 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.216 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:24.216 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:06:24.216 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:06:24.216 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.216 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.216 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:24.216 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:06:24.216 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:06:24.216 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.216 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.216 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.216 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:06:24.217 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:06:24.217 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.217 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.217 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:24.217 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:06:24.217 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:06:24.217 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.217 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.217 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:24.217 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:06:24.217 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:06:24.217 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.217 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.217 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:24.218 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:06:24.218 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:06:24.218 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.218 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.218 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:24.218 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:06:24.218 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:06:24.218 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.218 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:24.218 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.218 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.218 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.218 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:24.218 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:24.219 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 80.372470441000004, 2024-04-26T12:06:24.219 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:06:24.219 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:24.219 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.219 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:24.219 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.219 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:24.219 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:24.219 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.219 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.219 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.220 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:24.220 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:24.220 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.220 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.220 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.220 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:24.220 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:06:24.220 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.220 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.220 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.220 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:24.220 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:06:24.220 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:06:24.221 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.221 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.221 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:24.222 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:06:24.222 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:06:24.222 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.222 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.222 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.223 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:06:24.223 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:06:24.223 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.223 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.223 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:24.223 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:06:24.223 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:06:24.223 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.223 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.223 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:24.223 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:24.224 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:06:24.224 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.224 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.224 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:24.224 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:06:24.224 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:06:24.224 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.224 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.224 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:24.224 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:06:24.224 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:06:24.225 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.225 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:24.225 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.225 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.225 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.225 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:24.225 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:24.225 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 80.371976078000003, 2024-04-26T12:06:24.225 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:06:24.225 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:24.225 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.225 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:24.225 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.226 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:24.226 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:24.226 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.226 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.226 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.226 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:24.226 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:24.226 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.226 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.226 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.226 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:24.227 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:24.227 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.227 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.227 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.227 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:24.227 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:06:24.227 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:06:24.227 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.227 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.227 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:24.227 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:06:24.227 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:06:24.228 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.228 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.228 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.228 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:06:24.228 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:06:24.228 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.228 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.228 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:24.228 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:06:24.228 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:06:24.228 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.230 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.230 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:24.230 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:06:24.230 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:06:24.230 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.230 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.230 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:24.231 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:06:24.231 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:06:24.231 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.231 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.231 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:24.231 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:06:24.231 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:06:24.231 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.231 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:24.231 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.231 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.232 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.232 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:24.232 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:24.232 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 80.371937813000002, 2024-04-26T12:06:24.232 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:06:24.232 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:24.232 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.232 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:24.232 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.232 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:24.232 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:24.232 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.233 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.233 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.233 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:24.233 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:24.233 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.233 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.233 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.233 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:24.233 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:24.233 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.233 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.233 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.234 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:24.234 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:06:24.234 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:06:24.234 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.234 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.234 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:24.234 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:06:24.234 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:06:24.234 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.234 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.234 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.234 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:06:24.235 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:06:24.235 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.235 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.235 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:24.235 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:06:24.235 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:06:24.235 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.235 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.235 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:24.235 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:06:24.235 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:06:24.236 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.236 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.236 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:24.236 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:06:24.236 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:06:24.236 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.236 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.236 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:24.236 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:06:24.236 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:06:24.236 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.236 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:24.236 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.237 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.237 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.237 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:06:24.237 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:24.237 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 80.371257928000006, 2024-04-26T12:06:24.237 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:06:24.237 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:24.237 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:24.237 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:24.237 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.237 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:24.238 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:24.238 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.238 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.238 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.238 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:24.238 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:24.238 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.238 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.238 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.238 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:24.238 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:24.238 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.239 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.239 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.239 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:24.239 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:06:24.239 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:06:24.239 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.239 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.239 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:24.239 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:06:24.239 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:06:24.239 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.239 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.240 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.242 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:06:24.242 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:06:24.243 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.243 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.243 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:24.243 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:06:24.243 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:06:24.243 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.243 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.243 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:24.244 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:06:24.244 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:06:24.244 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.244 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:24.244 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.244 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.244 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.244 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:24.244 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:24.244 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 80.371228748999997, 2024-04-26T12:06:24.244 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:06:24.244 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:24.245 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:24.245 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:24.245 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.245 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:24.245 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:24.245 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.245 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.245 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.245 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:24.245 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:24.245 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.245 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.245 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.245 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:24.245 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:06:24.246 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.246 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.246 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.246 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:24.246 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:06:24.246 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:06:24.246 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.246 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.246 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:24.246 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:06:24.246 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:06:24.246 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.246 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.246 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:06:24.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:06:24.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.247 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:24.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:06:24.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:06:24.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.247 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:24.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:06:24.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:06:24.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:24.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:06:24.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:06:24.248 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.248 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:24.248 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.248 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:24.248 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:24.248 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 80.371196937999997, 2024-04-26T12:06:24.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:06:24.248 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:24.248 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:24.248 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:24.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.249 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:24.249 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:24.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.249 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.249 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:24.249 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:24.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.249 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.249 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:24.249 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:24.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:24.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.250 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:24.250 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:06:24.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:06:24.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.250 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:24.250 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:06:24.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:06:24.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.250 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.250 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:06:24.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:06:24.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:24.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:06:24.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:06:24.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:24.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:06:24.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:06:24.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:24.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:06:24.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:06:24.252 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.252 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:24.252 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.252 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:24.252 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:24.252 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 80.371175582000006, 2024-04-26T12:06:24.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:06:24.252 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:24.252 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:24.252 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:24.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.252 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:24.253 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:24.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.253 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:24.253 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:24.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.253 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:24.253 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:24.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:24.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:24.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:06:24.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:06:24.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:24.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:06:24.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:06:24.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:06:24.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:06:24.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:24.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:06:24.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:06:24.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:24.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:06:24.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:06:24.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:24.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:06:24.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:06:24.255 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.255 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:24.256 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.256 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:06:24.256 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:24.256 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 80.371147128999993, 2024-04-26T12:06:24.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:06:24.256 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:24.256 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:24.256 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:24.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:24.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:24.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:24.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:24.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:24.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:24.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:24.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:06:24.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:06:24.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:24.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:06:24.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:06:24.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:06:24.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:06:24.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:24.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:06:24.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:06:24.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:24.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:06:24.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:06:24.260 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.260 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:24.260 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.260 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:06:24.260 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:24.260 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 80.370425323000006, 2024-04-26T12:06:24.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:06:24.260 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:24.260 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:24.260 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:24.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:24.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:24.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:24.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:24.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:24.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:06:24.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:24.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:24.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:06:24.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:06:24.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:24.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:06:24.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:06:24.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:06:24.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:06:24.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:24.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:06:24.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:06:24.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:24.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:06:24.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:06:24.263 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.263 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:24.263 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.264 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:06:24.264 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:24.264 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 74.653498720000002, 2024-04-26T12:06:24.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:06:24.264 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:24.264 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.264 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:24.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:24.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:24.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:24.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:24.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:24.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:24.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:06:24.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:06:24.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:24.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:06:24.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:06:24.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:24.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:06:24.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:06:24.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:06:24.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:06:24.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:24.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:06:24.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:06:24.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:24.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:06:24.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:06:24.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:24.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:06:24.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:06:24.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:24.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:06:24.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:06:24.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:06:24.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:06:24.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.268 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:24.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:06:24.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:06:24.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:24.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:24.268 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:24.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:06:24.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:06:24.268 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.268 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:24.268 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.269 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:24.269 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:24.269 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:24.272 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:24.272 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:24.269+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:24.371 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:24.370+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:24.376 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:24.376 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:24.377 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:06:24.377 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:24.385 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:24.472 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:24.471+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:24.527 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:24.527 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:24.527 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:24.527 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:24.527 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:24.536 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:24.573 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:24.572+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:24.674 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:24.673+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:24.679 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:24.679 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:24.679 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:24.679 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:24.679 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.679 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:24.680 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:24.680 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 90.822296558000005, 2024-04-26T12:06:24.680 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:24.680 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:24.680 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.680 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:24.680 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:24.680 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:24.680 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:24.680 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.680 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:24.680 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.680 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:24.680 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:24.681 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.681 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.681 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.681 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:24.681 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:24.681 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.681 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.681 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.681 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:24.681 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:24.681 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.681 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.681 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.681 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:24.681 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:24.682 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:24.682 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.682 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.682 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:24.682 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:24.682 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:24.682 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.682 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.682 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.682 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:24.682 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:24.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.683 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:24.683 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:24.683 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:24.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.683 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:24.683 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:24.683 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:24.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.683 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:24.683 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:24.684 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:24.684 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.684 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.684 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:24.684 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:24.684 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:24.684 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.684 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.684 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.684 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:24.684 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:24.684 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.684 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.684 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:24.685 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:24.685 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:24.685 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.685 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.685 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:24.685 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:24.685 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:24.685 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.685 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:24.685 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.685 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.685 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.685 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:24.685 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:24.686 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 90.822190661999997, 2024-04-26T12:06:24.686 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:24.686 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:24.686 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.686 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:24.686 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:24.686 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:24.686 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:24.686 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.686 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:24.686 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.686 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:24.686 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:24.686 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.687 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.687 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:24.687 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:24.687 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.687 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.687 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:24.687 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:24.687 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.687 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.687 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:24.687 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:24.687 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:24.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.688 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.688 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:24.688 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:24.688 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:24.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.688 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.688 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.688 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:24.688 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:24.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.688 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.688 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:24.688 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:24.688 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:24.689 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.689 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.689 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:24.689 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:24.689 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:24.689 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.689 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.689 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:24.689 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:24.689 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:24.689 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.689 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.689 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:24.689 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:24.689 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:24.690 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.690 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.690 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:24.690 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:24.690 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.690 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:24.690 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:24.690 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:24.690 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.690 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:24.691 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:24.691 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:24.691 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.691 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:24.691 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.691 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.691 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.691 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:24.691 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:24.691 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 90.822175681999994, 2024-04-26T12:06:24.691 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:24.691 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:24.692 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.692 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:24.692 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:24.692 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:24.692 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:24.692 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.692 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:24.692 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.692 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:24.692 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:24.692 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.692 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.692 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.692 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:24.693 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:24.693 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.693 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.693 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.693 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:24.693 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:24.693 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.693 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.693 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.693 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:24.693 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:24.693 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:24.693 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.694 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.694 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:24.694 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:24.694 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:24.694 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.694 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.694 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.694 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:24.694 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:24.694 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.694 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.694 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:24.694 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:24.694 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:24.694 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.695 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:24.695 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:24.695 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:24.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.695 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:24.695 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:24.695 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:24.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.695 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:24.695 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:24.695 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:24.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.696 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.696 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.696 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:24.696 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:24.696 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.696 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.696 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:24.696 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:24.696 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:24.696 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.696 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.696 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:24.696 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:24.696 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:24.697 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.697 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:24.697 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.697 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.697 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.697 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:24.697 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:24.697 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 90.822131807000005, 2024-04-26T12:06:24.697 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:24.697 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:24.697 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.697 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:24.697 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:24.697 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:24.697 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:24.697 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.698 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:24.698 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.698 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:24.698 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:24.698 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.698 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.698 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.698 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:24.698 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:24.698 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.698 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.698 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.698 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:24.698 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:24.699 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.699 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.699 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.699 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:24.699 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:24.699 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:24.699 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.699 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.699 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:24.699 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:24.699 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:24.699 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.699 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.699 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.699 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:24.700 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:24.700 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.700 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.700 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:24.700 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:24.700 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:24.700 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.700 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.700 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:24.700 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:24.700 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:24.700 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.700 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.700 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:24.700 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:24.701 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:24.701 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.701 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.701 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:24.701 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:24.701 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:24.701 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.701 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.701 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.701 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:24.701 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:24.701 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.701 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.701 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:24.701 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:24.702 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:24.702 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.702 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.702 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:24.702 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:24.702 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:24.702 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.702 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:24.702 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.702 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.702 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.702 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:24.702 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:24.702 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 90.822046142999994, 2024-04-26T12:06:24.702 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:24.703 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:24.703 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.703 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:24.703 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:24.703 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:24.703 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:24.703 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.703 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:24.703 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.703 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:24.703 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:24.703 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.703 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.703 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.703 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:24.704 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:24.704 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.704 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.704 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.704 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:24.704 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:24.704 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.704 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.704 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.704 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:24.704 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:24.704 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:24.704 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.704 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.704 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:24.705 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:24.705 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:24.705 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.705 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.705 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.705 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:24.705 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:24.705 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.705 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.705 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:24.705 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:24.705 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:24.705 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.706 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.706 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:24.706 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:24.706 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:24.706 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.706 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.706 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:24.706 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:24.706 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:24.706 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.706 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.706 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:24.707 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:24.707 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:24.707 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.707 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.707 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:24.707 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:24.707 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.707 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:24.707 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:24.707 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:24.707 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.708 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:24.708 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:24.708 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:24.708 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.708 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:24.708 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.708 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.708 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.708 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:24.708 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:24.708 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 80.896141857000003, 2024-04-26T12:06:24.708 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:24.708 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:24.708 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.709 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:24.709 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.709 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:24.709 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:24.709 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.709 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.709 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.709 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:24.709 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:24.709 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.709 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.709 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.709 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:24.710 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:24.710 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:24.710 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.710 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.710 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:24.710 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:24.710 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:24.710 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.710 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.710 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:24.710 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:24.710 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:24.710 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.710 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.710 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.711 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:24.711 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:24.711 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.711 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.711 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:24.711 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:24.711 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:24.711 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.711 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.711 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:24.711 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:24.711 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:24.711 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.711 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.711 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:24.712 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:24.712 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:24.712 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.712 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.712 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:24.712 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:24.712 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:24.712 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.712 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.712 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.712 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:24.712 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:24.712 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.712 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.712 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:24.713 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:24.713 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:24.713 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.713 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.713 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:24.713 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:24.713 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:24.713 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.713 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:24.713 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.713 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.713 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.713 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:24.713 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:24.714 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 80.896105762000005, 2024-04-26T12:06:24.714 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:24.714 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:24.714 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.714 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:24.714 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.714 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:24.714 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:24.714 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.714 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.714 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.714 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:24.714 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:24.714 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.715 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.715 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.715 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:24.715 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:24.715 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:24.716 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.716 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.716 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:24.716 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:24.716 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:24.716 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.716 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.716 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:24.716 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:24.716 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:24.716 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.716 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.716 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.717 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:24.717 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:24.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.717 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.717 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:24.717 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:24.717 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:24.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.717 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.717 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:24.717 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:24.717 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:24.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.717 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.718 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:24.718 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:24.718 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:24.718 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.718 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.718 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:24.718 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:24.718 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:24.718 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.718 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.718 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.718 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:24.718 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:24.718 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.719 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.719 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:24.719 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:24.719 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:24.719 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.719 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.719 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:24.719 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:24.719 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:24.719 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.719 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:24.719 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.719 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.719 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.719 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:24.720 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:24.720 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 80.896068077999999, 2024-04-26T12:06:24.720 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:24.720 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:24.720 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.720 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:24.720 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.720 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:24.720 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:24.720 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.720 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.720 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.720 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:24.721 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:24.721 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.721 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.721 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:24.721 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:24.721 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.721 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.721 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:24.721 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:24.721 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:24.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.722 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.722 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:24.722 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:24.722 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:24.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.722 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.722 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.722 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:24.722 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:24.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.722 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.722 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:24.722 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:24.722 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:24.723 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.723 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:24.723 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:24.723 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:24.723 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.723 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:24.723 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:24.723 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:24.723 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.723 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:24.723 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:24.724 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:24.724 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.724 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.724 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.724 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:24.724 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:24.724 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.724 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.724 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:24.724 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:24.724 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:24.724 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.724 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.724 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:24.724 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:24.724 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:24.725 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.725 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:24.725 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.725 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.725 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.725 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:24.725 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:24.725 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 80.896046737999995, 2024-04-26T12:06:24.725 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:24.725 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:24.725 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.725 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:24.725 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.725 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:24.726 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:24.726 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.726 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.726 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.726 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:24.726 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:24.726 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.726 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.726 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.726 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:24.726 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:24.726 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.726 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.726 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.726 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:24.727 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:24.727 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:24.727 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.727 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.727 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:24.727 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:24.727 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:24.727 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.727 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.727 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.727 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:24.727 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:24.727 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.727 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.728 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:24.728 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:24.728 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:24.728 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.728 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.728 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:24.728 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:24.728 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:24.728 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.728 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.728 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:24.728 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:24.728 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:24.728 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.728 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.729 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:24.729 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:24.729 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:24.729 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.729 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.729 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.729 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:24.729 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:24.729 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.729 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.729 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:24.729 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:24.729 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:24.729 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.729 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.730 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:24.730 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:24.730 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:24.730 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.730 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:24.730 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.730 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.730 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.730 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:24.730 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:24.730 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 80.896024471999993, 2024-04-26T12:06:24.730 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:24.730 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:24.730 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.731 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:24.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:24.731 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:24.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:24.731 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:24.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:24.731 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:24.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.732 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:24.732 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:24.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:24.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.732 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:24.732 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:24.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:24.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.732 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.732 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:24.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:24.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:24.733 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:24.733 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:24.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:24.733 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:24.733 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:24.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:24.734 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:24.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:24.734 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.734 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.734 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:24.734 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:24.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:24.734 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.734 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.734 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.734 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:24.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:24.734 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.734 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.734 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:24.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:24.735 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:24.735 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.735 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:24.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:24.735 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:24.735 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.735 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:24.736 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.736 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:24.736 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:24.736 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 80.896002850000002, 2024-04-26T12:06:24.736 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:24.736 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:24.736 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.736 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:24.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.736 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:24.736 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:24.736 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:24.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:24.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:24.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:24.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.738 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:24.738 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:24.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:24.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.738 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.738 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:24.738 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:24.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:24.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.738 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.738 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.738 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:24.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:24.739 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.739 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.739 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:24.739 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:24.739 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:24.739 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.739 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.739 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:24.739 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:24.739 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:24.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.740 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.741 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:24.741 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:24.741 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:24.741 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.741 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.741 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:24.741 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:24.742 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:24.742 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.742 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.742 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.742 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:24.743 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:24.743 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.743 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.743 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:24.743 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:24.743 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:24.744 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.744 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.744 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:24.744 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:24.744 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:24.744 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.745 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:24.745 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.745 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.745 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.745 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:24.746 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:24.746 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 80.895976284, 2024-04-26T12:06:24.746 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:24.746 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:24.747 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.747 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:24.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.747 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:24.747 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:24.748 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.748 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.748 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:24.748 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:24.748 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.749 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.749 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.749 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:24.749 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:24.749 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.749 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.750 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.750 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:24.750 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:24.750 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:24.750 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.750 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.750 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:24.751 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:24.751 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:24.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.751 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.751 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.751 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:24.751 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:24.752 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.752 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.752 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:24.752 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:24.752 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:24.752 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.753 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:24.753 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:24.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:24.753 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.754 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:24.754 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:24.754 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:24.754 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.754 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.755 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:24.755 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:24.755 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:24.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.755 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.755 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.755 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:24.756 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:24.756 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.756 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.756 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:24.756 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:24.756 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:24.757 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.757 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.757 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:24.758 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:24.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:24.758 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.758 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:24.758 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.759 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:24.759 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:24.759 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 80.895937771999996, 2024-04-26T12:06:24.759 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:24.760 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:24.760 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.760 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:24.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:24.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:24.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.761 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:24.761 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:24.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.762 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.762 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:24.762 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:24.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.763 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.763 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:24.763 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:24.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:24.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.763 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.763 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:24.763 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:24.764 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:24.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.764 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.764 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:24.764 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:24.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.764 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:24.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:24.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:24.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:24.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:24.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:24.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:24.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:24.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:24.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:24.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:24.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:24.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:24.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:24.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:24.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:24.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:24.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.768 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.768 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:24.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:24.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:24.768 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.768 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:24.769 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.769 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:24.769 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:24.769 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 80.895909599000007, 2024-04-26T12:06:24.769 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:24.769 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:24.770 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.770 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:24.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:24.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:24.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:24.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:24.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:24.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:24.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:24.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:24.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:24.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:24.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:24.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:24.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:24.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:24.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:24.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:24.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:24.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:24.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:24.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:24.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:24.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:24.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:24.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:24.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:24.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:24.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:24.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:24.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:24.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:24.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:24.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:24.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:24.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:24.778 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.778 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:24.778 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.779 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:24.779 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:24.779 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 80.895875035000003, 2024-04-26T12:06:24.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:24.779 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:24.779 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.779 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:24.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.779 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:24.779 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:24.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.779 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.779 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:24.780 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:24.780 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.780 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.780 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:24.780 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:24.780 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.780 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.780 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:24.780 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:24.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:24.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:24.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:24.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:24.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:24.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:24.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:24.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:24.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:24.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:24.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:24.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:24.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:24.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:24.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:24.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:24.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:24.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:24.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:24.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:24.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:24.784 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:24.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:24.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.784 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:24.784 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:24.785 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:24.785 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.785 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:24.785 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.785 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.785 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.786 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:24.786 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:24.786 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 80.895000254999999, 2024-04-26T12:06:24.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:24.786 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:24.786 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.787 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:24.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:24.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:24.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:24.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:24.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.789 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:24.789 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:24.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:24.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.789 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.789 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:24.790 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:24.790 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:24.790 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.790 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.790 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:24.791 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:24.791 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:24.791 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.791 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.791 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.791 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:24.792 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:24.792 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:24.792 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:24.792 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:24.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:24.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:24.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:24.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.794 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:24.794 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:24.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:24.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.795 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.795 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:24.795 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:24.795 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:24.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.795 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.796 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.796 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:24.796 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:24.796 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.796 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.796 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:24.797 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:24.797 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:24.797 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.797 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:24.797 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:24.798 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:24.798 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.798 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:24.798 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.798 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.798 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.799 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:24.799 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:24.799 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 80.894961296000005, 2024-04-26T12:06:24.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:24.799 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:24.799 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.800 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:24.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:24.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:24.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:24.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:24.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:24.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:24.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.803 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:24.803 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:24.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:24.803 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.803 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.804 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:24.804 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:24.804 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:24.804 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.804 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.804 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.805 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:24.805 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:24.805 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.805 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.805 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:24.805 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:24.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:24.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:24.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:24.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:24.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:24.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:24.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:24.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.808 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.808 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:24.808 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:24.808 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:24.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.808 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.809 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.809 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:24.809 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:24.809 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.809 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.810 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:24.810 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:24.810 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:24.810 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.810 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.810 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:24.811 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:24.811 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:24.811 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.811 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:24.811 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.811 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.812 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:24.812 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:24.812 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 80.894925823999998, 2024-04-26T12:06:24.812 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:24.813 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:24.813 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.813 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:24.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:24.813 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:24.814 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.814 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.814 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.814 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:24.814 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:24.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.815 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.815 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.815 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:24.815 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:24.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:24.816 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.816 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.816 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:24.816 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:24.816 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:24.816 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.817 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.817 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:24.817 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:24.817 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:24.817 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.817 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.818 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.818 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:24.818 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:24.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:24.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:24.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:24.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.820 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:24.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:24.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:24.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.820 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:24.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:24.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:24.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.821 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:24.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:24.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:24.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.822 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.822 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:24.822 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:24.822 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.822 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:24.822 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:24.822 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:24.822 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.822 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:24.822 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:24.822 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:24.823 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.823 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:24.823 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.823 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:24.823 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:24.823 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 80.894847135000006, 2024-04-26T12:06:24.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:24.823 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:24.823 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:24.823 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:24.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.823 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:24.823 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:24.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:24.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:24.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:24.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:24.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:24.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:24.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:24.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:24.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:24.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:24.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:24.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:24.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:24.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:24.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:24.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:24.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:24.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:24.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:24.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:24.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:24.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:24.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:24.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:24.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:24.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:24.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:24.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:24.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:24.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:24.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:24.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:24.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:24.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:24.828 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.828 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:24.828 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.828 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.828 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:24.828 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:24.828 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 80.894696287000002, 2024-04-26T12:06:24.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:24.828 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:24.828 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:24.828 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:24.828 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.828 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:24.828 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:24.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.829 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:24.829 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:24.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:24.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.829 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:24.829 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:24.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:24.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.829 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:24.829 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:24.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:24.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:24.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:24.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:24.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:24.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:24.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:24.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:24.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:24.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:24.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:24.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:24.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:24.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:24.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:24.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:24.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:24.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:24.831 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.831 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:24.831 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.831 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:24.832 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:24.832 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:24.833 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:24.834 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:24.832+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:24.934 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:24.933+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:24.940 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:24.940 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:24.940 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:06:24.940 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:24.949 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:24.988 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:06:25.013 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:06:25.036 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:25.035+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:25.089 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:25.090 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:25.090 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:25.090 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:25.090 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:25.098 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:25.126 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-04-26T12:06:25.137 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:25.136+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:25.201 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:25.201 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:25.201 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:25.202 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:25.202 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.202 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:25.202 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:25.202 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 81.419208725000004, 2024-04-26T12:06:25.202 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:06:25.202 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:25.202 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.202 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:25.202 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.202 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:25.202 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:25.203 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.203 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.203 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.203 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:25.203 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:25.203 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.203 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.204 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.204 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:25.204 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:06:25.204 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:25.204 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.204 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.204 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:25.204 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:06:25.204 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:06:25.204 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.205 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.205 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:25.205 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:06:25.205 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:06:25.205 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.205 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.205 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.205 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:06:25.205 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:06:25.205 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.205 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.205 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:25.205 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:06:25.205 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:06:25.206 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.206 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.206 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:25.206 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:25.206 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:06:25.206 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.206 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.206 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:25.206 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:06:25.206 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:06:25.206 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.206 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.206 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:25.206 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:06:25.207 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:06:25.207 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.207 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.207 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.207 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:06:25.207 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:06:25.207 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.207 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.207 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:25.207 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:06:25.207 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:06:25.207 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.207 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.207 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:25.208 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:06:25.208 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:06:25.208 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.208 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:25.208 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.208 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.208 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.208 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:25.208 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:25.208 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 81.419153405000003, 2024-04-26T12:06:25.208 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:06:25.208 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:25.208 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.208 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:25.209 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.209 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:25.209 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:25.209 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.209 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.209 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.209 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:25.209 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:25.209 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.209 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.209 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.209 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:25.209 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:06:25.209 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:25.210 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.210 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.210 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:25.210 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:06:25.210 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:06:25.210 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.210 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.210 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:25.210 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:06:25.210 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:06:25.210 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.210 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.210 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.211 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:06:25.211 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:06:25.211 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.211 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.211 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:25.211 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:06:25.211 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:06:25.211 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.211 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.211 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:25.211 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:06:25.211 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:06:25.211 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.211 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.212 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:25.212 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:06:25.212 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:06:25.212 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.212 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.212 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:25.212 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:06:25.212 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:06:25.212 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.212 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.212 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.212 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:06:25.212 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:06:25.212 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.212 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.213 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:25.213 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:06:25.213 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:06:25.213 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.213 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.213 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:25.213 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:06:25.213 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:06:25.213 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.213 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:25.213 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.213 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.213 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.213 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:25.214 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:25.214 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 81.419103387000007, 2024-04-26T12:06:25.214 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:06:25.214 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:25.214 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.214 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:25.214 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.214 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:25.214 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:25.214 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.214 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.214 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.214 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:25.214 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:25.215 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.215 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.215 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.216 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:25.216 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:06:25.216 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.216 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.216 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.216 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:25.216 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:06:25.216 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:06:25.216 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.216 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.216 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:25.216 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:06:25.217 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:06:25.217 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.217 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.217 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.217 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:06:25.217 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:06:25.217 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.217 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.217 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:25.217 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:06:25.217 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:06:25.217 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.217 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.218 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:25.218 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:06:25.218 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:06:25.218 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.218 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.218 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:25.218 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:06:25.218 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:06:25.218 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.218 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.218 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:25.219 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:06:25.219 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:06:25.219 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.219 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.219 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.219 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:06:25.219 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:06:25.219 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.219 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.219 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:25.219 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:06:25.219 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:06:25.219 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.219 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.219 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:25.220 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:06:25.220 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:06:25.220 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.220 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:25.220 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.220 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.220 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.220 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:25.220 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:25.220 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 81.419068749999994, 2024-04-26T12:06:25.220 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:06:25.220 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:25.220 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.220 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:25.221 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.221 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:25.221 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:25.221 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.221 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.221 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.221 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:25.221 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:25.221 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.221 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.221 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.221 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:25.221 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:06:25.221 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.222 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.222 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.222 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:25.222 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:06:25.222 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:06:25.222 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.222 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.222 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:25.222 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:25.222 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:06:25.222 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.222 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.222 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.222 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:06:25.223 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:06:25.223 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.223 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.223 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:25.223 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:06:25.223 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:06:25.223 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.223 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.223 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:25.223 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:06:25.223 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:06:25.223 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.223 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.223 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:25.223 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:06:25.224 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:06:25.224 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.224 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.224 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.224 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:06:25.224 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:06:25.224 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.224 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.224 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:25.224 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:06:25.224 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:06:25.225 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.225 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.225 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:25.225 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:06:25.225 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:06:25.225 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.225 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.225 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:25.225 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:06:25.225 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:06:25.225 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.225 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:25.226 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.226 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.226 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.226 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:25.226 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:25.226 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 81.419030238000005, 2024-04-26T12:06:25.226 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:06:25.226 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:25.226 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.226 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:25.226 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.226 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:25.226 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:25.226 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.227 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.227 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.227 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:25.227 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:25.227 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.227 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.227 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.227 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:25.227 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:25.227 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:25.227 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.227 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.227 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:25.227 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:25.227 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:06:25.228 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.228 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.228 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:25.228 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:06:25.228 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:06:25.228 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.228 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.228 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.228 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:06:25.228 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:06:25.228 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.228 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.228 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:25.228 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:06:25.229 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:06:25.229 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.229 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.229 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:25.229 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:06:25.229 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:06:25.229 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.229 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.229 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:25.229 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:06:25.229 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:06:25.229 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.229 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.230 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.230 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:06:25.230 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:06:25.230 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.230 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.230 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:25.230 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:06:25.230 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:06:25.230 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.230 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.230 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:25.230 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:06:25.231 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:06:25.231 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.231 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.231 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:25.231 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:06:25.231 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:06:25.231 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.231 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:25.231 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.231 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.231 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.231 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:25.232 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:25.232 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 81.418999915000001, 2024-04-26T12:06:25.232 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:06:25.232 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:25.232 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.232 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:25.232 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.232 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:25.232 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:25.232 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.232 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.232 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.232 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:25.232 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:25.233 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.233 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.233 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.233 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:25.233 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:06:25.233 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.233 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.233 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.233 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:25.233 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:06:25.233 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:06:25.233 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.233 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.233 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:25.234 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:06:25.234 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:06:25.234 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.234 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.234 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.234 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:06:25.234 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:06:25.234 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.234 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.235 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:25.235 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:06:25.235 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:06:25.235 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.235 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.235 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:25.235 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:06:25.235 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:06:25.236 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.236 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.236 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:25.236 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:06:25.236 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:06:25.236 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.236 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.236 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:25.236 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:06:25.236 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:06:25.236 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.236 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.236 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.236 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:06:25.236 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:06:25.237 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.237 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.237 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:25.237 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:06:25.237 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:06:25.237 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.237 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.237 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:25.237 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:06:25.237 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:06:25.237 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.237 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:25.237 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.237 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.238 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.238 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:25.238 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:25.238 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 81.418973213000001, 2024-04-26T12:06:25.238 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:06:25.238 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:25.238 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:25.238 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:25.238 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.238 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:25.238 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:25.238 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.238 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.239 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.239 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:25.239 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:25.239 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.239 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.239 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.239 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:25.239 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:25.239 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.239 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.239 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.239 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:25.239 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:06:25.239 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:06:25.240 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.240 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.240 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:25.240 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:06:25.240 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:06:25.240 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.240 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.240 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.240 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:06:25.240 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:06:25.240 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.240 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.241 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:25.241 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:06:25.241 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:06:25.241 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.241 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.241 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:25.241 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:06:25.241 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:06:25.241 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.241 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.241 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:25.241 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:06:25.241 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:06:25.242 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.242 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:25.242 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.242 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.242 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.242 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:25.242 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:25.242 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 81.418930923000005, 2024-04-26T12:06:25.242 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:06:25.242 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:25.242 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:25.242 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:25.242 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.243 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:25.243 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:25.243 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.243 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.243 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.243 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:25.244 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:25.244 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.244 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.245 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.245 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:25.245 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:25.245 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.245 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.245 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.246 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:25.246 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:06:25.246 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:06:25.246 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.246 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.246 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:25.246 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:06:25.246 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:06:25.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.247 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:06:25.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:06:25.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.247 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:25.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:06:25.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:06:25.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:25.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:06:25.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:06:25.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:25.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:06:25.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:06:25.248 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.248 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:25.248 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.249 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:25.249 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:25.249 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 81.418902845000005, 2024-04-26T12:06:25.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:06:25.249 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:25.249 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:25.249 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:25.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.249 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:25.249 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:25.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.249 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.250 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:25.250 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:25.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.250 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:25.250 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:06:25.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.250 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:25.250 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:06:25.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:06:25.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:25.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:06:25.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:06:25.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:06:25.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:06:25.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.252 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:25.252 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:06:25.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:06:25.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.252 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:25.252 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:06:25.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:06:25.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.252 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:25.252 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:06:25.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:06:25.253 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.253 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:25.253 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.253 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:25.253 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:25.253 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 81.412907494999999, 2024-04-26T12:06:25.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:06:25.253 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:25.254 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.254 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:25.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:25.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:25.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:25.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:25.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:25.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:06:25.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:25.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:06:25.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:06:25.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:25.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:06:25.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:06:25.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:06:25.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:06:25.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:25.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:06:25.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:06:25.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:25.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:06:25.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:06:25.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:25.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:06:25.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:06:25.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:25.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:06:25.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:06:25.257 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.257 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:25.257 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.258 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:25.258 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:25.258 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 81.412838528999998, 2024-04-26T12:06:25.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:06:25.258 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:25.258 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.258 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:25.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:25.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:25.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:25.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:25.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:25.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:06:25.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:25.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:06:25.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:06:25.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:25.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:06:25.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:06:25.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:06:25.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:06:25.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:25.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:06:25.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:06:25.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:25.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:25.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:06:25.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:25.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:06:25.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:06:25.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:25.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:06:25.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:06:25.262 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.262 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:25.262 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.263 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:25.263 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:25.263 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 81.412344165999997, 2024-04-26T12:06:25.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:06:25.263 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:25.263 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.263 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:25.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:25.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:25.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:25.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:25.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:25.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:25.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:25.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:06:25.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:06:25.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:25.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:06:25.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:06:25.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:06:25.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:06:25.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:25.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:06:25.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:06:25.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:25.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:06:25.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:06:25.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:25.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:06:25.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:06:25.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:25.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:06:25.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:06:25.267 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.267 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:25.267 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.267 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:25.267 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:25.267 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 81.412305900999996, 2024-04-26T12:06:25.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:06:25.268 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:25.268 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.268 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:25.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.268 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:25.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:25.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.268 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:25.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:25.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:25.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:25.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:25.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:06:25.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:06:25.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:25.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:06:25.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:06:25.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:06:25.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:06:25.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:25.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:06:25.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:06:25.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:25.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:06:25.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:06:25.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:25.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:06:25.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:06:25.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:25.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:06:25.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:06:25.271 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.272 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:25.272 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.272 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.272 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.272 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:06:25.272 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:25.272 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 81.411626016, 2024-04-26T12:06:25.272 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:06:25.272 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:25.272 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:25.272 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:25.272 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.272 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:25.272 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:25.272 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.273 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.273 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.273 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:25.273 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:25.273 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.273 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.273 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.273 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:25.273 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:25.273 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.273 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.273 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.273 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:25.273 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:06:25.273 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:06:25.274 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.274 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.274 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:25.275 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:06:25.275 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:06:25.275 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.275 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.275 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.275 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:06:25.275 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:06:25.276 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.276 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.276 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:25.276 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:06:25.276 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:06:25.276 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.276 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.276 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:25.276 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:06:25.277 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:06:25.277 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.277 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:25.277 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.277 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.277 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.277 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:25.277 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:25.277 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 81.411596837000005, 2024-04-26T12:06:25.277 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:06:25.277 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:25.277 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:25.278 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:25.278 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.278 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:25.278 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:25.278 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.278 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.278 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.278 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:25.278 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:25.278 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.278 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.278 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.278 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:25.278 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:06:25.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.279 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.279 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.279 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:25.279 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:06:25.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:06:25.279 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.279 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.279 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:25.279 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:06:25.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:06:25.279 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.279 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.279 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.279 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:06:25.280 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:06:25.280 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.280 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.280 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:25.280 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:06:25.280 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:06:25.280 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.280 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.280 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:25.280 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:06:25.280 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:06:25.280 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.281 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:25.281 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:06:25.281 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:06:25.281 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.281 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:25.281 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.281 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.281 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:25.281 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:25.281 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 81.411565026000005, 2024-04-26T12:06:25.281 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:06:25.281 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:25.281 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:25.282 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:25.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:25.282 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:25.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:25.282 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:25.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:25.282 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:25.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:25.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:25.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:06:25.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:06:25.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:25.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:06:25.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:06:25.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:06:25.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:06:25.284 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.284 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:25.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:06:25.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:06:25.284 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.284 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:25.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:06:25.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:06:25.284 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.285 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:25.285 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:06:25.285 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:06:25.285 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.285 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:25.285 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.285 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.285 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:25.285 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:25.285 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 81.41154367, 2024-04-26T12:06:25.285 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:06:25.285 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:25.285 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:25.286 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:25.286 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.286 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:25.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:25.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:25.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:25.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:25.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:25.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:25.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:25.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:06:25.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:06:25.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:25.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:06:25.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:06:25.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.289 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:06:25.289 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:06:25.289 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.289 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.289 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:25.289 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:06:25.289 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:06:25.289 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.289 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.289 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:25.289 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:06:25.289 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:06:25.289 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.290 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.290 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:25.290 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:06:25.290 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:06:25.290 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.290 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:25.290 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.290 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.290 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.290 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:06:25.290 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:25.290 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 81.411515217000002, 2024-04-26T12:06:25.290 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:06:25.290 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:25.291 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:25.291 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:25.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.291 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:25.291 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:25.291 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.291 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.291 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:25.291 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:25.291 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.291 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.291 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:25.291 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:25.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.292 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.292 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.292 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:25.292 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:06:25.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:06:25.292 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.292 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.292 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:25.292 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:06:25.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:06:25.292 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.292 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.292 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.293 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:06:25.293 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:06:25.293 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.293 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.293 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:25.293 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:06:25.293 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:06:25.293 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.293 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.293 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:25.293 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:06:25.293 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:06:25.293 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.294 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:25.294 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.294 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.294 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.294 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:06:25.294 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:25.294 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 81.410793411, 2024-04-26T12:06:25.294 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:06:25.294 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:25.294 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:25.294 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:25.294 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.294 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:25.294 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:25.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:25.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:25.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:25.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:06:25.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:25.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:25.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:06:25.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:06:25.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:25.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:06:25.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:06:25.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:06:25.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:06:25.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:25.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:06:25.297 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:06:25.297 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.297 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.297 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:25.297 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:06:25.297 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:06:25.297 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.297 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:25.297 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.297 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.297 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.297 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:06:25.297 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:25.297 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 75.693866807999996, 2024-04-26T12:06:25.298 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:06:25.298 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:25.298 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.298 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:25.298 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.298 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:25.298 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:25.298 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.298 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.298 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.298 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:25.298 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:25.298 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:25.298 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.299 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.299 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:25.299 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:06:25.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:06:25.299 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.299 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.299 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:25.299 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:06:25.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:06:25.299 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.299 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.299 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:25.299 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:06:25.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:06:25.299 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:06:25.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:06:25.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:25.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:06:25.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:06:25.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:25.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:06:25.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:06:25.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.301 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:25.301 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:06:25.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:06:25.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.301 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:25.301 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:06:25.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:06:25.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.301 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.301 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:06:25.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:06:25.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.302 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:25.302 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:06:25.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:06:25.302 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:25.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:25.302 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:25.302 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:06:25.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:06:25.302 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.302 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:25.302 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.302 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:25.302 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:25.302 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:25.303 INFO:teuthology.orchestra.console.smithi154:Power on completed 2024-04-26T12:06:25.304 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:25.305 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:25.303+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:25.403 DEBUG:teuthology.orchestra.console.smithi154:Waiting for login prompt 2024-04-26T12:06:25.403 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi154 2024-04-26T12:06:25.416 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:25.416 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:25.416 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:06:25.416 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:25.416 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:25.415+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:25.425 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:25.516 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:25.515+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:25.526 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:25.527 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:25.527 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:25.527 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:25.527 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:25.535 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:25.619 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:25.618+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:25.680 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:25.680 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:25.680 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:25.680 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:25.680 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.680 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:25.680 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:25.680 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 91.822745834000003, 2024-04-26T12:06:25.680 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:25.680 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:25.680 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.681 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:25.681 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:25.681 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:25.681 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:25.681 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.681 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:25.681 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.681 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:25.681 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:25.681 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.681 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.681 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.681 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:25.681 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:25.682 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.682 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.682 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.682 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:25.682 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:25.682 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.682 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.682 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.682 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:25.682 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:25.682 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:25.682 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.682 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.683 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:25.683 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:25.683 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:25.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.683 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.683 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:25.683 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:25.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.683 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:25.683 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:25.683 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:25.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.684 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:25.684 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:25.684 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:25.684 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.684 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.684 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:25.684 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:25.684 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:25.684 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.684 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.684 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:25.684 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:25.684 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:25.684 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.685 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.685 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.685 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:25.685 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:25.685 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.685 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.685 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:25.685 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:25.685 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:25.685 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.685 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.685 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:25.685 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:25.685 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:25.686 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.686 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:25.686 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.686 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.686 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.686 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:25.686 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:25.686 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 91.822639937999995, 2024-04-26T12:06:25.686 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:25.686 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:25.686 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.686 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:25.686 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:25.686 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:25.686 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:25.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.687 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:25.687 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.687 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:25.687 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:25.687 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.687 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.687 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:25.687 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:25.687 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.687 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.687 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:25.687 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:25.688 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.688 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.688 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:25.688 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:25.688 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:25.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.688 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.688 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:25.688 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:25.688 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:25.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.688 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.688 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.688 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:25.689 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:25.689 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.689 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.689 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:25.689 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:25.689 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:25.689 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.689 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.689 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:25.689 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:25.689 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:25.689 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.689 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.689 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:25.689 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:25.690 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:25.690 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.690 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:25.690 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:25.690 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:25.690 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.690 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.690 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:25.690 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:25.690 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.690 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:25.690 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:25.691 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:25.691 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.691 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.691 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:25.691 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:25.691 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:25.691 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.691 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:25.691 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.691 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.691 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.691 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:25.691 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:25.691 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 91.822624958000006, 2024-04-26T12:06:25.691 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:25.692 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:25.692 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.692 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:25.692 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:25.692 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:25.692 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:25.692 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.692 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:25.692 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.692 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:25.692 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:25.692 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.692 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.692 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.693 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:25.693 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:25.693 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.693 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.693 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.693 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:25.693 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:25.693 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.693 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.693 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.693 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:25.693 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:25.693 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:25.693 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.694 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.694 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:25.694 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:25.694 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:25.694 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.694 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.694 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.694 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:25.694 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:25.694 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.694 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.694 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:25.694 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:25.694 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:25.694 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.695 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:25.695 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:25.695 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:25.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.695 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:25.695 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:25.695 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:25.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.695 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:25.695 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:25.695 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:25.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.696 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.696 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.696 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:25.696 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:25.696 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.696 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.696 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:25.696 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:25.696 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:25.696 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.696 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.696 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:25.696 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:25.696 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:25.696 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.697 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:25.697 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.697 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.697 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.697 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:25.697 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:25.697 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 91.822581083000003, 2024-04-26T12:06:25.697 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:25.697 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:25.697 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.697 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:25.697 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:25.697 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:25.697 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:25.697 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.698 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:25.698 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.698 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:25.698 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:25.698 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.698 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.698 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.698 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:25.698 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:25.698 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.698 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.698 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.698 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:25.698 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:25.699 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.699 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.699 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.699 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:25.699 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:25.699 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:25.699 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.699 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.699 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:25.699 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:25.699 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:25.699 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.699 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.699 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.699 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:25.700 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:25.700 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.700 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.700 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:25.700 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:25.700 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:25.700 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.700 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.700 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:25.700 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:25.700 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:25.700 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.700 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.700 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:25.700 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:25.700 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:25.701 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.701 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.701 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:25.701 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:25.701 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:25.701 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.701 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.701 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.701 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:25.701 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:25.701 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.701 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.701 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:25.701 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:25.701 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:25.702 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.702 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.702 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:25.702 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:25.702 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:25.702 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.702 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:25.702 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.702 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.702 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.702 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:25.702 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:25.702 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 91.822495419000006, 2024-04-26T12:06:25.702 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:25.702 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:25.703 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.703 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:25.703 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:25.703 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:25.703 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:25.703 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.703 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:25.703 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.703 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:25.703 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:25.703 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.703 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.703 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.703 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:25.703 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:25.704 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.704 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.704 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.704 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:25.704 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:25.704 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.704 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.704 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.704 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:25.704 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:25.704 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:25.704 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.704 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.704 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:25.705 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:25.705 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:25.705 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.705 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.705 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.705 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:25.705 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:25.705 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.705 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.705 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:25.705 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:25.705 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:25.705 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.705 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.706 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:25.706 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:25.706 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:25.706 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.706 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.706 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:25.706 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:25.706 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:25.706 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.706 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.706 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:25.706 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:25.706 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:25.707 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.707 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.707 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:25.707 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:25.707 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.707 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:25.707 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:25.707 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:25.707 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.707 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:25.708 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:25.708 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:25.708 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.708 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:25.708 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.708 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.708 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.708 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:25.708 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:25.708 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 81.896591133000001, 2024-04-26T12:06:25.708 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:25.708 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:25.708 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.708 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:25.708 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.709 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:25.709 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:25.709 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.709 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.709 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.709 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:25.709 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:25.709 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.709 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.709 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.709 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:25.709 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:25.709 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:25.709 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.709 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.710 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:25.710 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:25.710 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:25.710 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.710 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.710 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:25.710 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:25.710 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:25.710 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.710 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.710 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.710 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:25.710 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:25.710 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.710 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.711 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:25.711 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:25.711 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:25.711 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.711 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.711 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:25.711 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:25.711 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:25.711 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.711 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.711 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:25.711 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:25.711 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:25.711 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.711 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.712 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:25.712 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:25.712 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:25.712 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.712 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.712 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.712 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:25.712 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:25.712 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.712 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.712 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:25.712 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:25.712 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:25.712 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.712 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.712 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:25.713 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:25.713 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:25.713 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.713 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:25.713 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.713 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.713 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.713 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:25.713 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:25.713 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 81.896555038000002, 2024-04-26T12:06:25.713 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:25.713 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:25.713 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.713 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:25.713 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.714 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:25.714 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:25.714 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.714 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.714 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.714 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:25.714 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:25.714 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.714 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.714 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.714 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:25.714 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:25.714 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:25.714 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.715 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.715 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:25.715 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:25.715 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:25.715 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.715 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.715 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:25.715 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:25.715 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:25.715 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.715 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.715 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.715 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:25.715 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:25.715 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.716 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.716 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:25.716 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:25.716 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:25.716 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.716 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.716 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:25.716 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:25.716 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:25.716 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.716 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.716 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:25.716 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:25.716 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:25.716 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.716 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.717 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:25.717 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:25.717 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:25.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.717 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.717 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.717 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:25.717 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:25.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.717 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.717 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:25.717 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:25.717 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:25.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.717 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.718 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:25.718 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:25.718 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:25.718 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.718 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:25.718 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.718 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.718 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.718 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:25.718 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:25.718 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 81.896517353999997, 2024-04-26T12:06:25.718 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:25.718 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:25.718 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.718 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:25.719 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.719 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:25.719 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:25.719 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.719 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.719 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.719 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:25.719 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:25.719 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.719 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.719 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.719 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:25.719 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:25.719 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.720 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.720 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.720 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:25.720 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:25.720 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:25.720 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.720 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.720 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:25.720 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:25.720 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:25.720 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.720 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.720 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.720 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:25.721 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:25.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.721 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.721 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:25.721 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:25.721 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:25.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.721 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.721 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:25.721 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:25.721 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:25.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.721 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.721 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:25.721 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:25.722 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:25.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.722 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.722 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:25.722 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:25.722 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:25.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.722 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.722 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.722 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:25.722 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:25.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.722 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.722 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:25.723 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:25.723 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:25.723 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.723 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:25.723 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:25.723 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:25.723 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.723 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:25.723 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.723 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.723 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:25.723 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:25.723 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 81.896496013999993, 2024-04-26T12:06:25.724 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:25.724 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:25.724 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.724 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:25.724 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.724 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:25.724 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:25.724 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.724 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.724 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.724 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:25.724 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:25.724 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.724 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.724 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.725 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:25.725 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:25.725 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.725 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.725 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.725 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:25.725 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:25.725 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:25.725 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.725 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.725 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:25.725 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:25.725 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:25.725 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.725 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.725 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.726 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:25.726 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:25.726 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.726 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.726 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:25.726 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:25.726 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:25.726 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.726 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.726 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:25.726 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:25.726 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:25.726 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.726 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.727 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:25.727 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:25.727 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:25.727 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.727 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.727 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:25.727 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:25.727 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:25.727 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.727 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.727 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.727 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:25.727 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:25.727 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.727 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.728 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:25.728 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:25.728 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:25.728 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.728 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.728 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:25.728 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:25.728 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:25.728 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.728 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:25.728 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.728 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.728 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.728 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:25.728 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:25.729 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 81.896473748000005, 2024-04-26T12:06:25.729 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:25.729 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:25.729 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.729 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:25.729 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.729 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:25.729 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:25.729 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.729 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.729 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.729 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:25.729 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:25.729 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.730 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.730 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.730 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:25.730 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:25.730 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.730 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.730 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.730 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:25.730 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:25.730 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:25.730 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.730 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:25.731 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:25.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:25.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.731 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:25.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:25.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:25.731 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:25.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:25.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.732 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:25.732 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:25.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:25.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.732 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:25.732 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:25.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:25.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.732 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:25.732 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:25.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:25.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.733 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:25.733 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:25.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:25.733 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:25.733 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:25.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:25.733 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:25.733 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:25.733 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.733 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:25.734 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.734 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.734 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.734 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:25.734 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:25.734 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 81.896452126, 2024-04-26T12:06:25.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:25.734 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:25.734 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.734 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:25.734 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.734 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:25.734 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:25.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.734 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.735 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:25.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:25.735 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.735 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.735 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:25.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:25.735 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.735 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.735 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:25.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:25.735 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:25.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.736 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:25.736 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:25.736 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:25.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.736 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.736 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:25.736 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:25.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.736 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:25.736 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:25.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:25.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:25.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:25.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:25.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:25.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:25.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:25.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:25.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:25.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:25.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.738 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.738 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.738 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:25.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:25.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.738 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.738 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:25.738 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:25.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:25.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.738 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.738 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:25.739 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:25.739 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:25.739 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.739 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:25.739 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.739 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.739 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.739 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:25.739 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:25.739 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 81.896425559999997, 2024-04-26T12:06:25.739 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:25.739 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:25.739 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.739 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:25.739 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.740 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:25.740 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:25.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.740 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.740 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:25.740 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:25.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.740 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.740 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:25.740 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:25.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.741 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.741 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.741 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:25.741 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:25.741 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:25.741 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.741 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.741 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:25.741 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:25.741 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:25.741 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.741 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.741 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.742 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:25.742 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:25.742 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.742 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.742 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:25.742 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:25.742 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:25.742 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.742 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.742 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:25.742 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:25.742 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:25.743 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.743 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.743 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:25.743 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:25.743 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:25.743 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.743 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.743 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:25.743 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:25.743 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:25.743 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.743 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.743 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.743 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:25.744 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:25.744 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.744 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.744 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:25.744 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:25.744 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:25.744 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.744 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.744 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:25.744 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:25.744 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:25.744 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.744 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:25.745 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.745 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.745 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.745 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:25.745 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:25.745 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 81.896387047999994, 2024-04-26T12:06:25.745 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:25.745 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:25.745 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.745 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:25.745 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.745 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:25.745 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:25.745 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.745 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.746 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.746 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:25.746 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:25.746 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.746 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.746 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.746 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:25.746 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:25.746 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.746 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.746 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.746 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:25.746 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:25.747 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:25.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.747 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:25.747 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:25.747 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:25.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.747 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.747 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:25.747 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:25.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.748 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:25.748 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:25.748 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:25.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.748 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.748 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:25.748 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:25.748 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:25.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.748 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.748 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:25.748 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:25.748 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:25.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.749 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.749 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:25.749 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:25.749 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:25.749 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.749 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.749 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.749 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:25.749 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:25.749 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.749 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.749 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:25.749 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:25.749 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:25.749 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.750 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.750 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:25.750 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:25.750 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:25.750 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.750 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:25.750 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.750 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.750 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.750 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:25.750 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:25.750 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 81.896358875000004, 2024-04-26T12:06:25.750 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:25.750 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:25.751 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.751 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:25.751 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.751 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:25.751 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:25.751 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.751 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.751 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:25.751 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:25.751 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.751 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.751 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:25.752 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:25.752 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.752 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.752 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.752 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:25.752 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:25.752 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:25.752 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.752 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.752 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:25.752 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:25.752 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:25.752 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.752 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.752 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.753 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:25.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:25.753 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.753 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:25.753 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:25.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:25.753 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.753 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:25.753 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:25.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:25.753 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.753 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:25.754 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:25.754 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:25.754 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.754 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.754 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:25.754 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:25.754 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:25.754 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.754 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.754 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.754 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:25.754 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:25.754 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.754 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.755 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:25.755 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:25.755 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:25.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.755 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.755 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:25.755 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:25.755 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:25.755 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.755 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:25.755 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.755 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.755 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:25.755 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:25.756 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 81.896324311000001, 2024-04-26T12:06:25.756 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:25.756 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:25.756 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.756 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:25.756 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.756 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:25.756 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:25.756 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.756 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.756 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.756 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:25.756 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:25.756 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.757 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.757 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.757 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:25.757 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:25.757 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.757 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.757 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.757 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:25.757 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:25.757 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:25.757 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.757 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.757 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:25.757 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:25.757 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:25.758 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.758 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.758 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.758 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:25.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:25.758 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.758 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.758 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:25.758 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:25.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:25.758 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.758 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.758 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:25.759 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:25.759 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:25.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.759 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:25.759 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:25.759 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:25.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.759 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:25.759 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:25.759 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:25.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.759 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:25.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:25.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:25.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:25.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:25.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:25.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:25.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:25.760 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.760 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:25.761 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.761 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:25.761 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:25.761 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 81.895449530999997, 2024-04-26T12:06:25.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:25.761 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:25.761 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.761 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:25.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.761 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:25.761 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:25.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.762 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:25.762 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:25.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.762 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.762 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:25.762 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:25.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:25.762 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.762 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:25.762 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:25.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:25.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.763 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.763 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:25.763 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:25.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:25.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.763 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.763 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.763 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:25.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:25.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.763 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.763 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:25.763 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:25.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:25.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.764 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:25.764 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:25.764 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:25.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.764 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:25.764 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:25.764 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:25.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.764 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:25.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:25.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:25.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:25.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:25.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:25.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:25.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:25.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:25.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:25.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:25.766 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.766 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:25.766 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.766 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:25.767 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:25.767 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 81.895410572000003, 2024-04-26T12:06:25.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:25.767 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:25.767 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.767 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:25.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:25.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:25.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:25.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:25.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.768 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.768 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:25.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:25.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.768 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.768 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:25.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:25.769 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:25.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.769 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:25.769 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:25.769 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:25.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.769 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.769 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:25.769 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:25.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:25.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:25.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:25.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:25.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:25.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:25.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:25.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:25.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:25.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:25.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:25.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:25.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:25.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:25.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:25.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:25.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:25.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:25.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:25.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:25.772 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.772 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:25.772 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.772 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:25.773 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:25.773 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 81.895375099999995, 2024-04-26T12:06:25.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:25.773 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:25.773 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.773 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:25.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:25.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:25.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:25.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:25.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:25.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:25.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:25.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:25.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:25.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:25.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:25.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:25.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:25.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:25.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:25.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:25.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:25.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:25.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:25.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:25.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:25.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:25.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:25.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:25.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:25.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:25.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:25.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:25.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:25.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:25.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:25.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:25.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:25.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:25.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:25.778 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.778 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:25.778 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.778 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:25.778 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:25.778 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 81.895296411000004, 2024-04-26T12:06:25.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:25.778 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:25.779 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:25.779 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:25.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.779 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:25.779 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:25.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.779 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.779 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:25.779 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:25.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.779 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.780 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:25.780 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:25.780 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:25.780 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.780 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:25.780 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:25.780 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:25.780 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.780 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:25.780 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:25.780 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:25.780 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:25.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:25.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:25.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:25.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:25.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:25.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:25.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:25.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:25.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:25.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:25.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:25.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:25.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:25.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:25.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:25.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:25.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:25.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:25.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:25.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:25.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:25.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:25.783 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.784 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:25.784 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.784 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:25.784 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:25.784 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 81.895145563, 2024-04-26T12:06:25.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:25.784 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:25.784 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:25.784 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:25.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.784 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:25.784 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:25.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.785 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.785 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.785 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:25.785 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:25.785 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:25.785 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.785 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.785 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:25.785 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:25.785 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:25.785 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.785 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.785 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:25.785 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:25.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:25.786 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.786 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:25.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:25.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:25.786 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.786 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:25.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:25.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:25.786 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:25.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:25.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:25.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:25.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:25.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:25.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:25.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:25.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:25.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:25.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:25.787 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.787 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:25.788 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.788 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:25.788 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:25.788 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:25.789 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:25.788+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:25.790 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:25.891 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:25.892 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:25.892 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:06:25.892 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:25.896 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:25.894+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:25.900 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:25.975 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-26T12:06:25.991 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:25.990+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:26.009 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:26.009 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:26.009 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:26.009 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:26.009 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:26.018 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:26.088 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:06:26.091 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:26.090+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:26.123 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:26.123 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:26.123 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:26.124 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:26.124 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.124 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:26.124 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:26.124 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 82.339842110999996, 2024-04-26T12:06:26.124 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:06:26.125 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:26.125 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:26.125 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:26.125 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.125 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:26.125 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:26.126 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.126 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.126 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.126 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:26.126 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:26.126 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.127 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.127 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.127 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:26.127 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:06:26.127 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:26.127 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.128 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.128 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:26.128 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:06:26.128 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:06:26.128 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.129 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.129 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:26.129 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:06:26.129 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:06:26.129 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.129 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.129 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:26.129 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:06:26.130 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:06:26.130 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.130 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.130 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:26.130 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:06:26.130 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:06:26.130 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.130 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.130 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:26.131 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:26.131 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:06:26.131 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.131 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.131 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:26.131 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:06:26.131 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:06:26.131 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.131 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.131 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:26.132 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:06:26.132 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:06:26.132 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.132 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.132 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:26.132 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:06:26.132 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:06:26.132 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.132 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.132 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:26.133 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:06:26.133 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:06:26.133 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.133 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.133 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:26.133 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:06:26.133 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:06:26.133 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.133 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:26.133 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.133 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.133 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.133 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:26.133 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:26.134 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 82.339786790999995, 2024-04-26T12:06:26.134 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:06:26.134 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:26.134 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:26.134 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:26.134 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.134 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:26.134 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:26.134 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.134 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.134 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.134 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:26.134 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:26.135 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.135 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.135 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.135 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:26.135 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:06:26.135 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:26.135 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.135 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.135 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:26.135 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:06:26.135 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:06:26.135 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.135 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.135 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:26.135 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:06:26.136 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:06:26.136 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.136 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.136 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:26.136 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:06:26.136 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:06:26.136 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.136 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.136 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:26.136 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:06:26.136 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:06:26.136 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.136 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.136 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:26.137 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:06:26.137 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:06:26.137 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.137 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.137 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:26.137 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:06:26.137 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:06:26.137 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.137 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.137 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:26.137 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:06:26.137 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:06:26.137 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.137 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.137 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:26.138 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:06:26.138 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:06:26.138 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.138 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.138 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:26.138 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:06:26.138 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:06:26.138 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.138 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.138 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:26.138 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:06:26.139 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:06:26.139 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.139 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:26.139 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.139 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.139 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.139 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:26.139 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:26.139 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 82.339736772999998, 2024-04-26T12:06:26.139 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:06:26.139 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:26.139 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:26.139 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:26.140 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.140 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:26.140 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:26.140 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.140 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.140 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.140 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:26.140 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:26.140 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.140 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.140 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.140 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:26.140 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:06:26.140 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:26.141 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.141 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.142 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:26.142 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:06:26.142 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:06:26.142 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.142 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.142 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:26.142 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:06:26.142 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:06:26.143 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.143 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.143 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:26.143 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:06:26.143 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:06:26.143 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.143 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.143 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:26.143 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:06:26.143 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:06:26.143 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.143 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.143 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:26.144 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:06:26.144 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:06:26.144 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.144 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.144 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:26.144 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:06:26.144 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:06:26.144 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.144 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.144 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:26.144 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:06:26.145 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:06:26.145 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.145 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.145 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:26.145 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:06:26.145 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:06:26.145 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.145 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.145 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:26.145 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:06:26.145 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:06:26.145 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.145 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.145 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:26.145 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:06:26.146 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:06:26.146 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.146 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:26.146 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.146 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.146 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.146 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:26.146 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:26.146 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 82.339702136, 2024-04-26T12:06:26.146 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:06:26.146 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:26.146 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:26.146 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:26.146 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.147 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:26.147 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:26.147 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.147 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.147 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.147 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:26.147 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:26.147 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.147 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.147 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.147 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:26.147 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:06:26.148 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:26.148 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.148 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.148 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:26.148 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:06:26.148 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:06:26.148 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.148 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.148 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:26.148 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:26.148 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:06:26.148 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.148 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.148 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:26.148 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:06:26.149 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:06:26.149 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.149 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.149 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:26.149 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:06:26.149 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:06:26.149 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.149 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.149 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:26.149 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:06:26.149 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:06:26.149 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.149 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.149 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:26.150 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:06:26.150 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:06:26.150 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.150 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.150 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:26.150 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:06:26.150 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:06:26.150 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.150 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.150 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:26.150 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:06:26.150 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:06:26.150 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.150 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.151 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:26.151 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:06:26.151 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:06:26.151 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.151 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.151 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:26.151 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:06:26.151 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:06:26.151 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.151 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:26.151 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.151 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.151 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.151 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:26.152 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:26.152 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 82.339663623999996, 2024-04-26T12:06:26.152 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:06:26.152 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:26.152 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:26.152 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:26.152 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.152 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:26.152 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:26.152 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.152 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.152 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.153 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:26.153 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:26.153 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.153 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.153 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.153 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:26.153 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:26.153 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:26.153 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.153 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.153 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:26.153 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:26.153 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:06:26.153 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.153 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.154 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:26.154 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:06:26.154 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:06:26.154 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.154 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.154 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:26.154 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:06:26.154 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:06:26.154 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.154 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.154 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:26.154 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:06:26.154 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:06:26.154 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.155 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.155 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:26.155 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:06:26.155 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:06:26.155 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.155 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.155 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:26.155 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:06:26.155 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:06:26.155 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.155 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.155 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:26.155 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:06:26.155 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:06:26.156 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.156 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.156 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:26.156 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:06:26.156 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:06:26.156 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.156 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.156 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:26.156 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:06:26.156 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:06:26.156 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.156 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.156 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:26.156 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:06:26.157 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:06:26.157 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.157 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:26.157 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.157 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.157 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.157 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:26.157 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:26.157 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 82.339633301000006, 2024-04-26T12:06:26.157 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:06:26.157 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:26.157 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:26.157 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:26.157 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.158 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:26.158 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:26.158 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.158 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.158 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.158 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:26.158 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:26.158 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.158 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.158 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.158 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:26.158 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:06:26.158 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:26.158 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.159 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.159 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:26.159 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:06:26.159 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:06:26.159 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.159 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.159 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:26.159 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:06:26.159 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:06:26.159 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.159 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.159 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:26.159 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:06:26.160 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:06:26.160 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.160 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.160 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:26.160 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:06:26.160 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:06:26.160 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.160 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.160 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:26.160 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:06:26.160 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:06:26.160 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.160 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.160 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:26.160 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:06:26.161 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:06:26.161 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.161 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.161 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:26.161 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:06:26.161 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:06:26.161 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.161 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.161 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:26.161 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:06:26.161 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:06:26.161 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.161 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.161 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:26.162 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:06:26.162 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:06:26.162 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.162 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.162 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:26.162 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:06:26.162 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:06:26.162 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.162 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:26.162 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.162 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.162 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.162 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:26.162 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:26.163 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 82.339606599000007, 2024-04-26T12:06:26.163 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:06:26.163 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:26.163 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:26.163 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:26.163 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.163 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:26.163 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:26.163 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.163 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.163 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.163 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:26.163 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:26.163 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.164 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.164 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.164 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:26.164 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:26.164 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:26.164 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.164 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.164 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:26.164 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:06:26.164 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:06:26.164 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.164 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.164 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:26.164 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:06:26.165 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:06:26.165 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.165 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.165 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:26.165 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:06:26.165 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:06:26.165 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.165 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.165 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:26.165 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:06:26.165 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:06:26.165 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.165 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.165 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:26.165 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:06:26.166 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:06:26.166 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.166 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.166 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:26.166 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:06:26.166 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:06:26.166 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.166 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:26.166 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.166 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.167 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.167 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:26.167 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:26.167 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 82.339564308999996, 2024-04-26T12:06:26.167 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:06:26.167 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:26.167 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:26.167 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:26.167 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.167 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:26.167 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:26.168 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.168 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.168 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.168 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:26.168 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:26.168 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.168 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.168 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.168 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:26.168 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:26.168 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:26.168 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.168 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.168 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:26.168 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:06:26.168 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:06:26.169 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.169 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.169 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:26.169 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:06:26.169 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:06:26.169 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.169 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.169 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:26.169 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:06:26.169 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:06:26.169 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.169 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.169 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:26.169 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:06:26.169 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:06:26.170 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.170 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.170 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:26.170 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:06:26.170 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:06:26.170 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.170 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.170 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:26.170 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:06:26.170 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:06:26.170 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.170 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:26.170 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.170 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.171 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.171 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:26.171 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:26.171 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 82.339536230999997, 2024-04-26T12:06:26.171 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:06:26.171 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:26.171 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:26.171 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:26.171 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.172 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:26.172 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:26.172 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.172 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.173 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.173 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:26.173 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:26.173 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.173 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.173 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.173 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:26.174 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:06:26.174 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:26.174 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.174 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.174 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:26.174 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:06:26.174 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:06:26.174 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.174 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.175 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:26.175 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:06:26.175 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:06:26.175 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.175 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.175 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:26.175 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:06:26.176 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:06:26.176 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.176 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.176 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:26.176 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:06:26.176 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:06:26.176 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.176 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.176 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:26.176 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:06:26.176 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:06:26.176 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.176 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.176 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:26.177 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:06:26.177 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:06:26.177 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.177 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:26.177 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.177 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.177 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.177 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:26.177 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:26.177 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 82.333540881000005, 2024-04-26T12:06:26.177 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:06:26.178 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:26.178 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:26.178 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:26.178 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.178 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:26.178 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:26.178 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.178 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.178 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.178 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:26.178 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:26.178 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.178 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.178 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.179 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:26.179 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:06:26.179 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:26.179 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.179 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.179 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:26.179 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:06:26.179 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:06:26.179 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.179 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.179 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:26.179 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:06:26.179 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:06:26.179 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.180 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.180 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:26.180 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:06:26.180 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:06:26.180 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.180 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.180 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:26.180 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:06:26.180 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:06:26.180 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.180 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.180 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:26.180 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:06:26.181 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:06:26.181 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.181 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.181 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:26.181 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:06:26.181 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:06:26.181 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.181 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.181 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:26.181 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:06:26.181 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:06:26.181 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.181 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:26.181 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.181 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.182 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.182 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:26.182 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:26.182 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 82.333471915000004, 2024-04-26T12:06:26.182 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:06:26.182 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:26.182 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:26.182 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:26.182 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.182 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:26.182 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:26.182 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.182 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.183 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.183 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:26.183 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:26.183 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.183 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.183 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.183 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:26.183 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:06:26.183 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:26.183 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.183 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.183 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:26.183 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:06:26.184 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:06:26.184 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.184 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.184 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:26.184 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:06:26.184 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:06:26.184 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.184 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.184 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:26.184 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:06:26.184 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:06:26.184 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.184 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.184 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:26.184 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:06:26.185 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:06:26.185 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.185 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.185 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:26.185 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:26.185 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:06:26.185 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.185 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.185 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:26.185 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:06:26.185 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:06:26.185 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.185 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.185 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:26.186 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:06:26.186 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:06:26.186 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.186 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:26.186 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.186 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.186 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.186 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:26.186 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:26.186 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 82.332977552000003, 2024-04-26T12:06:26.186 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:06:26.186 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:26.186 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:26.187 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:26.187 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.187 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:26.187 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:26.187 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.187 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.187 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.187 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:26.187 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:26.187 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.187 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.187 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.187 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:26.187 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:26.187 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:26.188 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.188 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.188 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:26.188 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:06:26.188 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:06:26.188 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.188 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.188 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:26.188 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:06:26.188 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:06:26.188 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.188 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.188 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:26.188 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:06:26.189 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:06:26.189 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.189 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.189 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:26.189 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:06:26.189 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:06:26.189 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.189 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.189 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:26.189 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:06:26.189 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:06:26.189 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.189 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.189 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:26.190 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:06:26.190 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:06:26.190 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.190 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.190 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:26.190 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:06:26.190 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:06:26.190 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.190 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:26.190 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.190 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.190 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.190 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:26.191 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:26.191 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 82.332939287000002, 2024-04-26T12:06:26.191 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:06:26.191 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:26.191 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:26.191 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:26.191 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.191 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:26.191 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:26.191 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.191 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.191 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.191 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:26.192 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:26.192 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.192 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.192 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.192 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:26.192 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:26.192 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:26.192 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.192 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.192 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:26.192 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:06:26.192 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:06:26.192 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.192 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.193 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:26.193 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:06:26.193 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:06:26.193 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.193 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.193 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:26.193 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:06:26.193 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:06:26.193 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.193 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.193 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:26.193 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:06:26.193 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:06:26.193 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.194 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.194 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:26.194 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:06:26.194 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:06:26.194 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.194 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.194 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:26.194 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:06:26.194 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:06:26.194 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.194 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.194 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:26.194 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:06:26.194 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:06:26.195 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.195 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:26.195 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.195 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.195 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.195 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:06:26.195 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:26.195 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 82.332259402000005, 2024-04-26T12:06:26.196 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:06:26.196 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:26.196 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:26.196 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:26.196 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.196 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:26.196 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:26.197 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.197 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.197 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.197 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:26.197 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:26.197 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.197 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.197 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.197 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:26.197 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:26.197 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:26.197 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.197 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.197 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:26.197 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:06:26.198 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:06:26.198 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.198 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.198 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:26.198 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:06:26.198 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:06:26.198 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.198 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.198 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:26.198 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:06:26.198 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:06:26.198 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.198 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.198 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:26.199 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:06:26.199 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:06:26.199 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.199 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.199 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:26.199 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:06:26.199 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:06:26.199 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.199 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:26.199 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.199 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.199 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.199 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:26.199 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:26.200 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 82.332230222999996, 2024-04-26T12:06:26.200 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:06:26.200 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:26.200 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:26.200 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:26.200 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.200 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:26.200 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:26.200 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.200 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.200 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.200 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:26.200 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:26.200 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.201 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.201 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.201 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:26.201 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:06:26.201 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:26.201 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.201 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.201 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:26.201 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:06:26.201 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:06:26.201 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.201 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.201 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:26.201 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:06:26.202 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:06:26.202 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.202 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.202 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:26.202 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:06:26.202 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:06:26.202 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.202 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.202 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:26.202 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:06:26.202 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:06:26.202 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.202 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.202 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:26.203 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:06:26.203 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:06:26.203 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.203 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.203 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:26.203 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:06:26.203 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:06:26.203 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.203 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:26.203 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.203 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.203 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.203 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:26.203 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:26.204 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 82.332198411999997, 2024-04-26T12:06:26.204 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:06:26.204 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:26.204 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:26.204 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:26.204 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.204 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:26.204 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:26.204 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.204 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.204 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.204 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:26.204 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:26.204 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.205 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.205 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.205 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:26.205 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:26.205 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:26.205 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.205 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.205 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:26.205 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:06:26.205 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:06:26.205 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.205 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.205 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:26.205 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:06:26.205 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:06:26.206 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.206 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.206 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:26.206 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:06:26.206 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:06:26.206 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.206 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.206 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:26.206 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:06:26.206 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:06:26.206 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.206 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.206 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:26.207 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:06:26.207 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:06:26.207 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.207 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.207 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:26.207 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:06:26.207 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:06:26.207 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.207 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:26.207 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.207 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.207 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.207 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:26.207 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:26.208 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 82.332177056000006, 2024-04-26T12:06:26.208 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:06:26.208 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:26.208 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:26.208 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:26.208 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.208 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:26.208 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:26.208 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.208 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.208 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.208 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:26.208 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:26.208 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.208 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.208 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.209 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:26.209 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:26.209 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:26.209 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.209 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.209 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:26.209 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:06:26.209 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:06:26.209 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.209 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.209 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:26.209 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:06:26.209 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:06:26.210 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.210 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.210 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:26.210 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:06:26.210 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:06:26.210 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.210 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.210 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:26.210 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:06:26.210 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:06:26.210 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.210 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.210 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:26.210 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:06:26.211 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:06:26.211 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.211 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.211 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:26.211 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:06:26.211 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:06:26.211 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.211 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:26.211 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.211 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.211 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.211 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:06:26.211 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:26.211 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 82.332148602999993, 2024-04-26T12:06:26.211 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:06:26.212 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:26.212 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:26.212 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:26.212 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.212 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:26.212 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:26.212 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.212 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.212 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.212 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:26.212 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:26.212 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.212 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.212 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.212 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:26.213 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:26.213 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:26.213 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.213 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.213 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:26.213 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:06:26.213 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:06:26.213 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.213 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.213 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:26.213 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:06:26.213 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:06:26.213 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.213 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.213 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:26.214 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:06:26.214 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:06:26.214 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.214 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.214 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:26.214 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:06:26.214 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:06:26.214 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.214 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.214 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:26.214 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:06:26.214 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:06:26.214 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.214 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:26.215 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.215 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.215 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.215 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:06:26.215 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:26.215 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 82.331426797000006, 2024-04-26T12:06:26.215 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:06:26.215 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:26.215 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:26.215 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:26.215 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.215 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:26.215 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:26.215 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.216 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.216 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.216 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:26.216 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:26.216 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.216 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.216 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.216 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:26.216 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:06:26.216 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:26.216 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.216 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.216 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:26.216 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:06:26.216 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:06:26.217 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.217 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.217 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:26.217 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:06:26.217 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:06:26.217 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.217 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.217 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:26.217 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:06:26.217 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:06:26.217 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.217 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.217 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:26.217 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:06:26.217 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:06:26.218 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.218 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.218 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:26.218 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:06:26.218 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:06:26.218 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.218 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:26.218 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.218 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.218 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.218 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:06:26.218 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:26.218 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 76.614500194000001, 2024-04-26T12:06:26.219 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:06:26.219 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:26.219 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:26.219 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:26.219 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.219 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:26.219 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:26.219 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.219 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.219 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.219 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:26.219 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:26.219 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:26.219 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.220 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.220 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:26.220 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:06:26.220 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:06:26.220 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.220 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.220 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:26.220 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:06:26.220 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:06:26.220 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.221 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.221 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:26.221 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:06:26.221 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:06:26.221 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.221 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.221 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:26.221 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:06:26.221 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:06:26.221 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.221 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.221 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:26.221 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:06:26.221 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:06:26.222 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.222 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.222 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:26.222 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:06:26.222 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:06:26.222 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.222 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.222 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:26.222 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:06:26.222 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:06:26.222 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.222 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.222 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:26.222 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:06:26.222 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:06:26.223 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.223 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.223 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:26.223 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:06:26.223 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:06:26.223 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.223 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.223 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:26.223 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:06:26.223 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:06:26.223 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:26.223 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:26.223 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:26.224 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:06:26.224 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:06:26.224 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.224 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:26.224 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.224 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:26.224 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:26.224 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:26.225 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:26.226 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:26.226 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:06:26.227 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:26.227 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:26.224+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:26.231 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:26.235 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:06:26.235 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:06:26.326 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:26.325+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:26.329 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:26.329 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:26.338 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:26.427 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:26.426+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:26.480 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:26.481 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:26.490 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:26.531 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:26.530+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:26.629 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:26.628+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:26.631 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:26.632 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:26.640 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:26.730 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:26.729+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:26.746 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:26.747 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:26.756 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:26.832 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:26.831+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:26.857 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:26.857 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:26.866 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:26.933 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:26.932+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:26.967 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:26.968 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:26.976 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:27.033 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:27.032+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:27.082 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:27.082 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:27.091 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:27.135 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:27.134+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:27.193 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:27.193 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:27.201 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:27.242 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:27.241+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:27.337 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:27.336+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:27.342 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:27.343 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:27.352 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:27.438 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:27.437+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:27.454 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:27.454 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:27.463 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:27.539 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:27.538+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:27.563 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:27.563 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:27.572 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:27.641 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:27.640+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:27.674 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:27.674 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:27.683 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:27.742 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:27.741+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:27.787 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:27.787 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:27.795 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:27.842 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:27.841+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:27.897 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:27.897 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:27.906 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:27.943 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:27.943+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:27.990 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:06:28.045 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:28.044+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:28.048 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:28.048 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:28.057 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:28.146 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:28.145+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:28.159 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:28.159 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:28.167 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:28.236 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:06:28.247 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:28.246+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:28.269 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:28.269 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:28.278 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:28.349 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:28.347+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:28.422 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:28.423 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:28.430 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:28.432 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:28.432 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:28.433 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:06:28.450 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:28.448+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:28.466 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:28.467 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:28.470 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:06:28.471 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:06:28.535 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:28.535 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:28.535 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:06:28.535 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:28.543 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:28.550 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:28.549+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:28.645 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:28.645 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:28.645 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:28.645 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:28.645 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:28.651 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:28.650+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:28.653 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:28.752 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:28.751+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:28.797 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:28.797 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:28.797 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:28.797 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:28.798 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.798 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:28.798 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:28.798 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 94.940343225999996, 2024-04-26T12:06:28.798 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:28.798 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:28.798 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:28.798 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:28.798 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:28.798 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:28.798 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:28.798 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.798 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:28.798 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.799 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:28.799 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:28.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.799 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.799 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.799 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:28.799 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:28.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.799 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.799 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.799 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:28.799 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:28.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:28.799 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:28.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:28.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:28.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:28.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:28.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:28.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:28.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:28.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:28.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:28.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:28.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:28.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:28.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:28.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:28.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:28.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:28.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:28.803 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.803 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.803 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:28.803 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:28.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:28.803 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.803 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:28.803 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.803 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.803 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.803 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:28.803 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:28.804 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 94.940237330000002, 2024-04-26T12:06:28.805 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:28.805 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:28.805 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:28.805 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:28.805 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:28.805 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:28.805 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:28.805 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.805 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:28.805 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.805 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:28.805 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:28.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:28.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:28.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:28.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:28.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:28.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:28.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:28.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:28.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:28.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:28.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:28.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:28.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:28.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:28.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:28.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:28.808 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:28.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.808 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.808 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:28.808 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:28.808 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:28.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.808 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.808 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:28.808 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:28.808 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:28.809 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.809 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.809 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:28.809 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:28.809 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:28.809 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.809 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.809 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:28.809 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:28.809 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:28.809 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.809 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.809 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:28.809 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:28.809 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:28.809 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.810 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.810 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:28.810 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:28.810 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:28.810 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.810 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:28.810 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.810 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.810 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.810 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:28.810 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:28.810 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 94.940222349999999, 2024-04-26T12:06:28.810 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:28.810 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:28.811 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:28.811 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:28.811 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:28.811 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:28.811 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:28.811 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.811 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:28.811 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.811 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:28.811 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:28.811 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.811 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.811 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.811 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:28.811 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:28.811 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.812 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:28.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:28.812 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:28.812 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:28.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:28.812 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:28.812 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:28.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:28.812 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:28.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:28.813 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:28.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:28.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:28.813 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:28.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:28.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:28.813 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:28.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:28.814 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.814 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.814 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:28.815 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:28.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:28.815 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.815 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.815 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:28.815 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:28.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:28.815 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.815 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.816 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:28.816 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:28.816 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:28.816 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.816 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.816 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:28.816 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:28.816 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:28.816 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.816 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.816 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:28.816 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:28.816 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:28.816 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.816 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:28.816 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.817 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.817 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.817 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:28.817 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:28.817 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 94.940178474999996, 2024-04-26T12:06:28.817 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:28.817 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:28.817 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:28.817 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:28.817 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:28.817 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:28.817 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:28.817 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.817 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:28.817 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.818 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:28.818 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:28.818 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.818 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.818 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:28.818 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:28.818 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.818 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.818 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:28.818 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:28.818 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:28.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:28.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:28.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:28.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:28.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:28.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:28.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:28.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:28.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:28.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.820 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:28.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:28.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:28.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.820 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:28.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:28.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:28.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:28.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:28.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:28.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.821 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:28.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:28.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:28.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.821 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:28.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:28.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:28.822 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.822 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:28.822 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:28.822 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:28.822 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.822 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:28.822 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:28.822 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:28.822 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.822 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:28.822 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.822 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.823 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:28.823 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:28.823 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 94.940092811, 2024-04-26T12:06:28.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:28.823 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:28.823 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:28.823 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:28.823 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:28.823 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:28.823 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:28.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.823 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:28.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.823 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:28.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:28.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:28.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:28.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:28.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:28.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:28.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:28.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:28.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:28.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:28.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:28.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:28.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:28.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:28.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:28.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:28.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:28.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:28.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:28.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:28.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:28.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:28.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:28.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:28.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:28.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:28.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:28.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.828 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:28.828 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:28.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:28.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.828 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.828 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:28.828 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:28.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:28.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.828 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.828 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:28.828 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:28.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:28.828 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.828 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:28.828 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.829 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:28.829 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:28.829 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.014188524999994, 2024-04-26T12:06:28.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:28.829 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:28.829 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:28.829 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:28.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.829 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:28.829 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:28.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:28.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:28.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:28.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:28.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:28.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:28.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:28.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:28.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:28.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:28.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:28.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:28.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:28.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:28.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:28.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:28.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:28.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:28.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:28.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:28.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:28.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:28.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:28.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:28.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:28.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:28.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:28.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:28.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:28.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:28.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:28.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:28.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:28.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:28.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:28.834 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.834 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:28.834 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.834 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.834 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:28.834 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:28.834 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.014152429999996, 2024-04-26T12:06:28.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:28.834 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:28.834 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:28.834 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:28.835 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.835 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:28.835 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:28.835 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.835 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.835 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.835 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:28.835 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:28.835 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.835 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.835 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.835 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:28.836 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:28.836 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:28.836 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.836 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.836 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:28.836 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:28.836 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:28.836 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.836 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.836 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:28.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:28.837 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:28.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:28.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:28.837 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:28.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:28.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:28.837 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:28.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:28.839 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:28.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:28.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.839 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:28.839 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:28.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:28.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.839 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:28.839 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:28.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:28.839 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.839 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:28.839 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.840 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:28.840 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:28.840 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.014114746000004, 2024-04-26T12:06:28.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:28.840 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:28.840 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:28.840 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:28.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:28.840 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:28.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.840 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.841 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:28.841 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:28.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.841 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:28.841 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:28.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:28.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.841 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:28.841 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:28.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:28.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.842 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:28.842 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:28.842 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:28.842 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.842 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:28.842 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:28.842 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:28.842 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.842 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:28.842 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:28.842 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:28.843 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:28.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:28.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:28.843 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:28.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:28.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:28.843 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:28.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:28.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:28.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:28.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:28.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:28.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:28.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:28.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:28.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:28.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:28.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:28.845 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.845 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:28.845 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.845 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:28.845 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:28.845 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.014093406000001, 2024-04-26T12:06:28.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:28.845 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:28.845 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:28.846 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:28.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:28.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:28.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:28.847 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:28.847 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.847 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.847 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.847 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:28.847 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:28.847 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:28.847 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.847 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.847 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:28.847 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:28.847 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:28.847 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.847 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.848 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:28.848 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:28.848 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:28.848 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.848 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:28.848 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:28.848 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:28.848 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.848 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:28.848 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:28.848 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:28.848 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:28.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:28.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:28.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:28.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:28.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:28.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:28.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:28.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:28.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.850 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:28.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:28.850 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:28.850 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.850 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:28.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:28.850 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:28.850 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.850 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:28.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:28.850 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:28.850 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.850 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:28.851 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.851 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.851 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:28.851 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:28.851 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.014071139999999, 2024-04-26T12:06:28.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:28.851 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:28.851 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:28.851 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:28.851 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.851 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:28.851 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:28.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.852 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:28.852 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:28.852 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.852 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.852 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:28.852 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:28.852 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:28.852 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.852 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:28.852 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:28.852 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:28.852 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.853 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:28.853 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:28.853 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:28.853 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.853 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:28.853 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:28.853 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:28.853 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.853 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:28.853 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:28.853 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:28.853 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.854 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:28.854 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:28.854 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:28.854 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.854 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.854 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:28.854 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:28.854 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:28.854 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.854 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.854 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:28.854 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:28.855 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:28.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:28.855 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:28.855 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:28.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:28.855 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:28.855 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:28.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:28.855 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:28.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:28.856 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.856 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:28.856 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.856 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.856 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:28.856 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:28.856 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.014049517999993, 2024-04-26T12:06:28.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:28.856 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:28.856 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:28.857 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:28.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.857 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:28.857 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:28.857 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:28.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:28.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:28.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:28.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:28.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:28.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:28.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:28.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.859 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.859 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:28.859 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:28.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:28.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.859 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.859 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:28.859 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:28.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:28.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.859 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.859 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:28.859 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:28.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:28.860 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.860 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:28.860 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:28.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:28.860 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.860 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:28.860 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:28.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:28.860 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.860 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:28.860 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:28.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:28.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:28.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:28.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:28.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:28.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:28.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:28.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:28.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:28.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:28.862 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.862 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:28.862 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.862 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:28.862 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:28.862 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.014022952000005, 2024-04-26T12:06:28.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:28.862 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:28.862 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:28.862 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:28.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.862 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:28.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:28.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:28.863 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:28.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:28.863 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:28.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:28.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:28.863 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:28.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:28.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:28.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:28.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:28.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:28.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:28.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:28.865 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.865 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.865 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:28.865 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:28.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:28.865 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.865 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.865 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:28.865 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:28.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:28.865 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.865 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.865 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:28.865 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:28.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:28.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.866 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:28.866 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:28.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:28.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.866 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:28.866 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:28.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:28.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.866 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:28.866 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:28.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:28.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:28.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:28.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:28.868 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.868 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:28.868 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.868 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.868 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.868 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:28.868 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:28.868 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.013984440000002, 2024-04-26T12:06:28.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:28.868 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:28.868 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:28.868 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:28.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:28.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:28.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:28.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:28.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:28.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:28.870 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:28.870 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.870 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.870 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:28.870 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:28.870 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:28.870 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.870 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.870 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:28.870 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:28.870 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:28.870 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.870 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.870 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:28.871 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:28.871 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:28.871 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.871 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.871 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:28.871 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:28.871 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:28.871 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.871 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.871 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:28.871 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:28.871 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:28.872 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.872 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.872 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:28.872 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:28.872 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:28.872 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.872 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.872 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:28.872 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:28.872 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:28.872 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.872 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.872 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:28.872 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:28.872 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:28.873 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.873 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.873 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:28.873 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:28.873 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:28.873 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.873 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.873 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:28.873 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:28.873 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:28.873 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.873 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:28.873 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.873 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.873 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.873 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:28.874 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:28.874 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.013956266999998, 2024-04-26T12:06:28.874 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:28.874 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:28.874 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:28.874 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:28.874 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.874 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:28.874 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:28.874 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.874 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.874 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.874 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:28.874 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:28.875 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.875 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.875 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.875 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:28.875 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:28.875 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:28.875 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.875 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.875 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:28.875 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:28.875 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:28.875 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.875 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.875 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:28.875 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:28.875 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:28.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.876 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.876 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:28.876 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:28.876 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:28.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.876 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.876 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:28.876 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:28.876 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:28.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.876 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.876 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:28.876 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:28.876 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:28.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.877 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.877 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:28.877 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:28.877 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:28.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.877 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.877 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:28.877 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:28.877 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:28.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.878 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.878 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:28.878 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:28.878 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:28.878 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.878 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.878 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:28.878 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:28.878 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:28.878 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.878 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.879 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:28.879 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:28.879 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:28.879 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.879 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:28.879 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.879 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.879 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.879 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:28.879 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:28.879 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.013921702999994, 2024-04-26T12:06:28.879 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:28.879 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:28.880 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:28.880 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:28.880 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.880 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:28.880 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:28.880 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.880 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.880 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.880 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:28.880 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:28.880 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.880 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.880 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.880 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:28.880 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:28.880 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:28.881 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.881 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.881 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:28.881 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:28.881 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:28.881 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.881 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.881 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:28.881 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:28.881 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:28.881 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.881 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.881 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:28.881 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:28.881 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:28.882 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.882 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.882 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:28.882 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:28.882 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:28.882 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.882 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.882 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:28.882 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:28.882 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:28.882 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.882 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.882 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:28.883 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:28.883 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:28.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.883 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.883 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:28.883 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:28.883 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:28.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.883 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.883 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:28.884 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:28.884 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:28.884 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.884 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.884 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:28.884 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:28.884 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:28.884 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.884 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.884 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:28.884 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:28.884 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:28.884 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.884 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:28.884 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.884 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.885 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.885 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:28.885 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:28.885 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.013046923000005, 2024-04-26T12:06:28.885 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:28.885 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:28.885 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:28.885 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:28.885 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.885 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:28.885 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:28.885 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.885 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.885 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.885 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:28.886 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:28.886 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.886 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.886 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.886 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:28.886 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:28.886 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:28.886 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.886 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.886 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:28.886 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:28.886 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:28.886 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.886 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.886 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:28.887 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:28.887 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:28.887 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.887 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.887 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:28.887 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:28.887 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:28.887 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.887 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.887 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:28.887 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:28.887 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:28.887 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.887 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.887 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:28.888 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:28.888 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:28.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.888 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:28.888 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:28.888 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:28.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.889 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:28.889 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:28.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:28.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.889 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:28.889 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:28.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:28.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.889 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:28.889 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:28.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:28.890 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.890 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.890 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:28.890 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:28.890 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:28.890 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.890 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:28.890 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.890 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.890 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.890 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:28.891 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:28.891 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.013007963999996, 2024-04-26T12:06:28.891 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:28.891 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:28.891 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:28.891 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:28.891 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.891 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:28.891 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:28.891 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.892 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.892 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.892 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:28.892 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:28.892 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.892 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.892 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.892 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:28.892 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:28.892 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:28.892 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.892 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.892 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:28.892 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:28.893 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:28.893 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.893 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.893 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:28.893 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:28.893 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:28.895 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.895 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.895 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:28.895 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:28.895 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:28.895 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.895 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.895 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:28.895 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:28.896 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:28.896 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.896 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.896 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:28.896 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:28.896 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:28.896 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.896 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.896 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:28.896 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:28.896 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:28.896 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.896 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.896 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:28.896 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:28.897 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:28.897 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.897 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.897 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:28.897 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:28.897 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:28.897 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.897 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.898 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:28.898 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:28.898 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:28.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.898 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:28.898 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:28.898 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:28.898 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.898 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:28.898 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.898 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:28.899 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:28.899 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.012972492000003, 2024-04-26T12:06:28.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:28.899 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:28.899 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:28.899 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:28.899 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.899 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:28.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:28.900 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.900 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.900 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.900 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:28.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:28.900 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.901 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.901 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.901 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:28.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:28.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:28.901 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.901 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.901 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:28.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:28.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:28.901 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.901 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.901 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:28.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:28.902 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:28.902 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.902 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.902 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:28.902 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:28.902 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:28.902 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.902 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.902 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:28.902 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:28.902 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:28.902 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.902 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.903 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:28.903 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:28.903 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:28.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.903 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:28.903 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:28.903 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:28.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.903 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:28.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:28.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:28.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.904 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.904 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:28.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:28.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:28.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.904 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.904 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:28.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:28.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:28.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.905 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.905 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:28.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:28.905 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:28.905 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.905 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:28.905 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.012893802999997, 2024-04-26T12:06:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.907 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.907 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.907 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:28.907 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:28.908 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.908 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.908 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.908 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:28.908 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:28.908 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:28.908 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.908 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.908 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:28.908 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:28.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:28.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.909 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:28.909 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:28.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:28.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.910 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:28.910 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:28.910 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:28.910 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.910 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.910 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:28.911 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:28.911 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:28.911 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.911 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.911 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:28.911 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:28.911 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:28.911 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.911 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.911 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:28.911 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:28.912 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:28.912 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.912 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.912 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:28.912 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:28.912 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:28.912 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.912 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.912 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:28.912 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:28.913 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:28.913 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.913 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.913 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:28.913 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:28.913 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:28.913 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.913 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.913 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:28.913 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:28.913 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:28.913 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.914 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:28.914 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.914 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.914 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.914 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:28.914 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:28.914 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.012742954999993, 2024-04-26T12:06:28.914 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:28.914 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:28.914 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:28.914 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:28.915 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.915 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:28.915 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:28.915 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.915 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.915 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.915 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:28.915 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:28.915 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:28.915 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.915 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.916 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:28.916 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:28.916 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:28.916 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.916 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.916 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:28.916 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:28.916 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:28.916 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.916 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.916 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:28.917 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:28.917 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:28.917 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.917 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.917 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:28.917 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:28.917 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:28.917 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.917 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.917 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:28.918 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:28.918 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:28.918 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.918 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.918 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:28.918 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:28.918 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:28.918 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:28.918 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:28.918 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:28.919 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:28.919 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:28.919 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.919 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:28.919 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.919 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:28.919 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:28.919 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:28.921 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:28.919+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:28.921 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:29.022 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:29.020+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:29.027 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:29.027 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:29.027 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:06:29.027 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:29.037 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:29.123 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:29.122+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:29.138 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:29.138 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:29.138 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:29.138 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:29.138 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:29.147 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:29.224 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:29.223+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:29.252 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:29.252 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:29.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:29.252 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:29.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.253 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:29.253 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:29.253 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 85.469874075000007, 2024-04-26T12:06:29.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:06:29.253 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:29.253 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.253 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:29.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.253 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:29.253 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:29.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:29.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:29.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:29.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:06:29.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:29.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:29.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:06:29.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:06:29.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:29.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:06:29.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:06:29.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:06:29.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:06:29.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:29.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:06:29.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:06:29.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:29.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:29.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:06:29.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:29.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:06:29.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:06:29.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:29.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:06:29.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:06:29.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:06:29.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:06:29.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:29.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:06:29.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:06:29.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:29.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:06:29.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:06:29.259 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.259 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:29.260 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.260 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:29.260 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:29.260 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 85.469818755000006, 2024-04-26T12:06:29.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:06:29.260 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:29.260 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.260 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:29.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:29.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:29.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:29.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:29.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:29.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:06:29.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:29.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:29.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:06:29.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:06:29.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:29.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:06:29.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:06:29.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:06:29.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:06:29.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:29.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:06:29.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:06:29.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:29.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:06:29.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:06:29.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:29.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:06:29.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:06:29.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:29.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:06:29.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:06:29.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:06:29.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:06:29.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:29.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:06:29.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:06:29.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:29.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:06:29.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:06:29.265 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.265 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:29.265 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.266 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:29.266 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:29.266 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 85.469768736999995, 2024-04-26T12:06:29.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:06:29.266 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:29.266 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.266 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:29.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:29.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:29.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:29.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:29.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:29.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:06:29.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.268 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:29.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:06:29.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:06:29.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.268 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:29.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:06:29.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:06:29.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:06:29.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:06:29.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:29.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:06:29.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:06:29.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:29.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:06:29.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:06:29.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:29.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:06:29.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:06:29.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:29.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:06:29.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:06:29.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:06:29.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:06:29.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:29.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:06:29.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:06:29.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:29.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:06:29.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:06:29.271 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.271 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:29.271 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.272 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.272 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:29.273 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:29.273 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 85.469734099999997, 2024-04-26T12:06:29.273 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:06:29.273 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:29.273 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.273 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:29.273 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.274 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:29.274 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:29.274 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.274 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.274 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.274 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:29.274 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:29.274 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.274 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.274 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.274 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:29.274 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:06:29.274 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.274 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.275 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.275 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:29.275 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:06:29.275 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:06:29.275 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.275 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.275 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:29.275 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:29.275 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:06:29.275 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.275 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.275 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.275 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:06:29.275 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:06:29.275 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.276 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.276 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:29.276 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:06:29.276 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:06:29.276 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.276 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.276 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:29.276 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:06:29.276 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:06:29.276 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.276 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.276 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:29.276 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:06:29.277 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:06:29.277 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.277 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.277 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.277 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:06:29.277 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:06:29.277 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.277 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.277 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:29.277 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:06:29.278 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:06:29.278 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.278 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.278 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:29.278 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:06:29.278 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:06:29.278 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.278 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.279 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:29.279 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:06:29.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:06:29.279 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.279 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:29.279 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.279 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.279 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.279 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:29.279 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:29.279 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 85.469695587999993, 2024-04-26T12:06:29.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:06:29.279 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:29.279 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.279 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:29.280 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.280 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:29.280 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:29.280 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.280 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.280 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.280 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:29.280 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:29.280 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.280 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.280 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.280 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:29.280 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:29.280 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:29.280 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.281 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:29.281 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:29.281 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:06:29.281 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.281 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:29.281 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:06:29.281 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:06:29.281 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.281 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.281 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:06:29.281 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:06:29.281 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:29.282 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:06:29.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:06:29.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:29.282 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:06:29.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:06:29.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:29.282 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:06:29.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:06:29.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:06:29.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:06:29.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:29.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:06:29.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:06:29.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:29.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:06:29.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:06:29.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.284 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:29.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:06:29.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:06:29.284 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.284 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:29.284 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.284 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.284 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:29.284 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:29.284 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 85.469665265000003, 2024-04-26T12:06:29.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:06:29.284 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:29.285 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.285 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:29.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.285 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:29.285 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:29.285 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.285 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.285 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:29.285 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:29.285 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.285 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.286 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:29.286 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:06:29.286 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.286 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.286 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.286 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:29.286 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:06:29.286 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:06:29.286 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.286 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.286 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:29.286 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:06:29.286 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:06:29.286 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:06:29.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:06:29.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:29.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:06:29.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:06:29.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:29.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:06:29.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:06:29.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:29.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:06:29.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:06:29.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:29.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:06:29.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:06:29.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:06:29.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:06:29.289 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.289 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.289 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:29.289 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:06:29.289 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:06:29.289 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.289 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.289 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:29.289 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:06:29.289 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:06:29.289 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.289 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:29.289 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.289 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.289 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.290 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:29.290 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:29.290 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 85.469638563000004, 2024-04-26T12:06:29.290 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:06:29.290 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:29.290 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:29.290 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:29.290 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.290 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:29.290 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:29.290 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.290 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.290 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.290 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:29.291 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:29.291 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.291 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.291 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:29.291 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:29.291 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.291 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.291 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:29.291 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:06:29.291 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:06:29.291 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.291 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:29.292 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:06:29.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:06:29.292 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.292 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.292 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.292 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:06:29.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:06:29.292 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.293 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.293 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:29.293 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:06:29.293 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:06:29.293 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.293 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.293 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:29.293 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:06:29.293 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:06:29.293 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.294 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.294 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:29.294 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:06:29.294 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:06:29.294 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.294 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:29.294 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.294 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.294 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.294 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:29.294 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:29.294 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 85.469596272999993, 2024-04-26T12:06:29.294 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:06:29.295 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:29.295 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:29.295 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:29.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:29.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:29.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:29.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:29.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:29.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:29.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:29.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:06:29.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:06:29.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:29.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:06:29.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:06:29.297 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.297 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.297 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.297 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:06:29.297 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:06:29.297 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.297 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.297 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:29.297 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:06:29.297 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:06:29.297 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.297 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.297 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:29.297 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:06:29.297 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:06:29.298 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.298 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.298 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:29.298 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:06:29.298 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:06:29.298 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.298 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:29.298 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.298 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.298 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.298 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:29.298 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:29.299 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 85.469568194999994, 2024-04-26T12:06:29.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:06:29.299 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:29.299 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:29.299 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:29.299 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.299 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:29.299 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:29.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.299 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.299 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.299 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:29.299 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:29.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:29.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:06:29.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:29.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:06:29.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:06:29.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.301 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:29.301 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:06:29.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:06:29.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.301 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.301 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:06:29.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:06:29.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.301 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:29.301 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:06:29.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:06:29.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.302 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:29.302 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:06:29.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:06:29.302 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.302 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:29.302 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:06:29.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:06:29.302 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.302 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:29.302 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.302 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.303 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:29.303 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:29.303 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 85.463572845000002, 2024-04-26T12:06:29.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:06:29.303 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:29.303 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.303 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:29.303 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:29.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:29.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.303 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.303 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:29.304 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:29.304 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.304 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.304 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.304 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:29.304 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:06:29.304 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.304 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.304 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.304 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:29.304 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:06:29.304 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:06:29.304 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.304 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.305 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:29.305 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:06:29.305 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:06:29.305 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.305 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.305 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.305 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:06:29.305 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:06:29.305 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.305 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.305 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:29.305 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:06:29.305 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:06:29.305 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.306 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.306 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:29.306 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:06:29.306 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:06:29.306 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.306 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.306 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:29.306 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:06:29.306 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:06:29.306 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.306 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.306 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:29.306 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:06:29.306 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:06:29.307 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.307 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:29.307 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.307 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.307 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.307 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:29.307 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:29.307 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 85.463503879000001, 2024-04-26T12:06:29.307 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:06:29.307 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:29.307 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.307 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:29.307 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.307 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:29.307 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:29.308 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.308 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.308 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.308 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:29.308 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:29.308 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.308 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.308 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.308 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:29.308 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:06:29.308 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.308 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.308 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.308 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:29.309 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:06:29.309 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:06:29.309 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.309 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.309 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:29.309 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:06:29.309 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:06:29.309 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.309 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.309 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.309 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:06:29.309 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:06:29.309 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:29.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:06:29.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:06:29.310 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:29.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:29.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:06:29.310 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:29.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:06:29.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:06:29.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.311 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:29.311 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:06:29.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:06:29.311 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.311 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:29.311 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.311 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:29.311 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:29.311 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 85.463009516, 2024-04-26T12:06:29.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:06:29.312 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:29.312 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.312 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:29.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.312 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:29.312 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:29.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.312 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.312 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:29.312 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:29.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.312 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:29.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:29.313 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:29.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:06:29.313 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:06:29.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:29.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:06:29.313 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:06:29.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.314 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.314 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:06:29.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:06:29.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.314 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:29.314 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:06:29.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:06:29.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.314 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:29.314 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:06:29.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:06:29.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:29.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:06:29.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:06:29.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:29.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:06:29.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:06:29.315 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.315 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:29.315 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.316 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:29.316 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:29.316 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 85.462971250999999, 2024-04-26T12:06:29.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:06:29.316 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:29.316 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.316 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:29.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:29.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:29.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:29.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:29.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:29.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:29.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:29.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:06:29.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:06:29.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:29.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:06:29.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:06:29.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:06:29.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:06:29.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:29.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:06:29.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:06:29.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:29.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:06:29.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:06:29.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:29.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:06:29.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:06:29.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:29.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:06:29.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:06:29.320 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.320 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:29.320 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.320 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:06:29.320 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:29.320 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 85.462291366000002, 2024-04-26T12:06:29.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:06:29.320 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:29.321 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:29.321 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:29.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:29.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:29.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:29.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:29.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:29.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:29.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:29.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:06:29.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:06:29.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:29.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:06:29.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:06:29.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:06:29.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:06:29.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:29.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:06:29.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:06:29.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:29.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:06:29.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:06:29.324 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.324 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:29.324 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.324 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:29.324 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:29.324 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 85.462262186999993, 2024-04-26T12:06:29.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:06:29.324 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:29.324 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:29.324 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:29.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:29.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:29.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:29.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:29.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:29.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:06:29.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:29.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:06:29.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:06:29.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:29.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:06:29.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:06:29.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:06:29.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:06:29.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:29.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:06:29.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:06:29.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:29.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:06:29.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:06:29.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:29.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:06:29.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:06:29.328 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.328 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:29.328 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.328 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:29.328 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:29.328 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 85.462230375999994, 2024-04-26T12:06:29.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:06:29.328 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:29.328 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:29.328 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:29.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:29.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:29.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.329 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:29.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:29.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.329 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:29.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:29.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:29.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.329 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:29.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:06:29.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:06:29.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:29.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:06:29.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:06:29.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:06:29.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:06:29.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:29.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:06:29.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:06:29.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:29.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:06:29.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:06:29.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:29.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:06:29.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:06:29.331 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.332 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:29.332 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.332 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:29.332 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:29.332 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 85.462209020000003, 2024-04-26T12:06:29.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:06:29.332 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:29.332 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:29.332 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:29.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:29.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:29.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:29.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:29.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:29.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:29.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:29.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:29.334 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:06:29.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:06:29.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.334 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:29.334 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:06:29.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:06:29.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.334 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.334 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:06:29.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:06:29.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.335 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:29.335 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:06:29.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:06:29.335 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.335 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:29.335 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:06:29.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:06:29.335 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.335 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:29.335 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:06:29.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:06:29.335 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.335 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:29.336 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.336 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:06:29.336 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:29.336 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 85.462180567000004, 2024-04-26T12:06:29.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:06:29.336 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:29.336 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:29.336 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:29.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:29.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:29.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:29.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:29.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:29.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:29.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:29.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:06:29.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:06:29.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:29.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:06:29.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:06:29.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:06:29.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:06:29.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:29.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:06:29.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:06:29.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.339 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:29.339 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:06:29.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:06:29.339 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.339 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:29.339 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.339 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:06:29.339 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:29.339 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 85.461458761000003, 2024-04-26T12:06:29.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:06:29.340 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:29.340 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:29.340 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:29.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:29.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:29.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:29.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:29.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:29.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:06:29.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:29.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:29.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:06:29.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:06:29.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:29.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:06:29.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:06:29.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:06:29.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:06:29.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:29.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:06:29.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:06:29.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:29.343 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:06:29.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:06:29.343 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.343 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:29.343 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.343 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:06:29.343 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:29.343 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 79.744532157999998, 2024-04-26T12:06:29.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:06:29.343 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:29.343 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.343 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:29.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:29.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:29.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:29.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:29.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:29.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:29.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:06:29.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:06:29.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:29.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:06:29.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:06:29.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:29.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:06:29.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:06:29.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:06:29.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:06:29.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:29.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:06:29.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:06:29.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:29.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:06:29.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:06:29.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:29.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:06:29.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:06:29.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:29.347 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:06:29.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:06:29.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.347 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:06:29.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:06:29.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:29.347 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:06:29.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:06:29.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:29.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:29.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:29.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:06:29.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:06:29.348 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.348 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:29.348 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.348 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:29.348 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:29.348 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:29.350 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:29.350 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:29.349+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:29.449 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~12s 2024-04-26T12:06:29.450 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:29.449+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:29.454 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:29.454 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:29.454 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:06:29.454 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:29.458 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-26T12:06:29.464 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:29.551 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:29.550+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:29.565 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:29.566 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:29.566 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:29.566 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:29.566 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:29.574 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:29.652 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:29.651+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:29.719 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:29.719 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:29.719 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:29.719 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:29.720 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.720 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:29.720 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:29.720 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 95.861875237000007, 2024-04-26T12:06:29.720 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:29.720 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:29.720 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.720 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:29.720 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:29.720 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:29.720 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:29.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.721 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:29.721 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.721 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:29.721 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:29.721 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.721 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.721 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:29.722 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:29.722 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.722 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.722 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:29.722 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:29.722 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.723 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:29.723 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:29.723 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:29.723 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.723 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:29.723 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:29.723 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:29.724 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.724 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.724 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.724 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:29.724 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:29.724 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.724 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.724 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:29.724 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:29.724 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:29.724 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.724 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.725 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:29.725 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:29.725 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:29.725 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.725 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.725 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:29.725 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:29.725 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:29.725 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.725 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.725 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:29.725 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:29.725 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:29.725 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.726 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.726 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.726 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:29.726 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:29.726 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.726 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.726 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:29.726 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:29.726 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:29.726 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.726 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.726 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:29.727 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:29.727 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:29.727 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.727 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:29.727 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.727 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.727 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.728 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:29.728 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:29.728 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 95.861769340999999, 2024-04-26T12:06:29.728 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:29.729 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:29.729 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.729 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:29.729 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:29.729 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:29.729 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:29.729 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.729 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:29.729 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.729 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:29.729 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:29.729 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.729 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.729 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.730 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:29.730 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:29.730 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.730 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.730 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.730 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:29.730 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:29.730 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.730 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.730 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.730 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:29.730 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:29.730 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:29.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:29.731 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:29.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:29.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.731 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:29.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:29.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:29.732 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:29.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:29.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.732 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:29.732 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:29.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:29.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.732 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:29.732 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:29.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:29.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:29.733 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:29.733 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:29.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.733 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:29.733 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:29.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:29.733 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:29.733 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:29.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.734 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.734 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:29.734 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:29.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:29.734 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.734 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:29.734 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.734 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.734 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.734 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:29.734 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:29.734 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 95.861754360999996, 2024-04-26T12:06:29.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:29.735 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:29.735 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.735 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:29.735 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:29.735 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:29.735 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:29.735 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.735 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:29.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.735 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:29.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:29.735 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.735 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.736 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:29.736 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:29.736 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.736 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:29.736 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:29.736 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.736 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:29.736 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:29.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:29.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:29.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:29.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:29.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:29.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:29.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:29.738 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:29.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:29.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.738 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.738 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:29.738 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:29.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:29.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.738 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.738 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:29.738 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:29.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:29.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.739 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.739 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:29.739 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:29.739 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:29.739 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.739 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.739 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.739 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:29.739 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:29.739 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.739 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.739 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:29.739 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:29.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:29.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.740 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.740 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:29.740 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:29.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:29.740 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.740 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:29.740 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.740 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.740 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:29.740 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:29.741 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 95.861710486000007, 2024-04-26T12:06:29.741 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:29.741 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:29.741 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.741 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:29.741 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:29.741 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:29.741 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:29.741 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.741 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:29.741 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.741 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:29.741 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:29.741 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.742 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.742 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.742 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:29.742 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:29.742 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.742 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.742 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.742 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:29.742 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:29.742 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.742 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.742 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.742 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:29.742 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:29.743 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:29.743 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.743 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.743 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:29.743 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:29.743 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:29.743 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.743 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.743 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.743 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:29.743 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:29.743 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.743 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.743 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:29.744 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:29.744 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:29.744 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.744 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.744 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:29.744 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:29.744 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:29.744 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.744 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.744 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:29.744 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:29.744 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:29.744 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.744 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.745 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:29.745 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:29.745 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:29.745 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.745 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.745 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.745 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:29.745 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:29.745 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.745 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.745 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:29.745 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:29.745 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:29.745 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.746 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.746 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:29.746 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:29.746 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:29.746 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.746 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:29.746 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.746 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.746 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.746 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:29.746 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:29.746 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 95.861624821999996, 2024-04-26T12:06:29.746 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:29.746 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:29.747 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.747 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:29.747 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:29.747 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:29.747 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:29.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.747 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:29.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.747 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:29.747 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:29.747 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.748 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:29.748 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:29.748 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.748 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.748 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:29.748 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:29.748 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.748 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.748 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:29.748 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:29.748 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:29.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.748 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.749 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:29.749 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:29.749 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:29.749 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.749 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.749 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.749 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:29.749 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:29.749 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.749 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.749 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:29.749 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:29.750 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:29.750 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.750 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.750 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:29.750 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:29.750 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:29.750 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.750 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.750 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:29.750 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:29.751 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:29.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.751 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.751 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:29.751 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:29.751 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:29.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.751 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.751 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.751 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:29.751 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:29.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.751 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.751 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:29.752 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:29.752 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:29.752 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.752 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.752 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:29.752 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:29.752 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:29.752 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.752 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:29.753 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.753 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.753 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:29.753 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:29.753 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.935720536000005, 2024-04-26T12:06:29.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:29.753 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:29.753 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.753 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:29.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.753 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:29.753 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:29.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.754 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.754 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.754 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:29.754 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:29.754 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.754 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.754 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.754 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:29.754 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:29.755 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:29.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.755 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.755 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:29.755 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:29.755 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:29.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.755 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.755 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:29.755 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:29.755 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:29.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.755 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.756 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.756 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:29.756 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:29.756 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.756 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.756 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:29.756 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:29.756 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:29.756 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.756 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.756 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:29.757 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:29.757 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:29.757 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.757 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.757 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:29.757 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:29.757 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:29.757 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.757 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.757 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:29.757 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:29.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:29.758 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.758 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.758 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.758 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:29.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:29.758 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.758 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.758 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:29.758 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:29.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:29.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.759 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:29.759 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:29.759 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:29.763 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.764 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:29.764 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.764 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:29.764 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:29.765 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.935684441000006, 2024-04-26T12:06:29.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:29.765 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:29.765 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.765 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:29.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:29.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:29.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:29.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:29.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:29.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:29.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:29.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:29.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:29.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:29.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:29.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:29.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:29.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:29.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:29.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.768 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.768 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:29.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:29.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:29.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.768 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.768 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:29.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:29.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:29.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:29.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:29.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:29.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:29.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:29.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:29.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:29.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:29.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:29.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:29.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:29.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:29.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:29.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:29.773 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.773 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:29.773 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.773 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:29.774 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:29.774 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.935646757000001, 2024-04-26T12:06:29.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:29.774 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:29.774 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.774 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:29.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:29.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:29.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:29.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:29.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:29.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:29.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:29.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:29.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:29.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:29.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:29.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:29.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:29.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:29.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:29.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:29.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:29.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:29.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:29.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:29.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:29.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:29.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:29.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:29.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:29.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:29.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:29.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:29.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.779 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:29.779 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:29.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:29.779 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.779 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:29.779 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:29.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:29.779 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.779 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:29.779 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.780 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.780 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:29.780 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:29.780 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.935625416999997, 2024-04-26T12:06:29.780 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:29.780 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:29.780 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.780 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:29.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.780 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:29.780 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:29.780 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.780 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:29.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:29.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:29.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:29.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:29.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:29.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:29.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:29.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:29.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:29.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:29.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:29.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:29.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:29.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:29.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:29.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:29.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:29.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:29.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:29.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:29.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.784 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:29.784 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:29.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:29.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.784 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.784 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:29.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:29.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.785 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:29.785 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:29.785 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:29.785 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.785 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.785 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:29.785 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:29.785 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:29.785 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.785 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:29.785 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.786 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.786 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:29.786 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:29.786 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.935603150999995, 2024-04-26T12:06:29.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:29.786 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:29.786 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.786 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:29.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.786 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:29.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:29.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:29.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:29.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:29.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:29.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:29.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:29.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:29.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:29.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:29.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:29.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:29.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:29.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.789 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:29.789 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:29.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:29.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.789 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.789 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:29.789 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:29.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:29.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.789 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.789 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:29.789 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:29.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:29.790 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.790 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.790 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:29.790 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:29.790 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:29.790 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.790 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.790 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.790 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:29.790 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:29.790 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.790 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.791 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:29.791 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:29.791 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:29.791 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.791 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.791 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:29.791 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:29.791 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:29.791 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.791 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:29.791 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.791 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.791 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.791 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:29.792 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:29.792 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.935581529000004, 2024-04-26T12:06:29.792 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:29.792 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:29.792 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.792 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:29.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:29.792 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:29.792 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.792 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:29.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:29.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:29.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:29.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:29.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:29.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:29.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:29.794 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:29.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:29.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.794 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.794 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:29.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:29.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.794 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:29.794 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:29.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:29.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.795 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:29.795 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:29.795 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:29.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.795 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.795 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:29.795 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:29.795 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:29.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.795 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.795 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:29.796 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:29.796 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:29.796 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.796 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.796 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.796 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:29.796 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:29.796 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.796 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.796 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:29.796 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:29.796 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:29.796 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.797 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:29.797 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:29.797 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:29.797 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.797 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:29.797 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.797 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.797 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:29.797 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:29.797 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.935554963000001, 2024-04-26T12:06:29.797 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:29.797 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:29.798 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.798 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:29.798 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.798 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:29.799 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:29.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.799 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.799 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.799 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:29.799 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:29.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:29.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:29.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:29.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:29.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:29.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:29.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:29.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:29.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:29.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:29.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:29.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:29.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:29.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:29.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:29.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:29.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:29.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:29.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:29.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:29.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:29.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:29.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.803 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.803 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:29.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:29.803 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.803 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.803 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:29.803 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:29.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:29.803 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.803 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.803 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:29.803 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:29.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:29.803 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.804 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:29.804 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.804 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.804 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.804 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:29.804 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:29.804 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.935516450999998, 2024-04-26T12:06:29.804 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:29.804 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:29.804 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.804 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:29.804 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.804 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:29.805 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:29.805 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.805 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.805 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.805 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:29.805 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:29.805 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.805 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.805 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.805 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:29.805 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:29.805 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.805 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.805 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:29.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:29.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:29.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:29.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:29.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:29.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:29.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:29.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:29.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:29.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:29.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:29.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:29.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:29.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:29.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:29.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:29.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.808 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.808 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:29.808 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:29.808 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:29.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.808 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.808 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.808 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:29.808 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:29.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.808 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.808 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:29.808 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:29.808 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:29.809 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.809 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.809 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:29.809 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:29.809 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:29.809 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.809 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:29.809 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.809 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.809 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.809 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:29.809 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:29.809 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.935488277999994, 2024-04-26T12:06:29.809 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:29.810 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:29.810 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.810 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:29.810 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.810 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:29.810 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:29.810 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.810 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.810 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.810 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:29.810 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:29.810 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.810 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.810 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.811 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:29.811 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:29.811 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.811 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.811 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.811 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:29.811 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:29.811 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:29.811 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.811 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.811 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:29.811 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:29.811 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:29.811 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.811 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:29.812 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:29.812 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:29.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:29.812 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:29.812 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:29.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:29.812 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:29.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:29.813 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:29.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:29.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:29.813 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:29.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:29.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.813 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:29.814 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:29.814 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.814 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.814 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:29.814 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:29.814 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:29.814 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.814 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.814 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:29.814 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:29.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:29.815 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.815 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:29.815 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.815 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.815 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.815 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:29.815 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:29.815 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.935453714000005, 2024-04-26T12:06:29.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:29.815 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:29.815 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.815 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:29.815 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.816 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:29.816 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:29.816 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.816 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.816 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.816 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:29.816 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:29.816 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.816 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.816 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.816 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:29.816 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:29.816 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.816 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.816 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.817 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:29.818 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:29.818 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:29.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.818 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.818 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:29.818 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:29.818 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:29.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.818 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.818 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.818 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:29.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:29.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:29.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:29.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:29.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:29.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:29.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:29.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:29.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:29.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:29.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.820 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:29.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:29.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:29.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.820 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:29.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:29.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:29.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:29.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:29.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.821 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:29.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:29.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:29.821 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.821 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:29.821 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.821 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.821 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:29.822 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:29.822 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.934578934000001, 2024-04-26T12:06:29.822 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:29.822 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:29.822 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.822 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:29.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.822 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:29.822 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:29.822 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.822 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.823 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:29.823 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:29.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.823 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:29.823 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:29.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:29.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.823 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:29.823 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:29.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:29.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:29.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:29.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:29.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:29.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:29.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:29.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:29.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:29.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:29.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:29.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:29.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:29.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:29.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:29.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:29.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:29.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:29.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:29.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:29.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:29.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:29.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:29.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:29.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:29.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:29.827 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.827 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:29.827 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.827 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:29.827 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:29.827 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.934539975000007, 2024-04-26T12:06:29.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:29.827 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:29.827 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.827 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:29.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:29.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:29.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.828 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.828 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:29.828 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:29.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.828 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.828 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:29.828 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:29.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.828 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.828 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:29.828 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:29.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:29.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.829 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:29.829 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:29.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:29.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.829 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.829 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:29.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:29.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.829 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:29.829 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:29.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:29.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:29.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:29.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:29.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:29.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:29.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:29.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:29.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:29.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:29.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:29.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:29.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:29.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:29.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:29.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:29.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:29.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:29.832 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.832 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:29.832 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.832 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:29.832 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:29.833 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.934504502999999, 2024-04-26T12:06:29.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:29.833 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:29.833 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.833 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:29.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:29.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:29.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:29.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:29.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.834 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.834 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:29.834 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:29.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:29.834 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.834 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:29.834 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:29.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:29.834 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.834 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:29.834 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:29.835 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:29.835 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.835 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.835 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.835 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:29.835 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:29.835 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.835 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.835 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:29.835 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:29.835 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:29.835 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.835 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.835 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:29.836 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:29.836 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:29.836 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.836 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.836 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:29.836 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:29.836 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:29.836 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.836 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.836 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:29.836 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:29.836 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:29.836 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.836 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.836 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:29.837 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:29.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:29.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:29.837 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:29.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:29.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:29.837 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:29.837 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.837 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:29.837 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.838 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.838 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:29.838 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:29.838 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.934425813999994, 2024-04-26T12:06:29.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:29.838 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:29.838 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:29.838 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:29.838 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.838 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:29.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:29.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.839 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:29.839 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:29.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.839 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:29.839 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:29.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:29.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.839 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:29.839 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:29.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:29.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:29.840 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:29.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:29.840 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.840 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:29.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:29.840 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:29.840 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:29.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:29.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.841 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:29.841 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:29.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:29.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.841 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:29.841 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:29.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:29.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.841 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:29.841 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:29.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:29.842 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.842 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:29.842 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:29.842 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:29.842 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.842 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:29.842 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:29.842 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:29.842 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.842 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:29.842 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:29.842 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:29.843 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.843 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:29.843 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.843 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.843 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:29.843 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:29.843 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 85.934274966000004, 2024-04-26T12:06:29.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:29.843 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:29.843 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:29.843 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:29.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:29.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:29.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:29.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:29.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:29.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:29.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:29.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:29.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:29.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:29.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:29.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:29.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:29.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:29.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:29.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:29.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:29.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:29.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:29.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:29.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:29.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:29.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:29.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:29.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:29.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:29.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:29.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:29.846 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.846 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:29.846 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.847 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:29.847 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:29.847 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:29.848 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:29.849 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:29.847+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:29.949 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:29.948+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:29.953 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:29.953 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:29.953 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:06:29.953 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:29.962 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:30.051 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:30.049+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:30.103 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:30.103 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:30.103 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:30.103 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:30.103 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:30.112 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:30.150 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:30.149+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:30.252 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:30.251+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:30.256 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:30.256 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:30.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:30.256 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:30.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.256 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:30.256 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:30.256 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 86.474110369000002, 2024-04-26T12:06:30.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:06:30.256 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:30.256 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:30.256 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:30.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:30.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:30.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:30.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:30.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:30.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:06:30.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:30.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:30.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:06:30.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:06:30.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:30.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:06:30.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:06:30.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:30.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:06:30.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:06:30.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:30.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:06:30.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:06:30.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:30.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:30.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:06:30.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:30.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:06:30.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:06:30.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:30.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:06:30.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:06:30.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:30.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:06:30.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:06:30.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:30.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:06:30.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:06:30.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:30.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:06:30.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:06:30.261 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.261 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:30.261 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.261 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:30.262 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:30.262 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 86.474055049, 2024-04-26T12:06:30.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:06:30.262 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:30.262 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:30.262 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:30.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:30.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:30.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:30.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:30.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:30.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:06:30.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:30.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:30.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:06:30.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:06:30.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:30.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:06:30.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:06:30.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:30.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:06:30.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:06:30.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:30.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:06:30.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:06:30.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:30.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:06:30.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:06:30.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:30.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:06:30.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:06:30.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:30.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:06:30.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:06:30.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:30.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:06:30.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:06:30.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:30.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:06:30.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:06:30.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:30.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:06:30.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:06:30.266 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.266 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:30.266 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.267 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:30.267 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:30.267 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 86.474005031000004, 2024-04-26T12:06:30.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:06:30.267 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:30.267 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:30.267 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:30.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:30.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:30.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:30.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:30.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.268 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:30.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:06:30.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:30.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.268 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:30.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:06:30.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:06:30.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.268 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:30.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:06:30.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:06:30.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:30.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:06:30.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:06:30.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:30.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:06:30.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:06:30.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:30.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:06:30.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:06:30.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:30.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:06:30.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:06:30.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:30.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:06:30.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:06:30.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:30.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:06:30.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:06:30.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:30.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:06:30.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:06:30.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:30.272 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:06:30.272 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:06:30.272 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.272 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:30.272 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.272 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.272 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.272 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:30.272 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:30.272 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 86.473970394000006, 2024-04-26T12:06:30.272 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:06:30.272 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:30.272 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:30.272 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:30.272 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.273 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:30.273 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:30.273 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.273 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.273 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.273 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:30.273 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:30.273 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.273 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.273 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.273 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:30.273 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:06:30.273 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:30.273 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.273 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.273 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:30.274 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:06:30.274 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:06:30.274 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.274 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.274 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:30.274 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:30.274 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:06:30.274 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.274 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.274 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:30.274 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:06:30.274 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:06:30.274 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.274 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.275 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:30.275 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:06:30.275 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:06:30.275 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.275 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.275 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:30.275 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:06:30.275 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:06:30.275 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.275 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.275 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:30.275 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:06:30.275 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:06:30.275 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.275 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.275 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:30.276 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:06:30.276 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:06:30.276 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.276 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.276 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:30.276 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:06:30.276 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:06:30.276 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.276 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.276 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:30.276 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:06:30.276 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:06:30.276 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.276 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.277 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:30.277 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:06:30.277 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:06:30.277 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.277 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:30.277 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.277 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.277 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.277 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:30.277 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:30.278 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 86.473931882000002, 2024-04-26T12:06:30.278 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:06:30.278 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:30.278 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:30.279 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:30.279 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.279 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:30.279 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:30.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.279 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.279 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.279 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:30.279 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:30.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.279 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.279 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.279 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:30.279 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:30.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:30.280 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.280 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.280 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:30.280 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:30.280 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:06:30.280 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.280 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.280 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:30.280 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:06:30.280 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:06:30.280 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.280 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.280 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:30.280 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:06:30.280 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:06:30.281 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.281 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:30.281 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:06:30.281 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:06:30.281 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.281 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:30.281 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:06:30.281 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:06:30.281 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.281 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:30.281 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:06:30.281 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:06:30.281 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:30.282 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:06:30.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:06:30.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:30.282 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:06:30.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:06:30.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:30.282 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:06:30.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:06:30.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:30.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:06:30.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:06:30.283 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.283 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:30.283 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.283 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:30.283 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:30.283 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 86.473901558999998, 2024-04-26T12:06:30.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:06:30.283 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:30.284 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:30.284 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:30.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.284 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:30.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:30.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.284 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.284 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:30.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:30.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.284 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.284 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:30.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:06:30.285 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:30.285 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.285 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:30.285 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:06:30.285 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:06:30.285 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.285 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:30.285 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:06:30.285 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:06:30.285 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.285 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:30.285 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:06:30.286 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:06:30.286 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.286 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.286 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:30.286 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:06:30.286 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:06:30.286 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.286 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.286 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:30.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:06:30.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:06:30.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:30.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:06:30.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:06:30.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:30.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:06:30.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:06:30.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:30.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:06:30.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:06:30.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:30.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:06:30.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:06:30.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:30.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:06:30.289 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:06:30.289 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.289 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:30.289 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.289 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.289 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.289 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:30.289 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:30.289 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 86.473874856999998, 2024-04-26T12:06:30.289 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:06:30.289 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:30.289 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:30.289 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:30.289 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.289 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:30.290 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:30.290 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.290 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.290 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.290 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:30.290 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:30.290 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.290 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.290 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.290 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:30.290 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:30.290 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:30.290 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.290 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.290 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:30.291 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:06:30.291 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:06:30.291 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.291 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:30.291 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:06:30.291 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:06:30.291 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.291 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:30.291 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:06:30.291 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:06:30.291 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.291 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:30.292 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:06:30.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:06:30.292 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.292 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.292 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:30.292 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:06:30.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:06:30.292 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.292 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.292 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:30.292 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:06:30.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:06:30.292 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.292 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:30.292 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.293 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.293 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.293 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:30.293 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:30.293 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 86.473832567000002, 2024-04-26T12:06:30.293 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:06:30.293 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:30.293 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:30.293 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:30.293 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.293 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:30.293 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:30.293 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.293 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.293 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.293 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:30.294 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:30.294 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.294 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.294 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.294 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:30.294 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:30.294 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:30.294 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.294 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.294 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:30.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:06:30.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:06:30.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:30.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:06:30.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:06:30.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:30.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:06:30.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:06:30.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:30.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:06:30.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:06:30.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:30.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:06:30.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:06:30.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:30.297 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:06:30.297 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:06:30.297 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.297 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:30.297 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.298 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.298 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.298 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:30.298 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:30.298 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 86.473804489000003, 2024-04-26T12:06:30.298 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:06:30.298 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:30.298 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:30.298 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:30.298 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.298 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:30.298 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:30.298 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.299 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.299 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.299 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:30.299 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:30.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.299 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.299 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.299 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:30.299 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:06:30.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:30.299 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.299 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.299 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:30.299 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:06:30.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:06:30.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:30.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:06:30.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:06:30.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:30.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:06:30.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:06:30.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:30.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:06:30.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:06:30.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.301 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:30.301 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:06:30.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:06:30.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.301 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:30.301 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:06:30.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:06:30.301 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.301 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:30.301 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.302 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:30.302 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:30.302 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 86.467809138999996, 2024-04-26T12:06:30.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:06:30.302 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:30.302 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:30.302 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:30.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.302 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:30.302 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:30.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.302 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.302 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:30.302 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:30.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.303 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.303 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:30.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:06:30.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:30.303 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.303 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:30.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:06:30.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:06:30.303 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.303 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:30.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:06:30.304 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:06:30.304 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.304 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.304 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:30.304 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:06:30.304 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:06:30.304 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.304 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.304 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:30.304 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:06:30.305 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:06:30.305 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.305 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.305 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:30.305 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:06:30.305 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:06:30.305 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.305 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.306 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:30.306 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:06:30.306 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:06:30.306 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.306 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.306 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:30.306 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:06:30.306 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:06:30.306 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.306 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:30.306 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.307 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.307 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.307 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:30.307 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:30.307 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 86.467740172999996, 2024-04-26T12:06:30.307 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:06:30.307 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:30.307 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:30.308 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:30.308 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.308 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:30.308 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:30.308 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.308 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.308 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.308 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:30.308 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:30.309 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.309 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.309 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.309 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:30.309 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:06:30.309 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:30.309 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:30.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:06:30.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:06:30.310 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:30.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:06:30.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:06:30.310 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:30.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:06:30.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:06:30.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.311 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:30.311 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:06:30.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:06:30.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.311 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:30.311 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:30.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:06:30.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.311 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:30.311 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:06:30.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:06:30.312 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.312 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:30.312 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:06:30.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:06:30.312 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.312 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:30.312 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.312 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.312 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:30.312 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:30.312 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 86.467245809999994, 2024-04-26T12:06:30.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:06:30.312 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:30.313 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:30.313 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:30.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:30.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:30.313 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:30.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:30.313 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:30.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:30.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:30.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.314 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:30.314 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:06:30.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:06:30.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.314 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:30.314 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:06:30.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:06:30.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:30.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:06:30.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:06:30.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:30.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:06:30.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:06:30.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:30.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:06:30.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:06:30.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:30.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:06:30.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:06:30.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:30.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:06:30.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:06:30.316 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.316 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:30.316 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.316 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:30.316 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:30.317 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 86.467207544999994, 2024-04-26T12:06:30.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:06:30.317 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:30.317 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:30.317 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:30.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:30.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:30.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:30.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:30.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:30.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:30.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:30.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:30.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:06:30.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:06:30.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:30.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:06:30.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:06:30.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:30.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:06:30.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:06:30.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:30.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:06:30.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:06:30.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:30.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:06:30.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:06:30.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:30.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:06:30.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:06:30.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:30.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:06:30.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:06:30.320 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.320 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:30.320 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.320 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:06:30.320 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:30.321 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 86.466527659999997, 2024-04-26T12:06:30.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:06:30.321 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:30.321 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:30.321 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:30.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:30.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:30.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:30.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:30.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:30.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:30.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:30.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:30.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:06:30.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:06:30.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:30.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:06:30.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:06:30.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:30.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:06:30.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:06:30.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:30.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:06:30.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:06:30.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:30.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:06:30.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:06:30.323 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.323 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:30.324 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.324 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:30.324 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:30.324 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 86.466498481000002, 2024-04-26T12:06:30.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:06:30.324 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:30.324 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:30.324 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:30.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:30.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:30.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:30.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:30.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:30.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:06:30.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:30.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:30.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:06:30.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:06:30.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:30.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:06:30.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:06:30.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:30.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:06:30.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:06:30.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:30.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:06:30.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:06:30.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:30.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:06:30.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:06:30.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:30.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:06:30.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:06:30.327 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.327 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:30.327 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.327 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:30.327 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:30.328 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 86.466466670000003, 2024-04-26T12:06:30.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:06:30.328 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:30.328 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:30.328 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:30.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:30.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:30.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:30.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:30.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.329 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:30.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:30.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:30.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.329 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:30.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:06:30.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:06:30.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.329 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:30.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:06:30.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:06:30.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:30.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:06:30.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:06:30.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:30.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:06:30.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:06:30.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:30.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:06:30.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:06:30.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:30.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:06:30.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:06:30.331 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.331 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:30.331 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.332 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:30.332 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:30.332 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 86.466445313999998, 2024-04-26T12:06:30.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:06:30.332 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:30.333 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:30.333 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:30.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:30.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:30.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:30.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:30.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:30.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:30.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:30.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.334 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:30.334 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:06:30.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:06:30.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.334 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:30.334 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:06:30.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:06:30.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.334 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:30.335 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:06:30.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:06:30.335 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.335 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:30.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:06:30.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:06:30.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:30.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:06:30.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:06:30.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:30.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:06:30.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:06:30.336 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.336 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:30.336 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.337 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:06:30.337 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:30.337 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 86.466416860999999, 2024-04-26T12:06:30.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:06:30.337 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:30.337 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:30.337 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:30.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:30.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:30.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:30.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:30.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:30.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:30.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:30.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:30.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:06:30.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:06:30.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:30.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:06:30.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:06:30.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:30.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:06:30.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:06:30.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:30.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:06:30.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:06:30.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:30.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:06:30.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:06:30.341 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.341 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:30.341 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.341 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:06:30.341 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:30.341 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 86.465695054999998, 2024-04-26T12:06:30.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:06:30.341 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:30.341 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:30.341 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:30.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:30.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:30.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:30.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:30.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:30.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:06:30.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:30.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.343 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:30.343 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:06:30.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:06:30.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.343 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:30.343 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:06:30.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:06:30.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.343 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:30.343 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:06:30.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:06:30.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:30.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:06:30.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:06:30.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:30.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:06:30.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:06:30.345 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.345 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:30.345 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.345 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:06:30.345 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:30.345 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 80.748768451999993, 2024-04-26T12:06:30.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:06:30.345 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:30.345 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:30.345 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:30.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:30.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:30.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:30.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:30.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:30.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:30.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:06:30.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:06:30.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:30.347 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:06:30.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:06:30.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:30.347 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:06:30.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:06:30.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:30.347 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:06:30.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:06:30.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:30.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:06:30.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:06:30.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:30.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:06:30.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:06:30.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:30.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:06:30.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:06:30.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:30.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:06:30.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:06:30.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:30.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:06:30.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:06:30.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:30.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:06:30.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:06:30.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:30.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:30.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:30.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:06:30.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:06:30.354 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.354 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:30.354 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.354 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:30.354 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:30.355 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:30.357 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:30.358 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:30.355+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:30.457 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:30.456+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:30.468 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:30.468 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:30.468 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:06:30.468 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:30.472 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:06:30.477 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:30.561 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:30.560+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:30.597 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:30.597 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:30.597 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:06:30.615 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:30.616 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:30.618 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:06:30.619 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:06:30.621 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:30.621 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:30.630 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:30.671 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:30.670+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:30.760 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:30.759+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:30.772 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:30.772 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:30.782 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:30.861 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:30.860+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:30.883 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:30.884 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:30.893 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:30.962 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:30.961+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:30.993 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:30.993 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:31.002 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:31.064 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:31.063+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:31.103 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:31.104 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:31.113 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:31.164 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:31.163+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:31.217 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:31.217 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:31.226 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:31.266 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:31.265+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:31.366 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:31.365+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:31.368 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:31.368 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:31.377 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:31.467 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:31.466+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:31.476 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:06:31.478 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:31.479 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:31.488 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:31.568 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:31.567+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:31.590 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:31.590 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:31.599 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:31.669 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:31.668+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:31.701 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:31.701 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:31.709 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:31.770 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:31.769+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:31.810 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:31.811 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:31.820 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:31.870 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:31.869+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:31.923 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:31.924 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:31.933 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:31.971 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:31.970+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:32.073 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:32.072+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:32.075 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:32.075 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:32.085 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:32.174 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:32.173+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:32.228 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:32.228 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:32.238 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:32.282 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:32.281+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:32.340 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:32.340 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:32.350 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:32.376 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:32.375+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:32.468 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-26T12:06:32.477 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:32.476+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:32.494 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:32.494 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:32.503 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:32.578 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:32.577+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:32.604 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:32.604 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:32.614 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:32.619 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:06:32.679 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:32.678+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:32.722 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:32.722 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:32.731 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:32.751 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:32.751 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:32.752 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:06:32.770 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:32.770 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:32.773 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:06:32.773 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:06:32.780 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:32.779+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:32.874 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:32.874 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:32.874 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:32.874 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:32.875 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:32.881 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:32.880+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:32.883 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:32.982 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:32.981+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:32.986 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:32.986 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:32.986 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:32.986 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:32.987 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.987 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:32.987 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:32.987 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 99.129622191999999, 2024-04-26T12:06:32.987 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:32.987 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:32.987 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:32.987 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:32.987 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:32.987 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:32.987 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:32.987 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.987 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:32.988 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.988 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:32.988 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:32.988 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:32.988 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.988 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.988 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:32.988 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:32.988 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:32.988 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.988 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.988 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:32.988 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:32.988 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:32.988 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.989 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.989 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:32.989 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:32.989 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:32.989 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.989 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.989 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:32.989 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:32.989 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:32.989 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.989 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.989 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:32.989 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:32.989 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:32.990 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.990 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.990 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:32.990 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:32.990 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:32.990 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.990 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.990 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:32.990 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:32.990 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:32.990 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.990 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.990 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:32.991 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:32.991 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:32.991 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.991 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.991 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:32.991 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:32.991 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:32.991 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.991 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.991 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:32.991 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:32.991 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:32.991 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.991 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.992 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:32.992 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:32.992 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:32.992 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.992 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.992 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:32.992 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:32.992 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:32.992 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:32.992 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:32.992 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:32.992 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.993 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.993 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:32.993 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:32.993 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 99.129516296000006, 2024-04-26T12:06:32.993 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:32.993 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:32.993 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:32.993 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:32.993 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:32.993 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:32.993 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:32.993 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.993 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:32.994 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.994 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:32.994 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:32.994 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:32.994 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.994 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.994 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:32.994 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:32.994 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:32.994 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.994 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.994 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:32.994 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:32.994 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:32.995 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.995 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.995 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:32.995 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:32.995 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:32.995 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.995 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.995 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:32.995 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:32.995 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:32.995 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.995 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.995 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:32.996 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:32.996 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:32.996 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.996 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.996 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:32.996 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:32.996 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:32.996 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.996 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.996 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:32.996 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:32.996 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:32.996 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.996 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.996 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:32.997 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:32.997 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:32.997 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.997 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.997 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:32.997 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:32.997 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:32.997 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.997 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.997 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:32.997 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:32.997 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:32.997 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.997 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.998 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:32.998 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:32.998 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:32.998 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.998 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.998 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:32.998 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:32.998 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:32.998 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:32.998 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:32.998 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:32.998 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.998 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.998 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:32.999 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:32.999 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 99.129501316000002, 2024-04-26T12:06:32.999 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:32.999 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:32.999 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:32.999 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:32.999 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:32.999 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:32.999 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:32.999 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:32.999 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:32.999 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:32.999 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:32.999 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:33.000 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.000 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.000 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.000 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.000 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:33.000 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.000 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.000 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.000 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.000 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:33.000 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.000 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.000 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.000 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.001 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:33.001 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:33.001 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.001 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.001 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.001 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:33.001 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:33.001 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.001 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.001 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.001 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:33.001 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:33.001 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.001 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.002 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.002 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:33.002 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:33.002 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.002 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.002 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.002 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:33.002 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:33.002 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.002 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.002 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.002 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:33.002 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:33.002 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.003 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.003 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.003 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:33.003 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:33.003 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.003 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.003 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.003 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:33.003 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:33.003 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.003 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.003 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.003 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:33.004 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:33.004 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.004 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.004 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.004 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:33.004 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:33.004 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.004 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.004 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.004 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.004 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.004 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:33.004 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:33.004 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 99.129457441, 2024-04-26T12:06:33.005 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:33.005 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.005 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.005 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:33.005 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:33.005 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:33.005 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:33.005 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.005 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.005 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.005 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.005 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:33.005 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.005 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.005 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.006 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.006 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:33.006 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.006 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.006 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.006 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.006 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:33.006 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.006 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.006 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.006 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.006 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:33.006 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:33.006 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.007 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.007 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.007 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:33.007 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:33.008 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.008 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.008 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.008 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:33.008 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:33.009 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.009 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.009 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.009 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:33.009 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:33.009 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.009 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.009 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.009 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:33.009 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:33.009 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.009 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.009 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.009 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:33.009 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:33.010 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.010 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.010 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.010 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:33.010 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:33.010 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.010 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.010 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.010 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:33.010 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:33.010 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.010 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.010 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.010 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:33.011 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:33.011 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.011 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.011 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.011 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:33.011 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:33.011 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.011 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.011 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.011 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.011 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.011 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:33.011 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:33.011 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 99.129371777000003, 2024-04-26T12:06:33.012 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:33.012 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.012 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.012 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:33.012 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:33.012 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:33.012 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:33.012 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.012 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.012 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.012 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.012 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:33.012 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.012 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.012 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.013 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.013 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:33.013 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.013 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.013 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.013 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.013 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:33.013 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.013 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.013 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.013 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.013 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:33.013 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:33.013 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.014 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.014 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.014 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:33.014 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:33.014 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.014 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.014 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.014 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:33.014 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:33.014 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.014 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.014 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.014 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:33.014 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:33.015 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.015 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.015 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.015 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:33.015 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:33.015 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.015 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.015 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.015 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:33.015 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:33.015 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.015 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.015 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.015 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:33.015 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:33.016 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.016 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.016 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.016 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:33.016 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:33.016 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.016 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.016 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.016 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:33.016 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:33.016 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.016 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.016 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.016 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:33.016 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:33.017 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.017 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.017 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.017 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.017 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.017 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.017 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:33.017 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 89.203467490999998, 2024-04-26T12:06:33.017 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:33.017 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.017 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.017 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.017 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.017 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.017 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:33.018 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.018 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.018 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.018 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.018 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:33.018 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.018 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.018 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.018 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.018 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:33.018 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:33.018 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.018 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.018 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.018 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:33.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:33.019 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.019 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.019 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.019 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:33.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:33.019 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.019 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.019 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.019 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:33.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:33.019 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.019 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.019 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.019 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:33.020 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:33.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.020 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.020 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.020 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:33.020 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:33.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.020 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.020 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.020 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:33.020 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:33.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.020 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.020 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.020 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:33.021 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:33.021 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.021 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.021 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.021 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:33.021 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:33.021 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.021 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.021 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.021 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:33.021 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:33.021 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.021 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.021 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.021 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:33.022 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:33.022 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.022 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.022 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.022 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.022 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.022 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.022 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:33.022 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 89.203431395999999, 2024-04-26T12:06:33.022 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:33.022 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.022 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.022 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.022 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.022 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.023 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:33.023 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.023 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.023 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.023 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.023 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:33.023 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.023 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.023 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.023 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.023 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:33.023 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:33.023 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.023 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.023 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:33.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:33.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:33.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:33.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:33.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:33.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:33.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:33.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:33.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:33.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:33.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:33.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:33.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:33.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:33.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:33.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:33.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:33.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:33.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:33.027 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.027 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.027 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.027 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.027 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:33.027 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 89.203393711999993, 2024-04-26T12:06:33.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:33.027 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.027 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.027 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.028 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:33.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.028 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:33.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.028 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:33.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.029 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:33.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:33.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.029 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:33.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:33.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.029 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:33.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:33.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.030 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.030 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:33.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:33.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.030 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.030 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:33.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:33.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.030 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.030 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:33.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:33.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:33.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:33.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:33.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:33.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:33.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:33.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:33.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:33.032 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.032 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.032 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.032 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.032 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:33.032 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 89.203372372000004, 2024-04-26T12:06:33.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:33.033 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.033 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.033 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:33.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:33.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.034 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:33.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.034 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:33.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:33.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.034 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:33.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:33.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.035 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.035 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:33.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:33.035 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.035 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.035 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.035 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:33.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:33.035 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.035 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.035 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.035 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:33.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:33.035 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:33.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:33.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:33.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:33.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:33.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:33.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:33.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:33.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:33.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:33.038 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.038 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.039 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.039 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.039 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:33.039 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 89.203350106000002, 2024-04-26T12:06:33.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:33.039 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.039 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.039 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.039 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.039 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:33.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.040 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.040 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:33.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.040 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.040 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:33.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.040 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.040 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:33.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:33.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:33.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:33.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:33.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:33.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:33.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:33.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:33.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:33.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:33.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:33.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:33.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:33.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:33.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:33.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:33.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:33.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:33.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:33.044 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.044 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.044 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.044 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.044 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:33.044 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 89.203328483999996, 2024-04-26T12:06:33.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:33.044 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.044 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.044 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:33.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:33.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:33.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.046 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.046 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:33.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:33.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.046 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.046 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.046 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:33.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:33.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.046 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.046 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.046 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:33.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:33.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:33.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:33.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:33.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:33.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:33.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:33.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:33.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:33.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:33.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:33.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:33.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:33.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.049 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.049 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:33.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:33.049 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.049 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.049 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.049 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.049 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:33.049 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 89.203301917999994, 2024-04-26T12:06:33.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:33.049 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.050 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.050 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.050 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.050 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:33.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.050 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.050 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.050 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:33.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.050 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:33.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:33.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:33.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:33.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:33.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:33.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:33.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:33.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:33.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:33.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:33.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.053 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:33.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:33.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.053 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:33.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:33.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.053 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:33.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:33.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.054 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.054 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:33.054 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:33.054 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.054 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.054 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.054 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:33.054 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:33.054 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.054 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.054 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.054 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.054 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.054 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.055 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:33.055 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 89.203263406000005, 2024-04-26T12:06:33.055 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:33.055 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.055 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.055 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.055 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.055 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.055 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:33.055 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.055 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.055 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.055 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.055 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:33.055 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.056 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.056 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:33.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.056 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.056 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:33.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:33.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.056 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.056 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:33.057 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:33.057 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.057 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.057 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.058 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:33.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:33.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.058 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.058 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:33.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:33.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.058 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.058 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:33.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:33.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:33.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:33.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:33.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:33.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:33.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:33.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.060 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.060 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.060 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:33.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:33.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.060 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.060 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.060 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:33.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:33.060 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.060 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.060 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.061 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.061 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:33.061 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 89.203235233000001, 2024-04-26T12:06:33.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:33.061 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.061 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.061 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.061 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.061 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:33.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.061 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.062 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:33.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.062 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.062 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:33.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.062 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.062 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:33.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:33.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:33.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:33.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:33.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:33.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:33.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:33.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:33.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:33.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:33.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:33.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:33.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:33.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:33.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:33.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:33.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:33.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:33.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:33.066 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.066 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.066 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.066 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.066 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:33.066 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 89.203200668999997, 2024-04-26T12:06:33.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:33.066 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.066 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.066 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:33.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:33.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:33.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:33.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:33.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:33.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:33.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:33.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:33.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:33.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:33.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:33.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:33.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:33.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:33.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:33.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:33.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:33.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:33.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:33.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:33.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.071 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:33.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:33.071 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.071 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.071 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.071 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.071 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:33.071 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 89.202325888999994, 2024-04-26T12:06:33.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:33.072 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.072 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.072 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:33.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:33.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.073 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.073 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:33.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:33.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.073 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.073 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:33.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:33.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.073 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.073 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:33.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:33.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:33.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:33.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:33.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:33.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:33.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:33.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.075 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.075 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:33.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:33.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.075 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.075 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:33.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:33.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.075 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.075 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:33.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:33.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:33.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:33.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:33.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:33.076 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.076 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.076 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.076 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.077 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:33.077 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 89.20228693, 2024-04-26T12:06:33.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:33.077 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.077 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.077 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:33.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:33.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:33.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:33.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:33.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:33.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:33.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.079 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.079 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:33.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:33.079 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.079 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.079 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:33.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:33.079 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.079 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.079 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:33.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:33.079 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.080 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.080 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:33.080 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:33.080 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.080 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.080 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:33.080 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:33.080 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.080 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.080 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:33.080 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:33.080 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.081 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.081 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.081 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:33.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:33.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.081 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.081 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.081 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:33.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:33.081 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.081 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.081 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.082 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.082 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.082 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:33.082 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 89.202251458000006, 2024-04-26T12:06:33.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:33.082 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.082 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.082 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.082 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.082 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:33.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.083 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.083 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.083 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:33.083 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.083 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.083 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.083 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:33.083 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.083 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.083 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.083 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:33.084 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:33.084 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.084 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.084 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.084 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:33.084 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:33.084 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.084 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.084 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.084 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:33.084 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:33.084 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.084 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.084 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.084 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:33.085 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:33.085 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.085 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.085 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.085 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:33.085 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:33.085 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.085 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.085 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.085 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:33.085 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:33.085 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.085 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.085 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.085 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:33.086 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:33.086 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.086 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.086 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:33.086 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:33.086 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.086 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.086 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:33.086 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:33.086 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.086 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 89.202172769000001, 2024-04-26T12:06:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.090 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.090 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.090 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:33.090 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:33.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.090 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.090 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.090 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:33.090 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:33.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.090 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.090 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.090 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 89.202021920999996, 2024-04-26T12:06:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.094 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:33.094 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:33.094 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.094 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.094 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:33.094 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:33.094 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.094 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.094 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:33.094 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:33.094 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.096 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:33.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:33.096 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.096 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.096 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.096 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.096 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.096 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:33.098 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:33.098 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:33.097+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:33.198 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:33.197+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:33.202 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:33.203 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:33.203 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:06:33.203 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:33.211 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:33.300 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:33.299+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:33.352 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:33.353 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:33.353 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:33.353 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:33.353 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:33.361 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:33.405 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:33.404+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:33.465 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:33.465 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:33.465 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:33.465 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:33.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.465 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.466 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:33.466 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 89.682796429000007, 2024-04-26T12:06:33.466 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:06:33.466 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:33.466 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.466 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:33.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.466 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:33.466 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:33.466 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.466 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.466 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:33.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:33.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.467 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.467 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:33.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:06:33.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:33.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.467 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.467 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:33.468 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:06:33.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:06:33.468 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.468 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:33.468 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:06:33.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:06:33.468 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.469 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.469 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:06:33.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:06:33.469 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.469 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.469 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:33.469 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:06:33.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:06:33.469 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.469 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.469 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:33.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:33.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:06:33.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:33.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:06:33.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:06:33.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:33.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:06:33.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:06:33.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.471 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.471 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:06:33.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:06:33.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.471 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:33.471 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:06:33.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:06:33.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.472 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:33.472 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:06:33.472 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:06:33.472 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.472 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:33.472 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.472 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.472 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.472 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.472 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:33.472 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 89.682741109000006, 2024-04-26T12:06:33.472 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:06:33.473 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:33.473 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.473 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:33.473 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.473 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:33.473 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:33.473 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.473 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.473 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.473 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:33.473 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:33.473 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.473 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.474 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:33.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:06:33.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:33.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.474 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:33.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:06:33.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:06:33.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:33.475 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:06:33.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:06:33.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.475 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:06:33.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:06:33.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:33.475 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:06:33.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:06:33.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.476 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:33.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:06:33.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:06:33.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.476 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:33.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:06:33.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:06:33.477 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.477 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:33.477 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:06:33.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:06:33.477 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.477 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.477 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:06:33.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:06:33.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.478 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.478 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:33.478 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:06:33.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:06:33.479 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.479 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.479 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:33.479 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:06:33.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:06:33.479 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.479 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:33.479 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.480 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.480 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.480 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:33.480 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 89.682691090999995, 2024-04-26T12:06:33.480 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:06:33.480 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:33.480 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.480 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:33.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.480 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:33.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:33.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:33.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:33.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:33.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:06:33.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:33.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:06:33.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:06:33.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:33.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:06:33.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:06:33.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.483 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.483 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:06:33.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:06:33.483 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.484 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.484 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:33.484 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:06:33.484 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:06:33.484 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.484 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.484 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:33.484 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:06:33.485 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:06:33.485 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.485 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.485 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.485 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:06:33.485 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:06:33.485 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.485 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.486 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:33.486 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:06:33.486 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:06:33.486 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.486 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.486 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.486 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:06:33.486 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:06:33.487 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.488 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.488 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:33.488 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:06:33.488 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:06:33.488 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.488 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.488 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:33.488 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:06:33.489 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:06:33.489 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.489 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:33.489 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.489 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.489 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.489 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.489 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:33.489 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 89.682656453999996, 2024-04-26T12:06:33.489 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:06:33.489 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:33.489 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.489 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:33.489 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.490 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:33.490 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:33.490 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.490 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.490 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:33.490 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:33.490 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.490 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.490 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:33.490 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:06:33.490 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.491 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:33.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:06:33.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:06:33.491 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.491 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:33.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:33.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:06:33.491 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.491 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:06:33.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:06:33.492 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.492 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.492 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:33.492 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:06:33.492 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:06:33.492 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.492 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.492 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:33.492 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:06:33.492 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:06:33.492 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.492 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.492 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.492 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:06:33.492 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:06:33.493 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.493 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.493 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.493 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:06:33.493 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:06:33.493 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.493 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.493 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:33.493 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:06:33.493 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:06:33.493 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.493 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.493 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:33.493 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:06:33.494 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:06:33.494 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.494 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.494 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:33.494 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:06:33.494 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:06:33.494 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.494 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:33.494 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.494 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.494 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.494 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.494 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:33.494 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 89.682617941999993, 2024-04-26T12:06:33.494 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:06:33.495 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:33.495 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.495 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:33.495 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.495 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:33.495 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:33.495 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.495 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.495 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.495 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:33.495 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:33.495 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.495 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.495 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.495 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:33.496 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:33.496 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:33.496 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.496 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.496 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:33.496 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:33.496 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:06:33.496 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.496 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.496 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:33.496 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:06:33.496 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:06:33.496 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.496 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.497 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.497 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:06:33.497 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:06:33.497 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.497 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.497 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:33.497 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:06:33.497 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:06:33.497 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.497 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.497 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:33.497 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:06:33.497 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:06:33.497 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.497 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.498 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:33.498 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:06:33.498 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:06:33.498 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.498 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.498 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.498 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:06:33.498 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:06:33.498 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.498 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.498 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:33.498 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:06:33.498 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:06:33.498 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.499 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.499 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:33.499 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:06:33.499 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:06:33.499 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.499 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.499 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:33.499 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:06:33.499 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:06:33.499 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.499 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:33.499 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.499 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.499 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.500 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.500 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:33.500 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 89.682587619000003, 2024-04-26T12:06:33.500 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:06:33.500 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:33.500 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.500 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:33.500 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.500 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:33.500 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:33.500 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.500 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.500 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.500 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:33.500 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:33.501 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.501 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.501 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.501 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:33.501 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:06:33.501 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.501 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.501 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.501 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:33.501 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:06:33.501 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:06:33.501 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.501 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.501 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:33.502 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:06:33.502 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:06:33.502 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.502 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.502 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.502 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:06:33.502 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:06:33.502 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.502 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.502 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:33.502 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:06:33.502 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:06:33.502 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.502 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.503 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:33.503 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:06:33.503 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:06:33.503 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.503 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.503 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:33.503 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:06:33.503 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:06:33.503 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.503 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.503 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:33.503 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:06:33.503 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:06:33.503 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.504 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.504 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.504 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:06:33.504 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:06:33.504 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.504 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.504 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:33.504 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:06:33.504 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:06:33.504 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.504 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.504 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:33.504 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:06:33.504 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:06:33.504 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.505 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:33.505 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.505 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.505 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.505 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.505 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:33.505 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 89.682560917000004, 2024-04-26T12:06:33.505 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:06:33.505 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:33.505 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:33.506 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:33.506 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.506 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:33.507 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:33.507 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.507 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.507 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.507 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:33.507 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:33.507 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.507 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.507 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.507 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:33.507 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:33.507 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.507 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.507 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.507 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:33.508 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:06:33.508 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:06:33.508 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.508 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.508 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:33.508 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:06:33.508 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:06:33.508 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.508 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.508 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.508 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:06:33.508 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:06:33.508 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.508 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.508 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:33.509 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:06:33.509 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:06:33.509 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.509 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.509 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:33.509 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:06:33.509 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:06:33.509 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.509 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.509 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:33.509 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:06:33.509 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:06:33.509 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.509 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:33.509 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.510 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.510 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.510 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.510 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:33.510 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 89.682518626999993, 2024-04-26T12:06:33.510 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:06:33.510 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:33.510 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:33.510 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:33.510 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.510 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:33.510 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:33.510 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.510 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.511 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.511 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:33.511 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:33.511 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.511 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.511 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.511 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:33.511 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:33.511 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.511 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.511 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.511 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:33.511 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:06:33.511 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:06:33.512 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.512 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.512 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:33.512 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:06:33.512 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:06:33.512 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.512 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.512 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.512 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:06:33.512 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:06:33.512 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.512 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.512 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:33.512 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:06:33.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:06:33.513 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.513 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:33.513 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:06:33.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:06:33.513 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.513 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:33.513 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:06:33.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:06:33.513 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.513 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:33.513 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.513 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.514 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.514 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:33.514 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 89.682490548999994, 2024-04-26T12:06:33.514 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:06:33.514 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:33.514 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:33.514 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:33.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.515 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:33.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:33.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.515 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:33.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:33.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.515 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:33.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:06:33.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.516 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:33.516 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:06:33.516 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:06:33.516 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.516 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:33.516 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:06:33.516 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:06:33.516 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.516 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.517 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:06:33.517 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:06:33.517 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.517 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.517 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:33.517 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:06:33.517 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:06:33.517 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.517 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.517 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:33.517 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:06:33.517 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:06:33.517 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.517 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.517 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:33.518 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:06:33.518 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:06:33.518 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.518 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:33.518 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.518 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.518 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.518 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:33.518 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:33.518 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 89.676495199000001, 2024-04-26T12:06:33.518 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:06:33.518 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:33.518 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.518 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:33.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:33.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:33.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:33.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:33.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:33.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:06:33.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:33.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:06:33.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:06:33.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:33.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:06:33.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:06:33.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:06:33.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:06:33.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:33.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:06:33.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:06:33.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:33.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:06:33.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:06:33.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:33.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:06:33.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:06:33.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.522 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:33.522 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:06:33.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:06:33.522 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.522 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:33.522 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.522 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:33.522 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:33.522 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 89.676426233000001, 2024-04-26T12:06:33.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:06:33.523 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:33.523 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.523 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:33.523 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.523 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:33.523 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:33.523 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.523 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.523 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.523 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:33.524 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:33.524 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.524 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.524 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.525 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:33.525 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:06:33.525 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.525 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.525 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:33.525 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:06:33.525 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:06:33.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.525 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.525 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:33.525 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:06:33.525 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:06:33.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:06:33.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:06:33.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:33.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:06:33.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:06:33.527 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.527 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.527 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:33.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:33.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:06:33.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:33.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:06:33.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:06:33.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:33.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:06:33.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:06:33.528 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.528 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:33.528 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.529 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:33.529 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:33.529 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 89.675931869999999, 2024-04-26T12:06:33.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:06:33.529 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:33.529 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.529 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:33.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.529 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:33.529 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:33.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.530 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:33.530 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:33.530 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.530 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.530 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:33.530 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:33.530 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.530 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.530 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:33.530 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:06:33.530 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:06:33.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:33.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:06:33.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:06:33.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:06:33.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:06:33.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:33.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:06:33.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:06:33.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:33.532 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:06:33.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:06:33.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:33.532 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:06:33.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:06:33.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:33.532 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:06:33.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:06:33.533 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.533 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:33.533 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.533 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.533 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.533 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:33.533 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:33.533 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 89.675893604999999, 2024-04-26T12:06:33.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:06:33.533 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:33.533 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.533 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:33.534 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:33.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:33.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.534 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:33.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:33.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:33.535 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:33.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:33.535 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:06:33.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:06:33.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:33.535 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:06:33.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:06:33.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:06:33.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:06:33.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:33.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:06:33.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:06:33.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:33.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:06:33.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:06:33.537 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.537 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:33.537 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:06:33.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:06:33.537 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.537 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:33.537 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:06:33.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:06:33.537 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.537 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:33.537 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.537 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.537 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:06:33.538 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:33.538 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 89.675213720000002, 2024-04-26T12:06:33.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:06:33.538 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:33.538 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:33.538 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:33.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:33.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:33.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:33.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:33.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.539 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:33.539 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:33.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.539 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:33.539 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:06:33.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:06:33.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.539 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:33.540 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:06:33.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:06:33.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.540 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.540 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:06:33.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:06:33.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.540 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:33.540 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:06:33.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:06:33.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:33.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:06:33.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:06:33.541 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.541 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:33.541 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.541 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:33.541 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:33.541 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 89.675184540999993, 2024-04-26T12:06:33.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:06:33.541 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:33.542 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:33.542 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:33.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:33.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:33.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:33.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:33.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:33.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:06:33.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:33.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:06:33.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:06:33.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:33.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:06:33.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:06:33.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.544 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:06:33.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:06:33.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.544 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:33.544 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:06:33.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:06:33.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.544 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:33.544 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:06:33.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:06:33.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.545 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:33.545 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:06:33.545 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:06:33.545 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.545 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:33.545 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.545 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.545 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.546 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:33.546 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:33.546 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 89.675152729999994, 2024-04-26T12:06:33.546 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:06:33.546 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:33.546 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:33.547 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:33.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:33.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:33.547 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:33.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:33.547 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:33.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:33.547 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:33.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.548 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.548 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:33.548 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:06:33.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:06:33.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.548 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.548 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:33.548 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:06:33.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:06:33.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.548 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.548 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.548 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:06:33.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:06:33.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.549 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:33.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:06:33.549 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:06:33.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.549 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:33.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:06:33.549 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:06:33.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.549 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:33.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:06:33.549 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:06:33.550 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.550 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:33.550 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.550 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.550 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.550 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:33.550 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:33.550 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 89.675131374000003, 2024-04-26T12:06:33.550 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:06:33.550 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:33.550 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:33.550 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:33.550 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.550 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:33.550 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:33.551 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.551 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.551 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.551 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:33.551 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:33.551 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.551 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.551 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.551 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:33.552 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:33.552 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:33.552 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.552 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.552 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:33.552 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:06:33.552 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:06:33.552 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.552 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.552 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:33.552 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:06:33.552 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:06:33.552 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.552 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.553 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.553 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:06:33.553 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:06:33.553 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.553 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.553 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:33.553 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:06:33.553 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:06:33.553 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.553 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.553 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:33.553 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:06:33.553 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:06:33.553 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.553 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.554 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:33.554 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:06:33.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:06:33.554 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.554 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:33.554 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.554 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.554 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.554 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:06:33.554 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:33.554 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 89.675102921000004, 2024-04-26T12:06:33.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:06:33.554 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:33.554 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:33.554 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:33.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.555 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:33.555 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:33.555 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.555 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.555 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:33.555 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:33.555 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.555 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.555 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:33.555 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:33.555 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.555 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.556 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.556 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:33.556 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:06:33.556 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:06:33.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.556 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.556 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:33.556 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:06:33.556 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:06:33.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.556 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.556 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.556 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:06:33.556 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:06:33.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.557 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.557 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:33.557 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:06:33.557 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:06:33.557 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.557 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.557 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:33.557 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:06:33.557 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:06:33.557 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.557 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:33.557 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.557 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.557 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.557 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:06:33.557 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:33.558 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 89.674381115000003, 2024-04-26T12:06:33.558 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:06:33.558 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:33.558 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:33.558 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:33.558 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.558 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:33.558 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:33.558 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.558 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.558 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.558 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:33.559 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:33.559 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.559 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.559 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.559 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:33.559 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:06:33.559 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:33.559 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.559 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.559 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:33.559 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:06:33.559 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:06:33.559 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.560 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.560 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:33.560 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:06:33.560 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:06:33.560 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.560 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.560 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.560 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:06:33.560 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:06:33.560 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.560 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.560 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:33.560 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:06:33.560 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:06:33.560 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.561 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.561 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:33.561 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:06:33.561 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:06:33.561 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.561 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:33.561 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.561 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.561 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.561 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:06:33.561 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:33.561 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 83.957454511999998, 2024-04-26T12:06:33.561 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:06:33.561 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:33.561 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.562 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:33.562 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.562 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:33.562 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:33.562 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.562 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.562 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.562 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:33.562 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:33.562 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:33.562 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.562 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.562 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:33.562 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:06:33.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:06:33.563 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.563 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.563 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:33.563 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:06:33.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:06:33.563 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.563 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.563 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:33.563 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:06:33.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:06:33.563 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.563 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.563 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.563 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:06:33.564 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:06:33.564 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.564 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.564 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:33.564 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:06:33.564 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:06:33.564 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.564 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.564 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:33.564 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:06:33.564 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:06:33.564 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.564 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.564 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:33.564 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:06:33.565 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:06:33.565 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.565 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.565 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:33.565 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:06:33.565 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:06:33.565 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.565 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.565 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.565 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:06:33.565 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:06:33.565 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.565 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.565 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:33.565 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:06:33.566 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:06:33.566 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:33.566 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:33.566 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:33.566 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:06:33.566 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:06:33.566 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.566 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:33.566 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.566 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:33.567 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:33.567 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:33.568 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:33.569 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:33.567+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:33.669 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:33.668+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:33.675 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:33.676 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:33.676 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:06:33.676 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:33.685 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:33.770 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:33.769+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:33.827 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:33.828 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:33.828 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:33.828 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:33.828 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:33.836 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:33.871 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:33.870+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:33.941 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:33.941 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:33.941 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:33.941 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:33.941 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.941 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:33.941 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:33.941 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 100.08398581900001, 2024-04-26T12:06:33.942 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:33.942 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.942 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.942 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:33.942 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:33.942 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:33.942 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:33.942 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.942 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.942 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.942 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.942 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:33.942 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.942 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.943 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.943 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.943 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:33.943 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.943 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.943 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.943 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.943 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:33.943 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.943 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.943 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.943 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.943 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:33.943 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:33.944 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.944 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.944 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.944 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:33.944 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:33.944 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.944 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.944 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.944 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:33.944 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:33.944 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.944 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.944 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.944 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:33.944 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:33.945 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.945 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.945 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.945 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:33.945 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:33.945 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.945 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.945 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.945 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:33.945 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:33.945 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.945 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.945 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.945 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:33.945 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:33.946 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.946 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.946 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.946 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:33.946 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:33.946 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.946 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.946 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.946 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:33.946 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:33.946 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.946 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.946 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.947 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:33.947 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:33.947 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.947 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.947 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.947 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.947 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.947 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:33.947 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:33.947 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 100.083879923, 2024-04-26T12:06:33.947 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:33.947 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.947 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.947 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:33.947 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:33.948 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:33.948 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:33.948 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.948 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.948 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.948 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.948 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:33.948 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.948 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.948 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.948 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.948 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:33.948 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.948 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.949 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.949 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.949 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:33.949 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.949 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.949 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.949 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.949 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:33.949 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:33.949 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.949 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.949 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.949 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:33.950 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:33.950 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.950 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.950 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.950 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:33.950 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:33.950 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.950 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.950 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.950 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:33.950 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:33.950 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.950 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.950 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.951 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:33.951 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:33.951 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.951 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.951 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.951 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:33.951 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:33.951 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.951 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.951 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.951 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:33.951 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:33.951 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.951 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.951 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.952 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:33.952 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:33.952 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.952 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.952 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.952 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:33.952 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:33.952 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.952 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.952 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.952 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:33.952 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:33.952 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.952 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.952 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.953 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.953 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.953 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:33.953 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:33.953 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 100.08386494299999, 2024-04-26T12:06:33.953 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:33.953 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.953 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.953 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:33.953 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:33.953 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:33.953 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:33.953 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.953 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.954 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.954 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.954 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:33.954 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.954 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.954 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.954 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.954 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:33.954 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.954 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.954 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.954 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.955 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:33.955 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.955 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.955 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.955 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.955 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:33.955 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:33.955 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.955 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.955 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.955 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:33.955 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:33.955 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.955 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.956 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.956 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:33.956 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:33.956 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.956 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.956 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.956 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:33.956 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:33.956 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.956 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.956 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.956 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:33.956 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:33.956 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.956 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.957 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.957 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:33.957 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:33.957 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.957 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.957 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.957 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:33.957 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:33.957 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.957 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.957 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.957 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:33.957 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:33.957 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.958 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.958 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.958 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:33.958 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:33.958 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.958 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.958 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.958 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:33.958 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:33.958 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.958 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.958 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.958 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.958 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.959 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:33.959 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:33.959 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 100.08382106800001, 2024-04-26T12:06:33.959 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:33.959 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.959 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.959 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:33.959 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:33.959 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:33.959 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:33.959 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.959 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.959 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.959 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.959 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:33.960 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.960 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.960 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.960 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.960 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:33.960 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.960 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.960 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.960 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.960 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:33.960 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.960 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.960 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.960 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.961 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:33.961 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:33.961 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.961 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.961 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.961 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:33.961 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:33.961 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.961 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.961 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.961 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:33.961 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:33.961 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.961 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.962 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.962 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:33.962 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:33.962 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.962 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.962 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.962 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:33.962 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:33.962 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.962 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.962 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.962 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:33.962 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:33.962 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.963 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.963 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.963 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:33.963 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:33.963 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.963 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.963 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.963 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:33.963 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:33.963 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.963 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.963 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.963 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:33.963 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:33.963 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.964 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.964 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.964 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:33.964 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:33.964 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.964 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.964 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.964 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.964 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.964 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:33.964 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:33.964 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 100.083735404, 2024-04-26T12:06:33.964 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:33.964 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.964 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.965 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:33.965 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:33.965 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:33.965 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:33.965 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.965 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.965 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.965 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.965 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:33.965 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.965 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.965 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.965 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.965 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:33.966 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.966 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.966 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.966 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.966 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:33.966 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.966 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.966 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.966 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.966 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:33.966 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:33.966 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.966 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.966 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.967 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:33.967 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:33.967 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.967 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.967 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.967 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:33.967 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:33.967 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.967 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.967 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.967 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:33.967 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:33.967 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.967 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.968 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.968 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:33.968 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:33.968 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.968 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.968 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.968 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:33.968 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:33.968 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.968 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.968 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.968 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:33.968 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:33.969 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.969 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.969 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.969 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:33.969 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:33.969 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.969 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.969 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.969 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:33.969 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:33.969 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.969 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.969 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.969 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:33.970 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:33.970 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.970 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.970 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.970 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.970 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.970 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.970 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:33.970 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 90.157831118000004, 2024-04-26T12:06:33.970 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:33.970 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.970 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.970 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.971 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.971 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.971 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:33.971 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.971 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.971 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.971 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.971 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:33.971 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.971 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.971 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.971 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.971 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:33.971 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:33.971 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.972 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.972 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.972 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:33.972 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:33.972 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.972 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.972 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.972 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:33.972 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:33.972 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.972 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.972 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.972 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:33.972 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:33.973 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.973 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.973 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.973 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:33.973 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:33.973 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.973 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.973 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.973 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:33.973 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:33.973 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.973 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.973 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.973 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:33.974 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:33.974 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.974 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.974 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.974 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:33.974 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:33.974 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.974 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.974 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.974 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:33.974 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:33.974 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.974 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.974 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.974 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:33.975 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:33.975 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.975 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.975 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.975 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:33.975 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:33.975 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.975 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.975 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.975 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.975 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.975 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.975 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:33.975 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 90.157795023000006, 2024-04-26T12:06:33.975 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:33.976 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.976 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.976 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.976 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.976 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.976 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:33.976 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.976 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.976 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.976 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.976 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:33.976 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.976 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.976 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.976 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.977 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:33.977 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:33.977 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.977 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.977 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.977 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:33.977 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:33.977 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.977 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.977 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.977 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:33.977 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:33.977 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.977 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.978 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.978 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:33.978 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:33.978 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.978 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.978 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.978 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:33.978 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:33.978 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.978 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.978 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.978 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:33.978 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:33.978 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.978 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.979 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.979 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:33.979 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:33.979 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.979 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.979 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.979 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:33.979 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:33.979 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.979 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.979 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.979 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:33.979 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:33.979 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.979 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.980 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.980 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:33.980 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:33.980 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.980 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.980 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.980 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:33.980 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:33.980 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.980 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.980 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.980 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.980 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.980 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.981 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:33.981 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 90.157757339, 2024-04-26T12:06:33.981 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:33.981 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.981 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.981 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.981 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.981 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.981 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:33.981 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.981 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.981 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.981 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.981 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:33.982 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.982 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.982 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.982 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.982 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:33.982 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.982 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.982 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.982 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.982 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:33.982 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:33.982 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.982 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.982 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.983 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:33.983 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:33.983 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.983 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.983 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.983 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:33.983 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:33.983 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.983 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.983 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.983 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:33.983 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:33.983 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.983 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.983 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.984 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:33.984 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:33.984 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.984 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.984 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.984 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:33.984 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:33.984 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.984 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.984 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.984 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:33.984 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:33.984 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.984 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.984 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.985 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:33.985 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:33.985 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.985 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.985 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.985 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:33.985 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:33.985 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.985 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.985 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.985 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:33.985 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:33.985 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.985 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.985 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.986 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.986 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.986 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.986 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:33.986 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 90.157735998999996, 2024-04-26T12:06:33.986 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:33.986 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.986 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.986 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.986 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.986 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.986 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:33.986 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.986 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.987 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.987 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.987 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:33.987 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.987 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.987 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.987 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.987 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:33.987 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.987 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.987 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.987 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.987 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:33.987 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:33.987 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.988 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.988 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.988 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:33.988 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:33.988 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.988 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.988 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.988 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:33.988 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:33.988 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.988 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.988 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.988 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:33.988 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:33.989 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.989 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.989 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.989 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:33.989 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:33.989 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.989 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.989 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.989 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:33.989 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:33.989 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.989 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.989 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.989 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:33.989 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:33.990 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.990 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.990 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.990 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:33.990 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:33.990 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.990 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.990 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.990 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:33.990 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:33.990 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.990 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.990 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.990 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:33.990 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:33.991 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.991 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.991 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.991 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.991 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.991 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.991 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:33.991 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 90.157713732999994, 2024-04-26T12:06:33.991 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:33.991 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.991 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.991 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.991 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.991 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.991 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:33.992 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.992 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.992 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.992 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.992 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:33.992 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.992 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.992 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.992 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.992 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:33.992 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.992 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.992 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.992 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.993 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:33.993 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:33.993 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.993 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.993 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.993 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:33.993 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:33.993 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.993 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.993 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.993 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:33.993 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:33.993 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.993 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.993 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.994 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:33.994 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:33.994 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.994 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.994 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.994 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:33.994 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:33.994 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.994 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.994 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:33.994 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:33.994 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:33.994 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.995 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.995 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:33.995 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:33.995 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:33.995 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.995 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.995 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:33.995 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:33.995 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:33.995 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.995 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.995 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:33.995 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:33.995 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:33.996 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.996 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.996 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:33.996 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:33.996 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:33.996 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.996 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:33.996 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:33.996 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.996 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.996 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:33.996 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:33.996 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 90.157692111000003, 2024-04-26T12:06:33.996 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:33.996 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:33.997 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:33.997 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:33.997 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.997 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:33.997 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:33.997 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.997 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.997 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.997 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:33.997 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:33.997 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:33.997 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.997 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.997 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:33.997 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:33.998 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:33.998 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.998 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.998 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:33.998 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:33.998 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:33.998 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.998 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.998 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:33.998 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:33.998 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:33.998 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.998 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.998 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:33.999 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:33.999 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:33.999 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.999 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.999 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:33.999 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:33.999 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:33.999 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.999 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:33.999 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:33.999 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:33.999 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:33.999 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:33.999 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.000 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.000 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:34.000 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:34.000 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.000 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.000 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.000 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:34.000 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:34.000 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.000 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.000 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.000 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:34.000 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:34.000 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.000 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.001 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.001 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:34.001 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:34.001 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.001 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.001 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.001 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:34.001 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:34.001 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.001 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.001 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.001 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.001 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.001 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.001 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:34.002 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 90.157665545, 2024-04-26T12:06:34.002 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:34.002 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.002 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.002 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.002 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.002 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.002 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:34.002 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.002 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.002 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.002 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.002 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:34.002 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.003 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.003 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.003 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.003 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:34.003 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.003 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.003 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.003 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.003 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:34.003 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:34.003 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.003 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.003 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.003 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:34.004 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:34.004 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.004 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.004 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.004 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:34.004 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:34.004 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.004 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.004 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.004 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:34.004 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:34.004 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.004 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.004 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.004 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:34.005 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:34.005 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.005 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.005 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.005 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:34.005 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:34.005 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.005 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.005 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.005 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:34.005 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:34.005 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.005 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.005 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.005 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:34.006 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:34.006 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.006 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.006 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.006 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:34.006 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:34.006 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.006 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.006 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.006 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:34.006 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:34.006 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.006 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.006 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.007 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.007 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.007 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.007 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:34.007 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 90.157627032999997, 2024-04-26T12:06:34.007 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:34.007 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.007 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.007 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.007 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.007 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.007 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:34.007 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.007 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.008 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.008 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.008 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:34.008 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.008 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.008 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.008 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.008 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:34.008 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.008 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.008 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.008 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.008 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:34.008 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:34.008 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.009 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.009 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.009 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:34.009 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:34.009 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.009 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.009 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.009 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:34.009 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:34.009 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.009 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.009 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.009 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:34.009 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:34.010 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.010 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.010 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.010 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:34.010 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:34.010 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.010 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.010 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.010 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:34.010 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:34.010 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.010 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.010 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.010 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:34.011 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:34.011 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.011 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.011 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.011 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:34.011 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:34.011 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.011 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.011 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.011 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:34.011 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:34.011 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.012 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.012 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.012 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:34.012 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:34.012 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.012 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.012 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.012 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.012 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.012 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.012 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:34.012 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 90.157598859999993, 2024-04-26T12:06:34.012 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:34.012 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.013 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.013 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.013 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.013 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.013 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:34.013 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.013 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.013 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.013 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.013 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:34.013 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.014 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.014 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.014 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.014 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:34.014 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.014 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.014 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.014 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.014 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:34.014 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:34.015 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.015 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.015 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.015 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:34.015 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:34.015 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.015 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.015 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.015 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:34.015 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:34.015 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.015 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.017 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.017 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:34.017 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:34.017 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.017 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.017 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.017 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:34.017 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:34.018 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.018 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.018 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.018 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:34.018 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:34.018 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.018 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.018 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.018 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:34.018 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:34.018 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.018 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.018 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.019 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:34.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:34.019 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.019 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.019 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.019 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:34.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:34.019 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.019 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.019 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.019 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:34.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:34.019 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.019 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.019 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.020 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.020 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.020 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:34.020 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 90.157564296000004, 2024-04-26T12:06:34.020 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:34.020 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.020 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.020 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.020 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.020 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.020 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:34.020 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.021 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.021 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.021 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:34.021 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.021 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.021 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.021 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.021 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:34.021 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.021 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.021 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.021 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.021 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:34.022 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:34.022 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.022 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.022 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.022 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:34.022 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:34.022 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.022 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.022 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.022 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:34.022 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:34.022 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.022 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.022 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.023 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:34.023 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:34.023 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.023 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.023 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.023 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:34.023 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:34.023 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.023 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.023 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.023 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:34.023 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:34.023 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.023 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:34.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:34.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:34.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:34.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:34.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:34.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:34.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:34.025 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.025 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.025 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.025 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.025 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:34.025 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 90.156689516, 2024-04-26T12:06:34.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:34.025 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.025 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.026 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:34.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:34.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:34.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:34.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:34.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:34.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:34.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:34.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:34.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:34.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.028 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:34.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:34.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.028 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:34.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:34.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.028 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:34.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:34.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.029 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:34.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:34.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.029 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:34.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:34.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.029 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:34.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:34.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.030 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.030 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:34.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:34.030 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.030 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.030 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.030 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.031 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:34.031 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 90.156650557000006, 2024-04-26T12:06:34.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:34.031 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.031 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.031 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:34.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:34.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:34.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:34.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:34.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:34.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:34.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:34.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:34.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:34.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:34.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:34.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:34.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.034 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:34.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:34.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.034 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:34.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:34.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.035 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:34.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:34.035 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.035 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.035 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.035 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:34.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:34.035 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.035 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.035 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.035 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:34.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:34.035 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.035 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.035 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.036 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.036 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:34.036 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 90.156615084999999, 2024-04-26T12:06:34.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:34.036 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.036 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.036 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.036 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.036 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:34.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:34.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:34.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:34.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:34.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:34.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:34.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:34.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:34.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:34.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:34.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.039 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.039 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:34.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:34.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.039 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.039 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:34.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:34.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.039 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.039 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:34.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:34.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.040 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.040 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:34.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:34.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.040 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.040 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:34.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:34.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.040 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.040 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:34.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:34.041 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.041 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.041 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.041 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.041 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:34.041 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 90.156536396000007, 2024-04-26T12:06:34.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:34.041 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.041 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.041 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:34.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:34.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:34.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:34.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:34.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:34.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:34.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:34.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:34.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:34.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.044 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.044 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:34.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:34.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.044 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.044 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:34.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:34.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.044 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.044 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:34.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:34.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:34.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:34.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:34.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:34.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:34.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:34.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.046 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.046 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:34.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:34.046 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.046 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.046 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.046 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.046 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.046 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:34.046 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 90.156385548000003, 2024-04-26T12:06:34.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:34.046 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.046 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:34.047 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:34.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:34.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:34.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:34.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:34.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:34.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:34.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:34.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:34.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:34.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.049 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.049 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:34.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:34.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.049 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.049 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:34.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:34.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.049 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.050 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:34.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:34.050 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.050 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.050 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.050 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.050 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.050 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:34.051 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:34.052 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:34.050+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:34.152 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:34.150+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:34.166 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:34.166 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:34.166 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:06:34.166 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:34.176 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:34.253 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:34.252+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:34.278 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:34.278 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:34.279 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:34.279 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:34.279 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:34.287 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:34.354 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:34.353+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:34.390 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:34.390 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:34.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:34.390 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:34.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.390 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.390 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:34.391 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 90.608112169999998, 2024-04-26T12:06:34.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:06:34.391 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:34.391 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.391 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:34.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:34.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:34.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:34.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:34.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.392 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:34.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:06:34.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:34.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.392 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:34.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:06:34.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:06:34.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.392 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:34.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:06:34.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:06:34.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:06:34.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:06:34.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:34.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:06:34.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:06:34.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:34.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:34.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:06:34.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:34.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:06:34.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:06:34.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:34.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:06:34.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:06:34.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:06:34.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:06:34.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:34.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:06:34.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:06:34.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:34.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:06:34.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:06:34.395 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.395 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:34.396 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.396 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.396 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:34.396 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 90.608056849999997, 2024-04-26T12:06:34.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:06:34.396 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:34.396 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.396 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:34.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.396 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:34.396 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:34.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.397 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.397 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.397 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:34.397 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:34.397 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.397 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.397 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:34.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:06:34.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:34.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:34.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:06:34.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:06:34.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:34.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:06:34.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:06:34.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:06:34.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:06:34.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:34.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:06:34.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:06:34.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:34.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:06:34.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:06:34.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.400 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:34.400 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:06:34.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:06:34.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.400 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:34.400 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:06:34.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:06:34.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.400 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.400 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:06:34.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:06:34.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:34.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:06:34.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:06:34.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:34.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:06:34.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:06:34.401 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.401 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:34.401 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.402 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.402 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:34.402 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 90.608006832000001, 2024-04-26T12:06:34.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:06:34.402 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:34.402 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.402 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:34.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.402 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:34.402 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:34.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.402 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:34.403 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:34.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.403 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:34.403 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:06:34.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.403 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:34.403 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:06:34.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:06:34.403 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:34.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:06:34.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:06:34.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:06:34.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:06:34.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:34.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:06:34.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:06:34.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.405 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:34.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:06:34.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:06:34.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.405 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:06:34.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:06:34.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.405 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:34.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:06:34.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:06:34.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.406 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.406 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:06:34.406 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:06:34.406 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.406 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.406 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:34.406 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:06:34.406 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:06:34.406 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.406 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.406 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:34.406 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:06:34.406 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:06:34.406 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.407 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:34.407 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.407 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.407 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.407 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:34.407 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 90.607972195000002, 2024-04-26T12:06:34.407 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:06:34.407 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:34.407 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.407 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:34.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.407 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:34.407 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:34.407 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.408 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:34.408 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:34.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.408 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:34.408 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:06:34.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.408 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:34.408 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:06:34.409 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:06:34.409 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.409 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:34.409 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:34.409 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:06:34.409 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.409 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.409 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:06:34.409 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:06:34.409 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.409 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:34.409 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:06:34.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:06:34.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:34.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:06:34.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:06:34.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:06:34.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:06:34.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.411 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:06:34.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:06:34.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.411 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:34.411 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:06:34.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:06:34.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.411 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:34.411 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:06:34.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:06:34.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.411 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:34.412 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:06:34.412 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:06:34.412 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.412 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:34.412 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.412 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.412 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.412 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.412 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:34.412 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 90.607933682999999, 2024-04-26T12:06:34.412 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:06:34.412 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:34.412 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.412 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:34.412 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.413 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:34.413 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:34.413 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.413 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.413 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.413 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:34.413 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:34.413 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.413 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.413 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.413 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:34.413 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:34.413 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:34.413 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.413 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:34.414 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:34.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:06:34.414 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.414 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:34.414 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:06:34.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:06:34.414 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.414 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.415 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:06:34.415 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:06:34.415 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.415 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.415 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:34.415 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:06:34.415 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:06:34.415 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.415 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.415 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:34.415 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:06:34.415 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:06:34.415 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.415 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.416 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:34.416 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:06:34.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:06:34.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.416 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.416 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:06:34.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:06:34.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.416 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:34.416 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:06:34.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:06:34.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:34.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:06:34.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:06:34.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:34.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:06:34.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:06:34.417 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.417 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:34.417 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.417 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.418 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:34.418 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 90.607903359999995, 2024-04-26T12:06:34.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:06:34.418 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:34.418 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.418 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:34.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.418 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:34.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:34.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.418 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:34.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:34.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.419 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.419 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:34.419 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:06:34.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.419 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.419 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:34.419 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:06:34.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:06:34.419 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.419 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:34.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:06:34.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:06:34.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:06:34.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:06:34.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:34.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:06:34.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:06:34.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:34.421 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:06:34.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:06:34.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.421 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:34.421 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:06:34.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:06:34.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.421 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:34.421 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:06:34.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:06:34.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.421 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:06:34.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:06:34.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.422 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.422 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:34.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:06:34.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:06:34.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.422 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.422 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:34.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:06:34.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:06:34.422 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.422 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:34.423 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.423 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.423 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:34.423 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 90.607876657999995, 2024-04-26T12:06:34.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:06:34.423 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:34.423 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:34.423 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:34.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:34.423 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:34.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.424 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.424 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.424 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:34.424 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:34.424 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.424 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.424 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.424 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:34.424 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:34.424 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.424 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.424 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.424 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:34.424 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:06:34.424 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:06:34.424 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.425 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:34.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:06:34.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:06:34.425 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.425 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:06:34.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:06:34.425 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.425 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:34.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:06:34.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:06:34.425 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:34.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:06:34.426 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:06:34.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:34.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:06:34.426 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:06:34.426 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.426 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:34.426 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.427 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.427 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:34.427 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 90.607834367999999, 2024-04-26T12:06:34.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:06:34.427 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:34.427 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:34.427 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:34.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.427 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:34.427 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:34.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.427 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.427 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:34.427 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:34.428 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.428 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.428 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.428 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:34.428 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:34.428 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.428 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.428 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.428 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:34.428 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:06:34.428 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:06:34.428 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.428 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.428 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:34.429 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:06:34.429 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:06:34.429 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.429 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.429 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.429 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:06:34.429 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:06:34.429 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.429 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.429 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:34.429 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:06:34.429 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:06:34.429 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.429 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.429 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:34.430 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:06:34.430 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:06:34.430 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.430 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.430 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:34.430 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:06:34.430 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:06:34.430 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.430 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:34.430 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.431 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.431 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.431 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.431 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:34.431 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 90.607806289999999, 2024-04-26T12:06:34.431 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:06:34.431 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:34.431 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:34.431 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:34.431 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.431 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:34.431 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:34.432 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.432 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.432 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.432 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:34.433 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:34.433 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.433 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.433 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.434 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:34.434 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:06:34.434 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.434 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.434 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.434 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:34.434 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:06:34.434 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:06:34.434 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.434 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.434 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:34.434 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:06:34.435 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:06:34.435 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.435 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.435 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.435 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:06:34.435 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:06:34.435 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.435 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.435 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:34.435 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:06:34.435 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:06:34.435 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.435 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.435 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:34.436 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:06:34.436 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:06:34.436 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.436 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.436 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:34.436 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:06:34.436 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:06:34.436 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.436 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:34.436 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.436 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.436 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.436 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:34.437 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:34.437 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 90.601810940000007, 2024-04-26T12:06:34.437 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:06:34.437 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:34.437 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.437 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:34.437 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.437 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:34.437 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:34.437 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.437 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.437 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.437 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:34.437 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:34.438 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.438 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.438 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.438 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:34.438 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:06:34.438 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.438 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.438 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.438 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:34.438 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:06:34.438 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:06:34.438 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.439 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.439 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:34.439 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:06:34.439 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:06:34.439 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.439 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.439 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.439 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:06:34.439 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:06:34.439 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.439 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.439 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:34.439 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:06:34.440 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:06:34.440 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.440 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.440 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:34.440 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:06:34.440 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:06:34.440 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.440 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.440 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:34.440 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:06:34.440 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:06:34.440 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.440 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.440 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:34.441 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:06:34.441 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:06:34.441 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.441 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:34.441 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.441 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.441 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.441 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:34.441 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:34.441 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 90.601741974000007, 2024-04-26T12:06:34.441 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:06:34.441 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:34.441 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.442 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:34.442 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.442 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:34.442 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:34.442 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.442 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.442 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.442 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:34.442 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:34.442 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.442 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.442 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.442 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:34.442 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:06:34.443 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.443 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.443 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.443 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:34.443 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:06:34.443 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:06:34.443 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.443 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.443 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:34.443 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:06:34.444 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:06:34.444 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.444 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.444 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.444 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:06:34.444 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:06:34.444 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.444 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.444 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:34.444 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:06:34.444 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:06:34.445 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.445 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.445 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:34.445 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:34.445 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:06:34.445 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.445 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.445 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:34.445 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:06:34.445 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:06:34.445 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.445 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.445 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:34.445 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:06:34.445 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:06:34.446 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.446 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:34.446 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.446 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.446 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.446 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:34.446 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:34.446 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 90.601247611000005, 2024-04-26T12:06:34.446 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:06:34.446 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:34.446 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.446 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:34.446 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.446 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:34.447 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:34.447 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.447 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.447 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.447 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:34.447 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:34.447 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.447 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.447 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.447 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:34.447 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:34.447 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.447 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.447 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.448 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:34.448 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:06:34.448 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:06:34.448 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.448 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.448 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:34.448 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:06:34.448 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:06:34.448 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.448 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.448 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.448 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:06:34.448 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:06:34.448 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.448 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.449 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:34.449 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:06:34.449 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:06:34.449 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.449 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.449 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:34.449 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:06:34.449 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:06:34.449 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.449 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.449 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:34.449 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:06:34.449 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:06:34.449 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.450 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.450 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:34.450 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:06:34.450 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:06:34.450 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.450 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:34.450 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.450 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.450 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.450 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:34.450 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:34.450 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 90.601209346000005, 2024-04-26T12:06:34.450 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:06:34.451 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:34.451 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.451 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:34.451 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.451 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:34.451 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:34.451 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.451 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.451 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.451 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:34.451 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:34.451 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.451 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.451 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.452 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:34.452 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:34.452 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.452 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.452 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.452 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:34.452 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:06:34.452 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:06:34.452 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.452 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.452 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:34.452 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:06:34.452 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:06:34.452 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.453 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.453 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.453 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:06:34.453 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:06:34.453 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.453 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.453 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:34.453 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:06:34.453 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:06:34.453 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.453 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.453 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:34.453 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:06:34.453 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:06:34.454 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.454 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.454 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:34.454 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:06:34.454 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:06:34.454 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.454 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.454 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:34.454 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:06:34.454 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:06:34.454 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.454 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:34.454 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.454 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.455 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.455 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:06:34.455 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:34.455 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 90.600529460999994, 2024-04-26T12:06:34.455 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:06:34.455 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:34.455 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:34.455 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:34.455 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.455 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:34.455 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:34.455 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.455 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.455 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.455 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:34.456 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:34.456 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.456 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.456 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.456 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:34.456 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:34.456 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.456 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.456 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.456 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:34.456 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:06:34.456 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:06:34.456 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.456 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.456 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:34.457 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:06:34.457 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:06:34.457 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.457 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.457 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:06:34.457 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:06:34.457 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.457 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:34.457 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:06:34.457 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:06:34.457 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.458 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:34.458 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:06:34.458 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:06:34.458 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.458 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:34.458 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.458 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.458 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.458 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:34.458 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:34.458 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 90.600500281999999, 2024-04-26T12:06:34.458 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:06:34.458 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:34.458 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:34.459 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:34.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.459 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:34.459 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:34.459 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.459 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.459 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:34.459 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:34.459 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.459 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.459 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:34.459 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:06:34.459 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.460 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.460 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.460 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:34.460 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:06:34.460 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:06:34.460 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.460 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.460 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:34.460 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:06:34.460 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:06:34.460 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.460 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.460 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.460 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:06:34.461 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:06:34.461 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.461 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.461 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:34.461 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:06:34.461 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:06:34.461 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.461 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.461 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:34.461 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:06:34.461 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:06:34.461 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.461 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.461 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:34.462 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:06:34.462 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:06:34.462 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.462 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:34.462 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.462 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.462 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.462 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:34.462 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:34.462 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 90.600468470999999, 2024-04-26T12:06:34.462 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:06:34.462 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:34.462 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:34.462 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:34.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.463 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:34.463 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:34.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.463 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.463 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:34.463 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:34.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.463 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.463 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:34.463 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:34.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:34.464 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:34.464 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:06:34.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:06:34.464 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:34.464 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:06:34.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:06:34.464 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.464 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:06:34.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:06:34.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.465 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:34.465 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:06:34.465 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:06:34.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.465 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:34.465 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:06:34.465 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:06:34.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.465 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:34.465 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:06:34.466 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:06:34.466 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.466 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:34.466 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.466 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.466 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:34.466 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:34.466 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 90.600447114999994, 2024-04-26T12:06:34.466 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:06:34.466 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:34.466 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:34.466 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:34.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.467 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:34.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:34.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.467 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.467 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:34.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:34.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.467 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.467 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:34.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:34.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:34.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.468 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:34.468 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:06:34.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:06:34.468 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.468 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:34.468 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:06:34.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:06:34.468 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.468 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.468 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:06:34.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:06:34.468 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.469 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.469 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:34.469 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:06:34.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:06:34.469 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.469 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.469 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:34.469 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:06:34.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:06:34.469 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.469 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.469 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:34.469 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:06:34.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:06:34.469 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.470 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:34.470 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.470 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:06:34.470 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:34.470 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 90.600418661999996, 2024-04-26T12:06:34.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:06:34.470 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:34.470 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:34.470 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:34.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:34.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:34.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.471 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:34.471 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:34.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.471 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:34.471 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:34.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.471 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:34.471 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:06:34.473 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:06:34.473 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.473 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.473 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:34.473 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:06:34.473 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:06:34.473 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.473 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.473 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:06:34.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:06:34.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.474 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:34.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:06:34.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:06:34.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.474 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:34.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:06:34.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:06:34.474 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.474 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:34.475 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.475 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:06:34.475 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:34.475 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 90.599696855999994, 2024-04-26T12:06:34.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:06:34.475 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:34.475 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:34.475 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:34.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:34.475 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:34.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.476 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:34.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:34.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.476 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:34.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:06:34.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:34.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.476 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:34.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:06:34.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:06:34.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.477 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:34.477 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:06:34.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:06:34.477 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.477 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.477 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:06:34.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:06:34.477 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.477 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:34.477 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:06:34.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:06:34.477 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.478 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.478 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:34.478 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:06:34.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:06:34.478 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.478 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:34.478 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.478 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.478 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:06:34.478 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:34.478 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 84.882770253000004, 2024-04-26T12:06:34.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:06:34.478 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:34.479 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.479 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:34.479 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.479 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:34.479 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:34.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.479 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.479 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.479 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:34.479 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:34.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:34.479 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.479 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.479 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:34.479 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:06:34.480 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:06:34.480 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.480 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:34.480 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:06:34.480 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:06:34.480 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.480 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:34.480 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:06:34.480 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:06:34.480 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.480 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:06:34.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:06:34.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:34.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:06:34.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:06:34.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:34.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:06:34.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:06:34.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:34.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:06:34.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:06:34.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:34.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:06:34.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:06:34.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:06:34.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:06:34.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.483 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:34.483 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:06:34.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:06:34.483 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:34.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:34.483 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:34.483 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:06:34.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:06:34.483 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.483 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:34.483 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.483 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:34.483 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:34.483 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:34.485 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:34.486 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:34.484+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:34.486 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:06:34.586 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:34.585+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:34.595 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:34.595 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:34.595 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:06:34.595 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:34.604 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:34.687 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:34.686+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:34.747 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:34.747 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:34.747 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:34.747 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:34.747 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:34.755 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:34.774 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:06:34.799 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:34.798+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:34.859 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:34.859 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:34.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:34.859 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 101.002247017, 2024-04-26T12:06:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:34.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:34.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:34.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:34.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:34.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.862 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:34.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:34.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.862 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:34.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:34.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.863 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:34.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:34.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.863 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:34.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:34.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:34.865 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.865 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.865 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.865 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:34.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:34.865 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.865 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.865 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.865 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:34.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:34.865 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.865 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.865 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.866 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:34.866 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:34.866 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 101.00214112099999, 2024-04-26T12:06:34.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:34.866 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.866 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.866 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:34.866 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:34.866 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:34.866 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:34.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.866 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:34.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:34.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:34.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.868 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.868 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:34.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:34.868 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.868 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.868 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:34.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:34.868 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.868 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.868 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:34.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:34.868 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:34.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:34.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:34.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:34.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:34.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:34.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.870 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.870 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:34.870 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:34.870 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.870 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.870 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.870 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:34.870 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:34.870 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.870 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.870 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.870 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:34.870 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:34.870 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.871 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.871 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.871 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:34.871 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:34.871 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.871 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.871 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.871 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.871 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.871 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:34.871 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:34.871 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 101.00212614100001, 2024-04-26T12:06:34.871 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:34.871 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.871 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.872 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:34.872 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:34.872 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:34.872 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:34.872 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.872 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.874 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.874 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.874 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:34.875 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.875 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.875 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.875 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.875 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:34.875 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.875 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.875 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.875 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.875 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:34.875 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.875 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.875 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.875 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.876 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:34.876 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:34.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.876 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.876 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.876 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:34.876 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:34.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.876 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.876 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.876 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:34.876 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:34.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.876 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.877 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.877 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:34.877 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:34.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.877 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.877 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.877 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:34.877 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:34.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.877 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.877 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.877 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:34.877 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:34.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.877 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.878 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.878 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:34.878 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:34.878 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.878 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.878 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.878 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:34.878 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:34.878 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.878 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.879 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.879 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:34.879 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:34.879 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.879 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.879 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.879 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:34.879 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:34.879 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.879 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.879 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.879 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.879 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.879 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:34.880 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:34.880 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 101.002082266, 2024-04-26T12:06:34.880 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:34.880 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.880 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.880 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:34.880 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:34.880 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:34.880 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:34.880 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.880 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.880 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.880 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.880 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:34.880 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.881 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.881 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.881 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.881 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:34.881 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.881 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.881 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.881 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.881 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:34.881 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.881 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.881 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.881 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.881 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:34.882 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:34.882 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.882 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.882 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.882 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:34.882 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:34.882 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.882 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.882 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.882 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:34.882 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:34.882 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.882 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.882 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.883 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:34.883 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:34.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.883 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.883 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.883 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:34.883 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:34.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.883 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.883 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.883 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:34.883 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:34.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.883 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.884 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.884 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:34.884 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:34.884 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.884 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.884 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.884 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:34.884 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:34.884 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.884 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.884 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.884 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:34.884 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:34.884 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.885 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.885 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.885 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:34.885 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:34.885 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.885 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.885 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.885 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.885 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.885 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:34.885 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:34.886 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 101.00199660200001, 2024-04-26T12:06:34.886 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:34.886 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.886 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.886 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:34.886 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:34.886 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:34.886 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:34.886 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.886 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.886 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.887 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.887 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:34.887 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.887 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.887 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.887 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.887 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:34.887 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.887 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.887 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.887 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.887 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:34.888 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.888 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.888 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:34.888 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:34.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.888 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.888 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:34.888 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:34.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.888 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.888 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:34.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:34.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.889 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.889 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:34.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:34.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.889 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.889 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:34.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:34.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.890 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.890 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:34.890 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:34.890 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.890 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.890 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.890 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:34.890 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:34.890 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.890 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.890 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.890 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:34.890 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:34.890 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.891 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.891 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.891 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:34.891 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:34.891 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.891 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.891 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.891 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:34.891 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:34.891 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.891 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.891 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.891 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.891 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.892 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.892 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:34.892 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 91.076092316, 2024-04-26T12:06:34.892 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:34.892 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.892 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.892 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.892 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.892 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.892 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:34.892 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.892 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.892 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.892 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.892 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:34.893 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.893 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.893 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.893 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.893 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:34.893 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:34.893 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.893 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.893 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.893 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:34.893 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:34.893 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.893 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.893 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.893 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:34.894 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:34.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.894 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.894 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.894 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:34.894 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:34.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.894 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.894 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.894 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:34.894 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:34.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.894 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.894 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.895 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:34.895 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:34.895 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.895 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.895 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.895 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:34.895 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:34.895 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.895 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.895 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.895 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:34.895 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:34.895 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.895 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.896 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.896 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:34.896 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:34.896 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.896 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.896 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.896 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:34.896 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:34.896 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.896 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.896 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.896 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:34.896 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:34.896 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.897 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.897 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.897 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.897 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.897 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.897 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:34.897 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 91.076056221000002, 2024-04-26T12:06:34.897 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:34.897 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.897 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.897 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.897 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.897 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.897 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:34.898 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.898 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.898 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:34.898 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.898 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.898 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:34.898 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:34.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.899 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.899 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:34.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:34.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.899 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.899 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.899 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:34.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:34.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.899 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.899 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.899 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:34.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:34.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.900 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.900 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:34.900 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:34.900 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.900 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.900 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:34.900 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:34.900 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.900 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.900 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:34.900 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:34.900 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.901 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.901 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:34.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:34.901 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.901 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.901 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:34.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:34.901 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.901 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.901 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:34.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:34.902 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.902 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.902 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.902 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:34.902 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:34.902 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.902 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.902 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.902 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.902 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.902 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.902 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:34.902 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 91.076018536999996, 2024-04-26T12:06:34.902 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:34.902 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.903 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.903 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.903 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.903 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:34.903 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.903 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.903 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:34.903 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.904 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:34.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.904 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.904 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:34.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:34.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.904 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.904 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:34.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:34.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.904 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.905 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:34.905 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:34.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.905 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.905 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:34.905 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:34.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.905 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.905 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:34.905 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:34.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.906 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.906 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:34.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:34.906 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.906 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.906 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:34.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:34.906 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.906 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.906 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:34.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:34.906 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.907 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.907 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.907 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:34.907 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:34.907 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.907 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.907 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.907 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:34.907 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:34.907 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.907 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.907 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.907 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.907 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.907 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.908 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:34.908 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 91.075997197000007, 2024-04-26T12:06:34.908 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:34.908 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.908 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.908 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.908 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.908 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.908 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:34.908 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.908 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.908 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.908 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.908 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:34.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.909 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.909 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:34.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.909 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.909 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:34.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:34.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.909 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.909 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:34.910 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:34.910 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.910 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.910 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.910 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:34.910 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:34.910 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.910 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.910 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.910 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:34.910 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:34.910 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.910 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.910 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.911 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:34.911 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:34.911 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.911 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.911 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.911 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:34.911 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:34.911 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.911 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.911 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.911 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:34.911 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:34.911 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.911 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.911 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.912 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:34.912 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:34.912 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.912 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.912 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.912 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:34.912 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:34.912 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.912 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.912 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.912 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:34.912 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:34.912 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.912 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.912 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.913 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.913 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.913 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.913 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:34.913 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 91.075974931000005, 2024-04-26T12:06:34.913 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:34.913 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.913 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.913 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.913 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.913 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.913 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:34.913 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.913 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.913 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.914 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.914 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:34.914 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.914 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.914 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.914 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.914 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:34.914 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.914 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.914 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.914 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.914 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:34.914 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:34.914 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.915 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.915 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.915 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:34.915 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:34.915 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.915 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.915 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.915 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:34.915 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:34.915 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.915 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.915 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.915 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:34.915 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:34.915 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.916 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.916 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.916 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:34.916 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:34.916 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.916 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.916 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.916 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:34.916 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:34.916 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.916 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.917 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.917 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:34.917 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:34.917 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.917 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.917 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.917 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:34.917 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:34.917 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.917 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.917 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.917 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:34.917 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:34.917 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.918 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.918 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.918 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:34.918 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:34.918 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.918 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.918 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.918 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.918 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.918 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.918 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:34.919 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 91.075953308999999, 2024-04-26T12:06:34.919 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:34.919 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.919 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.919 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.919 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.919 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.919 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:34.919 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.919 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.919 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.919 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.919 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:34.919 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.920 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.920 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.920 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.920 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:34.920 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.920 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.920 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.920 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.920 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:34.920 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:34.920 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.920 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.920 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.920 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:34.920 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:34.921 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.921 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.921 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.921 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:34.921 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:34.921 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.921 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.921 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.921 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:34.921 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:34.921 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.921 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.921 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.921 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:34.921 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:34.922 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.922 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.922 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.922 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:34.922 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:34.922 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.922 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.922 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.922 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:34.922 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:34.922 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.922 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.922 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.922 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:34.923 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:34.923 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.923 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.923 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.923 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:34.923 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:34.923 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.923 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.923 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.923 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:34.923 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:34.923 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.923 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.923 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.923 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.924 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.924 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.924 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:34.924 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 91.075926742999997, 2024-04-26T12:06:34.924 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:34.924 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.924 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.924 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.924 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.924 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.924 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:34.924 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.924 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.924 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.924 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.925 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:34.925 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.925 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.925 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.925 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.925 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:34.925 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.925 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.925 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.925 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.925 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:34.925 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:34.925 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.925 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.926 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.926 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:34.926 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:34.926 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.926 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.926 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.926 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:34.926 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:34.926 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.926 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.926 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.926 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:34.926 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:34.926 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.927 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.927 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.927 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:34.927 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:34.927 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.927 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.927 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.927 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:34.927 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:34.927 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.927 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.927 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.927 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:34.927 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:34.927 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.928 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.928 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.928 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:34.928 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:34.928 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.928 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.928 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.928 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:34.928 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:34.928 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.928 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.928 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.928 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:34.928 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:34.928 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.929 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.929 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.929 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.929 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.929 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.929 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:34.929 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 91.075888230999993, 2024-04-26T12:06:34.929 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:34.929 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.929 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.929 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.929 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.929 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.929 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:34.930 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.930 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.930 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.930 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.930 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:34.930 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.930 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.930 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.930 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.930 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:34.930 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.930 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.930 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.930 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.931 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:34.931 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:34.931 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.931 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.931 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.931 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:34.931 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:34.931 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.931 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.931 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.931 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:34.931 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:34.931 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.931 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.931 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.932 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:34.932 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:34.932 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.932 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.932 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.932 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:34.932 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:34.932 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.932 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.932 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.932 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:34.932 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:34.932 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.932 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.932 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.933 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:34.933 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:34.933 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.933 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.933 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.933 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:34.933 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:34.933 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.933 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.933 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.933 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:34.933 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:34.933 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.933 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.933 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.934 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:34.934 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:34.934 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.934 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.934 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.934 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.934 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.934 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.934 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:34.934 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 91.075860058000004, 2024-04-26T12:06:34.934 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:34.934 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.934 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.934 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.935 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.935 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.935 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:34.935 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.935 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.935 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.935 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.935 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:34.935 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.935 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.935 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.935 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.935 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:34.935 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.935 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.936 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.936 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.936 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:34.936 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:34.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.936 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.936 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.936 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:34.936 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:34.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.936 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.936 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.936 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:34.936 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:34.937 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.937 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.937 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.937 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:34.937 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:34.937 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.937 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.937 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.937 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:34.937 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:34.937 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.937 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.937 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.937 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:34.937 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:34.938 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.938 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.938 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.938 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:34.938 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:34.938 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.938 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.938 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.938 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:34.938 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:34.938 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.938 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.938 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.938 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:34.938 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:34.939 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.939 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.939 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.939 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:34.939 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:34.939 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.939 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.939 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.939 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.939 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.939 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.939 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:34.939 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 91.075825494, 2024-04-26T12:06:34.939 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:34.940 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.940 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.940 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.940 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.940 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.940 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:34.940 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.940 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.940 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.940 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.940 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:34.941 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.941 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.941 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.941 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.941 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:34.941 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.941 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.941 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.941 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.941 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:34.941 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:34.941 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.941 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.941 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.941 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:34.942 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:34.942 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.942 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.942 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.942 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:34.942 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:34.942 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.942 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.942 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.942 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:34.942 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:34.942 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.942 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.942 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.943 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:34.943 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:34.943 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.943 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.943 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.943 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:34.943 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:34.943 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.943 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.943 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.943 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:34.943 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:34.943 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.943 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.943 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.944 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:34.944 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:34.944 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.944 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.944 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.944 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:34.944 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:34.944 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.944 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.944 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.944 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:34.944 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:34.944 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.944 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.945 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.945 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.945 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.945 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.945 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:34.945 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 91.074950713999996, 2024-04-26T12:06:34.945 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:34.945 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.945 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.945 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.945 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.945 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.945 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:34.945 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.945 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.946 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.946 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.946 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:34.946 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.946 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.946 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.946 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.946 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:34.946 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:34.946 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.946 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.946 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.946 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:34.946 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:34.947 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.947 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.947 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.947 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:34.947 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:34.947 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.947 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.947 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.947 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:34.947 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:34.947 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.947 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.947 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.947 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:34.947 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:34.948 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.948 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.948 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.948 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:34.948 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:34.948 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.948 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.948 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.948 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:34.948 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:34.948 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.948 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.948 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.948 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:34.948 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:34.949 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.949 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.949 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.949 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:34.949 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:34.949 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.949 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.949 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.949 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:34.949 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:34.949 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.949 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.949 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.949 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:34.949 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:34.950 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.950 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.950 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.950 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.950 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.950 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.950 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:34.950 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 91.074911755000002, 2024-04-26T12:06:34.950 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:34.950 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.950 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.950 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.950 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.950 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.951 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:34.951 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.951 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.951 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.951 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.951 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:34.951 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.951 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.951 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.951 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.951 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:34.951 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.951 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.951 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.951 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.952 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:34.952 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:34.952 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.952 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.952 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.952 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:34.952 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:34.952 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.952 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.952 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.952 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:34.952 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:34.952 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.952 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.952 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.953 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:34.953 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:34.953 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.953 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.953 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.953 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:34.953 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:34.953 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.953 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.953 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.953 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:34.953 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:34.953 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.953 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.953 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.954 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:34.954 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:34.954 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.954 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.954 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.954 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:34.954 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:34.954 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.954 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.954 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.954 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:34.954 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:34.954 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.954 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.955 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.955 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:34.955 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:34.955 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.955 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.955 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.955 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.955 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.955 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.955 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:34.955 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 91.074876282999995, 2024-04-26T12:06:34.955 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:34.955 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.955 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.956 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.956 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.956 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.956 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:34.956 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.956 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.956 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.956 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.956 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:34.956 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.956 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.956 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.956 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.956 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:34.956 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:34.957 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.957 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.957 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.957 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:34.957 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:34.957 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.957 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.957 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.957 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:34.957 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:34.957 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.957 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.957 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.957 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:34.958 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:34.958 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.958 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.958 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.958 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:34.958 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:34.958 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.958 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.958 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.958 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:34.958 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:34.958 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.958 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.958 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.959 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:34.959 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:34.959 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.959 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.959 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.959 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:34.959 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:34.959 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.959 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.959 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.959 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:34.959 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:34.959 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.959 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.959 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.960 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:34.960 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:34.960 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.960 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.960 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.960 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:34.960 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:34.960 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.960 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.960 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.960 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.960 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.960 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.960 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:34.960 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 91.074797594000003, 2024-04-26T12:06:34.961 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:34.961 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.961 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:34.961 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.961 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.961 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.961 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:34.961 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.961 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.961 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.961 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.961 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:34.961 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.961 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.962 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.962 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.962 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:34.962 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:34.962 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.962 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.962 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.962 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:34.962 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:34.962 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.962 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.962 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.962 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:34.962 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:34.963 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.963 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.963 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.963 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:34.963 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:34.963 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.963 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.963 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.963 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:34.963 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:34.963 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.963 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.963 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.963 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:34.963 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:34.964 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.964 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.964 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:34.964 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:34.964 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:34.964 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.964 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.964 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:34.964 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:34.964 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:34.964 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.964 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.964 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:34.964 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:34.965 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:34.965 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.965 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.965 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:34.965 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:34.965 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:34.965 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.965 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.965 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.965 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:34.965 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:34.965 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.965 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.965 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.965 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.966 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.966 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:34.966 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:34.966 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 91.074646745999999, 2024-04-26T12:06:34.966 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:34.966 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:34.966 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:34.966 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:34.966 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.966 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:34.966 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:34.966 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.966 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.966 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.967 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:34.967 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:34.967 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:34.967 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.967 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.967 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:34.967 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:34.967 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:34.967 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.967 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.967 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:34.967 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:34.967 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:34.967 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.967 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.968 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:34.968 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:34.968 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:34.968 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.968 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.968 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:34.968 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:34.968 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:34.968 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.968 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.968 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:34.968 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:34.968 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:34.968 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.968 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.969 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:34.969 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:34.969 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:34.969 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:34.969 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:34.969 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:34.969 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:34.969 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:34.969 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.969 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.969 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.969 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:34.969 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:34.969 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:34.971 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:34.971 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:34.971 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:06:34.972 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:34.972 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:34.969+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:34.973 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:34.973 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:06:34.974 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:34.974 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:06:35.072 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:35.071+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:35.077 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:35.077 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:35.087 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:35.179 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:35.178+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:35.191 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:35.192 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:35.201 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:35.285 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:35.284+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:35.343 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:35.343 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:35.352 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:35.380 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~18s 2024-04-26T12:06:35.396 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:35.395+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:35.457 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:35.458 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:35.466 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:35.471 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-26T12:06:35.482 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:35.481+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:35.583 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:35.582+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:35.610 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:35.610 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:35.619 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:35.684 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:35.683+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:35.761 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:35.762 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:35.771 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:35.815 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:35.814+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:35.874 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:35.875 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:35.883 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:35.924 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:35.923+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:35.987 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:35.985+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:36.025 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:36.025 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:36.035 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:36.087 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:36.086+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:36.178 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:36.178 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:36.186 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:36.188 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:36.187+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:36.289 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:36.288+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:36.294 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:36.294 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:36.304 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:36.390 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:36.389+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:36.405 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:36.406 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:36.415 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:36.499 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:36.498+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:36.557 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:36.558 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:36.566 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:36.610 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:36.609+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:36.669 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:36.669 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:36.679 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:36.722 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:36.719+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:36.794 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:36.793+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:36.822 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:36.822 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:36.831 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:36.895 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:36.894+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:36.932 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:36.933 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:36.943 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:36.975 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:06:36.996 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:36.995+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:37.048 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:37.048 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:37.057 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:37.097 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:37.096+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:37.099 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:37.099 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:37.099 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:06:37.118 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:37.118 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:37.121 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:06:37.121 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:06:37.197 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:37.197+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:37.199 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:37.199 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:37.199 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:37.199 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:37.199 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:37.208 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:37.298 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:37.297+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:37.312 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:37.312 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:37.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:37.313 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:37.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.313 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:37.313 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:37.313 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 103.455136665, 2024-04-26T12:06:37.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:37.313 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:37.313 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.314 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:37.314 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:37.314 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:37.314 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:37.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.314 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:37.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:37.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:37.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:37.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:37.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:37.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:37.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.316 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:37.316 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:37.316 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:37.316 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.316 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.316 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:37.316 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:37.316 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:37.316 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.316 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.316 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.316 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:37.316 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:37.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:37.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:37.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:37.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:37.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:37.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:37.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.318 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:37.318 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:37.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:37.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.318 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:37.318 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:37.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:37.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.319 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:37.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:37.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.319 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:37.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:37.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:37.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.320 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.320 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:37.320 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:37.320 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:37.320 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.320 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:37.320 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.320 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.320 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.320 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:37.321 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:37.321 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 103.455030769, 2024-04-26T12:06:37.321 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:37.321 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:37.321 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.321 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:37.321 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:37.321 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:37.321 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:37.321 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.322 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:37.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.322 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:37.322 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:37.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.322 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.322 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:37.322 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:37.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.322 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:37.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:37.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.323 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:37.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:37.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:37.323 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:37.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:37.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:37.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:37.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:37.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:37.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:37.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:37.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:37.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:37.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:37.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:37.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:37.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:37.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:37.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:37.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:37.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:37.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:37.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:37.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:37.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:37.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:37.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:37.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:37.326 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.326 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:37.327 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.327 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:37.327 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:37.327 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 103.455015789, 2024-04-26T12:06:37.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:37.327 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:37.327 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.327 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:37.327 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:37.327 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:37.327 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:37.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.328 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:37.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.328 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:37.328 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:37.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.328 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.328 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:37.328 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:37.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.328 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:37.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:37.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:37.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:37.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:37.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:37.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:37.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:37.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:37.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:37.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:37.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:37.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:37.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.334 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:37.334 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:37.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:37.334 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.334 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.334 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:37.334 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:37.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:37.334 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.334 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.334 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:37.334 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:37.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:37.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:37.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:37.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:37.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:37.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:37.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:37.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:37.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:37.336 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.336 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:37.336 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.336 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:37.336 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:37.336 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 103.454971914, 2024-04-26T12:06:37.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:37.336 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:37.336 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.336 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:37.336 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:37.337 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:37.337 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:37.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.337 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:37.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:37.337 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:37.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:37.337 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:37.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:37.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:37.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:37.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:37.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:37.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:37.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:37.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:37.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:37.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:37.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:37.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:37.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:37.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:37.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:37.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:37.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.340 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:37.340 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:37.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:37.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.340 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:37.340 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:37.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:37.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.340 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.340 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:37.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:37.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:37.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:37.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:37.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:37.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:37.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:37.341 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.341 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:37.341 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.342 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:37.342 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:37.342 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 103.45488625, 2024-04-26T12:06:37.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:37.342 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:37.342 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.342 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:37.342 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:37.342 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:37.342 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:37.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.342 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:37.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:37.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:37.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:37.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:37.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:37.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:37.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:37.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:37.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:37.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:37.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:37.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:37.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:37.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:37.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:37.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:37.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:37.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:37.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:37.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:37.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:37.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:37.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:37.346 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.346 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:37.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:37.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:37.346 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.346 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:37.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:37.346 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:37.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:37.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:37.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:37.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:37.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:37.347 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.347 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:37.347 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.347 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:37.347 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:37.348 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 93.528981963999996, 2024-04-26T12:06:37.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:37.348 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:37.348 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.348 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:37.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.348 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:37.348 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:37.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.348 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:37.348 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:37.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:37.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:37.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:37.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:37.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:37.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:37.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:37.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:37.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:37.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:37.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:37.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:37.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:37.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:37.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:37.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:37.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:37.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:37.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:37.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:37.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:37.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:37.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:37.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:37.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:37.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:37.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:37.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:37.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:37.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:37.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:37.352 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.352 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:37.353 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.353 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.353 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:37.353 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:37.353 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 93.528945868999998, 2024-04-26T12:06:37.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:37.353 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:37.353 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.353 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:37.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.353 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:37.353 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:37.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:37.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:37.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:37.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:37.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:37.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:37.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:37.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:37.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:37.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:37.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:37.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:37.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:37.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:37.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:37.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:37.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:37.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:37.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:37.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:37.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:37.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:37.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:37.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:37.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:37.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.357 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.357 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:37.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:37.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.357 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:37.357 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:37.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:37.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:37.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:37.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:37.358 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.358 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:37.358 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.358 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:37.358 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:37.358 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 93.528908185000006, 2024-04-26T12:06:37.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:37.358 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:37.358 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.359 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:37.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:37.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:37.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:37.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:37.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:37.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:37.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:37.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:37.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:37.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:37.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:37.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:37.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:37.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:37.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:37.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:37.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:37.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:37.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:37.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:37.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.362 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:37.362 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:37.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:37.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.362 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:37.362 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:37.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:37.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.362 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:37.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:37.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:37.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:37.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:37.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:37.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:37.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:37.363 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.364 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:37.364 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.364 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:37.364 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:37.364 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 93.528886845000002, 2024-04-26T12:06:37.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:37.364 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:37.364 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.364 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:37.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:37.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:37.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:37.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:37.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:37.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:37.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:37.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:37.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:37.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:37.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:37.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:37.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:37.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:37.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:37.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:37.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:37.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:37.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:37.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:37.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:37.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:37.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:37.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:37.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:37.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:37.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:37.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:37.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:37.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:37.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:37.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:37.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:37.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:37.369 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.369 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:37.369 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.369 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:37.369 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:37.369 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 93.528864579, 2024-04-26T12:06:37.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:37.369 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:37.370 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.370 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:37.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:37.370 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:37.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:37.370 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:37.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:37.370 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:37.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:37.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:37.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:37.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:37.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:37.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:37.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:37.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:37.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:37.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:37.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:37.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:37.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:37.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:37.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:37.373 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:37.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:37.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.373 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:37.373 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:37.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:37.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.373 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.373 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:37.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:37.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.373 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:37.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:37.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:37.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:37.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:37.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:37.374 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.374 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:37.374 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.374 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:37.374 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:37.375 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 93.528842956999995, 2024-04-26T12:06:37.375 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:37.375 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:37.375 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.375 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:37.375 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.375 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:37.375 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:37.375 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.375 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.375 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.375 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:37.375 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:37.375 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.375 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.376 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.376 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:37.376 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:37.376 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.376 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.376 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.376 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:37.376 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:37.376 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:37.376 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.376 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.376 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:37.376 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:37.376 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:37.376 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.377 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.377 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.377 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:37.377 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:37.377 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.377 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.377 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:37.377 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:37.377 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:37.377 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.377 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.377 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:37.377 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:37.377 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:37.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.378 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.378 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:37.378 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:37.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:37.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.378 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.378 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:37.378 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:37.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:37.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.378 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.378 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.378 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:37.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:37.379 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.379 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:37.379 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:37.379 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:37.379 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.379 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:37.379 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:37.379 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:37.379 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.379 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:37.379 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.379 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.380 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:37.380 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:37.380 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 93.528816391000007, 2024-04-26T12:06:37.380 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:37.380 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:37.380 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.380 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:37.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.380 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:37.380 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:37.380 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.380 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.380 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:37.381 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:37.381 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.381 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.381 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.381 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:37.381 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:37.381 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.381 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.381 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.381 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:37.381 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:37.381 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:37.381 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.381 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.381 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:37.382 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:37.382 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:37.382 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.382 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.382 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.382 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:37.382 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:37.382 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.382 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.382 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:37.382 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:37.382 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:37.382 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.382 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.383 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:37.383 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:37.383 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:37.383 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.383 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.383 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:37.383 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:37.383 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:37.383 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.383 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.383 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:37.383 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:37.383 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:37.383 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.383 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.384 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.384 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:37.384 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:37.384 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.384 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.384 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:37.384 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:37.384 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:37.384 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.384 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.384 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:37.384 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:37.384 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:37.384 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.385 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:37.385 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.385 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.385 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.385 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:37.385 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:37.385 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 93.528777879000003, 2024-04-26T12:06:37.385 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:37.385 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:37.385 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.385 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:37.385 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.385 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:37.385 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:37.386 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.386 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.386 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.386 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:37.386 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:37.386 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.386 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.386 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.386 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:37.386 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:37.386 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.386 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.386 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.386 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:37.387 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:37.387 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:37.387 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.387 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.387 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:37.387 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:37.387 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:37.387 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.387 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.387 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.387 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:37.387 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:37.387 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.387 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.388 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:37.388 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:37.388 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:37.388 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.388 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.388 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:37.388 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:37.388 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:37.388 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.388 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.388 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:37.388 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:37.388 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:37.388 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.388 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.389 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:37.389 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:37.389 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:37.389 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.389 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.389 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.389 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:37.389 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:37.389 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.389 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.389 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:37.389 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:37.389 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:37.389 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.389 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.390 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:37.390 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:37.390 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:37.390 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.390 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:37.390 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.390 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.390 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.390 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:37.390 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:37.390 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 93.528749705999999, 2024-04-26T12:06:37.390 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:37.390 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:37.390 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.391 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:37.391 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.391 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:37.391 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:37.391 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.391 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.391 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.391 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:37.391 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:37.391 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.391 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.391 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.391 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:37.391 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:37.391 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.392 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.392 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.392 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:37.392 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:37.392 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:37.392 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.392 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.392 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:37.392 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:37.392 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:37.392 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.392 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.392 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.392 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:37.393 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:37.393 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.393 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.393 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:37.393 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:37.393 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:37.393 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.393 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.393 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:37.393 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:37.393 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:37.393 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.393 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.393 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:37.393 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:37.394 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:37.394 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.394 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.394 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:37.394 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:37.394 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:37.394 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.394 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.394 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.394 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:37.394 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:37.394 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.394 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.395 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:37.395 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:37.395 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:37.395 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.395 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.395 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:37.395 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:37.395 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:37.395 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.395 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:37.395 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.396 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.396 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.396 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:37.396 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:37.396 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 93.528715141999996, 2024-04-26T12:06:37.396 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:37.396 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:37.396 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.396 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:37.396 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.396 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:37.396 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:37.396 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.396 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.396 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.397 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:37.397 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:37.397 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.397 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.397 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.397 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:37.397 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:37.397 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.397 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.397 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.397 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:37.397 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:37.398 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:37.398 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.398 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.398 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:37.398 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:37.398 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:37.398 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.398 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.398 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.398 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:37.398 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:37.398 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.398 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.398 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:37.399 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:37.399 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:37.399 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.399 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.399 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:37.399 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:37.399 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:37.399 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.399 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.399 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:37.399 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:37.400 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:37.400 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.400 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.400 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:37.400 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:37.400 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:37.400 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.400 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.400 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.400 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:37.400 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:37.400 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.400 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.400 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:37.400 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:37.401 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:37.401 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.401 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.401 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:37.401 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:37.401 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:37.401 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.401 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:37.401 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.401 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.401 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.401 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:37.401 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:37.401 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 93.527840362000006, 2024-04-26T12:06:37.402 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:37.402 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:37.402 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.402 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:37.402 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.402 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:37.402 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:37.402 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.402 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.402 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.402 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:37.402 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:37.402 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.403 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:37.403 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:37.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:37.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.403 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:37.403 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:37.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:37.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.403 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:37.403 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:37.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:37.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:37.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:37.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:37.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:37.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:37.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:37.405 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:37.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:37.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.405 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:37.405 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:37.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:37.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.405 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:37.405 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:37.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:37.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.405 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:37.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:37.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:37.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:37.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:37.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:37.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:37.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:37.406 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.407 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:37.407 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.407 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:37.407 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:37.407 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 93.527801402999998, 2024-04-26T12:06:37.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:37.407 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:37.407 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.407 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:37.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.407 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:37.407 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:37.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:37.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:37.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:37.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:37.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:37.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:37.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:37.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:37.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:37.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:37.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:37.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:37.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:37.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:37.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:37.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.410 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:37.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:37.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:37.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.410 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:37.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:37.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:37.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:37.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:37.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:37.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:37.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:37.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:37.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:37.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:37.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:37.412 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:37.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:37.412 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.412 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:37.412 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.412 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:37.412 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:37.412 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 93.527765931000005, 2024-04-26T12:06:37.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:37.412 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:37.413 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.413 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:37.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:37.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:37.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:37.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:37.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:37.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:37.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.414 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.414 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.414 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:37.414 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:37.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:37.414 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.414 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.414 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:37.414 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:37.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:37.414 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.414 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:37.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:37.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:37.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:37.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:37.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:37.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:37.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:37.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:37.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:37.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:37.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:37.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:37.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:37.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:37.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:37.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:37.417 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:37.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:37.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:37.417 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:37.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:37.417 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.417 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:37.417 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.418 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:37.418 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:37.418 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 93.527687241999999, 2024-04-26T12:06:37.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:37.418 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:37.418 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.418 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:37.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:37.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:37.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:37.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:37.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:37.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:37.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:37.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:37.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:37.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:37.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:37.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:37.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:37.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:37.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:37.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:37.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:37.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:37.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:37.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:37.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:37.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:37.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:37.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:37.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:37.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:37.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:37.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:37.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:37.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:37.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:37.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:37.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:37.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:37.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:37.422 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.423 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:37.423 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.423 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.423 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:37.423 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:37.423 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 93.527536393999995, 2024-04-26T12:06:37.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:37.423 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:37.423 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:37.423 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:37.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.423 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:37.423 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:37.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:37.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:37.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:37.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:37.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:37.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:37.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:37.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:37.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:37.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:37.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:37.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:37.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:37.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:37.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:37.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:37.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:37.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.426 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:37.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:37.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:37.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:37.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:37.426 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:37.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:37.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:37.426 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.426 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:37.426 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.426 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:37.427 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:37.427 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:37.428 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:37.429 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:37.427+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:37.485 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:06:37.528 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:37.527+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:37.531 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:37.531 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:37.531 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:06:37.531 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:37.540 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:37.629 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:37.628+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:37.681 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:37.681 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:37.682 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:37.682 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:37.682 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:37.690 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:37.734 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:37.733+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:37.794 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:37.794 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:37.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:37.794 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:37.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.794 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:37.795 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:37.795 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.011856369, 2024-04-26T12:06:37.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:06:37.795 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:37.795 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.795 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:37.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:37.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:37.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:37.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:37.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:37.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:06:37.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:37.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:37.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:06:37.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:06:37.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:37.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:06:37.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:06:37.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.797 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.797 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:06:37.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:06:37.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.797 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:37.798 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:06:37.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:06:37.798 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.798 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:37.798 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:37.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:06:37.798 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.798 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:37.798 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:06:37.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:06:37.798 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:37.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:06:37.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:06:37.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:06:37.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:06:37.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:37.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:06:37.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:06:37.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:37.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:06:37.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:06:37.800 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.800 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:37.800 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.800 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:37.800 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:37.800 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.011801048999999, 2024-04-26T12:06:37.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:06:37.801 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:37.801 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.801 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:37.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:37.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:37.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:37.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:37.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:37.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:06:37.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:37.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:37.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:06:37.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:06:37.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:37.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:06:37.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:06:37.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.803 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.803 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:06:37.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:06:37.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.803 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:37.803 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:06:37.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:06:37.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.803 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:37.803 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:06:37.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:06:37.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:37.804 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:06:37.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:06:37.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:37.804 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:06:37.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:06:37.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.804 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:06:37.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:06:37.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:37.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:06:37.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:06:37.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:37.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:06:37.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:06:37.805 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.805 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:37.805 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.806 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:37.806 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:37.806 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.011751031000003, 2024-04-26T12:06:37.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:06:37.806 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:37.806 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.806 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:37.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:37.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:37.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:37.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:37.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:37.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:06:37.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:37.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:06:37.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:06:37.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:37.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:06:37.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:06:37.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:06:37.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:06:37.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:37.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:06:37.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:06:37.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.809 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:37.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:06:37.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:06:37.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.809 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:37.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:06:37.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:06:37.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.809 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:37.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:06:37.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:06:37.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.810 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:06:37.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:06:37.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:37.810 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:06:37.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:06:37.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:37.810 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:06:37.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:06:37.811 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.811 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:37.811 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.811 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.811 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:37.811 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:37.811 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.011716394000004, 2024-04-26T12:06:37.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:06:37.811 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:37.811 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.811 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:37.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.811 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:37.811 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:37.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:37.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:37.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:37.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:06:37.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:37.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:06:37.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:06:37.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:37.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:37.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:06:37.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:06:37.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:06:37.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:37.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:06:37.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:06:37.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:37.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:06:37.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:06:37.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:37.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:06:37.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:06:37.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.815 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.815 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:06:37.815 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:06:37.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.815 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:37.815 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:06:37.815 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:06:37.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.815 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:37.815 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:06:37.815 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:06:37.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.816 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:37.816 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:06:37.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:06:37.816 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.816 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:37.816 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.816 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:37.816 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:37.816 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.011677882000001, 2024-04-26T12:06:37.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:06:37.816 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:37.816 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.817 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:37.817 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:37.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:37.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.817 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:37.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:37.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.817 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:37.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:37.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:37.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:37.818 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:37.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:06:37.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:37.818 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:06:37.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:06:37.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.818 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:06:37.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:06:37.819 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.819 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.819 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:37.819 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:06:37.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:06:37.819 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.819 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.819 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:37.819 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:06:37.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:06:37.819 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.819 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.819 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:37.819 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:06:37.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:06:37.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:06:37.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:06:37.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:37.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:06:37.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:06:37.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:37.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:06:37.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:06:37.821 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.821 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.821 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:37.821 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:06:37.821 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:06:37.821 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.821 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:37.821 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.821 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.821 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.821 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:37.821 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:37.821 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.011647558999996, 2024-04-26T12:06:37.821 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:06:37.822 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:37.822 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.822 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:37.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.822 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:37.822 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:37.822 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.822 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:37.822 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:37.822 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:37.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:06:37.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:37.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:06:37.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:06:37.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:37.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:06:37.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:06:37.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:06:37.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:06:37.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:37.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:06:37.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:06:37.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:37.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:06:37.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:06:37.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:37.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:06:37.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:06:37.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:37.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:06:37.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:06:37.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:06:37.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:06:37.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:37.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:06:37.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:06:37.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:37.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:06:37.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:06:37.826 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.826 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:37.826 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.827 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:37.827 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:37.827 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.011620856999997, 2024-04-26T12:06:37.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:06:37.827 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:37.827 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:37.827 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:37.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:37.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:37.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.828 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:37.828 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:37.828 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.828 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.828 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.828 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:37.828 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:37.828 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.828 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.828 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.828 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:37.828 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:06:37.828 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:06:37.828 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.828 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:37.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:06:37.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:06:37.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:06:37.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:06:37.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:37.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:06:37.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:06:37.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:37.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:06:37.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:06:37.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:37.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:06:37.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:06:37.830 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.830 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:37.830 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.830 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:37.831 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:37.831 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.011578567000001, 2024-04-26T12:06:37.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:06:37.831 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:37.831 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:37.831 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:37.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.831 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:37.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:37.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.831 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:37.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:37.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:37.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:37.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:37.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:06:37.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:06:37.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:37.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:06:37.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:06:37.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.833 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.833 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:06:37.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:06:37.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.833 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:37.833 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:06:37.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:06:37.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.833 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:37.833 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:06:37.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:06:37.834 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.834 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:37.834 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:06:37.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:06:37.834 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.834 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:37.834 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.834 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.834 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:37.834 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:37.834 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.011550489000001, 2024-04-26T12:06:37.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:06:37.835 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:37.835 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:37.835 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:37.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:37.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:37.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:37.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:37.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:37.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:06:37.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:37.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:06:37.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:06:37.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:37.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:06:37.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:06:37.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:06:37.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:06:37.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:37.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:06:37.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:06:37.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:37.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:06:37.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:06:37.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.838 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:37.838 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:06:37.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:06:37.838 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.838 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:37.838 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.838 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.838 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:37.838 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:37.838 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.005555138999995, 2024-04-26T12:06:37.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:06:37.838 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:37.838 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.839 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:37.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:37.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:37.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:37.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:37.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:37.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:06:37.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:37.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:06:37.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:06:37.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:37.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:06:37.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:06:37.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:06:37.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:06:37.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:37.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:06:37.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:06:37.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:37.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:06:37.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:06:37.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:37.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:06:37.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:06:37.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:37.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:06:37.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:06:37.842 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.842 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:37.842 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.842 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:37.842 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:37.842 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.005486172999994, 2024-04-26T12:06:37.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:06:37.842 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:37.843 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.843 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:37.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:37.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:37.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:37.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:37.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:37.844 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:06:37.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.844 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.844 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:37.844 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:06:37.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:06:37.844 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.844 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:37.844 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:06:37.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:06:37.844 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.844 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.844 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:06:37.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:06:37.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:37.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:06:37.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:06:37.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:37.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:37.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:06:37.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:37.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:06:37.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:06:37.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.846 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:37.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:06:37.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:06:37.846 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.846 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:37.846 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.847 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:37.847 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:37.847 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.004991810000007, 2024-04-26T12:06:37.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:06:37.847 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:37.847 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.847 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:37.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:37.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:37.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:37.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:37.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:37.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:37.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:37.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:06:37.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:06:37.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:37.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:06:37.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:06:37.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:06:37.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:06:37.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.850 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:37.850 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:06:37.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:06:37.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.850 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:37.850 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:06:37.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:06:37.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.850 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:37.850 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:06:37.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:06:37.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:37.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:06:37.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:06:37.851 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.851 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:37.851 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.852 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:37.852 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:37.852 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.004953545000006, 2024-04-26T12:06:37.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:06:37.852 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:37.852 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.852 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:37.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:37.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:37.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:37.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:37.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:37.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:37.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:37.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:06:37.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:06:37.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:37.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:06:37.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:06:37.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:06:37.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:06:37.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:37.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:06:37.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:06:37.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:37.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:06:37.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:06:37.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:37.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:06:37.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:06:37.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:37.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:06:37.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:06:37.855 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.855 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:37.855 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.856 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:06:37.856 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:37.856 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.004273659999996, 2024-04-26T12:06:37.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:06:37.856 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:37.856 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:37.856 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:37.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:37.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:37.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:37.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:37.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:37.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:37.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:37.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:06:37.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:06:37.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:37.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:06:37.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:06:37.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:06:37.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:06:37.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:37.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:06:37.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:06:37.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:37.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:06:37.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:06:37.859 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.859 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:37.859 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.859 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:37.859 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:37.859 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.004244481000001, 2024-04-26T12:06:37.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:06:37.859 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:37.859 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:37.859 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:37.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:37.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:37.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:37.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:37.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:37.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:06:37.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:37.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:06:37.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:06:37.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:37.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:06:37.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:06:37.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:06:37.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:06:37.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:37.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:06:37.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:06:37.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:37.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:06:37.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:06:37.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:37.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:06:37.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:06:37.862 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.863 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:37.863 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.863 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:37.863 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:37.863 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.004212670000001, 2024-04-26T12:06:37.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:06:37.863 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:37.863 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:37.863 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:37.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:37.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:37.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:37.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:37.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:37.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:37.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:37.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:37.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:06:37.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:06:37.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:37.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:06:37.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:06:37.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:06:37.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:06:37.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:37.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:06:37.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:06:37.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:37.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:06:37.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:06:37.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:37.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:06:37.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:06:37.866 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.866 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:37.866 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.867 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:37.867 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:37.867 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.004191313999996, 2024-04-26T12:06:37.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:06:37.867 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:37.867 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:37.867 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:37.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:37.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:37.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:37.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:37.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:37.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:37.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:37.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:37.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:06:37.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:06:37.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:37.869 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:06:37.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:06:37.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.869 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.869 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:06:37.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:06:37.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.869 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:37.869 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:06:37.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:06:37.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.869 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:37.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:06:37.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:06:37.870 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.870 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:37.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:06:37.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:06:37.870 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.870 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:37.870 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.870 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.870 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:06:37.870 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:37.870 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.004162860999998, 2024-04-26T12:06:37.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:06:37.871 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:37.871 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:37.871 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:37.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:37.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:37.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:37.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:37.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.872 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:37.872 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:37.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:37.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.872 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:37.872 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:06:37.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:06:37.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.872 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:37.872 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:06:37.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:06:37.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:06:37.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:06:37.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:37.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:06:37.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:06:37.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:37.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:06:37.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:06:37.873 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.873 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:37.874 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.874 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:06:37.874 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:37.874 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.003441054999996, 2024-04-26T12:06:37.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:06:37.874 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:37.874 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:37.874 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:37.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:37.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:37.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:37.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:37.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:37.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:06:37.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:37.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:37.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:06:37.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:06:37.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:06:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:06:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:06:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:06:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:06:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:06:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:06:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:06:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:06:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 88.286514452000006, 2024-04-26T12:06:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:06:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:37.878 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:37.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.878 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:37.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:37.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.878 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.878 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:37.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:37.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:37.878 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.878 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:37.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:06:37.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:06:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:06:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:06:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:06:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:06:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:06:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:06:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:06:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:06:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:06:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:06:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:06:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:06:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:06:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:06:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:06:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:06:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:06:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:06:37.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:37.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:37.882 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:37.882 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:06:37.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:06:37.882 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.882 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:37.882 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.882 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:37.882 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:37.882 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:37.884 INFO:tasks.workunit.client.0.smithi052.stderr:Updating files: 96% (12009/12492) Updating files: 97% (12118/12492) Updating files: 98% (12243/12492) Updating files: 99% (12368/12492) Updating files: 100% (12492/12492) Updating files: 100% (12492/12492), done. 2024-04-26T12:06:37.884 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:37.885 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:37.882+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:37.984 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:37.983+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:37.992 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:37.992 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:37.992 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:06:37.992 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:38.001 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:38.085 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:38.084+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:38.142 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:38.143 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:38.143 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:38.143 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:38.143 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:38.151 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:38.195 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:38.194+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:38.255 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:38.255 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:38.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:38.255 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:38.255 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.255 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:38.255 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:38.255 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 104.397677698, 2024-04-26T12:06:38.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:38.255 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:38.255 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.255 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:38.256 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:38.256 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:38.256 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:38.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.256 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:38.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.256 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:38.256 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:38.256 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.256 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:38.256 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:38.256 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:38.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:38.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:38.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:38.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:38.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:38.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:38.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:38.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.258 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:38.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:38.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.258 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:38.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:38.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:38.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.258 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:38.259 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:38.259 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:38.259 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.259 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:38.259 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:38.259 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:38.259 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.259 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:38.259 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:38.259 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:38.259 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.260 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:38.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:38.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:38.260 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:38.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:38.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:38.260 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:38.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:38.260 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.261 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:38.261 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.261 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:38.261 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:38.261 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 104.397571802, 2024-04-26T12:06:38.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:38.261 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:38.261 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.261 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:38.261 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:38.261 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:38.261 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:38.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.262 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:38.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:38.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:38.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:38.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:38.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.263 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:38.263 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:38.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.263 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:38.263 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:38.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:38.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.263 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:38.263 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:38.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:38.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:38.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:38.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:38.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:38.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:38.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:38.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:38.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:38.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:38.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:38.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:38.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:38.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:38.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:38.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:38.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:38.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:38.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:38.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:38.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:38.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:38.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:38.266 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.267 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:38.267 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.267 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:38.267 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:38.267 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 104.397556822, 2024-04-26T12:06:38.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:38.267 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:38.267 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.267 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:38.267 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:38.267 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:38.268 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:38.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.268 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:38.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:38.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:38.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:38.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:38.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:38.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:38.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:38.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:38.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:38.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:38.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:38.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:38.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:38.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:38.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:38.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 104.397512947, 2024-04-26T12:06:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.274 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:38.274 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:38.274 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:38.274 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:38.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.274 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:38.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.274 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:38.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:38.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:38.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:38.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:38.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:38.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 104.397427283, 2024-04-26T12:06:38.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:38.280 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:38.280 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.280 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:38.280 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:38.280 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:38.280 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:38.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.280 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:38.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:38.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:38.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:38.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:38.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:38.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:38.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:38.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:38.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:38.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:38.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:38.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:38.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:38.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:38.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:38.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:38.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:38.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:38.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:38.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:38.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:38.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:38.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:38.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 94.471522996999994, 2024-04-26T12:06:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 94.471486901999995, 2024-04-26T12:06:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 94.471449218000004, 2024-04-26T12:06:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 94.471427878, 2024-04-26T12:06:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:38.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:38.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:38.307 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.307 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:38.307 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.307 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:38.307 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:38.307 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 94.471405611999998, 2024-04-26T12:06:38.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:38.307 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:38.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:38.309 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:38.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:38.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.311 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:38.311 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:38.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:38.311 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.311 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:38.311 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:38.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:38.311 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.313 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:38.313 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:38.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:38.313 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.313 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:38.313 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.313 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.313 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:38.313 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:38.313 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 94.471383990000007, 2024-04-26T12:06:38.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:38.314 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:38.314 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.314 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:38.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:38.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:38.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:38.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:38.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:38.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:38.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:38.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:38.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:38.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:38.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:38.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.318 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:38.318 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:38.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:38.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.319 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:38.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:38.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.319 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:38.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:38.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:38.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.320 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.320 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:38.320 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:38.320 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:38.320 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.320 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:38.320 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.320 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.320 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.320 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:38.320 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:38.320 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 94.471357424000004, 2024-04-26T12:06:38.320 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:38.321 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:38.321 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.321 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:38.321 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.321 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:38.321 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:38.321 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.321 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.321 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.321 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:38.321 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:38.321 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.321 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.322 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:38.322 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:38.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.322 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.322 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:38.322 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:38.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:38.322 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.322 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:38.322 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:38.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:38.322 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:38.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:38.323 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:38.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:38.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:38.323 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:38.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:38.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:38.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:38.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:38.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:38.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:38.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:38.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:38.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:38.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:38.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:38.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:38.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:38.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:38.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:38.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:38.325 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.325 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:38.325 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.325 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:38.326 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:38.326 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 94.471318912000001, 2024-04-26T12:06:38.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:38.326 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:38.326 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.326 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:38.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:38.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:38.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:38.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:38.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:38.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:38.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:38.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:38.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:38.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:38.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:38.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:38.328 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.328 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.328 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:38.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:38.328 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.328 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:38.328 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:38.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:38.328 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.328 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:38.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:38.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:38.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:38.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:38.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:38.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:38.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:38.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:38.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:38.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:38.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:38.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:38.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:38.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:38.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:38.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:38.330 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.330 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:38.331 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.331 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:38.331 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:38.331 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 94.471290738999997, 2024-04-26T12:06:38.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:38.331 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:38.331 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.331 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:38.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:38.331 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:38.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.332 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:38.332 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:38.332 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.332 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:38.332 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:38.332 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.332 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:38.332 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:38.332 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:38.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:38.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:38.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:38.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:38.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:38.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:38.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:38.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:38.334 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.334 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.334 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:38.334 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:38.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:38.334 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.334 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.334 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:38.334 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:38.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:38.334 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.334 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.334 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:38.334 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:38.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:38.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:38.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:38.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:38.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:38.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:38.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:38.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:38.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:38.336 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.336 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:38.336 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.336 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:38.336 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:38.336 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 94.471256174999994, 2024-04-26T12:06:38.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:38.336 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:38.336 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.336 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:38.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:38.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:38.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:38.337 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:38.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:38.337 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:38.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:38.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:38.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:38.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:38.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:38.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:38.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:38.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:38.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:38.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:38.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:38.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:38.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:38.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:38.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:38.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:38.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:38.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.340 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:38.340 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:38.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:38.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.340 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.340 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:38.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:38.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.340 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:38.340 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:38.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:38.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:38.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:38.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:38.341 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.341 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:38.341 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.341 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:38.342 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:38.342 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 94.470381395000004, 2024-04-26T12:06:38.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:38.342 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:38.342 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.342 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:38.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:38.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:38.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:38.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:38.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:38.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:38.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:38.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:38.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:38.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:38.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:38.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:38.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:38.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:38.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:38.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:38.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:38.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:38.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:38.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:38.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:38.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:38.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:38.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:38.346 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.346 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:38.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:38.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:38.346 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.346 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:38.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:38.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:38.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:38.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:38.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:38.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:38.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:38.347 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.347 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:38.348 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.348 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:38.348 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:38.348 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 94.470342435999996, 2024-04-26T12:06:38.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:38.348 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:38.348 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.348 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:38.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:38.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:38.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:38.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:38.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:38.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:38.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:38.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:38.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:38.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:38.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:38.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:38.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:38.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:38.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:38.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:38.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:38.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:38.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:38.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:38.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:38.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:38.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:38.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:38.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:38.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:38.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:38.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:38.353 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.353 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:38.353 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:38.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:38.353 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.353 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:38.353 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:38.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:38.353 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.353 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:38.353 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.354 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:38.354 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:38.354 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 94.470306964000002, 2024-04-26T12:06:38.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:38.354 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:38.354 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.354 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:38.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:38.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:38.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:38.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:38.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:38.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:38.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:38.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:38.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:38.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:38.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:38.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:38.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.357 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.357 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:38.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:38.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.357 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:38.357 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:38.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:38.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:38.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:38.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:38.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:38.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:38.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:38.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:38.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:38.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:38.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:38.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:38.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:38.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:38.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:38.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:38.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:38.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:38.360 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.360 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:38.360 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.360 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:38.360 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:38.360 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 94.470228274999997, 2024-04-26T12:06:38.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:38.360 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:38.360 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.360 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:38.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:38.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:38.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:38.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:38.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:38.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:38.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:38.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.362 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:38.362 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:38.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:38.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.362 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:38.362 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:38.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:38.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:38.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:38.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:38.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:38.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:38.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:38.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:38.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:38.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 94.470077427000007, 2024-04-26T12:06:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:38.369 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:38.371 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:38.369+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:38.371 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:38.472 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:38.471+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:38.475 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:38.476 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:38.476 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:06:38.476 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:38.483 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-26T12:06:38.486 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:38.573 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:38.571+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:38.589 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:38.589 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:38.589 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:38.589 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:38.589 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:38.599 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:38.683 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:38.682+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:38.742 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:38.742 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:38.742 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:38.742 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:38.742 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.742 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:38.742 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:38.742 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.959646598000006, 2024-04-26T12:06:38.742 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:06:38.742 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:38.743 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.743 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:38.743 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.743 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:38.743 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:38.743 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.743 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.743 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.743 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:38.743 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:38.743 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.743 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.743 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.743 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:38.744 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:06:38.744 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:38.744 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.744 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.744 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:38.744 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:06:38.744 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:06:38.744 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.744 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.744 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:38.744 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:06:38.744 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:06:38.744 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.744 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.744 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.745 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:06:38.745 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:06:38.745 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.745 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.745 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:38.745 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:06:38.745 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:06:38.745 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.745 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.745 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:38.745 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:38.745 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:06:38.745 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.745 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.746 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:38.746 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:06:38.746 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:06:38.746 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.746 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.746 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:38.746 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:06:38.746 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:06:38.746 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.746 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.746 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.746 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:06:38.746 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:06:38.746 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.747 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.747 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:38.747 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:06:38.747 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:06:38.747 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.747 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.747 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:38.747 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:06:38.747 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:06:38.747 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.747 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:38.747 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.747 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.747 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.747 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:38.748 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:38.748 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.959591278000005, 2024-04-26T12:06:38.748 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:06:38.748 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:38.748 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.748 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:38.748 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.748 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:38.748 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:38.748 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.748 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.748 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.748 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:38.748 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:38.749 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.749 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.749 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.749 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:38.749 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:06:38.749 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:38.749 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.749 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.749 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:38.749 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:06:38.749 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:06:38.749 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.749 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.749 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:38.749 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:06:38.750 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:06:38.750 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.750 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.750 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.750 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:06:38.750 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:06:38.750 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.750 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.750 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:38.750 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:06:38.750 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:06:38.750 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.750 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.750 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:38.751 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:06:38.751 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:06:38.751 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.751 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.751 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:38.751 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:06:38.751 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:06:38.751 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.751 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.751 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:38.751 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:06:38.751 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:06:38.751 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.751 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.751 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.751 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:06:38.752 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:06:38.752 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.752 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.752 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:38.752 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:06:38.752 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:06:38.752 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.752 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.752 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:38.752 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:06:38.752 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:06:38.752 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.752 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:38.752 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.752 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.753 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.753 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:38.753 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:38.753 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.959541259999995, 2024-04-26T12:06:38.753 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:06:38.753 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:38.753 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.753 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:38.753 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.753 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:38.753 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:38.753 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.753 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.753 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.753 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:38.754 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:38.754 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.754 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.754 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.754 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:38.754 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:06:38.754 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.754 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.754 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.754 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:38.754 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:06:38.754 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:06:38.754 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.754 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.754 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:38.755 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:06:38.755 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:06:38.755 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.755 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.755 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.755 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:06:38.755 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:06:38.755 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.755 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.755 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:38.755 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:06:38.755 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:06:38.755 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.755 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.756 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:38.756 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:06:38.756 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:06:38.756 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.756 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.756 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:38.756 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:06:38.756 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:06:38.756 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.756 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.756 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:38.756 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:06:38.756 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:06:38.756 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.756 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.756 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.757 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:06:38.757 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:06:38.757 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.757 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.757 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:38.757 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:06:38.757 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:06:38.757 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.757 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.757 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:38.757 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:06:38.757 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:06:38.757 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.757 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:38.757 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.758 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.758 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.758 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:38.758 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:38.758 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.959506622999996, 2024-04-26T12:06:38.758 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:06:38.758 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:38.758 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.758 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:38.758 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.758 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:38.758 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:38.758 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.758 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.759 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.759 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:38.759 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:38.759 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.759 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.759 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.759 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:38.759 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:06:38.759 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.759 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.759 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.759 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:38.759 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:06:38.760 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:06:38.760 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.760 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.760 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:38.760 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:38.760 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:06:38.760 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.760 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.760 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.760 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:06:38.760 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:06:38.760 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.760 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.760 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:38.760 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:06:38.761 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:06:38.761 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.761 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.761 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:38.761 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:06:38.761 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:06:38.761 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.761 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.761 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:38.761 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:06:38.761 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:06:38.761 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.761 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.761 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.761 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:06:38.762 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:06:38.762 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.762 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.762 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:38.762 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:06:38.762 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:06:38.762 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.762 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.762 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:38.762 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:06:38.762 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:06:38.762 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.762 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.762 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:38.763 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:06:38.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:06:38.763 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.763 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:38.763 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.763 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.763 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:38.763 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:38.763 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.959468111000007, 2024-04-26T12:06:38.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:06:38.763 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:38.763 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.763 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:38.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.764 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:38.764 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:38.764 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.764 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.764 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.764 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:38.764 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:38.764 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.764 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.764 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.764 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:38.764 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:38.764 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:38.764 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.765 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.765 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:38.765 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:38.765 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:06:38.765 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.765 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.765 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:38.765 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:06:38.765 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:06:38.765 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.765 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.765 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.765 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:06:38.765 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:06:38.765 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.766 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.766 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:38.766 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:06:38.766 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:06:38.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.766 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.766 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:38.766 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:06:38.766 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:06:38.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.766 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.766 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:38.766 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:06:38.766 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:06:38.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.767 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.767 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.767 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:06:38.767 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:06:38.767 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.767 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.767 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:38.767 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:06:38.767 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:06:38.767 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.767 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.767 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:38.767 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:06:38.767 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:06:38.767 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.768 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.768 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:38.768 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:06:38.770 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:06:38.770 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.770 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:38.770 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.770 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.770 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:38.770 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:38.771 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.959437788000002, 2024-04-26T12:06:38.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:06:38.771 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:38.771 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.771 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:38.771 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.771 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:38.771 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:38.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.771 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.771 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:38.771 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:38.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:38.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:06:38.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:38.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:06:38.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:06:38.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:38.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:06:38.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:06:38.773 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.773 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.773 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.773 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:06:38.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:06:38.773 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.773 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.773 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:38.773 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:06:38.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:06:38.773 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.773 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.773 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:38.773 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:06:38.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:06:38.774 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.774 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.774 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:38.774 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:06:38.774 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:06:38.774 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.774 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.774 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:38.774 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:06:38.774 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:06:38.774 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.774 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.774 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.774 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:06:38.774 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:06:38.775 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:38.775 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:06:38.775 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:06:38.775 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:38.775 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:06:38.775 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:06:38.775 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.775 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:38.775 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.775 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.776 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:38.776 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:38.776 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.959411086000003, 2024-04-26T12:06:38.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:06:38.776 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:38.776 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:38.776 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:38.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:38.776 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:38.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:38.776 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:38.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.777 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:38.777 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:38.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.777 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:38.777 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:06:38.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:06:38.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.777 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:38.777 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:06:38.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:06:38.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:06:38.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:06:38.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:38.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:06:38.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:06:38.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:38.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:06:38.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:06:38.779 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.779 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.779 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:38.779 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:06:38.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:06:38.779 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.779 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:38.779 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.779 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.779 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.779 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:38.779 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:38.779 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.959368796000007, 2024-04-26T12:06:38.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:06:38.780 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:38.780 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:38.780 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:38.780 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.780 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:38.780 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:38.780 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.780 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.780 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.780 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:38.780 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:38.780 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.780 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.780 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.780 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:38.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:38.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.781 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:38.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:06:38.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:06:38.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.781 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:38.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:06:38.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:06:38.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.781 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:06:38.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:06:38.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:38.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:06:38.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:06:38.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:38.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:06:38.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:06:38.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:38.783 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:06:38.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:06:38.783 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.783 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:38.783 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.783 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.783 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:38.783 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:38.783 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.959340717999993, 2024-04-26T12:06:38.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:06:38.783 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:38.783 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:38.783 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:38.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:38.784 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:38.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:38.784 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:38.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:38.784 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:06:38.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.785 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.785 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:38.785 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:06:38.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:06:38.785 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.785 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.785 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:38.785 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:06:38.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:06:38.785 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.785 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.785 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.785 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:06:38.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:06:38.785 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.786 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.786 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:38.786 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:06:38.786 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:06:38.786 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.786 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.786 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:38.786 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:06:38.786 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:06:38.786 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.786 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.786 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:38.786 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:06:38.786 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:06:38.786 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.787 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:38.787 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.787 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.787 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:38.787 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:38.787 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.953345368000001, 2024-04-26T12:06:38.787 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:06:38.787 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:38.787 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.787 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:38.787 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.787 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:38.787 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:38.787 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:38.788 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:38.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:38.788 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:06:38.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:38.788 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:06:38.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:06:38.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:38.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:06:38.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:06:38.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:06:38.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:06:38.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:38.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:06:38.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:06:38.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.790 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.790 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:38.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:06:38.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:06:38.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.790 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.790 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:38.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:06:38.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:06:38.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.790 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.790 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:38.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:06:38.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:06:38.791 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.791 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:38.791 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.791 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:38.791 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:38.791 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.953276402, 2024-04-26T12:06:38.791 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:06:38.791 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:38.791 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.791 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:38.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.791 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:38.791 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:38.791 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.792 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.792 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.792 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:38.792 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:38.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.792 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.792 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.792 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:38.792 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:06:38.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.792 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.792 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.792 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:38.792 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:06:38.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:06:38.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:38.793 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:06:38.793 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:06:38.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.793 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:06:38.793 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:06:38.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:38.793 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:06:38.793 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:06:38.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:38.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:38.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:06:38.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:38.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:06:38.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:06:38.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:38.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:06:38.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:06:38.795 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.795 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:38.795 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.795 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:38.795 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:38.795 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.952782038999999, 2024-04-26T12:06:38.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:06:38.795 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:38.795 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.795 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:38.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:38.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:38.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:38.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:38.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:38.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:38.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.797 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:38.797 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:06:38.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:06:38.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.797 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:38.797 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:06:38.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:06:38.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.797 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.797 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:06:38.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:06:38.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.798 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:38.798 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:06:38.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:06:38.798 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.798 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:38.798 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:06:38.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:06:38.798 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:38.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:06:38.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:06:38.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:38.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:06:38.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:06:38.799 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.799 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:38.799 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.799 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:38.800 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:38.800 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.952743773999998, 2024-04-26T12:06:38.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:06:38.800 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:38.800 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.800 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:38.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:38.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:38.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:38.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:38.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:38.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:38.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:38.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:06:38.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:06:38.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:38.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:06:38.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:06:38.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:06:38.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:06:38.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:38.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:06:38.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:06:38.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:38.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:06:38.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:06:38.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.803 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:38.803 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:06:38.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:06:38.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.803 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:38.803 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:06:38.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:06:38.803 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.803 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:38.803 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.804 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 4 lcod 17'2)", 2024-04-26T12:06:38.804 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:38.804 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.952063889000001, 2024-04-26T12:06:38.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0003591, 2024-04-26T12:06:38.804 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:38.804 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:38.804 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:38.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:38.804 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:38.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:38.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:38.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:38.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787763+0000", 2024-04-26T12:06:38.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:38.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787766+0000", 2024-04-26T12:06:38.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:06:38.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:38.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787775+0000", 2024-04-26T12:06:38.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:06:38.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787782+0000", 2024-04-26T12:06:38.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2189999999999998e-06 2024-04-26T12:06:38.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:38.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788009+0000", 2024-04-26T12:06:38.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000227133 2024-04-26T12:06:38.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:38.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788123+0000", 2024-04-26T12:06:38.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011327 2024-04-26T12:06:38.807 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.807 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:38.807 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.807 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:38.807 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:38.807 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.952034710000007, 2024-04-26T12:06:38.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031148900000000003, 2024-04-26T12:06:38.807 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:38.808 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:38.808 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:38.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:38.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:38.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:38.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787793+0000", 2024-04-26T12:06:38.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:38.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787792+0000", 2024-04-26T12:06:38.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.809 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:38.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787795+0000", 2024-04-26T12:06:38.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:06:38.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.809 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:38.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787802+0000", 2024-04-26T12:06:38.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:06:38.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.809 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.810 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787818+0000", 2024-04-26T12:06:38.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6341000000000002e-05 2024-04-26T12:06:38.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:38.810 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787942+0000", 2024-04-26T12:06:38.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012390200000000001 2024-04-26T12:06:38.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:38.810 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787952+0000", 2024-04-26T12:06:38.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8460000000000003e-06 2024-04-26T12:06:38.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.811 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:38.811 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788104+0000", 2024-04-26T12:06:38.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015250999999999999 2024-04-26T12:06:38.811 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.811 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:38.811 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.811 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.811 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:38.811 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:38.811 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.952002899000007, 2024-04-26T12:06:38.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044991699999999998, 2024-04-26T12:06:38.811 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:38.811 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:38.812 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:38.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:38.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:38.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:38.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:38.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:38.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787824+0000", 2024-04-26T12:06:38.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:38.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:38.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787827+0000", 2024-04-26T12:06:38.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:06:38.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:38.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787836+0000", 2024-04-26T12:06:38.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:06:38.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787841+0000", 2024-04-26T12:06:38.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-06 2024-04-26T12:06:38.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:38.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788159+0000", 2024-04-26T12:06:38.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000318122 2024-04-26T12:06:38.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:38.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788165+0000", 2024-04-26T12:06:38.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:06:38.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:38.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788274+0000", 2024-04-26T12:06:38.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109201 2024-04-26T12:06:38.815 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.815 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:38.815 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.815 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T12:06:38.815 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:38.815 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.951981543000002, 2024-04-26T12:06:38.815 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048581600000000003, 2024-04-26T12:06:38.815 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:38.815 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:38.815 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:38.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.815 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:38.816 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:38.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.816 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:38.816 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:38.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.816 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:38.816 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787846+0000", 2024-04-26T12:06:38.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:06:38.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.816 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:38.816 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787848+0000", 2024-04-26T12:06:38.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.21e-06 2024-04-26T12:06:38.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.817 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:38.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787858+0000", 2024-04-26T12:06:38.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:06:38.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.817 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787868+0000", 2024-04-26T12:06:38.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0015e-05 2024-04-26T12:06:38.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.817 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:38.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788315+0000", 2024-04-26T12:06:38.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044670300000000001 2024-04-26T12:06:38.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:38.818 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788323+0000", 2024-04-26T12:06:38.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:06:38.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:38.818 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788332+0000", 2024-04-26T12:06:38.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:06:38.818 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.818 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:38.818 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.819 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T12:06:38.819 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:38.819 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.951953090000003, 2024-04-26T12:06:38.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048901599999999999, 2024-04-26T12:06:38.819 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:38.819 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:38.819 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:38.819 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.819 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:38.819 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:38.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.819 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.819 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.819 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:38.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:38.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:38.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787874+0000", 2024-04-26T12:06:38.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:38.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:38.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787877+0000", 2024-04-26T12:06:38.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:06:38.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:38.821 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787884+0000", 2024-04-26T12:06:38.821 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:06:38.821 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.821 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.821 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.821 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787897+0000", 2024-04-26T12:06:38.821 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3179e-05 2024-04-26T12:06:38.821 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.821 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.821 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:38.821 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788347+0000", 2024-04-26T12:06:38.821 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044982600000000001 2024-04-26T12:06:38.821 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.821 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.821 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:38.822 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788363+0000", 2024-04-26T12:06:38.822 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6300999999999999e-05 2024-04-26T12:06:38.822 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.822 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:38.822 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.822 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:06:38.822 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:38.822 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 94.951231284000002, 2024-04-26T12:06:38.822 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:06:38.822 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:38.822 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:38.822 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:38.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:38.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:38.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:38.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:38.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:38.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:06:38.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:38.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:38.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:06:38.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:06:38.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:38.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:06:38.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:06:38.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:06:38.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:06:38.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:38.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:06:38.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:06:38.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:38.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:06:38.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:06:38.825 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.825 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:38.825 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.825 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:06:38.826 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:38.826 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 89.234304680999998, 2024-04-26T12:06:38.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:06:38.826 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:38.826 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:38.826 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:38.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:38.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:38.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:38.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:38.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:38.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:38.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:06:38.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:06:38.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:38.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:06:38.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:06:38.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:38.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:06:38.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:06:38.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.828 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.828 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:38.828 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:06:38.828 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:06:38.828 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.828 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.828 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:38.828 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:06:38.828 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:06:38.828 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.828 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.828 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:38.828 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:06:38.828 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:06:38.828 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:38.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:06:38.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:06:38.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:38.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:06:38.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:06:38.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:38.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:06:38.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:06:38.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:38.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:06:38.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:06:38.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:38.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:38.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:38.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:06:38.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:06:38.830 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.830 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:38.830 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.830 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:38.830 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:38.830 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:38.832 INFO:tasks.workunit.client.0.smithi052.stderr:Note: switching to '7d2137f0a666c92a9411c1af5c33e4968be54da6'. 2024-04-26T12:06:38.833 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-04-26T12:06:38.833 INFO:tasks.workunit.client.0.smithi052.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-26T12:06:38.833 INFO:tasks.workunit.client.0.smithi052.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-26T12:06:38.833 INFO:tasks.workunit.client.0.smithi052.stderr:state without impacting any branches by switching back to a branch. 2024-04-26T12:06:38.833 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-04-26T12:06:38.833 INFO:tasks.workunit.client.0.smithi052.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-26T12:06:38.833 INFO:tasks.workunit.client.0.smithi052.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-26T12:06:38.833 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-04-26T12:06:38.833 INFO:tasks.workunit.client.0.smithi052.stderr: git switch -c 2024-04-26T12:06:38.833 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-04-26T12:06:38.833 INFO:tasks.workunit.client.0.smithi052.stderr:Or undo this operation with: 2024-04-26T12:06:38.833 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-04-26T12:06:38.833 INFO:tasks.workunit.client.0.smithi052.stderr: git switch - 2024-04-26T12:06:38.834 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-04-26T12:06:38.834 INFO:tasks.workunit.client.0.smithi052.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-26T12:06:38.834 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-04-26T12:06:38.834 INFO:tasks.workunit.client.0.smithi052.stderr:HEAD is now at 7d2137f0a66 Merge pull request #57086 from zdover23/wip-doc-2024-04-25-backport-57057-to-reef 2024-04-26T12:06:38.834 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:38.835 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:38.831+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:38.835 DEBUG:teuthology.orchestra.run.smithi052:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-26T12:06:38.858 INFO:tasks.workunit.client.0.smithi052.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-26T12:06:38.860 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T12:06:38.860 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-26T12:06:38.932 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:38.931+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:38.940 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:38.940 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:38.940 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:06:38.940 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:38.948 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:39.033 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:39.032+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:39.090 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:39.090 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:39.090 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:39.090 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:39.090 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:39.099 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:39.122 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:06:39.134 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:39.133+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:39.202 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:39.202 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:39.202 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:39.202 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:39.202 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.202 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 105.345132177, 2024-04-26T12:06:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:39.204 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.204 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.204 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.204 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:39.204 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:39.204 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.204 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.204 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.204 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:39.205 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:39.205 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:39.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.205 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.205 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:39.205 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:39.205 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 105.345026281, 2024-04-26T12:06:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:39.210 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:39.210 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:39.210 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:39.210 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.210 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:39.210 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.210 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:39.210 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:39.210 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.210 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.210 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.210 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 105.345011301, 2024-04-26T12:06:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:39.218 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:39.218 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.218 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.218 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:39.218 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:39.218 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:39.218 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.218 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.218 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:39.218 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:39.218 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:39.218 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.218 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.218 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:39.219 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:39.219 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:39.219 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.219 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.219 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:39.219 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:39.219 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:39.219 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.219 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.219 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:39.219 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:39.219 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:39.219 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.219 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.220 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:39.220 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:39.220 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:39.220 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.220 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.220 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:39.220 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:39.220 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:39.220 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.220 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:39.220 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.220 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.220 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.220 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:39.220 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:39.221 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 105.344967426, 2024-04-26T12:06:39.221 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:39.221 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:39.221 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:39.221 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:39.221 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:39.221 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:39.221 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:39.221 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.221 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:39.221 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.221 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:39.221 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:39.221 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.222 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.222 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.222 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:39.222 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:39.222 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.222 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.222 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.222 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:39.222 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:39.222 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:39.222 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.222 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.222 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:39.222 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:39.222 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:39.223 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.223 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.223 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:39.223 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:39.223 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:39.223 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.223 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.223 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:39.223 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:39.223 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:39.223 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.223 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.223 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:39.223 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:39.224 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:39.224 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.224 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.224 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:39.224 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:39.224 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:39.224 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.224 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.224 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:39.224 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:39.224 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:39.224 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.224 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.224 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:39.224 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:39.225 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:39.225 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.225 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.225 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:39.225 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:39.225 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:39.225 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.225 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.225 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:39.225 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:39.225 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:39.225 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.225 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.225 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:39.225 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:39.226 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:39.226 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.226 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:39.226 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.226 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.226 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.226 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:39.226 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:39.226 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 105.344881762, 2024-04-26T12:06:39.226 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:39.226 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:39.226 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:39.226 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:39.226 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:39.227 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:39.227 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:39.227 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.227 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:39.227 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.227 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:39.227 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:39.227 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.227 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.227 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.227 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:39.227 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:39.227 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.227 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.227 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.228 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:39.228 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:39.228 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:39.228 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.228 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.228 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:39.228 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:39.228 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:39.228 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.228 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.228 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:39.228 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:39.228 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:39.228 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.228 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.229 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:39.229 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:39.229 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:39.229 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.229 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.229 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:39.229 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:39.229 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:39.229 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.229 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.229 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:39.229 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:39.229 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:39.229 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.230 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.230 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:39.230 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:39.230 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:39.230 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.230 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.230 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:39.230 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:39.230 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:39.230 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.230 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.230 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:39.230 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:39.231 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:39.231 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.231 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.231 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:39.231 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:39.231 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:39.231 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.231 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.231 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:39.231 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:39.231 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:39.231 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.231 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:39.231 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.232 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.232 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.232 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:39.232 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:39.232 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 95.418977475999995, 2024-04-26T12:06:39.232 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:39.232 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:39.232 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:39.232 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:39.232 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.232 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:39.232 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:39.232 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.232 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.232 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.233 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:39.233 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:39.233 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.233 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.233 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.233 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:39.233 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:39.233 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:39.233 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.233 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.233 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:39.233 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:39.233 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:39.233 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.233 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.234 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:39.234 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:39.234 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:39.234 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.234 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:39.234 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:39.234 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:39.234 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.234 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:39.234 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:39.234 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:39.234 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.235 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.235 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:39.235 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:39.235 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:39.235 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.235 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.235 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:39.235 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:39.235 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:39.235 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.235 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.235 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:39.235 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:39.235 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:39.236 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.236 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.236 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:39.236 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:39.236 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:39.236 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.236 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.236 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:39.236 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:39.236 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:39.236 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.236 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.236 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:39.236 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:39.236 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:39.237 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.237 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:39.237 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.237 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.237 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.237 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:39.237 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:39.237 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 95.418941380999996, 2024-04-26T12:06:39.237 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:39.237 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:39.237 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:39.237 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:39.237 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.237 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:39.238 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:39.238 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.238 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.238 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.238 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:39.238 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:39.238 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.238 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.238 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.238 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:39.238 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:39.238 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:39.238 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.238 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.239 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:39.239 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:39.239 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:39.239 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.239 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.239 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:39.239 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:39.239 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:39.239 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.239 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.239 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:39.239 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:39.239 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:39.239 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.239 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.240 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:39.240 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:39.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:39.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.240 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:39.240 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:39.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:39.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.240 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:39.240 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:39.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:39.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:39.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:39.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:39.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:39.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:39.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:39.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:39.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:39.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:39.242 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.242 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.242 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:39.242 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:39.242 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:39.242 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.242 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:39.242 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.242 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.242 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.242 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:39.242 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:39.242 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 95.418903697000005, 2024-04-26T12:06:39.242 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:39.242 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:39.243 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:39.243 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:39.243 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.243 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:39.243 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:39.243 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.243 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.243 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.243 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:39.243 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:39.243 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.243 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.243 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.243 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:39.244 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:39.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:39.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.244 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:39.244 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:39.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:39.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.244 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:39.244 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:39.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:39.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:39.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:39.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:39.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:39.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:39.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:39.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:39.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:39.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:39.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.246 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:39.246 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:39.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:39.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.246 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:39.246 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:39.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:39.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.246 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:39.246 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:39.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:39.247 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:39.247 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:39.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:39.247 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:39.247 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:39.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:39.247 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.247 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:39.247 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.247 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.248 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:39.248 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:39.248 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 95.418882357000001, 2024-04-26T12:06:39.248 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:39.248 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:39.248 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:39.248 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:39.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.248 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:39.248 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:39.248 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.248 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.248 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:39.249 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:39.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.249 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:39.249 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:39.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:39.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.249 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:39.249 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:39.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:39.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.249 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:39.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:39.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:39.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:39.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:39.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:39.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:39.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:39.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:39.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:39.251 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:39.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:39.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:39.251 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:39.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:39.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:39.251 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:39.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:39.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:39.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:39.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:39.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:39.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:39.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:39.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:39.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:39.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:39.252 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.252 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:39.253 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.253 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.253 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.253 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:39.253 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:39.253 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 95.418860090999999, 2024-04-26T12:06:39.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:39.253 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:39.253 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:39.253 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:39.253 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.253 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:39.253 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:39.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.253 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.254 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.254 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:39.254 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:39.254 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.254 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.254 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:39.254 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:39.254 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:39.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.254 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.254 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:39.254 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:39.254 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:39.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.255 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.255 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:39.255 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:39.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:39.255 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.255 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.255 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:39.255 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:39.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:39.255 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.255 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.255 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:39.255 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:39.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:39.255 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.256 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:39.256 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:39.256 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:39.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.256 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:39.256 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:39.256 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:39.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.256 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:39.256 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:39.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:39.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:39.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:39.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:39.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:39.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:39.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:39.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:39.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:39.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:39.258 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.258 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:39.258 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.258 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:39.258 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:39.258 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 95.418838468999994, 2024-04-26T12:06:39.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:39.258 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:39.258 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:39.258 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:39.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.259 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:39.259 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:39.259 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.259 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.259 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:39.259 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:39.259 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.259 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.259 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:39.259 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:39.259 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:39.259 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:39.260 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:39.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:39.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:39.260 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:39.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:39.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:39.260 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:39.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:39.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.261 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:39.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:39.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:39.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.261 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:39.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:39.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:39.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.261 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:39.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:39.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:39.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:39.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:39.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:39.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:39.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:39.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:39.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:39.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:39.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:39.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.263 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:39.263 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:39.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:39.263 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.263 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:39.263 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.263 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:39.263 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:39.263 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 95.418811903000005, 2024-04-26T12:06:39.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:39.263 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:39.264 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:39.264 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:39.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:39.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:39.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:39.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:39.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:39.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:39.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:39.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:39.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:39.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:39.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:39.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:39.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:39.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:39.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:39.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:39.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:39.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:39.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:39.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:39.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:39.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:39.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:39.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:39.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:39.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.267 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:39.267 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:39.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:39.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.267 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:39.267 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:39.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:39.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.267 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:39.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:39.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:39.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:39.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:39.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:39.268 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.268 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:39.268 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.268 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:39.268 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:39.268 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 95.418773391000002, 2024-04-26T12:06:39.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:39.269 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:39.269 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:39.269 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:39.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:39.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:39.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:39.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:39.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:39.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:39.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:39.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:39.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:39.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:39.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:39.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:39.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:39.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:39.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:39.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:39.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:39.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:39.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:39.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:39.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:39.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:39.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:39.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:39.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:39.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:39.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:39.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:39.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:39.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:39.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:39.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.273 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:39.273 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:39.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:39.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.273 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:39.273 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:39.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:39.273 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.273 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:39.273 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.274 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:39.274 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:39.274 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 95.418745217999998, 2024-04-26T12:06:39.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:39.274 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:39.274 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:39.274 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:39.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.274 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:39.274 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:39.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.274 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:39.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:39.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:39.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:39.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:39.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:39.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:39.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:39.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:39.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:39.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:39.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:39.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:39.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:39.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:39.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:39.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:39.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:39.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:39.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:39.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:39.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:39.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:39.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:39.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:39.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:39.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:39.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:39.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:39.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:39.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:39.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:39.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:39.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:39.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:39.278 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.278 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:39.279 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.279 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:39.279 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:39.279 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 95.418710653999995, 2024-04-26T12:06:39.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:39.279 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:39.279 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:39.279 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:39.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.279 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:39.279 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:39.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:39.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:39.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:39.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:39.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:39.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:39.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:39.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:39.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:39.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:39.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:39.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:39.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:39.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:39.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:39.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:39.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:39.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:39.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:39.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:39.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:39.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:39.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:39.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:39.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:39.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:39.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:39.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:39.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:39.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:39.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:39.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:39.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:39.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:39.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:39.284 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.284 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:39.284 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.284 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:39.284 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:39.285 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 95.417835874000005, 2024-04-26T12:06:39.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:39.285 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:39.285 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:39.285 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:39.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:39.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:39.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:39.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:39.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:39.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:39.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:39.286 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:39.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:39.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:39.286 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:39.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:39.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:39.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:39.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:39.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:39.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:39.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:39.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:39.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:39.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:39.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:39.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:39.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:39.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:39.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:39.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:39.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:39.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:39.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:39.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:39.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:39.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:39.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:39.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:39.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:39.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:39.289 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.289 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:39.289 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.290 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:39.290 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:39.290 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 95.417796914999997, 2024-04-26T12:06:39.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:39.290 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:39.290 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:39.290 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:39.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.290 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:39.290 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:39.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:39.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:39.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:39.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:39.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:39.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:39.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:39.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:39.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:39.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:39.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:39.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:39.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:39.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:39.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:39.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:39.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:39.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:39.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:39.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:39.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:39.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:39.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:39.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:39.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:39.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:39.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:39.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:39.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:39.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:39.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:39.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:39.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:39.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:39.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:39.295 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.295 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:39.295 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.295 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:39.295 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:39.295 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 95.417761443000003, 2024-04-26T12:06:39.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:39.295 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:39.295 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:39.295 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:39.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:39.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:39.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:39.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:39.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:39.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:39.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:39.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:39.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:39.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:39.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:39.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:39.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:39.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:39.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:39.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:39.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:39.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:39.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:39.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:39.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:39.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:39.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:39.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:39.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:39.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:39.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:39.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:39.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:39.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:39.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:39.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:39.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:39.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:39.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:39.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:39.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:39.300 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.300 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:39.300 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.300 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:39.300 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:39.301 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 95.417682753999998, 2024-04-26T12:06:39.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:39.301 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:39.301 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:39.301 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:39.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:39.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:39.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:39.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:39.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:39.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:39.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:39.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:39.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:39.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:39.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:39.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:39.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:39.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:39.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:39.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:39.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:39.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:39.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:39.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:39.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:39.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:39.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:39.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:39.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:39.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:39.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:39.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:39.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:39.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:39.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:39.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:39.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:39.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:39.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:39.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:39.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:39.305 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.305 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:39.306 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.306 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:39.306 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:39.306 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 95.417531905999994, 2024-04-26T12:06:39.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:39.306 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:39.306 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:39.306 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:39.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:39.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:39.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:39.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:39.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:39.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:39.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:39.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:39.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:39.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:39.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:39.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:39.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:39.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:39.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:39.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:39.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:39.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:39.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:39.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:39.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:39.309 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:39.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:39.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:39.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:39.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:39.309 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:39.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:39.309 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.309 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:39.309 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.310 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:39.310 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:39.310 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:39.311 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:39.311 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:39.311 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:06:39.312 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:39.312 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:39.310+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:39.313 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:39.313 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:06:39.314 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:39.314 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:06:39.391 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-26T12:06:39.412 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:39.411+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:39.416 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:39.416 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:39.425 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:39.456 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-26T12:06:39.498 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T12:06:39.499 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T12:06:39.499 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-26T12:06:39.514 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:39.513+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:39.539 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T12:06:39.542 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T12:06:39.542 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-26T12:06:39.560 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-26T12:06:39.562 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-26T12:06:39.562 DEBUG:teuthology.orchestra.run.smithi052:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7d2137f0a666c92a9411c1af5c33e4968be54da6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-26T12:06:39.566 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:39.566 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:39.575 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:39.618 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:39.617+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:39.623 INFO:tasks.workunit.client.0.smithi052.stderr:+ mkdir -p fsstress 2024-04-26T12:06:39.624 INFO:tasks.workunit.client.0.smithi052.stderr:+ pushd fsstress 2024-04-26T12:06:39.625 INFO:tasks.workunit.client.0.smithi052.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T12:06:39.625 INFO:tasks.workunit.client.0.smithi052.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-26T12:06:39.676 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:39.676 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:39.685 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:39.726 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:39.725+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:39.790 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:39.790 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:39.799 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:39.816 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:39.815+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:39.901 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:39.901 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:39.910 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:39.916 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:39.916+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:40.012 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:40.012 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:40.017 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:40.017+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:40.021 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:40.118 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:40.117+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:40.122 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:40.122 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:40.131 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:40.169 INFO:tasks.workunit.client.0.smithi052.stderr:+ tar xzf ltp-full.tgz 2024-04-26T12:06:40.220 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:40.218+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:40.281 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:40.281 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:40.291 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:40.335 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:40.334+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:40.400 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:40.400 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:40.411 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:40.455 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:40.454+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:40.497 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:06:40.520 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:40.520 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:40.523 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:40.521+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:40.530 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:40.624 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:40.623+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:40.681 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:40.681 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:40.691 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:40.734 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:40.733+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:40.797 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:40.797 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:40.806 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:40.850 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:40.849+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:40.915 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:40.915 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:40.925 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:40.927 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:40.926+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:41.027 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:41.026+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:41.072 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:41.072 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:41.082 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:41.129 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:41.128+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:41.185 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~24s 2024-04-26T12:06:41.230 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:41.229+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:41.235 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:41.235 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:41.245 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:41.314 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:06:41.330 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:41.329+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:41.356 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:41.356 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:41.366 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:41.435 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:41.433+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:41.453 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:41.454 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:41.454 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:06:41.472 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:41.473 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:41.473 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:41.473 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:41.473 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:41.473 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:41.473 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:41.475 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:06:41.476 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:06:41.482 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:41.485 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-26T12:06:41.535 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:41.533+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:41.593 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:41.593 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:41.593 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:41.593 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:41.593 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.593 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:41.593 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:41.593 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 107.73561368, 2024-04-26T12:06:41.593 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:41.593 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:41.594 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:41.594 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:41.594 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:41.594 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:41.594 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:41.594 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.594 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:41.594 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.594 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:41.594 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:41.594 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.594 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.594 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.595 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:41.595 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:41.595 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.595 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.595 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:41.595 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:41.595 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:41.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.595 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.595 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:41.595 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:41.595 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:41.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.595 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.596 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:41.596 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:41.596 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:41.596 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.596 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.596 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:41.596 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:41.596 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:41.597 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.597 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.597 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:41.597 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:41.597 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:41.597 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.597 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.597 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:41.597 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:41.597 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:41.597 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.597 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.597 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:41.597 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:41.598 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:41.598 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.598 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.598 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:41.598 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:41.598 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:41.598 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.598 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.598 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:41.598 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:41.598 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:41.598 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.599 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.599 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:41.599 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:41.599 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:41.599 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.599 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.599 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:41.599 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:41.599 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:41.599 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.599 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:41.599 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.599 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.599 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.600 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:41.600 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:41.600 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 107.73550778400001, 2024-04-26T12:06:41.600 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:41.600 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:41.600 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:41.600 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:41.600 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:41.600 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:41.600 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:41.600 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.600 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:41.600 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.600 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:41.601 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:41.601 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.601 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:41.601 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:41.601 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.601 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:41.601 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:41.601 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:41.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.601 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:41.602 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:41.602 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:41.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.602 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.602 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:41.602 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:41.602 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:41.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.602 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.602 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:41.602 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:41.602 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:41.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.603 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.603 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:41.603 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:41.603 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:41.603 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.603 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.603 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:41.603 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:41.603 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:41.603 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.603 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.604 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:41.604 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:41.604 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:41.604 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.604 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.604 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:41.604 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:41.604 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:41.604 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.604 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.604 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:41.604 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:41.604 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:41.604 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.605 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.605 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:41.605 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:41.605 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:41.605 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.605 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.605 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:41.605 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:41.605 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:41.605 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.605 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:41.605 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.605 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.605 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.605 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:41.606 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:41.606 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 107.735492804, 2024-04-26T12:06:41.606 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:41.606 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:41.606 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:41.606 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:41.606 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:41.606 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:41.606 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:41.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.606 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:41.606 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.606 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:41.606 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:41.607 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.607 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.607 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:41.607 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:41.607 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.607 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.607 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:41.607 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:41.607 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:41.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.607 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.607 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:41.608 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:41.608 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:41.608 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.608 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.608 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:41.608 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:41.608 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:41.608 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.608 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.608 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:41.608 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:41.608 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:41.608 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.608 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.609 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:41.609 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:41.609 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:41.609 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.609 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.609 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:41.609 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:41.609 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:41.609 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.609 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.609 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:41.609 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:41.609 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:41.609 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.609 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.610 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:41.610 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:41.610 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:41.610 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.610 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.610 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:41.610 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:41.610 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:41.610 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.610 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.610 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:41.610 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:41.610 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:41.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.611 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.611 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:41.611 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:41.611 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:41.611 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.611 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:41.611 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.611 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.611 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:41.611 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:41.611 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 107.735448929, 2024-04-26T12:06:41.611 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:41.611 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:41.612 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:41.612 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:41.612 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:41.612 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:41.612 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:41.612 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.612 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:41.612 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.612 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:41.612 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:41.612 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.612 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.612 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.612 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:41.613 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:41.613 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.613 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.613 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.613 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:41.613 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:41.613 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:41.613 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.613 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.613 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:41.613 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:41.613 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:41.613 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.614 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.614 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:41.614 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:41.614 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:41.614 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.614 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.614 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:41.614 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:41.614 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:41.614 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.614 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.614 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:41.615 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:41.615 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:41.615 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.615 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.615 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:41.615 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:41.615 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:41.615 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.615 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.615 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:41.615 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:41.615 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:41.615 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.615 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.616 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:41.616 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:41.616 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:41.616 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.616 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.616 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:41.616 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:41.616 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:41.616 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.616 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.616 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:41.616 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:41.616 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:41.616 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.617 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.617 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:41.617 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:41.617 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:41.617 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.617 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:41.617 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.617 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.617 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.617 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:41.617 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:41.617 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 107.735363265, 2024-04-26T12:06:41.617 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:41.617 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:41.618 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:41.618 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:41.618 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:41.618 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:41.618 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:41.618 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.618 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:41.618 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.618 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:41.619 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:41.619 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.619 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.619 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.620 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:41.620 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:41.620 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.620 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.620 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.620 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:41.620 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:41.620 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:41.620 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.620 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.620 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:41.620 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:41.620 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:41.620 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.621 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.621 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:41.621 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:41.621 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:41.621 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.621 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.621 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:41.621 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:41.621 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:41.621 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.621 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.621 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:41.621 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:41.621 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:41.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.622 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.622 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:41.622 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:41.622 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:41.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.622 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.622 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:41.622 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:41.622 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:41.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.622 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.622 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:41.623 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:41.623 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:41.623 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.623 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.623 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:41.623 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:41.623 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:41.623 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.623 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.623 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:41.623 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:41.623 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:41.623 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.623 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.624 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:41.624 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:41.624 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:41.624 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.624 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:41.624 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.624 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.624 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.624 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:41.624 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:41.624 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 97.809458978999999, 2024-04-26T12:06:41.624 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:41.624 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:41.624 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:41.624 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:41.625 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.625 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:41.625 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:41.625 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.625 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.625 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.625 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:41.625 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:41.625 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.625 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.625 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.625 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:41.625 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:41.625 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:41.626 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.626 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.626 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:41.626 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:41.626 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:41.626 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.626 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.626 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:41.626 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:41.626 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:41.626 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.626 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.626 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:41.626 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:41.627 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:41.627 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.627 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.627 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:41.627 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:41.627 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:41.627 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.627 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.627 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:41.627 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:41.627 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:41.627 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.628 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.628 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:41.628 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:41.628 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:41.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.628 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.628 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:41.628 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:41.628 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:41.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.628 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.628 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:41.628 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:41.628 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:41.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.629 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.629 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:41.629 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:41.629 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:41.629 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.629 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.629 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:41.629 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:41.629 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:41.629 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.629 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:41.629 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.630 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.630 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.630 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:41.630 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:41.630 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 97.809422884, 2024-04-26T12:06:41.630 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:41.630 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:41.630 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:41.630 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:41.630 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.630 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:41.630 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:41.630 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.631 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.631 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:41.631 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:41.631 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.631 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.631 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:41.631 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:41.631 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:41.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.631 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.631 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:41.631 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:41.632 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:41.632 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.632 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.632 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:41.632 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:41.632 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:41.632 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.632 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.632 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:41.632 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:41.632 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:41.632 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.632 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.632 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:41.632 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:41.633 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:41.633 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.633 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.633 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:41.633 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:41.633 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:41.633 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.633 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.633 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:41.633 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:41.633 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:41.633 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.633 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.633 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:41.634 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:41.634 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:41.634 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.634 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.634 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:41.634 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:41.634 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:41.634 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.634 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.634 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:41.634 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:41.634 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:41.634 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.634 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.635 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:41.635 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:41.635 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:41.635 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.635 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:41.635 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.635 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.635 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.635 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:41.635 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:41.635 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 97.809385199999994, 2024-04-26T12:06:41.636 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:41.636 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:41.636 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:41.636 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:41.636 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.636 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:41.636 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:41.636 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.636 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.636 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.636 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:41.636 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:41.637 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.637 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.637 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.637 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:41.637 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:41.637 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:41.637 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.637 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.637 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:41.637 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:41.637 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:41.637 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.637 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.637 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:41.638 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:41.638 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:41.638 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.638 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.638 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:41.638 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:41.638 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:41.638 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.638 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.638 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:41.638 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:41.638 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:41.638 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.638 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.639 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:41.639 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:41.641 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:41.641 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.642 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.642 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:41.642 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:41.642 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:41.642 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.642 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.642 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:41.642 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:41.642 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:41.642 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.642 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.642 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:41.642 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:41.643 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:41.643 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.643 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.643 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:41.643 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:41.643 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:41.643 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.643 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.643 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:41.643 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:41.643 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:41.643 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.643 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:41.643 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.643 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.644 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.644 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:41.644 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:41.644 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 97.809363860000005, 2024-04-26T12:06:41.644 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:41.644 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:41.644 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:41.644 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:41.644 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.644 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:41.644 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:41.644 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.644 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.644 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.645 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:41.645 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:41.645 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.645 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.645 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.645 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:41.645 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:41.645 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:41.645 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.645 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.645 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:41.645 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:41.645 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:41.645 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.645 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.646 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:41.646 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:41.646 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:41.646 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.646 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.646 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:41.646 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:41.646 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:41.646 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.646 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.646 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:41.646 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:41.646 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:41.647 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.647 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.647 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:41.647 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:41.647 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:41.647 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.647 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.647 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:41.647 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:41.647 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:41.647 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.647 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.647 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:41.647 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:41.647 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:41.648 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.648 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.648 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:41.648 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:41.648 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:41.648 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.648 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.648 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:41.648 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:41.648 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:41.648 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.648 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.648 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:41.648 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:41.649 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:41.649 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.649 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:41.649 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.649 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.649 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:41.649 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:41.649 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 97.809341594000003, 2024-04-26T12:06:41.649 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:41.649 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:41.649 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:41.649 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:41.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.650 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:41.650 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:41.650 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.650 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.650 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:41.650 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:41.650 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.650 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.650 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:41.650 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:41.650 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:41.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.651 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:41.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:41.651 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:41.651 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.651 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:41.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:41.651 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:41.651 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.651 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:41.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:41.651 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:41.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.652 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:41.652 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:41.652 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:41.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.652 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:41.652 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:41.652 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:41.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.653 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:41.653 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:41.653 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:41.653 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.653 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.653 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:41.653 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:41.653 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:41.653 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.653 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.653 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:41.653 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:41.653 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:41.653 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.654 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.654 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:41.654 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:41.654 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:41.654 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.654 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.654 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:41.654 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:41.654 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:41.654 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.654 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:41.654 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.654 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.654 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.655 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:41.655 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:41.655 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 97.809319971999997, 2024-04-26T12:06:41.655 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:41.655 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:41.655 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:41.655 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:41.655 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.655 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:41.655 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:41.655 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.655 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.655 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.655 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:41.656 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:41.656 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.656 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:41.656 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:41.656 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:41.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.656 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:41.656 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:41.656 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:41.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.657 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:41.657 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:41.657 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:41.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.657 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:41.657 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:41.657 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:41.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.657 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:41.657 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:41.657 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:41.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.658 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:41.658 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:41.658 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:41.658 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.658 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.658 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:41.658 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:41.659 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:41.659 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.659 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.659 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:41.659 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:41.659 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:41.659 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.659 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.659 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:41.659 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:41.659 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:41.659 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.659 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.659 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:41.659 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:41.660 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:41.660 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.660 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.660 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:41.660 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:41.660 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:41.660 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.660 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:41.660 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.660 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.660 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.660 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:41.660 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:41.660 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 97.809293405999995, 2024-04-26T12:06:41.661 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:41.661 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:41.661 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:41.661 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:41.661 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.661 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:41.661 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:41.661 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.661 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.661 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.661 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:41.661 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:41.661 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.661 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.662 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:41.662 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:41.662 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:41.662 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.662 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:41.662 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:41.662 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:41.662 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.662 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:41.662 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:41.662 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:41.663 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.663 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.663 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:41.663 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:41.663 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:41.663 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.663 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.663 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:41.663 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:41.663 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:41.663 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.663 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.663 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:41.663 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:41.663 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:41.664 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.664 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.664 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:41.664 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:41.664 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:41.664 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.664 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.664 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:41.664 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:41.664 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:41.664 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.664 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.664 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:41.664 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:41.664 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:41.665 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.665 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.665 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:41.665 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:41.665 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:41.665 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.665 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.665 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:41.665 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:41.665 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:41.665 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.665 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:41.665 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.665 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.666 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.666 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:41.666 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:41.666 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 97.809254894000006, 2024-04-26T12:06:41.666 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:41.666 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:41.666 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:41.666 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:41.666 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.666 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:41.666 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:41.666 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.667 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.667 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.667 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:41.667 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:41.667 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.667 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.667 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.667 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:41.667 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:41.667 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:41.667 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.667 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.667 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:41.668 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:41.668 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:41.668 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.668 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.668 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:41.668 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:41.668 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:41.668 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.668 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.668 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:41.668 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:41.668 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:41.668 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.668 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.669 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:41.669 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:41.669 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:41.669 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.669 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.669 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:41.669 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:41.669 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:41.669 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.669 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.669 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:41.669 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:41.669 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:41.669 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.670 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.670 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:41.670 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:41.670 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:41.670 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.670 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.670 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:41.670 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:41.670 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:41.670 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.670 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.670 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:41.670 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:41.670 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:41.671 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.671 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.671 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:41.671 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:41.671 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:41.671 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.671 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:41.671 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.671 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.671 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.671 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:41.671 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:41.671 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 97.809226721000002, 2024-04-26T12:06:41.671 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:41.672 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:41.672 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:41.672 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:41.672 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.672 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:41.672 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:41.672 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.672 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.672 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.672 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:41.672 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:41.672 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.672 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.672 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.672 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:41.673 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:41.673 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:41.673 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.673 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.673 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:41.673 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:41.673 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:41.673 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.673 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.673 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:41.673 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:41.673 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:41.673 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.673 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.674 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:41.674 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:41.674 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:41.674 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.674 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.674 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:41.674 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:41.674 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:41.674 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.674 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.674 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:41.674 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:41.674 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:41.675 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.675 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.675 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:41.675 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:41.675 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:41.675 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.675 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.675 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:41.675 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:41.675 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:41.675 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.675 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.675 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:41.675 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:41.676 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:41.676 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.676 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.676 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:41.676 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:41.676 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:41.676 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.676 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.676 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:41.676 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:41.676 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:41.676 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.676 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:41.676 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.676 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.677 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.677 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:41.677 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:41.677 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 97.809192156999998, 2024-04-26T12:06:41.677 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:41.677 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:41.677 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:41.677 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:41.677 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.677 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:41.678 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:41.678 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.678 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.678 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.678 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:41.678 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:41.678 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.678 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.678 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.678 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:41.678 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:41.678 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:41.678 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.679 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.679 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:41.679 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:41.679 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:41.679 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.679 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.679 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:41.679 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:41.679 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:41.679 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.679 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.679 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:41.679 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:41.679 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:41.679 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.680 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.680 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:41.680 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:41.680 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:41.680 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.680 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.680 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:41.680 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:41.680 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:41.680 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.680 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.680 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:41.680 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:41.681 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:41.681 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.681 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.681 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:41.681 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:41.681 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:41.681 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.681 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.681 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:41.681 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:41.681 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:41.681 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.681 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.681 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:41.682 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:41.682 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:41.682 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.682 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.682 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:41.682 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:41.682 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:41.682 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.682 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:41.682 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.682 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.682 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.682 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:41.682 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:41.683 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 97.808317376999995, 2024-04-26T12:06:41.683 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:41.683 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:41.683 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:41.683 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:41.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.683 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:41.683 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:41.683 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.683 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:41.683 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:41.683 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.684 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.684 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:41.684 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:41.684 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:41.684 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.684 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.684 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:41.684 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:41.684 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:41.684 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.684 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.684 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:41.684 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:41.684 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:41.685 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.685 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.685 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:41.685 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:41.685 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:41.685 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.685 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.685 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:41.685 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:41.685 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:41.685 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.685 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.685 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:41.685 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:41.686 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:41.686 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.686 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.686 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:41.686 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:41.686 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:41.686 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.686 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.686 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:41.686 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:41.686 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:41.686 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.686 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.686 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:41.687 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:41.687 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:41.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.687 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.687 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:41.687 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:41.687 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:41.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.687 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.687 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:41.687 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:41.687 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:41.687 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.688 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:41.688 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.688 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.688 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:41.688 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:41.688 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 97.808278418, 2024-04-26T12:06:41.688 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:41.688 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:41.688 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:41.688 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:41.688 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.689 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:41.689 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:41.689 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.689 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.689 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.689 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:41.689 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:41.689 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.689 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.689 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.689 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:41.689 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:41.689 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:41.689 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.689 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.690 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:41.690 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:41.690 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:41.690 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.690 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:41.690 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:41.690 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:41.690 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.690 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:41.690 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:41.690 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:41.693 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:41.693 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:41.693 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.693 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.693 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:41.693 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:41.693 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:41.693 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.693 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:41.693 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.693 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.693 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.693 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:41.693 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:41.694 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 97.808242946000007, 2024-04-26T12:06:41.694 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:41.694 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:41.694 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:41.694 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:41.694 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.694 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:41.694 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:41.694 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.694 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.694 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.694 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:41.694 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:41.695 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.695 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:41.695 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:41.695 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:41.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.695 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:41.695 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:41.695 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:41.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.696 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:41.696 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:41.696 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:41.696 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.696 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.696 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:41.696 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:41.696 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:41.696 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.696 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.696 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:41.696 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:41.696 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:41.696 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.696 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.697 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:41.697 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:41.697 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:41.697 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.697 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.697 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:41.697 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:41.697 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:41.697 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.697 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.697 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:41.697 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:41.697 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:41.697 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.698 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.698 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:41.698 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:41.698 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:41.698 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.698 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.698 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:41.698 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:41.698 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:41.698 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.698 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.698 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:41.698 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:41.698 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:41.699 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.699 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:41.699 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.699 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.699 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.699 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:41.699 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:41.699 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 97.808164257000001, 2024-04-26T12:06:41.699 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:41.699 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:41.699 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:41.699 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:41.699 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.699 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:41.700 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:41.700 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.700 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.700 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.700 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:41.700 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:41.700 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.700 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.700 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.700 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:41.700 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:41.700 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:41.700 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.700 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.700 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:41.701 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:41.701 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:41.701 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.701 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.701 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:41.701 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:41.701 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:41.701 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.701 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.701 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:41.701 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:41.701 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:41.701 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.701 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.702 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:41.702 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:41.702 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:41.702 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.702 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.702 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:41.702 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:41.702 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:41.702 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.702 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.702 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:41.702 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:41.702 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:41.703 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.703 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.703 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:41.703 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:41.703 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:41.703 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.703 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.703 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:41.703 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:41.703 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:41.703 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.703 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.703 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:41.703 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:41.703 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:41.704 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.704 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.704 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:41.704 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:41.704 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:41.704 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.704 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:41.704 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.704 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.704 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.704 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:41.704 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:41.704 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 97.808013408999997, 2024-04-26T12:06:41.704 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:41.705 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:41.705 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:41.705 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:41.705 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.705 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:41.705 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:41.705 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.705 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.705 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.705 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:41.705 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:41.705 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:41.705 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.705 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.706 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:41.706 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:41.706 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:41.706 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.706 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.706 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:41.706 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:41.706 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:41.706 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.706 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.706 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:41.706 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:41.706 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:41.706 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.707 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:41.707 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:41.707 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:41.707 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.707 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:41.707 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:41.707 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:41.707 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.707 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:41.707 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:41.707 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:41.708 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:41.708 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:41.708 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:41.708 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:41.708 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:41.708 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.708 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:41.708 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.708 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:41.708 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:41.708 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:41.710 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:41.710 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:41.708+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:41.810 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:41.809+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:41.821 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:41.821 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:41.821 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:41.821 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4564.0:1342 4.3c e49/16 4:3d72f87c:::10000000822.00000000:head v 49'13, mlcod=49'11)", 2024-04-26T12:06:41.822 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:41.820509+0000", 2024-04-26T12:06:41.822 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00043540700000000001, 2024-04-26T12:06:41.822 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000437331, 2024-04-26T12:06:41.822 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:41.822 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:41.822 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:41.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:41.822 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:41.822 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.820509+0000", 2024-04-26T12:06:41.822 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:41.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:41.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:41.822 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:41.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.820509+0000", 2024-04-26T12:06:41.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:41.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:41.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:41.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:41.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.820509+0000", 2024-04-26T12:06:41.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:41.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:41.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:41.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:41.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.820514+0000", 2024-04-26T12:06:41.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1710000000000001e-06 2024-04-26T12:06:41.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:41.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:41.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:41.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.820520+0000", 2024-04-26T12:06:41.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:06:41.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:41.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:41.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:41.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.820523+0000", 2024-04-26T12:06:41.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.49e-06 2024-04-26T12:06:41.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:41.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:41.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:41.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.820551+0000", 2024-04-26T12:06:41.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7939000000000001e-05 2024-04-26T12:06:41.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:41.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:41.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:41.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.820563+0000", 2024-04-26T12:06:41.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1456e-05 2024-04-26T12:06:41.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:41.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:41.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:41.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.820925+0000", 2024-04-26T12:06:41.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00036211099999999998 2024-04-26T12:06:41.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:41.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:41.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:41.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.820946+0000", 2024-04-26T12:06:41.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1534000000000001e-05 2024-04-26T12:06:41.825 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:41.825 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:41.825 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:41.826 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:41.826 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-04-26T12:06:41.826 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 1 2024-04-26T12:06:41.826 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:41.831 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:41.911 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:41.910+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:41.978 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:41.979 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:41.979 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:41.979 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:41.979 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:41.988 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:42.033 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:42.032+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:42.098 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:42.099 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:42.099 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:42.099 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:42.099 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.099 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:42.099 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:42.099 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 98.315316101999997, 2024-04-26T12:06:42.099 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:06:42.099 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:42.099 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.099 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:42.099 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.099 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:42.100 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:42.100 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.100 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.100 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.100 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:42.100 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:42.100 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.100 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.100 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.100 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:42.100 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:06:42.100 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:42.100 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.100 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.100 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:42.101 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:06:42.101 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:06:42.101 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.101 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.101 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:42.101 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:06:42.101 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:06:42.101 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.101 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.101 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.101 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:06:42.101 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:06:42.101 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.101 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.102 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:42.102 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:06:42.102 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:06:42.102 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.102 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.102 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:42.102 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:42.102 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:06:42.102 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.102 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.102 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:42.102 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:06:42.102 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:06:42.102 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.103 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.103 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:42.103 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:06:42.103 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:06:42.103 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.103 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.103 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.103 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:06:42.103 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:06:42.103 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.103 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.103 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:42.103 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:06:42.103 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:06:42.103 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.104 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.104 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:42.104 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:06:42.104 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:06:42.104 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.104 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:42.104 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.104 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.104 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.104 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:42.104 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:42.104 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 98.315260781999996, 2024-04-26T12:06:42.104 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:06:42.104 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:42.105 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.105 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:42.105 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.105 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:42.105 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:42.105 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.105 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.105 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.105 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:42.105 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:42.105 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.105 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.105 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.105 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:42.105 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:06:42.106 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:42.106 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.106 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.106 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:42.106 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:06:42.106 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:06:42.106 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.106 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.106 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:42.106 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:06:42.106 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:06:42.106 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.106 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.106 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.107 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:06:42.107 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:06:42.107 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.107 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.107 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:42.107 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:06:42.107 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:06:42.107 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.107 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.107 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:42.107 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:06:42.107 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:06:42.107 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.107 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.108 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:42.108 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:06:42.108 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:06:42.108 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.108 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.108 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:42.108 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:06:42.108 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:06:42.108 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.108 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.108 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.108 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:06:42.108 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:06:42.108 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.108 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.109 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:42.109 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:06:42.109 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:06:42.109 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.109 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.109 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:42.109 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:06:42.109 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:06:42.109 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.109 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:42.109 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.109 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.109 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.109 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:42.110 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:42.110 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 98.315210764, 2024-04-26T12:06:42.110 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:06:42.110 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:42.110 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.110 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:42.110 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.110 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:42.110 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:42.110 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.110 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.110 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.110 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:42.110 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:42.110 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.111 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.111 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.111 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:42.111 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:06:42.111 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.111 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.111 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.111 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:42.111 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:06:42.111 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:06:42.111 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.111 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.111 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:42.111 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:06:42.112 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:06:42.112 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.112 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.112 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.112 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:06:42.112 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:06:42.112 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.112 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.112 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:42.112 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:06:42.112 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:06:42.112 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.112 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.112 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:42.113 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:06:42.113 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:06:42.113 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.113 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.113 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:42.113 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:06:42.113 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:06:42.113 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.113 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.113 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:42.113 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:06:42.113 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:06:42.113 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.113 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.114 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.114 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:06:42.114 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:06:42.114 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.114 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.114 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:42.114 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:06:42.114 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:06:42.114 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.114 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.114 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:42.114 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:06:42.114 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:06:42.114 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.115 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:42.115 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.115 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.115 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.115 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:42.115 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:42.115 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 98.315176127000001, 2024-04-26T12:06:42.115 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:06:42.115 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:42.116 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.116 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:42.116 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.116 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:42.116 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:42.116 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.116 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.117 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.117 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:42.117 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:42.117 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.117 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.117 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.117 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:42.117 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:06:42.117 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.117 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.117 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.117 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:42.117 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:06:42.118 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:06:42.118 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.118 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.118 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:42.118 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:42.118 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:06:42.118 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.118 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.118 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.118 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:06:42.118 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:06:42.118 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.118 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.118 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:42.119 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:06:42.119 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:06:42.119 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.119 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.120 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:42.120 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:06:42.120 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:06:42.120 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.120 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.120 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:42.120 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:06:42.120 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:06:42.120 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.120 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.120 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.120 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:06:42.120 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:06:42.120 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.121 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.121 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:42.121 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:06:42.121 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:06:42.121 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.121 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.121 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:42.121 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:06:42.121 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:06:42.121 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.121 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.121 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:42.121 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:06:42.121 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:06:42.121 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.122 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:42.122 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.122 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.122 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.122 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:42.122 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:42.122 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 98.315137614999998, 2024-04-26T12:06:42.122 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:06:42.122 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:42.122 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.122 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:42.122 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.122 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:42.122 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:42.123 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.123 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.123 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.123 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:42.123 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:42.123 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.123 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.123 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.123 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:42.123 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:42.123 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:42.123 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.123 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.123 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:42.123 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:42.124 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:06:42.124 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.124 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.124 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:42.124 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:06:42.124 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:06:42.124 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.124 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.124 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.124 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:06:42.124 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:06:42.124 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.124 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.124 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:42.125 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:06:42.125 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:06:42.125 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.125 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.125 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:42.125 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:06:42.125 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:06:42.125 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.125 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.125 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:42.125 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:06:42.125 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:06:42.125 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.125 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.125 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.126 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:06:42.126 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:06:42.126 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.126 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.126 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:42.126 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:06:42.126 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:06:42.126 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.126 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.126 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:42.126 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:06:42.126 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:06:42.126 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.126 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.126 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:42.127 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:06:42.127 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:06:42.127 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.127 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:42.127 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.127 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.127 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.127 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:42.127 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:42.127 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 98.315107291999993, 2024-04-26T12:06:42.127 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:06:42.127 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:42.127 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.128 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:42.128 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.128 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:42.128 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:42.128 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.128 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.128 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.128 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:42.128 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:42.128 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.128 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.128 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.128 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:42.129 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:06:42.129 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.129 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.129 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.129 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:42.129 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:06:42.129 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:06:42.129 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.129 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.129 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:42.129 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:06:42.129 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:06:42.129 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.129 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.130 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.130 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:06:42.130 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:06:42.130 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.130 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.130 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:42.130 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:06:42.130 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:06:42.130 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.130 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.130 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:42.130 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:06:42.130 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:06:42.130 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.130 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.131 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:42.131 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:06:42.131 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:06:42.131 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.131 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.131 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:42.131 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:06:42.131 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:06:42.131 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.131 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.131 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.131 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:06:42.132 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:06:42.132 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.132 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.132 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:42.132 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:06:42.132 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:06:42.132 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.132 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.132 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:42.132 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:06:42.132 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:06:42.132 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.132 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:42.132 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.133 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.133 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.133 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:42.133 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:42.133 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 98.315080589999994, 2024-04-26T12:06:42.133 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:06:42.133 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:42.133 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:42.133 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:42.133 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.133 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:42.133 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:42.133 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.133 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.133 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.134 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:42.134 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:42.134 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.134 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.134 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.134 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:42.134 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:42.134 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.134 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.134 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.134 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:42.134 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:06:42.134 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:06:42.134 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.135 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.135 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:42.135 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:06:42.135 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:06:42.135 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.135 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.135 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.135 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:06:42.135 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:06:42.135 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.135 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.135 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:42.135 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:06:42.135 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:06:42.135 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.136 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.136 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:42.136 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:06:42.136 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:06:42.136 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.136 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.136 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:42.136 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:06:42.136 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:06:42.136 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.136 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:42.136 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.136 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.136 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.136 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:42.137 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:42.137 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 98.315038299999998, 2024-04-26T12:06:42.137 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:06:42.137 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:42.137 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:42.137 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:42.137 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.137 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:42.137 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:42.137 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.137 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.137 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.137 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:42.137 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:42.137 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.138 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.138 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.138 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:42.138 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:42.138 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.138 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.138 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.138 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:42.138 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:06:42.138 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:06:42.138 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.138 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.138 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:42.138 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:06:42.138 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:06:42.139 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.139 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.139 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.139 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:06:42.139 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:06:42.139 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.139 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.139 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:42.139 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:06:42.139 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:06:42.139 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.139 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.139 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:42.139 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:06:42.140 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:06:42.140 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.140 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.140 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:42.140 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:06:42.140 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:06:42.140 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.140 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:42.140 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.140 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.140 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.140 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:42.140 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:42.140 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 98.315010221999998, 2024-04-26T12:06:42.141 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002033633, 2024-04-26T12:06:42.141 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:42.141 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:42.141 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:42.141 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.141 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:42.141 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:42.141 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.141 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.141 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.141 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:42.141 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780487+0000", 2024-04-26T12:06:42.141 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.141 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.141 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.142 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:42.142 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780486+0000", 2024-04-26T12:06:42.142 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.142 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.142 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.142 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:42.142 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780492+0000", 2024-04-26T12:06:42.142 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:06:42.142 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.142 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.142 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:42.142 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780500+0000", 2024-04-26T12:06:42.142 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5059999999999998e-06 2024-04-26T12:06:42.142 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.143 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.143 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.143 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780505+0000", 2024-04-26T12:06:42.143 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:06:42.143 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.143 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.143 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:42.143 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780556+0000", 2024-04-26T12:06:42.143 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0908000000000001e-05 2024-04-26T12:06:42.143 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.143 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.143 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:42.143 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780718+0000", 2024-04-26T12:06:42.143 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016205399999999999 2024-04-26T12:06:42.143 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.144 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.144 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:42.144 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782520+0000", 2024-04-26T12:06:42.144 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001802318 2024-04-26T12:06:42.144 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.144 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:42.144 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.144 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.144 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.144 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:42.144 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:42.144 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 98.309014872000006, 2024-04-26T12:06:42.144 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:06:42.144 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:42.144 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.145 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:42.145 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.145 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:42.145 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:42.145 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.145 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.145 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.145 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:42.145 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:42.145 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.145 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.145 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.145 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:42.145 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:06:42.145 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.146 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.146 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.146 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:42.146 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:06:42.146 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:06:42.146 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.146 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.146 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:42.146 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:06:42.146 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:06:42.146 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.146 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.146 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.146 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:06:42.146 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:06:42.147 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.147 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.147 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:42.147 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:06:42.147 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:06:42.147 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.147 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.147 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:42.147 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:06:42.147 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:06:42.147 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.147 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.147 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:42.147 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:06:42.147 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:06:42.148 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.148 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.148 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:42.148 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:06:42.148 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:06:42.148 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.148 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:42.148 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.148 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.148 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.148 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:42.148 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:42.148 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 98.308945906000005, 2024-04-26T12:06:42.148 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:06:42.149 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:42.149 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.149 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:42.149 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.149 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:42.149 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:42.149 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.149 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.149 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.149 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:42.149 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:42.149 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.149 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.149 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.149 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:42.149 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:06:42.150 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.150 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.150 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.150 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:42.150 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:06:42.150 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:06:42.150 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.150 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.150 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:42.150 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:06:42.150 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:06:42.150 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.150 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.150 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.151 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:06:42.151 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:06:42.151 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.151 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.151 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:42.151 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:06:42.151 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:06:42.151 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.151 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.151 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:42.151 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:42.151 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:06:42.151 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.151 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.151 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:42.152 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:06:42.152 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:06:42.152 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.152 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.152 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:42.152 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:06:42.152 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:06:42.152 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.152 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:42.152 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.152 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.152 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.152 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:42.152 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:42.152 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 98.308451543000004, 2024-04-26T12:06:42.153 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:06:42.153 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:42.153 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.153 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:42.153 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.153 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:42.153 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:42.153 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.153 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.153 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.153 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:42.153 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:42.153 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.153 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.153 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.154 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:42.154 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:42.154 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.154 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.154 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.154 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:42.154 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:06:42.154 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:06:42.154 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.154 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.154 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:42.154 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:06:42.154 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:06:42.155 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.155 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.155 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.155 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:06:42.155 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:06:42.155 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.155 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.155 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:42.155 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:06:42.155 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:06:42.155 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.155 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.155 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:42.155 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:06:42.155 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:06:42.156 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.156 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.156 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:42.156 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:06:42.156 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:06:42.156 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.156 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.156 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:42.156 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:06:42.156 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:06:42.156 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.156 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:42.156 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.156 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.156 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.157 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:42.157 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:42.157 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 98.308413278000003, 2024-04-26T12:06:42.157 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:06:42.157 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:42.157 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.157 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:42.157 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.157 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:42.157 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:42.157 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.157 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.157 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.157 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:42.157 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:42.158 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.158 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.158 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.158 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:42.158 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:42.158 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.158 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.158 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.158 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:42.158 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:06:42.158 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:06:42.158 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.158 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.159 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:42.159 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:06:42.159 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:06:42.159 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.159 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.159 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.159 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:06:42.159 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:06:42.159 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.159 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.159 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:42.159 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:06:42.159 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:06:42.159 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.159 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.160 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:42.160 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:06:42.160 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:06:42.160 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.160 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.160 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:42.160 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:06:42.160 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:06:42.160 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.160 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.160 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:42.160 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:06:42.160 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:06:42.160 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.160 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:42.161 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.161 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.161 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.161 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:06:42.161 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:42.161 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 98.306900787999993, 2024-04-26T12:06:42.161 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:06:42.161 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:42.161 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:42.161 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:42.161 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.161 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:42.161 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:42.161 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.161 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.162 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.162 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:42.162 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:42.162 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.162 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.162 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.162 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:42.162 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:06:42.162 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:42.162 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.162 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.162 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:42.162 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:06:42.162 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:06:42.162 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.163 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.163 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:42.163 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:06:42.163 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:06:42.163 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.163 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.163 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.163 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:06:42.163 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:06:42.163 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.163 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.163 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:42.163 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:06:42.164 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:06:42.164 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.164 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.164 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:42.164 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:06:42.164 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:06:42.164 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.164 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:42.164 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.164 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.164 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.164 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T12:06:42.165 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:42.165 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 92.589974185000003, 2024-04-26T12:06:42.165 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018816010000000001, 2024-04-26T12:06:42.165 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:42.165 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.165 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:42.165 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.165 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:42.165 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:42.165 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.165 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.165 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.165 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:42.165 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505523+0000", 2024-04-26T12:06:42.165 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.166 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.166 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.166 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:42.166 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505521+0000", 2024-04-26T12:06:42.166 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999981 2024-04-26T12:06:42.166 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.166 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.166 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:42.166 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505529+0000", 2024-04-26T12:06:42.166 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:06:42.166 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.166 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.166 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:42.166 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505544+0000", 2024-04-26T12:06:42.167 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5498e-05 2024-04-26T12:06:42.167 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.167 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.167 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.167 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505570+0000", 2024-04-26T12:06:42.167 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6186e-05 2024-04-26T12:06:42.167 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.167 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.167 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:42.167 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505625+0000", 2024-04-26T12:06:42.167 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5040000000000002e-05 2024-04-26T12:06:42.167 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.167 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.167 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:42.167 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505774+0000", 2024-04-26T12:06:42.168 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014868800000000001 2024-04-26T12:06:42.168 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.168 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.168 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:42.168 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.505918+0000", 2024-04-26T12:06:42.168 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014382500000000001 2024-04-26T12:06:42.168 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.168 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.168 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:42.168 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.506706+0000", 2024-04-26T12:06:42.168 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078789099999999998 2024-04-26T12:06:42.168 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.168 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.168 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.169 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507340+0000", 2024-04-26T12:06:42.169 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00063385500000000001 2024-04-26T12:06:42.169 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.169 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.169 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:42.169 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507377+0000", 2024-04-26T12:06:42.169 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7557e-05 2024-04-26T12:06:42.169 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.169 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.169 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:42.169 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:09.507404+0000", 2024-04-26T12:06:42.169 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6959999999999999e-05 2024-04-26T12:06:42.169 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.169 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:42.169 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.170 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.170 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.170 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4564.0:1505 4.30 e49/16 4:0fe87386:::100000008d8.00000000:head v 49'27, mlcod=49'25)", 2024-04-26T12:06:42.170 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:41.990629+0000", 2024-04-26T12:06:42.170 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.104867417, 2024-04-26T12:06:42.170 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0026612049999999998, 2024-04-26T12:06:42.170 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:42.170 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.170 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:42.170 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.170 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:42.170 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.990629+0000", 2024-04-26T12:06:42.170 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.170 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.170 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.171 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:42.171 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.990629+0000", 2024-04-26T12:06:42.171 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.171 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.171 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.171 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:42.171 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.990629+0000", 2024-04-26T12:06:42.171 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.171 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.171 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.171 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:42.171 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.990645+0000", 2024-04-26T12:06:42.171 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6311e-05 2024-04-26T12:06:42.171 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.171 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.172 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:42.172 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.990654+0000", 2024-04-26T12:06:42.172 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:06:42.172 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.172 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.172 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.172 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.990658+0000", 2024-04-26T12:06:42.172 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3080000000000001e-06 2024-04-26T12:06:42.172 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.172 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.172 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:42.172 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.990696+0000", 2024-04-26T12:06:42.172 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7926999999999998e-05 2024-04-26T12:06:42.172 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.172 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.173 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:42.173 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.990715+0000", 2024-04-26T12:06:42.173 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8771e-05 2024-04-26T12:06:42.173 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.173 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.173 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:42.173 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.993266+0000", 2024-04-26T12:06:42.173 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025508150000000001 2024-04-26T12:06:42.173 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.173 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.173 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:42.173 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.993291+0000", 2024-04-26T12:06:42.173 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5082000000000001e-05 2024-04-26T12:06:42.173 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.173 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:42.174 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.174 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.174 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.174 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:1553 4.29 4:9656b1fc:::1000000090b.00000000:head [write 0~2562] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:06:42.174 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:42.036775+0000", 2024-04-26T12:06:42.174 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.058722146000000003, 2024-04-26T12:06:42.174 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001561354, 2024-04-26T12:06:42.174 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:42.174 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.174 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:42.174 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:42.174 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:42.174 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 1553 2024-04-26T12:06:42.174 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.175 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:42.175 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.175 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:42.175 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.036775+0000", 2024-04-26T12:06:42.175 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.175 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.175 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.175 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:42.175 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.036775+0000", 2024-04-26T12:06:42.175 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.175 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.175 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.175 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:42.175 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.036774+0000", 2024-04-26T12:06:42.175 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:42.176 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.176 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.176 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:42.176 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.036778+0000", 2024-04-26T12:06:42.176 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7730000000000001e-06 2024-04-26T12:06:42.176 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.176 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.176 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:42.176 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.036787+0000", 2024-04-26T12:06:42.176 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3249999999999997e-06 2024-04-26T12:06:42.177 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.177 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.177 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.177 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.036793+0000", 2024-04-26T12:06:42.177 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:06:42.177 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.177 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.177 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:42.177 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.036836+0000", 2024-04-26T12:06:42.177 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3847000000000002e-05 2024-04-26T12:06:42.177 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.177 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.177 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:42.177 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.036970+0000", 2024-04-26T12:06:42.177 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013316000000000001 2024-04-26T12:06:42.178 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.178 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.178 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:42.178 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.037117+0000", 2024-04-26T12:06:42.178 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014714700000000001 2024-04-26T12:06:42.178 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.178 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.178 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:42.178 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.037714+0000", 2024-04-26T12:06:42.178 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00059693099999999998 2024-04-26T12:06:42.178 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.179 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.179 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.179 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.038288+0000", 2024-04-26T12:06:42.179 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00057465599999999999 2024-04-26T12:06:42.179 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.179 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.179 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:42.179 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.038317+0000", 2024-04-26T12:06:42.179 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8602000000000002e-05 2024-04-26T12:06:42.179 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.179 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.179 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:42.179 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.038336+0000", 2024-04-26T12:06:42.179 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9139000000000001e-05 2024-04-26T12:06:42.179 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.180 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:42.180 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.180 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.180 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.180 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:1594 4.7 4:e23fe23e:::10000000935.00000000:head [write 0~2466] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:06:42.180 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:42.076459+0000", 2024-04-26T12:06:42.180 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.019037429000000002, 2024-04-26T12:06:42.180 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015247819999999999, 2024-04-26T12:06:42.180 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:42.180 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.180 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:42.180 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:42.180 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:42.180 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 1594 2024-04-26T12:06:42.181 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.181 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:42.181 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.181 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:42.181 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.076459+0000", 2024-04-26T12:06:42.181 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.181 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.181 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.181 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:42.181 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.076459+0000", 2024-04-26T12:06:42.181 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.181 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.181 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.181 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:42.182 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.076459+0000", 2024-04-26T12:06:42.182 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.182 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.182 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.182 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:42.182 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.076463+0000", 2024-04-26T12:06:42.182 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2010000000000001e-06 2024-04-26T12:06:42.182 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.182 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.182 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:42.182 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.076471+0000", 2024-04-26T12:06:42.182 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6299999999999998e-06 2024-04-26T12:06:42.182 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.182 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.182 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.183 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.076475+0000", 2024-04-26T12:06:42.183 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3959999999999999e-06 2024-04-26T12:06:42.183 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.183 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.183 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:42.183 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.076503+0000", 2024-04-26T12:06:42.183 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7897000000000001e-05 2024-04-26T12:06:42.183 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.183 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.183 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:42.183 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.076574+0000", 2024-04-26T12:06:42.183 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0722000000000005e-05 2024-04-26T12:06:42.183 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.183 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.184 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:42.184 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.077907+0000", 2024-04-26T12:06:42.184 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001333318 2024-04-26T12:06:42.184 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.184 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.184 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:42.184 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.077947+0000", 2024-04-26T12:06:42.184 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0352999999999998e-05 2024-04-26T12:06:42.184 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.184 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.184 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:42.184 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.077984+0000", 2024-04-26T12:06:42.184 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6845999999999999e-05 2024-04-26T12:06:42.184 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.184 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:42.185 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.185 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.185 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.185 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:1597 4.1c 4:38c6ebbe:::10000000938.00000000:head [write 0~2365] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:06:42.185 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:42.079230+0000", 2024-04-26T12:06:42.185 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.016266659999999999, 2024-04-26T12:06:42.185 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001603047, 2024-04-26T12:06:42.185 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:42.185 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.185 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:42.185 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:42.185 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:42.185 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 1597 2024-04-26T12:06:42.185 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.185 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:42.186 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.186 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:42.186 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.079230+0000", 2024-04-26T12:06:42.186 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.186 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.186 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.186 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:42.186 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.079230+0000", 2024-04-26T12:06:42.186 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.186 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.186 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.186 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:42.186 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.079229+0000", 2024-04-26T12:06:42.186 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:42.187 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.187 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.187 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:42.187 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.079234+0000", 2024-04-26T12:06:42.187 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8470000000000003e-06 2024-04-26T12:06:42.187 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.187 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.187 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:42.187 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.079243+0000", 2024-04-26T12:06:42.187 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.918e-06 2024-04-26T12:06:42.187 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.187 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.187 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.187 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.079252+0000", 2024-04-26T12:06:42.187 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1249999999999999e-06 2024-04-26T12:06:42.188 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.188 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.188 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:42.188 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.079293+0000", 2024-04-26T12:06:42.188 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0395999999999997e-05 2024-04-26T12:06:42.188 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.188 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.188 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:42.188 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.079414+0000", 2024-04-26T12:06:42.188 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012152899999999999 2024-04-26T12:06:42.188 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.188 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.188 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:42.188 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.080745+0000", 2024-04-26T12:06:42.189 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001330758 2024-04-26T12:06:42.189 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.189 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.189 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:42.189 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.080775+0000", 2024-04-26T12:06:42.189 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0429999999999998e-05 2024-04-26T12:06:42.189 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.189 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.189 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:42.189 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.080833+0000", 2024-04-26T12:06:42.189 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7803999999999997e-05 2024-04-26T12:06:42.189 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.189 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:42.189 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.189 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.190 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.190 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:1605 4.29 4:948440df:::10000000941.00000000:head [write 0~2552] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:06:42.190 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:42.087874+0000", 2024-04-26T12:06:42.190 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0076223690000000004, 2024-04-26T12:06:42.190 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001613399, 2024-04-26T12:06:42.190 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:42.190 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.190 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:42.190 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:42.190 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:42.190 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 1605 2024-04-26T12:06:42.190 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.190 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:42.190 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.191 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:42.191 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.087874+0000", 2024-04-26T12:06:42.191 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.191 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.191 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.191 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:42.191 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.087874+0000", 2024-04-26T12:06:42.191 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.191 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.191 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.191 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:42.191 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.087874+0000", 2024-04-26T12:06:42.191 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:42.191 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.191 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.192 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:42.192 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.087879+0000", 2024-04-26T12:06:42.192 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9049999999999996e-06 2024-04-26T12:06:42.192 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.192 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.192 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:42.192 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.087889+0000", 2024-04-26T12:06:42.192 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0781000000000001e-05 2024-04-26T12:06:42.192 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.192 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.192 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.192 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.087894+0000", 2024-04-26T12:06:42.192 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9289999999999997e-06 2024-04-26T12:06:42.192 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.192 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.193 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:42.193 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.087922+0000", 2024-04-26T12:06:42.193 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7915e-05 2024-04-26T12:06:42.193 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.193 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.193 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:42.193 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.088007+0000", 2024-04-26T12:06:42.193 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4401999999999996e-05 2024-04-26T12:06:42.193 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.193 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.193 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:42.193 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.088080+0000", 2024-04-26T12:06:42.193 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3193000000000002e-05 2024-04-26T12:06:42.193 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.193 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.194 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:42.194 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.088480+0000", 2024-04-26T12:06:42.194 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00039991000000000001 2024-04-26T12:06:42.194 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.194 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.194 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.194 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.089444+0000", 2024-04-26T12:06:42.194 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096403000000000005 2024-04-26T12:06:42.194 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.194 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.194 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:42.194 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.089469+0000", 2024-04-26T12:06:42.194 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5446999999999999e-05 2024-04-26T12:06:42.194 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.195 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.195 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:42.195 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.089488+0000", 2024-04-26T12:06:42.195 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8620000000000001e-05 2024-04-26T12:06:42.195 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.195 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:42.195 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.195 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.195 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:42.195 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:42.196 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:42.195+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:42.197 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:42.297 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:42.296+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:42.306 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:42.307 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:42.307 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:06:42.307 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:42.316 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:42.398 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:42.397+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:42.423 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:42.424 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:42.424 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:42.424 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:42.424 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:42.433 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:42.499 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:42.497+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:42.550 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:42.550 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:42.550 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:42.550 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:42.550 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.550 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:42.550 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:42.550 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 108.69249313900001, 2024-04-26T12:06:42.550 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:42.557 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.557 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.557 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.557 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:42.557 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:42.557 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 108.692387243, 2024-04-26T12:06:42.557 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:42.557 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:42.557 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.557 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:42.557 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:42.557 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:42.558 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:42.558 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.558 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:42.558 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.558 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:42.558 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:42.558 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.558 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.558 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.558 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:42.559 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:42.559 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.559 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.559 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.559 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:42.559 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:42.559 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.559 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.559 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.559 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:42.559 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:42.559 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:42.562 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:42.562 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.562 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.562 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:42.562 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:42.562 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:42.562 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.562 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.562 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.562 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:42.562 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:42.563 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.563 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.563 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:42.563 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:42.563 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:42.563 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.563 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.563 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:42.563 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:42.563 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:42.563 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.564 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:42.564 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.564 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.564 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.564 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:42.564 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:42.564 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 108.692372263, 2024-04-26T12:06:42.564 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:42.564 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:42.564 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.564 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:42.566 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:42.566 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.566 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.566 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.566 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:42.566 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:42.566 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.566 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.566 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.566 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:42.566 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.568 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:42.568 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:42.568 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:42.568 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.568 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:42.568 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:42.568 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:42.568 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.568 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:42.568 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.570 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:42.570 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:42.570 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:42.570 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.570 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.570 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:42.570 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:42.570 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:42.570 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.570 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:42.570 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.570 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 108.69232838799999, 2024-04-26T12:06:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.574 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.574 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.574 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:42.574 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:42.574 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.574 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.574 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:42.574 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:42.574 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:42.577 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.577 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.577 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:42.577 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:42.577 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:42.577 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.577 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:42.577 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.577 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.577 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.577 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:42.577 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 108.692242724, 2024-04-26T12:06:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.580 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.580 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:42.580 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:42.580 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:42.580 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.580 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.580 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:42.580 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:42.580 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:42.580 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.580 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.580 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:42.582 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.582 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.582 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:42.582 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:42.582 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:42.582 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.582 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.582 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:42.582 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:42.582 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:42.582 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.583 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.583 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.583 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:42.583 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:42.583 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.583 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.583 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:42.583 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:42.583 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:42.583 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.584 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.584 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:42.584 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:42.584 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:42.584 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.584 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:42.584 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.584 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.584 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.584 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:42.584 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:42.585 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 98.766338438000005, 2024-04-26T12:06:42.585 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:42.585 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:42.585 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.585 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:42.585 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.585 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:42.585 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:42.585 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.586 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.586 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.586 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:42.586 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:42.586 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.586 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.586 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.586 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:42.586 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:42.586 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:42.586 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:42.588 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:42.588 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.588 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.588 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:42.588 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:42.588 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:42.588 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.588 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.588 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:42.588 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:42.588 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:42.588 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 98.766302343000007, 2024-04-26T12:06:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:42.592 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:42.592 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.592 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.592 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.592 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:42.592 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:42.592 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.592 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.593 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.593 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:42.593 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:42.593 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:42.593 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.593 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.593 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:42.593 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:42.593 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.597 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:42.597 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:42.597 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:42.597 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.597 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.597 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:42.597 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:42.597 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:42.597 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.597 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 98.766264659000001, 2024-04-26T12:06:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:42.599 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:42.599 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.599 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.599 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.599 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:42.599 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:42.599 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.599 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.599 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.599 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:42.599 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:42.600 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.600 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.600 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.600 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:42.600 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:42.600 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:42.600 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.600 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.600 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:42.600 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:42.600 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:42.600 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.601 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.601 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:42.601 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:42.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.601 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:42.601 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:42.601 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:42.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.602 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:42.602 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:42.602 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:42.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.602 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.602 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:42.602 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:42.602 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:42.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.602 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.603 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:42.603 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:42.603 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:42.603 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.603 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.603 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.603 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:42.603 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:42.603 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.603 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.603 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:42.604 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:42.604 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:42.604 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.604 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.604 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:42.604 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:42.604 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:42.604 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.604 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:42.604 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.604 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.604 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.605 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:42.605 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:42.605 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 98.766243318999997, 2024-04-26T12:06:42.605 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:42.605 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:42.605 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.605 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:42.605 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.605 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:42.605 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:42.605 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.605 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.606 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.606 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:42.606 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:42.606 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.606 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.606 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:42.606 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:42.606 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.606 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.607 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:42.607 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:42.607 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:42.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.607 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.607 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:42.607 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:42.607 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:42.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.607 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.607 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.608 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:42.608 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:42.608 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.608 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.608 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:42.608 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:42.608 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:42.608 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.608 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.608 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:42.608 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.610 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.610 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:42.610 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:42.610 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.610 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.610 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:42.610 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:42.610 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:42.610 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.610 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.610 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:42.610 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 98.766221052999995, 2024-04-26T12:06:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:42.612 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.612 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:42.612 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:42.612 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.612 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.612 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.612 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:42.612 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:42.612 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.612 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.612 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.613 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:42.613 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:42.613 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.613 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.613 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.613 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:42.613 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:42.613 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:42.613 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.613 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.613 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:42.613 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.615 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.615 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:42.615 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:42.615 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:42.615 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.615 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.615 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:42.615 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:42.615 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:42.615 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.615 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.615 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:42.616 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:42.616 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:42.616 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.616 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.616 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.616 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:42.616 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:42.616 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.616 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.616 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:42.616 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:42.616 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:42.617 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.617 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.617 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:42.617 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:42.617 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:42.617 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.617 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:42.617 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.617 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.617 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.617 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:42.617 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 98.766199431000004, 2024-04-26T12:06:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:42.621 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:42.621 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:42.621 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.621 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.621 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:42.621 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:42.621 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:42.621 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.621 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.621 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:42.621 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:42.621 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.624 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:42.624 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:42.624 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 98.766172865000001, 2024-04-26T12:06:42.624 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:42.624 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:42.624 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.624 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:42.624 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.624 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:42.624 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:42.624 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.624 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.625 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.625 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:42.625 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:42.625 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.625 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.625 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.625 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:42.625 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:42.625 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.625 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.625 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.625 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.630 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:42.630 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:42.630 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 98.766134352999998, 2024-04-26T12:06:42.630 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:42.630 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:42.630 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.630 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:42.630 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.630 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:42.630 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:42.630 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:42.632 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:42.632 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:42.632 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.632 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.632 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:42.632 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:42.632 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:42.632 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.632 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.632 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.632 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.634 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:42.634 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:42.634 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:42.634 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.634 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.634 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:42.634 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:42.634 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:42.634 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.634 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.634 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.634 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:42.635 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:42.635 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.635 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.635 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:42.635 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:42.635 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:42.635 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.635 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.635 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:42.635 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 98.766106179999994, 2024-04-26T12:06:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.637 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:42.637 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.637 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:42.637 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:42.637 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.637 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.637 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.637 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:42.637 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:42.637 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.637 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.637 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.638 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:42.638 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:42.638 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.638 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.638 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.638 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:42.638 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:42.638 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:42.638 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.638 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.638 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:42.638 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.642 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:42.642 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:42.642 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:42.642 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.642 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:42.642 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.642 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.642 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.642 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:42.642 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:42.642 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 98.766071616000005, 2024-04-26T12:06:42.642 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.644 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.644 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:42.644 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:42.644 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.644 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.644 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.644 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:42.644 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:42.644 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:42.644 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.644 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:42.646 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.646 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.646 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:42.646 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:42.646 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:42.646 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.646 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.646 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:42.646 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:42.646 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:42.646 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:42.648 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:42.648 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:42.648 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.648 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.648 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:42.648 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:42.648 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:42.648 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.648 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:42.648 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.648 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.649 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:42.649 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:42.649 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 98.765196836000001, 2024-04-26T12:06:42.649 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:42.649 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:42.649 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.649 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:42.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.649 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:42.649 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.653 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:42.653 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:42.653 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:42.653 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.653 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.653 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:42.653 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:42.653 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:42.653 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.653 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.653 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.653 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:42.654 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:42.654 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.654 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.654 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:42.654 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:42.654 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:42.654 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.654 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.654 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:42.654 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:42.654 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:42.655 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.655 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:42.655 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.655 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.655 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.655 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:42.655 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:42.655 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 98.765157877000007, 2024-04-26T12:06:42.655 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:42.655 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:42.655 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:42.659 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:42.659 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:42.659 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.659 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.659 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:42.659 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:42.659 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:42.659 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.659 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.659 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:42.659 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:42.659 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:42.660 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.660 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.660 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.660 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:42.660 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:42.660 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.660 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.660 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:42.660 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:42.660 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:42.660 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.660 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.660 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:42.661 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:42.661 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:42.661 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.661 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:42.661 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.661 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.661 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.661 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:42.661 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:42.661 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 98.765122405, 2024-04-26T12:06:42.661 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:42.661 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:42.662 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.662 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:42.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.662 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:42.662 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:42.662 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.662 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.662 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:42.662 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:42.662 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.662 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.663 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:42.663 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:42.663 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.663 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.663 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.663 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:42.663 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:42.663 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:42.663 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.663 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.663 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:42.663 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:42.664 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:42.664 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.664 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.664 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.664 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:42.664 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:42.664 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.664 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.664 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:42.664 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:42.664 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:42.664 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.664 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.665 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:42.665 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:42.665 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:42.665 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.665 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.665 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:42.665 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:42.665 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:42.665 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.665 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.665 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:42.665 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:42.666 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:42.666 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.666 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.666 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.666 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:42.666 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:42.666 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.666 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.666 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:42.666 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:42.666 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:42.666 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.666 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.667 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:42.667 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:42.667 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:42.667 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.667 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:42.667 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.667 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.667 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.667 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:42.667 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:42.667 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 98.765043715999994, 2024-04-26T12:06:42.667 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:42.667 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:42.668 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:42.668 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:42.668 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.668 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:42.668 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:42.668 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.668 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.668 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.668 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:42.668 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:42.668 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.668 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.668 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.669 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:42.669 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:42.669 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:42.669 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.669 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.669 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:42.669 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:42.669 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:42.669 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.669 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.669 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:42.670 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:42.670 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:42.670 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.670 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.670 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.670 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:42.670 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:42.670 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.670 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.670 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:42.670 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:42.671 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:42.671 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.671 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.671 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:42.671 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:42.671 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:42.671 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.671 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.671 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:42.671 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:42.671 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:42.671 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.672 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.672 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:42.672 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:42.672 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:42.672 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.672 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.672 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:42.673 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:42.674 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:42.674 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.674 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.674 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:42.674 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:42.674 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:42.674 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.674 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.674 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:42.674 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:42.674 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:42.674 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.674 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:42.675 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.675 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.675 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.675 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:42.675 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:42.675 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 98.764892868000004, 2024-04-26T12:06:42.675 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:42.675 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:42.675 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:42.675 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:42.675 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.675 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:42.675 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:42.676 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.676 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.676 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.676 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:42.676 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:42.676 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:42.676 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.676 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.676 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:42.676 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:42.676 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:42.676 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.677 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.677 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:42.677 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:42.677 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:42.677 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.677 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.677 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:42.677 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:42.677 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:42.677 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.677 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.677 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.677 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:42.678 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:42.678 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.678 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.678 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:42.678 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:42.678 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:42.678 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.678 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.678 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:42.678 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:42.678 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:42.678 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:42.679 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:42.679 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:42.679 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:42.679 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:42.679 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.679 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:42.679 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.679 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:42.679 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:42.679 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:42.681 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:42.679+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:42.681 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:42.782 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:42.781+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:42.791 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:42.791 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:42.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.791 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4564.0:2263 4.18 e49/16 4:1a89f8a9:::10000000c29.00000000:head v 49'47, mlcod=49'45)", 2024-04-26T12:06:42.791 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:42.790298+0000", 2024-04-26T12:06:42.791 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00020959, 2024-04-26T12:06:42.791 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000223694, 2024-04-26T12:06:42.791 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:42.791 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:42.791 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:42.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.792 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:42.792 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.790298+0000", 2024-04-26T12:06:42.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.792 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.792 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.792 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:42.792 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.790298+0000", 2024-04-26T12:06:42.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:42.792 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.792 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.792 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:42.792 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.790297+0000", 2024-04-26T12:06:42.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:42.792 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.792 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:42.793 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.790303+0000", 2024-04-26T12:06:42.793 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3000000000000001e-06 2024-04-26T12:06:42.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:42.793 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.790314+0000", 2024-04-26T12:06:42.793 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1442e-05 2024-04-26T12:06:42.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:42.793 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.790337+0000", 2024-04-26T12:06:42.793 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2705e-05 2024-04-26T12:06:42.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:42.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.790361+0000", 2024-04-26T12:06:42.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4510000000000001e-05 2024-04-26T12:06:42.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:42.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:42.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:42.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.790373+0000", 2024-04-26T12:06:42.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1361e-05 2024-04-26T12:06:42.794 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.794 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:42.794 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.794 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:42.794 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-04-26T12:06:42.794 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 1 2024-04-26T12:06:42.794 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:42.800 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:42.883 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:42.882+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:42.914 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:42.915 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:42.915 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:42.915 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:42.915 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:42.925 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:42.984 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:42.983+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:43.037 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:43.038 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:43.038 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:43.038 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:43.038 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.038 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:43.038 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:43.038 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 99.255247589000007, 2024-04-26T12:06:43.038 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:06:43.038 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:43.038 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.039 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:43.039 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.039 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:43.039 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:43.039 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.039 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.039 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.039 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:43.039 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:43.039 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.039 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.039 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.039 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:43.039 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:06:43.040 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:43.040 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.040 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.040 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:43.040 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:06:43.040 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:06:43.040 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.040 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.040 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:43.040 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:06:43.040 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:06:43.040 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.040 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.041 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.041 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:06:43.041 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:06:43.041 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.041 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.041 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:43.041 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:06:43.041 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:06:43.041 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.041 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.041 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:43.041 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:43.041 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:06:43.041 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.042 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.042 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:43.042 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:06:43.042 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:06:43.042 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.042 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.042 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:43.042 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:06:43.042 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:06:43.042 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.042 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.042 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.042 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:06:43.043 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:06:43.043 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.043 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.043 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:43.043 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:06:43.043 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:06:43.043 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.043 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.043 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:43.043 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:06:43.043 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:06:43.043 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.043 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:43.043 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.043 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.044 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.044 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:43.044 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:43.044 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 99.255192269000005, 2024-04-26T12:06:43.044 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:06:43.044 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:43.044 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.044 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:43.044 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.044 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:43.044 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:43.044 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.044 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.045 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.045 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:43.045 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:43.045 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.045 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.045 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.045 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:43.045 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:06:43.045 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:43.045 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.045 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.045 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:43.045 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:06:43.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:06:43.046 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.046 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.046 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:43.046 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:06:43.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:06:43.046 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.046 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.046 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.046 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:06:43.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:06:43.046 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.046 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.047 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:43.047 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:06:43.047 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:06:43.047 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.047 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.047 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:43.047 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:06:43.047 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:06:43.047 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.047 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.047 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:43.047 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:06:43.047 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:06:43.047 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.047 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.048 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:43.048 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:06:43.048 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:06:43.048 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.048 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.048 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.048 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:06:43.048 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:06:43.048 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.048 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.048 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:43.048 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:06:43.048 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:06:43.048 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.049 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.049 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:43.049 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:06:43.049 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:06:43.049 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.049 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:43.049 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.049 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.049 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.049 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:43.049 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:43.049 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 99.255142250999995, 2024-04-26T12:06:43.049 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025589430000000002, 2024-04-26T12:06:43.049 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:43.050 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.050 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:43.050 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.050 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:43.050 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:43.050 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.050 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.050 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.050 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:43.050 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780286+0000", 2024-04-26T12:06:43.050 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.050 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.050 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.050 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:43.051 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780285+0000", 2024-04-26T12:06:43.051 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.051 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.051 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.051 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:43.051 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780297+0000", 2024-04-26T12:06:43.051 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:06:43.051 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.051 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.051 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:43.051 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780306+0000", 2024-04-26T12:06:43.051 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:06:43.051 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.051 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.052 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.052 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780314+0000", 2024-04-26T12:06:43.052 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0609999999999996e-06 2024-04-26T12:06:43.052 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.052 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.052 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:43.052 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781427+0000", 2024-04-26T12:06:43.052 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001112732 2024-04-26T12:06:43.052 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.052 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.052 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:43.052 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781528+0000", 2024-04-26T12:06:43.053 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010129 2024-04-26T12:06:43.053 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.053 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.053 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:43.053 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781631+0000", 2024-04-26T12:06:43.053 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102954 2024-04-26T12:06:43.053 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.053 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.053 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:43.053 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782714+0000", 2024-04-26T12:06:43.053 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001082375 2024-04-26T12:06:43.053 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.053 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.053 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.054 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782782+0000", 2024-04-26T12:06:43.054 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7743999999999994e-05 2024-04-26T12:06:43.054 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.054 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.054 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:43.054 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782821+0000", 2024-04-26T12:06:43.054 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9181000000000003e-05 2024-04-26T12:06:43.054 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.055 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.055 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:43.055 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782845+0000", 2024-04-26T12:06:43.055 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:06:43.055 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.055 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:43.055 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.055 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.055 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.055 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:43.055 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:43.055 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 99.255107613999996, 2024-04-26T12:06:43.055 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:06:43.055 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:43.056 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.056 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:43.056 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.056 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:43.056 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:43.056 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.056 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.056 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.056 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:43.056 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:43.056 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.056 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.056 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.057 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:43.057 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:06:43.057 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.057 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.057 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.057 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:43.057 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:06:43.057 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:06:43.057 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.057 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.057 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:43.057 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:43.057 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:06:43.057 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.057 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.058 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.058 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:06:43.058 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:06:43.058 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.058 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.058 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:43.058 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:06:43.058 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:06:43.058 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.058 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.058 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:43.058 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:06:43.058 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:06:43.058 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.059 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.059 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:43.059 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:06:43.059 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:06:43.059 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.059 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.059 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.059 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:06:43.059 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:06:43.059 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.059 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.059 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:43.059 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:06:43.059 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:06:43.060 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.060 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.060 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:43.060 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:06:43.060 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:06:43.060 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.060 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.060 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:43.060 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:06:43.060 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:06:43.060 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.060 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:43.060 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.060 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.061 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.061 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:43.061 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:43.061 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 99.255069101999993, 2024-04-26T12:06:43.061 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:06:43.061 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:43.061 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.061 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:43.061 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.061 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:43.061 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:43.061 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.061 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.061 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.061 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:43.062 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:43.062 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.062 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.062 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.062 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:43.062 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:43.062 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:43.062 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.062 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.062 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:43.062 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:43.062 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:06:43.062 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.062 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.063 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:43.063 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:06:43.063 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:06:43.063 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.063 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.063 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.063 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:06:43.063 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:06:43.063 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.063 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.063 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:43.064 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:06:43.064 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:06:43.064 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.064 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.064 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:43.064 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:06:43.064 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:06:43.064 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.064 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.064 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:43.064 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:06:43.064 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:06:43.064 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.065 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.065 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.065 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:06:43.065 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:06:43.065 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.065 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.065 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:43.065 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:06:43.065 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:06:43.065 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.065 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.065 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:43.065 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:06:43.066 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:06:43.066 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.066 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.066 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:43.066 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:06:43.066 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:06:43.066 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.066 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:43.066 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.066 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.066 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.066 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:43.067 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:43.067 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 99.255038779000003, 2024-04-26T12:06:43.067 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:06:43.067 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:43.067 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.067 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:43.067 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.067 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:43.067 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:43.067 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.067 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.067 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.067 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:43.067 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:43.068 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.068 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.068 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.068 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:43.068 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:06:43.068 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.068 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.068 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.068 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:43.068 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:06:43.069 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:06:43.069 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.069 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.069 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:43.069 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:06:43.069 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:06:43.069 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.069 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.069 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.069 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:06:43.069 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:06:43.069 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.069 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.070 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:43.070 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:06:43.070 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:06:43.070 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.070 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.070 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:43.070 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:06:43.070 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:06:43.070 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.070 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.070 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:43.070 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:06:43.070 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:06:43.070 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.071 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.071 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:43.071 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:06:43.071 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:06:43.071 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.071 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.071 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.071 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:06:43.071 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:06:43.071 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.071 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.072 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:43.072 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:06:43.072 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:06:43.072 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.072 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.072 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:43.072 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:06:43.072 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:06:43.072 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.072 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:43.072 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.072 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.072 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.073 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:43.073 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:43.073 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 99.255012077000004, 2024-04-26T12:06:43.073 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:06:43.073 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:43.073 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:43.073 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:43.073 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.073 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:43.073 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:43.073 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.073 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.073 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.073 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:43.074 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:43.074 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.074 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.074 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.074 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:43.074 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:43.074 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.074 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.074 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.074 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:43.074 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:06:43.074 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:06:43.074 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.075 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.075 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:43.075 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:06:43.075 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:06:43.075 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.075 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.075 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.075 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:06:43.075 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:06:43.075 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.075 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.075 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:43.075 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:06:43.075 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:06:43.075 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.076 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.076 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:43.076 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:06:43.076 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:06:43.076 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.076 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.076 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:43.076 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:06:43.076 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:06:43.076 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.076 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:43.076 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.076 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.077 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.077 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:43.077 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:43.077 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 99.254969786999993, 2024-04-26T12:06:43.077 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:06:43.077 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:43.077 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:43.077 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:43.077 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.077 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:43.077 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:43.077 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.077 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.077 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.077 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:43.078 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:43.078 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.078 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.078 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.078 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:43.078 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:43.078 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.078 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.078 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.078 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:43.078 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:06:43.078 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:06:43.078 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.078 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.079 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:43.079 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:06:43.079 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:06:43.079 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.079 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.079 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.079 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:06:43.079 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:06:43.079 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.079 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.079 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:43.079 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:06:43.079 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:06:43.079 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.079 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.080 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:43.080 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:06:43.080 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:06:43.080 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.080 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.080 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:43.080 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:06:43.080 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:06:43.080 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.080 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:43.080 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.080 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.080 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.081 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:43.081 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:43.081 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 99.248946359000001, 2024-04-26T12:06:43.081 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041028999999999996, 2024-04-26T12:06:43.081 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:43.081 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.081 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:43.081 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.081 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:43.081 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:43.081 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.081 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.081 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.081 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:43.081 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786482+0000", 2024-04-26T12:06:43.082 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.082 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.082 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.082 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:43.082 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786481+0000", 2024-04-26T12:06:43.082 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.082 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.082 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.082 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:43.082 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786512+0000", 2024-04-26T12:06:43.082 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0275000000000001e-05 2024-04-26T12:06:43.082 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.082 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.083 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:43.083 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786531+0000", 2024-04-26T12:06:43.083 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9040999999999999e-05 2024-04-26T12:06:43.083 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.083 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.083 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.083 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786539+0000", 2024-04-26T12:06:43.083 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:06:43.083 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.083 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.083 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:43.083 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786597+0000", 2024-04-26T12:06:43.083 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7470999999999999e-05 2024-04-26T12:06:43.083 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.083 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.084 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:43.084 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786614+0000", 2024-04-26T12:06:43.084 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7683999999999999e-05 2024-04-26T12:06:43.084 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.084 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.084 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:43.084 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790553+0000", 2024-04-26T12:06:43.084 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039392079999999996 2024-04-26T12:06:43.084 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.084 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.084 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:43.084 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790585+0000", 2024-04-26T12:06:43.084 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1448000000000001e-05 2024-04-26T12:06:43.084 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.084 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:43.085 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.085 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.085 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.085 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T12:06:43.085 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:43.085 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 99.248877393000001, 2024-04-26T12:06:43.085 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041741720000000003, 2024-04-26T12:06:43.085 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:43.085 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.085 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:43.085 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.085 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:43.085 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:43.085 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.086 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.086 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.086 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:43.086 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786551+0000", 2024-04-26T12:06:43.086 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.086 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.086 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.086 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:43.086 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786550+0000", 2024-04-26T12:06:43.086 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.086 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.086 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.086 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:43.086 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786556+0000", 2024-04-26T12:06:43.087 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:06:43.087 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.087 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.087 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:43.087 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786563+0000", 2024-04-26T12:06:43.087 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-04-26T12:06:43.087 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.087 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.087 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.087 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.786693+0000", 2024-04-26T12:06:43.087 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012971 2024-04-26T12:06:43.087 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.087 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.087 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:43.088 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787069+0000", 2024-04-26T12:06:43.088 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037651999999999998 2024-04-26T12:06:43.088 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.088 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.088 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:43.088 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:43.088 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4099e-05 2024-04-26T12:06:43.088 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.088 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.088 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:43.088 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790687+0000", 2024-04-26T12:06:43.088 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036040529999999999 2024-04-26T12:06:43.088 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.088 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.088 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:43.089 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790725+0000", 2024-04-26T12:06:43.089 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7931e-05 2024-04-26T12:06:43.089 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.089 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:43.089 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.089 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.089 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.089 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:43.089 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:43.089 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 99.248383029999999, 2024-04-26T12:06:43.089 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037224379999999998, 2024-04-26T12:06:43.089 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:43.089 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.090 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:43.090 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.090 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:43.090 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:43.090 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.090 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.090 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.090 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:43.090 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:43.090 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.090 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.090 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.090 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:43.090 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787045+0000", 2024-04-26T12:06:43.091 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.091 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.091 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.091 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:43.091 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787058+0000", 2024-04-26T12:06:43.091 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3084e-05 2024-04-26T12:06:43.091 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.091 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.091 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:43.091 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787070+0000", 2024-04-26T12:06:43.091 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:06:43.091 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.091 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.091 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.091 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787078+0000", 2024-04-26T12:06:43.091 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:06:43.092 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.092 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.092 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:43.092 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787298+0000", 2024-04-26T12:06:43.092 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022053400000000001 2024-04-26T12:06:43.092 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.092 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.092 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:43.092 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787318+0000", 2024-04-26T12:06:43.092 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0032999999999999e-05 2024-04-26T12:06:43.092 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.092 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.092 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:43.092 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790729+0000", 2024-04-26T12:06:43.093 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034108749999999998 2024-04-26T12:06:43.093 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.093 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.093 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:43.093 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790768+0000", 2024-04-26T12:06:43.093 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770999999999999e-05 2024-04-26T12:06:43.093 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.093 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:43.093 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.093 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.093 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.093 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T12:06:43.093 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:43.093 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 99.248344764999999, 2024-04-26T12:06:43.094 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003680071, 2024-04-26T12:06:43.094 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:43.094 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.094 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:43.094 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.094 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:43.094 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:43.094 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.094 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.094 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.094 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:43.094 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787084+0000", 2024-04-26T12:06:43.094 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.095 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.095 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.095 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:43.095 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787083+0000", 2024-04-26T12:06:43.095 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.095 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.095 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.095 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:43.095 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787089+0000", 2024-04-26T12:06:43.095 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:06:43.095 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.095 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.095 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:43.095 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787096+0000", 2024-04-26T12:06:43.095 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-04-26T12:06:43.095 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.096 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.096 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.096 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787100+0000", 2024-04-26T12:06:43.096 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:06:43.096 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.096 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.096 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:43.096 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787149+0000", 2024-04-26T12:06:43.096 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:06:43.096 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.096 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.096 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:43.096 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787167+0000", 2024-04-26T12:06:43.096 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7914000000000002e-05 2024-04-26T12:06:43.097 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.097 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.097 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:43.097 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790724+0000", 2024-04-26T12:06:43.097 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035567749999999999 2024-04-26T12:06:43.097 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.097 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.097 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:43.097 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790764+0000", 2024-04-26T12:06:43.097 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9818999999999999e-05 2024-04-26T12:06:43.097 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.097 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:43.097 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.097 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.097 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.098 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:06:43.098 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:43.098 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 99.246832275000003, 2024-04-26T12:06:43.098 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002382847, 2024-04-26T12:06:43.098 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:43.098 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:06:43.098 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:43.098 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.098 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:43.098 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:43.098 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.098 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.098 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.098 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:43.099 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788596+0000", 2024-04-26T12:06:43.099 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.099 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.099 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.099 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:43.099 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788595+0000", 2024-04-26T12:06:43.099 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:43.099 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.099 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.099 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:43.099 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788606+0000", 2024-04-26T12:06:43.099 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:06:43.099 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.099 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.100 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:43.100 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788621+0000", 2024-04-26T12:06:43.100 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5543999999999999e-05 2024-04-26T12:06:43.100 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.100 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.100 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.100 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788633+0000", 2024-04-26T12:06:43.100 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2159e-05 2024-04-26T12:06:43.100 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.100 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.100 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:43.100 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788684+0000", 2024-04-26T12:06:43.100 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1056e-05 2024-04-26T12:06:43.100 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.101 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.101 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:43.101 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.790979+0000", 2024-04-26T12:06:43.101 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022946160000000002 2024-04-26T12:06:43.101 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.101 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:43.101 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.101 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.101 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.101 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4564.0:1505 4.30 e49/16 4:0fe87386:::100000008d8.00000000:head v 49'27, mlcod=49'25)", 2024-04-26T12:06:43.101 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:41.990629+0000", 2024-04-26T12:06:43.101 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.0447989040000001, 2024-04-26T12:06:43.101 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0026612049999999998, 2024-04-26T12:06:43.101 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:43.101 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.102 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:43.102 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.102 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:43.102 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.990629+0000", 2024-04-26T12:06:43.102 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.102 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.102 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.102 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:43.102 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.990629+0000", 2024-04-26T12:06:43.102 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.102 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.102 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.102 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:43.102 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.990629+0000", 2024-04-26T12:06:43.103 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.103 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.103 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.103 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:43.103 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.990645+0000", 2024-04-26T12:06:43.103 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6311e-05 2024-04-26T12:06:43.103 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.103 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.103 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:43.103 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.990654+0000", 2024-04-26T12:06:43.103 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:06:43.103 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.103 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.103 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.103 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.990658+0000", 2024-04-26T12:06:43.104 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3080000000000001e-06 2024-04-26T12:06:43.104 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.104 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.104 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:43.104 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.990696+0000", 2024-04-26T12:06:43.104 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7926999999999998e-05 2024-04-26T12:06:43.104 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.104 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.104 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:43.104 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.990715+0000", 2024-04-26T12:06:43.104 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8771e-05 2024-04-26T12:06:43.104 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.104 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.104 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:43.104 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.993266+0000", 2024-04-26T12:06:43.105 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025508150000000001 2024-04-26T12:06:43.105 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.105 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.105 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:43.105 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:41.993291+0000", 2024-04-26T12:06:43.105 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5082000000000001e-05 2024-04-26T12:06:43.105 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.105 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:43.105 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.105 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.105 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.105 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:2071 4.10 4:0a9c77cb:::10000000b3c.00000000:head [write 0~1292] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:06:43.105 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:42.579992+0000", 2024-04-26T12:06:43.105 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.455436591, 2024-04-26T12:06:43.105 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002819911, 2024-04-26T12:06:43.105 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:43.106 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.106 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:43.106 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:43.106 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:43.106 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 2071 2024-04-26T12:06:43.106 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.106 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:43.106 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.106 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:43.106 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.579992+0000", 2024-04-26T12:06:43.106 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.107 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.107 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.107 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:43.107 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.579992+0000", 2024-04-26T12:06:43.107 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.107 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.107 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.107 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:43.107 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.579991+0000", 2024-04-26T12:06:43.107 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.107 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.107 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.107 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:43.107 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.580003+0000", 2024-04-26T12:06:43.108 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1637999999999999e-05 2024-04-26T12:06:43.108 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.108 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.108 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:43.108 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.580012+0000", 2024-04-26T12:06:43.108 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8040000000000007e-06 2024-04-26T12:06:43.108 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.108 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.108 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.108 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.580016+0000", 2024-04-26T12:06:43.108 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4399999999999998e-06 2024-04-26T12:06:43.108 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.108 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.108 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:43.109 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.580051+0000", 2024-04-26T12:06:43.109 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4798999999999997e-05 2024-04-26T12:06:43.109 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.109 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.109 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:43.109 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.580163+0000", 2024-04-26T12:06:43.109 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112738 2024-04-26T12:06:43.109 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.109 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.109 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:43.110 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.582702+0000", 2024-04-26T12:06:43.110 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002538354 2024-04-26T12:06:43.110 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.110 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.110 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:43.110 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.582748+0000", 2024-04-26T12:06:43.110 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5927000000000003e-05 2024-04-26T12:06:43.110 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.110 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.110 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:43.110 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.582812+0000", 2024-04-26T12:06:43.110 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3880999999999994e-05 2024-04-26T12:06:43.110 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.110 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:43.111 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.111 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.111 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.111 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:2072 4.0 4:02498e63:::10000000b3d.00000000:head [write 0~1679] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:06:43.111 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:42.580799+0000", 2024-04-26T12:06:43.111 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.45462898000000002, 2024-04-26T12:06:43.111 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022457340000000001, 2024-04-26T12:06:43.111 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:43.111 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.111 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:43.111 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:43.111 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:43.111 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 2072 2024-04-26T12:06:43.111 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.111 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:43.112 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.112 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:43.112 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.580799+0000", 2024-04-26T12:06:43.112 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.112 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.112 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.112 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:43.112 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.580799+0000", 2024-04-26T12:06:43.112 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.112 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.112 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.112 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:43.112 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.580799+0000", 2024-04-26T12:06:43.112 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:43.112 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.113 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.113 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:43.113 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.580803+0000", 2024-04-26T12:06:43.113 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7480000000000001e-06 2024-04-26T12:06:43.113 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.113 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.113 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:43.113 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.580813+0000", 2024-04-26T12:06:43.113 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4870000000000008e-06 2024-04-26T12:06:43.113 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.113 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.113 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.113 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.580818+0000", 2024-04-26T12:06:43.113 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.203e-06 2024-04-26T12:06:43.114 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.114 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.114 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:43.114 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.580847+0000", 2024-04-26T12:06:43.114 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9298999999999998e-05 2024-04-26T12:06:43.114 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.114 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.114 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:43.114 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.580922+0000", 2024-04-26T12:06:43.114 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4908999999999997e-05 2024-04-26T12:06:43.114 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.114 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.114 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:43.114 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.581000+0000", 2024-04-26T12:06:43.114 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7906999999999998e-05 2024-04-26T12:06:43.115 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.115 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.115 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.115 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.581756+0000", 2024-04-26T12:06:43.115 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00075634200000000002 2024-04-26T12:06:43.115 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.115 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.115 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:43.115 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.582977+0000", 2024-04-26T12:06:43.115 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001220781 2024-04-26T12:06:43.115 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.115 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.115 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:43.115 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.583019+0000", 2024-04-26T12:06:43.116 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1656000000000002e-05 2024-04-26T12:06:43.116 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.116 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.116 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:43.116 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.583045+0000", 2024-04-26T12:06:43.116 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6169e-05 2024-04-26T12:06:43.116 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.116 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:43.116 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.116 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.116 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.116 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:2074 4.3b 4:dcaa3baf:::10000000b3f.00000000:head [write 0~1558] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:06:43.116 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:42.582369+0000", 2024-04-26T12:06:43.116 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.453058929, 2024-04-26T12:06:43.117 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0030137800000000002, 2024-04-26T12:06:43.117 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:43.117 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.117 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:43.117 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:43.117 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:43.117 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 2074 2024-04-26T12:06:43.117 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.117 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:43.117 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.117 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:43.117 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.582369+0000", 2024-04-26T12:06:43.117 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.117 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.117 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.118 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:43.118 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.582369+0000", 2024-04-26T12:06:43.118 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.118 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.118 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.118 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:43.118 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.582369+0000", 2024-04-26T12:06:43.118 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:43.118 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.118 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.118 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:43.118 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.582375+0000", 2024-04-26T12:06:43.118 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:06:43.118 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.119 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.119 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:43.119 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.582386+0000", 2024-04-26T12:06:43.119 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0858e-05 2024-04-26T12:06:43.119 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.119 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.119 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.119 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.582391+0000", 2024-04-26T12:06:43.119 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:06:43.119 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.119 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.119 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:43.119 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.582420+0000", 2024-04-26T12:06:43.119 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9512000000000001e-05 2024-04-26T12:06:43.119 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.119 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.120 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:43.120 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.582498+0000", 2024-04-26T12:06:43.120 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7325999999999998e-05 2024-04-26T12:06:43.120 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.120 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.120 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:43.120 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.585314+0000", 2024-04-26T12:06:43.120 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028162730000000002 2024-04-26T12:06:43.120 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.120 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.120 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:43.120 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.585344+0000", 2024-04-26T12:06:43.120 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0636999999999998e-05 2024-04-26T12:06:43.120 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.121 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.121 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:43.121 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.585383+0000", 2024-04-26T12:06:43.121 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8764999999999999e-05 2024-04-26T12:06:43.121 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.121 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:43.121 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.121 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.121 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.121 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4564.0:2082 4.39 e49/16 4:9e6852ca:::10000000b47.00000000:head v 49'37, mlcod=49'35)", 2024-04-26T12:06:43.121 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:42.589060+0000", 2024-04-26T12:06:43.121 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.44636826600000001, 2024-04-26T12:06:43.122 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00239631, 2024-04-26T12:06:43.122 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:43.122 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.122 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:43.122 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.122 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:43.122 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.589060+0000", 2024-04-26T12:06:43.122 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.122 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.122 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.122 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:43.122 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.589060+0000", 2024-04-26T12:06:43.123 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.123 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.123 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.123 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:43.123 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.589060+0000", 2024-04-26T12:06:43.123 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.123 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.123 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.123 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:43.124 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.589068+0000", 2024-04-26T12:06:43.124 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6109999999999994e-06 2024-04-26T12:06:43.124 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.124 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.124 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:43.124 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.589076+0000", 2024-04-26T12:06:43.124 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4970000000000004e-06 2024-04-26T12:06:43.124 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.124 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.124 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.124 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.589080+0000", 2024-04-26T12:06:43.125 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1829999999999996e-06 2024-04-26T12:06:43.125 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.125 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.125 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:43.125 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.589107+0000", 2024-04-26T12:06:43.125 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7087e-05 2024-04-26T12:06:43.125 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.125 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.125 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:43.125 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.589120+0000", 2024-04-26T12:06:43.125 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3050999999999999e-05 2024-04-26T12:06:43.125 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.125 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.125 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:43.125 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.591420+0000", 2024-04-26T12:06:43.126 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002299971 2024-04-26T12:06:43.126 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.126 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.126 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:43.129 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.591456+0000", 2024-04-26T12:06:43.129 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6412999999999998e-05 2024-04-26T12:06:43.129 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.129 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:43.129 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.129 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.129 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.129 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:2215 4.2d 4:b5489108:::10000000bee.00000000:head [write 0~84] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:06:43.129 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:42.739513+0000", 2024-04-26T12:06:43.129 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.29591565399999997, 2024-04-26T12:06:43.129 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002272451, 2024-04-26T12:06:43.129 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:43.130 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.130 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:43.130 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:43.130 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:43.130 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 2215 2024-04-26T12:06:43.130 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.130 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:43.130 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.130 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:43.130 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.739513+0000", 2024-04-26T12:06:43.130 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.130 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.130 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.130 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:43.131 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.739513+0000", 2024-04-26T12:06:43.131 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.131 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.131 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.131 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:43.131 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.739512+0000", 2024-04-26T12:06:43.131 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:43.131 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.131 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.131 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:43.131 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.739517+0000", 2024-04-26T12:06:43.131 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4280000000000004e-06 2024-04-26T12:06:43.131 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.131 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.131 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:43.132 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.739531+0000", 2024-04-26T12:06:43.132 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3393999999999999e-05 2024-04-26T12:06:43.132 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.132 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.132 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.132 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.739539+0000", 2024-04-26T12:06:43.132 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.687e-06 2024-04-26T12:06:43.132 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.132 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.132 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:43.132 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.739604+0000", 2024-04-26T12:06:43.132 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4684000000000006e-05 2024-04-26T12:06:43.132 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.133 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.133 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:43.133 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.739682+0000", 2024-04-26T12:06:43.133 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7782999999999997e-05 2024-04-26T12:06:43.133 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.133 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.133 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:43.133 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.741714+0000", 2024-04-26T12:06:43.133 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002032037 2024-04-26T12:06:43.133 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.133 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.133 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:43.133 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.741744+0000", 2024-04-26T12:06:43.133 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9757e-05 2024-04-26T12:06:43.134 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.134 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.134 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:43.134 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:42.741785+0000", 2024-04-26T12:06:43.134 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1560999999999997e-05 2024-04-26T12:06:43.134 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.134 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:43.134 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.134 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.134 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.134 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:2476 4.1e 4:7a81613a:::10000000d05.00000000:head [write 0~1700] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:06:43.134 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:43.010831+0000", 2024-04-26T12:06:43.134 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.024597691000000001, 2024-04-26T12:06:43.134 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0024987339999999999, 2024-04-26T12:06:43.135 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:43.135 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.135 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:43.135 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:43.135 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:43.135 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 2476 2024-04-26T12:06:43.135 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.135 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:43.135 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.135 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:43.135 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.010831+0000", 2024-04-26T12:06:43.135 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.135 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.135 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.136 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:43.136 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.010831+0000", 2024-04-26T12:06:43.136 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:43.136 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.136 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.136 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:43.136 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.010830+0000", 2024-04-26T12:06:43.136 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.136 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.136 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.136 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:43.136 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.010834+0000", 2024-04-26T12:06:43.136 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1339999999999997e-06 2024-04-26T12:06:43.136 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.137 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.137 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:43.137 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.010844+0000", 2024-04-26T12:06:43.137 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6209999999999999e-06 2024-04-26T12:06:43.137 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.137 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.137 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.137 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.010848+0000", 2024-04-26T12:06:43.137 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4150000000000001e-06 2024-04-26T12:06:43.137 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.137 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.137 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:43.137 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.010888+0000", 2024-04-26T12:06:43.137 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9409000000000002e-05 2024-04-26T12:06:43.137 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.138 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.138 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:43.138 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.011010+0000", 2024-04-26T12:06:43.138 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000122841 2024-04-26T12:06:43.138 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.138 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.138 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:43.138 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.011138+0000", 2024-04-26T12:06:43.138 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012767099999999999 2024-04-26T12:06:43.138 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.138 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.138 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.139 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.012175+0000", 2024-04-26T12:06:43.139 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001037074 2024-04-26T12:06:43.139 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.139 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.139 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:43.139 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.013235+0000", 2024-04-26T12:06:43.139 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0010601059999999999 2024-04-26T12:06:43.139 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.139 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.139 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:43.139 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.013293+0000", 2024-04-26T12:06:43.139 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7858000000000001e-05 2024-04-26T12:06:43.139 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:43.140 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:43.140 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:43.140 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.013329+0000", 2024-04-26T12:06:43.140 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.625e-05 2024-04-26T12:06:43.140 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.140 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:43.140 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.140 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:43.140 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:43.140 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:43.141 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:43.140+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:43.142 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:43.242 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:43.241+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:43.249 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:43.249 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:43.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.249 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4564.0:2712 4.b e49/16 4:d370087d:::10000000df0.00000000:head v 49'44, mlcod=49'42)", 2024-04-26T12:06:43.249 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:43.248637+0000", 2024-04-26T12:06:43.250 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00042203100000000001, 2024-04-26T12:06:43.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00043611799999999999, 2024-04-26T12:06:43.250 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:43.250 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:43.250 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:43.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:43.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:43.248637+0000", 2024-04-26T12:06:43.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:43.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:43.248637+0000", 2024-04-26T12:06:43.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:43.251 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:43.248636+0000", 2024-04-26T12:06:43.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:43.251 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:43.248641+0000", 2024-04-26T12:06:43.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9269999999999996e-06 2024-04-26T12:06:43.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:43.251 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:43.248650+0000", 2024-04-26T12:06:43.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5510000000000005e-06 2024-04-26T12:06:43.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:43.248655+0000", 2024-04-26T12:06:43.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.194e-06 2024-04-26T12:06:43.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:43.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:43.248684+0000", 2024-04-26T12:06:43.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9654000000000001e-05 2024-04-26T12:06:43.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:43.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:43.248698+0000", 2024-04-26T12:06:43.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3464e-05 2024-04-26T12:06:43.253 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.253 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:43.253 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.253 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.253 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-04-26T12:06:43.253 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 1 2024-04-26T12:06:43.253 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:43.259 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:43.343 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:43.342+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:43.366 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:43.366 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:43.367 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:43.367 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:43.367 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:43.377 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:43.461 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:43.460+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:43.477 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:06:43.501 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:06:43.527 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:43.528 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:43.528 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:43.528 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:43.528 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.528 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:43.528 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:43.528 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 109.67082230699999, 2024-04-26T12:06:43.528 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:43.528 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:43.528 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.528 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:43.528 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:43.528 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:43.529 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:43.529 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.529 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:43.529 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.529 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:43.529 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:43.529 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.529 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.529 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.529 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:43.529 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:43.529 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.529 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.529 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.529 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:43.530 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:43.530 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.530 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.530 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.530 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:43.530 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:43.530 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:43.530 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.530 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.530 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:43.530 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:43.530 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:43.530 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.530 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.530 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.531 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:43.531 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:43.531 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.531 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.531 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:43.531 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:43.531 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:43.531 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.531 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.531 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:43.531 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:43.531 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:43.531 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.531 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.531 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:43.532 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:43.532 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:43.532 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.532 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.532 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:43.532 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:43.532 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:43.532 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.532 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.532 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.532 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:43.532 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:43.533 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.533 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.533 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:43.533 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:43.533 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:43.533 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.533 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.533 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:43.533 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:43.533 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:43.533 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.533 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:43.533 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.533 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.533 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.534 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:43.534 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:43.534 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 109.670716411, 2024-04-26T12:06:43.534 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:43.534 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:43.534 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.534 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:43.534 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:43.534 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:43.534 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:43.534 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.534 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:43.534 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.534 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:43.534 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:43.535 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.535 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.535 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.535 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:43.535 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:43.535 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.535 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.535 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.535 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:43.535 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:43.535 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.535 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.535 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.535 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:43.535 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:43.536 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:43.536 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.536 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.536 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:43.536 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:43.536 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:43.536 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.536 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.536 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.536 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:43.536 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:43.536 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.536 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.536 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:43.536 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:43.537 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:43.537 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.537 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.537 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:43.537 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:43.537 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:43.537 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.537 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.537 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:43.537 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:43.537 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:43.538 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.538 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.538 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:43.538 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:43.538 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:43.538 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.538 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.539 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.539 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:43.539 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:43.539 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.539 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.539 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:43.539 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:43.539 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:43.539 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.539 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.539 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:43.539 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:43.539 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:43.539 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.539 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:43.540 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.540 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.540 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.540 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:43.540 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:43.540 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 109.670701431, 2024-04-26T12:06:43.540 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:43.540 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:43.540 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.540 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:43.540 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:43.540 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:43.540 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:43.540 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.540 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:43.541 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.541 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:43.541 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:43.541 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.541 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.541 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.541 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:43.541 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:43.541 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.541 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.541 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.541 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:43.541 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:43.541 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.542 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.542 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.542 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:43.542 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:43.542 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:43.542 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.542 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.542 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:43.542 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:43.542 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:43.542 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.542 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.542 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.542 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:43.543 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:43.543 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.543 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.543 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:43.543 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:43.543 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:43.543 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.543 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.543 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:43.543 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:43.543 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:43.543 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.543 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.543 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:43.543 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:43.544 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:43.544 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.544 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.544 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:43.544 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:43.544 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:43.544 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.544 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.544 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.544 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:43.544 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:43.544 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.544 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.544 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:43.545 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:43.545 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:43.545 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.545 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.545 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:43.545 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:43.545 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:43.545 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.545 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:43.545 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.545 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.545 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.545 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:43.545 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:43.547 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 109.67065755599999, 2024-04-26T12:06:43.547 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:43.547 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:43.547 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.547 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:43.548 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:43.548 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:43.548 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:43.548 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.548 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:43.548 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.549 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:43.549 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:43.549 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.549 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.549 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.549 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:43.549 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:43.549 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.549 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.549 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.549 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:43.549 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:43.549 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.550 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.550 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.550 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:43.550 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:43.550 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:43.550 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.550 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.550 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:43.550 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:43.550 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:43.550 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.550 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.550 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.550 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:43.550 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:43.551 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.551 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.551 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:43.551 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:43.551 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:43.551 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.551 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.551 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:43.551 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:43.551 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:43.551 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.551 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.551 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:43.551 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:43.551 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:43.552 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.552 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.552 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:43.552 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:43.552 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:43.552 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.552 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.552 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.552 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:43.552 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:43.552 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.552 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.552 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:43.552 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:43.552 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:43.552 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.553 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.553 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:43.553 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:43.553 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:43.553 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.553 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:43.553 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.553 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.553 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.553 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:43.553 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:43.553 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 109.670571892, 2024-04-26T12:06:43.553 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:43.553 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:43.553 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.554 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:43.554 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:43.554 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:43.554 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:43.554 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.554 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:43.554 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.554 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:43.554 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:43.554 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.554 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.554 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.554 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:43.554 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:43.554 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.555 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.555 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.555 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:43.555 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:43.555 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.555 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.555 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.555 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:43.555 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:43.555 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:43.555 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.555 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.555 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:43.555 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:43.555 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:43.556 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.556 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.556 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.556 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:43.556 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:43.556 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.556 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.556 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:43.556 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:43.556 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:43.556 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.556 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.556 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:43.556 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:43.556 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:43.556 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.557 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.557 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:43.557 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:43.557 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:43.557 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.557 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.557 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:43.557 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:43.557 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:43.557 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.557 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.557 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.557 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:43.557 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:43.557 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.558 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.558 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:43.558 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:43.558 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:43.558 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.558 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.558 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:43.558 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:43.558 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:43.558 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.558 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:43.558 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.558 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.558 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.559 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:43.559 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:43.559 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 99.744667605999993, 2024-04-26T12:06:43.559 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:43.559 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:43.559 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.559 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:43.559 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.559 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:43.559 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:43.559 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.559 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.559 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.559 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:43.559 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:43.559 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.560 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.560 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.560 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:43.560 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:43.560 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:43.560 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.560 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.560 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:43.560 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:43.560 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:43.560 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.560 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.560 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:43.560 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:43.560 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:43.561 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.561 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.561 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.561 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:43.561 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:43.561 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.561 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.561 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:43.561 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:43.561 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:43.561 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.561 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.561 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:43.561 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:43.561 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:43.562 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.562 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.562 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:43.562 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:43.562 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:43.562 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.562 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.562 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:43.562 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:43.562 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:43.562 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.562 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.562 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.562 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:43.562 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:43.563 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.563 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.563 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:43.563 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:43.563 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:43.563 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.563 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.563 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:43.563 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:43.563 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:43.563 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.563 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:43.563 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.563 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.563 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.563 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:43.564 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:43.564 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 99.744631510999994, 2024-04-26T12:06:43.564 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:43.564 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:43.564 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.564 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:43.564 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.564 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:43.564 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:43.564 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.564 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.564 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.564 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:43.564 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:43.564 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.565 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.565 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.565 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:43.565 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:43.565 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:43.565 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.565 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.565 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:43.565 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:43.565 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:43.565 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.565 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.565 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:43.565 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:43.565 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:43.565 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.566 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.566 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.566 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:43.566 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:43.566 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.566 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.566 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:43.566 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:43.566 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:43.566 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.566 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.566 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:43.566 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:43.566 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:43.566 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.567 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:43.567 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:43.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:43.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.567 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:43.567 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:43.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:43.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.567 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.567 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:43.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:43.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.568 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:43.568 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:43.568 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:43.568 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.568 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:43.568 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:43.568 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:43.568 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.568 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:43.568 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.568 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.568 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:43.568 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:43.569 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 99.744593827000003, 2024-04-26T12:06:43.569 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:43.569 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:43.569 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.569 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:43.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.569 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:43.569 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:43.569 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.569 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.569 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:43.569 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:43.569 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.569 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.570 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.570 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:43.570 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:43.570 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.570 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.570 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.570 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:43.570 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:43.570 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:43.570 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.570 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.570 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:43.570 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:43.570 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:43.570 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.571 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.571 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.571 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:43.571 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:43.571 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.571 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.571 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:43.571 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:43.571 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:43.571 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.571 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.571 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:43.571 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:43.571 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:43.571 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.572 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.572 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:43.572 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:43.572 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:43.572 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.572 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.572 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:43.572 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:43.572 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:43.572 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.572 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.572 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.572 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:43.572 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:43.572 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.573 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.573 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:43.573 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:43.573 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:43.573 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.573 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.573 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:43.573 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:43.573 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:43.573 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.573 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:43.573 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.573 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.573 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.573 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:43.574 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:43.574 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 99.744572486999999, 2024-04-26T12:06:43.574 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:43.574 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:43.574 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.574 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:43.574 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.574 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:43.574 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:43.574 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.574 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.574 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.574 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:43.574 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:43.574 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.574 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.575 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.575 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:43.575 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:43.575 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.575 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.575 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.575 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:43.575 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:43.575 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:43.575 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.575 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.575 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:43.575 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:43.575 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:43.575 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.576 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.576 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.576 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:43.576 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:43.576 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.576 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.576 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:43.576 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:43.576 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:43.576 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.576 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.576 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:43.576 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:43.576 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:43.576 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.577 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.577 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:43.577 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:43.577 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:43.577 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.577 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.577 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:43.577 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:43.577 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:43.577 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.577 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.577 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.577 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:43.577 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:43.577 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.578 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.578 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:43.578 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:43.578 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:43.578 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.578 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.578 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:43.578 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:43.578 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:43.578 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.578 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:43.578 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.578 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.578 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.578 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:43.579 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:43.579 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 99.744550220999997, 2024-04-26T12:06:43.579 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:43.579 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:43.579 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.579 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:43.579 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.579 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:43.579 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:43.579 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.579 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.579 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.579 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:43.579 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:43.579 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.579 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.580 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.580 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:43.580 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:43.580 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.580 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.580 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.580 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:43.580 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:43.580 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:43.580 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.580 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.580 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:43.580 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:43.580 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:43.580 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.581 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.581 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.581 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:43.581 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:43.581 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.581 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.581 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:43.581 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:43.581 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:43.581 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.581 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.581 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:43.581 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:43.581 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:43.581 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.582 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.582 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:43.582 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:43.582 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:43.582 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.582 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.582 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:43.582 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:43.582 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:43.582 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.582 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.582 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.582 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:43.582 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:43.583 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.583 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.583 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:43.583 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:43.583 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:43.583 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.583 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.583 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:43.583 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:43.583 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:43.583 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.583 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:43.583 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.583 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.583 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.583 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:43.584 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:43.584 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 99.744528599000006, 2024-04-26T12:06:43.584 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:43.584 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:43.584 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.584 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:43.584 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.584 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:43.584 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:43.584 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.584 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.584 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.585 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:43.585 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:43.585 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.585 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.585 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.585 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:43.585 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:43.585 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.585 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.585 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.585 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:43.585 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:43.585 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:43.586 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.586 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.586 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:43.586 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:43.586 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:43.586 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.586 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.586 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.586 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:43.586 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:43.586 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.586 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.586 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:43.586 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:43.586 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:43.586 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.587 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.587 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:43.587 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:43.587 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:43.587 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.587 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.587 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:43.587 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:43.587 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:43.587 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.587 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.587 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:43.587 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:43.587 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:43.587 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.588 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.588 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.588 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:43.588 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:43.588 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.588 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.588 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:43.588 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:43.588 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:43.588 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.588 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.588 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:43.588 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:43.588 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:43.588 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.589 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:43.589 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.589 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.589 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.589 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:43.589 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:43.589 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 99.744502033000003, 2024-04-26T12:06:43.589 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:43.589 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:43.589 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.589 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:43.589 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.589 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:43.589 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:43.590 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.590 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.590 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.590 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:43.590 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:43.590 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.590 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.590 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.590 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:43.590 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:43.590 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.590 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.590 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.590 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:43.590 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:43.591 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:43.591 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.591 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.591 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:43.591 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:43.591 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:43.591 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.591 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.591 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.591 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:43.591 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:43.591 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.591 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.591 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:43.591 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:43.592 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:43.592 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.592 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.592 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:43.592 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:43.592 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:43.592 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.592 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.592 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:43.592 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:43.592 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:43.592 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.592 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.592 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:43.592 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:43.592 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:43.593 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.593 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.593 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.593 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:43.593 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:43.593 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.593 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.593 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:43.593 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:43.593 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:43.593 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.593 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.593 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:43.593 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:43.593 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:43.594 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.594 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:43.594 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.594 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.594 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.594 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:43.594 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:43.594 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 99.744463521, 2024-04-26T12:06:43.594 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:43.594 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:43.594 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.594 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:43.594 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.594 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:43.595 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:43.595 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.595 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.595 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:43.595 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:43.595 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.595 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.595 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:43.595 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:43.595 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.595 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.596 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:43.596 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:43.596 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:43.596 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.596 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.596 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:43.596 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:43.596 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:43.596 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.596 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.596 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.596 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:43.596 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:43.596 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.597 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.597 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:43.597 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:43.597 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:43.597 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.597 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.597 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:43.597 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:43.597 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:43.597 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.597 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.597 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:43.597 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:43.597 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:43.597 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.598 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.598 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:43.598 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:43.598 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:43.598 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.598 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.598 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.598 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:43.598 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:43.598 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.598 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.598 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:43.598 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:43.598 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:43.598 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.599 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.599 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:43.599 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:43.599 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:43.599 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.599 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:43.599 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.599 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.599 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.599 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:43.599 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:43.599 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 99.744435347999996, 2024-04-26T12:06:43.599 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:43.599 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:43.599 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.600 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:43.600 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.600 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:43.600 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:43.600 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.600 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.600 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.600 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:43.600 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:43.600 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.600 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.600 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.600 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:43.600 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:43.600 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.601 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:43.601 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:43.601 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:43.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.601 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:43.601 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:43.601 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:43.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.601 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.601 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:43.601 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:43.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.602 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.602 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:43.602 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:43.602 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:43.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.602 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.602 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:43.602 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:43.602 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:43.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.602 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.602 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:43.602 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:43.603 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:43.603 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.603 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.603 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:43.603 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:43.603 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:43.603 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.603 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.603 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.603 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:43.603 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:43.603 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.603 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.603 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:43.603 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:43.604 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:43.604 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.604 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.604 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:43.604 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:43.604 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:43.604 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.604 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:43.604 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.604 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.604 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.604 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:43.604 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:43.604 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 99.744400784000007, 2024-04-26T12:06:43.604 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:43.605 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:43.605 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.605 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:43.605 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.605 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:43.605 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:43.605 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.605 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.605 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.605 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:43.605 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:43.605 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.605 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.605 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.605 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:43.606 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:43.606 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.606 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.606 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:43.606 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:43.606 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:43.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.606 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.606 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:43.606 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:43.606 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:43.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.606 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.606 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.607 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:43.607 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:43.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.607 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.607 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:43.607 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:43.607 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:43.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.607 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.607 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:43.607 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:43.607 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:43.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.607 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.607 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:43.608 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:43.608 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:43.608 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.608 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.608 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:43.608 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:43.608 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:43.608 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.608 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.608 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.608 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:43.608 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:43.608 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.608 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.608 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:43.609 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:43.609 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:43.609 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.609 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.609 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:43.609 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:43.609 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:43.609 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.609 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:43.609 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.609 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.609 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.609 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:43.609 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:43.609 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 99.743526004000003, 2024-04-26T12:06:43.610 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:43.610 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:43.610 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.610 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:43.610 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.610 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:43.610 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:43.610 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.610 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.610 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.610 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:43.610 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:43.610 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.610 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.610 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.611 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:43.611 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:43.611 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:43.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.611 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.611 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:43.611 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:43.611 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:43.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.611 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.611 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:43.611 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:43.611 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:43.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.611 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.612 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.612 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:43.612 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:43.612 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.612 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.612 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:43.612 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:43.612 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:43.612 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.612 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.612 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:43.612 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:43.612 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:43.612 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.612 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.612 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:43.613 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:43.613 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:43.613 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.613 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.613 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:43.613 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:43.613 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:43.613 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.613 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.613 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.613 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:43.613 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:43.613 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.613 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.613 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:43.614 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:43.614 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:43.614 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.614 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.614 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:43.614 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:43.614 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:43.614 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.614 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:43.614 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.614 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.614 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.614 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:43.614 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:43.614 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 99.743487044999995, 2024-04-26T12:06:43.615 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:43.615 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:43.615 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.615 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:43.615 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.615 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:43.615 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:43.615 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.615 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.615 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.615 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:43.615 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:43.615 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.615 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.615 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.616 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:43.616 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:43.616 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.616 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.616 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.616 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:43.616 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:43.616 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:43.616 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.616 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.616 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:43.616 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:43.616 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:43.616 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.616 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.616 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.617 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:43.617 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:43.617 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.617 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.617 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:43.617 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:43.617 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:43.617 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.617 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.617 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:43.617 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:43.617 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:43.617 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.617 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.617 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:43.618 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:43.618 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:43.618 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.618 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.618 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:43.618 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:43.618 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:43.618 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.618 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.618 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.618 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:43.618 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:43.618 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.618 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.618 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:43.619 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:43.619 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:43.619 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.619 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.619 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:43.619 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:43.619 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:43.619 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.619 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:43.619 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.619 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.619 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.619 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:43.619 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:43.619 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 99.743451573000002, 2024-04-26T12:06:43.619 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:43.620 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:43.620 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.620 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:43.620 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.620 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:43.620 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:43.620 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.620 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.620 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.620 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:43.620 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:43.620 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.620 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.620 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.621 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:43.621 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:43.621 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:43.621 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.621 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.621 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:43.621 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:43.621 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:43.621 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.621 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.621 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:43.621 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:43.621 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:43.621 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.621 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.621 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.622 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:43.622 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:43.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.622 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.622 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:43.622 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:43.622 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:43.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.622 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.622 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:43.622 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:43.622 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:43.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.622 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.622 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:43.623 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:43.623 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:43.623 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.623 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.623 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:43.623 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:43.623 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:43.623 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.623 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.623 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.623 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:43.623 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:43.623 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.623 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.623 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:43.624 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:43.624 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:43.624 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.624 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.624 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:43.624 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:43.624 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:43.624 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.624 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:43.624 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.624 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.624 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.624 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:43.624 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:43.624 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 99.743372883999996, 2024-04-26T12:06:43.625 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:43.625 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:43.625 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:43.625 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:43.625 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.625 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:43.625 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:43.625 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.625 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.625 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.625 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:43.625 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:43.625 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.625 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.625 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.626 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:43.626 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:43.626 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:43.626 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.626 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.626 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:43.626 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:43.626 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:43.626 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.626 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.626 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:43.626 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:43.626 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:43.626 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.626 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.627 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.627 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:43.627 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:43.627 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.627 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.627 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:43.627 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:43.627 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:43.627 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.627 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.627 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:43.627 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:43.627 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:43.627 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.627 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.627 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:43.628 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:43.628 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:43.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.628 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.628 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:43.628 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:43.628 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:43.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.628 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.628 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:43.628 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:43.628 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:43.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.628 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.628 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:43.629 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:43.629 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:43.629 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.629 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.629 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:43.629 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:43.629 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:43.629 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.629 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:43.629 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.629 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.629 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.629 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:43.629 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:43.629 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 99.743222036000006, 2024-04-26T12:06:43.629 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:43.630 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:43.630 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:43.630 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:43.630 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.630 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:43.630 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:43.630 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.630 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.630 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.630 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:43.630 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:43.630 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:43.630 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.630 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.630 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:43.631 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:43.631 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:43.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.631 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.631 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:43.631 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:43.631 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:43.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.631 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.631 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:43.631 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:43.631 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:43.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.631 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.631 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:43.631 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:43.632 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:43.632 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.632 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.632 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:43.632 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:43.632 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:43.632 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.632 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.632 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:43.632 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:43.632 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:43.632 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:43.633 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:43.633 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:43.633 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:43.633 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:43.633 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.633 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:43.633 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.633 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:43.633 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:43.633 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:43.634 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:43.635 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:43.635 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:06:43.635 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:43.633+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:43.636 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:43.636 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:43.636 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:43.640 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:06:43.640 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:06:43.735 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:43.734+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:43.744 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:43.745 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:43.755 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:43.840 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:43.839+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:43.905 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:43.905 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:43.914 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:43.955 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:43.954+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:44.038 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:44.037+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:44.063 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:44.064 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:44.073 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:44.139 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:44.138+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:44.182 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:44.182 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:44.192 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:44.240 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:44.239+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:44.300 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:44.300 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:44.310 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:44.351 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:44.350+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:44.442 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:44.440+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:44.459 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:44.459 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:44.469 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:44.494 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-26T12:06:44.542 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:44.541+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:44.582 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:44.582 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:44.592 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:44.644 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:44.643+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:44.745 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:44.745 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:44.745 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:44.743+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:44.755 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:44.846 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:44.845+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:44.900 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:44.900 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:44.909 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:44.950 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:44.949+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:45.019 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:45.019 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:45.028 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:45.047 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:45.046+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:45.138 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:45.139 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:45.148 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:45.149 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:45.147+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:45.249 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:45.248+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:45.259 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:45.259 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:45.269 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:45.350 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:45.349+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:45.383 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:45.383 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:45.394 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:45.451 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:45.450+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:45.500 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:45.500 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:45.509 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:45.552 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:45.551+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:45.617 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:45.617 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:45.626 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:45.641 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:06:45.653 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:45.652+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:45.736 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:45.736 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:45.746 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:45.783 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:45.783 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:45.783 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:06:45.789 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:45.788+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:45.804 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:45.804 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:45.807 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:06:45.807 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:06:45.855 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:45.854+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:45.861 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:45.862 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:45.862 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:45.862 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:45.862 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:45.872 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:45.957 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:45.956+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:46.023 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:46.023 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:46.023 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:46.023 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:46.023 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.023 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:46.024 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:46.024 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 112.166196121, 2024-04-26T12:06:46.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:46.024 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:46.024 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.024 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:46.024 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:46.024 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:46.024 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:46.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.024 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:46.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:46.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:46.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:46.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:46.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:46.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:46.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:46.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:46.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:46.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:46.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:46.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:46.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:46.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:46.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:46.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:46.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:46.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:46.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:46.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:46.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:46.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:46.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:46.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:46.028 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:46.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:46.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.028 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:46.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:46.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:46.028 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:46.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:46.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:46.029 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:46.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:46.029 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.029 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:46.029 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.029 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:46.029 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:46.029 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 112.166090225, 2024-04-26T12:06:46.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:46.029 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:46.029 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.029 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:46.030 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:46.030 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:46.030 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:46.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.030 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:46.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.030 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:46.030 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:46.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.030 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:46.030 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:46.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:46.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:46.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:46.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:46.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:46.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:46.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:46.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:46.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:46.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:46.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:46.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:46.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:46.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:46.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:46.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:46.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:46.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:46.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:46.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:46.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:46.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:46.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:46.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:46.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:46.034 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:46.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:46.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:46.034 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:46.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:46.034 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.034 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:46.034 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.035 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:46.035 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:46.035 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 112.166075245, 2024-04-26T12:06:46.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:46.035 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:46.035 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.035 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:46.035 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:46.035 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:46.035 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:46.035 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.035 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:46.035 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.035 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:46.035 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:46.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.036 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:46.036 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:46.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.036 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:46.036 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:46.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:46.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:46.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:46.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:46.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:46.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:46.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:46.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:46.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:46.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:46.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:46.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:46.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:46.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:46.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:46.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:46.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:46.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.039 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:46.039 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:46.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:46.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.039 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.039 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:46.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:46.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.039 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:46.039 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:46.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:46.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.040 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:46.040 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:46.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:46.040 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.040 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:46.040 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.040 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:46.040 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:46.040 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 112.16603137, 2024-04-26T12:06:46.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:46.040 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:46.041 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.041 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:46.041 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:46.041 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:46.041 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:46.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.041 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:46.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:46.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:46.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:46.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:46.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:46.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:46.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:46.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:46.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:46.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:46.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:46.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:46.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:46.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:46.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:46.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:46.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:46.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.044 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:46.044 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:46.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:46.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.044 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:46.044 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:46.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:46.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.044 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:46.044 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:46.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:46.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:46.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:46.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:46.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:46.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:46.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:46.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:46.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:46.045 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.046 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:46.046 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.046 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.046 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:46.046 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:46.046 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 112.165945706, 2024-04-26T12:06:46.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:46.046 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:46.046 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.046 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:46.046 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:46.046 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:46.046 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:46.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.047 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:46.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:46.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:46.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:46.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:46.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:46.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:46.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:46.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:46.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:46.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:46.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:46.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:46.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:46.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:46.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.049 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:46.049 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:46.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:46.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.049 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:46.049 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:46.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:46.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.049 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:46.049 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:46.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:46.050 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.050 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:46.050 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:46.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:46.050 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.050 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.050 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:46.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:46.050 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.050 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:46.050 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:46.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:46.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:46.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:46.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:46.051 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.051 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:46.051 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.051 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:46.051 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:46.051 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 102.24004142, 2024-04-26T12:06:46.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:46.052 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:46.052 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.052 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:46.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:46.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:46.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:46.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:46.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:46.053 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:46.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:46.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:46.053 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:46.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:46.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:46.053 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:46.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:46.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.054 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:46.054 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:46.054 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.054 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.054 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:46.054 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:46.054 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:46.054 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.054 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.054 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:46.054 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:46.054 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:46.054 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.054 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.055 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:46.055 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:46.055 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:46.055 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.055 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.055 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:46.055 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:46.055 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:46.055 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.055 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.055 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.055 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:46.055 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:46.055 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.055 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.056 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:46.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:46.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:46.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.056 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.056 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:46.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:46.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:46.056 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.056 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:46.056 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.056 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.056 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:46.057 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:46.057 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 102.240005325, 2024-04-26T12:06:46.057 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:46.057 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:46.057 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.057 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:46.057 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.057 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:46.057 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:46.057 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.057 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.057 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.057 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:46.057 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:46.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.058 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:46.058 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:46.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:46.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.058 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:46.058 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:46.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:46.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.058 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:46.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:46.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:46.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:46.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:46.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:46.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:46.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:46.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:46.060 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:46.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:46.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.060 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.060 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:46.060 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:46.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:46.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.060 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.060 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:46.060 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:46.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:46.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.061 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.061 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:46.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:46.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.061 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:46.061 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:46.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:46.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.062 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:46.062 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:46.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:46.062 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.062 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:46.062 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.062 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:46.062 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:46.062 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 102.23996764100001, 2024-04-26T12:06:46.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:46.063 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:46.063 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.063 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:46.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:46.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:46.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:46.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:46.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:46.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:46.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:46.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:46.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:46.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:46.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:46.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:46.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:46.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:46.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:46.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:46.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:46.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.066 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:46.066 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:46.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:46.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.066 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:46.066 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:46.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:46.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.066 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:46.066 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:46.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:46.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:46.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:46.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:46.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:46.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:46.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:46.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:46.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:46.068 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.068 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:46.068 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.068 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:46.068 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:46.068 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 102.239946301, 2024-04-26T12:06:46.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:46.068 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:46.068 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.068 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:46.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:46.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:46.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:46.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:46.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:46.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:46.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:46.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:46.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.071 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:46.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:46.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:46.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.071 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:46.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:46.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:46.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.071 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:46.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:46.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:46.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:46.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:46.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:46.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:46.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:46.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:46.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:46.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:46.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.073 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:46.073 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:46.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:46.073 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.073 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:46.073 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.073 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:46.073 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:46.073 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 102.239924035, 2024-04-26T12:06:46.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:46.073 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:46.074 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.074 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:46.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:46.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:46.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:46.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:46.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:46.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:46.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.075 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:46.075 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:46.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:46.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.075 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:46.075 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:46.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:46.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.075 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:46.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:46.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:46.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:46.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:46.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:46.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:46.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:46.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:46.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:46.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:46.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:46.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:46.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:46.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:46.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:46.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:46.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:46.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:46.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:46.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:46.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:46.078 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.078 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:46.078 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.078 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:46.078 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:46.079 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 102.239902413, 2024-04-26T12:06:46.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:46.079 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:46.079 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.079 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:46.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.079 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:46.079 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:46.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.079 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.079 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:46.079 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:46.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.079 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.080 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:46.080 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:46.080 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.080 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.080 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:46.080 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:46.080 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:46.080 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.080 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:46.080 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:46.080 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:46.080 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.081 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.081 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.081 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:46.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:46.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.081 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.081 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:46.081 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:46.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:46.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.081 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.081 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:46.081 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:46.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:46.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.082 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.082 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:46.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:46.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:46.082 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.082 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.082 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:46.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:46.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:46.082 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.082 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.082 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:46.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:46.082 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.083 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.083 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:46.083 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:46.083 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:46.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.083 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.083 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:46.083 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:46.083 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:46.083 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.083 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:46.083 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.083 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.083 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:46.084 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:46.084 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 102.23987584699999, 2024-04-26T12:06:46.084 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:46.084 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:46.084 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.084 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:46.084 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.084 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:46.084 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:46.084 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.084 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.084 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.084 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:46.084 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:46.084 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.085 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.085 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.085 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:46.085 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:46.085 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.085 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.085 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.085 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:46.085 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:46.085 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:46.085 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.085 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.085 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:46.085 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:46.085 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:46.086 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.086 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.086 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:46.086 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:46.086 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.086 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:46.086 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:46.086 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:46.086 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.086 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:46.086 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:46.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:46.087 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.087 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.087 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:46.087 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:46.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:46.087 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.087 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.087 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:46.087 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:46.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:46.087 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.087 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.087 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.087 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:46.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:46.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:46.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:46.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:46.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:46.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:46.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:46.088 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.088 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:46.088 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.089 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:46.089 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:46.089 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 102.239837335, 2024-04-26T12:06:46.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:46.089 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:46.089 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.089 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:46.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:46.089 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:46.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:46.090 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:46.090 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.090 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.090 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:46.090 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:46.090 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.090 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.090 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:46.090 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:46.090 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:46.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.091 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.091 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:46.091 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:46.091 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:46.091 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.091 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.091 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.091 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:46.091 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:46.091 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.091 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.091 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:46.091 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:46.091 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:46.091 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.092 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:46.092 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:46.092 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:46.092 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.092 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:46.092 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:46.092 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:46.092 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.092 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:46.092 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:46.092 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:46.093 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.093 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.093 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:46.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:46.093 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.093 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:46.093 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:46.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:46.093 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.093 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:46.093 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:46.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:46.093 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.094 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:46.094 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.094 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.094 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:46.094 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:46.094 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 102.239809162, 2024-04-26T12:06:46.094 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:46.094 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:46.094 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.094 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:46.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.094 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:46.094 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:46.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:46.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:46.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:46.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:46.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:46.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:46.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:46.096 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.096 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.096 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:46.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:46.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:46.096 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.096 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.096 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:46.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:46.096 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.096 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.096 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:46.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:46.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:46.097 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.097 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.097 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:46.097 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:46.097 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:46.097 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.097 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.097 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:46.097 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:46.097 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:46.097 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.097 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.097 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:46.097 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:46.098 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:46.098 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.098 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.098 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.098 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:46.098 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:46.098 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.098 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.098 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:46.098 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:46.098 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:46.098 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.098 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.098 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:46.098 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:46.099 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:46.099 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.099 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:46.099 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.099 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.099 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.099 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:46.099 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:46.099 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 102.239774598, 2024-04-26T12:06:46.099 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:46.099 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:46.099 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.099 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:46.099 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.099 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:46.100 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:46.100 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.100 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.100 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.100 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:46.100 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:46.100 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.100 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.100 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.100 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:46.100 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:46.100 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.100 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.100 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.100 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:46.101 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:46.101 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:46.101 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.101 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.101 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:46.101 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:46.101 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:46.101 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.101 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.101 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.101 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:46.101 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:46.101 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.101 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.101 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:46.102 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:46.102 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:46.102 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.102 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.102 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:46.102 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:46.102 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:46.102 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.102 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.102 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:46.102 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:46.102 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:46.102 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.102 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.102 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:46.103 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:46.103 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:46.103 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.103 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.103 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.103 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:46.103 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:46.103 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.103 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.103 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:46.103 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:46.103 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:46.103 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.103 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.103 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:46.104 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:46.104 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:46.104 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.104 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:46.104 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.104 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.104 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.104 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:46.104 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:46.104 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 102.23889981799999, 2024-04-26T12:06:46.104 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:46.104 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:46.104 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.104 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:46.104 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.105 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:46.105 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:46.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.105 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:46.105 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:46.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.105 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:46.105 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:46.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:46.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.106 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:46.106 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:46.106 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:46.106 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.106 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.106 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:46.106 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:46.106 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:46.106 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.106 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.106 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.106 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:46.106 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:46.106 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.107 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.107 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:46.107 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:46.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:46.107 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.107 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.107 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:46.107 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:46.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:46.107 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.107 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.107 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:46.107 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:46.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:46.107 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:46.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:46.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:46.108 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:46.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:46.108 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:46.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:46.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:46.108 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.109 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:46.109 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:46.109 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:46.109 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.109 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:46.109 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.109 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.109 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.109 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:46.110 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:46.110 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 102.238860859, 2024-04-26T12:06:46.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:46.110 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:46.110 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.110 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:46.110 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.110 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:46.110 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:46.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.110 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.110 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.111 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:46.111 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:46.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.111 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.111 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.111 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:46.111 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:46.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.111 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.111 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.111 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:46.111 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:46.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:46.111 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.111 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.112 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:46.112 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:46.112 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:46.112 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.112 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.112 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.112 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:46.112 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:46.112 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.112 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.112 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:46.112 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:46.112 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:46.112 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.112 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.113 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:46.113 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:46.113 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:46.113 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.113 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.113 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:46.113 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:46.113 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:46.113 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.113 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.113 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:46.113 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:46.113 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:46.113 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.113 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.113 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.114 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:46.114 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:46.114 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.114 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:46.114 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:46.114 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:46.114 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.114 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:46.114 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:46.114 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:46.114 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.115 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:46.115 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.115 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.115 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:46.115 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:46.115 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 102.23882538700001, 2024-04-26T12:06:46.115 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:46.115 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:46.115 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.115 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:46.115 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.115 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:46.115 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:46.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.116 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:46.116 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:46.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.116 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:46.116 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:46.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.116 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:46.116 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:46.117 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:46.117 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.117 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.117 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:46.117 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:46.117 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:46.117 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.117 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.117 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.117 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:46.117 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:46.117 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.117 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.117 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:46.117 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:46.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:46.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:46.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:46.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:46.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:46.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:46.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:46.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:46.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:46.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:46.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.119 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.119 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:46.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:46.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.119 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:46.119 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:46.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:46.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.119 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:46.119 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:46.120 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:46.120 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.120 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:46.120 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.120 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:46.120 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:46.120 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 102.238746698, 2024-04-26T12:06:46.120 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:46.120 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:46.120 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.120 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:46.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.120 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:46.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:46.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.121 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.121 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:46.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:46.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.121 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.121 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:46.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:46.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:46.121 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.121 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:46.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:46.122 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:46.122 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.122 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.122 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:46.122 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:46.122 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:46.122 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.122 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.122 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.122 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:46.122 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:46.122 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.122 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.122 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:46.122 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:46.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:46.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.123 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:46.123 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:46.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:46.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.123 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:46.123 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:46.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:46.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.124 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:46.124 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:46.124 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:46.124 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.124 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.124 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.124 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:46.124 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:46.124 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.124 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.124 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:46.124 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:46.124 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:46.124 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.124 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.125 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:46.125 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:46.125 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:46.125 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.125 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:46.125 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.125 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.125 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.125 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:46.125 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:46.125 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 102.23859585, 2024-04-26T12:06:46.125 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:46.125 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:46.125 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:46.125 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:46.126 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.126 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:46.126 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:46.126 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.126 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.126 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.126 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:46.126 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:46.126 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.126 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.126 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.126 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:46.126 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:46.126 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:46.126 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.127 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.127 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:46.127 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:46.127 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:46.127 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.127 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.127 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:46.127 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:46.127 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:46.127 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.127 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.127 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.127 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:46.127 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:46.127 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.128 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.128 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:46.128 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:46.128 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:46.128 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.128 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.128 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:46.128 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:46.128 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:46.128 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.128 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.128 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:46.128 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:46.128 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:46.128 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.129 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:46.129 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.129 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.129 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:46.129 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:46.130 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:46.131 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:46.128+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:46.231 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:46.230+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:46.244 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:46.244 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:46.244 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.244 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5535 4.1c 4:3a6640a8:::10000001984.00000000:head [write 0~2119 in=2119b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:46.245 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.236827+0000", 2024-04-26T12:06:46.245 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0067442029999999998, 2024-04-26T12:06:46.245 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0067680209999999999, 2024-04-26T12:06:46.245 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.245 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.245 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:46.245 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:46.245 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:46.245 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5535 2024-04-26T12:06:46.245 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.245 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.245 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.245 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.245 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.236827+0000", 2024-04-26T12:06:46.245 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.246 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.246 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.246 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.246 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.236827+0000", 2024-04-26T12:06:46.246 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.246 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.246 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.246 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.246 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.236826+0000", 2024-04-26T12:06:46.246 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:46.246 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.246 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.246 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.246 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.236830+0000", 2024-04-26T12:06:46.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5600000000000004e-06 2024-04-26T12:06:46.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.247 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.236839+0000", 2024-04-26T12:06:46.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7690000000000002e-06 2024-04-26T12:06:46.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.247 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.236844+0000", 2024-04-26T12:06:46.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6249999999999998e-06 2024-04-26T12:06:46.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.247 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.236871+0000", 2024-04-26T12:06:46.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7177000000000001e-05 2024-04-26T12:06:46.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.236946+0000", 2024-04-26T12:06:46.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5111000000000006e-05 2024-04-26T12:06:46.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:46.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.243527+0000", 2024-04-26T12:06:46.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065804440000000004 2024-04-26T12:06:46.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:46.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.243590+0000", 2024-04-26T12:06:46.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3596999999999994e-05 2024-04-26T12:06:46.249 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.249 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.249 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.249 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.249 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4564.0:5536 4.35 e50/16 4:ac6b9885:::10000001985.00000000:head v 50'83, mlcod=50'81)", 2024-04-26T12:06:46.249 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.238161+0000", 2024-04-26T12:06:46.249 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0054094750000000004, 2024-04-26T12:06:46.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055169570000000003, 2024-04-26T12:06:46.249 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.249 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:46.249 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.250 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.250 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.238161+0000", 2024-04-26T12:06:46.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.250 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.250 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.238161+0000", 2024-04-26T12:06:46.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.250 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.250 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.238161+0000", 2024-04-26T12:06:46.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.238166+0000", 2024-04-26T12:06:46.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4160000000000003e-06 2024-04-26T12:06:46.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.238177+0000", 2024-04-26T12:06:46.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0842999999999999e-05 2024-04-26T12:06:46.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.238183+0000", 2024-04-26T12:06:46.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.998e-06 2024-04-26T12:06:46.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.252 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.252 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.238219+0000", 2024-04-26T12:06:46.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6430000000000002e-05 2024-04-26T12:06:46.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.252 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.252 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.238233+0000", 2024-04-26T12:06:46.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3572e-05 2024-04-26T12:06:46.252 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.252 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.252 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.253 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4564.0:5537 4.a e50/16 4:53274087:::10000001987.00000000:head v 50'87, mlcod=50'85)", 2024-04-26T12:06:46.253 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.239935+0000", 2024-04-26T12:06:46.253 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00363592, 2024-04-26T12:06:46.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037793700000000002, 2024-04-26T12:06:46.253 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.253 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:46.253 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.253 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.253 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.239935+0000", 2024-04-26T12:06:46.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.253 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.239935+0000", 2024-04-26T12:06:46.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.239934+0000", 2024-04-26T12:06:46.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.239940+0000", 2024-04-26T12:06:46.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4820000000000002e-06 2024-04-26T12:06:46.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.239950+0000", 2024-04-26T12:06:46.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0380000000000001e-05 2024-04-26T12:06:46.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.239973+0000", 2024-04-26T12:06:46.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3317999999999999e-05 2024-04-26T12:06:46.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.240006+0000", 2024-04-26T12:06:46.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2246999999999998e-05 2024-04-26T12:06:46.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.240017+0000", 2024-04-26T12:06:46.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1289e-05 2024-04-26T12:06:46.256 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.256 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.256 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.256 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5538 4.23 4:c54a0d6f:::10000001988.00000000:head [write 0~852 in=852b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:46.256 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.240581+0000", 2024-04-26T12:06:46.256 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0029897410000000002, 2024-04-26T12:06:46.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031648829999999998, 2024-04-26T12:06:46.256 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.256 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:46.256 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:46.257 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:46.257 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:46.257 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5538 2024-04-26T12:06:46.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.257 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.240581+0000", 2024-04-26T12:06:46.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.240581+0000", 2024-04-26T12:06:46.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.240580+0000", 2024-04-26T12:06:46.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:46.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.240586+0000", 2024-04-26T12:06:46.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6899999999999997e-06 2024-04-26T12:06:46.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.240598+0000", 2024-04-26T12:06:46.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2217e-05 2024-04-26T12:06:46.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.240605+0000", 2024-04-26T12:06:46.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2579999999999998e-06 2024-04-26T12:06:46.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.240701+0000", 2024-04-26T12:06:46.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5240000000000003e-05 2024-04-26T12:06:46.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.240800+0000", 2024-04-26T12:06:46.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9730999999999998e-05 2024-04-26T12:06:46.260 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.260 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.260 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.260 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5539 4.4 4:231adcc3:::10000001989.00000000:head [write 0~1721 in=1721b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:46.260 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.241498+0000", 2024-04-26T12:06:46.260 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0020728449999999998, 2024-04-26T12:06:46.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022844300000000001, 2024-04-26T12:06:46.260 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.260 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:46.260 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:46.260 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:46.261 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:46.261 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5539 2024-04-26T12:06:46.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.261 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.241498+0000", 2024-04-26T12:06:46.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.241498+0000", 2024-04-26T12:06:46.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.241497+0000", 2024-04-26T12:06:46.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:46.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.241502+0000", 2024-04-26T12:06:46.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7910000000000004e-06 2024-04-26T12:06:46.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.241513+0000", 2024-04-26T12:06:46.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0900000000000001e-05 2024-04-26T12:06:46.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.241518+0000", 2024-04-26T12:06:46.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1939999999999997e-06 2024-04-26T12:06:46.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.241550+0000", 2024-04-26T12:06:46.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1446999999999999e-05 2024-04-26T12:06:46.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.241627+0000", 2024-04-26T12:06:46.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7356999999999998e-05 2024-04-26T12:06:46.264 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.264 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.264 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.264 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5540 4.2e 4:7400b5b9:::1000000198a.00000000:head [write 0~1986 in=1986b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:46.264 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.242440+0000", 2024-04-26T12:06:46.264 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0011312119999999999, 2024-04-26T12:06:46.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013776540000000001, 2024-04-26T12:06:46.264 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.264 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:46.264 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:46.264 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:46.264 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:46.265 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5540 2024-04-26T12:06:46.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.265 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.242440+0000", 2024-04-26T12:06:46.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.242440+0000", 2024-04-26T12:06:46.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.242439+0000", 2024-04-26T12:06:46.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.242444+0000", 2024-04-26T12:06:46.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7550000000000002e-06 2024-04-26T12:06:46.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.242454+0000", 2024-04-26T12:06:46.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0725e-05 2024-04-26T12:06:46.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.242459+0000", 2024-04-26T12:06:46.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9540000000000003e-06 2024-04-26T12:06:46.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.242503+0000", 2024-04-26T12:06:46.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3736999999999998e-05 2024-04-26T12:06:46.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.242638+0000", 2024-04-26T12:06:46.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000135024 2024-04-26T12:06:46.267 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.267 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.268 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.268 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5541 4.16 4:68ee194a:::1000000198b.00000000:head [write 0~877 in=877b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:46.268 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.243254+0000", 2024-04-26T12:06:46.268 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00031645700000000002, 2024-04-26T12:06:46.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00059608299999999996, 2024-04-26T12:06:46.268 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.268 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:06:46.268 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:46.268 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:46.268 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:46.268 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5541 2024-04-26T12:06:46.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.268 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.243254+0000", 2024-04-26T12:06:46.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.243254+0000", 2024-04-26T12:06:46.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.243254+0000", 2024-04-26T12:06:46.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.243257+0000", 2024-04-26T12:06:46.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0939999999999999e-06 2024-04-26T12:06:46.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.243263+0000", 2024-04-26T12:06:46.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:06:46.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.243267+0000", 2024-04-26T12:06:46.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.45e-06 2024-04-26T12:06:46.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.243294+0000", 2024-04-26T12:06:46.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7308e-05 2024-04-26T12:06:46.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.243372+0000", 2024-04-26T12:06:46.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7663999999999994e-05 2024-04-26T12:06:46.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:46.272 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.243444+0000", 2024-04-26T12:06:46.272 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2218999999999994e-05 2024-04-26T12:06:46.272 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.272 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.272 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.272 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.272 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-04-26T12:06:46.272 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 7 2024-04-26T12:06:46.272 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:46.273 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:46.332 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:46.331+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:46.382 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:46.382 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:46.382 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:46.382 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:46.382 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:46.394 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:46.433 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:46.432+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:46.509 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:06:46.534 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:46.532+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:46.553 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:46.553 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:46.553 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:46.554 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:46.554 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.554 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:46.554 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:46.554 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 102.771214372, 2024-04-26T12:06:46.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:06:46.554 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.554 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.554 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.554 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.554 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.554 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:46.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.555 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.555 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.555 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:46.555 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.555 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.555 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.555 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:06:46.555 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:46.555 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.555 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.555 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:06:46.556 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:06:46.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.556 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.556 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.556 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:06:46.556 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:06:46.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.556 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.556 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.556 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:06:46.556 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:06:46.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.556 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.556 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.556 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:06:46.557 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:06:46.557 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.557 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.557 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.557 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:46.557 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:06:46.557 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.557 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.557 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:46.557 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:06:46.557 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:06:46.557 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.557 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.557 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:46.558 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:06:46.558 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:06:46.558 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.558 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.558 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.558 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:06:46.558 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:06:46.558 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.558 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.558 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:46.558 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:06:46.558 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:06:46.559 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.559 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.559 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:46.559 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:06:46.559 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:06:46.559 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.559 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.559 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.559 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.559 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.559 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:46.559 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:46.559 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 102.771159052, 2024-04-26T12:06:46.559 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:06:46.559 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.560 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.560 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.560 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.560 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.560 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:46.560 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.560 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.560 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.560 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.560 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:46.560 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.560 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.560 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.560 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.560 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:06:46.561 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:46.561 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.561 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.561 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.561 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:06:46.561 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:06:46.561 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.561 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.561 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.561 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:06:46.561 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:06:46.561 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.561 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.561 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.562 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:06:46.562 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:06:46.562 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.562 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.562 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.562 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:06:46.562 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:06:46.562 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.562 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.562 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.562 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:06:46.562 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:06:46.562 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.562 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.563 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:46.563 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:06:46.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:06:46.563 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.563 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.563 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:46.563 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:06:46.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:06:46.563 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.563 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.563 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.563 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:06:46.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:06:46.563 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.563 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.564 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:46.564 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:06:46.564 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:06:46.564 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.564 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.564 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:46.564 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:06:46.564 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:06:46.564 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.564 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.564 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.564 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.564 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.564 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:46.565 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:46.565 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 102.77107439700001, 2024-04-26T12:06:46.565 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:06:46.565 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.565 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.565 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.565 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.565 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.565 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:46.565 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.565 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.565 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.565 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.565 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:46.565 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.565 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.566 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.566 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.566 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:06:46.566 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.566 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.566 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.566 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.566 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:06:46.566 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:06:46.566 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.566 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.566 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.566 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:46.566 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:06:46.567 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.567 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.567 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.567 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:06:46.567 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:06:46.567 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.567 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.567 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.567 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:06:46.567 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:06:46.567 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.567 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.567 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.567 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:06:46.568 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:06:46.568 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.568 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.568 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:46.568 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:06:46.568 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:06:46.568 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.568 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.568 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.568 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:06:46.568 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:06:46.568 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.568 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.568 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:46.568 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:06:46.569 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:06:46.569 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.569 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.569 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:46.569 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:06:46.569 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:06:46.569 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.569 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.569 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:46.569 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:06:46.569 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:06:46.569 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.569 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.570 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.570 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.570 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.570 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:46.570 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:46.570 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 102.771035885, 2024-04-26T12:06:46.570 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:06:46.570 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.570 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.570 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.570 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.570 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.571 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:46.571 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.571 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.571 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.571 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.571 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:46.571 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.571 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.571 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.571 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.571 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:46.571 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:46.571 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.571 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.571 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.572 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:46.572 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:06:46.572 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.572 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.572 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.572 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:06:46.572 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:06:46.572 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.572 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.572 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.572 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:06:46.572 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:06:46.572 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.572 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.572 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.573 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:06:46.573 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:06:46.573 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.573 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.573 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.573 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:06:46.573 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:06:46.573 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.573 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.573 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:46.573 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:06:46.573 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:06:46.573 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.573 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.574 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.574 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:06:46.574 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:06:46.574 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.574 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:46.574 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:06:46.574 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:06:46.574 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.574 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:46.574 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:06:46.574 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:06:46.574 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.575 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:46.575 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:06:46.575 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:06:46.575 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.575 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.575 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.575 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.575 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.575 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:46.575 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:46.575 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 102.771005562, 2024-04-26T12:06:46.575 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005709999999996, 2024-04-26T12:06:46.575 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.575 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.577 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.578 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.578 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.578 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:46.578 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.578 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.578 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.578 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.578 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780390+0000", 2024-04-26T12:06:46.578 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.578 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.578 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.578 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.578 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780389+0000", 2024-04-26T12:06:46.578 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.578 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.579 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.579 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.579 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780393+0000", 2024-04-26T12:06:46.579 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5449999999999999e-06 2024-04-26T12:06:46.579 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.579 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.579 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.579 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780399+0000", 2024-04-26T12:06:46.579 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.032e-06 2024-04-26T12:06:46.579 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.579 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.579 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.579 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780403+0000", 2024-04-26T12:06:46.579 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:06:46.579 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.580 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.580 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.580 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780460+0000", 2024-04-26T12:06:46.580 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-04-26T12:06:46.580 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.580 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.580 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.580 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780641+0000", 2024-04-26T12:06:46.580 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018093199999999999 2024-04-26T12:06:46.580 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.580 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.580 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:46.580 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780919+0000", 2024-04-26T12:06:46.580 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027880800000000002 2024-04-26T12:06:46.580 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.581 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.581 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:46.581 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782028+0000", 2024-04-26T12:06:46.581 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011090130000000001 2024-04-26T12:06:46.581 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.581 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.581 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.581 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787616+0000", 2024-04-26T12:06:46.581 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055871510000000003 2024-04-26T12:06:46.581 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.581 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.581 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:46.581 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787657+0000", 2024-04-26T12:06:46.581 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1071e-05 2024-04-26T12:06:46.581 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.582 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.582 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:46.582 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787690+0000", 2024-04-26T12:06:46.583 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3417999999999998e-05 2024-04-26T12:06:46.583 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.583 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.583 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.583 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.584 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.584 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:46.584 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:46.584 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 102.77097886, 2024-04-26T12:06:46.584 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:06:46.584 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.584 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:46.584 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.584 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.584 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.584 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:46.584 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.584 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.584 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.584 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.585 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:46.585 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.585 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.585 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.585 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.585 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:46.585 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.585 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.585 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.585 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.585 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:06:46.585 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:06:46.585 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.585 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.586 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.586 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:06:46.586 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:06:46.586 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.586 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.586 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.586 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:06:46.586 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:06:46.586 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.586 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.586 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.586 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:06:46.586 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:06:46.587 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.587 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.587 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.587 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:06:46.587 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:06:46.587 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.587 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.587 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:46.587 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:06:46.587 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:06:46.587 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.587 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.588 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.588 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.588 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.588 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:46.588 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:46.588 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 102.77093657, 2024-04-26T12:06:46.588 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:06:46.588 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.588 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:46.588 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.588 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.588 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.588 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:46.588 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.588 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.589 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.589 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.589 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:46.589 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.589 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.589 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.589 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.589 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:46.589 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.589 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.589 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.590 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:06:46.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:06:46.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.590 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:06:46.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:06:46.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.590 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:06:46.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:06:46.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:06:46.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:06:46.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:06:46.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:06:46.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:46.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:06:46.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:06:46.591 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.592 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.592 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.592 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.592 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.592 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:2502 4.0 4:017423cd:::10000000d1f.00000000:head [write 0~1685] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:06:46.592 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:43.035208+0000", 2024-04-26T12:06:46.592 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.5161874019999999, 2024-04-26T12:06:46.592 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0072786830000000002, 2024-04-26T12:06:46.592 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.592 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.592 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:46.592 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:46.592 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:46.592 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 2502 2024-04-26T12:06:46.592 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.593 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.593 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.593 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.593 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.035208+0000", 2024-04-26T12:06:46.593 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.593 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.593 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.593 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.593 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.035208+0000", 2024-04-26T12:06:46.593 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.593 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.593 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.593 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.593 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.035207+0000", 2024-04-26T12:06:46.593 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:46.594 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.594 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.594 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.594 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.035214+0000", 2024-04-26T12:06:46.594 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8580000000000002e-06 2024-04-26T12:06:46.594 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.594 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.594 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.594 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.035223+0000", 2024-04-26T12:06:46.594 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2119999999999992e-06 2024-04-26T12:06:46.594 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.594 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.594 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.594 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.035228+0000", 2024-04-26T12:06:46.595 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9540000000000003e-06 2024-04-26T12:06:46.595 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.595 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.595 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.595 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.035260+0000", 2024-04-26T12:06:46.595 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1553000000000001e-05 2024-04-26T12:06:46.595 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.595 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.595 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.595 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.035333+0000", 2024-04-26T12:06:46.595 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3028999999999995e-05 2024-04-26T12:06:46.595 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.595 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.595 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:46.595 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.035401+0000", 2024-04-26T12:06:46.596 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8107000000000004e-05 2024-04-26T12:06:46.596 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.596 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.596 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:46.596 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.035808+0000", 2024-04-26T12:06:46.596 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00040708200000000002 2024-04-26T12:06:46.596 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.596 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.596 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.596 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.042438+0000", 2024-04-26T12:06:46.596 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0066306539999999997 2024-04-26T12:06:46.596 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.596 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.596 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:46.596 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.042465+0000", 2024-04-26T12:06:46.597 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6466e-05 2024-04-26T12:06:46.597 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.597 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.597 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:46.597 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:43.042486+0000", 2024-04-26T12:06:46.597 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1512999999999999e-05 2024-04-26T12:06:46.597 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.597 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.597 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.597 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.597 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.597 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4564.0:5126 4.20 e50/16 4:072dcba1:::100000017e4.00000000:head v 50'94, mlcod=50'92)", 2024-04-26T12:06:46.597 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:45.850310+0000", 2024-04-26T12:06:46.597 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.70108522399999995, 2024-04-26T12:06:46.597 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073364040000000004, 2024-04-26T12:06:46.598 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.598 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.598 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.598 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.598 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.598 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.850310+0000", 2024-04-26T12:06:46.598 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.598 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.598 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.598 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.598 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.850310+0000", 2024-04-26T12:06:46.598 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.598 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.598 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.599 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.599 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.850309+0000", 2024-04-26T12:06:46.599 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.599 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.599 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.599 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.599 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.850314+0000", 2024-04-26T12:06:46.599 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6650000000000002e-06 2024-04-26T12:06:46.599 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.599 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.599 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.599 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.850323+0000", 2024-04-26T12:06:46.599 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1619999999999997e-06 2024-04-26T12:06:46.599 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.599 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.600 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.600 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.850327+0000", 2024-04-26T12:06:46.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1520000000000002e-06 2024-04-26T12:06:46.600 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.600 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.600 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.600 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.850387+0000", 2024-04-26T12:06:46.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9503000000000003e-05 2024-04-26T12:06:46.600 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.600 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.600 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.600 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.850400+0000", 2024-04-26T12:06:46.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3107e-05 2024-04-26T12:06:46.600 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.600 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.601 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:46.601 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.857566+0000", 2024-04-26T12:06:46.601 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0071656070000000001 2024-04-26T12:06:46.601 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.601 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.601 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:46.601 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.857646+0000", 2024-04-26T12:06:46.601 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0791999999999995e-05 2024-04-26T12:06:46.601 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.601 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.601 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.601 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.601 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.601 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5128 4.12 4:4af27bd2:::100000017e6.00000000:head [write 0~1985] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:46.601 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:45.851916+0000", 2024-04-26T12:06:46.602 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.69947871900000003, 2024-04-26T12:06:46.602 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0087160190000000002, 2024-04-26T12:06:46.602 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.602 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.602 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:46.602 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:46.602 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:46.602 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5128 2024-04-26T12:06:46.602 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.602 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.602 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.602 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.602 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851916+0000", 2024-04-26T12:06:46.602 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.602 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.603 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.603 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.603 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851916+0000", 2024-04-26T12:06:46.603 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.603 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.603 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.603 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.603 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851916+0000", 2024-04-26T12:06:46.603 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:46.603 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.603 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.603 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.603 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851923+0000", 2024-04-26T12:06:46.603 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9029999999999998e-06 2024-04-26T12:06:46.603 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.603 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.604 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.604 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851933+0000", 2024-04-26T12:06:46.604 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0665e-05 2024-04-26T12:06:46.604 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.604 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.604 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.604 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851938+0000", 2024-04-26T12:06:46.604 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1549999999999998e-06 2024-04-26T12:06:46.604 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.604 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.605 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.605 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851981+0000", 2024-04-26T12:06:46.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3028000000000002e-05 2024-04-26T12:06:46.605 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.605 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.605 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.605 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852118+0000", 2024-04-26T12:06:46.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000136556 2024-04-26T12:06:46.605 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.605 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.605 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:46.605 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.860523+0000", 2024-04-26T12:06:46.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0084049859999999997 2024-04-26T12:06:46.605 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.605 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:46.606 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.860574+0000", 2024-04-26T12:06:46.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.096e-05 2024-04-26T12:06:46.606 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.606 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:46.606 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.860632+0000", 2024-04-26T12:06:46.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8554000000000002e-05 2024-04-26T12:06:46.606 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.606 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.606 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.606 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.606 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.606 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5129 4.29 4:95ace1b8:::100000017e7.00000000:head [write 0~4336] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:46.606 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:45.852861+0000", 2024-04-26T12:06:46.607 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.69853457399999996, 2024-04-26T12:06:46.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0077481420000000004, 2024-04-26T12:06:46.607 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.607 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.607 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:46.607 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:46.607 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:46.607 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5129 2024-04-26T12:06:46.607 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.607 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.607 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.607 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.607 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852861+0000", 2024-04-26T12:06:46.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.607 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.608 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.608 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.608 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852861+0000", 2024-04-26T12:06:46.608 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.608 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.608 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.608 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.608 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852860+0000", 2024-04-26T12:06:46.608 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.608 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.608 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.608 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.608 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852867+0000", 2024-04-26T12:06:46.608 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6889999999999998e-06 2024-04-26T12:06:46.608 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.609 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.609 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.609 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852874+0000", 2024-04-26T12:06:46.609 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9190000000000002e-06 2024-04-26T12:06:46.609 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.609 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.609 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.609 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852877+0000", 2024-04-26T12:06:46.609 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770000000000003e-06 2024-04-26T12:06:46.609 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.609 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.609 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.609 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852935+0000", 2024-04-26T12:06:46.609 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7933999999999998e-05 2024-04-26T12:06:46.610 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.610 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.610 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.610 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.853026+0000", 2024-04-26T12:06:46.610 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0656999999999996e-05 2024-04-26T12:06:46.610 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.610 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.610 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:46.610 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.853097+0000", 2024-04-26T12:06:46.610 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0698000000000006e-05 2024-04-26T12:06:46.610 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.610 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.610 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.611 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.857693+0000", 2024-04-26T12:06:46.611 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045966979999999998 2024-04-26T12:06:46.611 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.611 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.611 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:46.611 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.860524+0000", 2024-04-26T12:06:46.611 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028308930000000001 2024-04-26T12:06:46.611 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.611 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.611 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:46.611 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.860576+0000", 2024-04-26T12:06:46.611 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1415000000000002e-05 2024-04-26T12:06:46.611 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.611 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.612 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:46.612 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.860609+0000", 2024-04-26T12:06:46.612 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2895999999999998e-05 2024-04-26T12:06:46.612 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.612 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.612 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.612 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.612 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.612 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4564.0:5451 4.3c e50/16 4:3eaa9979:::10000001929.00000000:head v 50'68, mlcod=50'66)", 2024-04-26T12:06:46.612 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.153240+0000", 2024-04-26T12:06:46.612 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.39815552999999998, 2024-04-26T12:06:46.612 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.008611357, 2024-04-26T12:06:46.612 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.612 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.612 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.613 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.613 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.613 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153240+0000", 2024-04-26T12:06:46.613 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.613 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.613 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.613 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.613 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153240+0000", 2024-04-26T12:06:46.613 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.613 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.613 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.613 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.613 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153239+0000", 2024-04-26T12:06:46.613 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.613 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.614 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.614 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.614 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153244+0000", 2024-04-26T12:06:46.614 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:06:46.614 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.614 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.614 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.614 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153254+0000", 2024-04-26T12:06:46.614 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2839999999999995e-06 2024-04-26T12:06:46.614 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.614 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.614 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.614 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153260+0000", 2024-04-26T12:06:46.614 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:06:46.615 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.615 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.615 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.615 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153298+0000", 2024-04-26T12:06:46.615 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8157000000000001e-05 2024-04-26T12:06:46.615 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.615 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.615 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.615 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153312+0000", 2024-04-26T12:06:46.615 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4158999999999999e-05 2024-04-26T12:06:46.615 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.615 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.615 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:46.615 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.161819+0000", 2024-04-26T12:06:46.615 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0085061819999999993 2024-04-26T12:06:46.616 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.616 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.616 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:46.616 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.161851+0000", 2024-04-26T12:06:46.616 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2416999999999998e-05 2024-04-26T12:06:46.616 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.616 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.616 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.616 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.616 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.616 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5452 4.21 4:840c9502:::1000000192a.00000000:head [write 0~4217] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:46.616 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.153843+0000", 2024-04-26T12:06:46.616 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.39755168099999999, 2024-04-26T12:06:46.616 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081189629999999999, 2024-04-26T12:06:46.616 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.617 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.617 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:46.617 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:46.617 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:46.617 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5452 2024-04-26T12:06:46.617 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.617 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.617 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.617 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.617 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153843+0000", 2024-04-26T12:06:46.617 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.617 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.617 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.617 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.617 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153843+0000", 2024-04-26T12:06:46.618 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.618 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.618 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.618 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.618 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153843+0000", 2024-04-26T12:06:46.618 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:46.618 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.618 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.618 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.618 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153851+0000", 2024-04-26T12:06:46.618 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9789999999999993e-06 2024-04-26T12:06:46.618 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.618 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.618 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153861+0000", 2024-04-26T12:06:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9699999999999994e-06 2024-04-26T12:06:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153865+0000", 2024-04-26T12:06:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9389999999999996e-06 2024-04-26T12:06:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153906+0000", 2024-04-26T12:06:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0608999999999997e-05 2024-04-26T12:06:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.620 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.620 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.154042+0000", 2024-04-26T12:06:46.620 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000135668 2024-04-26T12:06:46.620 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.620 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.620 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:46.620 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.161904+0000", 2024-04-26T12:06:46.620 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0078618290000000007 2024-04-26T12:06:46.620 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.620 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.620 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:46.620 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.161925+0000", 2024-04-26T12:06:46.620 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1483000000000001e-05 2024-04-26T12:06:46.620 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.620 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.621 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:46.621 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.161962+0000", 2024-04-26T12:06:46.621 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7364999999999999e-05 2024-04-26T12:06:46.621 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.621 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.621 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.621 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.621 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.621 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5453 4.29 4:97e80b19:::1000000192b.00000000:head [write 0~1672] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:46.621 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.154665+0000", 2024-04-26T12:06:46.621 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.396729946, 2024-04-26T12:06:46.621 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0072320010000000001, 2024-04-26T12:06:46.621 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.621 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.621 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:46.622 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:46.622 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:46.622 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5453 2024-04-26T12:06:46.622 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.622 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.622 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.622 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.622 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.154665+0000", 2024-04-26T12:06:46.622 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.622 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.622 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.622 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.623 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.154665+0000", 2024-04-26T12:06:46.623 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.623 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.623 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.623 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.623 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.154665+0000", 2024-04-26T12:06:46.623 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.623 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.623 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.623 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.623 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.154668+0000", 2024-04-26T12:06:46.623 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.309e-06 2024-04-26T12:06:46.623 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.623 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.623 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.624 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.154674+0000", 2024-04-26T12:06:46.624 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1469999999999998e-06 2024-04-26T12:06:46.624 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.624 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.624 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.624 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.154678+0000", 2024-04-26T12:06:46.624 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5499999999999999e-06 2024-04-26T12:06:46.624 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.624 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.624 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.624 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.154705+0000", 2024-04-26T12:06:46.624 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7483000000000001e-05 2024-04-26T12:06:46.624 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.624 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.625 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.625 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.154786+0000", 2024-04-26T12:06:46.625 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0990999999999998e-05 2024-04-26T12:06:46.625 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.625 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.625 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:46.625 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.154862+0000", 2024-04-26T12:06:46.625 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5771000000000003e-05 2024-04-26T12:06:46.625 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.625 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.625 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.625 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.155643+0000", 2024-04-26T12:06:46.625 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078086200000000001 2024-04-26T12:06:46.625 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.626 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.626 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:46.626 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.161844+0000", 2024-04-26T12:06:46.626 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062016509999999999 2024-04-26T12:06:46.626 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.626 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.626 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:46.626 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.161877+0000", 2024-04-26T12:06:46.626 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2873000000000002e-05 2024-04-26T12:06:46.626 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.626 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.626 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:46.626 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.161897+0000", 2024-04-26T12:06:46.626 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9898000000000002e-05 2024-04-26T12:06:46.626 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.627 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.627 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.627 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.627 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.627 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5455 4.36 4:6d76582f:::1000000192d.00000000:head [write 0~1520] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:46.627 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.156545+0000", 2024-04-26T12:06:46.627 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.39484976399999999, 2024-04-26T12:06:46.627 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0084645789999999999, 2024-04-26T12:06:46.627 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.627 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.627 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:46.627 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:46.627 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:46.627 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5455 2024-04-26T12:06:46.627 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.628 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.628 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.628 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.628 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156545+0000", 2024-04-26T12:06:46.628 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.628 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.628 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.628 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.628 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156545+0000", 2024-04-26T12:06:46.628 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.628 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.628 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.628 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.628 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156545+0000", 2024-04-26T12:06:46.628 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.628 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.629 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.629 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.629 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156548+0000", 2024-04-26T12:06:46.629 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4790000000000001e-06 2024-04-26T12:06:46.629 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.629 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.629 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.629 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156557+0000", 2024-04-26T12:06:46.629 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6309999999999992e-06 2024-04-26T12:06:46.629 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.629 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.629 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.629 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156561+0000", 2024-04-26T12:06:46.629 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5310000000000003e-06 2024-04-26T12:06:46.630 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.630 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.630 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.630 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156598+0000", 2024-04-26T12:06:46.630 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6198999999999997e-05 2024-04-26T12:06:46.630 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.630 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.630 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.630 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156689+0000", 2024-04-26T12:06:46.630 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1566999999999999e-05 2024-04-26T12:06:46.630 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.630 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.630 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:46.630 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.164915+0000", 2024-04-26T12:06:46.630 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0082259599999999992 2024-04-26T12:06:46.631 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.631 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.631 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:46.631 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.164953+0000", 2024-04-26T12:06:46.631 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7970999999999999e-05 2024-04-26T12:06:46.631 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.631 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.631 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:46.631 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.165010+0000", 2024-04-26T12:06:46.631 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6807e-05 2024-04-26T12:06:46.631 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.631 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.631 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.631 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.631 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.632 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5525 4.1e 4:796ca7cc:::10000001978.00000000:head [write 0~953] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:46.632 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.226451+0000", 2024-04-26T12:06:46.632 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.32494397800000002, 2024-04-26T12:06:46.632 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0085371560000000006, 2024-04-26T12:06:46.632 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.632 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.632 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:46.632 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:46.632 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:46.632 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5525 2024-04-26T12:06:46.632 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.632 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.632 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.632 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.632 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226451+0000", 2024-04-26T12:06:46.633 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.633 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.633 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.633 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.633 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226451+0000", 2024-04-26T12:06:46.633 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.633 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.633 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.633 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.633 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226451+0000", 2024-04-26T12:06:46.633 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.633 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.633 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.633 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.634 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226454+0000", 2024-04-26T12:06:46.634 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8940000000000002e-06 2024-04-26T12:06:46.634 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.634 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.634 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.634 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226461+0000", 2024-04-26T12:06:46.634 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6960000000000005e-06 2024-04-26T12:06:46.634 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.634 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.634 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.634 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226465+0000", 2024-04-26T12:06:46.634 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5820000000000002e-06 2024-04-26T12:06:46.634 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.634 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.634 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.635 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226492+0000", 2024-04-26T12:06:46.635 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7305e-05 2024-04-26T12:06:46.635 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.635 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.635 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.635 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226575+0000", 2024-04-26T12:06:46.635 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2688000000000005e-05 2024-04-26T12:06:46.635 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.635 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.635 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:46.635 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226657+0000", 2024-04-26T12:06:46.635 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2298000000000004e-05 2024-04-26T12:06:46.635 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.635 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.635 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:46.636 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.231017+0000", 2024-04-26T12:06:46.636 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043600330000000001 2024-04-26T12:06:46.636 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.636 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.636 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:46.636 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.234892+0000", 2024-04-26T12:06:46.636 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003874345 2024-04-26T12:06:46.636 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.636 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.636 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:46.636 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.234953+0000", 2024-04-26T12:06:46.636 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1148000000000005e-05 2024-04-26T12:06:46.636 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.636 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.636 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:46.637 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.234988+0000", 2024-04-26T12:06:46.637 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5627999999999998e-05 2024-04-26T12:06:46.637 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.637 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.637 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.637 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.637 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.637 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5526 4.4 4:20a3d30a:::10000001979.00000000:head [write 0~1030] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:46.637 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.227384+0000", 2024-04-26T12:06:46.637 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.32401139099999998, 2024-04-26T12:06:46.637 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076519550000000002, 2024-04-26T12:06:46.637 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.637 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.637 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:46.638 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:46.638 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:46.638 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5526 2024-04-26T12:06:46.638 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.638 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.638 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.638 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.638 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227384+0000", 2024-04-26T12:06:46.638 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.638 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.638 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.638 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.638 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227384+0000", 2024-04-26T12:06:46.638 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.639 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.639 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.639 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.639 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227383+0000", 2024-04-26T12:06:46.639 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:46.639 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.639 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.639 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.639 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227388+0000", 2024-04-26T12:06:46.639 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7350000000000004e-06 2024-04-26T12:06:46.639 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.639 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.639 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.639 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227398+0000", 2024-04-26T12:06:46.639 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0533000000000001e-05 2024-04-26T12:06:46.640 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.640 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.640 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.640 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227403+0000", 2024-04-26T12:06:46.640 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0919999999999997e-06 2024-04-26T12:06:46.640 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.640 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.640 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.640 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227433+0000", 2024-04-26T12:06:46.640 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9705000000000001e-05 2024-04-26T12:06:46.640 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.640 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.640 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.640 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227509+0000", 2024-04-26T12:06:46.641 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5862e-05 2024-04-26T12:06:46.641 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.641 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.641 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:46.641 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.234944+0000", 2024-04-26T12:06:46.641 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0074348929999999997 2024-04-26T12:06:46.641 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.641 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.641 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:46.641 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.234982+0000", 2024-04-26T12:06:46.641 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8488000000000001e-05 2024-04-26T12:06:46.641 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.642 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.642 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:46.642 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235036+0000", 2024-04-26T12:06:46.642 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3395e-05 2024-04-26T12:06:46.642 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.642 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.642 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.642 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.642 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.642 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4564.0:5531 4.2c e50/16 4:37f6d93a:::10000001980.00000000:head v 50'94, mlcod=50'92)", 2024-04-26T12:06:46.642 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.233360+0000", 2024-04-26T12:06:46.642 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.31803519200000002, 2024-04-26T12:06:46.642 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0072882060000000002, 2024-04-26T12:06:46.643 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.643 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.643 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.643 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.643 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.643 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.233360+0000", 2024-04-26T12:06:46.643 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.643 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.643 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.643 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.643 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.233360+0000", 2024-04-26T12:06:46.643 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.643 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.644 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.644 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.644 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.233359+0000", 2024-04-26T12:06:46.644 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.644 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.644 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.644 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.644 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.233364+0000", 2024-04-26T12:06:46.644 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.634e-06 2024-04-26T12:06:46.644 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.644 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.644 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.644 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.233374+0000", 2024-04-26T12:06:46.644 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5610000000000004e-06 2024-04-26T12:06:46.644 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.644 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.645 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.645 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.233379+0000", 2024-04-26T12:06:46.645 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9309999999999996e-06 2024-04-26T12:06:46.645 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.645 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.645 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.645 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.233409+0000", 2024-04-26T12:06:46.645 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9838000000000001e-05 2024-04-26T12:06:46.645 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.645 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.645 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.645 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.233423+0000", 2024-04-26T12:06:46.645 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3557000000000001e-05 2024-04-26T12:06:46.645 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.646 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.646 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:46.646 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.240614+0000", 2024-04-26T12:06:46.646 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0071914270000000002 2024-04-26T12:06:46.646 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.646 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.646 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:46.646 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.240648+0000", 2024-04-26T12:06:46.646 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3850000000000003e-05 2024-04-26T12:06:46.646 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.646 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.646 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.646 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.646 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.646 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4564.0:5533 4.3a e50/16 4:5d782e82:::10000001982.00000000:head v 50'87, mlcod=50'85)", 2024-04-26T12:06:46.647 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.235056+0000", 2024-04-26T12:06:46.647 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.31633905400000001, 2024-04-26T12:06:46.647 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0084653469999999998, 2024-04-26T12:06:46.647 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.647 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.647 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.647 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.647 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.647 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235056+0000", 2024-04-26T12:06:46.647 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.647 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.647 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.647 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.647 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235056+0000", 2024-04-26T12:06:46.648 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.648 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.648 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.648 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.648 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235056+0000", 2024-04-26T12:06:46.648 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.648 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.648 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.648 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.648 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235063+0000", 2024-04-26T12:06:46.648 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.374e-06 2024-04-26T12:06:46.648 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.648 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.648 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.649 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235072+0000", 2024-04-26T12:06:46.649 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6719999999999993e-06 2024-04-26T12:06:46.649 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.649 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.649 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.649 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235076+0000", 2024-04-26T12:06:46.649 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1919999999999998e-06 2024-04-26T12:06:46.649 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.649 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.649 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.649 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235104+0000", 2024-04-26T12:06:46.649 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8509000000000001e-05 2024-04-26T12:06:46.649 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.649 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.649 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.649 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235116+0000", 2024-04-26T12:06:46.650 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1970999999999999e-05 2024-04-26T12:06:46.650 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.650 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.650 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:46.650 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.243491+0000", 2024-04-26T12:06:46.650 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0083750930000000001 2024-04-26T12:06:46.650 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.650 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.650 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:46.650 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.243521+0000", 2024-04-26T12:06:46.650 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9992e-05 2024-04-26T12:06:46.650 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.650 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.650 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.651 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.651 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.651 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4564.0:5534 4.18 e50/16 4:1887e072:::10000001983.00000000:head v 50'103, mlcod=50'101)", 2024-04-26T12:06:46.651 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.236092+0000", 2024-04-26T12:06:46.651 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.31530359000000002, 2024-04-26T12:06:46.651 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0074497030000000002, 2024-04-26T12:06:46.651 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:46.651 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:46.651 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:46.651 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.651 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:46.651 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.236092+0000", 2024-04-26T12:06:46.651 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.651 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.651 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.651 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:46.652 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.236092+0000", 2024-04-26T12:06:46.652 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:46.652 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.652 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.652 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:46.652 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.236091+0000", 2024-04-26T12:06:46.652 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:46.652 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.652 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.652 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:46.652 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.236097+0000", 2024-04-26T12:06:46.652 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9900000000000002e-06 2024-04-26T12:06:46.652 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.652 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.652 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:46.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.236109+0000", 2024-04-26T12:06:46.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1834999999999999e-05 2024-04-26T12:06:46.653 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.236117+0000", 2024-04-26T12:06:46.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1259999999999998e-06 2024-04-26T12:06:46.653 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:46.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.236146+0000", 2024-04-26T12:06:46.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8736999999999999e-05 2024-04-26T12:06:46.653 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:46.654 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.236159+0000", 2024-04-26T12:06:46.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3098000000000001e-05 2024-04-26T12:06:46.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.654 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.654 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:46.654 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.243519+0000", 2024-04-26T12:06:46.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073600590000000004 2024-04-26T12:06:46.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:46.654 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:46.654 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:46.654 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.243541+0000", 2024-04-26T12:06:46.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2476e-05 2024-04-26T12:06:46.654 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.655 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.655 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.655 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:46.655 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:46.655 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:46.655 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:46.661 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:46.660+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:46.758 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:46.756+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:46.771 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:46.771 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:46.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.772 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:5983 4.e 4:7116baac:::10000001b74.00000000:head [write 0~157 in=157b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:46.772 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:46.770056+0000", 2024-04-26T12:06:46.772 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00081182200000000002, 2024-04-26T12:06:46.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00082744299999999997, 2024-04-26T12:06:46.772 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:46.772 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:46.772 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:46.772 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:46.772 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:46.772 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 5983 2024-04-26T12:06:46.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.772 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:46.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:46.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:46.770056+0000", 2024-04-26T12:06:46.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:46.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:46.770056+0000", 2024-04-26T12:06:46.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:46.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:46.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:46.770054+0000", 2024-04-26T12:06:46.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:46.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:46.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:46.770061+0000", 2024-04-26T12:06:46.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0800000000000002e-06 2024-04-26T12:06:46.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:46.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:46.770072+0000", 2024-04-26T12:06:46.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1058e-05 2024-04-26T12:06:46.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:46.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:46.770077+0000", 2024-04-26T12:06:46.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4550000000000003e-06 2024-04-26T12:06:46.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:46.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:46.770106+0000", 2024-04-26T12:06:46.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8643999999999999e-05 2024-04-26T12:06:46.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:46.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:46.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:46.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:46.770209+0000", 2024-04-26T12:06:46.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000103681 2024-04-26T12:06:46.775 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.775 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:46.775 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.775 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:46.775 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-04-26T12:06:46.776 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 1 2024-04-26T12:06:46.776 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:46.781 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:46.859 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:46.858+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:46.899 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:46.899 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:46.899 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:46.899 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:46.900 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:46.910 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:46.960 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:46.959+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:47.060 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:47.060 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:47.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:47.061 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:47.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.061 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:47.061 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:47.061 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 113.202299533, 2024-04-26T12:06:47.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:47.062 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:47.062 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.062 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:47.062 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:47.062 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:47.062 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:47.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.063 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:47.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:47.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:47.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:47.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:47.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:47.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:47.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:47.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:47.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:47.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:47.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:47.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:47.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:47.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:47.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.066 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:47.066 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:47.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:47.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:47.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:47.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:47.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:47.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:47.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:47.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:47.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:47.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:47.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:47.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:47.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:47.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:47.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:47.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:47.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:47.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:47.069 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.069 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:47.069 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.069 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:47.069 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:47.070 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 113.20219363699999, 2024-04-26T12:06:47.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:47.070 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:47.070 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.070 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:47.070 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:47.070 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:47.070 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:47.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.070 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:47.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:47.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:47.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.071 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:47.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:47.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.071 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:47.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:47.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.071 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:47.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:47.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:47.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:47.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:47.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:47.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:47.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:47.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:47.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:47.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:47.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.073 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:47.073 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:47.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:47.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.073 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:47.073 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:47.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:47.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.073 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:47.073 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:47.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:47.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:47.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:47.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:47.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:47.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:47.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:47.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:47.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:47.075 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.075 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:47.075 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.075 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:47.075 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:47.075 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 113.202178657, 2024-04-26T12:06:47.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:47.075 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:47.075 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.075 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:47.075 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:47.075 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:47.076 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:47.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.076 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:47.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:47.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:47.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:47.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:47.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:47.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:47.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:47.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:47.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:47.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:47.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:47.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:47.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:47.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:47.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:47.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:47.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:47.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:47.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:47.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:47.079 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.079 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:47.079 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:47.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:47.079 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.079 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:47.079 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:47.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:47.079 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.080 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.080 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:47.080 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:47.080 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.080 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:47.080 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:47.080 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:47.080 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.080 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:47.080 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:47.080 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:47.080 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.080 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:47.081 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.081 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.081 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:47.081 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:47.081 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 113.202134782, 2024-04-26T12:06:47.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:47.081 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:47.081 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.081 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:47.081 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:47.081 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:47.081 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:47.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.082 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:47.082 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.082 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:47.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:47.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.082 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.082 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.082 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:47.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:47.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.082 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.082 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.082 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:47.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:47.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.083 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.083 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:47.083 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:47.083 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:47.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.083 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.083 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:47.083 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:47.083 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:47.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.084 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.084 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.084 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:47.084 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:47.084 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.084 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.084 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:47.084 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:47.084 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:47.084 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.084 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.084 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:47.084 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:47.084 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:47.084 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.085 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.085 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:47.085 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:47.085 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:47.085 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.085 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.085 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:47.085 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:47.085 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:47.085 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.085 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.085 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.085 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:47.085 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:47.085 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.086 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:47.086 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:47.086 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:47.086 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.086 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:47.086 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:47.086 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:47.086 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.086 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:47.086 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.086 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.086 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:47.087 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:47.087 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 113.20204911800001, 2024-04-26T12:06:47.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:47.087 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:47.087 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.087 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:47.087 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:47.087 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:47.087 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:47.087 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.087 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:47.087 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.087 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:47.087 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:47.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:47.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:47.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:47.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:47.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:47.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:47.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:47.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:47.089 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:47.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:47.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.089 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:47.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:47.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:47.089 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:47.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:47.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.090 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.090 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:47.090 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:47.090 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:47.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.090 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.090 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:47.090 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:47.090 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:47.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.091 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.091 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:47.091 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:47.091 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:47.091 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.091 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.091 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.091 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:47.091 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:47.092 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.092 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:47.092 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:47.092 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:47.092 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.092 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:47.092 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:47.092 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:47.092 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.092 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:47.092 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.092 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.093 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:47.093 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:47.093 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 103.276144832, 2024-04-26T12:06:47.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:47.093 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:47.093 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.093 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:47.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.093 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:47.093 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:47.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.093 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.093 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:47.093 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:47.094 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.094 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.094 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:47.094 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:47.094 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:47.094 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.094 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:47.094 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:47.094 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:47.094 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.094 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:47.094 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:47.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:47.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:47.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:47.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:47.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:47.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:47.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:47.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:47.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:47.096 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.096 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.096 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:47.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:47.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:47.096 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.096 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.096 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:47.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:47.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:47.096 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.096 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.096 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:47.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:47.097 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.097 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.097 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:47.097 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:47.097 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:47.097 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.097 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.097 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:47.097 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:47.097 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:47.097 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.097 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:47.097 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.097 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.097 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.098 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:47.098 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:47.098 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 103.276108737, 2024-04-26T12:06:47.098 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:47.098 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:47.098 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.098 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:47.098 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.098 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:47.098 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:47.098 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.098 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.098 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.098 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:47.098 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:47.099 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.099 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.099 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.099 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:47.099 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:47.099 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:47.099 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.099 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.099 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:47.100 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:47.100 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:47.100 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.100 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.100 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:47.100 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:47.100 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:47.100 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.100 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.100 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.100 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:47.101 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:47.101 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.101 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.101 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:47.101 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:47.101 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:47.101 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.101 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.101 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:47.101 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:47.101 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:47.101 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.101 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.101 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:47.101 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:47.102 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:47.102 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.102 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.102 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:47.102 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:47.102 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:47.102 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.102 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.102 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.102 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:47.102 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:47.102 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.102 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.102 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:47.103 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:47.103 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:47.103 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.103 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.103 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:47.103 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:47.103 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:47.103 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.103 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:47.103 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.103 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.103 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.103 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:47.103 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:47.103 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 103.276071053, 2024-04-26T12:06:47.104 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:47.104 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:47.104 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.104 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:47.104 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.104 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:47.104 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:47.104 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.104 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.104 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.104 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:47.104 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:47.104 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.104 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.105 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:47.105 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:47.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.105 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:47.105 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:47.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:47.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.105 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:47.105 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:47.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:47.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.106 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.106 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:47.106 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:47.106 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.106 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.106 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:47.106 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:47.106 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:47.106 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.106 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.106 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:47.106 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:47.106 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:47.106 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.107 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.107 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:47.107 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:47.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:47.107 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.107 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.107 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:47.107 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:47.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:47.107 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.107 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.107 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.107 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:47.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:47.107 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:47.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:47.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:47.108 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:47.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:47.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:47.108 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.108 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:47.108 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.108 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.108 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:47.109 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:47.109 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 103.27604971300001, 2024-04-26T12:06:47.109 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:47.109 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:47.109 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.109 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:47.109 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.109 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:47.109 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:47.109 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.109 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.109 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.109 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:47.109 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:47.109 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.109 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.110 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.110 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:47.110 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:47.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.110 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.110 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.110 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:47.110 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:47.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:47.110 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.110 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.110 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:47.110 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:47.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:47.111 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.111 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.111 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.111 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:47.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:47.111 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.111 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.111 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:47.111 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:47.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:47.111 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.111 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.111 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:47.111 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:47.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:47.112 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.112 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.112 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:47.112 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:47.112 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:47.112 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.112 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.112 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:47.112 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:47.112 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:47.112 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.112 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.112 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.112 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:47.112 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:47.113 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.113 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.113 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:47.113 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:47.113 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:47.113 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.113 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.113 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:47.113 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:47.113 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:47.113 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.113 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:47.113 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.113 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.114 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:47.114 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:47.114 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 103.276027447, 2024-04-26T12:06:47.114 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:47.114 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:47.114 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.114 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:47.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.114 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:47.114 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:47.114 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.114 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.114 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:47.115 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:47.115 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.115 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.115 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:47.115 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:47.115 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.115 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.115 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:47.115 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:47.115 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:47.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.115 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.115 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:47.116 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:47.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:47.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.116 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.116 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:47.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:47.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.116 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:47.116 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:47.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:47.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.116 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:47.117 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:47.117 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:47.117 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.117 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.117 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:47.117 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:47.117 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:47.117 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.117 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.117 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:47.117 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:47.117 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:47.117 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.117 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:47.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:47.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:47.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:47.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:47.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:47.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:47.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:47.118 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.118 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:47.119 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.119 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:47.119 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:47.119 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 103.276005825, 2024-04-26T12:06:47.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:47.119 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:47.119 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.119 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:47.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.119 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:47.119 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:47.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.120 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:47.120 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:47.120 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.120 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:47.120 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:47.120 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.120 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:47.120 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:47.120 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:47.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.121 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:47.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:47.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:47.121 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.121 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:47.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:47.121 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.121 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:47.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:47.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:47.121 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.122 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:47.122 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:47.122 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:47.122 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.122 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.122 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:47.122 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:47.122 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:47.122 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.122 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.122 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:47.122 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:47.122 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:47.122 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.122 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.123 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.123 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:47.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:47.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.123 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:47.123 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:47.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:47.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.123 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:47.123 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:47.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:47.123 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.123 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:47.124 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.124 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.124 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.124 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:47.124 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:47.124 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 103.275979259, 2024-04-26T12:06:47.124 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:47.124 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:47.124 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.124 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:47.124 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.124 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:47.124 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:47.124 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.125 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.125 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.125 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:47.125 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:47.125 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.125 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.125 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.125 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:47.125 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:47.125 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.125 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.125 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.125 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:47.125 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:47.125 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:47.125 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.126 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.126 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:47.126 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:47.126 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:47.126 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.126 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.126 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.126 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:47.126 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:47.126 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.126 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.126 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:47.126 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:47.126 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:47.127 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.127 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.127 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:47.127 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:47.127 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:47.127 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.127 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.127 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:47.127 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:47.127 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:47.127 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.127 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.127 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:47.127 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:47.127 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:47.128 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.128 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.128 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.128 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:47.128 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:47.128 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.128 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.128 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:47.128 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:47.128 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:47.128 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.128 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.128 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:47.128 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:47.128 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:47.128 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.129 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:47.129 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.129 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.129 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.129 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:47.129 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:47.129 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 103.27594074700001, 2024-04-26T12:06:47.129 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:47.129 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:47.129 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.129 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:47.129 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.129 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:47.129 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:47.130 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.130 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.130 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.130 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:47.130 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:47.130 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.130 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.130 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.130 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:47.130 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:47.130 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.130 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.130 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.130 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:47.131 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:47.131 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:47.131 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.131 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.131 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:47.131 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:47.131 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:47.131 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.131 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.131 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.131 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:47.131 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:47.131 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.131 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.131 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:47.132 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:47.132 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:47.132 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.132 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.132 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:47.132 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:47.132 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:47.132 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.132 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.132 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:47.132 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:47.132 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:47.132 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.132 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.132 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:47.133 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:47.133 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:47.133 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.133 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.133 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.133 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:47.133 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:47.133 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.133 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.133 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:47.133 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:47.133 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:47.133 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.133 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.133 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:47.133 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:47.134 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:47.134 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.134 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:47.134 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.134 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.134 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.134 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:47.134 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:47.134 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 103.275912574, 2024-04-26T12:06:47.134 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:47.134 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:47.134 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.134 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:47.134 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.134 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:47.135 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:47.135 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.135 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.135 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.135 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:47.135 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:47.135 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.135 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.135 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.135 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:47.135 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:47.135 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.135 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.135 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.135 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:47.136 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:47.136 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:47.136 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.136 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.136 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:47.136 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:47.136 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:47.136 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.136 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.136 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.136 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:47.136 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:47.136 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.136 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.136 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:47.137 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:47.137 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:47.137 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.137 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.137 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:47.137 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:47.137 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:47.137 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.137 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.137 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:47.137 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:47.137 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:47.137 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.137 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.137 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:47.138 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:47.138 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:47.138 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.138 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.138 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.138 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:47.138 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:47.138 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.138 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.138 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:47.138 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:47.138 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:47.138 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.138 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.138 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:47.139 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:47.139 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:47.139 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.139 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:47.139 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.139 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.139 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.139 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:47.139 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:47.139 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 103.27587801, 2024-04-26T12:06:47.139 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:47.139 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:47.139 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.139 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:47.139 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.140 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:47.140 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:47.140 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.140 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.140 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.140 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:47.140 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:47.140 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.140 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.140 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.140 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:47.140 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:47.140 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.140 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.140 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.141 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:47.141 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:47.141 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:47.141 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.141 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.141 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:47.141 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:47.141 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:47.141 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.141 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.141 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.141 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:47.141 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:47.141 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.141 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.142 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:47.142 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:47.142 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:47.142 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.142 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.142 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:47.142 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:47.142 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:47.142 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.142 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.142 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:47.142 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:47.142 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:47.142 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.142 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.143 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:47.143 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:47.143 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:47.143 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.143 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.143 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.143 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:47.143 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:47.143 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.143 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.143 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:47.143 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:47.143 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:47.143 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.143 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.144 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:47.144 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:47.144 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:47.144 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.144 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:47.144 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.144 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.144 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.144 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:47.144 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:47.144 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 103.27500323, 2024-04-26T12:06:47.144 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:47.144 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:47.144 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.144 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:47.145 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.145 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:47.145 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:47.145 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.145 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.145 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.145 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:47.145 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:47.145 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.145 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.145 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.145 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:47.145 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:47.145 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:47.145 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.146 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.146 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:47.146 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:47.146 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:47.146 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.146 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.146 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:47.146 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:47.146 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:47.146 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.146 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.146 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.146 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:47.146 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:47.146 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.147 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.147 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:47.147 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:47.147 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:47.147 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.147 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.147 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:47.147 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:47.147 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:47.147 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.147 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.147 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:47.147 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:47.147 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:47.147 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.148 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.148 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:47.148 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:47.148 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:47.148 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.148 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.148 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.148 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:47.148 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:47.148 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.148 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.148 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:47.148 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:47.148 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:47.148 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.149 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.149 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:47.149 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:47.149 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:47.149 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.149 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:47.149 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.149 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.149 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.149 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:47.149 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:47.149 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 103.274964271, 2024-04-26T12:06:47.149 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:47.149 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:47.149 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.150 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:47.150 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.150 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:47.150 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:47.150 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.150 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.150 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.150 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:47.150 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:47.150 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.150 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.150 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.150 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:47.150 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:47.151 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.151 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.151 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.151 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:47.151 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:47.151 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:47.151 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.151 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.151 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:47.151 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:47.151 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:47.151 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.151 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.151 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.151 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:47.151 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:47.152 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.152 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.152 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:47.152 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:47.152 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:47.152 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.152 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.152 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:47.152 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:47.152 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:47.152 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.152 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.152 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:47.152 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:47.152 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:47.153 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.153 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.153 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:47.153 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:47.153 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:47.153 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.153 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.153 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.153 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:47.153 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:47.153 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.153 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.153 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:47.153 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:47.153 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:47.154 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.154 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.154 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:47.154 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:47.154 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:47.154 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.154 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:47.154 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.154 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.154 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.154 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:47.154 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:47.154 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 103.27492879899999, 2024-04-26T12:06:47.154 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:47.154 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:47.155 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.155 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:47.155 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.155 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:47.155 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:47.155 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.155 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.155 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.155 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:47.155 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:47.155 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.155 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.155 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.155 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:47.156 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:47.156 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.156 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.156 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.156 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:47.156 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:47.156 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:47.156 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.156 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.156 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:47.156 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:47.156 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:47.156 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.156 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.156 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.157 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:47.157 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:47.157 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.157 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.157 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:47.157 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:47.157 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:47.157 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.157 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.157 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:47.157 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:47.157 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:47.157 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.157 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.157 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:47.158 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:47.158 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:47.158 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.158 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.158 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:47.158 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:47.158 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:47.158 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.158 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.158 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.158 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:47.158 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:47.158 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.158 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.158 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:47.159 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:47.159 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:47.159 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.159 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.159 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:47.159 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:47.159 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:47.159 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.159 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:47.159 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.159 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.159 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.159 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:47.159 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:47.159 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 103.27485011, 2024-04-26T12:06:47.160 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:47.160 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:47.160 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.160 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:47.160 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.160 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:47.160 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:47.160 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.160 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.160 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.160 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:47.160 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:47.160 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.160 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.160 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.161 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:47.161 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:47.161 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:47.161 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.161 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.161 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:47.161 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:47.161 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:47.161 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.161 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.161 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:47.161 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:47.161 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:47.161 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.161 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.161 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.162 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:47.162 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:47.162 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.162 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.162 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:47.162 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:47.162 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:47.162 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.162 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.162 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:47.162 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:47.162 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:47.162 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.162 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.163 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:47.163 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:47.163 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:47.163 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.163 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.163 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:47.163 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:47.163 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:47.163 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.163 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.163 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.163 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:47.163 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:47.163 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.163 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.164 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:47.164 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:47.164 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:47.164 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.164 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.164 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:47.164 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:47.164 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:47.164 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.164 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:47.164 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.165 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.165 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.165 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:47.165 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:47.165 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 103.274699262, 2024-04-26T12:06:47.165 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:47.165 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:47.165 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:47.165 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:47.165 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.165 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:47.165 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:47.165 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.165 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.165 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.166 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:47.166 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:47.166 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:47.166 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.166 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.166 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:47.166 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:47.166 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:47.166 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.166 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.166 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:47.166 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:47.166 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:47.166 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.167 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.167 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:47.167 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:47.167 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:47.167 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.167 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.167 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.167 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:47.167 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:47.167 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.167 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.167 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:47.167 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:47.167 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:47.167 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.168 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.168 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:47.168 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:47.168 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:47.168 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:47.168 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:47.168 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:47.168 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:47.168 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:47.168 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.168 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:47.168 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.168 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:47.168 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:47.168 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:47.169 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~29s 2024-04-26T12:06:47.170 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:47.168+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:47.170 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:47.272 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:47.270+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:47.279 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:47.280 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:47.280 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.280 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4564.0:6446 4.30 e50/16)", 2024-04-26T12:06:47.280 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:47.279168+0000", 2024-04-26T12:06:47.280 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.2667000000000002e-05, 2024-04-26T12:06:47.280 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8926e-05, 2024-04-26T12:06:47.280 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:47.280 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-04-26T12:06:47.281 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:47.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.281 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:47.281 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.279168+0000", 2024-04-26T12:06:47.281 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.281 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.281 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:47.281 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.279168+0000", 2024-04-26T12:06:47.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:47.282 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.279167+0000", 2024-04-26T12:06:47.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:47.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.279176+0000", 2024-04-26T12:06:47.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7839999999999992e-06 2024-04-26T12:06:47.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:47.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.279186+0000", 2024-04-26T12:06:47.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9049999999999992e-06 2024-04-26T12:06:47.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.284 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.279192+0000", 2024-04-26T12:06:47.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4890000000000003e-06 2024-04-26T12:06:47.284 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.284 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:47.284 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.284 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.285 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-04-26T12:06:47.285 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 1 2024-04-26T12:06:47.285 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:47.289 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:47.375 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:47.374+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:47.437 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:47.437 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:47.437 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:47.437 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:47.438 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:47.447 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:47.472 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:47.471+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:47.503 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-26T12:06:47.573 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:47.572+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:47.596 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:47.596 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:47.596 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:47.596 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:47.596 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.596 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:47.596 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:47.596 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 103.81359333100001, 2024-04-26T12:06:47.596 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:06:47.596 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:47.597 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.597 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:47.597 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.597 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:47.597 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:47.597 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.597 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.597 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.597 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:47.597 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:47.597 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.597 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.597 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.597 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:47.598 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:06:47.598 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:47.598 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.598 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.598 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:47.598 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:06:47.598 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:06:47.598 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.598 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.598 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:47.598 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:06:47.598 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:06:47.598 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.598 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.599 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.599 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:06:47.599 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:06:47.599 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.599 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.599 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:47.599 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:06:47.599 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:06:47.599 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.599 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.599 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:47.599 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:47.599 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:06:47.600 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.600 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.600 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:47.600 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:06:47.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:06:47.600 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.600 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.600 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:47.600 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:06:47.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:06:47.601 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.601 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.601 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.601 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:06:47.601 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:06:47.601 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.601 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.601 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:47.601 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:06:47.601 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:06:47.601 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.601 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.601 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:47.601 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:06:47.602 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:06:47.602 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.602 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:47.602 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.602 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.602 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.602 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:47.602 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:47.605 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 103.81353801100001, 2024-04-26T12:06:47.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:06:47.606 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:47.606 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.606 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:47.606 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:47.606 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:47.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.606 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.606 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.607 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:47.607 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:47.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.607 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.607 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.607 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:47.607 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:06:47.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:47.607 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.607 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.607 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:47.607 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:06:47.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:06:47.608 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.608 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.608 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:47.608 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:06:47.608 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:06:47.608 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.608 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.608 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.608 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:06:47.608 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:06:47.608 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.609 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.609 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:47.609 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:06:47.609 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:06:47.609 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.609 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.609 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:47.609 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:06:47.609 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:06:47.609 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.609 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.610 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:47.610 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:06:47.610 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:06:47.610 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.610 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.610 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:47.610 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:06:47.610 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:06:47.610 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.610 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.610 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.610 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:06:47.610 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:06:47.611 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.611 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.611 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:47.611 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:06:47.611 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:06:47.611 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.611 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.611 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:47.611 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:06:47.611 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:06:47.612 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.612 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:47.612 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.612 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.612 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.612 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:47.612 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:47.612 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 103.813453356, 2024-04-26T12:06:47.612 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:06:47.613 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:47.613 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.613 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:47.613 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.613 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:47.613 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:47.613 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.613 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.613 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.613 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:47.614 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:47.614 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.614 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.614 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.614 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:47.614 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:06:47.614 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.614 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.614 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.614 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:47.614 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:06:47.614 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:06:47.615 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.615 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.615 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:47.615 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:47.615 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:06:47.615 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.615 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.615 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.615 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:06:47.615 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:06:47.615 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.615 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.615 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:06:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:06:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:06:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:06:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:06:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:06:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:06:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:06:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:06:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:06:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:06:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:06:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:06:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:06:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 103.81341484399999, 2024-04-26T12:06:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:06:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:47.620 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.620 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.620 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:47.620 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:47.620 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:06:47.620 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.620 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.620 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:47.620 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:06:47.620 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:06:47.620 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.620 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.620 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.620 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:06:47.620 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:06:47.621 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.621 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.621 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:47.621 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:06:47.621 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:06:47.621 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.621 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.621 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:47.621 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:06:47.621 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:06:47.621 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.621 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.621 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:47.622 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:06:47.622 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:06:47.622 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.622 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.622 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.622 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:06:47.622 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:06:47.622 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.622 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.622 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:47.622 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:06:47.622 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:06:47.622 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.622 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.623 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:47.623 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:06:47.623 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:06:47.623 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.623 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.623 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:47.623 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:06:47.623 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:06:47.623 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.623 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:47.623 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.623 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.623 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.623 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:47.624 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:47.624 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 103.813357819, 2024-04-26T12:06:47.624 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:06:47.624 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:47.624 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:47.624 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:47.624 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.624 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:47.624 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:47.624 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.624 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.624 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.624 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:47.624 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:47.624 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.625 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.625 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.625 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:47.625 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:47.625 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.625 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.625 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.625 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:47.625 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:06:47.625 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:06:47.625 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.625 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.625 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:47.625 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:06:47.625 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:06:47.626 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.626 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.626 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.626 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:06:47.626 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:06:47.626 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.626 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.626 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:47.626 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:06:47.626 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:06:47.626 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.626 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.626 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:47.626 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:06:47.627 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:06:47.627 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.627 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.627 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:47.627 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:06:47.627 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:06:47.627 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.627 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:47.627 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.627 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.627 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.627 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:47.627 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:47.627 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 103.81331552899999, 2024-04-26T12:06:47.627 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:06:47.628 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:47.628 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:47.628 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:47.628 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.628 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:47.628 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:47.628 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.628 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.628 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.628 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:47.628 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:47.628 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.628 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.629 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.629 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:47.629 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:47.629 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.629 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.629 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.629 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:47.629 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:06:47.629 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:06:47.629 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.629 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.629 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:47.629 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:06:47.629 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:06:47.630 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.630 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.630 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.630 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:06:47.630 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:06:47.630 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.630 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.630 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:47.630 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:06:47.630 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:06:47.630 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.630 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.630 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:47.630 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:06:47.631 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:06:47.631 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.631 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.631 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:47.631 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:06:47.631 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:06:47.631 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.631 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:47.631 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.631 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.631 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.631 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5128 4.12 4:4af27bd2:::100000017e6.00000000:head [write 0~1985] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:47.631 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:45.851916+0000", 2024-04-26T12:06:47.631 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.7418576780000001, 2024-04-26T12:06:47.631 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0087160190000000002, 2024-04-26T12:06:47.632 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:47.632 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.632 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:47.632 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:47.632 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:47.632 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5128 2024-04-26T12:06:47.632 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.632 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:47.632 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.632 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:47.632 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851916+0000", 2024-04-26T12:06:47.632 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.632 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.632 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.632 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:47.633 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851916+0000", 2024-04-26T12:06:47.633 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.633 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.633 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.633 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:47.633 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851916+0000", 2024-04-26T12:06:47.633 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:47.633 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.633 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.633 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:47.633 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851923+0000", 2024-04-26T12:06:47.633 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9029999999999998e-06 2024-04-26T12:06:47.633 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.633 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.633 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:47.634 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851933+0000", 2024-04-26T12:06:47.634 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0665e-05 2024-04-26T12:06:47.634 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.634 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.634 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.634 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851938+0000", 2024-04-26T12:06:47.634 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1549999999999998e-06 2024-04-26T12:06:47.634 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.634 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.634 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:47.634 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851981+0000", 2024-04-26T12:06:47.634 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3028000000000002e-05 2024-04-26T12:06:47.634 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.634 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.635 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:47.635 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852118+0000", 2024-04-26T12:06:47.635 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000136556 2024-04-26T12:06:47.635 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.635 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.635 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:47.635 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.860523+0000", 2024-04-26T12:06:47.635 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0084049859999999997 2024-04-26T12:06:47.635 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.635 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.635 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:47.635 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.860574+0000", 2024-04-26T12:06:47.635 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.096e-05 2024-04-26T12:06:47.635 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.636 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.636 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:47.636 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.860632+0000", 2024-04-26T12:06:47.636 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8554000000000002e-05 2024-04-26T12:06:47.636 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.636 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:47.636 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.636 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.636 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.636 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5129 4.29 4:95ace1b8:::100000017e7.00000000:head [write 0~4336] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:47.636 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:45.852861+0000", 2024-04-26T12:06:47.636 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.7409135330000001, 2024-04-26T12:06:47.636 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0077481420000000004, 2024-04-26T12:06:47.637 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:47.637 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.637 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:47.637 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:47.637 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:47.637 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5129 2024-04-26T12:06:47.637 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.637 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:47.637 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.637 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:47.637 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852861+0000", 2024-04-26T12:06:47.638 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.638 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.638 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.638 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:47.638 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852861+0000", 2024-04-26T12:06:47.638 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.638 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.638 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.638 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:47.639 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852860+0000", 2024-04-26T12:06:47.639 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.639 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.639 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.639 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:47.639 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852867+0000", 2024-04-26T12:06:47.639 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6889999999999998e-06 2024-04-26T12:06:47.639 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.639 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.639 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:47.640 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852874+0000", 2024-04-26T12:06:47.640 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9190000000000002e-06 2024-04-26T12:06:47.640 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.640 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.640 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.640 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852877+0000", 2024-04-26T12:06:47.640 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770000000000003e-06 2024-04-26T12:06:47.640 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.640 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.640 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:47.640 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852935+0000", 2024-04-26T12:06:47.640 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7933999999999998e-05 2024-04-26T12:06:47.640 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.640 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.641 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:47.641 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.853026+0000", 2024-04-26T12:06:47.641 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0656999999999996e-05 2024-04-26T12:06:47.641 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.643 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.643 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:47.643 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.853097+0000", 2024-04-26T12:06:47.643 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0698000000000006e-05 2024-04-26T12:06:47.643 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.643 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.643 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.643 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.857693+0000", 2024-04-26T12:06:47.643 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045966979999999998 2024-04-26T12:06:47.643 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.644 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.644 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:47.644 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.860524+0000", 2024-04-26T12:06:47.644 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028308930000000001 2024-04-26T12:06:47.644 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.644 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.644 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:47.644 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.860576+0000", 2024-04-26T12:06:47.644 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1415000000000002e-05 2024-04-26T12:06:47.644 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.644 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.644 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:47.644 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.860609+0000", 2024-04-26T12:06:47.644 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2895999999999998e-05 2024-04-26T12:06:47.645 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.645 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:47.645 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.645 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.645 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.645 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4564.0:5451 4.3c e50/16 4:3eaa9979:::10000001929.00000000:head v 50'68, mlcod=50'66)", 2024-04-26T12:06:47.645 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.153240+0000", 2024-04-26T12:06:47.645 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.440534489, 2024-04-26T12:06:47.645 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.008611357, 2024-04-26T12:06:47.645 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:47.645 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.645 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:47.645 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.646 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:47.646 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153240+0000", 2024-04-26T12:06:47.646 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.646 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.646 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.646 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:47.646 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153240+0000", 2024-04-26T12:06:47.646 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.646 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.646 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.646 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:47.646 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153239+0000", 2024-04-26T12:06:47.647 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.647 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.647 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.647 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:47.647 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153244+0000", 2024-04-26T12:06:47.647 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:06:47.647 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.647 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.647 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:47.647 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153254+0000", 2024-04-26T12:06:47.647 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2839999999999995e-06 2024-04-26T12:06:47.647 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.647 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.648 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.648 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153260+0000", 2024-04-26T12:06:47.648 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:06:47.648 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.648 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.648 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:47.648 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153298+0000", 2024-04-26T12:06:47.648 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8157000000000001e-05 2024-04-26T12:06:47.648 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.648 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.648 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:47.648 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153312+0000", 2024-04-26T12:06:47.649 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4158999999999999e-05 2024-04-26T12:06:47.649 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.649 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.649 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:47.649 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.161819+0000", 2024-04-26T12:06:47.649 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0085061819999999993 2024-04-26T12:06:47.649 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.649 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.649 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:47.649 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.161851+0000", 2024-04-26T12:06:47.649 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2416999999999998e-05 2024-04-26T12:06:47.649 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.649 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:47.649 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.650 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.650 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.650 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5452 4.21 4:840c9502:::1000000192a.00000000:head [write 0~4217] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:47.650 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.153843+0000", 2024-04-26T12:06:47.650 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.43993064, 2024-04-26T12:06:47.650 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081189629999999999, 2024-04-26T12:06:47.650 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:47.650 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.650 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:47.650 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:47.650 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:47.650 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5452 2024-04-26T12:06:47.650 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.650 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:47.651 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.651 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:47.651 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153843+0000", 2024-04-26T12:06:47.651 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.651 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.651 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.651 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:47.651 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153843+0000", 2024-04-26T12:06:47.651 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.651 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.651 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.652 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:47.652 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153843+0000", 2024-04-26T12:06:47.652 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:47.652 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.652 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.652 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:47.652 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153851+0000", 2024-04-26T12:06:47.652 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9789999999999993e-06 2024-04-26T12:06:47.652 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.652 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.652 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:47.652 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153861+0000", 2024-04-26T12:06:47.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9699999999999994e-06 2024-04-26T12:06:47.653 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153865+0000", 2024-04-26T12:06:47.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9389999999999996e-06 2024-04-26T12:06:47.653 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:47.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153906+0000", 2024-04-26T12:06:47.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0608999999999997e-05 2024-04-26T12:06:47.653 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:47.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.154042+0000", 2024-04-26T12:06:47.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000135668 2024-04-26T12:06:47.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.654 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.654 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:47.654 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.161904+0000", 2024-04-26T12:06:47.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0078618290000000007 2024-04-26T12:06:47.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.654 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.654 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:47.654 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.161925+0000", 2024-04-26T12:06:47.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1483000000000001e-05 2024-04-26T12:06:47.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.654 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.655 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:47.655 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.161962+0000", 2024-04-26T12:06:47.655 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7364999999999999e-05 2024-04-26T12:06:47.655 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.655 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:47.655 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.655 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.655 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.655 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5455 4.36 4:6d76582f:::1000000192d.00000000:head [write 0~1520] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:47.655 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.156545+0000", 2024-04-26T12:06:47.655 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.437228723, 2024-04-26T12:06:47.655 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0084645789999999999, 2024-04-26T12:06:47.655 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:47.655 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.656 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:47.656 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:47.656 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:47.656 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5455 2024-04-26T12:06:47.656 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.656 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:47.656 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.656 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:47.656 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156545+0000", 2024-04-26T12:06:47.656 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.656 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.656 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.656 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:47.656 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156545+0000", 2024-04-26T12:06:47.657 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.657 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.657 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.657 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:47.657 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156545+0000", 2024-04-26T12:06:47.657 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.657 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.657 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.657 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:47.657 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156548+0000", 2024-04-26T12:06:47.657 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4790000000000001e-06 2024-04-26T12:06:47.657 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.657 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.657 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:47.657 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156557+0000", 2024-04-26T12:06:47.658 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6309999999999992e-06 2024-04-26T12:06:47.658 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.658 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.658 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.658 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156561+0000", 2024-04-26T12:06:47.658 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5310000000000003e-06 2024-04-26T12:06:47.658 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.658 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.658 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:47.658 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156598+0000", 2024-04-26T12:06:47.658 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6198999999999997e-05 2024-04-26T12:06:47.658 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.658 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.658 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:47.659 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156689+0000", 2024-04-26T12:06:47.659 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1566999999999999e-05 2024-04-26T12:06:47.659 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.659 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:47.659 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.164915+0000", 2024-04-26T12:06:47.659 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0082259599999999992 2024-04-26T12:06:47.659 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.659 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:47.659 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.164953+0000", 2024-04-26T12:06:47.659 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7970999999999999e-05 2024-04-26T12:06:47.659 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.660 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:47.660 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.165010+0000", 2024-04-26T12:06:47.660 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6807e-05 2024-04-26T12:06:47.660 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.660 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:47.660 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.660 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.660 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.660 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5525 4.1e 4:796ca7cc:::10000001978.00000000:head [write 0~953] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:47.660 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.226451+0000", 2024-04-26T12:06:47.660 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.367322937, 2024-04-26T12:06:47.660 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0085371560000000006, 2024-04-26T12:06:47.660 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:47.660 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.660 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:47.661 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:47.661 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:47.661 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5525 2024-04-26T12:06:47.661 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.661 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:47.661 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.661 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:47.661 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226451+0000", 2024-04-26T12:06:47.661 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.661 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.661 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.661 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:47.661 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226451+0000", 2024-04-26T12:06:47.661 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.662 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.662 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.662 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:47.662 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226451+0000", 2024-04-26T12:06:47.662 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.662 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.662 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.662 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:47.663 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226454+0000", 2024-04-26T12:06:47.663 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8940000000000002e-06 2024-04-26T12:06:47.663 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.663 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.663 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:47.663 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226461+0000", 2024-04-26T12:06:47.663 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6960000000000005e-06 2024-04-26T12:06:47.663 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.663 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.663 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.663 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226465+0000", 2024-04-26T12:06:47.663 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5820000000000002e-06 2024-04-26T12:06:47.663 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.663 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.663 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:47.664 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226492+0000", 2024-04-26T12:06:47.664 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7305e-05 2024-04-26T12:06:47.664 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.664 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.664 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:47.664 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226575+0000", 2024-04-26T12:06:47.664 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2688000000000005e-05 2024-04-26T12:06:47.664 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.664 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.664 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:47.664 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226657+0000", 2024-04-26T12:06:47.664 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2298000000000004e-05 2024-04-26T12:06:47.664 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.664 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.665 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.665 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.231017+0000", 2024-04-26T12:06:47.665 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043600330000000001 2024-04-26T12:06:47.665 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.665 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.665 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:47.665 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.234892+0000", 2024-04-26T12:06:47.665 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003874345 2024-04-26T12:06:47.665 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.665 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.665 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:47.665 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.234953+0000", 2024-04-26T12:06:47.665 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1148000000000005e-05 2024-04-26T12:06:47.665 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.665 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.666 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:47.666 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.234988+0000", 2024-04-26T12:06:47.666 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5627999999999998e-05 2024-04-26T12:06:47.666 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.666 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:47.666 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.666 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.666 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.666 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5526 4.4 4:20a3d30a:::10000001979.00000000:head [write 0~1030] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:47.666 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.227384+0000", 2024-04-26T12:06:47.666 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.3663903500000001, 2024-04-26T12:06:47.666 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076519550000000002, 2024-04-26T12:06:47.666 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:47.666 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.667 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:47.667 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:47.667 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:47.667 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5526 2024-04-26T12:06:47.667 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.667 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:47.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.667 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:47.667 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227384+0000", 2024-04-26T12:06:47.667 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.667 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.667 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:47.667 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227384+0000", 2024-04-26T12:06:47.667 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.668 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.668 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.668 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:47.668 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227383+0000", 2024-04-26T12:06:47.668 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:47.668 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.668 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.668 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:47.668 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227388+0000", 2024-04-26T12:06:47.668 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7350000000000004e-06 2024-04-26T12:06:47.668 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.668 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.668 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:47.668 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227398+0000", 2024-04-26T12:06:47.668 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0533000000000001e-05 2024-04-26T12:06:47.669 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.669 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.669 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.669 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227403+0000", 2024-04-26T12:06:47.669 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0919999999999997e-06 2024-04-26T12:06:47.669 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.669 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.669 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:47.669 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227433+0000", 2024-04-26T12:06:47.669 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9705000000000001e-05 2024-04-26T12:06:47.669 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.669 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.669 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:47.669 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227509+0000", 2024-04-26T12:06:47.669 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5862e-05 2024-04-26T12:06:47.670 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.670 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.670 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:47.670 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.234944+0000", 2024-04-26T12:06:47.670 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0074348929999999997 2024-04-26T12:06:47.670 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.670 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.670 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:47.670 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.234982+0000", 2024-04-26T12:06:47.670 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8488000000000001e-05 2024-04-26T12:06:47.670 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.670 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.670 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:47.670 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235036+0000", 2024-04-26T12:06:47.671 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3395e-05 2024-04-26T12:06:47.671 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.671 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:47.671 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.671 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.671 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.671 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4564.0:5533 4.3a e50/16 4:5d782e82:::10000001982.00000000:head v 50'87, mlcod=50'85)", 2024-04-26T12:06:47.671 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.235056+0000", 2024-04-26T12:06:47.671 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.3587180130000001, 2024-04-26T12:06:47.671 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0084653469999999998, 2024-04-26T12:06:47.671 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:47.671 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.671 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:47.671 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.671 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:47.672 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235056+0000", 2024-04-26T12:06:47.672 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.672 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.672 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.672 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:47.672 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235056+0000", 2024-04-26T12:06:47.672 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.672 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.672 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.672 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:47.672 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235056+0000", 2024-04-26T12:06:47.672 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.672 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.672 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.672 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:47.673 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235063+0000", 2024-04-26T12:06:47.673 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.374e-06 2024-04-26T12:06:47.673 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.673 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.673 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:47.673 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235072+0000", 2024-04-26T12:06:47.673 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6719999999999993e-06 2024-04-26T12:06:47.673 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.673 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.673 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.673 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235076+0000", 2024-04-26T12:06:47.673 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1919999999999998e-06 2024-04-26T12:06:47.673 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.673 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:47.674 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235104+0000", 2024-04-26T12:06:47.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8509000000000001e-05 2024-04-26T12:06:47.674 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.674 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:47.674 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235116+0000", 2024-04-26T12:06:47.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1970999999999999e-05 2024-04-26T12:06:47.674 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.674 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:47.674 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.243491+0000", 2024-04-26T12:06:47.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0083750930000000001 2024-04-26T12:06:47.674 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.675 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.675 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:47.675 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.243521+0000", 2024-04-26T12:06:47.675 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9992e-05 2024-04-26T12:06:47.675 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.675 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:47.675 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.675 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.675 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.675 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4564.0:5534 4.18 e50/16 4:1887e072:::10000001983.00000000:head v 50'103, mlcod=50'101)", 2024-04-26T12:06:47.675 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.236092+0000", 2024-04-26T12:06:47.675 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.357682549, 2024-04-26T12:06:47.675 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0074497030000000002, 2024-04-26T12:06:47.675 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:47.676 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.676 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:47.676 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.676 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:47.676 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.236092+0000", 2024-04-26T12:06:47.676 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.676 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.676 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.676 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:47.676 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.236092+0000", 2024-04-26T12:06:47.676 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.676 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.676 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.676 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:47.677 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.236091+0000", 2024-04-26T12:06:47.677 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.677 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.677 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.677 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:47.677 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.236097+0000", 2024-04-26T12:06:47.677 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9900000000000002e-06 2024-04-26T12:06:47.677 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.677 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.677 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:47.677 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.236109+0000", 2024-04-26T12:06:47.677 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1834999999999999e-05 2024-04-26T12:06:47.677 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.677 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.677 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.678 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.236117+0000", 2024-04-26T12:06:47.678 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1259999999999998e-06 2024-04-26T12:06:47.678 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.678 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.678 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:47.678 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.236146+0000", 2024-04-26T12:06:47.678 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8736999999999999e-05 2024-04-26T12:06:47.678 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.678 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.678 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:47.678 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.236159+0000", 2024-04-26T12:06:47.678 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3098000000000001e-05 2024-04-26T12:06:47.678 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.679 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.679 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:47.679 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.243519+0000", 2024-04-26T12:06:47.679 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073600590000000004 2024-04-26T12:06:47.679 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.679 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.679 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:47.679 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.243541+0000", 2024-04-26T12:06:47.679 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2476e-05 2024-04-26T12:06:47.679 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.679 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:47.679 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.679 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.679 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.679 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5935 4.7 4:e0d0d212:::10000001b3e.00000000:head [write 0~1172] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:47.680 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.681004+0000", 2024-04-26T12:06:47.680 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.91276986299999996, 2024-04-26T12:06:47.680 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0083956459999999997, 2024-04-26T12:06:47.680 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:47.680 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.680 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:47.680 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:47.680 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:47.680 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5935 2024-04-26T12:06:47.680 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.680 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:47.680 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.680 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:47.680 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.681004+0000", 2024-04-26T12:06:47.680 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.680 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.681 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.681 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:47.681 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.681004+0000", 2024-04-26T12:06:47.681 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.681 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.681 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.681 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:47.681 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.681004+0000", 2024-04-26T12:06:47.681 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.681 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.681 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.681 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:47.681 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.681008+0000", 2024-04-26T12:06:47.681 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.109e-06 2024-04-26T12:06:47.681 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.682 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.682 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:47.682 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.681016+0000", 2024-04-26T12:06:47.682 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0700000000000007e-06 2024-04-26T12:06:47.682 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.682 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.682 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.682 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.681021+0000", 2024-04-26T12:06:47.682 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.814e-06 2024-04-26T12:06:47.682 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.682 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.682 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:47.682 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.681053+0000", 2024-04-26T12:06:47.682 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2121e-05 2024-04-26T12:06:47.683 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.683 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.683 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:47.683 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.681168+0000", 2024-04-26T12:06:47.683 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000115808 2024-04-26T12:06:47.683 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.683 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.683 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:47.683 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.689293+0000", 2024-04-26T12:06:47.683 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081242490000000001 2024-04-26T12:06:47.683 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.683 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.683 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:47.683 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.689333+0000", 2024-04-26T12:06:47.683 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0645999999999997e-05 2024-04-26T12:06:47.684 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.684 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.684 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:47.684 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.689400+0000", 2024-04-26T12:06:47.684 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6495000000000006e-05 2024-04-26T12:06:47.684 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.684 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:47.684 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.684 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.684 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.684 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:68 3.1f 3:f83d65d8:::200.00000004:head [write 0~3067008 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-26T12:06:47.684 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.734364+0000", 2024-04-26T12:06:47.684 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.85941003599999999, 2024-04-26T12:06:47.684 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012301993000000001, 2024-04-26T12:06:47.684 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:47.685 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.685 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:47.685 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.685 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:47.685 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.734364+0000", 2024-04-26T12:06:47.685 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.685 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.685 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.685 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:47.685 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.734364+0000", 2024-04-26T12:06:47.685 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.685 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.685 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.685 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:47.685 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.734363+0000", 2024-04-26T12:06:47.686 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:47.686 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.686 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.686 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:47.686 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.737105+0000", 2024-04-26T12:06:47.686 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002741627 2024-04-26T12:06:47.686 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.686 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.686 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:47.686 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.737117+0000", 2024-04-26T12:06:47.686 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2724999999999999e-05 2024-04-26T12:06:47.686 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.686 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.686 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.686 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.737123+0000", 2024-04-26T12:06:47.687 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.293e-06 2024-04-26T12:06:47.687 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.687 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.687 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:47.687 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.737198+0000", 2024-04-26T12:06:47.687 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4987000000000006e-05 2024-04-26T12:06:47.687 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.687 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.687 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:47.687 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.737247+0000", 2024-04-26T12:06:47.687 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9484000000000003e-05 2024-04-26T12:06:47.687 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.687 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.687 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:47.688 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.737321+0000", 2024-04-26T12:06:47.688 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3338999999999997e-05 2024-04-26T12:06:47.688 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.688 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.688 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:47.688 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.744691+0000", 2024-04-26T12:06:47.688 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073701970000000002 2024-04-26T12:06:47.688 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.688 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.688 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:47.688 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.746609+0000", 2024-04-26T12:06:47.688 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001917801 2024-04-26T12:06:47.688 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.689 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.690 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:47.690 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.746641+0000", 2024-04-26T12:06:47.690 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2255999999999997e-05 2024-04-26T12:06:47.690 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.690 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.690 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:47.690 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.746666+0000", 2024-04-26T12:06:47.690 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5185999999999999e-05 2024-04-26T12:06:47.690 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.690 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:47.690 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.690 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.690 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.690 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:6258 4.10 4:0ab2c138:::10000001cac.00000000:head [write 0~121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:47.691 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:47.069636+0000", 2024-04-26T12:06:47.691 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.52413787000000001, 2024-04-26T12:06:47.691 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0082349710000000007, 2024-04-26T12:06:47.691 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:47.691 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.691 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:47.691 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:47.691 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:47.691 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 6258 2024-04-26T12:06:47.691 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.691 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:47.691 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.691 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:47.691 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.069636+0000", 2024-04-26T12:06:47.692 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.692 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.692 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.692 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:47.692 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.069636+0000", 2024-04-26T12:06:47.692 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.692 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.692 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.692 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:47.692 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.069635+0000", 2024-04-26T12:06:47.692 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:47.692 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.692 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.692 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:47.692 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.069640+0000", 2024-04-26T12:06:47.693 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.386e-06 2024-04-26T12:06:47.693 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.693 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.693 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:47.693 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.069651+0000", 2024-04-26T12:06:47.693 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1054e-05 2024-04-26T12:06:47.693 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.693 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.693 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.693 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.069658+0000", 2024-04-26T12:06:47.693 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4599999999999997e-06 2024-04-26T12:06:47.693 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.693 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.693 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:47.693 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.069694+0000", 2024-04-26T12:06:47.694 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6216e-05 2024-04-26T12:06:47.694 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.694 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.694 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:47.694 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.069824+0000", 2024-04-26T12:06:47.694 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000129317 2024-04-26T12:06:47.694 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.694 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.694 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:47.694 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.077790+0000", 2024-04-26T12:06:47.694 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079659740000000007 2024-04-26T12:06:47.694 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.694 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.694 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:47.694 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.077821+0000", 2024-04-26T12:06:47.695 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0809999999999998e-05 2024-04-26T12:06:47.695 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.695 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.695 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:47.695 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.077871+0000", 2024-04-26T12:06:47.695 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0612999999999998e-05 2024-04-26T12:06:47.695 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.695 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:47.695 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.695 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.695 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.695 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:6404 4.2d 4:b770baea:::10000001d4f.00000000:head [write 0~551] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:47.695 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:47.223346+0000", 2024-04-26T12:06:47.695 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.370428543, 2024-04-26T12:06:47.696 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0075920110000000001, 2024-04-26T12:06:47.696 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:47.696 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.696 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:47.696 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:47.696 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:47.696 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 6404 2024-04-26T12:06:47.696 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.696 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:47.696 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.696 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:47.696 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.223346+0000", 2024-04-26T12:06:47.696 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.696 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.696 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.697 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:47.697 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.223346+0000", 2024-04-26T12:06:47.697 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.697 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.697 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.697 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:47.697 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.223345+0000", 2024-04-26T12:06:47.697 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.697 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.697 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.697 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:47.697 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.223349+0000", 2024-04-26T12:06:47.697 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4889999999999997e-06 2024-04-26T12:06:47.697 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.697 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.698 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:47.698 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.223358+0000", 2024-04-26T12:06:47.698 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2989999999999997e-06 2024-04-26T12:06:47.698 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.698 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.698 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.698 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.223364+0000", 2024-04-26T12:06:47.698 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5060000000000001e-06 2024-04-26T12:06:47.698 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.698 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.698 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:47.698 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.223409+0000", 2024-04-26T12:06:47.698 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5079e-05 2024-04-26T12:06:47.698 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.698 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.699 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:47.699 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.223501+0000", 2024-04-26T12:06:47.699 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1726999999999998e-05 2024-04-26T12:06:47.699 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.699 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.699 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:47.699 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.230846+0000", 2024-04-26T12:06:47.699 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073452400000000003 2024-04-26T12:06:47.699 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.699 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.699 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:47.699 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.230879+0000", 2024-04-26T12:06:47.699 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2771000000000002e-05 2024-04-26T12:06:47.699 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.700 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.700 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:47.700 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.230938+0000", 2024-04-26T12:06:47.700 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8526000000000002e-05 2024-04-26T12:06:47.700 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.700 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:47.700 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.700 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.700 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.700 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:6513 4.10 4:0a4b3ca1:::10000001dc5.00000000:head [write 0~1700] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:47.700 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:47.344875+0000", 2024-04-26T12:06:47.700 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.24889866799999999, 2024-04-26T12:06:47.700 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0078704150000000004, 2024-04-26T12:06:47.700 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:47.700 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:47.701 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:47.701 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:47.701 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:47.701 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 6513 2024-04-26T12:06:47.701 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.701 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:47.701 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.701 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:47.701 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.344875+0000", 2024-04-26T12:06:47.701 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.701 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.701 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.701 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:47.701 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.344875+0000", 2024-04-26T12:06:47.702 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:47.702 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.702 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.702 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:47.702 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.344875+0000", 2024-04-26T12:06:47.702 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:47.702 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.702 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.702 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:47.702 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.344879+0000", 2024-04-26T12:06:47.702 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3789999999999999e-06 2024-04-26T12:06:47.702 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.702 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.702 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:47.703 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.344888+0000", 2024-04-26T12:06:47.703 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4640000000000006e-06 2024-04-26T12:06:47.703 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.703 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.703 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:47.703 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.344894+0000", 2024-04-26T12:06:47.703 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2129999999999996e-06 2024-04-26T12:06:47.703 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.703 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.703 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:47.703 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.344934+0000", 2024-04-26T12:06:47.703 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0389000000000002e-05 2024-04-26T12:06:47.703 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.703 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.703 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:47.704 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.345066+0000", 2024-04-26T12:06:47.704 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013148700000000001 2024-04-26T12:06:47.704 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.704 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.704 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:47.704 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.352617+0000", 2024-04-26T12:06:47.704 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0075517199999999996 2024-04-26T12:06:47.704 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.704 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.704 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:47.704 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.352670+0000", 2024-04-26T12:06:47.704 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2256999999999998e-05 2024-04-26T12:06:47.704 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:47.704 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:47.704 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:47.705 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.352746+0000", 2024-04-26T12:06:47.705 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6190000000000001e-05 2024-04-26T12:06:47.705 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.705 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:47.705 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.705 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:47.705 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:47.705 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:47.706 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:47.705+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:47.707 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:47.810 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:06:47.811 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:47.809+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:47.820 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:47.820 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:47.820 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:06:47.820 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:47.831 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:47.911 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:47.910+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:47.937 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:47.937 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:47.937 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:47.937 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:47.937 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:47.946 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:47.960 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:47.960 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:47.960 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:06:47.982 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:47.982 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:47.985 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:06:47.985 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:06:48.014 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:48.010+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:48.057 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:48.057 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:48.066 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:48.112 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:48.111+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:48.175 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:48.175 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:48.184 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:48.228 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:48.227+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:48.289 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:48.290 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:48.299 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:48.315 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:48.314+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:48.416 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:48.415+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:48.447 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:48.448 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:48.456 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:48.517 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:48.516+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:48.565 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:48.565 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:48.575 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:48.620 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:48.618+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:48.689 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:48.689 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:48.699 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:48.740 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:48.739+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:48.821 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:48.820+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:48.851 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:48.851 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:48.861 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:48.922 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:48.921+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:48.977 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:48.977 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:48.987 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:49.023 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:49.022+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:49.098 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:49.098 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:49.109 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:49.154 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:49.153+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:49.219 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:49.219 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:49.226 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:49.225+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:49.227 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:49.327 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:49.326+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:49.342 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:49.342 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:49.352 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:49.428 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:49.427+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:49.504 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:49.504 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:49.514 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:49.520 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:06:49.530 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:49.528+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:49.626 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:49.626 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:49.630 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:49.629+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:49.636 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:49.731 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:49.730+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:49.744 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:49.744 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:49.754 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:49.832 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:49.831+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:49.861 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:49.862 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:49.871 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:49.933 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:49.931+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:49.980 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:49.980 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:49.986 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:06:49.990 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:50.034 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:50.033+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:50.097 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:50.097 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:50.107 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:50.131 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:50.132 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:50.132 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:06:50.138 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:50.134+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:50.152 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:50.152 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:50.155 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:06:50.155 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:06:50.237 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:50.236+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:50.254 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:50.254 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:50.254 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:50.254 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:50.254 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:50.267 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:50.351 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:50.350+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:50.416 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:50.417 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:50.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:50.417 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:50.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.417 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:50.417 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:50.417 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 116.559606059, 2024-04-26T12:06:50.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013885153000000001, 2024-04-26T12:06:50.417 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:50.417 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.417 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:50.417 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:50.417 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:50.418 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 161 2024-04-26T12:06:50.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.418 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:50.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:50.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:50.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:50.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:50.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:50.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854769+0000", 2024-04-26T12:06:50.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:50.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:50.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854862+0000", 2024-04-26T12:06:50.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2788999999999995e-05 2024-04-26T12:06:50.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:50.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854868+0000", 2024-04-26T12:06:50.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:06:50.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854871+0000", 2024-04-26T12:06:50.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9349999999999999e-06 2024-04-26T12:06:50.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:50.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860625+0000", 2024-04-26T12:06:50.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057538789999999999 2024-04-26T12:06:50.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:50.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860694+0000", 2024-04-26T12:06:50.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8672999999999998e-05 2024-04-26T12:06:50.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:50.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.860806+0000", 2024-04-26T12:06:50.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112803 2024-04-26T12:06:50.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:50.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.864162+0000", 2024-04-26T12:06:50.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033553139999999999 2024-04-26T12:06:50.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:50.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868611+0000", 2024-04-26T12:06:50.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044494540000000003 2024-04-26T12:06:50.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:50.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868636+0000", 2024-04-26T12:06:50.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4624e-05 2024-04-26T12:06:50.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:50.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868655+0000", 2024-04-26T12:06:50.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8774e-05 2024-04-26T12:06:50.423 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.423 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:50.423 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.423 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.424 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:50.424 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:50.424 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 116.559500163, 2024-04-26T12:06:50.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:50.424 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:50.424 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.424 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:50.424 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:50.424 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:50.424 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:50.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.424 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:50.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:50.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:50.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:50.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:50.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:50.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:50.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:50.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.426 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:50.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:50.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:50.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.426 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:50.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:50.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:50.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.427 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.427 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.427 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:50.427 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:50.427 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.427 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.427 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:50.427 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:50.427 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:50.427 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.427 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.427 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:50.427 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:50.427 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:50.427 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:50.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:50.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:50.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:50.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:50.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:50.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:50.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:50.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:50.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:50.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:50.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:50.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:50.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:50.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:50.429 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.429 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:50.429 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.430 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.430 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.430 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:50.430 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:50.430 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 116.55948518300001, 2024-04-26T12:06:50.430 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:50.430 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:50.430 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.430 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:50.430 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:50.430 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:50.430 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:50.430 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.430 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:50.431 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.431 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:50.431 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:50.431 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.431 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.431 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.431 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:50.431 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:50.431 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.431 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.431 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.431 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:50.431 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:50.431 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:50.432 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.432 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.432 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:50.432 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:50.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:50.432 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.432 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.432 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:50.432 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:50.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:50.432 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.433 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.433 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.433 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:50.433 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:50.433 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.433 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.433 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:50.434 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:50.434 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:50.434 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.434 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.434 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:50.434 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:50.434 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:50.435 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.435 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.435 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:50.435 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:50.435 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:50.435 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.435 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.435 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:50.435 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:50.435 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:50.435 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.435 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.435 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:50.435 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:50.435 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:50.436 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.436 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.436 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:50.436 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:50.436 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:50.436 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.436 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.436 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:50.436 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:50.436 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:50.436 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.436 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:50.436 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.436 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.437 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.437 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:50.437 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:50.437 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 116.559441308, 2024-04-26T12:06:50.437 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:50.437 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:50.437 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.437 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:50.437 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:50.437 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:50.437 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:50.437 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.437 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:50.437 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.437 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:50.438 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:50.438 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.438 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.438 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.438 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:50.438 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:50.438 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.438 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.438 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.438 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:50.438 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:50.438 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:50.438 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.438 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.438 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:50.439 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:50.439 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:50.439 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.439 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.439 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:50.439 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:50.439 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:50.439 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.439 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.439 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.439 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:50.439 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:50.439 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.439 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.439 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:50.440 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:50.440 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:50.440 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.440 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.440 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:50.440 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:50.440 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:50.440 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.440 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.440 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:50.440 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:50.440 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:50.440 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.440 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.441 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:50.441 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:50.441 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:50.441 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.441 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.441 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:50.441 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:50.441 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:50.441 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.441 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.441 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:50.441 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:50.441 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:50.441 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.441 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.442 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:50.442 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:50.442 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:50.442 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.442 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:50.442 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.442 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.442 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.442 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:50.442 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:50.442 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 116.55935564399999, 2024-04-26T12:06:50.442 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:50.442 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:50.442 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.442 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:50.443 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:50.443 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:50.443 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:50.443 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.443 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:50.443 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.443 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:50.443 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:50.443 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.443 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.443 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.443 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:50.443 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:50.443 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.444 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.444 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.444 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:50.444 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:50.444 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:50.444 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.444 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.444 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:50.444 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:50.444 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:50.444 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.444 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.444 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:50.444 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:50.444 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:50.445 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.445 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.445 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.445 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:50.445 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:50.445 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.445 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.445 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:50.445 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:50.445 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:50.445 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.445 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.445 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:50.445 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:50.445 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:50.445 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.446 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.446 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:50.446 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:50.446 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:50.446 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.446 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.446 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:50.446 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:50.446 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:50.446 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.446 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.446 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:50.446 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:50.447 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:50.447 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.447 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.447 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:50.447 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:50.447 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:50.447 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.447 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.447 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:50.447 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:50.447 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:50.447 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.447 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:50.447 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.447 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.448 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.448 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:50.448 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:50.448 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 106.633451358, 2024-04-26T12:06:50.448 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:50.448 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:50.448 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.448 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:50.448 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.448 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:50.448 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:50.448 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.448 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.448 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.448 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:50.449 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:50.449 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.449 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.449 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.449 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:50.449 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:50.449 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:50.449 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.449 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.449 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:50.449 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:50.449 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:50.449 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.449 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.449 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:50.450 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:50.450 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:50.450 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.450 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.450 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.450 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:50.450 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:50.450 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.450 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.450 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:50.450 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:50.450 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:50.450 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.450 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.450 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:50.451 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:50.451 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:50.451 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.451 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.451 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:50.451 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:50.451 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:50.451 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.451 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.451 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:50.451 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:50.451 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:50.451 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.451 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.451 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:50.452 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:50.452 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:50.452 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.452 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.452 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:50.452 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:50.452 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:50.452 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.452 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.452 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:50.452 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:50.452 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:50.452 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.452 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:50.453 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.453 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.453 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.453 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:50.453 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:50.453 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 106.633415263, 2024-04-26T12:06:50.453 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:50.453 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:50.453 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.453 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:50.453 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.453 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:50.453 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:50.453 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.453 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.454 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.454 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:50.454 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:50.454 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.454 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.454 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.454 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:50.454 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:50.454 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:50.454 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.454 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.454 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:50.454 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:50.454 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:50.455 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.455 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.455 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:50.455 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:50.455 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:50.455 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.455 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.455 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.455 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:50.455 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:50.455 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.455 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.455 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:50.455 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:50.455 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:50.456 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.456 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.456 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:50.456 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:50.456 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:50.456 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.456 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.456 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:50.456 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:50.456 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:50.456 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.456 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.456 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:50.457 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:50.457 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:50.457 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.457 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.457 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:50.457 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:50.457 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:50.457 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.457 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.457 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:50.457 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:50.457 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:50.457 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.458 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.458 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:50.458 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:50.458 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:50.458 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.458 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:50.458 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.458 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.458 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.458 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:50.458 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:50.458 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 106.633377579, 2024-04-26T12:06:50.458 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:50.458 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:50.459 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.459 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:50.459 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.459 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:50.459 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:50.459 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.459 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.459 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.459 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:50.459 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:50.459 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.459 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.459 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.459 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:50.459 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:50.460 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:50.460 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.460 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.460 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:50.460 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:50.460 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:50.460 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.460 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.460 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:50.460 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:50.460 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:50.460 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.460 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.460 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.460 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:50.461 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:50.461 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.461 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.461 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:50.461 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:50.461 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:50.461 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.461 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.461 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:50.461 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:50.461 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:50.461 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.461 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.461 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:50.461 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:50.462 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:50.462 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.462 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.462 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:50.462 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:50.462 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:50.462 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.462 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.462 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:50.462 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:50.462 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:50.462 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.462 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.462 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:50.463 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:50.463 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:50.463 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.463 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.463 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:50.463 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:50.463 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:50.463 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.463 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:50.463 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.463 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.463 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.463 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:50.463 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:50.463 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 106.63335623899999, 2024-04-26T12:06:50.464 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:50.464 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:50.464 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.464 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:50.464 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.464 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:50.464 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:50.464 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.464 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.464 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.464 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:50.464 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:50.464 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.464 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.464 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.465 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:50.465 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:50.465 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:50.465 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.465 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.465 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:50.465 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:50.465 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:50.465 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.465 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.465 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:50.465 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:50.465 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:50.465 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.465 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.466 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.466 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:50.466 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:50.466 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.466 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.466 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:50.466 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:50.466 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:50.466 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.466 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.466 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:50.466 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:50.466 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:50.466 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.466 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.467 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:50.467 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:50.467 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:50.467 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.467 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.467 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:50.467 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:50.467 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:50.467 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.467 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.467 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:50.467 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:50.467 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:50.468 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.468 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.468 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:50.469 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:50.469 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:50.469 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.470 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.470 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:50.470 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:50.470 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:50.470 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.470 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:50.470 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.470 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.470 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.470 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:50.470 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:50.470 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 106.63333397300001, 2024-04-26T12:06:50.470 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:50.470 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:50.470 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.471 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:50.471 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.471 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:50.471 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:50.471 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.471 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.471 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.471 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:50.471 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:50.471 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.471 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.471 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.471 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:50.471 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:50.471 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:50.472 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.472 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.472 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:50.472 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:50.472 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:50.472 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.472 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.472 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:50.472 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:50.472 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:50.472 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.472 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.472 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.472 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:50.473 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:50.473 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.473 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.473 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:50.473 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:50.473 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:50.473 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.473 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.473 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:50.473 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:50.473 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:50.473 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.473 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.473 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:50.474 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:50.474 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:50.474 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.474 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.474 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:50.474 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:50.474 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:50.474 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.474 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.474 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:50.474 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:50.474 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:50.474 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.474 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.474 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:50.475 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:50.475 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:50.475 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.475 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.475 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:50.475 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:50.475 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:50.475 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.475 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:50.475 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.475 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.475 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.475 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:50.475 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:50.475 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 106.633312351, 2024-04-26T12:06:50.476 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:50.476 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:50.476 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.476 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:50.476 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.476 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:50.476 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:50.476 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.476 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.476 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.476 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:50.476 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:50.476 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.476 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.476 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.477 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:50.477 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:50.477 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:50.477 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.477 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.477 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:50.477 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:50.477 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:50.477 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.477 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.477 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:50.477 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:50.477 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:50.477 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.477 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.478 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.478 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:50.478 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:50.478 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.478 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.478 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:50.478 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:50.478 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:50.478 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.478 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.478 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:50.478 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:50.478 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:50.478 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.479 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.479 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:50.479 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:50.479 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:50.479 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.479 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.479 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:50.479 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:50.479 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:50.479 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.479 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.479 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:50.479 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:50.479 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:50.479 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.480 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.480 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:50.480 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:50.480 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:50.480 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.480 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.480 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:50.480 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:50.480 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:50.480 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.480 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:50.480 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.480 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.480 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.480 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:50.480 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:50.481 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 106.633285785, 2024-04-26T12:06:50.481 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:50.481 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:50.481 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.481 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:50.481 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.481 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:50.481 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:50.481 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.481 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.481 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.481 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:50.481 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:50.481 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.481 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.482 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.482 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:50.482 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:50.482 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:50.482 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.482 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.482 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:50.482 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:50.482 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:50.482 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.482 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.482 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:50.482 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:50.482 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:50.482 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.483 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.483 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.483 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:50.483 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:50.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.483 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.483 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:50.483 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:50.483 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:50.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.483 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.483 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:50.483 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:50.483 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:50.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.484 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.484 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:50.484 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:50.484 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:50.484 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.484 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.484 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:50.484 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:50.484 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:50.484 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.484 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.484 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:50.484 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:50.484 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:50.484 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.485 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.485 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:50.485 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:50.485 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:50.485 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.485 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.485 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:50.485 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:50.485 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:50.485 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.485 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:50.485 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.485 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.485 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.485 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:50.486 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:50.486 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 106.63324727299999, 2024-04-26T12:06:50.486 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:50.486 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:50.486 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.486 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:50.486 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.486 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:50.486 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:50.486 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.486 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.486 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.486 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:50.486 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:50.487 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.487 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.487 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.487 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:50.487 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:50.487 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:50.487 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.487 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.487 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:50.487 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:50.487 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:50.487 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.487 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.487 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:50.487 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:50.488 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:50.488 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.488 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.488 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.488 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:50.488 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:50.488 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.488 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.488 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:50.488 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:50.488 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:50.488 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.488 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.488 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:50.488 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:50.489 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:50.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.489 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.489 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:50.489 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:50.489 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:50.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.489 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.489 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:50.489 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:50.489 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:50.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.489 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.489 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:50.489 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:50.490 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:50.490 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.490 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.490 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:50.490 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:50.490 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:50.490 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.490 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.490 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:50.490 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:50.490 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:50.490 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.490 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:50.490 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.491 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.491 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.491 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:50.491 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:50.491 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 106.63321910000001, 2024-04-26T12:06:50.491 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:50.491 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:50.491 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.491 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:50.491 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.491 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:50.491 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:50.491 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.491 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.491 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.492 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:50.492 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:50.492 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.492 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.492 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.492 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:50.492 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:50.492 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:50.492 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.492 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.492 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:50.492 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:50.492 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:50.492 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.492 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.493 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:50.493 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:50.493 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:50.493 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.493 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.493 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.493 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:50.493 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:50.493 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.493 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.493 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:50.493 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:50.493 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:50.493 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.493 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.494 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:50.494 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:50.494 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:50.494 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.494 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.494 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:50.494 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:50.494 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:50.494 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.494 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.494 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:50.494 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:50.494 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:50.494 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.494 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.495 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:50.495 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:50.495 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:50.495 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.495 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.495 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:50.495 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:50.495 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:50.495 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.495 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.495 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:50.495 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:50.495 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:50.495 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.495 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:50.496 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.496 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.496 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.496 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:50.496 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:50.496 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 106.633184536, 2024-04-26T12:06:50.496 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:50.496 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:50.496 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.496 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:50.496 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.496 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:50.496 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:50.496 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.496 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.497 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.497 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:50.497 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:50.497 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.497 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.497 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.497 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:50.497 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:50.497 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:50.497 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.497 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.497 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:50.497 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:50.497 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:50.497 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.498 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.498 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:50.498 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:50.498 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:50.498 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.498 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.498 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.498 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:50.498 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:50.498 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.498 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.498 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:50.498 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:50.498 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:50.498 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.499 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.499 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:50.499 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:50.499 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:50.499 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.499 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.499 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:50.499 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:50.499 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:50.499 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.499 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.499 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:50.499 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:50.499 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:50.500 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.500 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.500 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:50.500 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:50.500 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:50.500 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.500 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.500 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:50.500 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:50.500 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:50.500 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.500 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.500 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:50.500 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:50.500 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:50.501 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.501 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:50.501 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.501 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.501 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.501 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:50.501 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:50.501 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 106.632309756, 2024-04-26T12:06:50.501 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:50.501 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:50.501 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.501 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:50.501 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.501 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:50.501 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:50.502 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.502 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.502 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.502 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:50.502 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:50.502 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.502 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.502 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.502 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:50.502 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:50.502 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:50.502 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.502 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.502 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:50.502 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:50.503 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:50.503 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.503 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.503 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:50.503 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:50.503 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:50.503 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.503 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.503 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.503 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:50.503 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:50.503 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.503 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.503 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:50.503 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:50.504 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:50.504 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.504 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.504 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:50.504 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:50.504 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:50.504 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.504 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.504 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:50.504 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:50.504 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:50.504 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.504 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.504 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:50.504 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:50.505 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:50.505 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.505 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.505 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:50.505 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:50.505 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:50.505 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.505 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.505 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:50.505 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:50.505 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:50.505 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.505 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.505 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:50.505 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:50.506 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:50.506 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.506 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:50.506 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.506 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.506 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.506 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:50.506 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:50.506 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 106.632270797, 2024-04-26T12:06:50.506 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:50.506 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:50.506 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.506 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:50.506 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.506 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:50.507 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:50.507 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.507 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.507 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.507 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:50.507 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:50.507 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.507 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.507 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.507 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:50.507 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:50.507 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:50.507 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.507 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.507 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:50.507 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:50.508 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:50.508 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.508 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.508 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:50.508 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:50.508 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:50.508 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.508 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.508 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.508 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:50.508 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:50.508 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.508 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.508 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:50.508 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:50.509 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:50.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.509 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:50.509 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:50.509 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:50.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.509 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:50.509 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:50.509 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:50.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.509 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:50.509 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:50.510 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:50.510 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.510 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.510 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:50.510 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:50.510 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:50.510 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.510 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.510 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:50.510 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:50.510 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:50.510 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.510 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.510 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:50.511 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:50.511 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:50.511 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.511 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:50.511 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.511 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.511 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.511 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:50.511 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:50.511 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 106.632235325, 2024-04-26T12:06:50.511 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:50.511 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:50.511 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.511 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:50.511 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.512 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:50.512 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:50.512 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.512 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.512 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.512 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:50.512 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:50.512 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.512 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.512 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.512 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:50.512 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:50.512 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:50.512 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.512 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.513 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:50.513 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:50.513 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:50.513 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.513 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.513 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:50.513 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:50.513 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:50.513 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.513 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.513 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.513 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:50.513 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:50.513 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.514 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.514 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:50.514 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:50.514 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:50.514 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.514 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.514 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:50.514 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:50.514 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:50.514 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.514 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.514 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:50.514 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:50.514 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:50.514 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.515 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.515 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:50.515 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:50.515 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:50.515 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.515 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.515 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:50.515 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:50.515 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:50.515 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.515 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.515 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:50.515 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:50.515 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:50.516 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.516 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.516 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:50.516 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:50.516 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:50.516 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.516 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:50.516 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.516 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.516 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.516 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:50.516 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:50.516 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 106.632156636, 2024-04-26T12:06:50.516 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:50.516 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:50.516 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.517 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:50.517 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.517 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:50.517 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:50.517 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.517 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.517 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.517 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:50.517 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:50.517 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.517 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.517 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.517 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:50.517 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:50.517 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:50.518 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.518 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.518 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:50.518 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:50.518 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:50.518 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.518 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.518 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:50.518 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:50.518 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:50.518 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.518 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.518 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.518 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:50.518 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:50.519 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.519 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.519 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:50.519 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:50.519 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:50.519 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.519 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.519 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:50.519 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:50.519 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:50.519 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.519 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.519 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:50.519 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:50.519 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:50.520 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.520 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.520 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:50.520 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:50.520 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:50.520 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.520 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.520 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:50.520 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:50.520 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:50.520 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.520 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.520 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:50.520 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:50.520 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:50.521 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.521 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.521 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:50.521 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:50.521 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:50.521 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.521 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:50.521 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.521 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.521 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.521 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:50.521 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:50.521 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 106.632005788, 2024-04-26T12:06:50.521 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:50.521 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:50.522 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:50.522 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:50.522 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.522 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:50.522 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:50.522 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.522 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.522 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.522 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:50.522 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:50.522 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:50.522 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.522 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.522 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:50.522 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:50.523 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:50.523 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.523 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.523 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:50.523 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:50.523 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:50.523 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.523 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.523 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:50.523 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:50.523 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:50.523 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.523 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.523 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.523 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:50.524 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:50.524 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.524 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.524 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:50.524 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:50.524 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:50.524 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.524 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.524 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:50.524 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:50.524 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:50.524 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:50.525 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:50.525 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:50.525 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:50.525 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:50.525 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.525 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:50.525 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.525 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:50.525 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:50.525 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:50.527 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:50.525+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:50.527 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-26T12:06:50.528 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:50.627 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:50.626+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:50.638 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:50.638 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:50.638 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:06:50.639 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:50.648 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:50.728 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:50.727+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:50.796 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:50.796 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:50.796 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:50.796 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:50.797 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:50.806 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:50.830 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:50.829+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:50.925 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:50.925 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:50.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:50.925 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:50.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.925 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:50.925 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:50.925 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 107.14227907999999, 2024-04-26T12:06:50.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:06:50.925 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:06:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:06:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:06:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:06:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:06:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:06:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:06:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:06:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:06:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:06:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:06:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:06:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:06:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:06:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:06:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:06:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:06:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:06:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:06:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:06:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 107.14222375999999, 2024-04-26T12:06:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:06:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:06:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:06:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:06:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:06:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:06:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:06:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:06:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:06:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:06:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:06:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:06:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:06:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:06:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:50.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:06:50.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:06:50.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:50.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:06:50.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:06:50.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:50.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:06:50.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:06:50.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:50.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:06:50.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:06:50.936 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.936 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:50.936 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.936 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:50.936 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 107.142139105, 2024-04-26T12:06:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:06:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:50.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:06:50.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:50.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:50.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:06:50.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:06:50.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:50.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:50.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:06:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:06:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:06:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:06:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:06:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:06:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:06:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:06:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:06:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:06:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:06:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:06:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:06:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:06:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:06:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:06:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:06:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 107.142100593, 2024-04-26T12:06:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:06:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:06:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:06:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:06:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:06:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:06:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:06:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:06:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:06:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:06:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:06:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:06:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:06:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:06:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:06:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:06:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:06:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:06:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:06:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:06:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 107.14204356800001, 2024-04-26T12:06:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:06:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:06:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:06:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:06:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:06:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:06:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:06:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:06:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:06:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:06:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:06:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:06:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:06:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 107.142001278, 2024-04-26T12:06:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:06:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:50.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:50.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:50.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:50.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:50.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:50.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:50.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:06:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:06:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:06:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:06:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:06:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:06:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:06:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:06:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:06:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:06:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:06:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:06:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5128 4.12 4:4af27bd2:::100000017e6.00000000:head [write 0~1985] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:45.851916+0000", 2024-04-26T12:06:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.0705434269999996, 2024-04-26T12:06:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0087160190000000002, 2024-04-26T12:06:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5128 2024-04-26T12:06:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851916+0000", 2024-04-26T12:06:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851916+0000", 2024-04-26T12:06:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:50.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851916+0000", 2024-04-26T12:06:50.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:50.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:50.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851923+0000", 2024-04-26T12:06:50.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9029999999999998e-06 2024-04-26T12:06:50.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:50.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851933+0000", 2024-04-26T12:06:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0665e-05 2024-04-26T12:06:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851938+0000", 2024-04-26T12:06:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1549999999999998e-06 2024-04-26T12:06:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851981+0000", 2024-04-26T12:06:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3028000000000002e-05 2024-04-26T12:06:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852118+0000", 2024-04-26T12:06:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000136556 2024-04-26T12:06:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.860523+0000", 2024-04-26T12:06:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0084049859999999997 2024-04-26T12:06:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.860574+0000", 2024-04-26T12:06:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.096e-05 2024-04-26T12:06:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.860632+0000", 2024-04-26T12:06:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8554000000000002e-05 2024-04-26T12:06:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5129 4.29 4:95ace1b8:::100000017e7.00000000:head [write 0~4336] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:45.852861+0000", 2024-04-26T12:06:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.0695992820000004, 2024-04-26T12:06:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0077481420000000004, 2024-04-26T12:06:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5129 2024-04-26T12:06:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852861+0000", 2024-04-26T12:06:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852861+0000", 2024-04-26T12:06:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852860+0000", 2024-04-26T12:06:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852867+0000", 2024-04-26T12:06:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6889999999999998e-06 2024-04-26T12:06:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852874+0000", 2024-04-26T12:06:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9190000000000002e-06 2024-04-26T12:06:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852877+0000", 2024-04-26T12:06:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770000000000003e-06 2024-04-26T12:06:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852935+0000", 2024-04-26T12:06:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7933999999999998e-05 2024-04-26T12:06:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.853026+0000", 2024-04-26T12:06:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0656999999999996e-05 2024-04-26T12:06:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.853097+0000", 2024-04-26T12:06:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0698000000000006e-05 2024-04-26T12:06:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.857693+0000", 2024-04-26T12:06:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045966979999999998 2024-04-26T12:06:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.860524+0000", 2024-04-26T12:06:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028308930000000001 2024-04-26T12:06:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.860576+0000", 2024-04-26T12:06:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1415000000000002e-05 2024-04-26T12:06:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.860609+0000", 2024-04-26T12:06:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2895999999999998e-05 2024-04-26T12:06:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4564.0:5451 4.3c e50/16 4:3eaa9979:::10000001929.00000000:head v 50'68, mlcod=50'66)", 2024-04-26T12:06:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.153240+0000", 2024-04-26T12:06:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.7692202379999999, 2024-04-26T12:06:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.008611357, 2024-04-26T12:06:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153240+0000", 2024-04-26T12:06:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153240+0000", 2024-04-26T12:06:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153239+0000", 2024-04-26T12:06:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153244+0000", 2024-04-26T12:06:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:06:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153254+0000", 2024-04-26T12:06:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2839999999999995e-06 2024-04-26T12:06:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153260+0000", 2024-04-26T12:06:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:06:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153298+0000", 2024-04-26T12:06:50.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8157000000000001e-05 2024-04-26T12:06:50.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:50.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153312+0000", 2024-04-26T12:06:50.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4158999999999999e-05 2024-04-26T12:06:50.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:50.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.161819+0000", 2024-04-26T12:06:50.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0085061819999999993 2024-04-26T12:06:50.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.161851+0000", 2024-04-26T12:06:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2416999999999998e-05 2024-04-26T12:06:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5452 4.21 4:840c9502:::1000000192a.00000000:head [write 0~4217] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.153843+0000", 2024-04-26T12:06:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.768616389, 2024-04-26T12:06:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081189629999999999, 2024-04-26T12:06:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5452 2024-04-26T12:06:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153843+0000", 2024-04-26T12:06:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153843+0000", 2024-04-26T12:06:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153843+0000", 2024-04-26T12:06:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153851+0000", 2024-04-26T12:06:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9789999999999993e-06 2024-04-26T12:06:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153861+0000", 2024-04-26T12:06:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9699999999999994e-06 2024-04-26T12:06:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153865+0000", 2024-04-26T12:06:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9389999999999996e-06 2024-04-26T12:06:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153906+0000", 2024-04-26T12:06:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0608999999999997e-05 2024-04-26T12:06:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.154042+0000", 2024-04-26T12:06:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000135668 2024-04-26T12:06:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.161904+0000", 2024-04-26T12:06:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0078618290000000007 2024-04-26T12:06:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.161925+0000", 2024-04-26T12:06:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1483000000000001e-05 2024-04-26T12:06:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.161962+0000", 2024-04-26T12:06:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7364999999999999e-05 2024-04-26T12:06:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5455 4.36 4:6d76582f:::1000000192d.00000000:head [write 0~1520] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.156545+0000", 2024-04-26T12:06:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.7659144720000004, 2024-04-26T12:06:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0084645789999999999, 2024-04-26T12:06:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5455 2024-04-26T12:06:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156545+0000", 2024-04-26T12:06:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156545+0000", 2024-04-26T12:06:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156545+0000", 2024-04-26T12:06:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156548+0000", 2024-04-26T12:06:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4790000000000001e-06 2024-04-26T12:06:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156557+0000", 2024-04-26T12:06:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6309999999999992e-06 2024-04-26T12:06:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156561+0000", 2024-04-26T12:06:50.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5310000000000003e-06 2024-04-26T12:06:50.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:50.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156598+0000", 2024-04-26T12:06:50.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6198999999999997e-05 2024-04-26T12:06:50.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:50.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156689+0000", 2024-04-26T12:06:50.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1566999999999999e-05 2024-04-26T12:06:50.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:50.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.164915+0000", 2024-04-26T12:06:50.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0082259599999999992 2024-04-26T12:06:50.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:50.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.164953+0000", 2024-04-26T12:06:50.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7970999999999999e-05 2024-04-26T12:06:50.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:50.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.165010+0000", 2024-04-26T12:06:50.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6807e-05 2024-04-26T12:06:50.979 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.980 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:50.980 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.980 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5525 4.1e 4:796ca7cc:::10000001978.00000000:head [write 0~953] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:50.980 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.226451+0000", 2024-04-26T12:06:50.980 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.6960086859999999, 2024-04-26T12:06:50.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0085371560000000006, 2024-04-26T12:06:50.980 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:50.980 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.980 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:50.980 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:50.980 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:50.980 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5525 2024-04-26T12:06:50.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.981 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:50.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:50.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226451+0000", 2024-04-26T12:06:50.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:50.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226451+0000", 2024-04-26T12:06:50.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:50.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226451+0000", 2024-04-26T12:06:50.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:50.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:50.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226454+0000", 2024-04-26T12:06:50.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8940000000000002e-06 2024-04-26T12:06:50.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:50.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226461+0000", 2024-04-26T12:06:50.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6960000000000005e-06 2024-04-26T12:06:50.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226465+0000", 2024-04-26T12:06:50.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5820000000000002e-06 2024-04-26T12:06:50.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:50.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226492+0000", 2024-04-26T12:06:50.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7305e-05 2024-04-26T12:06:50.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:50.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226575+0000", 2024-04-26T12:06:50.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2688000000000005e-05 2024-04-26T12:06:50.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:50.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226657+0000", 2024-04-26T12:06:50.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2298000000000004e-05 2024-04-26T12:06:50.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:50.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.231017+0000", 2024-04-26T12:06:50.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043600330000000001 2024-04-26T12:06:50.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:50.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.234892+0000", 2024-04-26T12:06:50.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003874345 2024-04-26T12:06:50.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:50.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.234953+0000", 2024-04-26T12:06:50.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1148000000000005e-05 2024-04-26T12:06:50.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:50.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.234988+0000", 2024-04-26T12:06:50.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5627999999999998e-05 2024-04-26T12:06:50.985 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.986 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:50.986 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.986 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5526 4.4 4:20a3d30a:::10000001979.00000000:head [write 0~1030] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:50.986 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.227384+0000", 2024-04-26T12:06:50.986 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.6950760989999996, 2024-04-26T12:06:50.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076519550000000002, 2024-04-26T12:06:50.986 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:50.986 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.986 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:50.986 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:50.986 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:50.987 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5526 2024-04-26T12:06:50.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.987 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:50.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:50.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227384+0000", 2024-04-26T12:06:50.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:50.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227384+0000", 2024-04-26T12:06:50.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:50.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227383+0000", 2024-04-26T12:06:50.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:50.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:50.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227388+0000", 2024-04-26T12:06:50.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7350000000000004e-06 2024-04-26T12:06:50.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:50.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227398+0000", 2024-04-26T12:06:50.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0533000000000001e-05 2024-04-26T12:06:50.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227403+0000", 2024-04-26T12:06:50.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0919999999999997e-06 2024-04-26T12:06:50.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:50.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227433+0000", 2024-04-26T12:06:50.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9705000000000001e-05 2024-04-26T12:06:50.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:50.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227509+0000", 2024-04-26T12:06:50.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5862e-05 2024-04-26T12:06:50.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:50.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.234944+0000", 2024-04-26T12:06:50.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0074348929999999997 2024-04-26T12:06:50.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:50.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.234982+0000", 2024-04-26T12:06:50.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8488000000000001e-05 2024-04-26T12:06:50.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:50.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235036+0000", 2024-04-26T12:06:50.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3395e-05 2024-04-26T12:06:50.990 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.991 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:50.991 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.991 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4564.0:5533 4.3a e50/16 4:5d782e82:::10000001982.00000000:head v 50'87, mlcod=50'85)", 2024-04-26T12:06:50.991 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.235056+0000", 2024-04-26T12:06:50.991 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.6874037619999998, 2024-04-26T12:06:50.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0084653469999999998, 2024-04-26T12:06:50.991 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:50.991 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.991 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:50.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:50.992 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235056+0000", 2024-04-26T12:06:50.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.992 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:50.992 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235056+0000", 2024-04-26T12:06:50.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.992 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:50.992 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235056+0000", 2024-04-26T12:06:50.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:50.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:50.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235063+0000", 2024-04-26T12:06:50.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.374e-06 2024-04-26T12:06:50.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:50.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235072+0000", 2024-04-26T12:06:50.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6719999999999993e-06 2024-04-26T12:06:50.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235076+0000", 2024-04-26T12:06:50.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1919999999999998e-06 2024-04-26T12:06:50.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:50.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235104+0000", 2024-04-26T12:06:50.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8509000000000001e-05 2024-04-26T12:06:50.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:50.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235116+0000", 2024-04-26T12:06:50.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1970999999999999e-05 2024-04-26T12:06:50.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:50.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.243491+0000", 2024-04-26T12:06:50.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0083750930000000001 2024-04-26T12:06:50.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:50.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.243521+0000", 2024-04-26T12:06:50.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9992e-05 2024-04-26T12:06:50.995 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.995 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:50.995 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:50.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.995 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5935 4.7 4:e0d0d212:::10000001b3e.00000000:head [write 0~1172] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:50.995 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.681004+0000", 2024-04-26T12:06:50.995 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.2414556120000002, 2024-04-26T12:06:50.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0083956459999999997, 2024-04-26T12:06:50.996 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:50.996 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:50.996 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:50.996 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:50.996 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:50.996 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5935 2024-04-26T12:06:50.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.996 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:50.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:50.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.681004+0000", 2024-04-26T12:06:50.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.997 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:50.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.681004+0000", 2024-04-26T12:06:50.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:50.997 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.997 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:50.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.681004+0000", 2024-04-26T12:06:50.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:50.997 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.997 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:50.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.681008+0000", 2024-04-26T12:06:50.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.109e-06 2024-04-26T12:06:50.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:50.998 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.681016+0000", 2024-04-26T12:06:50.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0700000000000007e-06 2024-04-26T12:06:50.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:50.998 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.681021+0000", 2024-04-26T12:06:50.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.814e-06 2024-04-26T12:06:50.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:50.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.681053+0000", 2024-04-26T12:06:50.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2121e-05 2024-04-26T12:06:50.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:50.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.681168+0000", 2024-04-26T12:06:50.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000115808 2024-04-26T12:06:50.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:50.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:50.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:50.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.689293+0000", 2024-04-26T12:06:50.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081242490000000001 2024-04-26T12:06:51.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:51.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.689333+0000", 2024-04-26T12:06:51.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0645999999999997e-05 2024-04-26T12:06:51.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:51.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.689400+0000", 2024-04-26T12:06:51.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6495000000000006e-05 2024-04-26T12:06:51.000 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:51.000 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:51.000 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:51.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.001 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:68 3.1f 3:f83d65d8:::200.00000004:head [write 0~3067008 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-26T12:06:51.001 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.734364+0000", 2024-04-26T12:06:51.001 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.1880957849999998, 2024-04-26T12:06:51.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012301993000000001, 2024-04-26T12:06:51.001 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:51.001 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:51.001 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:51.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.001 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:51.001 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.734364+0000", 2024-04-26T12:06:51.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:51.001 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:51.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.734364+0000", 2024-04-26T12:06:51.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:51.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:51.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.734363+0000", 2024-04-26T12:06:51.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:51.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:51.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.737105+0000", 2024-04-26T12:06:51.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002741627 2024-04-26T12:06:51.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:51.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.737117+0000", 2024-04-26T12:06:51.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2724999999999999e-05 2024-04-26T12:06:51.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.737123+0000", 2024-04-26T12:06:51.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.293e-06 2024-04-26T12:06:51.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:51.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.737198+0000", 2024-04-26T12:06:51.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4987000000000006e-05 2024-04-26T12:06:51.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:51.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.737247+0000", 2024-04-26T12:06:51.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9484000000000003e-05 2024-04-26T12:06:51.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:51.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.737321+0000", 2024-04-26T12:06:51.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3338999999999997e-05 2024-04-26T12:06:51.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:51.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.744691+0000", 2024-04-26T12:06:51.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073701970000000002 2024-04-26T12:06:51.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.005 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:51.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.746609+0000", 2024-04-26T12:06:51.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001917801 2024-04-26T12:06:51.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.005 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:51.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.746641+0000", 2024-04-26T12:06:51.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2255999999999997e-05 2024-04-26T12:06:51.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.005 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:51.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.746666+0000", 2024-04-26T12:06:51.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5185999999999999e-05 2024-04-26T12:06:51.006 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:51.006 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:51.006 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:51.006 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.006 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.006 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:6258 4.10 4:0ab2c138:::10000001cac.00000000:head [write 0~121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:51.006 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:47.069636+0000", 2024-04-26T12:06:51.006 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.852823619, 2024-04-26T12:06:51.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0082349710000000007, 2024-04-26T12:06:51.006 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:51.006 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:51.006 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:51.007 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:51.007 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:51.007 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 6258 2024-04-26T12:06:51.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.007 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:51.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:51.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.069636+0000", 2024-04-26T12:06:51.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:51.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:51.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.069636+0000", 2024-04-26T12:06:51.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:51.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.008 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:51.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.069635+0000", 2024-04-26T12:06:51.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:51.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.008 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:51.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.069640+0000", 2024-04-26T12:06:51.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.386e-06 2024-04-26T12:06:51.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:51.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.069651+0000", 2024-04-26T12:06:51.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1054e-05 2024-04-26T12:06:51.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.069658+0000", 2024-04-26T12:06:51.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4599999999999997e-06 2024-04-26T12:06:51.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:51.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.069694+0000", 2024-04-26T12:06:51.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6216e-05 2024-04-26T12:06:51.010 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.010 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:51.010 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.069824+0000", 2024-04-26T12:06:51.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000129317 2024-04-26T12:06:51.010 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.010 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:51.010 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.077790+0000", 2024-04-26T12:06:51.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079659740000000007 2024-04-26T12:06:51.010 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.011 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:51.011 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.077821+0000", 2024-04-26T12:06:51.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0809999999999998e-05 2024-04-26T12:06:51.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.011 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:51.011 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.077871+0000", 2024-04-26T12:06:51.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0612999999999998e-05 2024-04-26T12:06:51.011 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:51.011 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:51.011 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:51.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.011 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:6404 4.2d 4:b770baea:::10000001d4f.00000000:head [write 0~551] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:51.012 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:47.223346+0000", 2024-04-26T12:06:51.012 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.699114292, 2024-04-26T12:06:51.012 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0075920110000000001, 2024-04-26T12:06:51.012 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:51.012 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:51.012 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:51.012 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:51.012 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:51.012 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 6404 2024-04-26T12:06:51.012 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.012 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:51.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.012 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:51.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.223346+0000", 2024-04-26T12:06:51.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:51.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.013 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:51.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.223346+0000", 2024-04-26T12:06:51.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:51.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.013 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:51.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.223345+0000", 2024-04-26T12:06:51.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:51.014 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:51.014 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.223349+0000", 2024-04-26T12:06:51.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4889999999999997e-06 2024-04-26T12:06:51.014 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:51.014 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.223358+0000", 2024-04-26T12:06:51.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2989999999999997e-06 2024-04-26T12:06:51.014 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.223364+0000", 2024-04-26T12:06:51.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5060000000000001e-06 2024-04-26T12:06:51.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:51.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.223409+0000", 2024-04-26T12:06:51.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5079e-05 2024-04-26T12:06:51.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:51.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.223501+0000", 2024-04-26T12:06:51.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1726999999999998e-05 2024-04-26T12:06:51.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:51.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.230846+0000", 2024-04-26T12:06:51.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073452400000000003 2024-04-26T12:06:51.016 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:51.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.230879+0000", 2024-04-26T12:06:51.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2771000000000002e-05 2024-04-26T12:06:51.016 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:51.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.230938+0000", 2024-04-26T12:06:51.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8526000000000002e-05 2024-04-26T12:06:51.017 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:51.017 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:51.017 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:51.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.017 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:6513 4.10 4:0a4b3ca1:::10000001dc5.00000000:head [write 0~1700] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:51.017 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:47.344875+0000", 2024-04-26T12:06:51.017 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.5775844169999997, 2024-04-26T12:06:51.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0078704150000000004, 2024-04-26T12:06:51.017 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:51.017 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:51.017 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:51.017 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:51.018 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:51.018 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 6513 2024-04-26T12:06:51.018 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.018 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:51.018 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.018 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:51.018 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.344875+0000", 2024-04-26T12:06:51.018 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:51.018 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.018 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.018 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:51.018 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.344875+0000", 2024-04-26T12:06:51.018 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:51.018 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.019 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.019 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:51.019 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.344875+0000", 2024-04-26T12:06:51.019 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:51.019 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.019 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.019 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:51.019 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.344879+0000", 2024-04-26T12:06:51.019 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3789999999999999e-06 2024-04-26T12:06:51.019 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.019 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.019 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:51.019 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.344888+0000", 2024-04-26T12:06:51.019 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4640000000000006e-06 2024-04-26T12:06:51.019 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.019 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.020 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.020 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.344894+0000", 2024-04-26T12:06:51.020 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2129999999999996e-06 2024-04-26T12:06:51.020 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.020 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.020 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:51.020 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.344934+0000", 2024-04-26T12:06:51.020 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0389000000000002e-05 2024-04-26T12:06:51.020 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.020 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.020 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:51.020 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.345066+0000", 2024-04-26T12:06:51.020 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013148700000000001 2024-04-26T12:06:51.020 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.021 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.021 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:51.021 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.352617+0000", 2024-04-26T12:06:51.021 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0075517199999999996 2024-04-26T12:06:51.021 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.021 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.021 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:51.021 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.352670+0000", 2024-04-26T12:06:51.021 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2256999999999998e-05 2024-04-26T12:06:51.021 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.021 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.021 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:51.021 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.352746+0000", 2024-04-26T12:06:51.021 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6190000000000001e-05 2024-04-26T12:06:51.021 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:51.021 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:51.022 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:51.022 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.022 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.022 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:9062 4.3e 4:7c3973ca:::10000002987.00000000:head [write 0~5714] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:06:51.022 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:50.509865+0000", 2024-04-26T12:06:51.022 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.41259523300000001, 2024-04-26T12:06:51.022 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0091852819999999995, 2024-04-26T12:06:51.022 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:51.022 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:51.022 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:51.022 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:51.022 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:51.022 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 9062 2024-04-26T12:06:51.022 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.023 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:51.023 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.023 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:51.023 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.509865+0000", 2024-04-26T12:06:51.023 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:51.023 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.023 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.023 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:51.023 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.509865+0000", 2024-04-26T12:06:51.023 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:51.023 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.023 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.023 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:51.023 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.509864+0000", 2024-04-26T12:06:51.024 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:51.024 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.024 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.024 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:51.024 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.509879+0000", 2024-04-26T12:06:51.024 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5277e-05 2024-04-26T12:06:51.024 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.024 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.024 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:51.024 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.509890+0000", 2024-04-26T12:06:51.024 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.076e-05 2024-04-26T12:06:51.024 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.024 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.024 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.025 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.509895+0000", 2024-04-26T12:06:51.025 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7990000000000001e-06 2024-04-26T12:06:51.025 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.025 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.025 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:51.025 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.509935+0000", 2024-04-26T12:06:51.025 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0482999999999998e-05 2024-04-26T12:06:51.025 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.025 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op must wait for map", 2024-04-26T12:06:51.026 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.509938+0000", 2024-04-26T12:06:51.026 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1480000000000002e-06 2024-04-26T12:06:51.026 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:51.026 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.513208+0000", 2024-04-26T12:06:51.026 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0032693980000000002 2024-04-26T12:06:51.026 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:51.026 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.513294+0000", 2024-04-26T12:06:51.026 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6753000000000001e-05 2024-04-26T12:06:51.026 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.027 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.027 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:51.027 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.518953+0000", 2024-04-26T12:06:51.027 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0056583470000000002 2024-04-26T12:06:51.027 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.027 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.027 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:51.027 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.519004+0000", 2024-04-26T12:06:51.027 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1619000000000002e-05 2024-04-26T12:06:51.027 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.027 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.027 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:51.027 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.519050+0000", 2024-04-26T12:06:51.027 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5507999999999999e-05 2024-04-26T12:06:51.028 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:51.028 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:51.028 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:51.028 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:51.028 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:51.028 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:51.029 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:51.028+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:51.030 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:51.130 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:51.129+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:51.138 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:51.138 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:51.138 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.138 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:9571 4.32 4:4e56458f:::10000002bf7.00000000:head [write 0~3908 in=3908b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:06:51.138 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:51.137371+0000", 2024-04-26T12:06:51.138 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00044730399999999999, 2024-04-26T12:06:51.138 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00046988299999999999, 2024-04-26T12:06:51.138 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 9571 2024-04-26T12:06:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.137371+0000", 2024-04-26T12:06:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.137371+0000", 2024-04-26T12:06:51.140 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.140 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.140 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.140 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:51.140 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.137370+0000", 2024-04-26T12:06:51.140 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:51.140 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.140 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.140 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:51.140 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.137377+0000", 2024-04-26T12:06:51.140 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0419999999999997e-06 2024-04-26T12:06:51.140 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.140 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.140 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:51.141 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.137388+0000", 2024-04-26T12:06:51.141 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1242e-05 2024-04-26T12:06:51.141 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.141 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.141 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.141 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.137394+0000", 2024-04-26T12:06:51.141 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2660000000000001e-06 2024-04-26T12:06:51.141 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.141 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.141 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:51.141 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.137433+0000", 2024-04-26T12:06:51.141 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9001000000000001e-05 2024-04-26T12:06:51.141 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.141 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.141 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:51.142 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.137512+0000", 2024-04-26T12:06:51.142 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9268000000000001e-05 2024-04-26T12:06:51.142 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.142 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:51.142 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.142 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.142 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-04-26T12:06:51.142 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 1 2024-04-26T12:06:51.142 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:51.148 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:51.232 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:51.231+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:51.296 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:51.296 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:51.296 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:51.296 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:51.296 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:51.305 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:51.333 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:51.332+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:51.434 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:51.433+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:51.457 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:51.457 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:51.457 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:51.457 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:51.457 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.457 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:51.457 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:51.458 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 117.599932575, 2024-04-26T12:06:51.458 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013888851000000001, 2024-04-26T12:06:51.458 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:51.458 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:51.458 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:51.458 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:51.458 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:51.458 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 162 2024-04-26T12:06:51.458 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.458 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:51.458 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.458 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:51.459 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:51.459 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.459 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.459 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.459 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:51.459 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:51.459 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.459 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.459 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.459 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:51.459 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854875+0000", 2024-04-26T12:06:51.459 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:51.459 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.459 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.460 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:51.460 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854877+0000", 2024-04-26T12:06:51.460 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:06:51.460 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.460 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.460 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:51.460 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854882+0000", 2024-04-26T12:06:51.460 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:06:51.460 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.460 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.460 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.460 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854885+0000", 2024-04-26T12:06:51.460 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7110000000000001e-06 2024-04-26T12:06:51.460 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.460 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.461 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:51.461 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861326+0000", 2024-04-26T12:06:51.461 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064406730000000001 2024-04-26T12:06:51.461 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.461 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.461 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:51.461 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861369+0000", 2024-04-26T12:06:51.461 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3087000000000003e-05 2024-04-26T12:06:51.461 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.461 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.461 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:51.461 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861483+0000", 2024-04-26T12:06:51.461 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113689 2024-04-26T12:06:51.461 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.462 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.462 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:51.462 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866676+0000", 2024-04-26T12:06:51.462 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051930750000000001 2024-04-26T12:06:51.462 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.462 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.462 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:51.462 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868695+0000", 2024-04-26T12:06:51.462 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020187410000000001 2024-04-26T12:06:51.462 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.462 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.462 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:51.463 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868733+0000", 2024-04-26T12:06:51.463 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7948999999999999e-05 2024-04-26T12:06:51.463 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.463 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.463 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:51.463 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868764+0000", 2024-04-26T12:06:51.463 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1554999999999999e-05 2024-04-26T12:06:51.463 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.463 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:51.463 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.463 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.463 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.463 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:51.463 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:51.464 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 117.59991759499999, 2024-04-26T12:06:51.464 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013939029, 2024-04-26T12:06:51.464 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:51.464 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:51.464 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:51.464 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:51.464 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:51.464 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 163 2024-04-26T12:06:51.464 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.464 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:51.464 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.464 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:51.464 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:51.464 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.465 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.465 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.465 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:51.465 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:51.465 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.465 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.465 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.465 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:51.465 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854890+0000", 2024-04-26T12:06:51.465 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:51.465 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.465 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.466 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:51.466 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854893+0000", 2024-04-26T12:06:51.466 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.016e-06 2024-04-26T12:06:51.466 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.466 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.466 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:51.466 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854898+0000", 2024-04-26T12:06:51.466 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:06:51.466 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.466 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.466 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.466 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854900+0000", 2024-04-26T12:06:51.466 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:06:51.466 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.467 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.467 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:51.467 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861750+0000", 2024-04-26T12:06:51.467 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068502509999999999 2024-04-26T12:06:51.467 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.467 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.467 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:51.467 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861828+0000", 2024-04-26T12:06:51.467 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7904999999999994e-05 2024-04-26T12:06:51.467 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.467 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.467 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:51.467 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.861951+0000", 2024-04-26T12:06:51.468 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012319499999999999 2024-04-26T12:06:51.468 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.468 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.468 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:51.468 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866680+0000", 2024-04-26T12:06:51.468 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047282160000000004 2024-04-26T12:06:51.468 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.468 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.468 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:51.468 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868793+0000", 2024-04-26T12:06:51.468 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021129959999999998 2024-04-26T12:06:51.468 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.468 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.468 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:51.469 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868814+0000", 2024-04-26T12:06:51.469 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1033999999999999e-05 2024-04-26T12:06:51.469 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.469 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.469 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:51.469 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868829+0000", 2024-04-26T12:06:51.469 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5662999999999999e-05 2024-04-26T12:06:51.469 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.469 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:51.469 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.469 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.469 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.469 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:51.469 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:51.470 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 117.59987372000001, 2024-04-26T12:06:51.470 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014008042, 2024-04-26T12:06:51.470 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:51.470 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:51.470 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:51.470 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:51.470 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:51.470 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 164 2024-04-26T12:06:51.470 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.470 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:51.470 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.470 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:51.470 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:51.471 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.471 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.471 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.471 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:51.472 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:51.472 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.472 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.472 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.472 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:51.472 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.854934+0000", 2024-04-26T12:06:51.472 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:51.472 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.472 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.472 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:51.472 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855003+0000", 2024-04-26T12:06:51.473 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9547000000000003e-05 2024-04-26T12:06:51.473 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.473 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.473 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:51.473 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855009+0000", 2024-04-26T12:06:51.473 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:06:51.473 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.473 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.473 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.473 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855013+0000", 2024-04-26T12:06:51.473 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:06:51.473 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.473 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.473 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:51.473 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862237+0000", 2024-04-26T12:06:51.474 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072241909999999996 2024-04-26T12:06:51.474 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.474 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.474 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:51.474 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862281+0000", 2024-04-26T12:06:51.474 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3980999999999998e-05 2024-04-26T12:06:51.474 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.474 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.474 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:51.474 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862352+0000", 2024-04-26T12:06:51.474 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:06:51.474 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.474 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.474 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:51.475 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866687+0000", 2024-04-26T12:06:51.475 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043355299999999998 2024-04-26T12:06:51.475 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.475 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.475 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:51.475 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868868+0000", 2024-04-26T12:06:51.475 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021809170000000001 2024-04-26T12:06:51.475 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.475 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.475 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:51.475 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868906+0000", 2024-04-26T12:06:51.475 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7701999999999999e-05 2024-04-26T12:06:51.475 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.476 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.476 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:51.476 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868942+0000", 2024-04-26T12:06:51.476 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6426e-05 2024-04-26T12:06:51.476 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.476 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:51.476 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.476 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.476 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.476 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:06:51.476 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:51.476 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 117.59978805599999, 2024-04-26T12:06:51.476 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013978694, 2024-04-26T12:06:51.476 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:51.476 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:51.477 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:51.477 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4176", 2024-04-26T12:06:51.477 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/3555698539", 2024-04-26T12:06:51.477 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 165 2024-04-26T12:06:51.477 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.477 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:51.477 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.477 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:51.477 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:51.477 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.477 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.477 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.477 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:51.477 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:51.477 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.478 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.478 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.478 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:51.478 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855020+0000", 2024-04-26T12:06:51.478 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:51.478 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.478 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.478 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:51.478 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855023+0000", 2024-04-26T12:06:51.478 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.196e-06 2024-04-26T12:06:51.478 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.478 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.478 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:51.479 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855027+0000", 2024-04-26T12:06:51.479 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:06:51.479 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.479 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.479 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.479 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.855030+0000", 2024-04-26T12:06:51.479 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7180000000000001e-06 2024-04-26T12:06:51.479 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.479 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.479 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:51.479 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862690+0000", 2024-04-26T12:06:51.479 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076606929999999997 2024-04-26T12:06:51.479 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.479 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.479 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:51.480 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862763+0000", 2024-04-26T12:06:51.480 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2449999999999999e-05 2024-04-26T12:06:51.480 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.480 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.480 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:51.480 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.862879+0000", 2024-04-26T12:06:51.480 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115882 2024-04-26T12:06:51.480 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.480 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.480 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:51.480 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.866689+0000", 2024-04-26T12:06:51.480 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038104129999999999 2024-04-26T12:06:51.480 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.480 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.481 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:51.481 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868963+0000", 2024-04-26T12:06:51.481 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022739240000000001 2024-04-26T12:06:51.481 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.481 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.481 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:51.481 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868983+0000", 2024-04-26T12:06:51.481 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0251999999999999e-05 2024-04-26T12:06:51.481 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.481 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.481 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:51.481 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:04:53.868999+0000", 2024-04-26T12:06:51.481 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5150000000000001e-05 2024-04-26T12:06:51.481 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.482 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:51.482 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.482 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.482 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.482 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:51.482 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:51.482 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 107.67388377, 2024-04-26T12:06:51.482 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015777488999999999, 2024-04-26T12:06:51.482 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:51.482 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:51.482 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:51.482 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.482 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:51.482 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:51.483 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.483 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.483 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:51.483 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780924+0000", 2024-04-26T12:06:51.483 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.483 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.483 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:51.483 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:51.483 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:51.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.483 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.483 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:51.483 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780931+0000", 2024-04-26T12:06:51.484 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:06:51.484 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.484 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.484 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:51.484 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780940+0000", 2024-04-26T12:06:51.484 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6460000000000005e-06 2024-04-26T12:06:51.484 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.484 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.484 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.484 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780952+0000", 2024-04-26T12:06:51.484 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:06:51.484 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.484 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.484 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:51.485 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785249+0000", 2024-04-26T12:06:51.485 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042969130000000003 2024-04-26T12:06:51.485 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.485 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.485 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:51.485 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785372+0000", 2024-04-26T12:06:51.485 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012377199999999999 2024-04-26T12:06:51.485 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.485 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.485 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:51.485 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785491+0000", 2024-04-26T12:06:51.485 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011848199999999999 2024-04-26T12:06:51.485 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.486 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.486 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:51.486 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789090+0000", 2024-04-26T12:06:51.486 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035991019999999999 2024-04-26T12:06:51.486 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.486 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.486 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:51.486 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796609+0000", 2024-04-26T12:06:51.486 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075196100000000004 2024-04-26T12:06:51.486 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.487 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.487 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:51.487 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796662+0000", 2024-04-26T12:06:51.487 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2942999999999998e-05 2024-04-26T12:06:51.487 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.487 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.487 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:51.487 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796702+0000", 2024-04-26T12:06:51.487 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9158e-05 2024-04-26T12:06:51.487 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.487 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:51.487 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.487 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.487 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.488 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:51.488 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:51.488 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 107.673847675, 2024-04-26T12:06:51.488 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:51.488 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:51.488 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:51.488 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:51.488 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.488 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:51.488 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:51.488 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.488 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.488 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.488 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:51.488 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:51.489 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.489 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.489 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:51.489 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:51.489 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:51.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.489 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.489 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:51.489 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:51.489 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:51.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.489 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.489 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:51.490 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:51.490 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:51.490 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.490 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.490 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.490 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:51.490 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:51.490 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.490 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.490 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:51.490 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:51.490 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:51.490 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.490 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.491 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:51.491 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:51.491 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:51.491 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.491 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.491 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:51.491 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:51.491 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:51.491 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.491 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.491 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:51.491 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:51.491 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:51.491 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.492 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.492 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:51.494 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:51.494 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:51.494 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.494 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.494 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:51.494 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:51.494 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:51.494 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.494 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.495 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:51.495 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:51.495 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:51.495 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.495 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:51.495 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.495 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.495 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.495 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:51.495 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:51.495 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 107.673809991, 2024-04-26T12:06:51.495 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:51.495 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:51.495 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:51.495 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:51.496 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.496 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:51.496 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:51.496 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.496 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.496 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.496 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:51.496 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:51.496 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.496 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.496 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.496 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:51.496 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:51.496 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:51.496 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.497 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.497 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:51.497 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:51.497 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:51.497 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.497 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.497 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:51.497 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:51.497 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:51.497 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.497 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.497 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.497 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:51.497 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:51.497 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.498 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.498 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:51.498 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:51.498 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:51.498 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.498 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.498 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:51.498 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:51.498 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:51.498 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.498 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.498 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:51.498 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:51.498 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:51.498 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.498 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.499 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:51.499 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:51.499 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:51.499 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.499 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.499 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:51.499 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:51.499 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:51.499 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.499 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.499 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:51.499 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:51.499 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:51.499 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.500 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.500 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:51.500 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:51.500 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:51.500 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.500 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:51.500 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.500 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.500 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.500 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:51.500 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:51.500 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 107.673788651, 2024-04-26T12:06:51.500 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:51.500 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:51.502 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:51.502 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.502 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.502 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:51.502 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:51.502 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:51.502 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.502 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.502 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:51.502 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:51.502 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:51.503 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.503 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.503 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.503 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:51.503 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:51.503 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.503 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.503 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:51.503 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:51.503 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:51.503 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.503 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.503 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:51.503 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:51.504 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:51.504 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.504 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.504 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:51.504 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:51.504 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:51.504 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.504 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.504 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:51.504 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:51.504 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:51.504 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.504 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.504 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:51.504 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:51.505 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:51.505 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.505 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.505 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:51.505 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:51.505 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:51.505 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.505 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.505 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:51.505 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:51.505 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:51.505 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.505 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:51.505 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.506 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.506 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.506 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:51.506 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:51.506 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 107.67376638499999, 2024-04-26T12:06:51.506 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:51.506 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:51.506 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:51.506 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:51.506 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.506 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:51.506 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:51.506 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.507 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.507 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.507 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:51.507 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:51.507 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.507 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.507 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.507 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:51.507 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:51.507 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:51.507 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.508 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.508 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:51.508 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:51.508 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:51.508 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.508 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.508 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:51.508 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:51.508 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:51.508 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.508 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.508 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.508 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:51.509 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:51.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.509 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:51.509 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:51.509 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:51.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.509 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:51.509 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:51.509 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:51.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.509 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:51.509 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:51.510 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:51.510 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.510 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.510 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:51.510 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:51.510 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:51.510 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.510 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.510 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:51.510 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:51.510 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:51.510 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.510 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.510 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:51.511 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:51.511 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:51.511 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.511 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.511 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:51.511 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:51.511 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:51.511 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.511 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:51.511 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.511 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.511 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.511 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:51.511 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:51.512 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 107.673744763, 2024-04-26T12:06:51.512 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:51.512 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:51.512 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:51.512 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:51.512 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.512 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:51.512 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:51.512 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.512 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.512 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.512 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:51.512 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:51.512 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.512 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.513 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.513 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:51.513 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:51.513 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:51.513 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.513 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.513 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:51.513 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:51.513 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:51.513 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.513 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.513 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:51.513 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:51.513 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:51.513 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.514 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.514 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.514 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:51.514 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:51.514 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.514 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.514 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:51.514 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:51.514 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:51.514 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.514 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.514 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:51.514 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:51.514 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:51.515 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.515 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.515 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:51.515 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:51.515 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:51.515 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.515 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.515 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:51.515 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:51.515 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:51.515 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.515 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.515 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:51.515 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:51.515 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:51.516 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.516 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.516 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:51.516 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:51.516 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:51.516 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.516 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.516 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:51.516 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:51.516 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:51.516 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.516 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:51.516 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.516 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.517 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.517 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:51.517 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:51.517 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 107.673718197, 2024-04-26T12:06:51.517 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:51.517 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:51.517 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:51.517 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:51.517 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.517 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:51.517 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:51.517 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.517 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.517 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.518 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:51.518 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:51.518 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.518 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.518 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.518 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:51.518 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:51.518 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:51.518 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.518 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.518 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:51.518 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:51.518 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:51.518 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.519 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.519 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:51.519 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:51.519 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:51.519 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.519 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.519 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.519 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:51.519 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:51.519 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.519 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.519 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:51.519 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:51.519 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:51.520 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.520 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.520 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:51.520 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:51.520 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:51.520 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.520 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.520 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:51.521 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:51.521 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:51.521 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.521 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.521 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:51.521 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:51.521 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:51.521 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.521 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.521 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:51.521 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:51.521 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:51.521 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.522 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.522 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:51.522 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:51.522 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:51.522 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.522 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.522 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:51.522 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:51.522 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:51.522 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.522 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:51.523 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.523 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.523 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.523 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:51.523 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:51.523 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 107.673679685, 2024-04-26T12:06:51.523 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:51.523 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:51.523 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:51.523 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:51.523 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.523 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:51.523 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:51.523 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.523 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.524 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.524 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:51.524 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:51.524 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.524 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.524 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.524 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:51.524 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:51.524 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:51.524 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.524 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.524 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:51.524 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:51.525 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:51.525 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.525 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.525 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:51.525 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:51.525 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:51.525 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.525 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.525 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.525 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:51.525 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:51.525 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.525 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.525 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:51.526 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:51.526 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:51.526 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.526 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.526 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:51.526 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:51.526 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:51.526 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.526 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.526 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:51.526 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:51.526 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:51.526 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.526 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.527 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:51.527 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:51.527 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:51.527 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.527 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.527 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:51.527 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:51.527 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:51.527 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.527 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.527 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:51.527 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:51.527 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:51.527 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.527 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.527 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:51.528 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:51.528 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:51.528 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.528 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:51.528 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.528 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.528 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.528 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:51.528 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:51.528 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 107.67365151200001, 2024-04-26T12:06:51.528 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015666543000000002, 2024-04-26T12:06:51.528 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:51.528 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:51.528 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:51.528 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.528 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:51.529 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:51.529 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.529 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.529 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.529 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:51.529 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:51.529 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.529 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.529 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.529 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:51.529 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781156+0000", 2024-04-26T12:06:51.529 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:51.530 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.530 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.530 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:51.530 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781160+0000", 2024-04-26T12:06:51.530 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:06:51.530 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.530 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.530 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:51.530 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781173+0000", 2024-04-26T12:06:51.530 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3006e-05 2024-04-26T12:06:51.530 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.530 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.530 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.530 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781181+0000", 2024-04-26T12:06:51.531 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-04-26T12:06:51.531 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.531 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.531 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:51.531 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782050+0000", 2024-04-26T12:06:51.531 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086912999999999997 2024-04-26T12:06:51.531 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.531 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.531 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:51.531 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782502+0000", 2024-04-26T12:06:51.531 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00045192600000000001 2024-04-26T12:06:51.531 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.531 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.532 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:51.532 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782824+0000", 2024-04-26T12:06:51.532 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032146300000000002 2024-04-26T12:06:51.532 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.532 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.532 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:51.532 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786922+0000", 2024-04-26T12:06:51.532 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040979179999999999 2024-04-26T12:06:51.532 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.532 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.532 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:51.532 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796653+0000", 2024-04-26T12:06:51.533 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097316469999999995 2024-04-26T12:06:51.533 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.533 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.533 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:51.533 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796775+0000", 2024-04-26T12:06:51.533 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012222900000000001 2024-04-26T12:06:51.533 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.533 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.533 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:51.533 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796823+0000", 2024-04-26T12:06:51.533 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7450000000000001e-05 2024-04-26T12:06:51.533 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.533 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:51.534 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.534 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.534 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.534 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:51.534 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:51.534 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 107.673616948, 2024-04-26T12:06:51.534 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:51.534 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:51.534 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:51.534 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:51.534 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.534 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:51.534 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:51.534 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.535 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.535 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.535 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:51.535 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:51.535 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.535 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.535 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.535 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:51.535 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:51.535 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:51.535 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.535 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.535 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:51.535 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:51.535 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:51.536 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.536 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.536 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:51.536 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:51.536 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:51.536 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.536 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.536 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.536 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:51.536 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:51.536 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.536 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.536 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:51.536 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:51.537 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:51.537 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.537 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.537 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:51.537 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:51.537 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:51.537 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.537 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.537 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:51.537 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:51.537 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:51.537 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.537 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.537 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:51.537 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:51.538 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:51.538 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.538 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.538 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:51.538 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:51.538 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:51.538 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.538 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.538 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:51.538 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:51.538 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:51.538 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.538 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.538 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:51.539 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:51.539 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:51.539 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.539 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:51.539 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.539 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.539 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.539 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:51.539 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:51.539 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 107.672742168, 2024-04-26T12:06:51.539 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015085971, 2024-04-26T12:06:51.539 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:51.539 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:51.540 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:51.540 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.540 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:51.540 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:51.540 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.540 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.540 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.540 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:51.540 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782066+0000", 2024-04-26T12:06:51.540 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.540 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.540 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.540 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:51.540 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782065+0000", 2024-04-26T12:06:51.540 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:51.541 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.541 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.541 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:51.541 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782071+0000", 2024-04-26T12:06:51.541 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:06:51.541 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.541 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.541 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:51.541 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782083+0000", 2024-04-26T12:06:51.541 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.222e-05 2024-04-26T12:06:51.541 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.541 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.541 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.541 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782096+0000", 2024-04-26T12:06:51.541 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3128e-05 2024-04-26T12:06:51.541 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.542 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.542 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:51.542 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784329+0000", 2024-04-26T12:06:51.542 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022323339999999999 2024-04-26T12:06:51.542 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.542 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.542 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:51.542 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784648+0000", 2024-04-26T12:06:51.542 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031940899999999999 2024-04-26T12:06:51.542 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.542 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.542 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:51.542 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.784793+0000", 2024-04-26T12:06:51.543 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000144549 2024-04-26T12:06:51.543 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.543 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.543 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:51.543 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787632+0000", 2024-04-26T12:06:51.543 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028392370000000001 2024-04-26T12:06:51.543 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.543 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.543 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:51.543 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797061+0000", 2024-04-26T12:06:51.543 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094291070000000008 2024-04-26T12:06:51.543 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.543 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.543 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:51.543 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797113+0000", 2024-04-26T12:06:51.544 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1549999999999999e-05 2024-04-26T12:06:51.544 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.544 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.544 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:51.544 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797152+0000", 2024-04-26T12:06:51.544 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9076999999999999e-05 2024-04-26T12:06:51.544 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.544 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:51.544 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.544 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.544 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.544 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:51.544 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:51.544 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 107.67270320900001, 2024-04-26T12:06:51.545 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015135834000000001, 2024-04-26T12:06:51.545 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:51.545 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:51.545 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:51.545 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.545 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:51.545 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:51.545 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.545 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.545 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.545 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:51.545 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782105+0000", 2024-04-26T12:06:51.545 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.545 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.545 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.546 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:51.546 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782104+0000", 2024-04-26T12:06:51.546 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:51.546 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.546 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.546 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:51.546 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782108+0000", 2024-04-26T12:06:51.546 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:06:51.546 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.546 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.546 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:51.546 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782117+0000", 2024-04-26T12:06:51.546 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:06:51.546 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.547 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.547 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.547 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782122+0000", 2024-04-26T12:06:51.547 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:06:51.547 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.547 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.547 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:51.547 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782208+0000", 2024-04-26T12:06:51.547 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6358000000000002e-05 2024-04-26T12:06:51.547 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.547 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.547 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:51.547 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782827+0000", 2024-04-26T12:06:51.547 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061895199999999998 2024-04-26T12:06:51.547 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.548 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.548 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:51.548 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782954+0000", 2024-04-26T12:06:51.548 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012636400000000001 2024-04-26T12:06:51.548 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.548 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.548 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:51.548 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787330+0000", 2024-04-26T12:06:51.548 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004376642 2024-04-26T12:06:51.548 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.548 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.548 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:51.548 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797111+0000", 2024-04-26T12:06:51.548 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0097802480000000001 2024-04-26T12:06:51.548 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.548 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.549 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:51.549 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797175+0000", 2024-04-26T12:06:51.549 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4809999999999998e-05 2024-04-26T12:06:51.549 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.549 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.549 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:51.549 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797240+0000", 2024-04-26T12:06:51.549 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5123999999999995e-05 2024-04-26T12:06:51.549 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.549 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:51.549 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.549 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.549 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.549 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:51.550 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:51.550 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 107.672667737, 2024-04-26T12:06:51.550 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015143681000000001, 2024-04-26T12:06:51.550 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:51.550 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:51.550 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:51.550 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.550 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:51.550 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:51.550 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.550 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.550 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.550 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:51.550 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:51.551 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.551 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.551 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.551 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:51.551 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782140+0000", 2024-04-26T12:06:51.551 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:51.551 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.551 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.551 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:51.551 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782144+0000", 2024-04-26T12:06:51.551 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6770000000000003e-06 2024-04-26T12:06:51.551 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.551 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.551 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:51.551 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782152+0000", 2024-04-26T12:06:51.552 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:06:51.552 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.552 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.552 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.552 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782165+0000", 2024-04-26T12:06:51.552 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3339999999999999e-05 2024-04-26T12:06:51.552 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.552 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.552 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:51.552 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785768+0000", 2024-04-26T12:06:51.552 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003603102 2024-04-26T12:06:51.552 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.552 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.552 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:51.552 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.785962+0000", 2024-04-26T12:06:51.553 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019360100000000001 2024-04-26T12:06:51.553 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.553 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.553 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:51.553 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786182+0000", 2024-04-26T12:06:51.553 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000219965 2024-04-26T12:06:51.553 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.553 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.553 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:51.553 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787999+0000", 2024-04-26T12:06:51.553 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001817733 2024-04-26T12:06:51.553 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.553 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.553 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:51.553 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797202+0000", 2024-04-26T12:06:51.554 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092028049999999997 2024-04-26T12:06:51.554 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.554 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.554 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:51.554 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797250+0000", 2024-04-26T12:06:51.554 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8087999999999998e-05 2024-04-26T12:06:51.554 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.554 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.554 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:51.554 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797284+0000", 2024-04-26T12:06:51.554 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3540000000000001e-05 2024-04-26T12:06:51.554 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.554 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:51.554 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.555 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.555 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.555 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:51.555 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:51.555 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 107.67258904800001, 2024-04-26T12:06:51.555 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015293383000000001, 2024-04-26T12:06:51.555 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:51.555 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:51.555 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:51.555 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.555 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:51.555 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:51.556 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.556 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.556 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.556 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:51.557 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782219+0000", 2024-04-26T12:06:51.557 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.557 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.557 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.557 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:51.557 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782218+0000", 2024-04-26T12:06:51.557 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:51.557 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.557 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.557 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:51.557 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782224+0000", 2024-04-26T12:06:51.558 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:06:51.558 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.558 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.558 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:51.558 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782254+0000", 2024-04-26T12:06:51.558 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0309000000000001e-05 2024-04-26T12:06:51.558 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.558 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.558 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.558 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782279+0000", 2024-04-26T12:06:51.558 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4269000000000001e-05 2024-04-26T12:06:51.558 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.558 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.559 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:51.559 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783048+0000", 2024-04-26T12:06:51.559 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00076915800000000004 2024-04-26T12:06:51.559 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.559 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.559 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:51.559 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783152+0000", 2024-04-26T12:06:51.559 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010461100000000001 2024-04-26T12:06:51.559 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.559 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.559 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:51.559 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783288+0000", 2024-04-26T12:06:51.559 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013598700000000001 2024-04-26T12:06:51.560 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.560 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.560 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:51.560 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787519+0000", 2024-04-26T12:06:51.560 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042309380000000001 2024-04-26T12:06:51.560 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.560 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.560 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:51.560 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797432+0000", 2024-04-26T12:06:51.560 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0099130309999999992 2024-04-26T12:06:51.560 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.560 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.560 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:51.560 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797477+0000", 2024-04-26T12:06:51.560 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4746999999999997e-05 2024-04-26T12:06:51.561 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.561 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.561 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:51.561 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797512+0000", 2024-04-26T12:06:51.561 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5057e-05 2024-04-26T12:06:51.561 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.561 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:51.561 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.561 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.561 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 107.6724382, 2024-04-26T12:06:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015044849000000001, 2024-04-26T12:06:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:51.563 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782370+0000", 2024-04-26T12:06:51.563 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.563 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.563 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.563 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:51.563 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782369+0000", 2024-04-26T12:06:51.563 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:51.563 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.563 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.563 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:51.563 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782376+0000", 2024-04-26T12:06:51.563 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:06:51.563 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.563 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.563 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:51.564 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782455+0000", 2024-04-26T12:06:51.564 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8671999999999995e-05 2024-04-26T12:06:51.564 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.564 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.564 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.564 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.782481+0000", 2024-04-26T12:06:51.564 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5834e-05 2024-04-26T12:06:51.564 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.564 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.564 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:51.564 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786573+0000", 2024-04-26T12:06:51.564 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040921439999999998 2024-04-26T12:06:51.564 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.564 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.565 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:51.565 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:51.565 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105492 2024-04-26T12:06:51.565 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.565 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.565 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:51.565 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797415+0000", 2024-04-26T12:06:51.565 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010736117 2024-04-26T12:06:51.565 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.565 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:51.565 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.565 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.565 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.565 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:9757 4.13 4:ca460221:::10000002cd3.00000000:head [write 0~2872501] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:06:51.565 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:51.390144+0000", 2024-04-26T12:06:51.566 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.064664115999999994, 2024-04-26T12:06:51.566 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017793265999999999, 2024-04-26T12:06:51.566 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:51.566 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:51.566 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:51.566 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:51.566 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:51.566 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 9757 2024-04-26T12:06:51.566 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.566 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:51.566 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.566 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:51.566 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.390144+0000", 2024-04-26T12:06:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.390144+0000", 2024-04-26T12:06:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.390142+0000", 2024-04-26T12:06:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.392971+0000", 2024-04-26T12:06:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028284500000000001 2024-04-26T12:06:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.392984+0000", 2024-04-26T12:06:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3526000000000001e-05 2024-04-26T12:06:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.392992+0000", 2024-04-26T12:06:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4919999999999996e-06 2024-04-26T12:06:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.393034+0000", 2024-04-26T12:06:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2679999999999998e-05 2024-04-26T12:06:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.393149+0000", 2024-04-26T12:06:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000114795 2024-04-26T12:06:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.407790+0000", 2024-04-26T12:06:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014641381 2024-04-26T12:06:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.570 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:51.570 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.407845+0000", 2024-04-26T12:06:51.570 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.5062999999999998e-05 2024-04-26T12:06:51.570 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:51.570 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:51.570 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:51.571 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.407937+0000", 2024-04-26T12:06:51.571 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1522999999999998e-05 2024-04-26T12:06:51.571 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.571 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:51.571 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.571 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:51.571 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:51.571 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:51.573 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:51.571+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:51.573 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:51.673 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:51.672+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:51.681 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:51.736 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:51.737 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.737 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4564.0:10022 4.1b e52/16 4:d882c42e:::10000002def.00000000:head v 52'140, mlcod=52'138)", 2024-04-26T12:06:51.737 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:51.679926+0000", 2024-04-26T12:06:51.737 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0014615159999999999, 2024-04-26T12:06:51.737 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014762480000000001, 2024-04-26T12:06:51.737 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:51.737 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:51.737 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:51.737 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.738 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:51.738 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:51.679926+0000", 2024-04-26T12:06:51.738 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:51.738 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.738 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.738 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:51.738 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:51.679926+0000", 2024-04-26T12:06:51.738 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:51.738 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.738 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.738 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:51.738 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:51.679925+0000", 2024-04-26T12:06:51.738 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:51.738 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.739 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.739 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:51.739 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:51.679933+0000", 2024-04-26T12:06:51.739 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9570000000000002e-06 2024-04-26T12:06:51.739 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.739 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.739 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:51.739 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:51.679944+0000", 2024-04-26T12:06:51.739 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1165999999999999e-05 2024-04-26T12:06:51.739 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.739 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.739 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.739 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:51.679952+0000", 2024-04-26T12:06:51.739 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6429999999999995e-06 2024-04-26T12:06:51.739 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.740 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.740 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:51.740 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:51.679982+0000", 2024-04-26T12:06:51.740 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0196e-05 2024-04-26T12:06:51.740 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.740 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.740 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:51.740 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:51.679999+0000", 2024-04-26T12:06:51.740 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7212000000000001e-05 2024-04-26T12:06:51.740 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:51.740 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:51.740 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:51.740 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.740 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.740 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:10023 4.2f 4:f6c1d010:::10000002df0.00000000:head [write 0~1319 in=1319b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:06:51.741 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:51.680442+0000", 2024-04-26T12:06:51.741 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00094506400000000002, 2024-04-26T12:06:51.741 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001009121, 2024-04-26T12:06:51.741 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:51.741 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:51.741 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:51.741 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:51.741 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:51.741 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 10023 2024-04-26T12:06:51.741 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.741 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:51.741 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.741 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:51.741 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:51.680442+0000", 2024-04-26T12:06:51.741 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:51.742 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.742 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.742 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:51.742 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:51.680442+0000", 2024-04-26T12:06:51.742 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:51.742 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.742 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.742 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:51.742 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:51.680441+0000", 2024-04-26T12:06:51.742 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:51.742 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.742 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.742 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:51.742 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:51.680446+0000", 2024-04-26T12:06:51.742 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7489999999999998e-06 2024-04-26T12:06:51.743 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.743 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.743 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:51.743 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:51.680457+0000", 2024-04-26T12:06:51.743 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0648999999999999e-05 2024-04-26T12:06:51.743 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.743 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.743 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:51.743 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:51.680462+0000", 2024-04-26T12:06:51.743 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0610000000000003e-06 2024-04-26T12:06:51.743 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.743 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.743 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:51.743 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:51.680501+0000", 2024-04-26T12:06:51.743 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9150999999999998e-05 2024-04-26T12:06:51.744 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:51.744 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:51.744 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:51.744 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:51.680625+0000", 2024-04-26T12:06:51.744 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000123876 2024-04-26T12:06:51.744 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:51.744 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:51.744 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:51.744 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:51.744 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-04-26T12:06:51.744 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 2 2024-04-26T12:06:51.744 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:51.745 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:51.786 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:51.785+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:51.876 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:51.875+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:51.895 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:51.895 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:51.895 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:51.895 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:51.895 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:51.906 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:51.977 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:51.976+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:52.021 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:52.022 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:52.022 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:52.022 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:52.022 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.022 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:52.022 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:52.022 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 108.23892548000001, 2024-04-26T12:06:52.022 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079167419999999992, 2024-04-26T12:06:52.022 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:52.022 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:52.022 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:52.022 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.023 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:52.023 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:52.023 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.023 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.023 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.023 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:52.023 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780181+0000", 2024-04-26T12:06:52.023 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.023 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.023 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.023 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:52.023 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780179+0000", 2024-04-26T12:06:52.023 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:52.023 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.024 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.024 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:52.024 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780191+0000", 2024-04-26T12:06:52.024 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1789e-05 2024-04-26T12:06:52.024 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.024 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.024 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:52.024 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780210+0000", 2024-04-26T12:06:52.024 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8811999999999999e-05 2024-04-26T12:06:52.024 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.024 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.024 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:52.025 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780223+0000", 2024-04-26T12:06:52.025 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3811e-05 2024-04-26T12:06:52.025 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.025 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.025 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:52.025 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780711+0000", 2024-04-26T12:06:52.025 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048800100000000001 2024-04-26T12:06:52.025 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.025 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.025 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:52.025 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780923+0000", 2024-04-26T12:06:52.025 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021103800000000001 2024-04-26T12:06:52.025 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:52.026 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781108+0000", 2024-04-26T12:06:52.026 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000185119 2024-04-26T12:06:52.026 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:52.026 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782699+0000", 2024-04-26T12:06:52.026 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015915180000000001 2024-04-26T12:06:52.027 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.027 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.027 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:52.027 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.787959+0000", 2024-04-26T12:06:52.027 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052602710000000004 2024-04-26T12:06:52.027 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.027 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.027 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:52.027 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788056+0000", 2024-04-26T12:06:52.027 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6503999999999996e-05 2024-04-26T12:06:52.027 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.028 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.028 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:52.028 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788097+0000", 2024-04-26T12:06:52.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1542999999999998e-05 2024-04-26T12:06:52.028 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.028 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:52.028 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.028 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.028 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.029 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:52.029 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:52.029 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 108.23887016, 2024-04-26T12:06:52.029 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080303470000000002, 2024-04-26T12:06:52.029 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:52.029 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:52.029 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:52.029 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.029 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:52.029 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:52.029 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.029 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.029 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.030 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:52.030 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780236+0000", 2024-04-26T12:06:52.030 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.030 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.030 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.030 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:52.030 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780235+0000", 2024-04-26T12:06:52.030 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:52.030 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.030 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.030 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:52.030 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780243+0000", 2024-04-26T12:06:52.031 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:06:52.031 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.031 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.031 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:52.031 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780264+0000", 2024-04-26T12:06:52.031 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1860000000000001e-05 2024-04-26T12:06:52.031 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.031 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.031 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:52.031 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780279+0000", 2024-04-26T12:06:52.031 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4207e-05 2024-04-26T12:06:52.031 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.031 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.031 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:52.032 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781381+0000", 2024-04-26T12:06:52.032 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011026569999999999 2024-04-26T12:06:52.032 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.032 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.032 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:52.032 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781450+0000", 2024-04-26T12:06:52.032 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8899000000000006e-05 2024-04-26T12:06:52.032 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.032 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.032 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:52.032 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781566+0000", 2024-04-26T12:06:52.032 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011631799999999999 2024-04-26T12:06:52.032 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.032 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.033 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:52.033 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782705+0000", 2024-04-26T12:06:52.033 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011382639999999999 2024-04-26T12:06:52.033 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.033 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.033 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:52.033 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788171+0000", 2024-04-26T12:06:52.033 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054659169999999998 2024-04-26T12:06:52.033 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.033 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.033 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:52.033 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788228+0000", 2024-04-26T12:06:52.033 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7494999999999998e-05 2024-04-26T12:06:52.033 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.033 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.034 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:52.034 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788266+0000", 2024-04-26T12:06:52.034 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:06:52.034 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.034 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:52.034 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.034 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.034 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.035 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:52.035 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:52.035 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 108.238785505, 2024-04-26T12:06:52.035 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081754229999999994, 2024-04-26T12:06:52.035 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:52.035 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:52.035 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:52.036 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.036 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:52.036 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:52.036 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.036 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.036 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.036 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:52.036 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780321+0000", 2024-04-26T12:06:52.037 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.037 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.037 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.037 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:52.037 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780320+0000", 2024-04-26T12:06:52.037 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:52.037 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.038 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.038 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:52.038 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780334+0000", 2024-04-26T12:06:52.038 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4198e-05 2024-04-26T12:06:52.038 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.038 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.039 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:52.039 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780342+0000", 2024-04-26T12:06:52.039 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:06:52.039 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.039 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.039 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:52.039 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780350+0000", 2024-04-26T12:06:52.040 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.977e-06 2024-04-26T12:06:52.040 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.040 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.040 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:52.040 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781857+0000", 2024-04-26T12:06:52.040 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015069269999999999 2024-04-26T12:06:52.040 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.041 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.041 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:52.041 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781939+0000", 2024-04-26T12:06:52.041 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1487000000000001e-05 2024-04-26T12:06:52.041 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.041 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.041 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:52.041 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782085+0000", 2024-04-26T12:06:52.042 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014599599999999999 2024-04-26T12:06:52.042 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.042 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.042 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:52.042 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788389+0000", 2024-04-26T12:06:52.042 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063043539999999999 2024-04-26T12:06:52.042 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.043 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.043 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:52.043 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788402+0000", 2024-04-26T12:06:52.043 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2947e-05 2024-04-26T12:06:52.043 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.043 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.043 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:52.044 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788457+0000", 2024-04-26T12:06:52.044 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4659e-05 2024-04-26T12:06:52.044 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.044 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.044 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:52.044 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788496+0000", 2024-04-26T12:06:52.045 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9449999999999997e-05 2024-04-26T12:06:52.045 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.045 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:52.045 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.045 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.045 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.045 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:52.045 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:52.045 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 108.23874699300001, 2024-04-26T12:06:52.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094179989999999998, 2024-04-26T12:06:52.046 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:52.046 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:52.046 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:52.046 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.046 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:52.046 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:52.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.046 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.046 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.046 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:52.046 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:52.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.047 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.047 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.047 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:52.047 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780359+0000", 2024-04-26T12:06:52.047 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:52.047 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.047 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.047 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:52.047 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780363+0000", 2024-04-26T12:06:52.047 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:06:52.047 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.047 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.047 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:52.047 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780370+0000", 2024-04-26T12:06:52.047 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:06:52.048 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.048 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.048 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:52.048 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780384+0000", 2024-04-26T12:06:52.048 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3834e-05 2024-04-26T12:06:52.048 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.048 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.048 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:52.048 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781848+0000", 2024-04-26T12:06:52.048 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014648560000000001 2024-04-26T12:06:52.048 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.048 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.048 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:52.048 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781957+0000", 2024-04-26T12:06:52.048 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010900699999999999 2024-04-26T12:06:52.049 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.049 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.049 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:52.049 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782093+0000", 2024-04-26T12:06:52.049 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013537 2024-04-26T12:06:52.049 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.049 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.049 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:52.049 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788329+0000", 2024-04-26T12:06:52.049 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062360879999999999 2024-04-26T12:06:52.049 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.049 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.049 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:52.049 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789650+0000", 2024-04-26T12:06:52.050 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013209890000000001 2024-04-26T12:06:52.050 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.050 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.050 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:52.050 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789712+0000", 2024-04-26T12:06:52.050 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-04-26T12:06:52.050 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.050 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.050 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:52.050 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789777+0000", 2024-04-26T12:06:52.051 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5698999999999996e-05 2024-04-26T12:06:52.051 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.051 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:52.051 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.051 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.051 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.052 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:52.052 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:52.052 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 108.238689968, 2024-04-26T12:06:52.052 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076991489999999997, 2024-04-26T12:06:52.052 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:52.052 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:52.052 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:52.052 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.053 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:52.053 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:52.053 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.053 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.053 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.053 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:52.053 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:52.053 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.053 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.054 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.054 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:52.054 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780416+0000", 2024-04-26T12:06:52.054 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:52.054 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.054 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.054 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:52.054 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780419+0000", 2024-04-26T12:06:52.055 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:06:52.055 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.055 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.055 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:52.055 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780427+0000", 2024-04-26T12:06:52.055 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5229999999999995e-06 2024-04-26T12:06:52.056 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.056 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.056 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:52.056 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780437+0000", 2024-04-26T12:06:52.056 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:06:52.056 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.057 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.057 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:52.057 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781398+0000", 2024-04-26T12:06:52.057 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00096131099999999996 2024-04-26T12:06:52.057 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.057 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.057 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:52.058 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.781531+0000", 2024-04-26T12:06:52.058 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013269200000000001 2024-04-26T12:06:52.058 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.058 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.058 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:52.058 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.788115+0000", 2024-04-26T12:06:52.058 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065842929999999997 2024-04-26T12:06:52.058 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.059 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:52.059 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.059 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.059 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.059 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:52.059 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:52.059 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 108.23864767800001, 2024-04-26T12:06:52.059 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094156629999999995, 2024-04-26T12:06:52.060 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:52.060 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:52.060 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:52.060 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.060 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:52.060 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:52.061 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.061 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.061 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.061 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:52.061 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780459+0000", 2024-04-26T12:06:52.061 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.061 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.062 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.062 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:52.062 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780458+0000", 2024-04-26T12:06:52.062 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:52.062 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.062 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.063 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:52.063 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780462+0000", 2024-04-26T12:06:52.063 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4869999999999998e-06 2024-04-26T12:06:52.063 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.063 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.063 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:52.063 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780471+0000", 2024-04-26T12:06:52.063 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:06:52.063 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.064 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.064 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:52.064 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.780478+0000", 2024-04-26T12:06:52.064 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8059999999999997e-06 2024-04-26T12:06:52.064 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.064 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.064 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:52.064 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782422+0000", 2024-04-26T12:06:52.064 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019441 2024-04-26T12:06:52.064 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.064 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.064 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:52.064 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.782535+0000", 2024-04-26T12:06:52.064 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112281 2024-04-26T12:06:52.065 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.065 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.065 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:52.065 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:05:03.789874+0000", 2024-04-26T12:06:52.065 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073396540000000001 2024-04-26T12:06:52.065 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.065 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:52.065 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.065 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.065 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.065 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5128 4.12 4:4af27bd2:::100000017e6.00000000:head [write 0~1985] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:52.065 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:45.851916+0000", 2024-04-26T12:06:52.065 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 6.1671898269999996, 2024-04-26T12:06:52.065 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0087160190000000002, 2024-04-26T12:06:52.066 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:52.066 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:52.066 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:52.066 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:52.066 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:52.066 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5128 2024-04-26T12:06:52.066 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.066 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:52.066 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.066 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:52.066 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851916+0000", 2024-04-26T12:06:52.066 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.067 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.067 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.067 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:52.067 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851916+0000", 2024-04-26T12:06:52.067 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.067 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.067 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.067 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:52.067 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851916+0000", 2024-04-26T12:06:52.067 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:52.067 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.067 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.067 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:52.067 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851923+0000", 2024-04-26T12:06:52.068 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9029999999999998e-06 2024-04-26T12:06:52.068 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.068 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.068 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:52.068 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851933+0000", 2024-04-26T12:06:52.068 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0665e-05 2024-04-26T12:06:52.068 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.068 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.068 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:52.068 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851938+0000", 2024-04-26T12:06:52.068 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1549999999999998e-06 2024-04-26T12:06:52.068 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.068 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.068 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:52.068 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.851981+0000", 2024-04-26T12:06:52.068 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3028000000000002e-05 2024-04-26T12:06:52.069 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.069 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.069 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:52.069 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852118+0000", 2024-04-26T12:06:52.069 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000136556 2024-04-26T12:06:52.069 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.069 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.069 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:52.069 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.860523+0000", 2024-04-26T12:06:52.069 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0084049859999999997 2024-04-26T12:06:52.069 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.069 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.069 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:52.069 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.860574+0000", 2024-04-26T12:06:52.070 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.096e-05 2024-04-26T12:06:52.070 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.070 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.070 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:52.070 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.860632+0000", 2024-04-26T12:06:52.070 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8554000000000002e-05 2024-04-26T12:06:52.070 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.070 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:52.070 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.070 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.070 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.070 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5129 4.29 4:95ace1b8:::100000017e7.00000000:head [write 0~4336] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:52.070 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:45.852861+0000", 2024-04-26T12:06:52.071 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 6.1662456819999996, 2024-04-26T12:06:52.071 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0077481420000000004, 2024-04-26T12:06:52.071 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:52.071 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:52.071 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:52.071 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:52.071 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:52.071 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5129 2024-04-26T12:06:52.071 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.072 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:52.072 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.072 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:52.072 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852861+0000", 2024-04-26T12:06:52.072 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.072 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.073 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.073 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:52.073 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852861+0000", 2024-04-26T12:06:52.073 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.073 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.073 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.074 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:52.074 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852860+0000", 2024-04-26T12:06:52.074 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:52.074 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.074 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.074 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:52.075 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852867+0000", 2024-04-26T12:06:52.075 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6889999999999998e-06 2024-04-26T12:06:52.075 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.075 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.075 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:52.075 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852874+0000", 2024-04-26T12:06:52.076 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9190000000000002e-06 2024-04-26T12:06:52.076 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.076 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.076 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:52.076 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852877+0000", 2024-04-26T12:06:52.076 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8770000000000003e-06 2024-04-26T12:06:52.077 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.077 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.077 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:52.077 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.852935+0000", 2024-04-26T12:06:52.077 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7933999999999998e-05 2024-04-26T12:06:52.077 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.077 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.078 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:52.078 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.853026+0000", 2024-04-26T12:06:52.078 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0656999999999996e-05 2024-04-26T12:06:52.078 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.078 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.078 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:52.078 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.853097+0000", 2024-04-26T12:06:52.078 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0698000000000006e-05 2024-04-26T12:06:52.079 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.079 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.079 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:52.079 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.857693+0000", 2024-04-26T12:06:52.079 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045966979999999998 2024-04-26T12:06:52.079 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.079 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.080 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:52.080 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.860524+0000", 2024-04-26T12:06:52.080 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028308930000000001 2024-04-26T12:06:52.080 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.080 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.080 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:52.081 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.860576+0000", 2024-04-26T12:06:52.081 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1415000000000002e-05 2024-04-26T12:06:52.081 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.081 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.081 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:52.081 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:45.860609+0000", 2024-04-26T12:06:52.081 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2895999999999998e-05 2024-04-26T12:06:52.081 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.081 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:52.081 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.082 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.082 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.082 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4564.0:5451 4.3c e50/16 4:3eaa9979:::10000001929.00000000:head v 50'68, mlcod=50'66)", 2024-04-26T12:06:52.082 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.153240+0000", 2024-04-26T12:06:52.082 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.865866638, 2024-04-26T12:06:52.082 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.008611357, 2024-04-26T12:06:52.082 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:52.082 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:52.082 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:52.082 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.082 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:52.082 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153240+0000", 2024-04-26T12:06:52.083 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.083 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.083 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.083 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:52.083 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153240+0000", 2024-04-26T12:06:52.083 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.083 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.083 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.083 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:52.083 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153239+0000", 2024-04-26T12:06:52.083 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:52.083 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.083 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.084 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:52.084 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153244+0000", 2024-04-26T12:06:52.084 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:06:52.084 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.084 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.084 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:52.084 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153254+0000", 2024-04-26T12:06:52.084 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2839999999999995e-06 2024-04-26T12:06:52.084 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.084 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.084 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:52.084 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153260+0000", 2024-04-26T12:06:52.085 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:06:52.085 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.085 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.085 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:52.085 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153298+0000", 2024-04-26T12:06:52.085 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8157000000000001e-05 2024-04-26T12:06:52.085 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.085 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.085 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:52.085 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153312+0000", 2024-04-26T12:06:52.085 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4158999999999999e-05 2024-04-26T12:06:52.085 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.085 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.085 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:52.086 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.161819+0000", 2024-04-26T12:06:52.086 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0085061819999999993 2024-04-26T12:06:52.086 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.086 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.086 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:52.086 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.161851+0000", 2024-04-26T12:06:52.086 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2416999999999998e-05 2024-04-26T12:06:52.086 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.086 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:52.086 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.086 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.086 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.086 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5452 4.21 4:840c9502:::1000000192a.00000000:head [write 0~4217] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:52.087 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.153843+0000", 2024-04-26T12:06:52.087 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.865262789, 2024-04-26T12:06:52.087 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081189629999999999, 2024-04-26T12:06:52.087 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:52.087 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:52.087 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:52.087 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:52.087 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:52.087 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5452 2024-04-26T12:06:52.087 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.087 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:52.087 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.087 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:52.087 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153843+0000", 2024-04-26T12:06:52.088 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.088 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.088 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.088 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:52.088 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153843+0000", 2024-04-26T12:06:52.088 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.088 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.088 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.088 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:52.088 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153843+0000", 2024-04-26T12:06:52.088 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:52.088 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.088 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.088 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:52.089 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153851+0000", 2024-04-26T12:06:52.089 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9789999999999993e-06 2024-04-26T12:06:52.089 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.089 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.089 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:52.089 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153861+0000", 2024-04-26T12:06:52.089 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9699999999999994e-06 2024-04-26T12:06:52.089 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.089 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.089 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:52.089 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153865+0000", 2024-04-26T12:06:52.089 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9389999999999996e-06 2024-04-26T12:06:52.089 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.089 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.090 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:52.090 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.153906+0000", 2024-04-26T12:06:52.090 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0608999999999997e-05 2024-04-26T12:06:52.090 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.090 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.090 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:52.090 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.154042+0000", 2024-04-26T12:06:52.090 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000135668 2024-04-26T12:06:52.090 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.090 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.090 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:52.090 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.161904+0000", 2024-04-26T12:06:52.090 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0078618290000000007 2024-04-26T12:06:52.090 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.091 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.091 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:52.091 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.161925+0000", 2024-04-26T12:06:52.091 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1483000000000001e-05 2024-04-26T12:06:52.091 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.091 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.091 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:52.091 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.161962+0000", 2024-04-26T12:06:52.091 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7364999999999999e-05 2024-04-26T12:06:52.091 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.091 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:52.091 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.091 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.091 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.092 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5455 4.36 4:6d76582f:::1000000192d.00000000:head [write 0~1520] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:52.092 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.156545+0000", 2024-04-26T12:06:52.092 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.8625608719999995, 2024-04-26T12:06:52.092 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0084645789999999999, 2024-04-26T12:06:52.092 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:52.092 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:52.092 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:52.092 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:52.092 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:52.092 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5455 2024-04-26T12:06:52.092 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.092 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:52.092 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.092 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:52.092 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156545+0000", 2024-04-26T12:06:52.093 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.093 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.093 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.093 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:52.093 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156545+0000", 2024-04-26T12:06:52.093 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.093 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.093 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.093 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:52.093 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156545+0000", 2024-04-26T12:06:52.093 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:52.093 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.093 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.093 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:52.094 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156548+0000", 2024-04-26T12:06:52.094 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4790000000000001e-06 2024-04-26T12:06:52.094 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.094 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.094 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:52.094 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156557+0000", 2024-04-26T12:06:52.094 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6309999999999992e-06 2024-04-26T12:06:52.094 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.094 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.094 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:52.094 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156561+0000", 2024-04-26T12:06:52.094 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5310000000000003e-06 2024-04-26T12:06:52.094 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.094 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.095 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:52.095 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156598+0000", 2024-04-26T12:06:52.095 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6198999999999997e-05 2024-04-26T12:06:52.095 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.095 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.095 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:52.095 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.156689+0000", 2024-04-26T12:06:52.095 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1566999999999999e-05 2024-04-26T12:06:52.095 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.095 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.095 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:52.095 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.164915+0000", 2024-04-26T12:06:52.095 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0082259599999999992 2024-04-26T12:06:52.095 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.096 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.096 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:52.096 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.164953+0000", 2024-04-26T12:06:52.096 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7970999999999999e-05 2024-04-26T12:06:52.096 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.096 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.096 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:52.096 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.165010+0000", 2024-04-26T12:06:52.096 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6807e-05 2024-04-26T12:06:52.096 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.096 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:52.096 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.096 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.097 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.097 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5525 4.1e 4:796ca7cc:::10000001978.00000000:head [write 0~953] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:52.097 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.226451+0000", 2024-04-26T12:06:52.097 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.7926550859999999, 2024-04-26T12:06:52.097 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0085371560000000006, 2024-04-26T12:06:52.097 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:52.097 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:52.097 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:52.097 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:52.097 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:52.097 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5525 2024-04-26T12:06:52.097 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.097 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:52.097 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.097 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:52.098 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226451+0000", 2024-04-26T12:06:52.098 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.098 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.098 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.098 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:52.098 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226451+0000", 2024-04-26T12:06:52.098 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.098 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.098 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.098 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:52.098 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226451+0000", 2024-04-26T12:06:52.098 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:52.098 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.099 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.099 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:52.099 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226454+0000", 2024-04-26T12:06:52.099 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8940000000000002e-06 2024-04-26T12:06:52.099 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.099 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.099 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:52.099 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226461+0000", 2024-04-26T12:06:52.099 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6960000000000005e-06 2024-04-26T12:06:52.099 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.100 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.100 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:52.100 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226465+0000", 2024-04-26T12:06:52.100 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5820000000000002e-06 2024-04-26T12:06:52.100 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.100 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.100 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:52.100 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226492+0000", 2024-04-26T12:06:52.100 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7305e-05 2024-04-26T12:06:52.100 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.100 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.100 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:52.100 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226575+0000", 2024-04-26T12:06:52.100 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2688000000000005e-05 2024-04-26T12:06:52.101 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.101 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.101 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:52.101 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.226657+0000", 2024-04-26T12:06:52.101 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2298000000000004e-05 2024-04-26T12:06:52.101 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.101 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.101 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:52.101 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.231017+0000", 2024-04-26T12:06:52.101 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043600330000000001 2024-04-26T12:06:52.101 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.101 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.101 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:52.101 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.234892+0000", 2024-04-26T12:06:52.102 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003874345 2024-04-26T12:06:52.102 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.102 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.102 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:52.102 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.234953+0000", 2024-04-26T12:06:52.102 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1148000000000005e-05 2024-04-26T12:06:52.102 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.102 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.102 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:52.102 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.234988+0000", 2024-04-26T12:06:52.102 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5627999999999998e-05 2024-04-26T12:06:52.102 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.102 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:52.102 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.103 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.103 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.103 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5526 4.4 4:20a3d30a:::10000001979.00000000:head [write 0~1030] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:52.103 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.227384+0000", 2024-04-26T12:06:52.103 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.7917224990000005, 2024-04-26T12:06:52.103 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076519550000000002, 2024-04-26T12:06:52.103 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:52.103 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:52.103 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:52.103 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:52.103 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:52.103 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5526 2024-04-26T12:06:52.103 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.103 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:52.104 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.104 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:52.104 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227384+0000", 2024-04-26T12:06:52.104 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.104 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.104 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.104 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:52.104 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227384+0000", 2024-04-26T12:06:52.104 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.104 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.104 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.104 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:52.104 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227383+0000", 2024-04-26T12:06:52.104 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:52.105 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.105 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.105 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:52.105 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227388+0000", 2024-04-26T12:06:52.105 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7350000000000004e-06 2024-04-26T12:06:52.105 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.105 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.105 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:52.105 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227398+0000", 2024-04-26T12:06:52.105 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0533000000000001e-05 2024-04-26T12:06:52.105 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.105 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.105 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:52.105 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227403+0000", 2024-04-26T12:06:52.105 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0919999999999997e-06 2024-04-26T12:06:52.106 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.106 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.106 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:52.106 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227433+0000", 2024-04-26T12:06:52.106 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9705000000000001e-05 2024-04-26T12:06:52.106 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.106 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.106 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:52.106 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.227509+0000", 2024-04-26T12:06:52.106 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5862e-05 2024-04-26T12:06:52.106 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.106 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.106 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:52.106 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.234944+0000", 2024-04-26T12:06:52.107 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0074348929999999997 2024-04-26T12:06:52.107 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.107 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.107 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:52.107 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.234982+0000", 2024-04-26T12:06:52.107 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8488000000000001e-05 2024-04-26T12:06:52.107 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.107 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.107 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:52.107 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235036+0000", 2024-04-26T12:06:52.107 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3395e-05 2024-04-26T12:06:52.107 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.107 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:52.107 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.108 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.108 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.110 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4564.0:5533 4.3a e50/16 4:5d782e82:::10000001982.00000000:head v 50'87, mlcod=50'85)", 2024-04-26T12:06:52.110 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.235056+0000", 2024-04-26T12:06:52.110 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.7840501619999998, 2024-04-26T12:06:52.110 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0084653469999999998, 2024-04-26T12:06:52.110 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:52.110 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:52.110 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:52.110 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.110 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:52.110 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235056+0000", 2024-04-26T12:06:52.110 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.110 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.110 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.110 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:52.110 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235056+0000", 2024-04-26T12:06:52.111 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.111 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.111 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.111 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:52.111 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235056+0000", 2024-04-26T12:06:52.111 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:52.111 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.111 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.111 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:52.111 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235063+0000", 2024-04-26T12:06:52.111 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.374e-06 2024-04-26T12:06:52.111 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.111 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.111 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:52.112 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235072+0000", 2024-04-26T12:06:52.112 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6719999999999993e-06 2024-04-26T12:06:52.112 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.112 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.112 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:52.112 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235076+0000", 2024-04-26T12:06:52.112 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1919999999999998e-06 2024-04-26T12:06:52.112 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.112 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.112 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:52.112 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235104+0000", 2024-04-26T12:06:52.112 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8509000000000001e-05 2024-04-26T12:06:52.112 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.112 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.113 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:52.113 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.235116+0000", 2024-04-26T12:06:52.113 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1970999999999999e-05 2024-04-26T12:06:52.113 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.113 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.113 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:52.113 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.243491+0000", 2024-04-26T12:06:52.113 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0083750930000000001 2024-04-26T12:06:52.113 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.113 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.113 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:52.113 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.243521+0000", 2024-04-26T12:06:52.113 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9992e-05 2024-04-26T12:06:52.113 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.114 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:52.114 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.114 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.114 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.114 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:5935 4.7 4:e0d0d212:::10000001b3e.00000000:head [write 0~1172] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:52.114 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.681004+0000", 2024-04-26T12:06:52.114 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.3381020120000002, 2024-04-26T12:06:52.114 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0083956459999999997, 2024-04-26T12:06:52.114 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:52.114 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:52.114 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:52.114 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:52.114 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:52.114 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 5935 2024-04-26T12:06:52.115 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.115 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:52.115 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.115 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:52.115 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.681004+0000", 2024-04-26T12:06:52.115 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.115 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.115 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.115 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:52.115 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.681004+0000", 2024-04-26T12:06:52.115 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.115 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.115 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.115 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:52.115 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.681004+0000", 2024-04-26T12:06:52.116 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:52.116 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.116 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.116 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:52.116 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.681008+0000", 2024-04-26T12:06:52.116 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.109e-06 2024-04-26T12:06:52.116 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.116 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.116 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:52.116 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.681016+0000", 2024-04-26T12:06:52.116 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0700000000000007e-06 2024-04-26T12:06:52.116 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.116 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.116 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:52.116 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.681021+0000", 2024-04-26T12:06:52.117 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.814e-06 2024-04-26T12:06:52.117 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.117 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.117 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:52.117 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.681053+0000", 2024-04-26T12:06:52.117 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2121e-05 2024-04-26T12:06:52.117 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.117 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.117 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:52.117 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.681168+0000", 2024-04-26T12:06:52.117 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000115808 2024-04-26T12:06:52.117 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.117 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.117 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:52.117 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.689293+0000", 2024-04-26T12:06:52.118 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081242490000000001 2024-04-26T12:06:52.118 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.118 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.118 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:52.118 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.689333+0000", 2024-04-26T12:06:52.118 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0645999999999997e-05 2024-04-26T12:06:52.118 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.118 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.118 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:52.118 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.689400+0000", 2024-04-26T12:06:52.118 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6495000000000006e-05 2024-04-26T12:06:52.118 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.118 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:52.118 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.119 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.119 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.119 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:68 3.1f 3:f83d65d8:::200.00000004:head [write 0~3067008 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-26T12:06:52.119 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:46.734364+0000", 2024-04-26T12:06:52.119 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.2847421849999998, 2024-04-26T12:06:52.119 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012301993000000001, 2024-04-26T12:06:52.119 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:52.119 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:52.119 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:52.119 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.119 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:52.119 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.734364+0000", 2024-04-26T12:06:52.119 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.119 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.119 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.120 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:52.120 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.734364+0000", 2024-04-26T12:06:52.120 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.120 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.120 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.120 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:52.120 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.734363+0000", 2024-04-26T12:06:52.120 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:52.120 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.120 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.120 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:52.120 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.737105+0000", 2024-04-26T12:06:52.120 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002741627 2024-04-26T12:06:52.120 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.120 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.121 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:52.121 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.737117+0000", 2024-04-26T12:06:52.121 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2724999999999999e-05 2024-04-26T12:06:52.121 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.121 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.121 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:52.121 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.737123+0000", 2024-04-26T12:06:52.121 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.293e-06 2024-04-26T12:06:52.121 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.121 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.121 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:52.121 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.737198+0000", 2024-04-26T12:06:52.121 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4987000000000006e-05 2024-04-26T12:06:52.121 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.121 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.122 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:52.122 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.737247+0000", 2024-04-26T12:06:52.122 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9484000000000003e-05 2024-04-26T12:06:52.122 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.122 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.122 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:52.122 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.737321+0000", 2024-04-26T12:06:52.122 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3338999999999997e-05 2024-04-26T12:06:52.122 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.122 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.122 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:52.122 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.744691+0000", 2024-04-26T12:06:52.122 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073701970000000002 2024-04-26T12:06:52.122 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.123 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.123 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:52.123 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.746609+0000", 2024-04-26T12:06:52.123 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001917801 2024-04-26T12:06:52.123 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.123 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.123 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:52.123 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.746641+0000", 2024-04-26T12:06:52.123 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2255999999999997e-05 2024-04-26T12:06:52.123 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.123 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.123 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:52.123 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:46.746666+0000", 2024-04-26T12:06:52.123 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5185999999999999e-05 2024-04-26T12:06:52.124 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.124 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:52.124 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.124 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.124 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.124 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:6258 4.10 4:0ab2c138:::10000001cac.00000000:head [write 0~121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:52.124 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:47.069636+0000", 2024-04-26T12:06:52.124 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.9494700189999996, 2024-04-26T12:06:52.124 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0082349710000000007, 2024-04-26T12:06:52.124 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:52.124 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:52.124 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:52.124 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:52.124 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:52.124 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 6258 2024-04-26T12:06:52.125 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.125 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:52.125 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.125 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:52.125 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.069636+0000", 2024-04-26T12:06:52.125 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.125 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.125 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.125 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:52.125 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.069636+0000", 2024-04-26T12:06:52.125 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.125 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.126 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.126 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:52.126 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.069635+0000", 2024-04-26T12:06:52.126 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:52.126 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.126 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.126 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:52.126 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.069640+0000", 2024-04-26T12:06:52.126 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.386e-06 2024-04-26T12:06:52.126 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.126 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.126 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:52.126 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.069651+0000", 2024-04-26T12:06:52.126 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1054e-05 2024-04-26T12:06:52.127 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.127 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.127 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:52.127 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.069658+0000", 2024-04-26T12:06:52.127 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4599999999999997e-06 2024-04-26T12:06:52.127 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.127 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.127 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:52.127 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.069694+0000", 2024-04-26T12:06:52.127 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6216e-05 2024-04-26T12:06:52.127 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.127 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.127 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:52.127 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.069824+0000", 2024-04-26T12:06:52.127 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000129317 2024-04-26T12:06:52.128 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.128 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.128 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:52.128 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.077790+0000", 2024-04-26T12:06:52.128 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079659740000000007 2024-04-26T12:06:52.128 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.128 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.128 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:52.128 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.077821+0000", 2024-04-26T12:06:52.128 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0809999999999998e-05 2024-04-26T12:06:52.128 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.128 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.129 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:52.129 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.077871+0000", 2024-04-26T12:06:52.129 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0612999999999998e-05 2024-04-26T12:06:52.129 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.129 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:52.129 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.129 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.129 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.129 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:6513 4.10 4:0a4b3ca1:::10000001dc5.00000000:head [write 0~1700] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:06:52.130 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:47.344875+0000", 2024-04-26T12:06:52.130 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.6742308169999998, 2024-04-26T12:06:52.130 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0078704150000000004, 2024-04-26T12:06:52.130 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:52.130 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:52.130 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:52.130 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:52.130 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:52.130 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 6513 2024-04-26T12:06:52.130 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.130 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:52.130 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.130 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:52.130 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.344875+0000", 2024-04-26T12:06:52.131 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.131 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.131 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.131 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:52.131 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.344875+0000", 2024-04-26T12:06:52.131 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.131 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.131 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.131 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:52.131 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.344875+0000", 2024-04-26T12:06:52.131 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:52.131 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.131 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.131 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:52.132 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.344879+0000", 2024-04-26T12:06:52.132 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3789999999999999e-06 2024-04-26T12:06:52.132 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.132 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.132 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:52.132 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.344888+0000", 2024-04-26T12:06:52.132 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4640000000000006e-06 2024-04-26T12:06:52.132 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.132 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.132 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:52.132 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.344894+0000", 2024-04-26T12:06:52.132 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2129999999999996e-06 2024-04-26T12:06:52.132 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.132 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.132 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:52.133 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.344934+0000", 2024-04-26T12:06:52.133 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0389000000000002e-05 2024-04-26T12:06:52.133 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.133 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.133 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:52.133 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.345066+0000", 2024-04-26T12:06:52.133 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013148700000000001 2024-04-26T12:06:52.133 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.133 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.133 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:52.133 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.352617+0000", 2024-04-26T12:06:52.133 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0075517199999999996 2024-04-26T12:06:52.133 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.133 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.133 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:52.134 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.352670+0000", 2024-04-26T12:06:52.134 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2256999999999998e-05 2024-04-26T12:06:52.134 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.134 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.134 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:52.134 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:47.352746+0000", 2024-04-26T12:06:52.134 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6190000000000001e-05 2024-04-26T12:06:52.134 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.134 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:52.134 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.134 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.134 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.134 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:9062 4.3e 4:7c3973ca:::10000002987.00000000:head [write 0~5714] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:06:52.134 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:50.509865+0000", 2024-04-26T12:06:52.135 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.509241633, 2024-04-26T12:06:52.135 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0091852819999999995, 2024-04-26T12:06:52.135 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:52.135 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:52.135 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:52.135 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:52.135 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:52.135 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 9062 2024-04-26T12:06:52.135 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.135 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:52.135 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.135 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:52.135 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.509865+0000", 2024-04-26T12:06:52.135 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.136 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.136 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.136 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:52.136 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.509865+0000", 2024-04-26T12:06:52.136 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.136 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.136 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.136 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:52.136 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.509864+0000", 2024-04-26T12:06:52.136 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:52.136 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.136 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.136 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:52.136 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.509879+0000", 2024-04-26T12:06:52.136 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5277e-05 2024-04-26T12:06:52.137 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.137 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.137 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:52.137 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.509890+0000", 2024-04-26T12:06:52.137 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.076e-05 2024-04-26T12:06:52.137 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.137 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.137 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:52.137 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.509895+0000", 2024-04-26T12:06:52.137 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7990000000000001e-06 2024-04-26T12:06:52.137 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.137 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.137 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:52.137 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.509935+0000", 2024-04-26T12:06:52.138 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0482999999999998e-05 2024-04-26T12:06:52.138 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.138 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.138 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op must wait for map", 2024-04-26T12:06:52.138 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.509938+0000", 2024-04-26T12:06:52.138 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1480000000000002e-06 2024-04-26T12:06:52.138 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.138 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.138 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:52.138 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.513208+0000", 2024-04-26T12:06:52.138 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0032693980000000002 2024-04-26T12:06:52.138 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.138 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.138 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:52.139 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.513294+0000", 2024-04-26T12:06:52.139 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6753000000000001e-05 2024-04-26T12:06:52.139 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.139 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.139 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:52.139 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.518953+0000", 2024-04-26T12:06:52.139 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0056583470000000002 2024-04-26T12:06:52.139 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.139 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.139 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:52.139 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.519004+0000", 2024-04-26T12:06:52.139 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1619000000000002e-05 2024-04-26T12:06:52.139 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.139 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.140 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:52.140 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.519050+0000", 2024-04-26T12:06:52.140 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5507999999999999e-05 2024-04-26T12:06:52.140 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.140 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:52.140 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.140 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.140 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.140 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4564.0:9417 4.18 e52/16 4:1a6350e5:::10000002b35.00000000:head v 52'173, mlcod=52'171)", 2024-04-26T12:06:52.140 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:50.942542+0000", 2024-04-26T12:06:52.140 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.0765645619999999, 2024-04-26T12:06:52.140 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0083363780000000002, 2024-04-26T12:06:52.140 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:52.140 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:52.140 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:52.141 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.141 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:52.141 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.942542+0000", 2024-04-26T12:06:52.141 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.141 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.141 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.141 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:52.141 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.942542+0000", 2024-04-26T12:06:52.141 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:52.141 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.141 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.141 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:52.141 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.942541+0000", 2024-04-26T12:06:52.141 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:52.141 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.142 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.142 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:52.142 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.942551+0000", 2024-04-26T12:06:52.142 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0336999999999999e-05 2024-04-26T12:06:52.142 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.142 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.142 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:52.142 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.942561+0000", 2024-04-26T12:06:52.142 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6639999999999993e-06 2024-04-26T12:06:52.142 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.142 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.142 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:52.142 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.942566+0000", 2024-04-26T12:06:52.142 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6380000000000003e-06 2024-04-26T12:06:52.143 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.143 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.143 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:52.143 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.942600+0000", 2024-04-26T12:06:52.143 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3940999999999999e-05 2024-04-26T12:06:52.143 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.143 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.143 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:52.143 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.942611+0000", 2024-04-26T12:06:52.143 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1565e-05 2024-04-26T12:06:52.143 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.143 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.143 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:52.143 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.950849+0000", 2024-04-26T12:06:52.143 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0082376189999999998 2024-04-26T12:06:52.144 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:52.144 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:52.144 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:52.144 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:50.950878+0000", 2024-04-26T12:06:52.144 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9196999999999998e-05 2024-04-26T12:06:52.144 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.144 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:52.144 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.144 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:52.144 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:52.144 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:52.146 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:52.146 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:52.144+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:52.157 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:06:52.246 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:52.245+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:52.255 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:52.255 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:52.255 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.255 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4564.0:10581 4.17 e52/16 4:e907323c:::1000000306b.00000000:head v 52'158, mlcod=52'156)", 2024-04-26T12:06:52.255 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:52.254235+0000", 2024-04-26T12:06:52.255 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00031155000000000001, 2024-04-26T12:06:52.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032627200000000001, 2024-04-26T12:06:52.255 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:52.256 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:52.256 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:52.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.256 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:52.256 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.254235+0000", 2024-04-26T12:06:52.256 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:52.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.256 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:52.256 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.254235+0000", 2024-04-26T12:06:52.256 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:52.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.256 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:52.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.254234+0000", 2024-04-26T12:06:52.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:52.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:52.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.254239+0000", 2024-04-26T12:06:52.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7099999999999998e-06 2024-04-26T12:06:52.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:52.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.254249+0000", 2024-04-26T12:06:52.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6490000000000003e-06 2024-04-26T12:06:52.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:52.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.254253+0000", 2024-04-26T12:06:52.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2989999999999998e-06 2024-04-26T12:06:52.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.258 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:52.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.254274+0000", 2024-04-26T12:06:52.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1189999999999999e-05 2024-04-26T12:06:52.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.258 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:52.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.254284+0000", 2024-04-26T12:06:52.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0346999999999999e-05 2024-04-26T12:06:52.259 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:52.259 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:52.259 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:52.259 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.259 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4564.0:10576 4.11 e52/16 4:8990feac:::10000003066.00000000:head v 52'189, mlcod=52'187)", 2024-04-26T12:06:52.259 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:52.250265+0000", 2024-04-26T12:06:52.260 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0042813139999999996, 2024-04-26T12:06:52.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043325780000000001, 2024-04-26T12:06:52.260 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:52.260 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:52.260 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:52.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:52.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.250265+0000", 2024-04-26T12:06:52.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:52.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.261 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:52.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.250265+0000", 2024-04-26T12:06:52.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:52.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.261 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:52.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.250265+0000", 2024-04-26T12:06:52.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:52.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:52.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.250271+0000", 2024-04-26T12:06:52.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9540000000000001e-06 2024-04-26T12:06:52.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:52.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.250277+0000", 2024-04-26T12:06:52.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.6000000000000003e-06 2024-04-26T12:06:52.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:52.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.250281+0000", 2024-04-26T12:06:52.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5200000000000002e-06 2024-04-26T12:06:52.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.263 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:52.263 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.250313+0000", 2024-04-26T12:06:52.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2057999999999997e-05 2024-04-26T12:06:52.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.263 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:52.263 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.250332+0000", 2024-04-26T12:06:52.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8658999999999999e-05 2024-04-26T12:06:52.263 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:52.263 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:52.264 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:52.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.264 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4564.0:10577 4.29 e52/16 4:948eefcc:::10000003067.00000000:head v 52'166, mlcod=52'164)", 2024-04-26T12:06:52.264 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:52.251124+0000", 2024-04-26T12:06:52.264 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.003421973, 2024-04-26T12:06:52.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035038410000000002, 2024-04-26T12:06:52.264 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:52.265 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:52.265 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:52.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:52.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.251124+0000", 2024-04-26T12:06:52.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:52.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:52.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.251124+0000", 2024-04-26T12:06:52.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:52.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:52.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.251124+0000", 2024-04-26T12:06:52.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:52.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:52.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.251130+0000", 2024-04-26T12:06:52.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7599999999999999e-06 2024-04-26T12:06:52.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:52.267 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.251136+0000", 2024-04-26T12:06:52.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5969999999999997e-06 2024-04-26T12:06:52.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.267 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:52.267 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.251140+0000", 2024-04-26T12:06:52.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5319999999999998e-06 2024-04-26T12:06:52.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.267 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:52.267 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.251165+0000", 2024-04-26T12:06:52.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4779000000000001e-05 2024-04-26T12:06:52.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:52.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.251178+0000", 2024-04-26T12:06:52.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3138e-05 2024-04-26T12:06:52.268 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:52.268 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:52.268 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:52.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.268 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4564.0:10578 4.1e e52/16 4:7b39fb32:::10000003068.00000000:head v 52'167, mlcod=52'165)", 2024-04-26T12:06:52.268 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:52.251936+0000", 2024-04-26T12:06:52.268 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0026100239999999999, 2024-04-26T12:06:52.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002721458, 2024-04-26T12:06:52.268 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:52.268 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:52.269 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:52.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:52.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.251936+0000", 2024-04-26T12:06:52.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:52.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:52.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.251936+0000", 2024-04-26T12:06:52.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:52.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:52.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.251936+0000", 2024-04-26T12:06:52.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:52.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:52.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.251941+0000", 2024-04-26T12:06:52.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3449999999999996e-06 2024-04-26T12:06:52.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:52.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.251947+0000", 2024-04-26T12:06:52.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:06:52.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:52.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.251951+0000", 2024-04-26T12:06:52.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2590000000000001e-06 2024-04-26T12:06:52.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:52.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.251979+0000", 2024-04-26T12:06:52.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8677999999999999e-05 2024-04-26T12:06:52.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:52.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.251991+0000", 2024-04-26T12:06:52.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2064e-05 2024-04-26T12:06:52.272 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:52.272 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:52.272 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:52.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.272 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:10579 4.20 4:077dbe33:::10000003069.00000000:head [write 0~72 in=72b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:06:52.272 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:52.252372+0000", 2024-04-26T12:06:52.272 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0021744920000000001, 2024-04-26T12:06:52.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023197859999999999, 2024-04-26T12:06:52.273 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:52.273 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:06:52.273 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:52.273 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:52.273 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:52.274 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 10579 2024-04-26T12:06:52.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.274 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:52.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.274 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:52.274 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.252372+0000", 2024-04-26T12:06:52.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:52.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:52.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.252372+0000", 2024-04-26T12:06:52.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:52.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:52.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.252371+0000", 2024-04-26T12:06:52.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:52.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:52.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.252375+0000", 2024-04-26T12:06:52.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0280000000000002e-06 2024-04-26T12:06:52.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:52.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.252383+0000", 2024-04-26T12:06:52.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1510000000000004e-06 2024-04-26T12:06:52.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:52.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.252388+0000", 2024-04-26T12:06:52.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7169999999999999e-06 2024-04-26T12:06:52.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.279 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:52.279 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.252427+0000", 2024-04-26T12:06:52.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8708999999999998e-05 2024-04-26T12:06:52.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:52.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.252547+0000", 2024-04-26T12:06:52.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000120537 2024-04-26T12:06:52.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:52.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.252669+0000", 2024-04-26T12:06:52.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000121711 2024-04-26T12:06:52.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:52.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:52.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:52.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:52.253635+0000", 2024-04-26T12:06:52.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00096632700000000001 2024-04-26T12:06:52.281 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:52.281 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:52.281 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:52.281 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:52.281 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-04-26T12:06:52.281 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 5 2024-04-26T12:06:52.281 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:52.283 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:52.296 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:52.297 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:52.297 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:06:52.300 INFO:tasks.workunit.client.0.smithi052.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-26T12:06:52.303 INFO:tasks.workunit.client.0.smithi052.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T12:06:52.303 INFO:tasks.workunit.client.0.smithi052.stderr:+ make 2024-04-26T12:06:52.316 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:52.316 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:52.318 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:06:52.319 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:06:52.347 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:52.346+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:52.362 INFO:tasks.workunit.client.0.smithi052.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-26T12:06:52.390 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:52.390 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:52.400 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:52.448 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:52.447+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:52.501 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:52.501 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:52.510 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:52.528 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:06:52.549 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:52.548+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:52.613 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:52.613 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:52.622 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:52.637 INFO:tasks.workunit.client.0.smithi052.stderr:++ readlink -f fsstress 2024-04-26T12:06:52.639 INFO:tasks.workunit.client.0.smithi052.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-26T12:06:52.639 INFO:tasks.workunit.client.0.smithi052.stderr:+ popd 2024-04-26T12:06:52.640 INFO:tasks.workunit.client.0.smithi052.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T12:06:52.640 INFO:tasks.workunit.client.0.smithi052.stderr:+ popd 2024-04-26T12:06:52.640 INFO:tasks.workunit.client.0.smithi052.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-26T12:06:52.641 INFO:tasks.workunit.client.0.smithi052.stderr:++ mktemp -d -p . 2024-04-26T12:06:52.642 INFO:tasks.workunit.client.0.smithi052.stderr:+ T=./tmp.BSZJEe4bnC 2024-04-26T12:06:52.642 INFO:tasks.workunit.client.0.smithi052.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.BSZJEe4bnC -l 1 -n 1000 -p 10 -v 2024-04-26T12:06:52.644 INFO:tasks.workunit.client.0.smithi052.stdout:seed = 1713523961 2024-04-26T12:06:52.646 INFO:tasks.workunit.client.0.smithi052.stdout:0/0: fsync - no filename 2024-04-26T12:06:52.646 INFO:tasks.workunit.client.0.smithi052.stdout:0/1: mkdir d0 0 2024-04-26T12:06:52.646 INFO:tasks.workunit.client.0.smithi052.stdout:1/0: fsync - no filename 2024-04-26T12:06:52.646 INFO:tasks.workunit.client.0.smithi052.stdout:1/1: dwrite - no filename 2024-04-26T12:06:52.647 INFO:tasks.workunit.client.0.smithi052.stdout:2/0: rename - no filename 2024-04-26T12:06:52.647 INFO:tasks.workunit.client.0.smithi052.stdout:2/1: dread - no filename 2024-04-26T12:06:52.648 INFO:tasks.workunit.client.0.smithi052.stdout:3/0: truncate - no filename 2024-04-26T12:06:52.648 INFO:tasks.workunit.client.0.smithi052.stdout:3/1: write - no filename 2024-04-26T12:06:52.648 INFO:tasks.workunit.client.0.smithi052.stdout:3/2: dread - no filename 2024-04-26T12:06:52.648 INFO:tasks.workunit.client.0.smithi052.stdout:3/3: write - no filename 2024-04-26T12:06:52.648 INFO:tasks.workunit.client.0.smithi052.stdout:3/4: truncate - no filename 2024-04-26T12:06:52.648 INFO:tasks.workunit.client.0.smithi052.stdout:0/2: mkdir d0/d1 0 2024-04-26T12:06:52.648 INFO:tasks.workunit.client.0.smithi052.stdout:0/3: unlink - no file 2024-04-26T12:06:52.648 INFO:tasks.workunit.client.0.smithi052.stdout:1/2: mkdir d0 0 2024-04-26T12:06:52.648 INFO:tasks.workunit.client.0.smithi052.stdout:1/3: dwrite - no filename 2024-04-26T12:06:52.648 INFO:tasks.workunit.client.0.smithi052.stdout:3/5: chown . 540953 1 2024-04-26T12:06:52.648 INFO:tasks.workunit.client.0.smithi052.stdout:3/6: stat - no entries 2024-04-26T12:06:52.648 INFO:tasks.workunit.client.0.smithi052.stdout:3/7: dwrite - no filename 2024-04-26T12:06:52.648 INFO:tasks.workunit.client.0.smithi052.stdout:3/8: rename - no filename 2024-04-26T12:06:52.648 INFO:tasks.workunit.client.0.smithi052.stdout:3/9: chown . 809362 1 2024-04-26T12:06:52.648 INFO:tasks.workunit.client.0.smithi052.stdout:3/10: write - no filename 2024-04-26T12:06:52.649 INFO:tasks.workunit.client.0.smithi052.stdout:3/11: write - no filename 2024-04-26T12:06:52.649 INFO:tasks.workunit.client.0.smithi052.stdout:2/2: mkdir d0 0 2024-04-26T12:06:52.649 INFO:tasks.workunit.client.0.smithi052.stdout:2/3: dread - no filename 2024-04-26T12:06:52.649 INFO:tasks.workunit.client.0.smithi052.stdout:2/4: truncate - no filename 2024-04-26T12:06:52.649 INFO:tasks.workunit.client.0.smithi052.stdout:0/4: stat d0/d1 0 2024-04-26T12:06:52.649 INFO:tasks.workunit.client.0.smithi052.stdout:1/4: rename d0 to d0/d1 22 2024-04-26T12:06:52.649 INFO:tasks.workunit.client.0.smithi052.stdout:4/0: rmdir - no directory 2024-04-26T12:06:52.649 INFO:tasks.workunit.client.0.smithi052.stdout:4/1: write - no filename 2024-04-26T12:06:52.649 INFO:tasks.workunit.client.0.smithi052.stdout:3/12: mknod c0 0 2024-04-26T12:06:52.649 INFO:tasks.workunit.client.0.smithi052.stdout:3/13: dread - no filename 2024-04-26T12:06:52.653 INFO:tasks.workunit.client.0.smithi052.stdout:2/5: mknod d0/c1 0 2024-04-26T12:06:52.653 INFO:tasks.workunit.client.0.smithi052.stdout:5/0: dread - no filename 2024-04-26T12:06:52.653 INFO:tasks.workunit.client.0.smithi052.stdout:5/1: truncate - no filename 2024-04-26T12:06:52.653 INFO:tasks.workunit.client.0.smithi052.stdout:5/2: dwrite - no filename 2024-04-26T12:06:52.653 INFO:tasks.workunit.client.0.smithi052.stdout:5/3: dwrite - no filename 2024-04-26T12:06:52.653 INFO:tasks.workunit.client.0.smithi052.stdout:0/5: mkdir d0/d1/d2 0 2024-04-26T12:06:52.654 INFO:tasks.workunit.client.0.smithi052.stdout:0/6: fsync - no filename 2024-04-26T12:06:52.654 INFO:tasks.workunit.client.0.smithi052.stdout:0/7: fsync - no filename 2024-04-26T12:06:52.654 INFO:tasks.workunit.client.0.smithi052.stdout:1/5: mkdir d0/d2 0 2024-04-26T12:06:52.654 INFO:tasks.workunit.client.0.smithi052.stdout:3/14: chown c0 634 1 2024-04-26T12:06:52.654 INFO:tasks.workunit.client.0.smithi052.stdout:3/15: read - no filename 2024-04-26T12:06:52.654 INFO:tasks.workunit.client.0.smithi052.stdout:3/16: dread - no filename 2024-04-26T12:06:52.655 INFO:tasks.workunit.client.0.smithi052.stdout:3/17: dread - no filename 2024-04-26T12:06:52.655 INFO:tasks.workunit.client.0.smithi052.stdout:6/0: read - no filename 2024-04-26T12:06:52.655 INFO:tasks.workunit.client.0.smithi052.stdout:4/2: getdents . 0 2024-04-26T12:06:52.655 INFO:tasks.workunit.client.0.smithi052.stdout:6/1: chown . 55585 1 2024-04-26T12:06:52.656 INFO:tasks.workunit.client.0.smithi052.stdout:6/2: dwrite - no filename 2024-04-26T12:06:52.656 INFO:tasks.workunit.client.0.smithi052.stdout:6/3: dread - no filename 2024-04-26T12:06:52.656 INFO:tasks.workunit.client.0.smithi052.stdout:4/3: dread - no filename 2024-04-26T12:06:52.656 INFO:tasks.workunit.client.0.smithi052.stdout:4/4: dread - no filename 2024-04-26T12:06:52.656 INFO:tasks.workunit.client.0.smithi052.stdout:4/5: truncate - no filename 2024-04-26T12:06:52.656 INFO:tasks.workunit.client.0.smithi052.stdout:4/6: rename - no filename 2024-04-26T12:06:52.656 INFO:tasks.workunit.client.0.smithi052.stdout:3/18: unlink c0 0 2024-04-26T12:06:52.656 INFO:tasks.workunit.client.0.smithi052.stdout:3/19: write - no filename 2024-04-26T12:06:52.657 INFO:tasks.workunit.client.0.smithi052.stdout:3/20: rmdir - no directory 2024-04-26T12:06:52.657 INFO:tasks.workunit.client.0.smithi052.stdout:0/8: creat d0/f3 x:0 0 0 2024-04-26T12:06:52.657 INFO:tasks.workunit.client.0.smithi052.stdout:7/0: dwrite - no filename 2024-04-26T12:06:52.657 INFO:tasks.workunit.client.0.smithi052.stdout:3/21: mknod c1 0 2024-04-26T12:06:52.657 INFO:tasks.workunit.client.0.smithi052.stdout:5/4: creat f0 x:0 0 0 2024-04-26T12:06:52.657 INFO:tasks.workunit.client.0.smithi052.stdout:7/1: chown . 1033010 1 2024-04-26T12:06:52.657 INFO:tasks.workunit.client.0.smithi052.stdout:7/2: rename - no filename 2024-04-26T12:06:52.657 INFO:tasks.workunit.client.0.smithi052.stdout:7/3: read - no filename 2024-04-26T12:06:52.657 INFO:tasks.workunit.client.0.smithi052.stdout:7/4: write - no filename 2024-04-26T12:06:52.658 INFO:tasks.workunit.client.0.smithi052.stdout:7/5: truncate - no filename 2024-04-26T12:06:52.658 INFO:tasks.workunit.client.0.smithi052.stdout:6/4: creat f0 x:0 0 0 2024-04-26T12:06:52.658 INFO:tasks.workunit.client.0.smithi052.stdout:8/0: fdatasync - no filename 2024-04-26T12:06:52.658 INFO:tasks.workunit.client.0.smithi052.stdout:8/1: fsync - no filename 2024-04-26T12:06:52.658 INFO:tasks.workunit.client.0.smithi052.stdout:8/2: rename - no filename 2024-04-26T12:06:52.658 INFO:tasks.workunit.client.0.smithi052.stdout:6/5: dread - f0 zero size 2024-04-26T12:06:52.658 INFO:tasks.workunit.client.0.smithi052.stdout:1/6: mknod d0/d2/c3 0 2024-04-26T12:06:52.658 INFO:tasks.workunit.client.0.smithi052.stdout:1/7: truncate - no filename 2024-04-26T12:06:52.658 INFO:tasks.workunit.client.0.smithi052.stdout:4/7: symlink l0 0 2024-04-26T12:06:52.658 INFO:tasks.workunit.client.0.smithi052.stdout:3/22: chown c1 8 1 2024-04-26T12:06:52.658 INFO:tasks.workunit.client.0.smithi052.stdout:3/23: write - no filename 2024-04-26T12:06:52.659 INFO:tasks.workunit.client.0.smithi052.stdout:0/9: creat d0/d1/f4 x:0 0 0 2024-04-26T12:06:52.659 INFO:tasks.workunit.client.0.smithi052.stdout:5/5: rename f0 to f1 0 2024-04-26T12:06:52.659 INFO:tasks.workunit.client.0.smithi052.stdout:4/8: mknod c1 0 2024-04-26T12:06:52.659 INFO:tasks.workunit.client.0.smithi052.stdout:4/9: dread - no filename 2024-04-26T12:06:52.659 INFO:tasks.workunit.client.0.smithi052.stdout:4/10: write - no filename 2024-04-26T12:06:52.659 INFO:tasks.workunit.client.0.smithi052.stdout:7/6: creat f0 x:0 0 0 2024-04-26T12:06:52.659 INFO:tasks.workunit.client.0.smithi052.stdout:3/24: mkdir d2 0 2024-04-26T12:06:52.659 INFO:tasks.workunit.client.0.smithi052.stdout:9/0: link - no file 2024-04-26T12:06:52.659 INFO:tasks.workunit.client.0.smithi052.stdout:9/1: dwrite - no filename 2024-04-26T12:06:52.659 INFO:tasks.workunit.client.0.smithi052.stdout:9/2: dread - no filename 2024-04-26T12:06:52.659 INFO:tasks.workunit.client.0.smithi052.stdout:8/3: mkdir d0 0 2024-04-26T12:06:52.659 INFO:tasks.workunit.client.0.smithi052.stdout:8/4: write - no filename 2024-04-26T12:06:52.659 INFO:tasks.workunit.client.0.smithi052.stdout:6/6: rename f0 to f1 0 2024-04-26T12:06:52.659 INFO:tasks.workunit.client.0.smithi052.stdout:6/7: readlink - no filename 2024-04-26T12:06:52.659 INFO:tasks.workunit.client.0.smithi052.stdout:1/8: rename d0/d2 to d0/d2/d4 22 2024-04-26T12:06:52.660 INFO:tasks.workunit.client.0.smithi052.stdout:7/7: unlink f0 0 2024-04-26T12:06:52.660 INFO:tasks.workunit.client.0.smithi052.stdout:7/8: dwrite - no filename 2024-04-26T12:06:52.660 INFO:tasks.workunit.client.0.smithi052.stdout:7/9: dwrite - no filename 2024-04-26T12:06:52.662 INFO:tasks.workunit.client.0.smithi052.stdout:7/10: mkdir d1 0 2024-04-26T12:06:52.662 INFO:tasks.workunit.client.0.smithi052.stdout:3/25: symlink d2/l3 0 2024-04-26T12:06:52.662 INFO:tasks.workunit.client.0.smithi052.stdout:8/5: creat d0/f1 x:0 0 0 2024-04-26T12:06:52.662 INFO:tasks.workunit.client.0.smithi052.stdout:9/3: symlink l0 0 2024-04-26T12:06:52.662 INFO:tasks.workunit.client.0.smithi052.stdout:1/9: link d0/d2/c3 d0/d2/c5 0 2024-04-26T12:06:52.662 INFO:tasks.workunit.client.0.smithi052.stdout:7/11: chown d1 282363036 1 2024-04-26T12:06:52.662 INFO:tasks.workunit.client.0.smithi052.stdout:9/4: mknod c1 0 2024-04-26T12:06:52.662 INFO:tasks.workunit.client.0.smithi052.stdout:9/5: truncate - no filename 2024-04-26T12:06:52.662 INFO:tasks.workunit.client.0.smithi052.stdout:3/26: chown c1 15614 1 2024-04-26T12:06:52.662 INFO:tasks.workunit.client.0.smithi052.stdout:1/10: chown d0/d2 15660798 1 2024-04-26T12:06:52.663 INFO:tasks.workunit.client.0.smithi052.stdout:8/6: chown d0/f1 753215811 1 2024-04-26T12:06:52.663 INFO:tasks.workunit.client.0.smithi052.stdout:7/12: symlink d1/l2 0 2024-04-26T12:06:52.663 INFO:tasks.workunit.client.0.smithi052.stdout:7/13: truncate - no filename 2024-04-26T12:06:52.663 INFO:tasks.workunit.client.0.smithi052.stdout:9/6: creat f2 x:0 0 0 2024-04-26T12:06:52.663 INFO:tasks.workunit.client.0.smithi052.stdout:7/14: rename d1 to d1/d3 22 2024-04-26T12:06:52.663 INFO:tasks.workunit.client.0.smithi052.stdout:1/11: creat d0/d2/f6 x:0 0 0 2024-04-26T12:06:52.663 INFO:tasks.workunit.client.0.smithi052.stdout:0/10: dwrite d0/f3 [0,4194304] 0 2024-04-26T12:06:52.664 INFO:tasks.workunit.client.0.smithi052.stdout:1/12: write d0/d2/f6 [773036,7050] 0 2024-04-26T12:06:52.664 INFO:tasks.workunit.client.0.smithi052.stdout:7/15: link d1/l2 d1/l4 0 2024-04-26T12:06:52.666 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:52.665+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:52.670 INFO:tasks.workunit.client.0.smithi052.stdout:8/7: dwrite d0/f1 [0,4194304] 0 2024-04-26T12:06:52.670 INFO:tasks.workunit.client.0.smithi052.stdout:1/13: fdatasync d0/d2/f6 0 2024-04-26T12:06:52.673 INFO:tasks.workunit.client.0.smithi052.stdout:9/7: dwrite f2 [0,4194304] 0 2024-04-26T12:06:52.678 INFO:tasks.workunit.client.0.smithi052.stdout:2/6: getdents d0 0 2024-04-26T12:06:52.678 INFO:tasks.workunit.client.0.smithi052.stdout:2/7: readlink - no filename 2024-04-26T12:06:52.678 INFO:tasks.workunit.client.0.smithi052.stdout:4/11: getdents . 0 2024-04-26T12:06:52.678 INFO:tasks.workunit.client.0.smithi052.stdout:5/6: fsync f1 0 2024-04-26T12:06:52.680 INFO:tasks.workunit.client.0.smithi052.stdout:3/27: getdents d2 0 2024-04-26T12:06:52.680 INFO:tasks.workunit.client.0.smithi052.stdout:1/14: mknod d0/c7 0 2024-04-26T12:06:52.680 INFO:tasks.workunit.client.0.smithi052.stdout:9/8: mkdir d3 0 2024-04-26T12:06:52.680 INFO:tasks.workunit.client.0.smithi052.stdout:4/12: creat f2 x:0 0 0 2024-04-26T12:06:52.680 INFO:tasks.workunit.client.0.smithi052.stdout:7/16: chown d1/l4 0 1 2024-04-26T12:06:52.680 INFO:tasks.workunit.client.0.smithi052.stdout:2/8: rmdir d0 39 2024-04-26T12:06:52.680 INFO:tasks.workunit.client.0.smithi052.stdout:2/9: read - no filename 2024-04-26T12:06:52.680 INFO:tasks.workunit.client.0.smithi052.stdout:2/10: dread - no filename 2024-04-26T12:06:52.680 INFO:tasks.workunit.client.0.smithi052.stdout:2/11: dwrite - no filename 2024-04-26T12:06:52.680 INFO:tasks.workunit.client.0.smithi052.stdout:2/12: write - no filename 2024-04-26T12:06:52.681 INFO:tasks.workunit.client.0.smithi052.stdout:0/11: rmdir d0/d1/d2 0 2024-04-26T12:06:52.681 INFO:tasks.workunit.client.0.smithi052.stdout:5/7: creat f2 x:0 0 0 2024-04-26T12:06:52.681 INFO:tasks.workunit.client.0.smithi052.stdout:3/28: mkdir d2/d4 0 2024-04-26T12:06:52.681 INFO:tasks.workunit.client.0.smithi052.stdout:4/13: read - f2 zero size 2024-04-26T12:06:52.681 INFO:tasks.workunit.client.0.smithi052.stdout:1/15: rename d0 to d0/d8 22 2024-04-26T12:06:52.681 INFO:tasks.workunit.client.0.smithi052.stdout:7/17: rmdir d1 39 2024-04-26T12:06:52.683 INFO:tasks.workunit.client.0.smithi052.stdout:4/14: readlink l0 0 2024-04-26T12:06:52.683 INFO:tasks.workunit.client.0.smithi052.stdout:9/9: write f2 [2500264,61692] 0 2024-04-26T12:06:52.683 INFO:tasks.workunit.client.0.smithi052.stdout:5/8: mknod c3 0 2024-04-26T12:06:52.683 INFO:tasks.workunit.client.0.smithi052.stdout:3/29: rename d2 to d2/d5 22 2024-04-26T12:06:52.683 INFO:tasks.workunit.client.0.smithi052.stdout:3/30: write - no filename 2024-04-26T12:06:52.683 INFO:tasks.workunit.client.0.smithi052.stdout:3/31: dwrite - no filename 2024-04-26T12:06:52.683 INFO:tasks.workunit.client.0.smithi052.stdout:9/10: chown d3 0 1 2024-04-26T12:06:52.683 INFO:tasks.workunit.client.0.smithi052.stdout:0/12: creat d0/d1/f5 x:0 0 0 2024-04-26T12:06:52.683 INFO:tasks.workunit.client.0.smithi052.stdout:1/16: mkdir d0/d9 0 2024-04-26T12:06:52.683 INFO:tasks.workunit.client.0.smithi052.stdout:5/9: stat f2 0 2024-04-26T12:06:52.683 INFO:tasks.workunit.client.0.smithi052.stdout:2/13: chown d0/c1 759017 1 2024-04-26T12:06:52.683 INFO:tasks.workunit.client.0.smithi052.stdout:4/15: mkdir d3 0 2024-04-26T12:06:52.684 INFO:tasks.workunit.client.0.smithi052.stdout:5/10: dread - f2 zero size 2024-04-26T12:06:52.684 INFO:tasks.workunit.client.0.smithi052.stdout:7/18: rmdir d1 39 2024-04-26T12:06:52.684 INFO:tasks.workunit.client.0.smithi052.stdout:4/16: fdatasync f2 0 2024-04-26T12:06:52.684 INFO:tasks.workunit.client.0.smithi052.stdout:5/11: chown f2 203 1 2024-04-26T12:06:52.684 INFO:tasks.workunit.client.0.smithi052.stdout:0/13: truncate d0/f3 4473740 0 2024-04-26T12:06:52.684 INFO:tasks.workunit.client.0.smithi052.stdout:2/14: unlink d0/c1 0 2024-04-26T12:06:52.684 INFO:tasks.workunit.client.0.smithi052.stdout:2/15: truncate - no filename 2024-04-26T12:06:52.684 INFO:tasks.workunit.client.0.smithi052.stdout:9/11: symlink d3/l4 0 2024-04-26T12:06:52.684 INFO:tasks.workunit.client.0.smithi052.stdout:3/32: mknod d2/d4/c6 0 2024-04-26T12:06:52.686 INFO:tasks.workunit.client.0.smithi052.stdout:7/19: chown d1/l4 33 1 2024-04-26T12:06:52.686 INFO:tasks.workunit.client.0.smithi052.stdout:2/16: symlink d0/l2 0 2024-04-26T12:06:52.686 INFO:tasks.workunit.client.0.smithi052.stdout:4/17: getdents d3 0 2024-04-26T12:06:52.686 INFO:tasks.workunit.client.0.smithi052.stdout:2/17: rename d0 to d0/d3 22 2024-04-26T12:06:52.686 INFO:tasks.workunit.client.0.smithi052.stdout:2/18: fdatasync - no filename 2024-04-26T12:06:52.686 INFO:tasks.workunit.client.0.smithi052.stdout:2/19: dwrite - no filename 2024-04-26T12:06:52.686 INFO:tasks.workunit.client.0.smithi052.stdout:3/33: unlink d2/d4/c6 0 2024-04-26T12:06:52.686 INFO:tasks.workunit.client.0.smithi052.stdout:0/14: chown d0/d1/f4 1 1 2024-04-26T12:06:52.687 INFO:tasks.workunit.client.0.smithi052.stdout:4/18: rename d3 to d3/d4 22 2024-04-26T12:06:52.687 INFO:tasks.workunit.client.0.smithi052.stdout:2/20: chown d0 80 1 2024-04-26T12:06:52.687 INFO:tasks.workunit.client.0.smithi052.stdout:1/17: truncate d0/d2/f6 203609 0 2024-04-26T12:06:52.687 INFO:tasks.workunit.client.0.smithi052.stdout:7/20: rename d1/l4 to d1/l5 0 2024-04-26T12:06:52.687 INFO:tasks.workunit.client.0.smithi052.stdout:9/12: link l0 d3/l5 0 2024-04-26T12:06:52.687 INFO:tasks.workunit.client.0.smithi052.stdout:0/15: read d0/f3 [2489958,18199] 0 2024-04-26T12:06:52.687 INFO:tasks.workunit.client.0.smithi052.stdout:1/18: fdatasync d0/d2/f6 0 2024-04-26T12:06:52.687 INFO:tasks.workunit.client.0.smithi052.stdout:3/34: creat d2/f7 x:0 0 0 2024-04-26T12:06:52.687 INFO:tasks.workunit.client.0.smithi052.stdout:4/19: creat d3/f5 x:0 0 0 2024-04-26T12:06:52.688 INFO:tasks.workunit.client.0.smithi052.stdout:2/21: creat d0/f4 x:0 0 0 2024-04-26T12:06:52.691 INFO:tasks.workunit.client.0.smithi052.stdout:5/12: getdents . 0 2024-04-26T12:06:52.691 INFO:tasks.workunit.client.0.smithi052.stdout:5/13: stat f1 0 2024-04-26T12:06:52.691 INFO:tasks.workunit.client.0.smithi052.stdout:4/20: creat d3/f6 x:0 0 0 2024-04-26T12:06:52.691 INFO:tasks.workunit.client.0.smithi052.stdout:3/35: creat d2/f8 x:0 0 0 2024-04-26T12:06:52.691 INFO:tasks.workunit.client.0.smithi052.stdout:2/22: truncate d0/f4 726729 0 2024-04-26T12:06:52.691 INFO:tasks.workunit.client.0.smithi052.stdout:3/36: stat d2/l3 0 2024-04-26T12:06:52.691 INFO:tasks.workunit.client.0.smithi052.stdout:0/16: creat d0/d1/f6 x:0 0 0 2024-04-26T12:06:52.691 INFO:tasks.workunit.client.0.smithi052.stdout:5/14: mknod c4 0 2024-04-26T12:06:52.691 INFO:tasks.workunit.client.0.smithi052.stdout:4/21: write f2 [276021,2002] 0 2024-04-26T12:06:52.691 INFO:tasks.workunit.client.0.smithi052.stdout:2/23: creat d0/f5 x:0 0 0 2024-04-26T12:06:52.691 INFO:tasks.workunit.client.0.smithi052.stdout:0/17: symlink d0/l7 0 2024-04-26T12:06:52.691 INFO:tasks.workunit.client.0.smithi052.stdout:5/15: mknod c5 0 2024-04-26T12:06:52.691 INFO:tasks.workunit.client.0.smithi052.stdout:7/21: readlink d1/l5 0 2024-04-26T12:06:52.691 INFO:tasks.workunit.client.0.smithi052.stdout:3/37: rename c1 to d2/c9 0 2024-04-26T12:06:52.692 INFO:tasks.workunit.client.0.smithi052.stdout:0/18: rename d0 to d0/d1/d8 22 2024-04-26T12:06:52.692 INFO:tasks.workunit.client.0.smithi052.stdout:2/24: write d0/f5 [139930,21259] 0 2024-04-26T12:06:52.692 INFO:tasks.workunit.client.0.smithi052.stdout:3/38: creat d2/fa x:0 0 0 2024-04-26T12:06:52.692 INFO:tasks.workunit.client.0.smithi052.stdout:7/22: creat d1/f6 x:0 0 0 2024-04-26T12:06:52.692 INFO:tasks.workunit.client.0.smithi052.stdout:5/16: link c5 c6 0 2024-04-26T12:06:52.692 INFO:tasks.workunit.client.0.smithi052.stdout:0/19: chown d0/d1/f4 31 1 2024-04-26T12:06:52.692 INFO:tasks.workunit.client.0.smithi052.stdout:4/22: chown d3/f6 11 1 2024-04-26T12:06:52.692 INFO:tasks.workunit.client.0.smithi052.stdout:3/39: creat d2/fb x:0 0 0 2024-04-26T12:06:52.692 INFO:tasks.workunit.client.0.smithi052.stdout:2/25: read d0/f4 [26266,5970] 0 2024-04-26T12:06:52.692 INFO:tasks.workunit.client.0.smithi052.stdout:9/13: dread f2 [0,4194304] 0 2024-04-26T12:06:52.693 INFO:tasks.workunit.client.0.smithi052.stdout:5/17: truncate f1 39156 0 2024-04-26T12:06:52.693 INFO:tasks.workunit.client.0.smithi052.stdout:4/23: unlink d3/f5 0 2024-04-26T12:06:52.693 INFO:tasks.workunit.client.0.smithi052.stdout:1/19: write d0/d2/f6 [904188,53534] 0 2024-04-26T12:06:52.693 INFO:tasks.workunit.client.0.smithi052.stdout:2/26: chown d0/l2 4491 1 2024-04-26T12:06:52.693 INFO:tasks.workunit.client.0.smithi052.stdout:5/18: symlink l7 0 2024-04-26T12:06:52.693 INFO:tasks.workunit.client.0.smithi052.stdout:0/20: link d0/f3 d0/f9 0 2024-04-26T12:06:52.696 INFO:tasks.workunit.client.0.smithi052.stdout:5/19: read f1 [3325,67440] 0 2024-04-26T12:06:52.696 INFO:tasks.workunit.client.0.smithi052.stdout:0/21: read - d0/d1/f4 zero size 2024-04-26T12:06:52.697 INFO:tasks.workunit.client.0.smithi052.stdout:2/27: dread d0/f5 [0,4194304] 0 2024-04-26T12:06:52.700 INFO:tasks.workunit.client.0.smithi052.stdout:0/22: chown d0/d1/f4 47397 1 2024-04-26T12:06:52.706 INFO:tasks.workunit.client.0.smithi052.stdout:9/14: dread f2 [0,4194304] 0 2024-04-26T12:06:52.707 INFO:tasks.workunit.client.0.smithi052.stdout:7/23: dwrite d1/f6 [0,4194304] 0 2024-04-26T12:06:52.707 INFO:tasks.workunit.client.0.smithi052.stdout:4/24: dwrite f2 [0,4194304] 0 2024-04-26T12:06:52.707 INFO:tasks.workunit.client.0.smithi052.stdout:2/28: link d0/f5 d0/f6 0 2024-04-26T12:06:52.709 INFO:tasks.workunit.client.0.smithi052.stdout:4/25: rename d3 to d3/d7 22 2024-04-26T12:06:52.709 INFO:tasks.workunit.client.0.smithi052.stdout:9/15: fsync f2 0 2024-04-26T12:06:52.710 INFO:tasks.workunit.client.0.smithi052.stdout:7/24: creat d1/f7 x:0 0 0 2024-04-26T12:06:52.711 INFO:tasks.workunit.client.0.smithi052.stdout:1/20: dwrite d0/d2/f6 [0,4194304] 0 2024-04-26T12:06:52.712 INFO:tasks.workunit.client.0.smithi052.stdout:4/26: rename c1 to d3/c8 0 2024-04-26T12:06:52.712 INFO:tasks.workunit.client.0.smithi052.stdout:2/29: write d0/f6 [343698,47004] 0 2024-04-26T12:06:52.712 INFO:tasks.workunit.client.0.smithi052.stdout:9/16: getdents d3 0 2024-04-26T12:06:52.713 INFO:tasks.workunit.client.0.smithi052.stdout:5/20: dwrite f2 [0,4194304] 0 2024-04-26T12:06:52.713 INFO:tasks.workunit.client.0.smithi052.stdout:2/30: stat d0 0 2024-04-26T12:06:52.715 INFO:tasks.workunit.client.0.smithi052.stdout:9/17: write f2 [106827,129412] 0 2024-04-26T12:06:52.715 INFO:tasks.workunit.client.0.smithi052.stdout:7/25: truncate d1/f7 233907 0 2024-04-26T12:06:52.717 INFO:tasks.workunit.client.0.smithi052.stdout:9/18: chown f2 413440149 1 2024-04-26T12:06:52.717 INFO:tasks.workunit.client.0.smithi052.stdout:4/27: truncate f2 2954850 0 2024-04-26T12:06:52.718 INFO:tasks.workunit.client.0.smithi052.stdout:5/21: dread f1 [0,4194304] 0 2024-04-26T12:06:52.723 INFO:tasks.workunit.client.0.smithi052.stdout:0/23: dwrite d0/d1/f4 [0,4194304] 0 2024-04-26T12:06:52.723 INFO:tasks.workunit.client.0.smithi052.stdout:5/22: unlink f2 0 2024-04-26T12:06:52.724 INFO:tasks.workunit.client.0.smithi052.stdout:4/28: dread - d3/f6 zero size 2024-04-26T12:06:52.724 INFO:tasks.workunit.client.0.smithi052.stdout:5/23: mknod c8 0 2024-04-26T12:06:52.724 INFO:tasks.workunit.client.0.smithi052.stdout:0/24: symlink d0/la 0 2024-04-26T12:06:52.724 INFO:tasks.workunit.client.0.smithi052.stdout:1/21: dread d0/d2/f6 [0,4194304] 0 2024-04-26T12:06:52.724 INFO:tasks.workunit.client.0.smithi052.stdout:0/25: symlink d0/lb 0 2024-04-26T12:06:52.725 INFO:tasks.workunit.client.0.smithi052.stdout:5/24: rename c5 to c9 0 2024-04-26T12:06:52.725 INFO:tasks.workunit.client.0.smithi052.stdout:0/26: rename d0 to d0/dc 22 2024-04-26T12:06:52.726 INFO:tasks.workunit.client.0.smithi052.stdout:2/31: dwrite d0/f6 [0,4194304] 0 2024-04-26T12:06:52.727 INFO:tasks.workunit.client.0.smithi052.stdout:9/19: dread f2 [0,4194304] 0 2024-04-26T12:06:52.727 INFO:tasks.workunit.client.0.smithi052.stdout:0/27: write d0/f9 [2098730,97753] 0 2024-04-26T12:06:52.730 INFO:tasks.workunit.client.0.smithi052.stdout:9/20: write f2 [1588852,40176] 0 2024-04-26T12:06:52.730 INFO:tasks.workunit.client.0.smithi052.stdout:0/28: mkdir d0/d1/dd 0 2024-04-26T12:06:52.731 INFO:tasks.workunit.client.0.smithi052.stdout:0/29: chown d0/d1 5305265 1 2024-04-26T12:06:52.733 INFO:tasks.workunit.client.0.smithi052.stdout:0/30: chown d0/f3 903661507 1 2024-04-26T12:06:52.734 INFO:tasks.workunit.client.0.smithi052.stdout:1/22: dwrite d0/d2/f6 [0,4194304] 0 2024-04-26T12:06:52.736 INFO:tasks.workunit.client.0.smithi052.stdout:5/25: dwrite f1 [0,4194304] 0 2024-04-26T12:06:52.736 INFO:tasks.workunit.client.0.smithi052.stdout:2/32: dread d0/f5 [0,4194304] 0 2024-04-26T12:06:52.736 INFO:tasks.workunit.client.0.smithi052.stdout:1/23: stat d0 0 2024-04-26T12:06:52.736 INFO:tasks.workunit.client.0.smithi052.stdout:0/31: write d0/f3 [138025,115382] 0 2024-04-26T12:06:52.737 INFO:tasks.workunit.client.0.smithi052.stdout:5/26: symlink la 0 2024-04-26T12:06:52.737 INFO:tasks.workunit.client.0.smithi052.stdout:2/33: mkdir d0/d7 0 2024-04-26T12:06:52.737 INFO:tasks.workunit.client.0.smithi052.stdout:1/24: mkdir d0/da 0 2024-04-26T12:06:52.738 INFO:tasks.workunit.client.0.smithi052.stdout:0/32: fdatasync d0/d1/f6 0 2024-04-26T12:06:52.738 INFO:tasks.workunit.client.0.smithi052.stdout:2/34: stat d0/f5 0 2024-04-26T12:06:52.739 INFO:tasks.workunit.client.0.smithi052.stdout:0/33: creat d0/fe x:0 0 0 2024-04-26T12:06:52.739 INFO:tasks.workunit.client.0.smithi052.stdout:1/25: write d0/d2/f6 [4040970,25962] 0 2024-04-26T12:06:52.740 INFO:tasks.workunit.client.0.smithi052.stdout:1/26: rmdir d0 39 2024-04-26T12:06:52.740 INFO:tasks.workunit.client.0.smithi052.stdout:0/34: dread - d0/fe zero size 2024-04-26T12:06:52.741 INFO:tasks.workunit.client.0.smithi052.stdout:2/35: link d0/f4 d0/d7/f8 0 2024-04-26T12:06:52.741 INFO:tasks.workunit.client.0.smithi052.stdout:9/21: dwrite f2 [0,4194304] 0 2024-04-26T12:06:52.742 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:52.742 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:52.742 INFO:tasks.workunit.client.0.smithi052.stdout:9/22: rename d3/l4 to d3/l6 0 2024-04-26T12:06:52.744 INFO:tasks.workunit.client.0.smithi052.stdout:2/36: fsync d0/f4 0 2024-04-26T12:06:52.745 INFO:tasks.workunit.client.0.smithi052.stdout:2/37: write d0/f6 [5021935,49716] 0 2024-04-26T12:06:52.746 INFO:tasks.workunit.client.0.smithi052.stdout:2/38: creat d0/d7/f9 x:0 0 0 2024-04-26T12:06:52.747 INFO:tasks.workunit.client.0.smithi052.stdout:0/35: truncate d0/f9 1774317 0 2024-04-26T12:06:52.747 INFO:tasks.workunit.client.0.smithi052.stdout:9/23: truncate f2 465761 0 2024-04-26T12:06:52.748 INFO:tasks.workunit.client.0.smithi052.stdout:0/36: mknod d0/cf 0 2024-04-26T12:06:52.748 INFO:tasks.workunit.client.0.smithi052.stdout:1/27: fsync d0/d2/f6 0 2024-04-26T12:06:52.750 INFO:tasks.workunit.client.0.smithi052.stdout:0/37: mknod d0/d1/dd/c10 0 2024-04-26T12:06:52.750 INFO:tasks.workunit.client.0.smithi052.stdout:1/28: creat d0/d2/fb x:0 0 0 2024-04-26T12:06:52.750 INFO:tasks.workunit.client.0.smithi052.stdout:0/38: fdatasync d0/f9 0 2024-04-26T12:06:52.750 INFO:tasks.workunit.client.0.smithi052.stdout:5/27: fsync f1 0 2024-04-26T12:06:52.750 INFO:tasks.workunit.client.0.smithi052.stdout:1/29: creat d0/da/fc x:0 0 0 2024-04-26T12:06:52.750 INFO:tasks.workunit.client.0.smithi052.stdout:0/39: readlink d0/la 0 2024-04-26T12:06:52.752 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:52.751+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:52.754 INFO:tasks.workunit.client.0.smithi052.stdout:1/30: chown d0/c7 35 1 2024-04-26T12:06:52.754 INFO:tasks.workunit.client.0.smithi052.stdout:2/39: dwrite d0/f5 [0,4194304] 0 2024-04-26T12:06:52.754 INFO:tasks.workunit.client.0.smithi052.stdout:0/40: mkdir d0/d1/d11 0 2024-04-26T12:06:52.754 INFO:tasks.workunit.client.0.smithi052.stdout:1/31: mkdir d0/d2/dd 0 2024-04-26T12:06:52.754 INFO:tasks.workunit.client.0.smithi052.stdout:2/40: stat d0/f4 0 2024-04-26T12:06:52.755 INFO:tasks.workunit.client.0.smithi052.stdout:0/41: readlink d0/l7 0 2024-04-26T12:06:52.755 INFO:tasks.workunit.client.0.smithi052.stdout:9/24: fdatasync f2 0 2024-04-26T12:06:52.755 INFO:tasks.workunit.client.0.smithi052.stdout:1/32: rename d0/d9 to d0/d2/de 0 2024-04-26T12:06:52.755 INFO:tasks.workunit.client.0.smithi052.stdout:1/33: stat d0/d2 0 2024-04-26T12:06:52.755 INFO:tasks.workunit.client.0.smithi052.stdout:9/25: truncate f2 568142 0 2024-04-26T12:06:52.755 INFO:tasks.workunit.client.0.smithi052.stdout:2/41: getdents d0 0 2024-04-26T12:06:52.758 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:52.758 INFO:tasks.workunit.client.0.smithi052.stdout:1/34: write d0/d2/f6 [661926,44077] 0 2024-04-26T12:06:52.758 INFO:tasks.workunit.client.0.smithi052.stdout:2/42: write d0/f4 [782400,116968] 0 2024-04-26T12:06:52.758 INFO:tasks.workunit.client.0.smithi052.stdout:1/35: chown d0/d2/de 69426959 1 2024-04-26T12:06:52.758 INFO:tasks.workunit.client.0.smithi052.stdout:2/43: rmdir d0/d7 39 2024-04-26T12:06:52.758 INFO:tasks.workunit.client.0.smithi052.stdout:5/28: dwrite f1 [0,4194304] 0 2024-04-26T12:06:52.758 INFO:tasks.workunit.client.0.smithi052.stdout:5/29: mkdir db 0 2024-04-26T12:06:52.759 INFO:tasks.workunit.client.0.smithi052.stdout:1/36: write d0/da/fc [763425,23362] 0 2024-04-26T12:06:52.759 INFO:tasks.workunit.client.0.smithi052.stdout:9/26: truncate f2 436575 0 2024-04-26T12:06:52.760 INFO:tasks.workunit.client.0.smithi052.stdout:0/42: dwrite d0/d1/f4 [4194304,4194304] 0 2024-04-26T12:06:52.760 INFO:tasks.workunit.client.0.smithi052.stdout:9/27: creat d3/f7 x:0 0 0 2024-04-26T12:06:52.762 INFO:tasks.workunit.client.0.smithi052.stdout:1/37: write d0/d2/fb [475145,2355] 0 2024-04-26T12:06:52.762 INFO:tasks.workunit.client.0.smithi052.stdout:9/28: dread - d3/f7 zero size 2024-04-26T12:06:52.762 INFO:tasks.workunit.client.0.smithi052.stdout:0/43: unlink d0/lb 0 2024-04-26T12:06:52.763 INFO:tasks.workunit.client.0.smithi052.stdout:9/29: mkdir d3/d8 0 2024-04-26T12:06:52.763 INFO:tasks.workunit.client.0.smithi052.stdout:1/38: chown d0/d2/de 27494 1 2024-04-26T12:06:52.764 INFO:tasks.workunit.client.0.smithi052.stdout:0/44: chown d0/cf 36 1 2024-04-26T12:06:52.765 INFO:tasks.workunit.client.0.smithi052.stdout:9/30: rmdir d3/d8 0 2024-04-26T12:06:52.765 INFO:tasks.workunit.client.0.smithi052.stdout:5/30: dread f1 [0,4194304] 0 2024-04-26T12:06:52.765 INFO:tasks.workunit.client.0.smithi052.stdout:2/44: dwrite d0/f4 [0,4194304] 0 2024-04-26T12:06:52.765 INFO:tasks.workunit.client.0.smithi052.stdout:9/31: rename d3 to d3/d9 22 2024-04-26T12:06:52.767 INFO:tasks.workunit.client.0.smithi052.stdout:5/31: mkdir db/dc 0 2024-04-26T12:06:52.767 INFO:tasks.workunit.client.0.smithi052.stdout:2/45: truncate d0/d7/f9 703584 0 2024-04-26T12:06:52.769 INFO:tasks.workunit.client.0.smithi052.stdout:5/32: mkdir db/dd 0 2024-04-26T12:06:52.770 INFO:tasks.workunit.client.0.smithi052.stdout:2/46: creat d0/fa x:0 0 0 2024-04-26T12:06:52.774 INFO:tasks.workunit.client.0.smithi052.stdout:1/39: dwrite d0/d2/fb [0,4194304] 0 2024-04-26T12:06:52.775 INFO:tasks.workunit.client.0.smithi052.stdout:0/45: dwrite d0/d1/f4 [8388608,4194304] 0 2024-04-26T12:06:52.776 INFO:tasks.workunit.client.0.smithi052.stdout:5/33: dread f1 [0,4194304] 0 2024-04-26T12:06:52.777 INFO:tasks.workunit.client.0.smithi052.stdout:0/46: write d0/f3 [5065,7819] 0 2024-04-26T12:06:52.777 INFO:tasks.workunit.client.0.smithi052.stdout:1/40: mkdir d0/d2/de/df 0 2024-04-26T12:06:52.778 INFO:tasks.workunit.client.0.smithi052.stdout:2/47: dread d0/d7/f8 [0,4194304] 0 2024-04-26T12:06:52.778 INFO:tasks.workunit.client.0.smithi052.stdout:1/41: creat d0/d2/f10 x:0 0 0 2024-04-26T12:06:52.779 INFO:tasks.workunit.client.0.smithi052.stdout:0/47: rename d0/d1/f4 to d0/d1/f12 0 2024-04-26T12:06:52.780 INFO:tasks.workunit.client.0.smithi052.stdout:0/48: creat d0/d1/f13 x:0 0 0 2024-04-26T12:06:52.780 INFO:tasks.workunit.client.0.smithi052.stdout:1/42: symlink d0/d2/de/l11 0 2024-04-26T12:06:52.780 INFO:tasks.workunit.client.0.smithi052.stdout:0/49: mknod d0/d1/c14 0 2024-04-26T12:06:52.781 INFO:tasks.workunit.client.0.smithi052.stdout:1/43: rename d0 to d0/d2/de/df/d12 22 2024-04-26T12:06:52.782 INFO:tasks.workunit.client.0.smithi052.stdout:9/32: dwrite f2 [0,4194304] 0 2024-04-26T12:06:52.783 INFO:tasks.workunit.client.0.smithi052.stdout:9/33: mknod d3/ca 0 2024-04-26T12:06:52.785 INFO:tasks.workunit.client.0.smithi052.stdout:9/34: truncate d3/f7 664404 0 2024-04-26T12:06:52.786 INFO:tasks.workunit.client.0.smithi052.stdout:5/34: truncate f1 2346644 0 2024-04-26T12:06:52.787 INFO:tasks.workunit.client.0.smithi052.stdout:9/35: write f2 [4092841,60343] 0 2024-04-26T12:06:52.788 INFO:tasks.workunit.client.0.smithi052.stdout:5/35: rename c4 to db/dd/ce 0 2024-04-26T12:06:52.789 INFO:tasks.workunit.client.0.smithi052.stdout:0/50: dwrite d0/d1/f6 [0,4194304] 0 2024-04-26T12:06:52.790 INFO:tasks.workunit.client.0.smithi052.stdout:5/36: symlink db/dc/lf 0 2024-04-26T12:06:52.790 INFO:tasks.workunit.client.0.smithi052.stdout:1/44: dwrite d0/d2/f10 [0,4194304] 0 2024-04-26T12:06:52.791 INFO:tasks.workunit.client.0.smithi052.stdout:0/51: chown d0/d1/f5 0 1 2024-04-26T12:06:52.791 INFO:tasks.workunit.client.0.smithi052.stdout:5/37: chown c6 1857 1 2024-04-26T12:06:52.791 INFO:tasks.workunit.client.0.smithi052.stdout:0/52: mknod d0/d1/c15 0 2024-04-26T12:06:52.791 INFO:tasks.workunit.client.0.smithi052.stdout:2/48: truncate d0/f6 387446 0 2024-04-26T12:06:52.791 INFO:tasks.workunit.client.0.smithi052.stdout:5/38: creat db/f10 x:0 0 0 2024-04-26T12:06:52.792 INFO:tasks.workunit.client.0.smithi052.stdout:2/49: stat d0/d7/f8 0 2024-04-26T12:06:52.792 INFO:tasks.workunit.client.0.smithi052.stdout:0/53: creat d0/d1/d11/f16 x:0 0 0 2024-04-26T12:06:52.793 INFO:tasks.workunit.client.0.smithi052.stdout:0/54: dread - d0/d1/d11/f16 zero size 2024-04-26T12:06:52.794 INFO:tasks.workunit.client.0.smithi052.stdout:9/36: write f2 [4667620,77255] 0 2024-04-26T12:06:52.794 INFO:tasks.workunit.client.0.smithi052.stdout:1/45: dread d0/d2/f10 [0,4194304] 0 2024-04-26T12:06:52.795 INFO:tasks.workunit.client.0.smithi052.stdout:0/55: creat d0/d1/d11/f17 x:0 0 0 2024-04-26T12:06:52.795 INFO:tasks.workunit.client.0.smithi052.stdout:9/37: mkdir d3/db 0 2024-04-26T12:06:52.795 INFO:tasks.workunit.client.0.smithi052.stdout:1/46: unlink d0/d2/c3 0 2024-04-26T12:06:52.796 INFO:tasks.workunit.client.0.smithi052.stdout:9/38: truncate d3/f7 1387920 0 2024-04-26T12:06:52.797 INFO:tasks.workunit.client.0.smithi052.stdout:1/47: write d0/d2/fb [3724282,108361] 0 2024-04-26T12:06:52.797 INFO:tasks.workunit.client.0.smithi052.stdout:0/56: truncate d0/d1/f6 4667390 0 2024-04-26T12:06:52.797 INFO:tasks.workunit.client.0.smithi052.stdout:5/39: dwrite db/f10 [0,4194304] 0 2024-04-26T12:06:52.798 INFO:tasks.workunit.client.0.smithi052.stdout:1/48: fsync d0/d2/f6 0 2024-04-26T12:06:52.799 INFO:tasks.workunit.client.0.smithi052.stdout:0/57: mknod d0/d1/dd/c18 0 2024-04-26T12:06:52.799 INFO:tasks.workunit.client.0.smithi052.stdout:9/39: link l0 d3/lc 0 2024-04-26T12:06:52.799 INFO:tasks.workunit.client.0.smithi052.stdout:0/58: chown d0/d1/dd 9663997 1 2024-04-26T12:06:52.800 INFO:tasks.workunit.client.0.smithi052.stdout:9/40: creat d3/fd x:0 0 0 2024-04-26T12:06:52.800 INFO:tasks.workunit.client.0.smithi052.stdout:0/59: creat d0/d1/dd/f19 x:0 0 0 2024-04-26T12:06:52.800 INFO:tasks.workunit.client.0.smithi052.stdout:9/41: write d3/fd [1002718,81619] 0 2024-04-26T12:06:52.800 INFO:tasks.workunit.client.0.smithi052.stdout:0/60: readlink d0/l7 0 2024-04-26T12:06:52.801 INFO:tasks.workunit.client.0.smithi052.stdout:9/42: write f2 [5397703,118313] 0 2024-04-26T12:06:52.802 INFO:tasks.workunit.client.0.smithi052.stdout:0/61: mkdir d0/d1/d1a 0 2024-04-26T12:06:52.802 INFO:tasks.workunit.client.0.smithi052.stdout:9/43: rename f2 to d3/db/fe 0 2024-04-26T12:06:52.802 INFO:tasks.workunit.client.0.smithi052.stdout:0/62: mknod d0/c1b 0 2024-04-26T12:06:52.803 INFO:tasks.workunit.client.0.smithi052.stdout:9/44: creat d3/ff x:0 0 0 2024-04-26T12:06:52.804 INFO:tasks.workunit.client.0.smithi052.stdout:0/63: creat d0/f1c x:0 0 0 2024-04-26T12:06:52.804 INFO:tasks.workunit.client.0.smithi052.stdout:0/64: mknod d0/d1/dd/c1d 0 2024-04-26T12:06:52.804 INFO:tasks.workunit.client.0.smithi052.stdout:1/49: dwrite d0/d2/f6 [0,4194304] 0 2024-04-26T12:06:52.805 INFO:tasks.workunit.client.0.smithi052.stdout:0/65: creat d0/d1/dd/f1e x:0 0 0 2024-04-26T12:06:52.806 INFO:tasks.workunit.client.0.smithi052.stdout:0/66: getdents d0/d1/d1a 0 2024-04-26T12:06:52.808 INFO:tasks.workunit.client.0.smithi052.stdout:5/40: truncate db/f10 784705 0 2024-04-26T12:06:52.809 INFO:tasks.workunit.client.0.smithi052.stdout:9/45: dwrite d3/f7 [0,4194304] 0 2024-04-26T12:06:52.810 INFO:tasks.workunit.client.0.smithi052.stdout:2/50: write d0/f6 [857370,14213] 0 2024-04-26T12:06:52.810 INFO:tasks.workunit.client.0.smithi052.stdout:9/46: mkdir d3/db/d10 0 2024-04-26T12:06:52.811 INFO:tasks.workunit.client.0.smithi052.stdout:0/67: getdents d0/d1/dd 0 2024-04-26T12:06:52.811 INFO:tasks.workunit.client.0.smithi052.stdout:2/51: chown d0/d7 14793 1 2024-04-26T12:06:52.811 INFO:tasks.workunit.client.0.smithi052.stdout:9/47: stat d3/l5 0 2024-04-26T12:06:52.811 INFO:tasks.workunit.client.0.smithi052.stdout:1/50: mkdir d0/d2/dd/d13 0 2024-04-26T12:06:52.811 INFO:tasks.workunit.client.0.smithi052.stdout:2/52: write d0/fa [57525,41250] 0 2024-04-26T12:06:52.812 INFO:tasks.workunit.client.0.smithi052.stdout:0/68: unlink d0/d1/dd/c18 0 2024-04-26T12:06:52.812 INFO:tasks.workunit.client.0.smithi052.stdout:9/48: rename c1 to d3/c11 0 2024-04-26T12:06:52.813 INFO:tasks.workunit.client.0.smithi052.stdout:9/49: mknod d3/c12 0 2024-04-26T12:06:52.813 INFO:tasks.workunit.client.0.smithi052.stdout:5/41: dread f1 [0,4194304] 0 2024-04-26T12:06:52.814 INFO:tasks.workunit.client.0.smithi052.stdout:9/50: mkdir d3/db/d13 0 2024-04-26T12:06:52.814 INFO:tasks.workunit.client.0.smithi052.stdout:1/51: read d0/da/fc [205153,18234] 0 2024-04-26T12:06:52.815 INFO:tasks.workunit.client.0.smithi052.stdout:9/51: write d3/f7 [4694913,62804] 0 2024-04-26T12:06:52.816 INFO:tasks.workunit.client.0.smithi052.stdout:5/42: dread db/f10 [0,4194304] 0 2024-04-26T12:06:52.817 INFO:tasks.workunit.client.0.smithi052.stdout:1/52: write d0/d2/fb [3307147,103677] 0 2024-04-26T12:06:52.818 INFO:tasks.workunit.client.0.smithi052.stdout:5/43: rename la to db/l11 0 2024-04-26T12:06:52.819 INFO:tasks.workunit.client.0.smithi052.stdout:1/53: creat d0/d2/dd/f14 x:0 0 0 2024-04-26T12:06:52.819 INFO:tasks.workunit.client.0.smithi052.stdout:5/44: fsync f1 0 2024-04-26T12:06:52.819 INFO:tasks.workunit.client.0.smithi052.stdout:2/53: dwrite d0/f4 [0,4194304] 0 2024-04-26T12:06:52.820 INFO:tasks.workunit.client.0.smithi052.stdout:0/69: dwrite d0/d1/d11/f16 [0,4194304] 0 2024-04-26T12:06:52.820 INFO:tasks.workunit.client.0.smithi052.stdout:9/52: fsync d3/f7 0 2024-04-26T12:06:52.822 INFO:tasks.workunit.client.0.smithi052.stdout:2/54: chown d0/d7 1011 1 2024-04-26T12:06:52.823 INFO:tasks.workunit.client.0.smithi052.stdout:5/45: read f1 [2023575,102161] 0 2024-04-26T12:06:52.823 INFO:tasks.workunit.client.0.smithi052.stdout:5/46: chown db 46 1 2024-04-26T12:06:52.823 INFO:tasks.workunit.client.0.smithi052.stdout:0/70: dread - d0/d1/f13 zero size 2024-04-26T12:06:52.823 INFO:tasks.workunit.client.0.smithi052.stdout:2/55: read d0/d7/f8 [1670405,81679] 0 2024-04-26T12:06:52.823 INFO:tasks.workunit.client.0.smithi052.stdout:9/53: rename l0 to d3/db/d10/l14 0 2024-04-26T12:06:52.823 INFO:tasks.workunit.client.0.smithi052.stdout:5/47: creat db/dc/f12 x:0 0 0 2024-04-26T12:06:52.824 INFO:tasks.workunit.client.0.smithi052.stdout:9/54: chown d3/c12 2127011 1 2024-04-26T12:06:52.824 INFO:tasks.workunit.client.0.smithi052.stdout:0/71: rename d0/cf to d0/d1/dd/c1f 0 2024-04-26T12:06:52.824 INFO:tasks.workunit.client.0.smithi052.stdout:5/48: mknod db/dc/c13 0 2024-04-26T12:06:52.824 INFO:tasks.workunit.client.0.smithi052.stdout:9/55: fsync d3/db/fe 0 2024-04-26T12:06:52.826 INFO:tasks.workunit.client.0.smithi052.stdout:5/49: chown c6 3 1 2024-04-26T12:06:52.826 INFO:tasks.workunit.client.0.smithi052.stdout:0/72: getdents d0/d1 0 2024-04-26T12:06:52.826 INFO:tasks.workunit.client.0.smithi052.stdout:9/56: mknod d3/db/d10/c15 0 2024-04-26T12:06:52.826 INFO:tasks.workunit.client.0.smithi052.stdout:1/54: truncate d0/d2/f10 403570 0 2024-04-26T12:06:52.826 INFO:tasks.workunit.client.0.smithi052.stdout:5/50: truncate db/dc/f12 239101 0 2024-04-26T12:06:52.827 INFO:tasks.workunit.client.0.smithi052.stdout:0/73: mkdir d0/d1/d1a/d20 0 2024-04-26T12:06:52.827 INFO:tasks.workunit.client.0.smithi052.stdout:9/57: mknod d3/db/d13/c16 0 2024-04-26T12:06:52.828 INFO:tasks.workunit.client.0.smithi052.stdout:1/55: chown d0/d2/de/l11 3 1 2024-04-26T12:06:52.828 INFO:tasks.workunit.client.0.smithi052.stdout:0/74: mkdir d0/d1/d11/d21 0 2024-04-26T12:06:52.829 INFO:tasks.workunit.client.0.smithi052.stdout:9/58: unlink d3/db/fe 0 2024-04-26T12:06:52.829 INFO:tasks.workunit.client.0.smithi052.stdout:2/56: dwrite d0/d7/f8 [0,4194304] 0 2024-04-26T12:06:52.829 INFO:tasks.workunit.client.0.smithi052.stdout:1/56: mkdir d0/d2/dd/d13/d15 0 2024-04-26T12:06:52.830 INFO:tasks.workunit.client.0.smithi052.stdout:2/57: rename d0/d7/f8 to d0/d7/fb 0 2024-04-26T12:06:52.830 INFO:tasks.workunit.client.0.smithi052.stdout:2/58: fdatasync d0/fa 0 2024-04-26T12:06:52.831 INFO:tasks.workunit.client.0.smithi052.stdout:5/51: dread db/dc/f12 [0,4194304] 0 2024-04-26T12:06:52.832 INFO:tasks.workunit.client.0.smithi052.stdout:2/59: rename d0/l2 to d0/d7/lc 0 2024-04-26T12:06:52.834 INFO:tasks.workunit.client.0.smithi052.stdout:9/59: dread d3/f7 [0,4194304] 0 2024-04-26T12:06:52.834 INFO:tasks.workunit.client.0.smithi052.stdout:5/52: truncate db/f10 1711994 0 2024-04-26T12:06:52.834 INFO:tasks.workunit.client.0.smithi052.stdout:2/60: mknod d0/d7/cd 0 2024-04-26T12:06:52.834 INFO:tasks.workunit.client.0.smithi052.stdout:0/75: dwrite d0/f3 [0,4194304] 0 2024-04-26T12:06:52.835 INFO:tasks.workunit.client.0.smithi052.stdout:5/53: symlink db/l14 0 2024-04-26T12:06:52.836 INFO:tasks.workunit.client.0.smithi052.stdout:0/76: creat d0/d1/dd/f22 x:0 0 0 2024-04-26T12:06:52.837 INFO:tasks.workunit.client.0.smithi052.stdout:2/61: truncate d0/d7/f9 851148 0 2024-04-26T12:06:52.837 INFO:tasks.workunit.client.0.smithi052.stdout:1/57: dwrite d0/d2/f6 [0,4194304] 0 2024-04-26T12:06:52.837 INFO:tasks.workunit.client.0.smithi052.stdout:5/54: rmdir db/dc 39 2024-04-26T12:06:52.837 INFO:tasks.workunit.client.0.smithi052.stdout:0/77: dread - d0/f1c zero size 2024-04-26T12:06:52.837 INFO:tasks.workunit.client.0.smithi052.stdout:1/58: rename d0 to d0/d16 22 2024-04-26T12:06:52.838 INFO:tasks.workunit.client.0.smithi052.stdout:5/55: mknod db/c15 0 2024-04-26T12:06:52.839 INFO:tasks.workunit.client.0.smithi052.stdout:2/62: link d0/d7/fb d0/d7/fe 0 2024-04-26T12:06:52.839 INFO:tasks.workunit.client.0.smithi052.stdout:0/78: symlink d0/d1/d11/d21/l23 0 2024-04-26T12:06:52.839 INFO:tasks.workunit.client.0.smithi052.stdout:1/59: unlink d0/da/fc 0 2024-04-26T12:06:52.840 INFO:tasks.workunit.client.0.smithi052.stdout:0/79: creat d0/d1/f24 x:0 0 0 2024-04-26T12:06:52.840 INFO:tasks.workunit.client.0.smithi052.stdout:1/60: write d0/d2/fb [272296,77794] 0 2024-04-26T12:06:52.840 INFO:tasks.workunit.client.0.smithi052.stdout:9/60: dwrite d3/fd [0,4194304] 0 2024-04-26T12:06:52.841 INFO:tasks.workunit.client.0.smithi052.stdout:5/56: link db/dd/ce db/c16 0 2024-04-26T12:06:52.841 INFO:tasks.workunit.client.0.smithi052.stdout:0/80: write d0/d1/f5 [884485,14242] 0 2024-04-26T12:06:52.841 INFO:tasks.workunit.client.0.smithi052.stdout:9/61: stat d3/db/d10/l14 0 2024-04-26T12:06:52.842 INFO:tasks.workunit.client.0.smithi052.stdout:0/81: mknod d0/d1/d11/c25 0 2024-04-26T12:06:52.843 INFO:tasks.workunit.client.0.smithi052.stdout:0/82: chown d0/f3 39958149 1 2024-04-26T12:06:52.844 INFO:tasks.workunit.client.0.smithi052.stdout:0/83: fdatasync d0/d1/d11/f16 0 2024-04-26T12:06:52.846 INFO:tasks.workunit.client.0.smithi052.stdout:0/84: mkdir d0/d26 0 2024-04-26T12:06:52.848 INFO:tasks.workunit.client.0.smithi052.stdout:0/85: chown d0/d1/f5 8255473 1 2024-04-26T12:06:52.849 INFO:tasks.workunit.client.0.smithi052.stdout:1/61: dwrite d0/d2/f6 [4194304,4194304] 0 2024-04-26T12:06:52.851 INFO:tasks.workunit.client.0.smithi052.stdout:9/62: dwrite d3/ff [0,4194304] 0 2024-04-26T12:06:52.851 INFO:tasks.workunit.client.0.smithi052.stdout:2/63: dread d0/d7/f9 [0,4194304] 0 2024-04-26T12:06:52.852 INFO:tasks.workunit.client.0.smithi052.stdout:2/64: fsync d0/f6 0 2024-04-26T12:06:52.852 INFO:tasks.workunit.client.0.smithi052.stdout:0/86: symlink d0/d1/d1a/d20/l27 0 2024-04-26T12:06:52.853 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:52.851+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:52.853 INFO:tasks.workunit.client.0.smithi052.stdout:9/63: chown d3/l5 40391 1 2024-04-26T12:06:52.853 INFO:tasks.workunit.client.0.smithi052.stdout:0/87: readlink d0/d1/d11/d21/l23 0 2024-04-26T12:06:52.854 INFO:tasks.workunit.client.0.smithi052.stdout:2/65: write d0/f4 [777360,49483] 0 2024-04-26T12:06:52.855 INFO:tasks.workunit.client.0.smithi052.stdout:9/64: link d3/c12 d3/db/c17 0 2024-04-26T12:06:52.855 INFO:tasks.workunit.client.0.smithi052.stdout:2/66: chown d0 3478 1 2024-04-26T12:06:52.857 INFO:tasks.workunit.client.0.smithi052.stdout:9/65: unlink d3/db/d10/c15 0 2024-04-26T12:06:52.857 INFO:tasks.workunit.client.0.smithi052.stdout:2/67: unlink d0/d7/fb 0 2024-04-26T12:06:52.858 INFO:tasks.workunit.client.0.smithi052.stdout:0/88: truncate d0/d1/d11/f16 1725253 0 2024-04-26T12:06:52.858 INFO:tasks.workunit.client.0.smithi052.stdout:5/57: dwrite f1 [0,4194304] 0 2024-04-26T12:06:52.859 INFO:tasks.workunit.client.0.smithi052.stdout:0/89: chown d0/d1/dd 746515 1 2024-04-26T12:06:52.859 INFO:tasks.workunit.client.0.smithi052.stdout:2/68: chown d0/d7/f9 2 1 2024-04-26T12:06:52.859 INFO:tasks.workunit.client.0.smithi052.stdout:9/66: creat d3/db/d10/f18 x:0 0 0 2024-04-26T12:06:52.860 INFO:tasks.workunit.client.0.smithi052.stdout:1/62: dwrite d0/d2/dd/f14 [0,4194304] 0 2024-04-26T12:06:52.860 INFO:tasks.workunit.client.0.smithi052.stdout:2/69: symlink d0/d7/lf 0 2024-04-26T12:06:52.860 INFO:tasks.workunit.client.0.smithi052.stdout:9/67: fdatasync d3/db/d10/f18 0 2024-04-26T12:06:52.861 INFO:tasks.workunit.client.0.smithi052.stdout:0/90: rename d0/d1/dd/f22 to d0/d1/dd/f28 0 2024-04-26T12:06:52.862 INFO:tasks.workunit.client.0.smithi052.stdout:2/70: rename d0/d7/f9 to d0/d7/f10 0 2024-04-26T12:06:52.862 INFO:tasks.workunit.client.0.smithi052.stdout:0/91: write d0/f3 [68689,103374] 0 2024-04-26T12:06:52.863 INFO:tasks.workunit.client.0.smithi052.stdout:2/71: truncate d0/f6 1457668 0 2024-04-26T12:06:52.864 INFO:tasks.workunit.client.0.smithi052.stdout:0/92: dread - d0/d1/d11/f17 zero size 2024-04-26T12:06:52.866 INFO:tasks.workunit.client.0.smithi052.stdout:9/68: dread d3/fd [0,4194304] 0 2024-04-26T12:06:52.867 INFO:tasks.workunit.client.0.smithi052.stdout:5/58: truncate f1 1679397 0 2024-04-26T12:06:52.868 INFO:tasks.workunit.client.0.smithi052.stdout:1/63: dwrite d0/d2/f6 [0,4194304] 0 2024-04-26T12:06:52.869 INFO:tasks.workunit.client.0.smithi052.stdout:5/59: chown db/f10 869922 1 2024-04-26T12:06:52.870 INFO:tasks.workunit.client.0.smithi052.stdout:1/64: rename d0 to d0/d2/de/d17 22 2024-04-26T12:06:52.871 INFO:tasks.workunit.client.0.smithi052.stdout:1/65: unlink d0/c7 0 2024-04-26T12:06:52.874 INFO:tasks.workunit.client.0.smithi052.stdout:2/72: dwrite d0/f4 [0,4194304] 0 2024-04-26T12:06:52.874 INFO:tasks.workunit.client.0.smithi052.stdout:0/93: dwrite d0/f1c [0,4194304] 0 2024-04-26T12:06:52.875 INFO:tasks.workunit.client.0.smithi052.stdout:1/66: write d0/d2/f6 [8764645,92879] 0 2024-04-26T12:06:52.876 INFO:tasks.workunit.client.0.smithi052.stdout:0/94: fdatasync d0/fe 0 2024-04-26T12:06:52.876 INFO:tasks.workunit.client.0.smithi052.stdout:5/60: dread db/f10 [0,4194304] 0 2024-04-26T12:06:52.877 INFO:tasks.workunit.client.0.smithi052.stdout:9/69: dwrite d3/db/d10/f18 [0,4194304] 0 2024-04-26T12:06:52.880 INFO:tasks.workunit.client.0.smithi052.stdout:5/61: dread f1 [0,4194304] 0 2024-04-26T12:06:52.881 INFO:tasks.workunit.client.0.smithi052.stdout:5/62: chown db/dd 18355391 1 2024-04-26T12:06:52.886 INFO:tasks.workunit.client.0.smithi052.stdout:2/73: dwrite d0/d7/f10 [0,4194304] 0 2024-04-26T12:06:52.886 INFO:tasks.workunit.client.0.smithi052.stdout:9/70: dread d3/fd [0,4194304] 0 2024-04-26T12:06:52.886 INFO:tasks.workunit.client.0.smithi052.stdout:0/95: dwrite d0/f9 [4194304,4194304] 0 2024-04-26T12:06:52.886 INFO:tasks.workunit.client.0.smithi052.stdout:9/71: fsync d3/ff 0 2024-04-26T12:06:52.887 INFO:tasks.workunit.client.0.smithi052.stdout:9/72: write d3/fd [2573760,5302] 0 2024-04-26T12:06:52.887 INFO:tasks.workunit.client.0.smithi052.stdout:0/96: link d0/d1/c14 d0/d1/d1a/d20/c29 0 2024-04-26T12:06:52.887 INFO:tasks.workunit.client.0.smithi052.stdout:0/97: chown d0 3 1 2024-04-26T12:06:52.888 INFO:tasks.workunit.client.0.smithi052.stdout:0/98: write d0/f3 [4272422,84187] 0 2024-04-26T12:06:52.888 INFO:tasks.workunit.client.0.smithi052.stdout:9/73: rename d3/db/d10/l14 to d3/db/d10/l19 0 2024-04-26T12:06:52.889 INFO:tasks.workunit.client.0.smithi052.stdout:0/99: unlink d0/f1c 0 2024-04-26T12:06:52.889 INFO:tasks.workunit.client.0.smithi052.stdout:0/100: fsync d0/d1/dd/f19 0 2024-04-26T12:06:52.890 INFO:tasks.workunit.client.0.smithi052.stdout:0/101: truncate d0/d1/f24 63205 0 2024-04-26T12:06:52.891 INFO:tasks.workunit.client.0.smithi052.stdout:0/102: chown d0/d1/f13 76997 1 2024-04-26T12:06:52.891 INFO:tasks.workunit.client.0.smithi052.stdout:9/74: dread d3/ff [0,4194304] 0 2024-04-26T12:06:52.892 INFO:tasks.workunit.client.0.smithi052.stdout:0/103: truncate d0/fe 890912 0 2024-04-26T12:06:52.892 INFO:tasks.workunit.client.0.smithi052.stdout:0/104: fsync d0/d1/dd/f19 0 2024-04-26T12:06:52.893 INFO:tasks.workunit.client.0.smithi052.stdout:0/105: write d0/d1/d11/f17 [276141,12755] 0 2024-04-26T12:06:52.894 INFO:tasks.workunit.client.0.smithi052.stdout:5/63: write db/dc/f12 [80640,82646] 0 2024-04-26T12:06:52.895 INFO:tasks.workunit.client.0.smithi052.stdout:5/64: symlink db/dd/l17 0 2024-04-26T12:06:52.895 INFO:tasks.workunit.client.0.smithi052.stdout:0/106: rename d0/d1/d11/d21 to d0/d1/d1a/d2a 0 2024-04-26T12:06:52.896 INFO:tasks.workunit.client.0.smithi052.stdout:0/107: rename d0/d1/d1a to d0/d1/d1a/d2a/d2b 22 2024-04-26T12:06:52.897 INFO:tasks.workunit.client.0.smithi052.stdout:9/75: dwrite d3/fd [0,4194304] 0 2024-04-26T12:06:52.900 INFO:tasks.workunit.client.0.smithi052.stdout:9/76: link d3/db/d10/l19 d3/db/d10/l1a 0 2024-04-26T12:06:52.900 INFO:tasks.workunit.client.0.smithi052.stdout:9/77: chown d3 80 1 2024-04-26T12:06:52.901 INFO:tasks.workunit.client.0.smithi052.stdout:9/78: mkdir d3/d1b 0 2024-04-26T12:06:52.902 INFO:tasks.workunit.client.0.smithi052.stdout:5/65: dwrite f1 [0,4194304] 0 2024-04-26T12:06:52.903 INFO:tasks.workunit.client.0.smithi052.stdout:5/66: readlink db/l14 0 2024-04-26T12:06:52.903 INFO:tasks.workunit.client.0.smithi052.stdout:9/79: readlink d3/db/d10/l19 0 2024-04-26T12:06:52.904 INFO:tasks.workunit.client.0.smithi052.stdout:5/67: mkdir db/dd/d18 0 2024-04-26T12:06:52.905 INFO:tasks.workunit.client.0.smithi052.stdout:0/108: dwrite d0/d1/d11/f16 [0,4194304] 0 2024-04-26T12:06:52.907 INFO:tasks.workunit.client.0.smithi052.stdout:0/109: mkdir d0/d1/d2c 0 2024-04-26T12:06:52.912 INFO:tasks.workunit.client.0.smithi052.stdout:9/80: dwrite d3/ff [4194304,4194304] 0 2024-04-26T12:06:52.913 INFO:tasks.workunit.client.0.smithi052.stdout:5/68: dwrite f1 [4194304,4194304] 0 2024-04-26T12:06:52.914 INFO:tasks.workunit.client.0.smithi052.stdout:9/81: unlink d3/lc 0 2024-04-26T12:06:52.914 INFO:tasks.workunit.client.0.smithi052.stdout:5/69: readlink db/dc/lf 0 2024-04-26T12:06:52.915 INFO:tasks.workunit.client.0.smithi052.stdout:9/82: unlink d3/db/c17 0 2024-04-26T12:06:52.915 INFO:tasks.workunit.client.0.smithi052.stdout:0/110: dwrite d0/f9 [8388608,4194304] 0 2024-04-26T12:06:52.916 INFO:tasks.workunit.client.0.smithi052.stdout:9/83: creat d3/db/d10/f1c x:0 0 0 2024-04-26T12:06:52.916 INFO:tasks.workunit.client.0.smithi052.stdout:5/70: dread db/f10 [0,4194304] 0 2024-04-26T12:06:52.917 INFO:tasks.workunit.client.0.smithi052.stdout:5/71: creat db/dd/f19 x:0 0 0 2024-04-26T12:06:52.918 INFO:tasks.workunit.client.0.smithi052.stdout:5/72: rmdir db/dc 39 2024-04-26T12:06:52.919 INFO:tasks.workunit.client.0.smithi052.stdout:5/73: read - db/dd/f19 zero size 2024-04-26T12:06:52.920 INFO:tasks.workunit.client.0.smithi052.stdout:9/84: rmdir d3 39 2024-04-26T12:06:52.922 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:52.922 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:52.922 INFO:tasks.workunit.client.0.smithi052.stdout:0/111: dwrite d0/fe [0,4194304] 0 2024-04-26T12:06:52.931 INFO:tasks.workunit.client.0.smithi052.stdout:9/85: dread d3/f7 [0,4194304] 0 2024-04-26T12:06:52.931 INFO:tasks.workunit.client.0.smithi052.stdout:5/74: dwrite db/dd/f19 [0,4194304] 0 2024-04-26T12:06:52.931 INFO:tasks.workunit.client.0.smithi052.stdout:0/112: dread d0/d1/f12 [0,4194304] 0 2024-04-26T12:06:52.931 INFO:tasks.workunit.client.0.smithi052.stdout:5/75: rename c3 to db/c1a 0 2024-04-26T12:06:52.931 INFO:tasks.workunit.client.0.smithi052.stdout:5/76: write db/dd/f19 [2710476,46777] 0 2024-04-26T12:06:52.931 INFO:tasks.workunit.client.0.smithi052.stdout:0/113: rename d0/d1/c15 to d0/d1/d2c/c2d 0 2024-04-26T12:06:52.931 INFO:tasks.workunit.client.0.smithi052.stdout:0/114: chown d0/d1/f6 115131 1 2024-04-26T12:06:52.932 INFO:tasks.workunit.client.0.smithi052.stdout:0/115: symlink d0/l2e 0 2024-04-26T12:06:52.934 INFO:tasks.workunit.client.0.smithi052.stdout:0/116: rename d0/d1/dd/c1f to d0/d1/d2c/c2f 0 2024-04-26T12:06:52.934 INFO:tasks.workunit.client.0.smithi052.stdout:9/86: dwrite d3/db/d10/f1c [0,4194304] 0 2024-04-26T12:06:52.935 INFO:tasks.workunit.client.0.smithi052.stdout:0/117: rmdir d0/d1/d1a 39 2024-04-26T12:06:52.936 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:52.936 INFO:tasks.workunit.client.0.smithi052.stdout:9/87: stat d3/l5 0 2024-04-26T12:06:52.945 INFO:tasks.workunit.client.0.smithi052.stdout:0/118: dread d0/d1/f5 [0,4194304] 0 2024-04-26T12:06:52.946 INFO:tasks.workunit.client.0.smithi052.stdout:0/119: chown d0/d1/f5 7988 1 2024-04-26T12:06:52.946 INFO:tasks.workunit.client.0.smithi052.stdout:0/120: stat d0/f3 0 2024-04-26T12:06:52.950 INFO:tasks.workunit.client.0.smithi052.stdout:9/88: fsync d3/db/d10/f1c 0 2024-04-26T12:06:52.954 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:52.953+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:52.989 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~35s 2024-04-26T12:06:53.039 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:53.039 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:53.047 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:53.091 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:53.090+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:53.148 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:53.149 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:53.155 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:53.154+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:53.158 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:53.256 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:53.255+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:53.301 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:53.301 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:53.309 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:53.357 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:53.357+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:53.412 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:53.412 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:53.420 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:53.464 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:53.463+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:53.511 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-26T12:06:53.522 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:53.523 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:53.532 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:53.573 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:53.572+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:53.661 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:53.660+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:53.673 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:53.673 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:53.682 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:53.761 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:53.760+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:53.787 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:53.787 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:53.796 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:53.862 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:53.861+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:53.938 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:53.938 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:53.946 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:53.963 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:53.962+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:54.048 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:54.048 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:54.058 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:54.064 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:54.063+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:54.160 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:54.160 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:54.168 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:54.166+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:54.169 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:54.171 INFO:tasks.workunit.client.0.smithi052.stdout:8/8: sync 2024-04-26T12:06:54.171 INFO:tasks.workunit.client.0.smithi052.stdout:4/29: sync 2024-04-26T12:06:54.171 INFO:tasks.workunit.client.0.smithi052.stdout:2/74: sync 2024-04-26T12:06:54.171 INFO:tasks.workunit.client.0.smithi052.stdout:7/26: sync 2024-04-26T12:06:54.171 INFO:tasks.workunit.client.0.smithi052.stdout:6/8: sync 2024-04-26T12:06:54.171 INFO:tasks.workunit.client.0.smithi052.stdout:3/40: sync 2024-04-26T12:06:54.171 INFO:tasks.workunit.client.0.smithi052.stdout:9/89: sync 2024-04-26T12:06:54.171 INFO:tasks.workunit.client.0.smithi052.stdout:0/121: sync 2024-04-26T12:06:54.171 INFO:tasks.workunit.client.0.smithi052.stdout:5/77: sync 2024-04-26T12:06:54.171 INFO:tasks.workunit.client.0.smithi052.stdout:1/67: sync 2024-04-26T12:06:54.173 INFO:tasks.workunit.client.0.smithi052.stdout:8/9: fsync d0/f1 0 2024-04-26T12:06:54.173 INFO:tasks.workunit.client.0.smithi052.stdout:1/68: chown d0/d2/de/df 363185403 1 2024-04-26T12:06:54.173 INFO:tasks.workunit.client.0.smithi052.stdout:4/30: creat d3/f9 x:0 0 0 2024-04-26T12:06:54.173 INFO:tasks.workunit.client.0.smithi052.stdout:8/10: fsync d0/f1 0 2024-04-26T12:06:54.173 INFO:tasks.workunit.client.0.smithi052.stdout:9/90: chown d3/c12 14572821 1 2024-04-26T12:06:54.173 INFO:tasks.workunit.client.0.smithi052.stdout:6/9: rename f1 to f2 0 2024-04-26T12:06:54.173 INFO:tasks.workunit.client.0.smithi052.stdout:2/75: creat d0/d7/f11 x:0 0 0 2024-04-26T12:06:54.174 INFO:tasks.workunit.client.0.smithi052.stdout:3/41: mkdir d2/d4/dc 0 2024-04-26T12:06:54.174 INFO:tasks.workunit.client.0.smithi052.stdout:5/78: symlink db/l1b 0 2024-04-26T12:06:54.174 INFO:tasks.workunit.client.0.smithi052.stdout:9/91: rename d3 to d3/d1b/d1d 22 2024-04-26T12:06:54.174 INFO:tasks.workunit.client.0.smithi052.stdout:8/11: fdatasync d0/f1 0 2024-04-26T12:06:54.174 INFO:tasks.workunit.client.0.smithi052.stdout:5/79: fdatasync f1 0 2024-04-26T12:06:54.174 INFO:tasks.workunit.client.0.smithi052.stdout:4/31: chown d3/c8 31161 1 2024-04-26T12:06:54.175 INFO:tasks.workunit.client.0.smithi052.stdout:0/122: unlink d0/d1/d1a/d2a/l23 0 2024-04-26T12:06:54.175 INFO:tasks.workunit.client.0.smithi052.stdout:9/92: mknod d3/db/c1e 0 2024-04-26T12:06:54.176 INFO:tasks.workunit.client.0.smithi052.stdout:5/80: mknod db/dd/c1c 0 2024-04-26T12:06:54.176 INFO:tasks.workunit.client.0.smithi052.stdout:2/76: creat d0/f12 x:0 0 0 2024-04-26T12:06:54.177 INFO:tasks.workunit.client.0.smithi052.stdout:1/69: rename d0/d2/fb to d0/d2/f18 0 2024-04-26T12:06:54.178 INFO:tasks.workunit.client.0.smithi052.stdout:4/32: link d3/c8 d3/ca 0 2024-04-26T12:06:54.179 INFO:tasks.workunit.client.0.smithi052.stdout:5/81: creat db/dc/f1d x:0 0 0 2024-04-26T12:06:54.180 INFO:tasks.workunit.client.0.smithi052.stdout:2/77: creat d0/f13 x:0 0 0 2024-04-26T12:06:54.181 INFO:tasks.workunit.client.0.smithi052.stdout:4/33: creat d3/fb x:0 0 0 2024-04-26T12:06:54.181 INFO:tasks.workunit.client.0.smithi052.stdout:1/70: creat d0/da/f19 x:0 0 0 2024-04-26T12:06:54.182 INFO:tasks.workunit.client.0.smithi052.stdout:4/34: dread - d3/fb zero size 2024-04-26T12:06:54.182 INFO:tasks.workunit.client.0.smithi052.stdout:1/71: chown d0/da 12 1 2024-04-26T12:06:54.183 INFO:tasks.workunit.client.0.smithi052.stdout:2/78: write d0/d7/f10 [68932,70556] 0 2024-04-26T12:06:54.184 INFO:tasks.workunit.client.0.smithi052.stdout:3/42: dwrite d2/f7 [0,4194304] 0 2024-04-26T12:06:54.186 INFO:tasks.workunit.client.0.smithi052.stdout:8/12: dread d0/f1 [0,4194304] 0 2024-04-26T12:06:54.186 INFO:tasks.workunit.client.0.smithi052.stdout:6/10: dwrite f2 [0,4194304] 0 2024-04-26T12:06:54.186 INFO:tasks.workunit.client.0.smithi052.stdout:2/79: mknod d0/d7/c14 0 2024-04-26T12:06:54.186 INFO:tasks.workunit.client.0.smithi052.stdout:6/11: stat f2 0 2024-04-26T12:06:54.186 INFO:tasks.workunit.client.0.smithi052.stdout:3/43: chown d2/d4/dc 1440447747 1 2024-04-26T12:06:54.187 INFO:tasks.workunit.client.0.smithi052.stdout:8/13: fsync d0/f1 0 2024-04-26T12:06:54.187 INFO:tasks.workunit.client.0.smithi052.stdout:2/80: fdatasync d0/f13 0 2024-04-26T12:06:54.187 INFO:tasks.workunit.client.0.smithi052.stdout:9/93: dread d3/db/d10/f1c [0,4194304] 0 2024-04-26T12:06:54.187 INFO:tasks.workunit.client.0.smithi052.stdout:6/12: symlink l3 0 2024-04-26T12:06:54.187 INFO:tasks.workunit.client.0.smithi052.stdout:0/123: dread d0/d1/d11/f16 [0,4194304] 0 2024-04-26T12:06:54.188 INFO:tasks.workunit.client.0.smithi052.stdout:3/44: mkdir d2/d4/dc/dd 0 2024-04-26T12:06:54.188 INFO:tasks.workunit.client.0.smithi052.stdout:9/94: symlink d3/l1f 0 2024-04-26T12:06:54.188 INFO:tasks.workunit.client.0.smithi052.stdout:0/124: getdents d0/d26 0 2024-04-26T12:06:54.189 INFO:tasks.workunit.client.0.smithi052.stdout:2/81: rename d0/f13 to d0/f15 0 2024-04-26T12:06:54.189 INFO:tasks.workunit.client.0.smithi052.stdout:0/125: readlink d0/d1/d1a/d20/l27 0 2024-04-26T12:06:54.191 INFO:tasks.workunit.client.0.smithi052.stdout:0/126: write d0/d1/f24 [657724,32434] 0 2024-04-26T12:06:54.195 INFO:tasks.workunit.client.0.smithi052.stdout:9/95: dwrite d3/ff [0,4194304] 0 2024-04-26T12:06:54.198 INFO:tasks.workunit.client.0.smithi052.stdout:9/96: fsync d3/db/d10/f1c 0 2024-04-26T12:06:54.199 INFO:tasks.workunit.client.0.smithi052.stdout:0/127: dwrite d0/fe [0,4194304] 0 2024-04-26T12:06:54.207 INFO:tasks.workunit.client.0.smithi052.stdout:9/97: creat d3/db/f20 x:0 0 0 2024-04-26T12:06:54.208 INFO:tasks.workunit.client.0.smithi052.stdout:8/14: truncate d0/f1 929693 0 2024-04-26T12:06:54.208 INFO:tasks.workunit.client.0.smithi052.stdout:0/128: read d0/d1/d11/f17 [184303,99514] 0 2024-04-26T12:06:54.208 INFO:tasks.workunit.client.0.smithi052.stdout:5/82: truncate db/f10 600702 0 2024-04-26T12:06:54.208 INFO:tasks.workunit.client.0.smithi052.stdout:4/35: getdents d3 0 2024-04-26T12:06:54.208 INFO:tasks.workunit.client.0.smithi052.stdout:2/82: getdents d0/d7 0 2024-04-26T12:06:54.209 INFO:tasks.workunit.client.0.smithi052.stdout:9/98: write d3/db/d10/f1c [29569,122856] 0 2024-04-26T12:06:54.209 INFO:tasks.workunit.client.0.smithi052.stdout:3/45: truncate d2/f7 208096 0 2024-04-26T12:06:54.210 INFO:tasks.workunit.client.0.smithi052.stdout:0/129: rmdir d0/d1/d1a 39 2024-04-26T12:06:54.210 INFO:tasks.workunit.client.0.smithi052.stdout:5/83: read db/dc/f12 [229668,56507] 0 2024-04-26T12:06:54.210 INFO:tasks.workunit.client.0.smithi052.stdout:2/83: mkdir d0/d7/d16 0 2024-04-26T12:06:54.210 INFO:tasks.workunit.client.0.smithi052.stdout:1/72: readlink d0/d2/de/l11 0 2024-04-26T12:06:54.210 INFO:tasks.workunit.client.0.smithi052.stdout:0/130: stat d0/d1/f24 0 2024-04-26T12:06:54.210 INFO:tasks.workunit.client.0.smithi052.stdout:4/36: write d3/fb [140574,39307] 0 2024-04-26T12:06:54.211 INFO:tasks.workunit.client.0.smithi052.stdout:3/46: write d2/f8 [87761,37439] 0 2024-04-26T12:06:54.211 INFO:tasks.workunit.client.0.smithi052.stdout:8/15: rmdir d0 39 2024-04-26T12:06:54.213 INFO:tasks.workunit.client.0.smithi052.stdout:4/37: creat d3/fc x:0 0 0 2024-04-26T12:06:54.213 INFO:tasks.workunit.client.0.smithi052.stdout:5/84: mkdir db/dd/d18/d1e 0 2024-04-26T12:06:54.215 INFO:tasks.workunit.client.0.smithi052.stdout:8/16: creat d0/f2 x:0 0 0 2024-04-26T12:06:54.215 INFO:tasks.workunit.client.0.smithi052.stdout:4/38: creat d3/fd x:0 0 0 2024-04-26T12:06:54.215 INFO:tasks.workunit.client.0.smithi052.stdout:3/47: mknod d2/d4/dc/ce 0 2024-04-26T12:06:54.216 INFO:tasks.workunit.client.0.smithi052.stdout:1/73: dread d0/d2/f10 [0,4194304] 0 2024-04-26T12:06:54.216 INFO:tasks.workunit.client.0.smithi052.stdout:6/13: dwrite f2 [4194304,4194304] 0 2024-04-26T12:06:54.217 INFO:tasks.workunit.client.0.smithi052.stdout:5/85: write f1 [2126181,54645] 0 2024-04-26T12:06:54.217 INFO:tasks.workunit.client.0.smithi052.stdout:8/17: dread - d0/f2 zero size 2024-04-26T12:06:54.218 INFO:tasks.workunit.client.0.smithi052.stdout:4/39: chown d3/c8 643573420 1 2024-04-26T12:06:54.218 INFO:tasks.workunit.client.0.smithi052.stdout:6/14: mknod c4 0 2024-04-26T12:06:54.220 INFO:tasks.workunit.client.0.smithi052.stdout:8/18: creat d0/f3 x:0 0 0 2024-04-26T12:06:54.220 INFO:tasks.workunit.client.0.smithi052.stdout:4/40: readlink l0 0 2024-04-26T12:06:54.221 INFO:tasks.workunit.client.0.smithi052.stdout:3/48: dread d2/f8 [0,4194304] 0 2024-04-26T12:06:54.221 INFO:tasks.workunit.client.0.smithi052.stdout:6/15: mknod c5 0 2024-04-26T12:06:54.222 INFO:tasks.workunit.client.0.smithi052.stdout:4/41: chown l0 128590 1 2024-04-26T12:06:54.223 INFO:tasks.workunit.client.0.smithi052.stdout:5/86: fdatasync db/f10 0 2024-04-26T12:06:54.223 INFO:tasks.workunit.client.0.smithi052.stdout:6/16: stat l3 0 2024-04-26T12:06:54.223 INFO:tasks.workunit.client.0.smithi052.stdout:8/19: dread - d0/f2 zero size 2024-04-26T12:06:54.223 INFO:tasks.workunit.client.0.smithi052.stdout:9/99: dwrite d3/db/d10/f18 [0,4194304] 0 2024-04-26T12:06:54.223 INFO:tasks.workunit.client.0.smithi052.stdout:2/84: dwrite d0/f12 [0,4194304] 0 2024-04-26T12:06:54.224 INFO:tasks.workunit.client.0.smithi052.stdout:3/49: rename d2/f8 to d2/ff 0 2024-04-26T12:06:54.225 INFO:tasks.workunit.client.0.smithi052.stdout:0/131: dwrite d0/d1/dd/f28 [0,4194304] 0 2024-04-26T12:06:54.225 INFO:tasks.workunit.client.0.smithi052.stdout:4/42: mknod d3/ce 0 2024-04-26T12:06:54.225 INFO:tasks.workunit.client.0.smithi052.stdout:6/17: rename c5 to c6 0 2024-04-26T12:06:54.225 INFO:tasks.workunit.client.0.smithi052.stdout:8/20: mkdir d0/d4 0 2024-04-26T12:06:54.226 INFO:tasks.workunit.client.0.smithi052.stdout:6/18: chown l3 81097192 1 2024-04-26T12:06:54.226 INFO:tasks.workunit.client.0.smithi052.stdout:9/100: chown d3/db/d10/l19 5358 1 2024-04-26T12:06:54.226 INFO:tasks.workunit.client.0.smithi052.stdout:6/19: readlink l3 0 2024-04-26T12:06:54.227 INFO:tasks.workunit.client.0.smithi052.stdout:5/87: creat db/f1f x:0 0 0 2024-04-26T12:06:54.227 INFO:tasks.workunit.client.0.smithi052.stdout:8/21: stat d0/f3 0 2024-04-26T12:06:54.227 INFO:tasks.workunit.client.0.smithi052.stdout:4/43: symlink d3/lf 0 2024-04-26T12:06:54.228 INFO:tasks.workunit.client.0.smithi052.stdout:3/50: rename d2/l3 to d2/d4/l10 0 2024-04-26T12:06:54.228 INFO:tasks.workunit.client.0.smithi052.stdout:4/44: readlink d3/lf 0 2024-04-26T12:06:54.228 INFO:tasks.workunit.client.0.smithi052.stdout:9/101: chown d3/db/d10/f18 934896 1 2024-04-26T12:06:54.228 INFO:tasks.workunit.client.0.smithi052.stdout:8/22: write d0/f2 [688177,122619] 0 2024-04-26T12:06:54.228 INFO:tasks.workunit.client.0.smithi052.stdout:8/23: readlink - no filename 2024-04-26T12:06:54.229 INFO:tasks.workunit.client.0.smithi052.stdout:8/24: readlink - no filename 2024-04-26T12:06:54.229 INFO:tasks.workunit.client.0.smithi052.stdout:0/132: chown d0/d1/d2c/c2d 7110858 1 2024-04-26T12:06:54.229 INFO:tasks.workunit.client.0.smithi052.stdout:1/74: dread d0/d2/f6 [4194304,4194304] 0 2024-04-26T12:06:54.229 INFO:tasks.workunit.client.0.smithi052.stdout:5/88: unlink db/l1b 0 2024-04-26T12:06:54.229 INFO:tasks.workunit.client.0.smithi052.stdout:4/45: write d3/fb [502201,9226] 0 2024-04-26T12:06:54.230 INFO:tasks.workunit.client.0.smithi052.stdout:3/51: chown d2/fa 303364566 1 2024-04-26T12:06:54.230 INFO:tasks.workunit.client.0.smithi052.stdout:9/102: symlink d3/db/l21 0 2024-04-26T12:06:54.231 INFO:tasks.workunit.client.0.smithi052.stdout:0/133: chown d0/d1/d11 31240 1 2024-04-26T12:06:54.231 INFO:tasks.workunit.client.0.smithi052.stdout:5/89: write db/f10 [899236,4832] 0 2024-04-26T12:06:54.231 INFO:tasks.workunit.client.0.smithi052.stdout:4/46: chown d3/c8 0 1 2024-04-26T12:06:54.232 INFO:tasks.workunit.client.0.smithi052.stdout:9/103: write d3/fd [113018,76144] 0 2024-04-26T12:06:54.233 INFO:tasks.workunit.client.0.smithi052.stdout:0/134: symlink d0/d26/l30 0 2024-04-26T12:06:54.234 INFO:tasks.workunit.client.0.smithi052.stdout:4/47: rename d3/fc to d3/f10 0 2024-04-26T12:06:54.235 INFO:tasks.workunit.client.0.smithi052.stdout:2/85: dwrite d0/fa [0,4194304] 0 2024-04-26T12:06:54.235 INFO:tasks.workunit.client.0.smithi052.stdout:6/20: dread f2 [0,4194304] 0 2024-04-26T12:06:54.235 INFO:tasks.workunit.client.0.smithi052.stdout:4/48: symlink d3/l11 0 2024-04-26T12:06:54.236 INFO:tasks.workunit.client.0.smithi052.stdout:5/90: link db/c15 db/dd/d18/c20 0 2024-04-26T12:06:54.236 INFO:tasks.workunit.client.0.smithi052.stdout:9/104: rename d3/c11 to d3/db/d13/c22 0 2024-04-26T12:06:54.236 INFO:tasks.workunit.client.0.smithi052.stdout:5/91: chown db 22227 1 2024-04-26T12:06:54.237 INFO:tasks.workunit.client.0.smithi052.stdout:0/135: link d0/d1/f24 d0/d1/d11/f31 0 2024-04-26T12:06:54.237 INFO:tasks.workunit.client.0.smithi052.stdout:6/21: write f2 [2748768,80197] 0 2024-04-26T12:06:54.237 INFO:tasks.workunit.client.0.smithi052.stdout:2/86: creat d0/f17 x:0 0 0 2024-04-26T12:06:54.237 INFO:tasks.workunit.client.0.smithi052.stdout:9/105: mkdir d3/d23 0 2024-04-26T12:06:54.238 INFO:tasks.workunit.client.0.smithi052.stdout:6/22: mknod c7 0 2024-04-26T12:06:54.238 INFO:tasks.workunit.client.0.smithi052.stdout:1/75: dread d0/d2/dd/f14 [0,4194304] 0 2024-04-26T12:06:54.238 INFO:tasks.workunit.client.0.smithi052.stdout:0/136: fdatasync d0/d1/f12 0 2024-04-26T12:06:54.239 INFO:tasks.workunit.client.0.smithi052.stdout:2/87: chown d0/d7/cd 39675851 1 2024-04-26T12:06:54.239 INFO:tasks.workunit.client.0.smithi052.stdout:9/106: mkdir d3/db/d24 0 2024-04-26T12:06:54.239 INFO:tasks.workunit.client.0.smithi052.stdout:6/23: mknod c8 0 2024-04-26T12:06:54.239 INFO:tasks.workunit.client.0.smithi052.stdout:4/49: rmdir d3 39 2024-04-26T12:06:54.240 INFO:tasks.workunit.client.0.smithi052.stdout:0/137: dread - d0/d1/f13 zero size 2024-04-26T12:06:54.240 INFO:tasks.workunit.client.0.smithi052.stdout:5/92: rename db/dd/ce to db/c21 0 2024-04-26T12:06:54.240 INFO:tasks.workunit.client.0.smithi052.stdout:9/107: write d3/fd [2732899,108920] 0 2024-04-26T12:06:54.240 INFO:tasks.workunit.client.0.smithi052.stdout:6/24: creat f9 x:0 0 0 2024-04-26T12:06:54.241 INFO:tasks.workunit.client.0.smithi052.stdout:4/50: dread - d3/f6 zero size 2024-04-26T12:06:54.241 INFO:tasks.workunit.client.0.smithi052.stdout:1/76: rmdir d0/d2/dd/d13/d15 0 2024-04-26T12:06:54.241 INFO:tasks.workunit.client.0.smithi052.stdout:8/25: dread d0/f2 [0,4194304] 0 2024-04-26T12:06:54.242 INFO:tasks.workunit.client.0.smithi052.stdout:5/93: dread db/dc/f12 [0,4194304] 0 2024-04-26T12:06:54.243 INFO:tasks.workunit.client.0.smithi052.stdout:4/51: mkdir d3/d12 0 2024-04-26T12:06:54.245 INFO:tasks.workunit.client.0.smithi052.stdout:1/77: creat d0/d2/de/df/f1a x:0 0 0 2024-04-26T12:06:54.245 INFO:tasks.workunit.client.0.smithi052.stdout:8/26: fdatasync d0/f1 0 2024-04-26T12:06:54.245 INFO:tasks.workunit.client.0.smithi052.stdout:4/52: truncate d3/f6 539638 0 2024-04-26T12:06:54.246 INFO:tasks.workunit.client.0.smithi052.stdout:5/94: unlink db/c21 0 2024-04-26T12:06:54.246 INFO:tasks.workunit.client.0.smithi052.stdout:6/25: getdents . 0 2024-04-26T12:06:54.246 INFO:tasks.workunit.client.0.smithi052.stdout:8/27: mkdir d0/d4/d5 0 2024-04-26T12:06:54.247 INFO:tasks.workunit.client.0.smithi052.stdout:0/138: dread d0/f3 [8388608,4194304] 0 2024-04-26T12:06:54.247 INFO:tasks.workunit.client.0.smithi052.stdout:1/78: write d0/d2/f18 [1709725,23449] 0 2024-04-26T12:06:54.247 INFO:tasks.workunit.client.0.smithi052.stdout:8/28: dread - d0/f3 zero size 2024-04-26T12:06:54.248 INFO:tasks.workunit.client.0.smithi052.stdout:6/26: write f9 [563335,43879] 0 2024-04-26T12:06:54.249 INFO:tasks.workunit.client.0.smithi052.stdout:2/88: dwrite d0/f5 [0,4194304] 0 2024-04-26T12:06:54.249 INFO:tasks.workunit.client.0.smithi052.stdout:4/53: link d3/f10 d3/d12/f13 0 2024-04-26T12:06:54.249 INFO:tasks.workunit.client.0.smithi052.stdout:5/95: write db/dc/f1d [205098,104036] 0 2024-04-26T12:06:54.250 INFO:tasks.workunit.client.0.smithi052.stdout:6/27: mkdir da 0 2024-04-26T12:06:54.250 INFO:tasks.workunit.client.0.smithi052.stdout:5/96: chown c8 1 1 2024-04-26T12:06:54.251 INFO:tasks.workunit.client.0.smithi052.stdout:9/108: dwrite d3/f7 [0,4194304] 0 2024-04-26T12:06:54.251 INFO:tasks.workunit.client.0.smithi052.stdout:8/29: mknod d0/d4/d5/c6 0 2024-04-26T12:06:54.252 INFO:tasks.workunit.client.0.smithi052.stdout:2/89: write d0/d7/fe [369179,91080] 0 2024-04-26T12:06:54.252 INFO:tasks.workunit.client.0.smithi052.stdout:0/139: truncate d0/d1/f12 11175141 0 2024-04-26T12:06:54.256 INFO:tasks.workunit.client.0.smithi052.stdout:8/30: link d0/f3 d0/d4/f7 0 2024-04-26T12:06:54.256 INFO:tasks.workunit.client.0.smithi052.stdout:2/90: mknod d0/d7/d16/c18 0 2024-04-26T12:06:54.256 INFO:tasks.workunit.client.0.smithi052.stdout:8/31: stat d0/d4/d5/c6 0 2024-04-26T12:06:54.256 INFO:tasks.workunit.client.0.smithi052.stdout:1/79: dread d0/d2/dd/f14 [0,4194304] 0 2024-04-26T12:06:54.257 INFO:tasks.workunit.client.0.smithi052.stdout:4/54: dwrite d3/fb [0,4194304] 0 2024-04-26T12:06:54.258 INFO:tasks.workunit.client.0.smithi052.stdout:1/80: creat d0/da/f1b x:0 0 0 2024-04-26T12:06:54.259 INFO:tasks.workunit.client.0.smithi052.stdout:9/109: dread d3/db/d10/f18 [0,4194304] 0 2024-04-26T12:06:54.259 INFO:tasks.workunit.client.0.smithi052.stdout:4/55: truncate d3/f10 969254 0 2024-04-26T12:06:54.259 INFO:tasks.workunit.client.0.smithi052.stdout:1/81: mkdir d0/d2/dd/d1c 0 2024-04-26T12:06:54.260 INFO:tasks.workunit.client.0.smithi052.stdout:9/110: symlink d3/d23/l25 0 2024-04-26T12:06:54.261 INFO:tasks.workunit.client.0.smithi052.stdout:9/111: fdatasync d3/db/d10/f18 0 2024-04-26T12:06:54.261 INFO:tasks.workunit.client.0.smithi052.stdout:1/82: mkdir d0/d2/dd/d1c/d1d 0 2024-04-26T12:06:54.262 INFO:tasks.workunit.client.0.smithi052.stdout:2/91: dwrite d0/f12 [0,4194304] 0 2024-04-26T12:06:54.262 INFO:tasks.workunit.client.0.smithi052.stdout:9/112: chown d3/db/d10 17 1 2024-04-26T12:06:54.263 INFO:tasks.workunit.client.0.smithi052.stdout:2/92: mknod d0/c19 0 2024-04-26T12:06:54.263 INFO:tasks.workunit.client.0.smithi052.stdout:5/97: link db/dc/c13 db/dd/d18/d1e/c22 0 2024-04-26T12:06:54.264 INFO:tasks.workunit.client.0.smithi052.stdout:5/98: mkdir db/d23 0 2024-04-26T12:06:54.265 INFO:tasks.workunit.client.0.smithi052.stdout:5/99: chown db/dc/f1d 5 1 2024-04-26T12:06:54.265 INFO:tasks.workunit.client.0.smithi052.stdout:6/28: truncate f9 12601 0 2024-04-26T12:06:54.266 INFO:tasks.workunit.client.0.smithi052.stdout:5/100: stat c8 0 2024-04-26T12:06:54.267 INFO:tasks.workunit.client.0.smithi052.stdout:8/32: rmdir d0 39 2024-04-26T12:06:54.267 INFO:tasks.workunit.client.0.smithi052.stdout:5/101: read f1 [4760913,74145] 0 2024-04-26T12:06:54.267 INFO:tasks.workunit.client.0.smithi052.stdout:8/33: chown d0/d4/d5 3920211 1 2024-04-26T12:06:54.267 INFO:tasks.workunit.client.0.smithi052.stdout:9/113: dread d3/fd [0,4194304] 0 2024-04-26T12:06:54.268 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:54.266+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:54.268 INFO:tasks.workunit.client.0.smithi052.stdout:5/102: write db/f10 [908627,34323] 0 2024-04-26T12:06:54.268 INFO:tasks.workunit.client.0.smithi052.stdout:8/34: unlink d0/f1 0 2024-04-26T12:06:54.268 INFO:tasks.workunit.client.0.smithi052.stdout:9/114: stat d3/db/c1e 0 2024-04-26T12:06:54.268 INFO:tasks.workunit.client.0.smithi052.stdout:1/83: dwrite d0/d2/f6 [0,4194304] 0 2024-04-26T12:06:54.269 INFO:tasks.workunit.client.0.smithi052.stdout:9/115: symlink d3/db/l26 0 2024-04-26T12:06:54.269 INFO:tasks.workunit.client.0.smithi052.stdout:1/84: mkdir d0/d1e 0 2024-04-26T12:06:54.269 INFO:tasks.workunit.client.0.smithi052.stdout:5/103: write db/f1f [598478,57760] 0 2024-04-26T12:06:54.270 INFO:tasks.workunit.client.0.smithi052.stdout:8/35: rename d0/f3 to d0/d4/d5/f8 0 2024-04-26T12:06:54.270 INFO:tasks.workunit.client.0.smithi052.stdout:1/85: rename d0 to d0/d2/d1f 22 2024-04-26T12:06:54.270 INFO:tasks.workunit.client.0.smithi052.stdout:9/116: symlink d3/d23/l27 0 2024-04-26T12:06:54.270 INFO:tasks.workunit.client.0.smithi052.stdout:1/86: creat d0/f20 x:0 0 0 2024-04-26T12:06:54.270 INFO:tasks.workunit.client.0.smithi052.stdout:9/117: mknod d3/db/d10/c28 0 2024-04-26T12:06:54.271 INFO:tasks.workunit.client.0.smithi052.stdout:1/87: write d0/d2/de/df/f1a [115094,30623] 0 2024-04-26T12:06:54.272 INFO:tasks.workunit.client.0.smithi052.stdout:9/118: rename d3/ff to d3/db/d13/f29 0 2024-04-26T12:06:54.272 INFO:tasks.workunit.client.0.smithi052.stdout:4/56: truncate d3/fb 267446 0 2024-04-26T12:06:54.273 INFO:tasks.workunit.client.0.smithi052.stdout:9/119: stat d3/db/d10/l19 0 2024-04-26T12:06:54.273 INFO:tasks.workunit.client.0.smithi052.stdout:1/88: mknod d0/d2/c21 0 2024-04-26T12:06:54.274 INFO:tasks.workunit.client.0.smithi052.stdout:9/120: fdatasync d3/db/d13/f29 0 2024-04-26T12:06:54.274 INFO:tasks.workunit.client.0.smithi052.stdout:1/89: fdatasync d0/da/f1b 0 2024-04-26T12:06:54.275 INFO:tasks.workunit.client.0.smithi052.stdout:4/57: dread d3/f10 [0,4194304] 0 2024-04-26T12:06:54.275 INFO:tasks.workunit.client.0.smithi052.stdout:5/104: dwrite db/dc/f1d [0,4194304] 0 2024-04-26T12:06:54.275 INFO:tasks.workunit.client.0.smithi052.stdout:9/121: symlink d3/d1b/l2a 0 2024-04-26T12:06:54.276 INFO:tasks.workunit.client.0.smithi052.stdout:4/58: rename f2 to d3/f14 0 2024-04-26T12:06:54.276 INFO:tasks.workunit.client.0.smithi052.stdout:5/105: write db/f10 [32991,50151] 0 2024-04-26T12:06:54.276 INFO:tasks.workunit.client.0.smithi052.stdout:1/90: rmdir d0/d2/dd/d13 0 2024-04-26T12:06:54.276 INFO:tasks.workunit.client.0.smithi052.stdout:2/93: truncate d0/f12 3232124 0 2024-04-26T12:06:54.277 INFO:tasks.workunit.client.0.smithi052.stdout:4/59: stat d3/ce 0 2024-04-26T12:06:54.277 INFO:tasks.workunit.client.0.smithi052.stdout:9/122: truncate d3/f7 5585486 0 2024-04-26T12:06:54.277 INFO:tasks.workunit.client.0.smithi052.stdout:4/60: mkdir d3/d15 0 2024-04-26T12:06:54.278 INFO:tasks.workunit.client.0.smithi052.stdout:5/106: creat db/d23/f24 x:0 0 0 2024-04-26T12:06:54.278 INFO:tasks.workunit.client.0.smithi052.stdout:1/91: truncate d0/da/f1b 44648 0 2024-04-26T12:06:54.278 INFO:tasks.workunit.client.0.smithi052.stdout:2/94: truncate d0/d7/fe 4260085 0 2024-04-26T12:06:54.279 INFO:tasks.workunit.client.0.smithi052.stdout:4/61: link d3/f9 d3/f16 0 2024-04-26T12:06:54.280 INFO:tasks.workunit.client.0.smithi052.stdout:1/92: symlink d0/d2/l22 0 2024-04-26T12:06:54.280 INFO:tasks.workunit.client.0.smithi052.stdout:2/95: write d0/d7/f10 [726766,18954] 0 2024-04-26T12:06:54.281 INFO:tasks.workunit.client.0.smithi052.stdout:2/96: dread - d0/f17 zero size 2024-04-26T12:06:54.281 INFO:tasks.workunit.client.0.smithi052.stdout:8/36: dwrite d0/d4/f7 [0,4194304] 0 2024-04-26T12:06:54.281 INFO:tasks.workunit.client.0.smithi052.stdout:1/93: mkdir d0/d2/dd/d1c/d1d/d23 0 2024-04-26T12:06:54.282 INFO:tasks.workunit.client.0.smithi052.stdout:2/97: creat d0/d7/d16/f1a x:0 0 0 2024-04-26T12:06:54.282 INFO:tasks.workunit.client.0.smithi052.stdout:9/123: dread d3/db/d10/f18 [0,4194304] 0 2024-04-26T12:06:54.283 INFO:tasks.workunit.client.0.smithi052.stdout:8/37: truncate d0/f2 1837383 0 2024-04-26T12:06:54.283 INFO:tasks.workunit.client.0.smithi052.stdout:1/94: creat d0/d2/f24 x:0 0 0 2024-04-26T12:06:54.283 INFO:tasks.workunit.client.0.smithi052.stdout:2/98: symlink d0/d7/l1b 0 2024-04-26T12:06:54.284 INFO:tasks.workunit.client.0.smithi052.stdout:2/99: creat d0/d7/d16/f1c x:0 0 0 2024-04-26T12:06:54.284 INFO:tasks.workunit.client.0.smithi052.stdout:9/124: truncate d3/db/d13/f29 8046278 0 2024-04-26T12:06:54.285 INFO:tasks.workunit.client.0.smithi052.stdout:9/125: fsync d3/db/f20 0 2024-04-26T12:06:54.286 INFO:tasks.workunit.client.0.smithi052.stdout:9/126: chown d3/db/d10/c28 2 1 2024-04-26T12:06:54.287 INFO:tasks.workunit.client.0.smithi052.stdout:9/127: mkdir d3/db/d2b 0 2024-04-26T12:06:54.288 INFO:tasks.workunit.client.0.smithi052.stdout:8/38: dwrite d0/d4/d5/f8 [0,4194304] 0 2024-04-26T12:06:54.288 INFO:tasks.workunit.client.0.smithi052.stdout:5/107: rename db/d23 to db/dd/d18/d1e/d25 0 2024-04-26T12:06:54.288 INFO:tasks.workunit.client.0.smithi052.stdout:9/128: write d3/db/d10/f1c [4700215,20711] 0 2024-04-26T12:06:54.289 INFO:tasks.workunit.client.0.smithi052.stdout:4/62: rename d3/f6 to d3/d15/f17 0 2024-04-26T12:06:54.290 INFO:tasks.workunit.client.0.smithi052.stdout:7/27: sync 2024-04-26T12:06:54.290 INFO:tasks.workunit.client.0.smithi052.stdout:0/140: sync 2024-04-26T12:06:54.290 INFO:tasks.workunit.client.0.smithi052.stdout:8/39: symlink d0/d4/l9 0 2024-04-26T12:06:54.290 INFO:tasks.workunit.client.0.smithi052.stdout:1/95: dread d0/d2/de/df/f1a [0,4194304] 0 2024-04-26T12:06:54.290 INFO:tasks.workunit.client.0.smithi052.stdout:8/40: chown d0 7666773 1 2024-04-26T12:06:54.291 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:54.291 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:54.292 INFO:tasks.workunit.client.0.smithi052.stdout:9/129: write d3/fd [1505809,103824] 0 2024-04-26T12:06:54.292 INFO:tasks.workunit.client.0.smithi052.stdout:4/63: chown d3/f14 49144534 1 2024-04-26T12:06:54.292 INFO:tasks.workunit.client.0.smithi052.stdout:5/108: creat db/f26 x:0 0 0 2024-04-26T12:06:54.292 INFO:tasks.workunit.client.0.smithi052.stdout:7/28: rmdir d1 39 2024-04-26T12:06:54.293 INFO:tasks.workunit.client.0.smithi052.stdout:8/41: mknod d0/d4/d5/ca 0 2024-04-26T12:06:54.293 INFO:tasks.workunit.client.0.smithi052.stdout:4/64: fsync d3/f9 0 2024-04-26T12:06:54.293 INFO:tasks.workunit.client.0.smithi052.stdout:0/141: mkdir d0/d1/d1a/d2a/d32 0 2024-04-26T12:06:54.293 INFO:tasks.workunit.client.0.smithi052.stdout:5/109: chown db/c16 6751 1 2024-04-26T12:06:54.293 INFO:tasks.workunit.client.0.smithi052.stdout:2/100: dwrite d0/f12 [0,4194304] 0 2024-04-26T12:06:54.293 INFO:tasks.workunit.client.0.smithi052.stdout:9/130: creat d3/db/d24/f2c x:0 0 0 2024-04-26T12:06:54.294 INFO:tasks.workunit.client.0.smithi052.stdout:7/29: chown d1/l2 823 1 2024-04-26T12:06:54.294 INFO:tasks.workunit.client.0.smithi052.stdout:2/101: fdatasync d0/d7/fe 0 2024-04-26T12:06:54.294 INFO:tasks.workunit.client.0.smithi052.stdout:5/110: creat db/dd/f27 x:0 0 0 2024-04-26T12:06:54.294 INFO:tasks.workunit.client.0.smithi052.stdout:4/65: creat d3/d12/f18 x:0 0 0 2024-04-26T12:06:54.295 INFO:tasks.workunit.client.0.smithi052.stdout:0/142: symlink d0/d1/d1a/d2a/d32/l33 0 2024-04-26T12:06:54.295 INFO:tasks.workunit.client.0.smithi052.stdout:9/131: chown d3/d23/l25 268 1 2024-04-26T12:06:54.295 INFO:tasks.workunit.client.0.smithi052.stdout:7/30: link d1/f7 d1/f8 0 2024-04-26T12:06:54.297 INFO:tasks.workunit.client.0.smithi052.stdout:4/66: truncate d3/d15/f17 1229009 0 2024-04-26T12:06:54.297 INFO:tasks.workunit.client.0.smithi052.stdout:7/31: creat d1/f9 x:0 0 0 2024-04-26T12:06:54.297 INFO:tasks.workunit.client.0.smithi052.stdout:0/143: chown d0/d1/d11/f31 1 1 2024-04-26T12:06:54.297 INFO:tasks.workunit.client.0.smithi052.stdout:5/111: write db/f10 [846654,6262] 0 2024-04-26T12:06:54.298 INFO:tasks.workunit.client.0.smithi052.stdout:0/144: fsync d0/fe 0 2024-04-26T12:06:54.298 INFO:tasks.workunit.client.0.smithi052.stdout:7/32: creat d1/fa x:0 0 0 2024-04-26T12:06:54.298 INFO:tasks.workunit.client.0.smithi052.stdout:4/67: creat d3/d12/f19 x:0 0 0 2024-04-26T12:06:54.298 INFO:tasks.workunit.client.0.smithi052.stdout:5/112: mknod db/dd/c28 0 2024-04-26T12:06:54.298 INFO:tasks.workunit.client.0.smithi052.stdout:9/132: rename d3/db/c1e to d3/db/d10/c2d 0 2024-04-26T12:06:54.300 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:54.301 INFO:tasks.workunit.client.0.smithi052.stdout:0/145: mknod d0/d1/d1a/c34 0 2024-04-26T12:06:54.301 INFO:tasks.workunit.client.0.smithi052.stdout:7/33: write d1/f7 [1025152,95826] 0 2024-04-26T12:06:54.301 INFO:tasks.workunit.client.0.smithi052.stdout:5/113: mkdir db/dc/d29 0 2024-04-26T12:06:54.302 INFO:tasks.workunit.client.0.smithi052.stdout:8/42: dwrite d0/d4/d5/f8 [0,4194304] 0 2024-04-26T12:06:54.302 INFO:tasks.workunit.client.0.smithi052.stdout:4/68: write d3/f16 [814448,51151] 0 2024-04-26T12:06:54.302 INFO:tasks.workunit.client.0.smithi052.stdout:9/133: mkdir d3/db/d10/d2e 0 2024-04-26T12:06:54.302 INFO:tasks.workunit.client.0.smithi052.stdout:7/34: read d1/f6 [1857630,39350] 0 2024-04-26T12:06:54.302 INFO:tasks.workunit.client.0.smithi052.stdout:4/69: write d3/f16 [1742024,101625] 0 2024-04-26T12:06:54.302 INFO:tasks.workunit.client.0.smithi052.stdout:0/146: unlink d0/d1/dd/f1e 0 2024-04-26T12:06:54.303 INFO:tasks.workunit.client.0.smithi052.stdout:4/70: dread d3/d12/f13 [0,4194304] 0 2024-04-26T12:06:54.304 INFO:tasks.workunit.client.0.smithi052.stdout:7/35: creat d1/fb x:0 0 0 2024-04-26T12:06:54.305 INFO:tasks.workunit.client.0.smithi052.stdout:5/114: dread db/dc/f1d [0,4194304] 0 2024-04-26T12:06:54.305 INFO:tasks.workunit.client.0.smithi052.stdout:0/147: write d0/f3 [8366154,29851] 0 2024-04-26T12:06:54.306 INFO:tasks.workunit.client.0.smithi052.stdout:7/36: symlink d1/lc 0 2024-04-26T12:06:54.306 INFO:tasks.workunit.client.0.smithi052.stdout:9/134: rmdir d3/db 39 2024-04-26T12:06:54.306 INFO:tasks.workunit.client.0.smithi052.stdout:4/71: creat d3/d12/f1a x:0 0 0 2024-04-26T12:06:54.306 INFO:tasks.workunit.client.0.smithi052.stdout:0/148: mknod d0/d1/d2c/c35 0 2024-04-26T12:06:54.307 INFO:tasks.workunit.client.0.smithi052.stdout:4/72: mknod d3/d12/c1b 0 2024-04-26T12:06:54.308 INFO:tasks.workunit.client.0.smithi052.stdout:6/29: sync 2024-04-26T12:06:54.308 INFO:tasks.workunit.client.0.smithi052.stdout:3/52: sync 2024-04-26T12:06:54.308 INFO:tasks.workunit.client.0.smithi052.stdout:9/135: unlink d3/db/d10/l19 0 2024-04-26T12:06:54.308 INFO:tasks.workunit.client.0.smithi052.stdout:1/96: sync 2024-04-26T12:06:54.308 INFO:tasks.workunit.client.0.smithi052.stdout:2/102: sync 2024-04-26T12:06:54.309 INFO:tasks.workunit.client.0.smithi052.stdout:6/30: stat c4 0 2024-04-26T12:06:54.309 INFO:tasks.workunit.client.0.smithi052.stdout:8/43: dwrite d0/f2 [0,4194304] 0 2024-04-26T12:06:54.309 INFO:tasks.workunit.client.0.smithi052.stdout:4/73: write d3/fd [91286,3158] 0 2024-04-26T12:06:54.315 INFO:tasks.workunit.client.0.smithi052.stdout:4/74: creat d3/f1c x:0 0 0 2024-04-26T12:06:54.316 INFO:tasks.workunit.client.0.smithi052.stdout:6/31: rename c8 to da/cb 0 2024-04-26T12:06:54.316 INFO:tasks.workunit.client.0.smithi052.stdout:3/53: rename d2/d4 to d2/d4/dc/dd/d11 22 2024-04-26T12:06:54.316 INFO:tasks.workunit.client.0.smithi052.stdout:2/103: creat d0/f1d x:0 0 0 2024-04-26T12:06:54.316 INFO:tasks.workunit.client.0.smithi052.stdout:0/149: truncate d0/d1/f24 102852 0 2024-04-26T12:06:54.318 INFO:tasks.workunit.client.0.smithi052.stdout:4/75: chown d3/l11 119167455 1 2024-04-26T12:06:54.318 INFO:tasks.workunit.client.0.smithi052.stdout:7/37: dwrite d1/fb [0,4194304] 0 2024-04-26T12:06:54.318 INFO:tasks.workunit.client.0.smithi052.stdout:2/104: dread - d0/d7/d16/f1c zero size 2024-04-26T12:06:54.318 INFO:tasks.workunit.client.0.smithi052.stdout:0/150: mkdir d0/d26/d36 0 2024-04-26T12:06:54.318 INFO:tasks.workunit.client.0.smithi052.stdout:1/97: getdents d0/d2/dd/d1c/d1d/d23 0 2024-04-26T12:06:54.318 INFO:tasks.workunit.client.0.smithi052.stdout:5/115: dwrite db/dd/d18/d1e/d25/f24 [0,4194304] 0 2024-04-26T12:06:54.318 INFO:tasks.workunit.client.0.smithi052.stdout:3/54: mkdir d2/d4/dc/d12 0 2024-04-26T12:06:54.319 INFO:tasks.workunit.client.0.smithi052.stdout:4/76: read d3/f16 [484351,13482] 0 2024-04-26T12:06:54.319 INFO:tasks.workunit.client.0.smithi052.stdout:7/38: dread - d1/fa zero size 2024-04-26T12:06:54.319 INFO:tasks.workunit.client.0.smithi052.stdout:0/151: read d0/f3 [10939685,73549] 0 2024-04-26T12:06:54.319 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:06:54.320 INFO:tasks.workunit.client.0.smithi052.stdout:8/44: dread d0/f2 [0,4194304] 0 2024-04-26T12:06:54.320 INFO:tasks.workunit.client.0.smithi052.stdout:7/39: creat d1/fd x:0 0 0 2024-04-26T12:06:54.320 INFO:tasks.workunit.client.0.smithi052.stdout:4/77: dread - d3/d12/f18 zero size 2024-04-26T12:06:54.325 INFO:tasks.workunit.client.0.smithi052.stdout:0/152: creat d0/d1/d1a/f37 x:0 0 0 2024-04-26T12:06:54.325 INFO:tasks.workunit.client.0.smithi052.stdout:5/116: rename db/dd/d18 to db/dd/d18/d1e/d2a 22 2024-04-26T12:06:54.325 INFO:tasks.workunit.client.0.smithi052.stdout:9/136: truncate d3/fd 1217450 0 2024-04-26T12:06:54.325 INFO:tasks.workunit.client.0.smithi052.stdout:5/117: chown db/f10 0 1 2024-04-26T12:06:54.325 INFO:tasks.workunit.client.0.smithi052.stdout:7/40: mknod d1/ce 0 2024-04-26T12:06:54.325 INFO:tasks.workunit.client.0.smithi052.stdout:8/45: mkdir d0/d4/d5/db 0 2024-04-26T12:06:54.327 INFO:tasks.workunit.client.0.smithi052.stdout:5/118: truncate db/f26 488489 0 2024-04-26T12:06:54.328 INFO:tasks.workunit.client.0.smithi052.stdout:2/105: dread d0/f12 [0,4194304] 0 2024-04-26T12:06:54.329 INFO:tasks.workunit.client.0.smithi052.stdout:7/41: creat d1/ff x:0 0 0 2024-04-26T12:06:54.330 INFO:tasks.workunit.client.0.smithi052.stdout:4/78: getdents d3/d15 0 2024-04-26T12:06:54.331 INFO:tasks.workunit.client.0.smithi052.stdout:9/137: write d3/db/d10/f1c [4117625,81795] 0 2024-04-26T12:06:54.334 INFO:tasks.workunit.client.0.smithi052.stdout:7/42: fdatasync d1/fa 0 2024-04-26T12:06:54.334 INFO:tasks.workunit.client.0.smithi052.stdout:2/106: creat d0/d7/d16/f1e x:0 0 0 2024-04-26T12:06:54.335 INFO:tasks.workunit.client.0.smithi052.stdout:3/55: dwrite d2/f7 [0,4194304] 0 2024-04-26T12:06:54.336 INFO:tasks.workunit.client.0.smithi052.stdout:0/153: dread d0/fe [0,4194304] 0 2024-04-26T12:06:54.337 INFO:tasks.workunit.client.0.smithi052.stdout:6/32: dwrite f9 [0,4194304] 0 2024-04-26T12:06:54.338 INFO:tasks.workunit.client.0.smithi052.stdout:4/79: symlink d3/l1d 0 2024-04-26T12:06:54.339 INFO:tasks.workunit.client.0.smithi052.stdout:1/98: dwrite d0/d2/f6 [0,4194304] 0 2024-04-26T12:06:54.339 INFO:tasks.workunit.client.0.smithi052.stdout:2/107: mknod d0/d7/c1f 0 2024-04-26T12:06:54.343 INFO:tasks.workunit.client.0.smithi052.stdout:3/56: chown d2/ff 31042 1 2024-04-26T12:06:54.344 INFO:tasks.workunit.client.0.smithi052.stdout:2/108: readlink d0/d7/lf 0 2024-04-26T12:06:54.344 INFO:tasks.workunit.client.0.smithi052.stdout:4/80: rmdir d3/d15 39 2024-04-26T12:06:54.344 INFO:tasks.workunit.client.0.smithi052.stdout:5/119: dwrite db/f1f [0,4194304] 0 2024-04-26T12:06:54.345 INFO:tasks.workunit.client.0.smithi052.stdout:8/46: dread d0/d4/d5/f8 [0,4194304] 0 2024-04-26T12:06:54.346 INFO:tasks.workunit.client.0.smithi052.stdout:0/154: getdents d0/d1/d1a/d20 0 2024-04-26T12:06:54.346 INFO:tasks.workunit.client.0.smithi052.stdout:3/57: rename d2/d4/dc/d12 to d2/d4/dc/d12/d13 22 2024-04-26T12:06:54.346 INFO:tasks.workunit.client.0.smithi052.stdout:5/120: symlink db/l2b 0 2024-04-26T12:06:54.347 INFO:tasks.workunit.client.0.smithi052.stdout:1/99: write d0/d2/f10 [1126911,87597] 0 2024-04-26T12:06:54.348 INFO:tasks.workunit.client.0.smithi052.stdout:8/47: mkdir d0/d4/dc 0 2024-04-26T12:06:54.348 INFO:tasks.workunit.client.0.smithi052.stdout:5/121: chown db/dc/d29 61 1 2024-04-26T12:06:54.349 INFO:tasks.workunit.client.0.smithi052.stdout:4/81: link d3/d12/f19 d3/d12/f1e 0 2024-04-26T12:06:54.349 INFO:tasks.workunit.client.0.smithi052.stdout:3/58: chown d2/c9 8257 1 2024-04-26T12:06:54.349 INFO:tasks.workunit.client.0.smithi052.stdout:7/43: truncate d1/f7 853799 0 2024-04-26T12:06:54.349 INFO:tasks.workunit.client.0.smithi052.stdout:4/82: stat d3/lf 0 2024-04-26T12:06:54.349 INFO:tasks.workunit.client.0.smithi052.stdout:6/33: truncate f2 3015971 0 2024-04-26T12:06:54.349 INFO:tasks.workunit.client.0.smithi052.stdout:9/138: dread d3/db/d10/f1c [0,4194304] 0 2024-04-26T12:06:54.349 INFO:tasks.workunit.client.0.smithi052.stdout:7/44: dread - d1/ff zero size 2024-04-26T12:06:54.349 INFO:tasks.workunit.client.0.smithi052.stdout:1/100: creat d0/d2/dd/d1c/d1d/f25 x:0 0 0 2024-04-26T12:06:54.350 INFO:tasks.workunit.client.0.smithi052.stdout:8/48: unlink d0/d4/d5/ca 0 2024-04-26T12:06:54.351 INFO:tasks.workunit.client.0.smithi052.stdout:6/34: write f9 [2108533,100888] 0 2024-04-26T12:06:54.351 INFO:tasks.workunit.client.0.smithi052.stdout:0/155: link d0/d1/c14 d0/d26/c38 0 2024-04-26T12:06:54.351 INFO:tasks.workunit.client.0.smithi052.stdout:7/45: creat d1/f10 x:0 0 0 2024-04-26T12:06:54.352 INFO:tasks.workunit.client.0.smithi052.stdout:0/156: stat d0 0 2024-04-26T12:06:54.352 INFO:tasks.workunit.client.0.smithi052.stdout:4/83: truncate d3/d12/f1e 110769 0 2024-04-26T12:06:54.353 INFO:tasks.workunit.client.0.smithi052.stdout:9/139: stat d3/db/d10/c2d 0 2024-04-26T12:06:54.353 INFO:tasks.workunit.client.0.smithi052.stdout:2/109: dread d0/fa [0,4194304] 0 2024-04-26T12:06:54.355 INFO:tasks.workunit.client.0.smithi052.stdout:7/46: symlink d1/l11 0 2024-04-26T12:06:54.356 INFO:tasks.workunit.client.0.smithi052.stdout:2/110: stat d0/d7/fe 0 2024-04-26T12:06:54.356 INFO:tasks.workunit.client.0.smithi052.stdout:1/101: dread d0/d2/f10 [0,4194304] 0 2024-04-26T12:06:54.357 INFO:tasks.workunit.client.0.smithi052.stdout:0/157: truncate d0/d1/dd/f19 805939 0 2024-04-26T12:06:54.357 INFO:tasks.workunit.client.0.smithi052.stdout:7/47: readlink d1/lc 0 2024-04-26T12:06:54.357 INFO:tasks.workunit.client.0.smithi052.stdout:4/84: mkdir d3/d1f 0 2024-04-26T12:06:54.358 INFO:tasks.workunit.client.0.smithi052.stdout:2/111: mknod d0/d7/d16/c20 0 2024-04-26T12:06:54.359 INFO:tasks.workunit.client.0.smithi052.stdout:6/35: read f2 [1355071,112591] 0 2024-04-26T12:06:54.359 INFO:tasks.workunit.client.0.smithi052.stdout:5/122: dwrite f1 [4194304,4194304] 0 2024-04-26T12:06:54.360 INFO:tasks.workunit.client.0.smithi052.stdout:1/102: creat d0/d2/dd/f26 x:0 0 0 2024-04-26T12:06:54.360 INFO:tasks.workunit.client.0.smithi052.stdout:2/112: readlink d0/d7/lf 0 2024-04-26T12:06:54.360 INFO:tasks.workunit.client.0.smithi052.stdout:3/59: dwrite d2/fa [0,4194304] 0 2024-04-26T12:06:54.361 INFO:tasks.workunit.client.0.smithi052.stdout:7/48: chown d1/f6 404 1 2024-04-26T12:06:54.361 INFO:tasks.workunit.client.0.smithi052.stdout:6/36: chown da/cb 3 1 2024-04-26T12:06:54.361 INFO:tasks.workunit.client.0.smithi052.stdout:4/85: creat d3/d12/f20 x:0 0 0 2024-04-26T12:06:54.362 INFO:tasks.workunit.client.0.smithi052.stdout:8/49: dread d0/d4/d5/f8 [0,4194304] 0 2024-04-26T12:06:54.364 INFO:tasks.workunit.client.0.smithi052.stdout:4/86: fsync d3/f10 0 2024-04-26T12:06:54.364 INFO:tasks.workunit.client.0.smithi052.stdout:7/49: stat d1/f8 0 2024-04-26T12:06:54.365 INFO:tasks.workunit.client.0.smithi052.stdout:1/103: creat d0/d2/de/f27 x:0 0 0 2024-04-26T12:06:54.366 INFO:tasks.workunit.client.0.smithi052.stdout:7/50: creat d1/f12 x:0 0 0 2024-04-26T12:06:54.366 INFO:tasks.workunit.client.0.smithi052.stdout:2/113: creat d0/f21 x:0 0 0 2024-04-26T12:06:54.371 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:54.366+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:54.373 INFO:tasks.workunit.client.0.smithi052.stdout:4/87: mkdir d3/d1f/d21 0 2024-04-26T12:06:54.373 INFO:tasks.workunit.client.0.smithi052.stdout:6/37: dread f2 [0,4194304] 0 2024-04-26T12:06:54.373 INFO:tasks.workunit.client.0.smithi052.stdout:7/51: mknod d1/c13 0 2024-04-26T12:06:54.373 INFO:tasks.workunit.client.0.smithi052.stdout:4/88: chown d3/d1f/d21 40 1 2024-04-26T12:06:54.373 INFO:tasks.workunit.client.0.smithi052.stdout:0/158: dwrite d0/d1/f6 [0,4194304] 0 2024-04-26T12:06:54.373 INFO:tasks.workunit.client.0.smithi052.stdout:5/123: getdents db/dd/d18 0 2024-04-26T12:06:54.373 INFO:tasks.workunit.client.0.smithi052.stdout:1/104: creat d0/d1e/f28 x:0 0 0 2024-04-26T12:06:54.373 INFO:tasks.workunit.client.0.smithi052.stdout:2/114: write d0/d7/d16/f1a [489088,127279] 0 2024-04-26T12:06:54.374 INFO:tasks.workunit.client.0.smithi052.stdout:4/89: mkdir d3/d22 0 2024-04-26T12:06:54.375 INFO:tasks.workunit.client.0.smithi052.stdout:1/105: unlink d0/da/f1b 0 2024-04-26T12:06:54.375 INFO:tasks.workunit.client.0.smithi052.stdout:6/38: truncate f2 2665254 0 2024-04-26T12:06:54.376 INFO:tasks.workunit.client.0.smithi052.stdout:2/115: mkdir d0/d7/d22 0 2024-04-26T12:06:54.376 INFO:tasks.workunit.client.0.smithi052.stdout:3/60: dwrite d2/fb [0,4194304] 0 2024-04-26T12:06:54.376 INFO:tasks.workunit.client.0.smithi052.stdout:5/124: symlink db/dc/d29/l2c 0 2024-04-26T12:06:54.376 INFO:tasks.workunit.client.0.smithi052.stdout:8/50: dread d0/d4/d5/f8 [0,4194304] 0 2024-04-26T12:06:54.377 INFO:tasks.workunit.client.0.smithi052.stdout:6/39: mknod da/cc 0 2024-04-26T12:06:54.377 INFO:tasks.workunit.client.0.smithi052.stdout:4/90: creat d3/d22/f23 x:0 0 0 2024-04-26T12:06:54.378 INFO:tasks.workunit.client.0.smithi052.stdout:2/116: chown d0/f6 2892397 1 2024-04-26T12:06:54.378 INFO:tasks.workunit.client.0.smithi052.stdout:8/51: unlink d0/d4/f7 0 2024-04-26T12:06:54.379 INFO:tasks.workunit.client.0.smithi052.stdout:1/106: rename d0/d2/dd/f26 to d0/d1e/f29 0 2024-04-26T12:06:54.380 INFO:tasks.workunit.client.0.smithi052.stdout:0/159: dread d0/f9 [4194304,4194304] 0 2024-04-26T12:06:54.381 INFO:tasks.workunit.client.0.smithi052.stdout:9/140: sync 2024-04-26T12:06:54.381 INFO:tasks.workunit.client.0.smithi052.stdout:7/52: dwrite d1/f6 [0,4194304] 0 2024-04-26T12:06:54.381 INFO:tasks.workunit.client.0.smithi052.stdout:1/107: chown d0/d2/f10 36131003 1 2024-04-26T12:06:54.383 INFO:tasks.workunit.client.0.smithi052.stdout:0/160: fdatasync d0/d1/d11/f16 0 2024-04-26T12:06:54.387 INFO:tasks.workunit.client.0.smithi052.stdout:7/53: write d1/f7 [1610901,13781] 0 2024-04-26T12:06:54.387 INFO:tasks.workunit.client.0.smithi052.stdout:9/141: creat d3/db/d2b/f2f x:0 0 0 2024-04-26T12:06:54.387 INFO:tasks.workunit.client.0.smithi052.stdout:1/108: chown d0/d2/c21 13 1 2024-04-26T12:06:54.387 INFO:tasks.workunit.client.0.smithi052.stdout:3/61: dread d2/fa [0,4194304] 0 2024-04-26T12:06:54.388 INFO:tasks.workunit.client.0.smithi052.stdout:1/109: readlink d0/d2/l22 0 2024-04-26T12:06:54.389 INFO:tasks.workunit.client.0.smithi052.stdout:0/161: write d0/d1/dd/f19 [1242383,129055] 0 2024-04-26T12:06:54.389 INFO:tasks.workunit.client.0.smithi052.stdout:7/54: chown d1/fd 11646 1 2024-04-26T12:06:54.389 INFO:tasks.workunit.client.0.smithi052.stdout:3/62: chown d2/d4 0 1 2024-04-26T12:06:54.390 INFO:tasks.workunit.client.0.smithi052.stdout:9/142: dread - d3/db/d24/f2c zero size 2024-04-26T12:06:54.390 INFO:tasks.workunit.client.0.smithi052.stdout:2/117: dwrite d0/d7/f10 [0,4194304] 0 2024-04-26T12:06:54.391 INFO:tasks.workunit.client.0.smithi052.stdout:6/40: dread f2 [0,4194304] 0 2024-04-26T12:06:54.392 INFO:tasks.workunit.client.0.smithi052.stdout:3/63: rename d2 to d2/d4/dc/dd/d14 22 2024-04-26T12:06:54.393 INFO:tasks.workunit.client.0.smithi052.stdout:8/52: dwrite d0/d4/d5/f8 [0,4194304] 0 2024-04-26T12:06:54.394 INFO:tasks.workunit.client.0.smithi052.stdout:4/91: dwrite d3/f10 [0,4194304] 0 2024-04-26T12:06:54.394 INFO:tasks.workunit.client.0.smithi052.stdout:1/110: link d0/d1e/f28 d0/d2/f2a 0 2024-04-26T12:06:54.394 INFO:tasks.workunit.client.0.smithi052.stdout:6/41: creat da/fd x:0 0 0 2024-04-26T12:06:54.394 INFO:tasks.workunit.client.0.smithi052.stdout:8/53: stat d0/f2 0 2024-04-26T12:06:54.394 INFO:tasks.workunit.client.0.smithi052.stdout:0/162: dread - d0/d1/d1a/f37 zero size 2024-04-26T12:06:54.395 INFO:tasks.workunit.client.0.smithi052.stdout:2/118: creat d0/d7/d22/f23 x:0 0 0 2024-04-26T12:06:54.395 INFO:tasks.workunit.client.0.smithi052.stdout:3/64: symlink d2/d4/l15 0 2024-04-26T12:06:54.395 INFO:tasks.workunit.client.0.smithi052.stdout:0/163: readlink d0/d26/l30 0 2024-04-26T12:06:54.397 INFO:tasks.workunit.client.0.smithi052.stdout:4/92: creat d3/d1f/f24 x:0 0 0 2024-04-26T12:06:54.397 INFO:tasks.workunit.client.0.smithi052.stdout:2/119: chown d0/d7/f10 46128 1 2024-04-26T12:06:54.397 INFO:tasks.workunit.client.0.smithi052.stdout:9/143: link d3/l6 d3/db/d10/l30 0 2024-04-26T12:06:54.397 INFO:tasks.workunit.client.0.smithi052.stdout:3/65: mknod d2/c16 0 2024-04-26T12:06:54.397 INFO:tasks.workunit.client.0.smithi052.stdout:8/54: write d0/d4/d5/f8 [4992520,76069] 0 2024-04-26T12:06:54.398 INFO:tasks.workunit.client.0.smithi052.stdout:0/164: mknod d0/c39 0 2024-04-26T12:06:54.398 INFO:tasks.workunit.client.0.smithi052.stdout:2/120: readlink d0/d7/lc 0 2024-04-26T12:06:54.399 INFO:tasks.workunit.client.0.smithi052.stdout:9/144: stat d3/db/d10/f18 0 2024-04-26T12:06:54.400 INFO:tasks.workunit.client.0.smithi052.stdout:0/165: rmdir d0/d1/dd 39 2024-04-26T12:06:54.401 INFO:tasks.workunit.client.0.smithi052.stdout:7/55: dwrite d1/f7 [0,4194304] 0 2024-04-26T12:06:54.401 INFO:tasks.workunit.client.0.smithi052.stdout:3/66: rename d2/c16 to d2/d4/c17 0 2024-04-26T12:06:54.401 INFO:tasks.workunit.client.0.smithi052.stdout:8/55: write d0/f2 [3360147,90483] 0 2024-04-26T12:06:54.402 INFO:tasks.workunit.client.0.smithi052.stdout:2/121: creat d0/d7/d16/f24 x:0 0 0 2024-04-26T12:06:54.402 INFO:tasks.workunit.client.0.smithi052.stdout:6/42: write f2 [1016762,386] 0 2024-04-26T12:06:54.407 INFO:tasks.workunit.client.0.smithi052.stdout:2/122: stat d0/f1d 0 2024-04-26T12:06:54.407 INFO:tasks.workunit.client.0.smithi052.stdout:8/56: chown d0/f2 405479 1 2024-04-26T12:06:54.407 INFO:tasks.workunit.client.0.smithi052.stdout:3/67: mknod d2/d4/c18 0 2024-04-26T12:06:54.408 INFO:tasks.workunit.client.0.smithi052.stdout:6/43: symlink da/le 0 2024-04-26T12:06:54.408 INFO:tasks.workunit.client.0.smithi052.stdout:7/56: write d1/f10 [319854,119989] 0 2024-04-26T12:06:54.409 INFO:tasks.workunit.client.0.smithi052.stdout:0/166: dread d0/d1/f24 [0,4194304] 0 2024-04-26T12:06:54.410 INFO:tasks.workunit.client.0.smithi052.stdout:2/123: mknod d0/d7/d22/c25 0 2024-04-26T12:06:54.411 INFO:tasks.workunit.client.0.smithi052.stdout:3/68: write d2/fb [2953052,47079] 0 2024-04-26T12:06:54.411 INFO:tasks.workunit.client.0.smithi052.stdout:1/111: dwrite d0/d2/f2a [0,4194304] 0 2024-04-26T12:06:54.415 INFO:tasks.workunit.client.0.smithi052.stdout:2/124: fsync d0/f12 0 2024-04-26T12:06:54.415 INFO:tasks.workunit.client.0.smithi052.stdout:5/125: sync 2024-04-26T12:06:54.415 INFO:tasks.workunit.client.0.smithi052.stdout:6/44: sync 2024-04-26T12:06:54.416 INFO:tasks.workunit.client.0.smithi052.stdout:4/93: dwrite d3/d12/f13 [0,4194304] 0 2024-04-26T12:06:54.417 INFO:tasks.workunit.client.0.smithi052.stdout:6/45: fsync f9 0 2024-04-26T12:06:54.419 INFO:tasks.workunit.client.0.smithi052.stdout:4/94: fsync d3/d22/f23 0 2024-04-26T12:06:54.419 INFO:tasks.workunit.client.0.smithi052.stdout:9/145: dwrite d3/db/d24/f2c [0,4194304] 0 2024-04-26T12:06:54.424 INFO:tasks.workunit.client.0.smithi052.stdout:5/126: symlink db/dd/l2d 0 2024-04-26T12:06:54.424 INFO:tasks.workunit.client.0.smithi052.stdout:2/125: mknod d0/d7/d16/c26 0 2024-04-26T12:06:54.425 INFO:tasks.workunit.client.0.smithi052.stdout:6/46: creat da/ff x:0 0 0 2024-04-26T12:06:54.426 INFO:tasks.workunit.client.0.smithi052.stdout:4/95: write d3/f1c [1027676,80025] 0 2024-04-26T12:06:54.426 INFO:tasks.workunit.client.0.smithi052.stdout:8/57: dwrite d0/d4/d5/f8 [0,4194304] 0 2024-04-26T12:06:54.427 INFO:tasks.workunit.client.0.smithi052.stdout:2/126: stat d0/d7/lc 0 2024-04-26T12:06:54.428 INFO:tasks.workunit.client.0.smithi052.stdout:3/69: getdents d2/d4 0 2024-04-26T12:06:54.428 INFO:tasks.workunit.client.0.smithi052.stdout:9/146: mknod d3/c31 0 2024-04-26T12:06:54.428 INFO:tasks.workunit.client.0.smithi052.stdout:7/57: dwrite d1/f9 [0,4194304] 0 2024-04-26T12:06:54.430 INFO:tasks.workunit.client.0.smithi052.stdout:0/167: dread d0/d1/dd/f28 [0,4194304] 0 2024-04-26T12:06:54.431 INFO:tasks.workunit.client.0.smithi052.stdout:2/127: dread - d0/f17 zero size 2024-04-26T12:06:54.432 INFO:tasks.workunit.client.0.smithi052.stdout:7/58: creat d1/f14 x:0 0 0 2024-04-26T12:06:54.433 INFO:tasks.workunit.client.0.smithi052.stdout:9/147: unlink d3/fd 0 2024-04-26T12:06:54.433 INFO:tasks.workunit.client.0.smithi052.stdout:2/128: read d0/f12 [56903,13767] 0 2024-04-26T12:06:54.433 INFO:tasks.workunit.client.0.smithi052.stdout:1/112: dwrite d0/d2/de/df/f1a [0,4194304] 0 2024-04-26T12:06:54.433 INFO:tasks.workunit.client.0.smithi052.stdout:4/96: truncate d3/d15/f17 2013552 0 2024-04-26T12:06:54.435 INFO:tasks.workunit.client.0.smithi052.stdout:7/59: creat d1/f15 x:0 0 0 2024-04-26T12:06:54.437 INFO:tasks.workunit.client.0.smithi052.stdout:8/58: link d0/d4/d5/c6 d0/d4/dc/cd 0 2024-04-26T12:06:54.437 INFO:tasks.workunit.client.0.smithi052.stdout:2/129: fdatasync d0/d7/d16/f24 0 2024-04-26T12:06:54.441 INFO:tasks.workunit.client.0.smithi052.stdout:9/148: dread - d3/db/f20 zero size 2024-04-26T12:06:54.442 INFO:tasks.workunit.client.0.smithi052.stdout:7/60: truncate d1/f15 258720 0 2024-04-26T12:06:54.442 INFO:tasks.workunit.client.0.smithi052.stdout:6/47: sync 2024-04-26T12:06:54.442 INFO:tasks.workunit.client.0.smithi052.stdout:9/149: sync 2024-04-26T12:06:54.443 INFO:tasks.workunit.client.0.smithi052.stdout:5/127: dwrite f1 [0,4194304] 0 2024-04-26T12:06:54.443 INFO:tasks.workunit.client.0.smithi052.stdout:1/113: write d0/d2/f10 [172637,12151] 0 2024-04-26T12:06:54.444 INFO:tasks.workunit.client.0.smithi052.stdout:7/61: readlink d1/l11 0 2024-04-26T12:06:54.446 INFO:tasks.workunit.client.0.smithi052.stdout:6/48: mknod da/c10 0 2024-04-26T12:06:54.447 INFO:tasks.workunit.client.0.smithi052.stdout:2/130: rename d0/d7/cd to d0/d7/d16/c27 0 2024-04-26T12:06:54.449 INFO:tasks.workunit.client.0.smithi052.stdout:1/114: fdatasync d0/d2/f18 0 2024-04-26T12:06:54.450 INFO:tasks.workunit.client.0.smithi052.stdout:9/150: write d3/db/d10/f1c [922925,76620] 0 2024-04-26T12:06:54.450 INFO:tasks.workunit.client.0.smithi052.stdout:3/70: dwrite d2/ff [0,4194304] 0 2024-04-26T12:06:54.452 INFO:tasks.workunit.client.0.smithi052.stdout:6/49: write da/ff [113978,66055] 0 2024-04-26T12:06:54.452 INFO:tasks.workunit.client.0.smithi052.stdout:7/62: write d1/f15 [1284086,30402] 0 2024-04-26T12:06:54.452 INFO:tasks.workunit.client.0.smithi052.stdout:0/168: dwrite d0/d1/f5 [0,4194304] 0 2024-04-26T12:06:54.452 INFO:tasks.workunit.client.0.smithi052.stdout:5/128: chown db/dd/d18/d1e/d25/f24 25940 1 2024-04-26T12:06:54.452 INFO:tasks.workunit.client.0.smithi052.stdout:2/131: creat d0/d7/d22/f28 x:0 0 0 2024-04-26T12:06:54.453 INFO:tasks.workunit.client.0.smithi052.stdout:7/63: readlink d1/l5 0 2024-04-26T12:06:54.454 INFO:tasks.workunit.client.0.smithi052.stdout:9/151: fsync d3/db/d24/f2c 0 2024-04-26T12:06:54.454 INFO:tasks.workunit.client.0.smithi052.stdout:6/50: chown da/fd 3200 1 2024-04-26T12:06:54.455 INFO:tasks.workunit.client.0.smithi052.stdout:8/59: dwrite d0/f2 [0,4194304] 0 2024-04-26T12:06:54.456 INFO:tasks.workunit.client.0.smithi052.stdout:0/169: creat d0/d1/d1a/d20/f3a x:0 0 0 2024-04-26T12:06:54.457 INFO:tasks.workunit.client.0.smithi052.stdout:4/97: dwrite d3/d12/f19 [0,4194304] 0 2024-04-26T12:06:54.458 INFO:tasks.workunit.client.0.smithi052.stdout:7/64: write d1/f12 [591863,20790] 0 2024-04-26T12:06:54.460 INFO:tasks.workunit.client.0.smithi052.stdout:6/51: truncate da/ff 666429 0 2024-04-26T12:06:54.461 INFO:tasks.workunit.client.0.smithi052.stdout:0/170: mkdir d0/d1/d1a/d3b 0 2024-04-26T12:06:54.462 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:54.462 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:54.462 INFO:tasks.workunit.client.0.smithi052.stdout:4/98: creat d3/d1f/f25 x:0 0 0 2024-04-26T12:06:54.464 INFO:tasks.workunit.client.0.smithi052.stdout:6/52: unlink da/fd 0 2024-04-26T12:06:54.464 INFO:tasks.workunit.client.0.smithi052.stdout:5/129: dread db/f10 [0,4194304] 0 2024-04-26T12:06:54.464 INFO:tasks.workunit.client.0.smithi052.stdout:0/171: rmdir d0/d1/dd 39 2024-04-26T12:06:54.466 INFO:tasks.workunit.client.0.smithi052.stdout:4/99: chown d3/d12/f20 920610 1 2024-04-26T12:06:54.467 INFO:tasks.workunit.client.0.smithi052.stdout:8/60: truncate d0/f2 775130 0 2024-04-26T12:06:54.468 INFO:tasks.workunit.client.0.smithi052.stdout:3/71: dwrite d2/fb [0,4194304] 0 2024-04-26T12:06:54.468 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:54.467+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:54.469 INFO:tasks.workunit.client.0.smithi052.stdout:6/53: creat da/f11 x:0 0 0 2024-04-26T12:06:54.469 INFO:tasks.workunit.client.0.smithi052.stdout:0/172: mkdir d0/d3c 0 2024-04-26T12:06:54.469 INFO:tasks.workunit.client.0.smithi052.stdout:4/100: mknod d3/d12/c26 0 2024-04-26T12:06:54.469 INFO:tasks.workunit.client.0.smithi052.stdout:2/132: dread d0/d7/fe [0,4194304] 0 2024-04-26T12:06:54.469 INFO:tasks.workunit.client.0.smithi052.stdout:1/115: dwrite d0/da/f19 [0,4194304] 0 2024-04-26T12:06:54.471 INFO:tasks.workunit.client.0.smithi052.stdout:5/130: rename db/dd/l17 to db/dd/d18/d1e/d25/l2e 0 2024-04-26T12:06:54.472 INFO:tasks.workunit.client.0.smithi052.stdout:8/61: creat d0/d4/d5/fe x:0 0 0 2024-04-26T12:06:54.473 INFO:tasks.workunit.client.0.smithi052.stdout:7/65: dwrite d1/f10 [0,4194304] 0 2024-04-26T12:06:54.473 INFO:tasks.workunit.client.0.smithi052.stdout:3/72: mknod d2/d4/dc/c19 0 2024-04-26T12:06:54.473 INFO:tasks.workunit.client.0.smithi052.stdout:6/54: chown da/cc 410013 1 2024-04-26T12:06:54.474 INFO:tasks.workunit.client.0.smithi052.stdout:9/152: dwrite d3/db/d10/f1c [4194304,4194304] 0 2024-04-26T12:06:54.475 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:54.475 INFO:tasks.workunit.client.0.smithi052.stdout:5/131: truncate db/f10 1345297 0 2024-04-26T12:06:54.476 INFO:tasks.workunit.client.0.smithi052.stdout:6/55: fsync da/ff 0 2024-04-26T12:06:54.477 INFO:tasks.workunit.client.0.smithi052.stdout:1/116: creat d0/d2/dd/d1c/d1d/d23/f2b x:0 0 0 2024-04-26T12:06:54.480 INFO:tasks.workunit.client.0.smithi052.stdout:7/66: truncate d1/ff 435613 0 2024-04-26T12:06:54.482 INFO:tasks.workunit.client.0.smithi052.stdout:6/56: creat da/f12 x:0 0 0 2024-04-26T12:06:54.484 INFO:tasks.workunit.client.0.smithi052.stdout:5/132: creat db/dd/d18/d1e/f2f x:0 0 0 2024-04-26T12:06:54.484 INFO:tasks.workunit.client.0.smithi052.stdout:7/67: creat d1/f16 x:0 0 0 2024-04-26T12:06:54.485 INFO:tasks.workunit.client.0.smithi052.stdout:6/57: dread - da/f12 zero size 2024-04-26T12:06:54.488 INFO:tasks.workunit.client.0.smithi052.stdout:0/173: dread d0/f3 [0,4194304] 0 2024-04-26T12:06:54.489 INFO:tasks.workunit.client.0.smithi052.stdout:6/58: rmdir da 39 2024-04-26T12:06:54.489 INFO:tasks.workunit.client.0.smithi052.stdout:1/117: write d0/d2/f2a [5216591,13688] 0 2024-04-26T12:06:54.492 INFO:tasks.workunit.client.0.smithi052.stdout:0/174: mkdir d0/d3d 0 2024-04-26T12:06:54.494 INFO:tasks.workunit.client.0.smithi052.stdout:4/101: dwrite d3/d12/f1a [0,4194304] 0 2024-04-26T12:06:54.494 INFO:tasks.workunit.client.0.smithi052.stdout:8/62: dwrite d0/d4/d5/f8 [0,4194304] 0 2024-04-26T12:06:54.494 INFO:tasks.workunit.client.0.smithi052.stdout:5/133: write db/dd/d18/d1e/f2f [418106,3049] 0 2024-04-26T12:06:54.495 INFO:tasks.workunit.client.0.smithi052.stdout:2/133: dwrite d0/d7/d16/f1e [0,4194304] 0 2024-04-26T12:06:54.495 INFO:tasks.workunit.client.0.smithi052.stdout:6/59: chown da/c10 2820 1 2024-04-26T12:06:54.495 INFO:tasks.workunit.client.0.smithi052.stdout:3/73: dread d2/fb [0,4194304] 0 2024-04-26T12:06:54.495 INFO:tasks.workunit.client.0.smithi052.stdout:8/63: chown d0 1219 1 2024-04-26T12:06:54.495 INFO:tasks.workunit.client.0.smithi052.stdout:7/68: getdents d1 0 2024-04-26T12:06:54.496 INFO:tasks.workunit.client.0.smithi052.stdout:3/74: chown d2 30 1 2024-04-26T12:06:54.496 INFO:tasks.workunit.client.0.smithi052.stdout:1/118: write d0/d2/f2a [1681208,68249] 0 2024-04-26T12:06:54.497 INFO:tasks.workunit.client.0.smithi052.stdout:2/134: mknod d0/d7/c29 0 2024-04-26T12:06:54.497 INFO:tasks.workunit.client.0.smithi052.stdout:9/153: dwrite d3/db/d2b/f2f [0,4194304] 0 2024-04-26T12:06:54.497 INFO:tasks.workunit.client.0.smithi052.stdout:7/69: creat d1/f17 x:0 0 0 2024-04-26T12:06:54.498 INFO:tasks.workunit.client.0.smithi052.stdout:6/60: write f2 [2284012,118745] 0 2024-04-26T12:06:54.498 INFO:tasks.workunit.client.0.smithi052.stdout:3/75: truncate d2/ff 4665298 0 2024-04-26T12:06:54.499 INFO:tasks.workunit.client.0.smithi052.stdout:1/119: dread - d0/d1e/f29 zero size 2024-04-26T12:06:54.499 INFO:tasks.workunit.client.0.smithi052.stdout:7/70: stat d1/f15 0 2024-04-26T12:06:54.499 INFO:tasks.workunit.client.0.smithi052.stdout:4/102: write d3/d1f/f24 [551897,83998] 0 2024-04-26T12:06:54.499 INFO:tasks.workunit.client.0.smithi052.stdout:2/135: rmdir d0/d7/d16 39 2024-04-26T12:06:54.499 INFO:tasks.workunit.client.0.smithi052.stdout:3/76: stat d2/ff 0 2024-04-26T12:06:54.500 INFO:tasks.workunit.client.0.smithi052.stdout:6/61: write da/ff [246009,33398] 0 2024-04-26T12:06:54.501 INFO:tasks.workunit.client.0.smithi052.stdout:7/71: link d1/ff d1/f18 0 2024-04-26T12:06:54.502 INFO:tasks.workunit.client.0.smithi052.stdout:2/136: mknod d0/d7/d16/c2a 0 2024-04-26T12:06:54.502 INFO:tasks.workunit.client.0.smithi052.stdout:6/62: creat da/f13 x:0 0 0 2024-04-26T12:06:54.503 INFO:tasks.workunit.client.0.smithi052.stdout:6/63: fdatasync da/f13 0 2024-04-26T12:06:54.503 INFO:tasks.workunit.client.0.smithi052.stdout:0/175: truncate d0/d1/f6 1549173 0 2024-04-26T12:06:54.504 INFO:tasks.workunit.client.0.smithi052.stdout:7/72: symlink d1/l19 0 2024-04-26T12:06:54.506 INFO:tasks.workunit.client.0.smithi052.stdout:0/176: symlink d0/d26/l3e 0 2024-04-26T12:06:54.507 INFO:tasks.workunit.client.0.smithi052.stdout:6/64: write da/f12 [120695,27582] 0 2024-04-26T12:06:54.507 INFO:tasks.workunit.client.0.smithi052.stdout:5/134: rename db/c15 to db/dd/d18/c30 0 2024-04-26T12:06:54.508 INFO:tasks.workunit.client.0.smithi052.stdout:7/73: write d1/f14 [858215,33483] 0 2024-04-26T12:06:54.509 INFO:tasks.workunit.client.0.smithi052.stdout:9/154: dread d3/db/d10/f18 [0,4194304] 0 2024-04-26T12:06:54.509 INFO:tasks.workunit.client.0.smithi052.stdout:3/77: dread d2/ff [0,4194304] 0 2024-04-26T12:06:54.511 INFO:tasks.workunit.client.0.smithi052.stdout:6/65: chown da/c10 15744 1 2024-04-26T12:06:54.511 INFO:tasks.workunit.client.0.smithi052.stdout:4/103: dwrite d3/fb [0,4194304] 0 2024-04-26T12:06:54.512 INFO:tasks.workunit.client.0.smithi052.stdout:7/74: write d1/fa [381896,116816] 0 2024-04-26T12:06:54.513 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:54.514 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:54.515 INFO:tasks.workunit.client.0.smithi052.stdout:1/120: dwrite d0/d1e/f29 [0,4194304] 0 2024-04-26T12:06:54.518 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:06:54.520 INFO:tasks.workunit.client.0.smithi052.stdout:2/137: getdents d0/d7/d16 0 2024-04-26T12:06:54.521 INFO:tasks.workunit.client.0.smithi052.stdout:6/66: rmdir da 39 2024-04-26T12:06:54.521 INFO:tasks.workunit.client.0.smithi052.stdout:3/78: dread d2/fa [0,4194304] 0 2024-04-26T12:06:54.522 INFO:tasks.workunit.client.0.smithi052.stdout:7/75: mknod d1/c1a 0 2024-04-26T12:06:54.522 INFO:tasks.workunit.client.0.smithi052.stdout:9/155: dwrite d3/db/f20 [0,4194304] 0 2024-04-26T12:06:54.522 INFO:tasks.workunit.client.0.smithi052.stdout:5/135: write db/f10 [2370482,65290] 0 2024-04-26T12:06:54.522 INFO:tasks.workunit.client.0.smithi052.stdout:1/121: mkdir d0/d2/dd/d2c 0 2024-04-26T12:06:54.522 INFO:tasks.workunit.client.0.smithi052.stdout:8/64: dwrite d0/d4/d5/fe [0,4194304] 0 2024-04-26T12:06:54.522 INFO:tasks.workunit.client.0.smithi052.stdout:4/104: symlink d3/d1f/d21/l27 0 2024-04-26T12:06:54.522 INFO:tasks.workunit.client.0.smithi052.stdout:2/138: dread - d0/f21 zero size 2024-04-26T12:06:54.524 INFO:tasks.workunit.client.0.smithi052.stdout:4/105: chown d3/f14 3000833 1 2024-04-26T12:06:54.524 INFO:tasks.workunit.client.0.smithi052.stdout:9/156: fdatasync d3/db/d24/f2c 0 2024-04-26T12:06:54.524 INFO:tasks.workunit.client.0.smithi052.stdout:6/67: rename da/c10 to da/c14 0 2024-04-26T12:06:54.524 INFO:tasks.workunit.client.0.smithi052.stdout:3/79: symlink d2/l1a 0 2024-04-26T12:06:54.524 INFO:tasks.workunit.client.0.smithi052.stdout:8/65: stat d0/d4/d5/c6 0 2024-04-26T12:06:54.525 INFO:tasks.workunit.client.0.smithi052.stdout:1/122: creat d0/d2/de/f2d x:0 0 0 2024-04-26T12:06:54.526 INFO:tasks.workunit.client.0.smithi052.stdout:6/68: truncate f9 105847 0 2024-04-26T12:06:54.527 INFO:tasks.workunit.client.0.smithi052.stdout:6/69: readlink l3 0 2024-04-26T12:06:54.527 INFO:tasks.workunit.client.0.smithi052.stdout:1/123: write d0/d2/de/df/f1a [1277323,15221] 0 2024-04-26T12:06:54.529 INFO:tasks.workunit.client.0.smithi052.stdout:1/124: read d0/d2/f2a [3391074,22461] 0 2024-04-26T12:06:54.529 INFO:tasks.workunit.client.0.smithi052.stdout:2/139: dread d0/f6 [0,4194304] 0 2024-04-26T12:06:54.531 INFO:tasks.workunit.client.0.smithi052.stdout:2/140: dread - d0/d7/d22/f28 zero size 2024-04-26T12:06:54.536 INFO:tasks.workunit.client.0.smithi052.stdout:3/80: dwrite d2/fa [4194304,4194304] 0 2024-04-26T12:06:54.537 INFO:tasks.workunit.client.0.smithi052.stdout:8/66: dwrite d0/d4/d5/fe [0,4194304] 0 2024-04-26T12:06:54.540 INFO:tasks.workunit.client.0.smithi052.stdout:2/141: dread d0/f4 [0,4194304] 0 2024-04-26T12:06:54.540 INFO:tasks.workunit.client.0.smithi052.stdout:1/125: rename d0/d2/de/df to d0/da/d2e 0 2024-04-26T12:06:54.543 INFO:tasks.workunit.client.0.smithi052.stdout:3/81: dread d2/ff [0,4194304] 0 2024-04-26T12:06:54.544 INFO:tasks.workunit.client.0.smithi052.stdout:8/67: dwrite d0/d4/d5/fe [0,4194304] 0 2024-04-26T12:06:54.547 INFO:tasks.workunit.client.0.smithi052.stdout:1/126: dwrite d0/d2/de/f27 [0,4194304] 0 2024-04-26T12:06:54.549 INFO:tasks.workunit.client.0.smithi052.stdout:1/127: chown d0/d2/c5 7419540 1 2024-04-26T12:06:54.549 INFO:tasks.workunit.client.0.smithi052.stdout:8/68: symlink d0/d4/d5/db/lf 0 2024-04-26T12:06:54.549 INFO:tasks.workunit.client.0.smithi052.stdout:2/142: mknod d0/c2b 0 2024-04-26T12:06:54.549 INFO:tasks.workunit.client.0.smithi052.stdout:2/143: fdatasync d0/d7/fe 0 2024-04-26T12:06:54.550 INFO:tasks.workunit.client.0.smithi052.stdout:0/177: sync 2024-04-26T12:06:54.550 INFO:tasks.workunit.client.0.smithi052.stdout:1/128: fsync d0/da/d2e/f1a 0 2024-04-26T12:06:54.551 INFO:tasks.workunit.client.0.smithi052.stdout:8/69: truncate d0/f2 1537298 0 2024-04-26T12:06:54.552 INFO:tasks.workunit.client.0.smithi052.stdout:1/129: creat d0/da/f2f x:0 0 0 2024-04-26T12:06:54.553 INFO:tasks.workunit.client.0.smithi052.stdout:0/178: rmdir d0/d1/dd 39 2024-04-26T12:06:54.553 INFO:tasks.workunit.client.0.smithi052.stdout:5/136: dread db/f10 [0,4194304] 0 2024-04-26T12:06:54.555 INFO:tasks.workunit.client.0.smithi052.stdout:0/179: fsync d0/d1/f12 0 2024-04-26T12:06:54.555 INFO:tasks.workunit.client.0.smithi052.stdout:3/82: dwrite d2/ff [0,4194304] 0 2024-04-26T12:06:54.557 INFO:tasks.workunit.client.0.smithi052.stdout:5/137: link db/l2b db/dc/d29/l31 0 2024-04-26T12:06:54.558 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:54.558 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:54.558 INFO:tasks.workunit.client.0.smithi052.stdout:2/144: dwrite d0/d7/d22/f28 [0,4194304] 0 2024-04-26T12:06:54.559 INFO:tasks.workunit.client.0.smithi052.stdout:5/138: creat db/dd/d18/d1e/d25/f32 x:0 0 0 2024-04-26T12:06:54.560 INFO:tasks.workunit.client.0.smithi052.stdout:2/145: mknod d0/d7/c2c 0 2024-04-26T12:06:54.560 INFO:tasks.workunit.client.0.smithi052.stdout:5/139: write db/f1f [2607578,78378] 0 2024-04-26T12:06:54.561 INFO:tasks.workunit.client.0.smithi052.stdout:2/146: symlink d0/d7/d16/l2d 0 2024-04-26T12:06:54.561 INFO:tasks.workunit.client.0.smithi052.stdout:3/83: dread d2/fa [0,4194304] 0 2024-04-26T12:06:54.562 INFO:tasks.workunit.client.0.smithi052.stdout:2/147: write d0/f15 [482901,53466] 0 2024-04-26T12:06:54.563 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:06:54.563 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:06:54.564 INFO:tasks.workunit.client.0.smithi052.stdout:2/148: mknod d0/d7/c2e 0 2024-04-26T12:06:54.564 INFO:tasks.workunit.client.0.smithi052.stdout:2/149: mkdir d0/d7/d2f 0 2024-04-26T12:06:54.565 INFO:tasks.workunit.client.0.smithi052.stdout:2/150: rename d0/d7/f11 to d0/d7/d16/f30 0 2024-04-26T12:06:54.566 INFO:tasks.workunit.client.0.smithi052.stdout:3/84: dwrite d2/fa [0,4194304] 0 2024-04-26T12:06:54.567 INFO:tasks.workunit.client.0.smithi052.stdout:2/151: truncate d0/f12 3806124 0 2024-04-26T12:06:54.567 INFO:tasks.workunit.client.0.smithi052.stdout:5/140: dread db/dd/d18/d1e/f2f [0,4194304] 0 2024-04-26T12:06:54.567 INFO:tasks.workunit.client.0.smithi052.stdout:3/85: write d2/fa [2396400,54160] 0 2024-04-26T12:06:54.568 INFO:tasks.workunit.client.0.smithi052.stdout:3/86: write d2/ff [4621018,90136] 0 2024-04-26T12:06:54.568 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:54.567+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:54.569 INFO:tasks.workunit.client.0.smithi052.stdout:3/87: read d2/fb [1712337,117367] 0 2024-04-26T12:06:54.570 INFO:tasks.workunit.client.0.smithi052.stdout:3/88: creat d2/d4/dc/f1b x:0 0 0 2024-04-26T12:06:54.574 INFO:tasks.workunit.client.0.smithi052.stdout:5/141: dread db/dc/f1d [0,4194304] 0 2024-04-26T12:06:54.575 INFO:tasks.workunit.client.0.smithi052.stdout:5/142: stat db/dd/f27 0 2024-04-26T12:06:54.575 INFO:tasks.workunit.client.0.smithi052.stdout:2/152: dwrite d0/f21 [0,4194304] 0 2024-04-26T12:06:54.575 INFO:tasks.workunit.client.0.smithi052.stdout:5/143: mknod db/dd/d18/d1e/c33 0 2024-04-26T12:06:54.575 INFO:tasks.workunit.client.0.smithi052.stdout:2/153: creat d0/d7/f31 x:0 0 0 2024-04-26T12:06:54.575 INFO:tasks.workunit.client.0.smithi052.stdout:5/144: unlink db/dc/lf 0 2024-04-26T12:06:54.575 INFO:tasks.workunit.client.0.smithi052.stdout:2/154: symlink d0/d7/l32 0 2024-04-26T12:06:54.576 INFO:tasks.workunit.client.0.smithi052.stdout:3/89: dwrite d2/f7 [0,4194304] 0 2024-04-26T12:06:54.577 INFO:tasks.workunit.client.0.smithi052.stdout:5/145: dread db/f10 [0,4194304] 0 2024-04-26T12:06:54.578 INFO:tasks.workunit.client.0.smithi052.stdout:5/146: chown db/dd/d18/c20 211407 1 2024-04-26T12:06:54.580 INFO:tasks.workunit.client.0.smithi052.stdout:5/147: mkdir db/dd/d34 0 2024-04-26T12:06:54.581 INFO:tasks.workunit.client.0.smithi052.stdout:4/106: getdents d3/d1f/d21 0 2024-04-26T12:06:54.581 INFO:tasks.workunit.client.0.smithi052.stdout:7/76: truncate d1/f6 509948 0 2024-04-26T12:06:54.581 INFO:tasks.workunit.client.0.smithi052.stdout:6/70: getdents da 0 2024-04-26T12:06:54.582 INFO:tasks.workunit.client.0.smithi052.stdout:7/77: stat d1/ff 0 2024-04-26T12:06:54.582 INFO:tasks.workunit.client.0.smithi052.stdout:2/155: dwrite d0/d7/d16/f1c [0,4194304] 0 2024-04-26T12:06:54.582 INFO:tasks.workunit.client.0.smithi052.stdout:7/78: fdatasync d1/f16 0 2024-04-26T12:06:54.583 INFO:tasks.workunit.client.0.smithi052.stdout:6/71: creat da/f15 x:0 0 0 2024-04-26T12:06:54.583 INFO:tasks.workunit.client.0.smithi052.stdout:4/107: symlink d3/d22/l28 0 2024-04-26T12:06:54.583 INFO:tasks.workunit.client.0.smithi052.stdout:5/148: creat db/f35 x:0 0 0 2024-04-26T12:06:54.584 INFO:tasks.workunit.client.0.smithi052.stdout:6/72: creat da/f16 x:0 0 0 2024-04-26T12:06:54.585 INFO:tasks.workunit.client.0.smithi052.stdout:3/90: dwrite d2/fb [0,4194304] 0 2024-04-26T12:06:54.585 INFO:tasks.workunit.client.0.smithi052.stdout:4/108: symlink d3/d22/l29 0 2024-04-26T12:06:54.587 INFO:tasks.workunit.client.0.smithi052.stdout:9/157: dwrite d3/db/f20 [4194304,4194304] 0 2024-04-26T12:06:54.587 INFO:tasks.workunit.client.0.smithi052.stdout:5/149: creat db/dd/d18/d1e/f36 x:0 0 0 2024-04-26T12:06:54.588 INFO:tasks.workunit.client.0.smithi052.stdout:3/91: read - d2/d4/dc/f1b zero size 2024-04-26T12:06:54.588 INFO:tasks.workunit.client.0.smithi052.stdout:3/92: readlink d2/d4/l10 0 2024-04-26T12:06:54.588 INFO:tasks.workunit.client.0.smithi052.stdout:2/156: dread d0/f4 [0,4194304] 0 2024-04-26T12:06:54.590 INFO:tasks.workunit.client.0.smithi052.stdout:5/150: mknod db/dc/d29/c37 0 2024-04-26T12:06:54.591 INFO:tasks.workunit.client.0.smithi052.stdout:6/73: link c6 da/c17 0 2024-04-26T12:06:54.593 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:54.593 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:54.593 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:06:54.593 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:54.594 INFO:tasks.workunit.client.0.smithi052.stdout:6/74: truncate da/f16 274979 0 2024-04-26T12:06:54.595 INFO:tasks.workunit.client.0.smithi052.stdout:9/158: dwrite d3/db/d10/f18 [0,4194304] 0 2024-04-26T12:06:54.597 INFO:tasks.workunit.client.0.smithi052.stdout:6/75: write da/f15 [377721,40056] 0 2024-04-26T12:06:54.598 INFO:tasks.workunit.client.0.smithi052.stdout:3/93: dwrite d2/fa [4194304,4194304] 0 2024-04-26T12:06:54.599 INFO:tasks.workunit.client.0.smithi052.stdout:2/157: dwrite d0/d7/d16/f1e [0,4194304] 0 2024-04-26T12:06:54.605 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:54.607 INFO:tasks.workunit.client.0.smithi052.stdout:9/159: chown d3/d23/l27 115 1 2024-04-26T12:06:54.609 INFO:tasks.workunit.client.0.smithi052.stdout:8/70: getdents d0/d4/d5/db 0 2024-04-26T12:06:54.609 INFO:tasks.workunit.client.0.smithi052.stdout:3/94: rename d2/d4/dc/dd to d2/d4/dc/d12/d1c 0 2024-04-26T12:06:54.610 INFO:tasks.workunit.client.0.smithi052.stdout:8/71: readlink d0/d4/d5/db/lf 0 2024-04-26T12:06:54.611 INFO:tasks.workunit.client.0.smithi052.stdout:9/160: mkdir d3/db/d32 0 2024-04-26T12:06:54.611 INFO:tasks.workunit.client.0.smithi052.stdout:6/76: rename da/c14 to da/c18 0 2024-04-26T12:06:54.611 INFO:tasks.workunit.client.0.smithi052.stdout:3/95: chown d2/d4/dc/c19 1375542 1 2024-04-26T12:06:54.611 INFO:tasks.workunit.client.0.smithi052.stdout:6/77: mknod da/c19 0 2024-04-26T12:06:54.612 INFO:tasks.workunit.client.0.smithi052.stdout:9/161: rename d3/db/d32 to d3/db/d32/d33 22 2024-04-26T12:06:54.612 INFO:tasks.workunit.client.0.smithi052.stdout:3/96: mkdir d2/d4/dc/d1d 0 2024-04-26T12:06:54.613 INFO:tasks.workunit.client.0.smithi052.stdout:6/78: rename da/cb to da/c1a 0 2024-04-26T12:06:54.613 INFO:tasks.workunit.client.0.smithi052.stdout:9/162: readlink d3/d23/l25 0 2024-04-26T12:06:54.613 INFO:tasks.workunit.client.0.smithi052.stdout:6/79: fsync da/f12 0 2024-04-26T12:06:54.614 INFO:tasks.workunit.client.0.smithi052.stdout:0/180: dwrite d0/d1/f12 [4194304,4194304] 0 2024-04-26T12:06:54.614 INFO:tasks.workunit.client.0.smithi052.stdout:3/97: rename d2/fa to d2/d4/dc/d12/f1e 0 2024-04-26T12:06:54.614 INFO:tasks.workunit.client.0.smithi052.stdout:6/80: write da/f12 [342278,54767] 0 2024-04-26T12:06:54.615 INFO:tasks.workunit.client.0.smithi052.stdout:3/98: chown d2/d4/dc/d1d 2137408729 1 2024-04-26T12:06:54.615 INFO:tasks.workunit.client.0.smithi052.stdout:0/181: chown d0/l2e 98507927 1 2024-04-26T12:06:54.615 INFO:tasks.workunit.client.0.smithi052.stdout:6/81: chown da/f15 23162 1 2024-04-26T12:06:54.616 INFO:tasks.workunit.client.0.smithi052.stdout:8/72: dread d0/d4/d5/f8 [0,4194304] 0 2024-04-26T12:06:54.616 INFO:tasks.workunit.client.0.smithi052.stdout:6/82: creat da/f1b x:0 0 0 2024-04-26T12:06:54.617 INFO:tasks.workunit.client.0.smithi052.stdout:8/73: chown d0/d4/d5 14 1 2024-04-26T12:06:54.617 INFO:tasks.workunit.client.0.smithi052.stdout:0/182: getdents d0/d1 0 2024-04-26T12:06:54.617 INFO:tasks.workunit.client.0.smithi052.stdout:6/83: chown da/c19 815261 1 2024-04-26T12:06:54.618 INFO:tasks.workunit.client.0.smithi052.stdout:0/183: readlink d0/la 0 2024-04-26T12:06:54.618 INFO:tasks.workunit.client.0.smithi052.stdout:8/74: mknod d0/d4/c10 0 2024-04-26T12:06:54.621 INFO:tasks.workunit.client.0.smithi052.stdout:5/151: truncate db/dd/f19 2981107 0 2024-04-26T12:06:54.621 INFO:tasks.workunit.client.0.smithi052.stdout:9/163: dwrite d3/db/d10/f1c [0,4194304] 0 2024-04-26T12:06:54.621 INFO:tasks.workunit.client.0.smithi052.stdout:0/184: truncate d0/d1/f24 947573 0 2024-04-26T12:06:54.623 INFO:tasks.workunit.client.0.smithi052.stdout:5/152: chown db/f35 110466093 1 2024-04-26T12:06:54.624 INFO:tasks.workunit.client.0.smithi052.stdout:0/185: write d0/d1/f5 [1574839,112792] 0 2024-04-26T12:06:54.626 INFO:tasks.workunit.client.0.smithi052.stdout:5/153: write db/f1f [4544780,63162] 0 2024-04-26T12:06:54.627 INFO:tasks.workunit.client.0.smithi052.stdout:7/79: dwrite d1/ff [0,4194304] 0 2024-04-26T12:06:54.627 INFO:tasks.workunit.client.0.smithi052.stdout:6/84: dwrite da/f1b [0,4194304] 0 2024-04-26T12:06:54.628 INFO:tasks.workunit.client.0.smithi052.stdout:3/99: truncate d2/ff 3726755 0 2024-04-26T12:06:54.628 INFO:tasks.workunit.client.0.smithi052.stdout:5/154: write f1 [8338165,106171] 0 2024-04-26T12:06:54.628 INFO:tasks.workunit.client.0.smithi052.stdout:8/75: rmdir d0 39 2024-04-26T12:06:54.629 INFO:tasks.workunit.client.0.smithi052.stdout:2/158: dwrite d0/f12 [0,4194304] 0 2024-04-26T12:06:54.630 INFO:tasks.workunit.client.0.smithi052.stdout:7/80: symlink d1/l1b 0 2024-04-26T12:06:54.630 INFO:tasks.workunit.client.0.smithi052.stdout:6/85: read f9 [41888,30633] 0 2024-04-26T12:06:54.630 INFO:tasks.workunit.client.0.smithi052.stdout:0/186: rename d0/d1/f5 to d0/d3d/f3f 0 2024-04-26T12:06:54.630 INFO:tasks.workunit.client.0.smithi052.stdout:3/100: read d2/d4/dc/d12/f1e [4099684,43398] 0 2024-04-26T12:06:54.631 INFO:tasks.workunit.client.0.smithi052.stdout:7/81: mkdir d1/d1c 0 2024-04-26T12:06:54.631 INFO:tasks.workunit.client.0.smithi052.stdout:8/76: fsync d0/d4/d5/fe 0 2024-04-26T12:06:54.631 INFO:tasks.workunit.client.0.smithi052.stdout:5/155: link db/f35 db/f38 0 2024-04-26T12:06:54.632 INFO:tasks.workunit.client.0.smithi052.stdout:7/82: rename d1/l19 to d1/l1d 0 2024-04-26T12:06:54.633 INFO:tasks.workunit.client.0.smithi052.stdout:2/159: creat d0/f33 x:0 0 0 2024-04-26T12:06:54.633 INFO:tasks.workunit.client.0.smithi052.stdout:7/83: fsync d1/f17 0 2024-04-26T12:06:54.634 INFO:tasks.workunit.client.0.smithi052.stdout:1/130: sync 2024-04-26T12:06:54.636 INFO:tasks.workunit.client.0.smithi052.stdout:6/86: dwrite da/f1b [0,4194304] 0 2024-04-26T12:06:54.636 INFO:tasks.workunit.client.0.smithi052.stdout:1/131: creat d0/d2/dd/d1c/d1d/d23/f30 x:0 0 0 2024-04-26T12:06:54.636 INFO:tasks.workunit.client.0.smithi052.stdout:9/164: truncate d3/f7 455581 0 2024-04-26T12:06:54.637 INFO:tasks.workunit.client.0.smithi052.stdout:2/160: dread d0/d7/d16/f1e [0,4194304] 0 2024-04-26T12:06:54.637 INFO:tasks.workunit.client.0.smithi052.stdout:6/87: link da/f16 da/f1c 0 2024-04-26T12:06:54.637 INFO:tasks.workunit.client.0.smithi052.stdout:9/165: read d3/db/d10/f18 [2840450,49027] 0 2024-04-26T12:06:54.639 INFO:tasks.workunit.client.0.smithi052.stdout:5/156: truncate db/dd/d18/d1e/f2f 283528 0 2024-04-26T12:06:54.639 INFO:tasks.workunit.client.0.smithi052.stdout:7/84: fdatasync d1/f6 0 2024-04-26T12:06:54.640 INFO:tasks.workunit.client.0.smithi052.stdout:7/85: readlink d1/l5 0 2024-04-26T12:06:54.641 INFO:tasks.workunit.client.0.smithi052.stdout:5/157: read db/dd/f19 [574971,63049] 0 2024-04-26T12:06:54.642 INFO:tasks.workunit.client.0.smithi052.stdout:7/86: creat d1/d1c/f1e x:0 0 0 2024-04-26T12:06:54.643 INFO:tasks.workunit.client.0.smithi052.stdout:0/187: link d0/d1/d1a/c34 d0/d1/d1a/d2a/d32/c40 0 2024-04-26T12:06:54.643 INFO:tasks.workunit.client.0.smithi052.stdout:8/77: dread d0/f2 [0,4194304] 0 2024-04-26T12:06:54.643 INFO:tasks.workunit.client.0.smithi052.stdout:7/87: readlink d1/l11 0 2024-04-26T12:06:54.645 INFO:tasks.workunit.client.0.smithi052.stdout:5/158: unlink db/dd/d18/d1e/c33 0 2024-04-26T12:06:54.646 INFO:tasks.workunit.client.0.smithi052.stdout:1/132: dwrite d0/da/f2f [0,4194304] 0 2024-04-26T12:06:54.647 INFO:tasks.workunit.client.0.smithi052.stdout:7/88: mkdir d1/d1f 0 2024-04-26T12:06:54.647 INFO:tasks.workunit.client.0.smithi052.stdout:3/101: dwrite d2/ff [0,4194304] 0 2024-04-26T12:06:54.648 INFO:tasks.workunit.client.0.smithi052.stdout:8/78: creat d0/d4/d5/f11 x:0 0 0 2024-04-26T12:06:54.649 INFO:tasks.workunit.client.0.smithi052.stdout:6/88: dwrite da/f13 [0,4194304] 0 2024-04-26T12:06:54.651 INFO:tasks.workunit.client.0.smithi052.stdout:9/166: dwrite d3/db/d2b/f2f [4194304,4194304] 0 2024-04-26T12:06:54.651 INFO:tasks.workunit.client.0.smithi052.stdout:3/102: mkdir d2/d1f 0 2024-04-26T12:06:54.651 INFO:tasks.workunit.client.0.smithi052.stdout:8/79: write d0/d4/d5/f11 [173272,5175] 0 2024-04-26T12:06:54.654 INFO:tasks.workunit.client.0.smithi052.stdout:3/103: chown d2/d4/dc/c19 1 1 2024-04-26T12:06:54.654 INFO:tasks.workunit.client.0.smithi052.stdout:9/167: mknod d3/db/d13/c34 0 2024-04-26T12:06:54.656 INFO:tasks.workunit.client.0.smithi052.stdout:0/188: dwrite d0/f3 [8388608,4194304] 0 2024-04-26T12:06:54.657 INFO:tasks.workunit.client.0.smithi052.stdout:4/109: sync 2024-04-26T12:06:54.657 INFO:tasks.workunit.client.0.smithi052.stdout:2/161: sync 2024-04-26T12:06:54.658 INFO:tasks.workunit.client.0.smithi052.stdout:7/89: dwrite d1/f9 [0,4194304] 0 2024-04-26T12:06:54.658 INFO:tasks.workunit.client.0.smithi052.stdout:5/159: dwrite db/f10 [0,4194304] 0 2024-04-26T12:06:54.658 INFO:tasks.workunit.client.0.smithi052.stdout:9/168: symlink d3/db/d10/d2e/l35 0 2024-04-26T12:06:54.659 INFO:tasks.workunit.client.0.smithi052.stdout:0/189: chown d0/d1/f12 6 1 2024-04-26T12:06:54.659 INFO:tasks.workunit.client.0.smithi052.stdout:7/90: readlink d1/l1d 0 2024-04-26T12:06:54.660 INFO:tasks.workunit.client.0.smithi052.stdout:0/190: chown d0/l2e 57371999 1 2024-04-26T12:06:54.660 INFO:tasks.workunit.client.0.smithi052.stdout:5/160: chown db/dd/f19 114411926 1 2024-04-26T12:06:54.660 INFO:tasks.workunit.client.0.smithi052.stdout:7/91: dread - d1/fd zero size 2024-04-26T12:06:54.660 INFO:tasks.workunit.client.0.smithi052.stdout:9/169: chown d3/c12 0 1 2024-04-26T12:06:54.660 INFO:tasks.workunit.client.0.smithi052.stdout:0/191: chown d0/d1/d1a 111729516 1 2024-04-26T12:06:54.660 INFO:tasks.workunit.client.0.smithi052.stdout:7/92: chown d1/c13 84 1 2024-04-26T12:06:54.660 INFO:tasks.workunit.client.0.smithi052.stdout:5/161: rmdir db/dd 39 2024-04-26T12:06:54.660 INFO:tasks.workunit.client.0.smithi052.stdout:7/93: creat d1/f20 x:0 0 0 2024-04-26T12:06:54.661 INFO:tasks.workunit.client.0.smithi052.stdout:7/94: read d1/f8 [2640869,56611] 0 2024-04-26T12:06:54.661 INFO:tasks.workunit.client.0.smithi052.stdout:0/192: fsync d0/d1/d11/f31 0 2024-04-26T12:06:54.662 INFO:tasks.workunit.client.0.smithi052.stdout:8/80: read d0/d4/d5/f11 [14136,35104] 0 2024-04-26T12:06:54.663 INFO:tasks.workunit.client.0.smithi052.stdout:4/110: dread d3/d12/f13 [0,4194304] 0 2024-04-26T12:06:54.663 INFO:tasks.workunit.client.0.smithi052.stdout:0/193: rmdir d0/d1/d11 39 2024-04-26T12:06:54.663 INFO:tasks.workunit.client.0.smithi052.stdout:7/95: truncate d1/f6 977933 0 2024-04-26T12:06:54.664 INFO:tasks.workunit.client.0.smithi052.stdout:8/81: rename d0/d4 to d0/d4/d5/db/d12 22 2024-04-26T12:06:54.665 INFO:tasks.workunit.client.0.smithi052.stdout:6/89: truncate da/f12 74087 0 2024-04-26T12:06:54.665 INFO:tasks.workunit.client.0.smithi052.stdout:4/111: creat d3/d15/f2a x:0 0 0 2024-04-26T12:06:54.665 INFO:tasks.workunit.client.0.smithi052.stdout:5/162: dread db/dc/f1d [0,4194304] 0 2024-04-26T12:06:54.667 INFO:tasks.workunit.client.0.smithi052.stdout:6/90: creat da/f1d x:0 0 0 2024-04-26T12:06:54.667 INFO:tasks.workunit.client.0.smithi052.stdout:3/104: truncate d2/fb 538852 0 2024-04-26T12:06:54.668 INFO:tasks.workunit.client.0.smithi052.stdout:9/170: dwrite d3/db/d10/f18 [0,4194304] 0 2024-04-26T12:06:54.669 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:54.667+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:54.669 INFO:tasks.workunit.client.0.smithi052.stdout:6/91: creat da/f1e x:0 0 0 2024-04-26T12:06:54.669 INFO:tasks.workunit.client.0.smithi052.stdout:5/163: mknod db/dd/d18/d1e/d25/c39 0 2024-04-26T12:06:54.670 INFO:tasks.workunit.client.0.smithi052.stdout:9/171: mknod d3/c36 0 2024-04-26T12:06:54.670 INFO:tasks.workunit.client.0.smithi052.stdout:5/164: fsync db/f38 0 2024-04-26T12:06:54.671 INFO:tasks.workunit.client.0.smithi052.stdout:3/105: creat d2/d4/dc/d12/d1c/f20 x:0 0 0 2024-04-26T12:06:54.671 INFO:tasks.workunit.client.0.smithi052.stdout:0/194: dwrite d0/f9 [8388608,4194304] 0 2024-04-26T12:06:54.672 INFO:tasks.workunit.client.0.smithi052.stdout:5/165: chown db/dd/d18/c30 62 1 2024-04-26T12:06:54.672 INFO:tasks.workunit.client.0.smithi052.stdout:8/82: dread d0/d4/d5/f8 [0,4194304] 0 2024-04-26T12:06:54.673 INFO:tasks.workunit.client.0.smithi052.stdout:9/172: write d3/db/d10/f1c [7173546,47914] 0 2024-04-26T12:06:54.673 INFO:tasks.workunit.client.0.smithi052.stdout:3/106: fsync d2/fb 0 2024-04-26T12:06:54.674 INFO:tasks.workunit.client.0.smithi052.stdout:8/83: mknod d0/c13 0 2024-04-26T12:06:54.675 INFO:tasks.workunit.client.0.smithi052.stdout:8/84: readlink d0/d4/l9 0 2024-04-26T12:06:54.675 INFO:tasks.workunit.client.0.smithi052.stdout:5/166: dread db/f26 [0,4194304] 0 2024-04-26T12:06:54.676 INFO:tasks.workunit.client.0.smithi052.stdout:8/85: chown d0 34721 1 2024-04-26T12:06:54.676 INFO:tasks.workunit.client.0.smithi052.stdout:3/107: creat d2/d4/f21 x:0 0 0 2024-04-26T12:06:54.676 INFO:tasks.workunit.client.0.smithi052.stdout:9/173: write d3/db/d2b/f2f [1506688,104224] 0 2024-04-26T12:06:54.677 INFO:tasks.workunit.client.0.smithi052.stdout:1/133: dread d0/d2/dd/f14 [0,4194304] 0 2024-04-26T12:06:54.677 INFO:tasks.workunit.client.0.smithi052.stdout:5/167: chown db/l2b 21306 1 2024-04-26T12:06:54.678 INFO:tasks.workunit.client.0.smithi052.stdout:3/108: write d2/f7 [713050,124676] 0 2024-04-26T12:06:54.678 INFO:tasks.workunit.client.0.smithi052.stdout:6/92: dwrite da/f15 [0,4194304] 0 2024-04-26T12:06:54.679 INFO:tasks.workunit.client.0.smithi052.stdout:8/86: write d0/d4/d5/fe [3363880,49097] 0 2024-04-26T12:06:54.680 INFO:tasks.workunit.client.0.smithi052.stdout:1/134: creat d0/d2/f31 x:0 0 0 2024-04-26T12:06:54.681 INFO:tasks.workunit.client.0.smithi052.stdout:9/174: rename d3/db/d10/c2d to d3/db/d13/c37 0 2024-04-26T12:06:54.681 INFO:tasks.workunit.client.0.smithi052.stdout:3/109: mkdir d2/d1f/d22 0 2024-04-26T12:06:54.681 INFO:tasks.workunit.client.0.smithi052.stdout:1/135: stat d0/d2 0 2024-04-26T12:06:54.683 INFO:tasks.workunit.client.0.smithi052.stdout:3/110: mknod d2/d4/dc/c23 0 2024-04-26T12:06:54.683 INFO:tasks.workunit.client.0.smithi052.stdout:9/175: write d3/db/d10/f18 [3054888,85329] 0 2024-04-26T12:06:54.686 INFO:tasks.workunit.client.0.smithi052.stdout:0/195: dwrite d0/d1/f24 [0,4194304] 0 2024-04-26T12:06:54.688 INFO:tasks.workunit.client.0.smithi052.stdout:8/87: dread d0/d4/d5/f8 [0,4194304] 0 2024-04-26T12:06:54.689 INFO:tasks.workunit.client.0.smithi052.stdout:5/168: dwrite db/dd/d18/d1e/d25/f32 [0,4194304] 0 2024-04-26T12:06:54.690 INFO:tasks.workunit.client.0.smithi052.stdout:8/88: chown d0/d4/d5/f11 414748 1 2024-04-26T12:06:54.691 INFO:tasks.workunit.client.0.smithi052.stdout:6/93: dwrite da/f16 [0,4194304] 0 2024-04-26T12:06:54.691 INFO:tasks.workunit.client.0.smithi052.stdout:6/94: fdatasync da/f1d 0 2024-04-26T12:06:54.691 INFO:tasks.workunit.client.0.smithi052.stdout:0/196: link d0/d1/d1a/d20/f3a d0/d1/f41 0 2024-04-26T12:06:54.691 INFO:tasks.workunit.client.0.smithi052.stdout:3/111: dread d2/ff [0,4194304] 0 2024-04-26T12:06:54.692 INFO:tasks.workunit.client.0.smithi052.stdout:5/169: getdents db 0 2024-04-26T12:06:54.692 INFO:tasks.workunit.client.0.smithi052.stdout:2/162: sync 2024-04-26T12:06:54.692 INFO:tasks.workunit.client.0.smithi052.stdout:7/96: sync 2024-04-26T12:06:54.692 INFO:tasks.workunit.client.0.smithi052.stdout:1/136: read d0/d1e/f28 [4847905,68413] 0 2024-04-26T12:06:54.693 INFO:tasks.workunit.client.0.smithi052.stdout:5/170: fdatasync db/dd/d18/d1e/f36 0 2024-04-26T12:06:54.694 INFO:tasks.workunit.client.0.smithi052.stdout:3/112: mknod d2/d1f/c24 0 2024-04-26T12:06:54.694 INFO:tasks.workunit.client.0.smithi052.stdout:7/97: truncate d1/f9 4403706 0 2024-04-26T12:06:54.694 INFO:tasks.workunit.client.0.smithi052.stdout:1/137: creat d0/d2/dd/f32 x:0 0 0 2024-04-26T12:06:54.695 INFO:tasks.workunit.client.0.smithi052.stdout:0/197: truncate d0/d1/d11/f17 661716 0 2024-04-26T12:06:54.695 INFO:tasks.workunit.client.0.smithi052.stdout:8/89: getdents d0/d4/d5 0 2024-04-26T12:06:54.695 INFO:tasks.workunit.client.0.smithi052.stdout:2/163: symlink d0/d7/d2f/l34 0 2024-04-26T12:06:54.695 INFO:tasks.workunit.client.0.smithi052.stdout:5/171: creat db/dd/d18/d1e/f3a x:0 0 0 2024-04-26T12:06:54.696 INFO:tasks.workunit.client.0.smithi052.stdout:1/138: mknod d0/c33 0 2024-04-26T12:06:54.696 INFO:tasks.workunit.client.0.smithi052.stdout:7/98: unlink d1/l2 0 2024-04-26T12:06:54.698 INFO:tasks.workunit.client.0.smithi052.stdout:5/172: creat db/dd/d18/d1e/f3b x:0 0 0 2024-04-26T12:06:54.699 INFO:tasks.workunit.client.0.smithi052.stdout:1/139: write d0/d1e/f29 [1711074,87175] 0 2024-04-26T12:06:54.699 INFO:tasks.workunit.client.0.smithi052.stdout:0/198: getdents d0/d26 0 2024-04-26T12:06:54.699 INFO:tasks.workunit.client.0.smithi052.stdout:6/95: dwrite da/f1e [0,4194304] 0 2024-04-26T12:06:54.700 INFO:tasks.workunit.client.0.smithi052.stdout:5/173: readlink db/dd/l2d 0 2024-04-26T12:06:54.701 INFO:tasks.workunit.client.0.smithi052.stdout:6/96: symlink da/l1f 0 2024-04-26T12:06:54.702 INFO:tasks.workunit.client.0.smithi052.stdout:1/140: mkdir d0/d2/dd/d34 0 2024-04-26T12:06:54.704 INFO:tasks.workunit.client.0.smithi052.stdout:9/176: dread d3/f7 [0,4194304] 0 2024-04-26T12:06:54.704 INFO:tasks.workunit.client.0.smithi052.stdout:3/113: dwrite d2/f7 [0,4194304] 0 2024-04-26T12:06:54.704 INFO:tasks.workunit.client.0.smithi052.stdout:0/199: getdents d0/d3d 0 2024-04-26T12:06:54.705 INFO:tasks.workunit.client.0.smithi052.stdout:8/90: dread d0/d4/d5/f8 [0,4194304] 0 2024-04-26T12:06:54.706 INFO:tasks.workunit.client.0.smithi052.stdout:5/174: truncate db/dd/f19 1611214 0 2024-04-26T12:06:54.706 INFO:tasks.workunit.client.0.smithi052.stdout:2/164: dread d0/d7/d16/f1a [0,4194304] 0 2024-04-26T12:06:54.706 INFO:tasks.workunit.client.0.smithi052.stdout:0/200: mkdir d0/d1/d2c/d42 0 2024-04-26T12:06:54.707 INFO:tasks.workunit.client.0.smithi052.stdout:2/165: fdatasync d0/f33 0 2024-04-26T12:06:54.707 INFO:tasks.workunit.client.0.smithi052.stdout:9/177: chown d3/l6 279010313 1 2024-04-26T12:06:54.707 INFO:tasks.workunit.client.0.smithi052.stdout:3/114: write d2/fb [1467724,7295] 0 2024-04-26T12:06:54.707 INFO:tasks.workunit.client.0.smithi052.stdout:8/91: chown d0/d4/d5/fe 42 1 2024-04-26T12:06:54.707 INFO:tasks.workunit.client.0.smithi052.stdout:7/99: dwrite d1/d1c/f1e [0,4194304] 0 2024-04-26T12:06:54.707 INFO:tasks.workunit.client.0.smithi052.stdout:6/97: getdents da 0 2024-04-26T12:06:54.707 INFO:tasks.workunit.client.0.smithi052.stdout:9/178: creat d3/db/d10/f38 x:0 0 0 2024-04-26T12:06:54.708 INFO:tasks.workunit.client.0.smithi052.stdout:8/92: write d0/d4/d5/f8 [264658,5278] 0 2024-04-26T12:06:54.708 INFO:tasks.workunit.client.0.smithi052.stdout:6/98: rmdir da 39 2024-04-26T12:06:54.709 INFO:tasks.workunit.client.0.smithi052.stdout:7/100: mkdir d1/d1c/d21 0 2024-04-26T12:06:54.709 INFO:tasks.workunit.client.0.smithi052.stdout:2/166: link d0/d7/c2e d0/d7/c35 0 2024-04-26T12:06:54.710 INFO:tasks.workunit.client.0.smithi052.stdout:3/115: truncate d2/d4/dc/d12/d1c/f20 664530 0 2024-04-26T12:06:54.710 INFO:tasks.workunit.client.0.smithi052.stdout:9/179: mkdir d3/d39 0 2024-04-26T12:06:54.710 INFO:tasks.workunit.client.0.smithi052.stdout:9/180: sync 2024-04-26T12:06:54.710 INFO:tasks.workunit.client.0.smithi052.stdout:1/141: truncate d0/da/f19 2298761 0 2024-04-26T12:06:54.710 INFO:tasks.workunit.client.0.smithi052.stdout:6/99: creat da/f20 x:0 0 0 2024-04-26T12:06:54.712 INFO:tasks.workunit.client.0.smithi052.stdout:7/101: chown d1/lc 22676661 1 2024-04-26T12:06:54.712 INFO:tasks.workunit.client.0.smithi052.stdout:2/167: chown d0/d7/d22/f28 10476 1 2024-04-26T12:06:54.712 INFO:tasks.workunit.client.0.smithi052.stdout:8/93: write d0/d4/d5/f11 [402663,3472] 0 2024-04-26T12:06:54.713 INFO:tasks.workunit.client.0.smithi052.stdout:6/100: symlink da/l21 0 2024-04-26T12:06:54.713 INFO:tasks.workunit.client.0.smithi052.stdout:3/116: rename d2/d1f/d22 to d2/d4/dc/d1d/d25 0 2024-04-26T12:06:54.714 INFO:tasks.workunit.client.0.smithi052.stdout:2/168: chown d0/d7/d16/c27 4221 1 2024-04-26T12:06:54.714 INFO:tasks.workunit.client.0.smithi052.stdout:8/94: creat d0/d4/d5/f14 x:0 0 0 2024-04-26T12:06:54.715 INFO:tasks.workunit.client.0.smithi052.stdout:1/142: getdents d0/d2/dd/d34 0 2024-04-26T12:06:54.716 INFO:tasks.workunit.client.0.smithi052.stdout:6/101: write da/f15 [1132767,126806] 0 2024-04-26T12:06:54.716 INFO:tasks.workunit.client.0.smithi052.stdout:4/112: dread d3/f16 [0,4194304] 0 2024-04-26T12:06:54.716 INFO:tasks.workunit.client.0.smithi052.stdout:0/201: dwrite d0/d3d/f3f [4194304,4194304] 0 2024-04-26T12:06:54.716 INFO:tasks.workunit.client.0.smithi052.stdout:7/102: creat d1/d1f/f22 x:0 0 0 2024-04-26T12:06:54.717 INFO:tasks.workunit.client.0.smithi052.stdout:2/169: write d0/f4 [386028,47833] 0 2024-04-26T12:06:54.717 INFO:tasks.workunit.client.0.smithi052.stdout:3/117: mknod d2/d4/dc/c26 0 2024-04-26T12:06:54.718 INFO:tasks.workunit.client.0.smithi052.stdout:5/175: dwrite db/dd/d18/d1e/f2f [0,4194304] 0 2024-04-26T12:06:54.719 INFO:tasks.workunit.client.0.smithi052.stdout:1/143: readlink d0/d2/l22 0 2024-04-26T12:06:54.719 INFO:tasks.workunit.client.0.smithi052.stdout:6/102: mkdir da/d22 0 2024-04-26T12:06:54.720 INFO:tasks.workunit.client.0.smithi052.stdout:8/95: write d0/d4/d5/f8 [4106086,6767] 0 2024-04-26T12:06:54.720 INFO:tasks.workunit.client.0.smithi052.stdout:7/103: mkdir d1/d1c/d23 0 2024-04-26T12:06:54.720 INFO:tasks.workunit.client.0.smithi052.stdout:9/181: dread d3/db/f20 [0,4194304] 0 2024-04-26T12:06:54.720 INFO:tasks.workunit.client.0.smithi052.stdout:5/176: stat db/dc/c13 0 2024-04-26T12:06:54.721 INFO:tasks.workunit.client.0.smithi052.stdout:2/170: mkdir d0/d36 0 2024-04-26T12:06:54.721 INFO:tasks.workunit.client.0.smithi052.stdout:1/144: dread - d0/d2/f31 zero size 2024-04-26T12:06:54.721 INFO:tasks.workunit.client.0.smithi052.stdout:6/103: write da/f1b [10025,27974] 0 2024-04-26T12:06:54.722 INFO:tasks.workunit.client.0.smithi052.stdout:8/96: mknod d0/d4/d5/c15 0 2024-04-26T12:06:54.722 INFO:tasks.workunit.client.0.smithi052.stdout:9/182: mknod d3/db/c3a 0 2024-04-26T12:06:54.722 INFO:tasks.workunit.client.0.smithi052.stdout:3/118: getdents d2/d4/dc/d1d/d25 0 2024-04-26T12:06:54.723 INFO:tasks.workunit.client.0.smithi052.stdout:2/171: mknod d0/d7/d2f/c37 0 2024-04-26T12:06:54.723 INFO:tasks.workunit.client.0.smithi052.stdout:5/177: symlink db/dd/d18/d1e/l3c 0 2024-04-26T12:06:54.723 INFO:tasks.workunit.client.0.smithi052.stdout:8/97: mkdir d0/d16 0 2024-04-26T12:06:54.723 INFO:tasks.workunit.client.0.smithi052.stdout:1/145: write d0/da/f2f [3624069,45509] 0 2024-04-26T12:06:54.726 INFO:tasks.workunit.client.0.smithi052.stdout:2/172: truncate d0/f1d 143185 0 2024-04-26T12:06:54.726 INFO:tasks.workunit.client.0.smithi052.stdout:7/104: write d1/f8 [4979847,7431] 0 2024-04-26T12:06:54.727 INFO:tasks.workunit.client.0.smithi052.stdout:1/146: chown d0/d2/dd/d1c/d1d/f25 185 1 2024-04-26T12:06:54.727 INFO:tasks.workunit.client.0.smithi052.stdout:5/178: symlink db/dd/d18/d1e/d25/l3d 0 2024-04-26T12:06:54.728 INFO:tasks.workunit.client.0.smithi052.stdout:3/119: getdents d2/d4 0 2024-04-26T12:06:54.728 INFO:tasks.workunit.client.0.smithi052.stdout:0/202: dread d0/d1/dd/f19 [0,4194304] 0 2024-04-26T12:06:54.729 INFO:tasks.workunit.client.0.smithi052.stdout:4/113: read d3/d15/f17 [992984,112984] 0 2024-04-26T12:06:54.729 INFO:tasks.workunit.client.0.smithi052.stdout:7/105: mknod d1/c24 0 2024-04-26T12:06:54.730 INFO:tasks.workunit.client.0.smithi052.stdout:4/114: sync 2024-04-26T12:06:54.730 INFO:tasks.workunit.client.0.smithi052.stdout:3/120: readlink d2/d4/l10 0 2024-04-26T12:06:54.730 INFO:tasks.workunit.client.0.smithi052.stdout:4/115: sync 2024-04-26T12:06:54.730 INFO:tasks.workunit.client.0.smithi052.stdout:1/147: write d0/d1e/f29 [686702,120262] 0 2024-04-26T12:06:54.730 INFO:tasks.workunit.client.0.smithi052.stdout:5/179: mknod db/dd/d18/d1e/d25/c3e 0 2024-04-26T12:06:54.734 INFO:tasks.workunit.client.0.smithi052.stdout:0/203: write d0/f3 [5564875,55422] 0 2024-04-26T12:06:54.734 INFO:tasks.workunit.client.0.smithi052.stdout:4/116: fsync d3/d12/f18 0 2024-04-26T12:06:54.734 INFO:tasks.workunit.client.0.smithi052.stdout:6/104: dwrite da/f1d [0,4194304] 0 2024-04-26T12:06:54.734 INFO:tasks.workunit.client.0.smithi052.stdout:8/98: dread d0/d4/d5/fe [0,4194304] 0 2024-04-26T12:06:54.734 INFO:tasks.workunit.client.0.smithi052.stdout:7/106: creat d1/d1c/d23/f25 x:0 0 0 2024-04-26T12:06:54.734 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:54.735 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:54.735 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:54.735 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:54.735 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:54.735 INFO:tasks.workunit.client.0.smithi052.stdout:1/148: mknod d0/da/d2e/c35 0 2024-04-26T12:06:54.735 INFO:tasks.workunit.client.0.smithi052.stdout:5/180: mkdir db/dd/d18/d1e/d3f 0 2024-04-26T12:06:54.735 INFO:tasks.workunit.client.0.smithi052.stdout:9/183: dwrite d3/db/f20 [4194304,4194304] 0 2024-04-26T12:06:54.736 INFO:tasks.workunit.client.0.smithi052.stdout:4/117: mkdir d3/d2b 0 2024-04-26T12:06:54.739 INFO:tasks.workunit.client.0.smithi052.stdout:7/107: creat d1/d1f/f26 x:0 0 0 2024-04-26T12:06:54.739 INFO:tasks.workunit.client.0.smithi052.stdout:2/173: dwrite d0/f17 [0,4194304] 0 2024-04-26T12:06:54.739 INFO:tasks.workunit.client.0.smithi052.stdout:0/204: getdents d0/d3d 0 2024-04-26T12:06:54.739 INFO:tasks.workunit.client.0.smithi052.stdout:9/184: readlink d3/l5 0 2024-04-26T12:06:54.743 INFO:tasks.workunit.client.0.smithi052.stdout:3/121: dwrite d2/d4/f21 [0,4194304] 0 2024-04-26T12:06:54.743 INFO:tasks.workunit.client.0.smithi052.stdout:9/185: fsync d3/db/d10/f18 0 2024-04-26T12:06:54.743 INFO:tasks.workunit.client.0.smithi052.stdout:0/205: creat d0/d1/d11/f43 x:0 0 0 2024-04-26T12:06:54.744 INFO:tasks.workunit.client.0.smithi052.stdout:2/174: getdents d0 0 2024-04-26T12:06:54.745 INFO:tasks.workunit.client.0.smithi052.stdout:0/206: fsync d0/f3 0 2024-04-26T12:06:54.746 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:54.747 INFO:tasks.workunit.client.0.smithi052.stdout:6/105: dwrite da/ff [0,4194304] 0 2024-04-26T12:06:54.747 INFO:tasks.workunit.client.0.smithi052.stdout:4/118: dread d3/f1c [0,4194304] 0 2024-04-26T12:06:54.748 INFO:tasks.workunit.client.0.smithi052.stdout:9/186: chown d3/db/d24/f2c 0 1 2024-04-26T12:06:54.748 INFO:tasks.workunit.client.0.smithi052.stdout:8/99: dwrite d0/d4/d5/f14 [0,4194304] 0 2024-04-26T12:06:54.748 INFO:tasks.workunit.client.0.smithi052.stdout:2/175: chown d0/d7/d16/c27 79811217 1 2024-04-26T12:06:54.748 INFO:tasks.workunit.client.0.smithi052.stdout:1/149: dwrite d0/da/f2f [4194304,4194304] 0 2024-04-26T12:06:54.748 INFO:tasks.workunit.client.0.smithi052.stdout:3/122: write d2/d4/dc/f1b [145127,44262] 0 2024-04-26T12:06:54.748 INFO:tasks.workunit.client.0.smithi052.stdout:6/106: write da/ff [2824893,21393] 0 2024-04-26T12:06:54.750 INFO:tasks.workunit.client.0.smithi052.stdout:3/123: symlink d2/d4/dc/l27 0 2024-04-26T12:06:54.750 INFO:tasks.workunit.client.0.smithi052.stdout:1/150: symlink d0/d2/dd/l36 0 2024-04-26T12:06:54.751 INFO:tasks.workunit.client.0.smithi052.stdout:6/107: dread f9 [0,4194304] 0 2024-04-26T12:06:54.752 INFO:tasks.workunit.client.0.smithi052.stdout:8/100: read d0/d4/d5/f8 [235297,88637] 0 2024-04-26T12:06:54.753 INFO:tasks.workunit.client.0.smithi052.stdout:0/207: link d0/d1/d1a/d2a/d32/l33 d0/d1/d11/l44 0 2024-04-26T12:06:54.754 INFO:tasks.workunit.client.0.smithi052.stdout:3/124: creat d2/d4/dc/f28 x:0 0 0 2024-04-26T12:06:54.754 INFO:tasks.workunit.client.0.smithi052.stdout:6/108: symlink da/l23 0 2024-04-26T12:06:54.755 INFO:tasks.workunit.client.0.smithi052.stdout:1/151: creat d0/d2/dd/d1c/d1d/f37 x:0 0 0 2024-04-26T12:06:54.755 INFO:tasks.workunit.client.0.smithi052.stdout:5/181: sync 2024-04-26T12:06:54.755 INFO:tasks.workunit.client.0.smithi052.stdout:0/208: creat d0/f45 x:0 0 0 2024-04-26T12:06:54.760 INFO:tasks.workunit.client.0.smithi052.stdout:2/176: dwrite d0/f17 [0,4194304] 0 2024-04-26T12:06:54.760 INFO:tasks.workunit.client.0.smithi052.stdout:0/209: fdatasync d0/d1/d11/f17 0 2024-04-26T12:06:54.762 INFO:tasks.workunit.client.0.smithi052.stdout:4/119: dwrite d3/d1f/f24 [0,4194304] 0 2024-04-26T12:06:54.762 INFO:tasks.workunit.client.0.smithi052.stdout:0/210: readlink d0/la 0 2024-04-26T12:06:54.763 INFO:tasks.workunit.client.0.smithi052.stdout:9/187: dwrite d3/db/f20 [4194304,4194304] 0 2024-04-26T12:06:54.764 INFO:tasks.workunit.client.0.smithi052.stdout:7/108: dread d1/f14 [0,4194304] 0 2024-04-26T12:06:54.764 INFO:tasks.workunit.client.0.smithi052.stdout:2/177: creat d0/d7/d16/f38 x:0 0 0 2024-04-26T12:06:54.766 INFO:tasks.workunit.client.0.smithi052.stdout:0/211: write d0/f45 [591168,126155] 0 2024-04-26T12:06:54.766 INFO:tasks.workunit.client.0.smithi052.stdout:4/120: write d3/d1f/f25 [504095,111601] 0 2024-04-26T12:06:54.767 INFO:tasks.workunit.client.0.smithi052.stdout:3/125: fsync d2/d4/dc/f28 0 2024-04-26T12:06:54.768 INFO:tasks.workunit.client.0.smithi052.stdout:6/109: dwrite da/ff [4194304,4194304] 0 2024-04-26T12:06:54.768 INFO:tasks.workunit.client.0.smithi052.stdout:8/101: dwrite d0/d4/d5/f8 [0,4194304] 0 2024-04-26T12:06:54.768 INFO:tasks.workunit.client.0.smithi052.stdout:0/212: fdatasync d0/fe 0 2024-04-26T12:06:54.769 INFO:tasks.workunit.client.0.smithi052.stdout:9/188: getdents d3/db/d32 0 2024-04-26T12:06:54.769 INFO:tasks.workunit.client.0.smithi052.stdout:2/178: chown d0/d7/d16/c18 15555 1 2024-04-26T12:06:54.770 INFO:tasks.workunit.client.0.smithi052.stdout:4/121: write d3/f1c [1780926,55335] 0 2024-04-26T12:06:54.770 INFO:tasks.workunit.client.0.smithi052.stdout:7/109: creat d1/f27 x:0 0 0 2024-04-26T12:06:54.770 INFO:tasks.workunit.client.0.smithi052.stdout:1/152: dwrite d0/d2/f24 [0,4194304] 0 2024-04-26T12:06:54.770 INFO:tasks.workunit.client.0.smithi052.stdout:5/182: dwrite db/dc/f12 [0,4194304] 0 2024-04-26T12:06:54.770 INFO:tasks.workunit.client.0.smithi052.stdout:2/179: fdatasync d0/f12 0 2024-04-26T12:06:54.772 INFO:tasks.workunit.client.0.smithi052.stdout:8/102: write d0/d4/d5/f14 [1453809,34153] 0 2024-04-26T12:06:54.773 INFO:tasks.workunit.client.0.smithi052.stdout:7/110: chown d1/f8 26 1 2024-04-26T12:06:54.773 INFO:tasks.workunit.client.0.smithi052.stdout:9/189: write d3/db/d2b/f2f [2182749,9928] 0 2024-04-26T12:06:54.779 INFO:tasks.workunit.client.0.smithi052.stdout:7/111: write d1/d1c/d23/f25 [72015,101532] 0 2024-04-26T12:06:54.780 INFO:tasks.workunit.client.0.smithi052.stdout:2/180: creat d0/d7/f39 x:0 0 0 2024-04-26T12:06:54.780 INFO:tasks.workunit.client.0.smithi052.stdout:1/153: unlink d0/d2/dd/d1c/d1d/f25 0 2024-04-26T12:06:54.780 INFO:tasks.workunit.client.0.smithi052.stdout:2/181: dread - d0/d7/f31 zero size 2024-04-26T12:06:54.780 INFO:tasks.workunit.client.0.smithi052.stdout:9/190: rename d3/db/d32 to d3/d3b 0 2024-04-26T12:06:54.780 INFO:tasks.workunit.client.0.smithi052.stdout:7/112: write d1/fa [1255804,17823] 0 2024-04-26T12:06:54.780 INFO:tasks.workunit.client.0.smithi052.stdout:6/110: dwrite f2 [0,4194304] 0 2024-04-26T12:06:54.780 INFO:tasks.workunit.client.0.smithi052.stdout:2/182: chown d0/f5 399262323 1 2024-04-26T12:06:54.780 INFO:tasks.workunit.client.0.smithi052.stdout:0/213: dwrite d0/d1/f12 [4194304,4194304] 0 2024-04-26T12:06:54.781 INFO:tasks.workunit.client.0.smithi052.stdout:1/154: rename d0/d1e/f28 to d0/d2/dd/d1c/d1d/d23/f38 0 2024-04-26T12:06:54.781 INFO:tasks.workunit.client.0.smithi052.stdout:7/113: symlink d1/d1c/d23/l28 0 2024-04-26T12:06:54.782 INFO:tasks.workunit.client.0.smithi052.stdout:2/183: mkdir d0/d7/d16/d3a 0 2024-04-26T12:06:54.782 INFO:tasks.workunit.client.0.smithi052.stdout:7/114: fsync d1/d1c/f1e 0 2024-04-26T12:06:54.783 INFO:tasks.workunit.client.0.smithi052.stdout:8/103: dread d0/d4/d5/f8 [0,4194304] 0 2024-04-26T12:06:54.783 INFO:tasks.workunit.client.0.smithi052.stdout:0/214: link d0/c39 d0/d1/d1a/d3b/c46 0 2024-04-26T12:06:54.784 INFO:tasks.workunit.client.0.smithi052.stdout:7/115: getdents d1/d1f 0 2024-04-26T12:06:54.784 INFO:tasks.workunit.client.0.smithi052.stdout:6/111: dread da/f1d [0,4194304] 0 2024-04-26T12:06:54.784 INFO:tasks.workunit.client.0.smithi052.stdout:7/116: chown d1/f18 101883767 1 2024-04-26T12:06:54.785 INFO:tasks.workunit.client.0.smithi052.stdout:8/104: fsync d0/d4/d5/f8 0 2024-04-26T12:06:54.786 INFO:tasks.workunit.client.0.smithi052.stdout:7/117: creat d1/d1c/f29 x:0 0 0 2024-04-26T12:06:54.786 INFO:tasks.workunit.client.0.smithi052.stdout:8/105: creat d0/d4/f17 x:0 0 0 2024-04-26T12:06:54.786 INFO:tasks.workunit.client.0.smithi052.stdout:6/112: getdents da 0 2024-04-26T12:06:54.786 INFO:tasks.workunit.client.0.smithi052.stdout:6/113: unlink da/l1f 0 2024-04-26T12:06:54.786 INFO:tasks.workunit.client.0.smithi052.stdout:7/118: symlink d1/d1f/l2a 0 2024-04-26T12:06:54.787 INFO:tasks.workunit.client.0.smithi052.stdout:6/114: dread - da/f11 zero size 2024-04-26T12:06:54.787 INFO:tasks.workunit.client.0.smithi052.stdout:3/126: read d2/d4/dc/d12/d1c/f20 [541654,6719] 0 2024-04-26T12:06:54.787 INFO:tasks.workunit.client.0.smithi052.stdout:7/119: readlink d1/d1c/d23/l28 0 2024-04-26T12:06:54.787 INFO:tasks.workunit.client.0.smithi052.stdout:4/122: read d3/f14 [728405,74666] 0 2024-04-26T12:06:54.788 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:54.786+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:54.788 INFO:tasks.workunit.client.0.smithi052.stdout:3/127: read d2/d4/dc/d12/f1e [2194231,26820] 0 2024-04-26T12:06:54.788 INFO:tasks.workunit.client.0.smithi052.stdout:4/123: symlink d3/d12/l2c 0 2024-04-26T12:06:54.789 INFO:tasks.workunit.client.0.smithi052.stdout:4/124: write d3/d1f/f25 [1222396,115120] 0 2024-04-26T12:06:54.790 INFO:tasks.workunit.client.0.smithi052.stdout:1/155: fsync d0/d2/f2a 0 2024-04-26T12:06:54.793 INFO:tasks.workunit.client.0.smithi052.stdout:1/156: write d0/d2/f6 [4438993,25353] 0 2024-04-26T12:06:54.793 INFO:tasks.workunit.client.0.smithi052.stdout:4/125: mknod d3/d1f/d21/c2d 0 2024-04-26T12:06:54.793 INFO:tasks.workunit.client.0.smithi052.stdout:8/106: dwrite d0/d4/f17 [0,4194304] 0 2024-04-26T12:06:54.794 INFO:tasks.workunit.client.0.smithi052.stdout:7/120: rmdir d1/d1c 39 2024-04-26T12:06:54.795 INFO:tasks.workunit.client.0.smithi052.stdout:6/115: dwrite da/f16 [4194304,4194304] 0 2024-04-26T12:06:54.796 INFO:tasks.workunit.client.0.smithi052.stdout:4/126: mkdir d3/d2e 0 2024-04-26T12:06:54.796 INFO:tasks.workunit.client.0.smithi052.stdout:8/107: symlink d0/d4/d5/l18 0 2024-04-26T12:06:54.797 INFO:tasks.workunit.client.0.smithi052.stdout:6/116: stat da/le 0 2024-04-26T12:06:54.798 INFO:tasks.workunit.client.0.smithi052.stdout:3/128: dwrite d2/fb [0,4194304] 0 2024-04-26T12:06:54.798 INFO:tasks.workunit.client.0.smithi052.stdout:7/121: creat d1/d1c/d21/f2b x:0 0 0 2024-04-26T12:06:54.799 INFO:tasks.workunit.client.0.smithi052.stdout:3/129: creat d2/f29 x:0 0 0 2024-04-26T12:06:54.800 INFO:tasks.workunit.client.0.smithi052.stdout:4/127: getdents d3/d22 0 2024-04-26T12:06:54.800 INFO:tasks.workunit.client.0.smithi052.stdout:7/122: write d1/f18 [1756169,120417] 0 2024-04-26T12:06:54.801 INFO:tasks.workunit.client.0.smithi052.stdout:2/184: dread d0/f1d [0,4194304] 0 2024-04-26T12:06:54.803 INFO:tasks.workunit.client.0.smithi052.stdout:1/157: dwrite d0/d1e/f29 [0,4194304] 0 2024-04-26T12:06:54.804 INFO:tasks.workunit.client.0.smithi052.stdout:4/128: creat d3/f2f x:0 0 0 2024-04-26T12:06:54.804 INFO:tasks.workunit.client.0.smithi052.stdout:2/185: truncate d0/f1d 237210 0 2024-04-26T12:06:54.805 INFO:tasks.workunit.client.0.smithi052.stdout:4/129: truncate d3/fd 101797 0 2024-04-26T12:06:54.805 INFO:tasks.workunit.client.0.smithi052.stdout:7/123: write d1/f6 [1203469,94377] 0 2024-04-26T12:06:54.805 INFO:tasks.workunit.client.0.smithi052.stdout:4/130: mkdir d3/d22/d30 0 2024-04-26T12:06:54.805 INFO:tasks.workunit.client.0.smithi052.stdout:7/124: readlink d1/lc 0 2024-04-26T12:06:54.806 INFO:tasks.workunit.client.0.smithi052.stdout:7/125: chown d1/f12 27336 1 2024-04-26T12:06:54.807 INFO:tasks.workunit.client.0.smithi052.stdout:4/131: getdents d3/d2e 0 2024-04-26T12:06:54.807 INFO:tasks.workunit.client.0.smithi052.stdout:7/126: fsync d1/f10 0 2024-04-26T12:06:54.807 INFO:tasks.workunit.client.0.smithi052.stdout:3/130: dwrite d2/d4/dc/f1b [0,4194304] 0 2024-04-26T12:06:54.808 INFO:tasks.workunit.client.0.smithi052.stdout:1/158: truncate d0/d2/dd/f14 994093 0 2024-04-26T12:06:54.808 INFO:tasks.workunit.client.0.smithi052.stdout:4/132: symlink d3/d2e/l31 0 2024-04-26T12:06:54.808 INFO:tasks.workunit.client.0.smithi052.stdout:9/191: sync 2024-04-26T12:06:54.808 INFO:tasks.workunit.client.0.smithi052.stdout:6/117: sync 2024-04-26T12:06:54.809 INFO:tasks.workunit.client.0.smithi052.stdout:3/131: mkdir d2/d4/d2a 0 2024-04-26T12:06:54.809 INFO:tasks.workunit.client.0.smithi052.stdout:6/118: chown l3 435 1 2024-04-26T12:06:54.810 INFO:tasks.workunit.client.0.smithi052.stdout:4/133: creat d3/d1f/d21/f32 x:0 0 0 2024-04-26T12:06:54.810 INFO:tasks.workunit.client.0.smithi052.stdout:7/127: write d1/f17 [748901,78323] 0 2024-04-26T12:06:54.810 INFO:tasks.workunit.client.0.smithi052.stdout:9/192: mkdir d3/db/d10/d3c 0 2024-04-26T12:06:54.810 INFO:tasks.workunit.client.0.smithi052.stdout:3/132: readlink d2/d4/dc/l27 0 2024-04-26T12:06:54.810 INFO:tasks.workunit.client.0.smithi052.stdout:1/159: rename d0/d2/de/l11 to d0/d2/dd/l39 0 2024-04-26T12:06:54.810 INFO:tasks.workunit.client.0.smithi052.stdout:4/134: chown d3/fb 3 1 2024-04-26T12:06:54.811 INFO:tasks.workunit.client.0.smithi052.stdout:6/119: creat da/d22/f24 x:0 0 0 2024-04-26T12:06:54.811 INFO:tasks.workunit.client.0.smithi052.stdout:9/193: write d3/db/d24/f2c [4287278,94490] 0 2024-04-26T12:06:54.811 INFO:tasks.workunit.client.0.smithi052.stdout:4/135: symlink d3/l33 0 2024-04-26T12:06:54.812 INFO:tasks.workunit.client.0.smithi052.stdout:6/120: link da/f13 da/d22/f25 0 2024-04-26T12:06:54.812 INFO:tasks.workunit.client.0.smithi052.stdout:4/136: readlink d3/l33 0 2024-04-26T12:06:54.813 INFO:tasks.workunit.client.0.smithi052.stdout:6/121: truncate da/ff 9167611 0 2024-04-26T12:06:54.813 INFO:tasks.workunit.client.0.smithi052.stdout:4/137: mkdir d3/d12/d34 0 2024-04-26T12:06:54.813 INFO:tasks.workunit.client.0.smithi052.stdout:8/108: fsync d0/d4/f17 0 2024-04-26T12:06:54.813 INFO:tasks.workunit.client.0.smithi052.stdout:6/122: stat da 0 2024-04-26T12:06:54.813 INFO:tasks.workunit.client.0.smithi052.stdout:4/138: chown d3/d15 1754320808 1 2024-04-26T12:06:54.814 INFO:tasks.workunit.client.0.smithi052.stdout:6/123: symlink da/l26 0 2024-04-26T12:06:54.814 INFO:tasks.workunit.client.0.smithi052.stdout:4/139: write d3/d12/f20 [525720,107544] 0 2024-04-26T12:06:54.815 INFO:tasks.workunit.client.0.smithi052.stdout:2/186: read d0/fa [4116563,65217] 0 2024-04-26T12:06:54.815 INFO:tasks.workunit.client.0.smithi052.stdout:6/124: rename da/f15 to da/d22/f27 0 2024-04-26T12:06:54.816 INFO:tasks.workunit.client.0.smithi052.stdout:7/128: dwrite d1/f20 [0,4194304] 0 2024-04-26T12:06:54.817 INFO:tasks.workunit.client.0.smithi052.stdout:4/140: chown d3/fb 0 1 2024-04-26T12:06:54.817 INFO:tasks.workunit.client.0.smithi052.stdout:0/215: dread d0/d1/dd/f28 [0,4194304] 0 2024-04-26T12:06:54.817 INFO:tasks.workunit.client.0.smithi052.stdout:9/194: truncate d3/db/d10/f1c 6137818 0 2024-04-26T12:06:54.817 INFO:tasks.workunit.client.0.smithi052.stdout:2/187: fsync d0/d7/d16/f1a 0 2024-04-26T12:06:54.817 INFO:tasks.workunit.client.0.smithi052.stdout:4/141: dread - d3/f2f zero size 2024-04-26T12:06:54.817 INFO:tasks.workunit.client.0.smithi052.stdout:9/195: read d3/db/d10/f18 [3162660,87966] 0 2024-04-26T12:06:54.817 INFO:tasks.workunit.client.0.smithi052.stdout:7/129: creat d1/d1c/d23/f2c x:0 0 0 2024-04-26T12:06:54.818 INFO:tasks.workunit.client.0.smithi052.stdout:2/188: mknod d0/d7/d2f/c3b 0 2024-04-26T12:06:54.818 INFO:tasks.workunit.client.0.smithi052.stdout:6/125: link da/l26 da/d22/l28 0 2024-04-26T12:06:54.818 INFO:tasks.workunit.client.0.smithi052.stdout:0/216: mkdir d0/d1/d1a/d20/d47 0 2024-04-26T12:06:54.819 INFO:tasks.workunit.client.0.smithi052.stdout:6/126: mkdir da/d22/d29 0 2024-04-26T12:06:54.819 INFO:tasks.workunit.client.0.smithi052.stdout:7/130: unlink d1/d1c/f29 0 2024-04-26T12:06:54.819 INFO:tasks.workunit.client.0.smithi052.stdout:0/217: write d0/f3 [13010543,27352] 0 2024-04-26T12:06:54.819 INFO:tasks.workunit.client.0.smithi052.stdout:2/189: creat d0/d7/f3c x:0 0 0 2024-04-26T12:06:54.820 INFO:tasks.workunit.client.0.smithi052.stdout:6/127: chown da/l21 106894878 1 2024-04-26T12:06:54.821 INFO:tasks.workunit.client.0.smithi052.stdout:7/131: rename d1/d1c/d23/l28 to d1/d1f/l2d 0 2024-04-26T12:06:54.822 INFO:tasks.workunit.client.0.smithi052.stdout:2/190: getdents d0/d7/d22 0 2024-04-26T12:06:54.822 INFO:tasks.workunit.client.0.smithi052.stdout:7/132: creat d1/d1c/d21/f2e x:0 0 0 2024-04-26T12:06:54.823 INFO:tasks.workunit.client.0.smithi052.stdout:9/196: dread d3/db/d10/f18 [0,4194304] 0 2024-04-26T12:06:54.823 INFO:tasks.workunit.client.0.smithi052.stdout:4/142: dwrite d3/d12/f20 [0,4194304] 0 2024-04-26T12:06:54.824 INFO:tasks.workunit.client.0.smithi052.stdout:9/197: mknod d3/c3d 0 2024-04-26T12:06:54.825 INFO:tasks.workunit.client.0.smithi052.stdout:6/128: dread da/f1d [0,4194304] 0 2024-04-26T12:06:54.825 INFO:tasks.workunit.client.0.smithi052.stdout:2/191: read d0/f5 [1402372,99477] 0 2024-04-26T12:06:54.825 INFO:tasks.workunit.client.0.smithi052.stdout:9/198: fdatasync d3/db/d2b/f2f 0 2024-04-26T12:06:54.825 INFO:tasks.workunit.client.0.smithi052.stdout:2/192: chown d0 41 1 2024-04-26T12:06:54.826 INFO:tasks.workunit.client.0.smithi052.stdout:9/199: fdatasync d3/db/d10/f18 0 2024-04-26T12:06:54.827 INFO:tasks.workunit.client.0.smithi052.stdout:3/133: fdatasync d2/d4/dc/f1b 0 2024-04-26T12:06:54.827 INFO:tasks.workunit.client.0.smithi052.stdout:2/193: dread d0/f1d [0,4194304] 0 2024-04-26T12:06:54.828 INFO:tasks.workunit.client.0.smithi052.stdout:4/143: truncate d3/d15/f17 933222 0 2024-04-26T12:06:54.828 INFO:tasks.workunit.client.0.smithi052.stdout:9/200: read d3/db/d10/f18 [1108054,39719] 0 2024-04-26T12:06:54.829 INFO:tasks.workunit.client.0.smithi052.stdout:9/201: creat d3/d3b/f3e x:0 0 0 2024-04-26T12:06:54.830 INFO:tasks.workunit.client.0.smithi052.stdout:4/144: write d3/f14 [864220,102896] 0 2024-04-26T12:06:54.830 INFO:tasks.workunit.client.0.smithi052.stdout:7/133: dwrite d1/d1c/d23/f25 [0,4194304] 0 2024-04-26T12:06:54.830 INFO:tasks.workunit.client.0.smithi052.stdout:2/194: truncate d0/d7/d16/f30 82002 0 2024-04-26T12:06:54.831 INFO:tasks.workunit.client.0.smithi052.stdout:9/202: mknod d3/db/d24/c3f 0 2024-04-26T12:06:54.831 INFO:tasks.workunit.client.0.smithi052.stdout:6/129: dread da/ff [0,4194304] 0 2024-04-26T12:06:54.832 INFO:tasks.workunit.client.0.smithi052.stdout:4/145: getdents d3/d2b 0 2024-04-26T12:06:54.832 INFO:tasks.workunit.client.0.smithi052.stdout:6/130: read da/ff [1733973,8995] 0 2024-04-26T12:06:54.832 INFO:tasks.workunit.client.0.smithi052.stdout:3/134: truncate d2/fb 3368047 0 2024-04-26T12:06:54.832 INFO:tasks.workunit.client.0.smithi052.stdout:5/183: dread db/f1f [0,4194304] 0 2024-04-26T12:06:54.834 INFO:tasks.workunit.client.0.smithi052.stdout:3/135: write d2/d4/dc/f28 [992130,108010] 0 2024-04-26T12:06:54.834 INFO:tasks.workunit.client.0.smithi052.stdout:6/131: symlink da/d22/d29/l2a 0 2024-04-26T12:06:54.835 INFO:tasks.workunit.client.0.smithi052.stdout:6/132: unlink da/cc 0 2024-04-26T12:06:54.836 INFO:tasks.workunit.client.0.smithi052.stdout:6/133: symlink da/d22/d29/l2b 0 2024-04-26T12:06:54.836 INFO:tasks.workunit.client.0.smithi052.stdout:3/136: getdents d2/d4 0 2024-04-26T12:06:54.837 INFO:tasks.workunit.client.0.smithi052.stdout:2/195: dwrite d0/d7/d16/f1e [0,4194304] 0 2024-04-26T12:06:54.837 INFO:tasks.workunit.client.0.smithi052.stdout:6/134: creat da/d22/f2c x:0 0 0 2024-04-26T12:06:54.838 INFO:tasks.workunit.client.0.smithi052.stdout:6/135: read da/f16 [2548247,40310] 0 2024-04-26T12:06:54.839 INFO:tasks.workunit.client.0.smithi052.stdout:2/196: write d0/d7/d16/f24 [801282,97581] 0 2024-04-26T12:06:54.839 INFO:tasks.workunit.client.0.smithi052.stdout:4/146: dwrite d3/f16 [0,4194304] 0 2024-04-26T12:06:54.840 INFO:tasks.workunit.client.0.smithi052.stdout:4/147: stat d3/l11 0 2024-04-26T12:06:54.840 INFO:tasks.workunit.client.0.smithi052.stdout:2/197: mkdir d0/d7/d2f/d3d 0 2024-04-26T12:06:54.841 INFO:tasks.workunit.client.0.smithi052.stdout:9/203: write d3/db/d13/f29 [1941150,15299] 0 2024-04-26T12:06:54.842 INFO:tasks.workunit.client.0.smithi052.stdout:2/198: creat d0/d7/d2f/d3d/f3e x:0 0 0 2024-04-26T12:06:54.843 INFO:tasks.workunit.client.0.smithi052.stdout:3/137: dwrite d2/f29 [0,4194304] 0 2024-04-26T12:06:54.844 INFO:tasks.workunit.client.0.smithi052.stdout:2/199: chown d0/d7/c2e 10788 1 2024-04-26T12:06:54.844 INFO:tasks.workunit.client.0.smithi052.stdout:5/184: write db/dd/f19 [1740599,24384] 0 2024-04-26T12:06:54.845 INFO:tasks.workunit.client.0.smithi052.stdout:6/136: dread da/d22/f27 [0,4194304] 0 2024-04-26T12:06:54.845 INFO:tasks.workunit.client.0.smithi052.stdout:3/138: creat d2/d4/dc/d1d/d25/f2b x:0 0 0 2024-04-26T12:06:54.846 INFO:tasks.workunit.client.0.smithi052.stdout:2/200: mkdir d0/d3f 0 2024-04-26T12:06:54.846 INFO:tasks.workunit.client.0.smithi052.stdout:4/148: fsync d3/d12/f20 0 2024-04-26T12:06:54.846 INFO:tasks.workunit.client.0.smithi052.stdout:6/137: chown da/d22/f25 1548 1 2024-04-26T12:06:54.846 INFO:tasks.workunit.client.0.smithi052.stdout:5/185: mkdir db/dd/d18/d1e/d40 0 2024-04-26T12:06:54.847 INFO:tasks.workunit.client.0.smithi052.stdout:3/139: unlink d2/d4/dc/c23 0 2024-04-26T12:06:54.848 INFO:tasks.workunit.client.0.smithi052.stdout:4/149: truncate d3/fd 1064505 0 2024-04-26T12:06:54.848 INFO:tasks.workunit.client.0.smithi052.stdout:3/140: creat d2/d1f/f2c x:0 0 0 2024-04-26T12:06:54.848 INFO:tasks.workunit.client.0.smithi052.stdout:5/186: rename db/dd/d18/d1e/d25/c3e to db/dd/c41 0 2024-04-26T12:06:54.849 INFO:tasks.workunit.client.0.smithi052.stdout:9/204: dwrite d3/db/f20 [0,4194304] 0 2024-04-26T12:06:54.849 INFO:tasks.workunit.client.0.smithi052.stdout:2/201: fdatasync d0/d7/d2f/d3d/f3e 0 2024-04-26T12:06:54.850 INFO:tasks.workunit.client.0.smithi052.stdout:1/160: sync 2024-04-26T12:06:54.850 INFO:tasks.workunit.client.0.smithi052.stdout:5/187: unlink db/dd/d18/d1e/d25/l3d 0 2024-04-26T12:06:54.850 INFO:tasks.workunit.client.0.smithi052.stdout:8/109: sync 2024-04-26T12:06:54.851 INFO:tasks.workunit.client.0.smithi052.stdout:7/134: sync 2024-04-26T12:06:54.851 INFO:tasks.workunit.client.0.smithi052.stdout:0/218: sync 2024-04-26T12:06:54.851 INFO:tasks.workunit.client.0.smithi052.stdout:6/138: read da/f12 [23582,127863] 0 2024-04-26T12:06:54.852 INFO:tasks.workunit.client.0.smithi052.stdout:9/205: mkdir d3/db/d10/d3c/d40 0 2024-04-26T12:06:54.852 INFO:tasks.workunit.client.0.smithi052.stdout:1/161: mkdir d0/da/d3a 0 2024-04-26T12:06:54.852 INFO:tasks.workunit.client.0.smithi052.stdout:2/202: getdents d0/d7/d16 0 2024-04-26T12:06:54.852 INFO:tasks.workunit.client.0.smithi052.stdout:5/188: mkdir db/dc/d29/d42 0 2024-04-26T12:06:54.853 INFO:tasks.workunit.client.0.smithi052.stdout:7/135: chown d1/f12 32 1 2024-04-26T12:06:54.853 INFO:tasks.workunit.client.0.smithi052.stdout:1/162: chown d0/d2/dd/l36 383 1 2024-04-26T12:06:54.853 INFO:tasks.workunit.client.0.smithi052.stdout:6/139: creat da/d22/f2d x:0 0 0 2024-04-26T12:06:54.854 INFO:tasks.workunit.client.0.smithi052.stdout:9/206: symlink d3/d1b/l41 0 2024-04-26T12:06:54.854 INFO:tasks.workunit.client.0.smithi052.stdout:5/189: unlink db/f10 0 2024-04-26T12:06:54.854 INFO:tasks.workunit.client.0.smithi052.stdout:0/219: symlink d0/d1/d1a/d20/d47/l48 0 2024-04-26T12:06:54.855 INFO:tasks.workunit.client.0.smithi052.stdout:7/136: mkdir d1/d1c/d21/d2f 0 2024-04-26T12:06:54.856 INFO:tasks.workunit.client.0.smithi052.stdout:4/150: dwrite d3/fd [0,4194304] 0 2024-04-26T12:06:54.856 INFO:tasks.workunit.client.0.smithi052.stdout:3/141: dread d2/d4/f21 [0,4194304] 0 2024-04-26T12:06:54.856 INFO:tasks.workunit.client.0.smithi052.stdout:1/163: write d0/d2/dd/d1c/d1d/d23/f38 [260763,21493] 0 2024-04-26T12:06:54.857 INFO:tasks.workunit.client.0.smithi052.stdout:4/151: rmdir d3/d1f 39 2024-04-26T12:06:54.858 INFO:tasks.workunit.client.0.smithi052.stdout:9/207: creat d3/db/d10/d3c/d40/f42 x:0 0 0 2024-04-26T12:06:54.859 INFO:tasks.workunit.client.0.smithi052.stdout:8/110: dread d0/d4/d5/f11 [0,4194304] 0 2024-04-26T12:06:54.859 INFO:tasks.workunit.client.0.smithi052.stdout:2/203: truncate d0/f6 341409 0 2024-04-26T12:06:54.859 INFO:tasks.workunit.client.0.smithi052.stdout:6/140: dread da/ff [4194304,4194304] 0 2024-04-26T12:06:54.861 INFO:tasks.workunit.client.0.smithi052.stdout:0/220: getdents d0/d1/d1a/d20/d47 0 2024-04-26T12:06:54.861 INFO:tasks.workunit.client.0.smithi052.stdout:9/208: mkdir d3/db/d2b/d43 0 2024-04-26T12:06:54.861 INFO:tasks.workunit.client.0.smithi052.stdout:6/141: write da/d22/f2c [795475,5175] 0 2024-04-26T12:06:54.861 INFO:tasks.workunit.client.0.smithi052.stdout:2/204: creat d0/d7/d16/f40 x:0 0 0 2024-04-26T12:06:54.861 INFO:tasks.workunit.client.0.smithi052.stdout:8/111: unlink d0/d4/dc/cd 0 2024-04-26T12:06:54.861 INFO:tasks.workunit.client.0.smithi052.stdout:5/190: mknod db/dc/d29/c43 0 2024-04-26T12:06:54.862 INFO:tasks.workunit.client.0.smithi052.stdout:3/142: getdents d2/d4/dc/d12 0 2024-04-26T12:06:54.862 INFO:tasks.workunit.client.0.smithi052.stdout:0/221: read d0/f45 [311079,28442] 0 2024-04-26T12:06:54.863 INFO:tasks.workunit.client.0.smithi052.stdout:8/112: mknod d0/d4/d5/db/c19 0 2024-04-26T12:06:54.863 INFO:tasks.workunit.client.0.smithi052.stdout:3/143: mkdir d2/d4/d2a/d2d 0 2024-04-26T12:06:54.864 INFO:tasks.workunit.client.0.smithi052.stdout:5/191: write db/f1f [1309615,6355] 0 2024-04-26T12:06:54.865 INFO:tasks.workunit.client.0.smithi052.stdout:2/205: dread d0/d7/d16/f1a [0,4194304] 0 2024-04-26T12:06:54.865 INFO:tasks.workunit.client.0.smithi052.stdout:0/222: creat d0/f49 x:0 0 0 2024-04-26T12:06:54.865 INFO:tasks.workunit.client.0.smithi052.stdout:9/209: link d3/ca d3/db/d13/c44 0 2024-04-26T12:06:54.868 INFO:tasks.workunit.client.0.smithi052.stdout:1/164: dwrite d0/d2/dd/f14 [0,4194304] 0 2024-04-26T12:06:54.868 INFO:tasks.workunit.client.0.smithi052.stdout:0/223: creat d0/d1/d11/f4a x:0 0 0 2024-04-26T12:06:54.868 INFO:tasks.workunit.client.0.smithi052.stdout:9/210: chown d3/l5 138181 1 2024-04-26T12:06:54.868 INFO:tasks.workunit.client.0.smithi052.stdout:2/206: write d0/d7/d16/f1a [1074482,18553] 0 2024-04-26T12:06:54.870 INFO:tasks.workunit.client.0.smithi052.stdout:4/152: truncate d3/d12/f13 1748053 0 2024-04-26T12:06:54.870 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:54.868+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:54.872 INFO:tasks.workunit.client.0.smithi052.stdout:6/142: dwrite da/f1c [4194304,4194304] 0 2024-04-26T12:06:54.872 INFO:tasks.workunit.client.0.smithi052.stdout:9/211: dread - d3/db/d10/f38 zero size 2024-04-26T12:06:54.873 INFO:tasks.workunit.client.0.smithi052.stdout:2/207: mknod d0/d7/d16/c41 0 2024-04-26T12:06:54.873 INFO:tasks.workunit.client.0.smithi052.stdout:0/224: dread - d0/d1/f13 zero size 2024-04-26T12:06:54.873 INFO:tasks.workunit.client.0.smithi052.stdout:4/153: unlink d3/l33 0 2024-04-26T12:06:54.874 INFO:tasks.workunit.client.0.smithi052.stdout:2/208: stat d0/d7/c2e 0 2024-04-26T12:06:54.874 INFO:tasks.workunit.client.0.smithi052.stdout:3/144: dwrite d2/d1f/f2c [0,4194304] 0 2024-04-26T12:06:54.875 INFO:tasks.workunit.client.0.smithi052.stdout:8/113: dread d0/d4/d5/fe [0,4194304] 0 2024-04-26T12:06:54.876 INFO:tasks.workunit.client.0.smithi052.stdout:4/154: symlink d3/d22/d30/l35 0 2024-04-26T12:06:54.878 INFO:tasks.workunit.client.0.smithi052.stdout:2/209: mknod d0/d7/d2f/c42 0 2024-04-26T12:06:54.878 INFO:tasks.workunit.client.0.smithi052.stdout:5/192: dwrite db/dd/d18/d1e/f3a [0,4194304] 0 2024-04-26T12:06:54.878 INFO:tasks.workunit.client.0.smithi052.stdout:8/114: fdatasync d0/f2 0 2024-04-26T12:06:54.878 INFO:tasks.workunit.client.0.smithi052.stdout:3/145: creat d2/d4/d2a/d2d/f2e x:0 0 0 2024-04-26T12:06:54.879 INFO:tasks.workunit.client.0.smithi052.stdout:3/146: creat d2/f2f x:0 0 0 2024-04-26T12:06:54.880 INFO:tasks.workunit.client.0.smithi052.stdout:2/210: unlink d0/f17 0 2024-04-26T12:06:54.881 INFO:tasks.workunit.client.0.smithi052.stdout:8/115: creat d0/d16/f1a x:0 0 0 2024-04-26T12:06:54.881 INFO:tasks.workunit.client.0.smithi052.stdout:0/225: truncate d0/d1/f24 3211621 0 2024-04-26T12:06:54.882 INFO:tasks.workunit.client.0.smithi052.stdout:7/137: dread d1/fb [0,4194304] 0 2024-04-26T12:06:54.882 INFO:tasks.workunit.client.0.smithi052.stdout:6/143: dwrite da/f11 [0,4194304] 0 2024-04-26T12:06:54.882 INFO:tasks.workunit.client.0.smithi052.stdout:8/116: mkdir d0/d4/d5/db/d1b 0 2024-04-26T12:06:54.883 INFO:tasks.workunit.client.0.smithi052.stdout:0/226: creat d0/d1/d1a/f4b x:0 0 0 2024-04-26T12:06:54.884 INFO:tasks.workunit.client.0.smithi052.stdout:2/211: write d0/d7/d16/f1a [1182864,51178] 0 2024-04-26T12:06:54.884 INFO:tasks.workunit.client.0.smithi052.stdout:6/144: write da/f1e [4972312,82557] 0 2024-04-26T12:06:54.884 INFO:tasks.workunit.client.0.smithi052.stdout:7/138: symlink d1/d1c/d23/l30 0 2024-04-26T12:06:54.885 INFO:tasks.workunit.client.0.smithi052.stdout:3/147: dread d2/d4/dc/d12/d1c/f20 [0,4194304] 0 2024-04-26T12:06:54.886 INFO:tasks.workunit.client.0.smithi052.stdout:2/212: chown d0/d7/d22/f23 5 1 2024-04-26T12:06:54.886 INFO:tasks.workunit.client.0.smithi052.stdout:8/117: getdents d0/d4/d5/db/d1b 0 2024-04-26T12:06:54.886 INFO:tasks.workunit.client.0.smithi052.stdout:5/193: dread db/dd/d18/d1e/f2f [0,4194304] 0 2024-04-26T12:06:54.886 INFO:tasks.workunit.client.0.smithi052.stdout:0/227: creat d0/d26/d36/f4c x:0 0 0 2024-04-26T12:06:54.887 INFO:tasks.workunit.client.0.smithi052.stdout:6/145: creat da/d22/d29/f2e x:0 0 0 2024-04-26T12:06:54.887 INFO:tasks.workunit.client.0.smithi052.stdout:8/118: mkdir d0/d4/d1c 0 2024-04-26T12:06:54.888 INFO:tasks.workunit.client.0.smithi052.stdout:6/146: write da/d22/f24 [988973,23524] 0 2024-04-26T12:06:54.888 INFO:tasks.workunit.client.0.smithi052.stdout:5/194: mknod db/dd/d18/d1e/d40/c44 0 2024-04-26T12:06:54.889 INFO:tasks.workunit.client.0.smithi052.stdout:8/119: chown d0/d4/d5/db 99617642 1 2024-04-26T12:06:54.890 INFO:tasks.workunit.client.0.smithi052.stdout:8/120: stat d0/d16/f1a 0 2024-04-26T12:06:54.890 INFO:tasks.workunit.client.0.smithi052.stdout:6/147: write da/d22/f2c [1091366,40512] 0 2024-04-26T12:06:54.891 INFO:tasks.workunit.client.0.smithi052.stdout:3/148: write d2/fb [3875281,119139] 0 2024-04-26T12:06:54.891 INFO:tasks.workunit.client.0.smithi052.stdout:5/195: rename l7 to db/dd/d18/d1e/l45 0 2024-04-26T12:06:54.893 INFO:tasks.workunit.client.0.smithi052.stdout:4/155: dread d3/d1f/f25 [0,4194304] 0 2024-04-26T12:06:54.893 INFO:tasks.workunit.client.0.smithi052.stdout:6/148: creat da/d22/d29/f2f x:0 0 0 2024-04-26T12:06:54.893 INFO:tasks.workunit.client.0.smithi052.stdout:7/139: dwrite d1/fa [0,4194304] 0 2024-04-26T12:06:54.893 INFO:tasks.workunit.client.0.smithi052.stdout:3/149: write d2/f29 [1191700,54911] 0 2024-04-26T12:06:54.894 INFO:tasks.workunit.client.0.smithi052.stdout:2/213: dwrite d0/f21 [0,4194304] 0 2024-04-26T12:06:54.896 INFO:tasks.workunit.client.0.smithi052.stdout:8/121: truncate d0/d4/f17 2843768 0 2024-04-26T12:06:54.897 INFO:tasks.workunit.client.0.smithi052.stdout:6/149: mknod da/d22/d29/c30 0 2024-04-26T12:06:54.898 INFO:tasks.workunit.client.0.smithi052.stdout:9/212: dread d3/db/d10/f1c [4194304,4194304] 0 2024-04-26T12:06:54.898 INFO:tasks.workunit.client.0.smithi052.stdout:7/140: write d1/ff [2154363,44223] 0 2024-04-26T12:06:54.900 INFO:tasks.workunit.client.0.smithi052.stdout:3/150: rename d2/d4/l15 to d2/d4/dc/d12/d1c/l30 0 2024-04-26T12:06:54.900 INFO:tasks.workunit.client.0.smithi052.stdout:6/150: mkdir da/d22/d29/d31 0 2024-04-26T12:06:54.901 INFO:tasks.workunit.client.0.smithi052.stdout:4/156: dread d3/f1c [0,4194304] 0 2024-04-26T12:06:54.902 INFO:tasks.workunit.client.0.smithi052.stdout:9/213: write d3/db/d2b/f2f [5779154,38750] 0 2024-04-26T12:06:54.902 INFO:tasks.workunit.client.0.smithi052.stdout:0/228: dwrite d0/d1/f6 [0,4194304] 0 2024-04-26T12:06:54.902 INFO:tasks.workunit.client.0.smithi052.stdout:4/157: rmdir d3/d12 39 2024-04-26T12:06:54.902 INFO:tasks.workunit.client.0.smithi052.stdout:6/151: chown da/f1c 832606 1 2024-04-26T12:06:54.905 INFO:tasks.workunit.client.0.smithi052.stdout:0/229: stat d0/d1/d1a/d20/d47/l48 0 2024-04-26T12:06:54.905 INFO:tasks.workunit.client.0.smithi052.stdout:9/214: rmdir d3/db/d2b/d43 0 2024-04-26T12:06:54.905 INFO:tasks.workunit.client.0.smithi052.stdout:4/158: truncate d3/d15/f2a 544809 0 2024-04-26T12:06:54.905 INFO:tasks.workunit.client.0.smithi052.stdout:2/214: dwrite d0/d7/f31 [0,4194304] 0 2024-04-26T12:06:54.906 INFO:tasks.workunit.client.0.smithi052.stdout:5/196: dwrite db/dd/d18/d1e/f2f [0,4194304] 0 2024-04-26T12:06:54.907 INFO:tasks.workunit.client.0.smithi052.stdout:0/230: fsync d0/d3d/f3f 0 2024-04-26T12:06:54.907 INFO:tasks.workunit.client.0.smithi052.stdout:7/141: truncate d1/f17 106622 0 2024-04-26T12:06:54.908 INFO:tasks.workunit.client.0.smithi052.stdout:0/231: dread - d0/d26/d36/f4c zero size 2024-04-26T12:06:54.908 INFO:tasks.workunit.client.0.smithi052.stdout:2/215: unlink d0/d7/d16/c26 0 2024-04-26T12:06:54.908 INFO:tasks.workunit.client.0.smithi052.stdout:9/215: truncate d3/db/d10/d3c/d40/f42 744245 0 2024-04-26T12:06:54.909 INFO:tasks.workunit.client.0.smithi052.stdout:3/151: truncate d2/f29 30999 0 2024-04-26T12:06:54.909 INFO:tasks.workunit.client.0.smithi052.stdout:8/122: dwrite d0/d4/f17 [0,4194304] 0 2024-04-26T12:06:54.910 INFO:tasks.workunit.client.0.smithi052.stdout:5/197: mkdir db/dd/d18/d1e/d40/d46 0 2024-04-26T12:06:54.910 INFO:tasks.workunit.client.0.smithi052.stdout:7/142: getdents d1/d1f 0 2024-04-26T12:06:54.910 INFO:tasks.workunit.client.0.smithi052.stdout:7/143: chown d1 403 1 2024-04-26T12:06:54.911 INFO:tasks.workunit.client.0.smithi052.stdout:9/216: chown d3/db/d10/l30 16339544 1 2024-04-26T12:06:54.911 INFO:tasks.workunit.client.0.smithi052.stdout:8/123: symlink d0/d16/l1d 0 2024-04-26T12:06:54.911 INFO:tasks.workunit.client.0.smithi052.stdout:6/152: write f9 [176209,15936] 0 2024-04-26T12:06:54.913 INFO:tasks.workunit.client.0.smithi052.stdout:8/124: symlink d0/d4/l1e 0 2024-04-26T12:06:54.913 INFO:tasks.workunit.client.0.smithi052.stdout:6/153: creat da/f32 x:0 0 0 2024-04-26T12:06:54.913 INFO:tasks.workunit.client.0.smithi052.stdout:9/217: mkdir d3/db/d10/d2e/d45 0 2024-04-26T12:06:54.913 INFO:tasks.workunit.client.0.smithi052.stdout:2/216: dread d0/f21 [0,4194304] 0 2024-04-26T12:06:54.914 INFO:tasks.workunit.client.0.smithi052.stdout:8/125: creat d0/f1f x:0 0 0 2024-04-26T12:06:54.914 INFO:tasks.workunit.client.0.smithi052.stdout:6/154: chown da/f20 2160789 1 2024-04-26T12:06:54.914 INFO:tasks.workunit.client.0.smithi052.stdout:4/159: write d3/f10 [1959100,98267] 0 2024-04-26T12:06:54.914 INFO:tasks.workunit.client.0.smithi052.stdout:3/152: dread d2/f29 [0,4194304] 0 2024-04-26T12:06:54.914 INFO:tasks.workunit.client.0.smithi052.stdout:8/126: chown d0/d4 83 1 2024-04-26T12:06:54.915 INFO:tasks.workunit.client.0.smithi052.stdout:6/155: dread - da/d22/f2d zero size 2024-04-26T12:06:54.916 INFO:tasks.workunit.client.0.smithi052.stdout:6/156: sync 2024-04-26T12:06:54.916 INFO:tasks.workunit.client.0.smithi052.stdout:8/127: mkdir d0/d4/d5/db/d20 0 2024-04-26T12:06:54.916 INFO:tasks.workunit.client.0.smithi052.stdout:4/160: write d3/f9 [3054761,58145] 0 2024-04-26T12:06:54.917 INFO:tasks.workunit.client.0.smithi052.stdout:3/153: fdatasync d2/d4/dc/d12/d1c/f20 0 2024-04-26T12:06:54.917 INFO:tasks.workunit.client.0.smithi052.stdout:4/161: stat d3/d1f/f25 0 2024-04-26T12:06:54.918 INFO:tasks.workunit.client.0.smithi052.stdout:8/128: rename d0/d4/dc to d0/d4/dc/d21 22 2024-04-26T12:06:54.918 INFO:tasks.workunit.client.0.smithi052.stdout:4/162: read d3/fd [2196084,29818] 0 2024-04-26T12:06:54.918 INFO:tasks.workunit.client.0.smithi052.stdout:7/144: dwrite d1/f10 [0,4194304] 0 2024-04-26T12:06:54.919 INFO:tasks.workunit.client.0.smithi052.stdout:9/218: truncate d3/db/d24/f2c 36042 0 2024-04-26T12:06:54.920 INFO:tasks.workunit.client.0.smithi052.stdout:7/145: dread - d1/d1f/f26 zero size 2024-04-26T12:06:54.921 INFO:tasks.workunit.client.0.smithi052.stdout:4/163: getdents d3/d15 0 2024-04-26T12:06:54.921 INFO:tasks.workunit.client.0.smithi052.stdout:8/129: link d0/f1f d0/d4/d5/db/d1b/f22 0 2024-04-26T12:06:54.922 INFO:tasks.workunit.client.0.smithi052.stdout:2/217: dread d0/f15 [0,4194304] 0 2024-04-26T12:06:54.923 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:54.923 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:54.923 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:54.923 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:54.923 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.923 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:54.924 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:54.924 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 111.139579576, 2024-04-26T12:06:54.924 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015983431999999999, 2024-04-26T12:06:54.924 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:54.924 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:54.924 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:54.924 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.924 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:54.924 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:54.924 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.924 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.924 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.924 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:54.924 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780960+0000", 2024-04-26T12:06:54.925 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.925 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.925 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.925 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:54.925 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780959+0000", 2024-04-26T12:06:54.925 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:54.925 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.925 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.925 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:54.925 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780963+0000", 2024-04-26T12:06:54.925 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:06:54.925 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.925 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.925 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:54.925 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780980+0000", 2024-04-26T12:06:54.926 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6308e-05 2024-04-26T12:06:54.926 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.926 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.926 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:54.926 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780991+0000", 2024-04-26T12:06:54.926 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1236999999999999e-05 2024-04-26T12:06:54.926 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.926 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.926 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:54.926 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786066+0000", 2024-04-26T12:06:54.926 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050745870000000002 2024-04-26T12:06:54.926 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.926 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.926 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:54.927 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786179+0000", 2024-04-26T12:06:54.927 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113628 2024-04-26T12:06:54.927 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.927 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.927 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:54.927 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786324+0000", 2024-04-26T12:06:54.927 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014488899999999999 2024-04-26T12:06:54.927 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.927 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.927 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:54.927 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789124+0000", 2024-04-26T12:06:54.927 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027996560000000002 2024-04-26T12:06:54.927 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.927 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.928 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:54.928 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796741+0000", 2024-04-26T12:06:54.928 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076172760000000001 2024-04-26T12:06:54.928 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.928 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.928 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:54.928 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796869+0000", 2024-04-26T12:06:54.928 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012768100000000001 2024-04-26T12:06:54.928 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.928 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.928 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:54.928 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796944+0000", 2024-04-26T12:06:54.928 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4906000000000004e-05 2024-04-26T12:06:54.929 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.929 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:54.929 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.929 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.929 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.929 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:54.929 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:54.929 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 111.139541892, 2024-04-26T12:06:54.929 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016169695000000001, 2024-04-26T12:06:54.929 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:54.929 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:54.929 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:54.929 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.929 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:54.929 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:54.930 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.930 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.930 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.930 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:54.930 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780998+0000", 2024-04-26T12:06:54.930 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.930 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.930 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.930 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:54.930 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.780997+0000", 2024-04-26T12:06:54.930 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:54.930 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.930 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.930 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:54.931 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781002+0000", 2024-04-26T12:06:54.931 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3209999999999998e-06 2024-04-26T12:06:54.931 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.931 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.931 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:54.931 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781009+0000", 2024-04-26T12:06:54.931 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:06:54.931 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.931 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.931 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:54.931 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781014+0000", 2024-04-26T12:06:54.931 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:54.931 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.931 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.932 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:54.932 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786559+0000", 2024-04-26T12:06:54.932 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055452269999999998 2024-04-26T12:06:54.932 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.932 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.932 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:54.932 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786678+0000", 2024-04-26T12:06:54.932 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118991 2024-04-26T12:06:54.932 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.932 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.932 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:54.932 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.786802+0000", 2024-04-26T12:06:54.932 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123509 2024-04-26T12:06:54.932 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.933 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.933 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:54.933 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789126+0000", 2024-04-26T12:06:54.933 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023245900000000001 2024-04-26T12:06:54.933 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.933 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.933 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:54.933 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797058+0000", 2024-04-26T12:06:54.933 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079315189999999997 2024-04-26T12:06:54.933 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.933 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.933 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:54.933 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797129+0000", 2024-04-26T12:06:54.933 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0974000000000002e-05 2024-04-26T12:06:54.933 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.934 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.934 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:54.934 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.797168+0000", 2024-04-26T12:06:54.934 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:06:54.934 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.934 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:54.934 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.934 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.934 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.934 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:54.934 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:54.934 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 111.13952055199999, 2024-04-26T12:06:54.934 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017841718999999999, 2024-04-26T12:06:54.934 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:54.935 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:54.935 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:54.935 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.935 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:54.935 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:54.935 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.935 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.935 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.935 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:54.935 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:54.935 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.935 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.935 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.935 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:54.936 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781019+0000", 2024-04-26T12:06:54.936 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:54.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.936 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.936 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:54.936 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781022+0000", 2024-04-26T12:06:54.936 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:54.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.936 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.936 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:54.936 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781029+0000", 2024-04-26T12:06:54.936 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:06:54.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.936 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.937 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:54.937 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781035+0000", 2024-04-26T12:06:54.937 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6160000000000001e-06 2024-04-26T12:06:54.937 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.937 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.937 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:54.937 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787057+0000", 2024-04-26T12:06:54.937 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060219109999999996 2024-04-26T12:06:54.937 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.937 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.937 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:54.937 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787148+0000", 2024-04-26T12:06:54.937 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1268999999999996e-05 2024-04-26T12:06:54.938 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.938 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.938 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:54.938 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787313+0000", 2024-04-26T12:06:54.938 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483099999999999 2024-04-26T12:06:54.938 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.938 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.938 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:54.938 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789129+0000", 2024-04-26T12:06:54.938 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001815837 2024-04-26T12:06:54.938 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.938 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.938 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:54.938 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798809+0000", 2024-04-26T12:06:54.939 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096799910000000006 2024-04-26T12:06:54.939 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.939 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.939 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:54.939 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798840+0000", 2024-04-26T12:06:54.939 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1358e-05 2024-04-26T12:06:54.939 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.939 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.939 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:54.939 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798861+0000", 2024-04-26T12:06:54.939 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0638000000000001e-05 2024-04-26T12:06:54.939 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.939 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:54.939 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.939 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.940 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.940 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:54.940 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:54.940 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 111.13949828600001, 2024-04-26T12:06:54.940 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017943094, 2024-04-26T12:06:54.940 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:54.940 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:54.940 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:54.940 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.940 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:54.940 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:54.940 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.940 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.940 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.941 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:54.941 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:54.941 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.941 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.941 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.941 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:54.941 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781041+0000", 2024-04-26T12:06:54.941 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:54.941 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.941 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.941 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:54.941 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781044+0000", 2024-04-26T12:06:54.941 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.847e-06 2024-04-26T12:06:54.941 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.941 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.942 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:54.942 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781051+0000", 2024-04-26T12:06:54.942 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.985e-06 2024-04-26T12:06:54.942 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.942 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.942 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:54.942 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781057+0000", 2024-04-26T12:06:54.942 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:06:54.942 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.942 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.942 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:54.942 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787568+0000", 2024-04-26T12:06:54.942 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065110949999999997 2024-04-26T12:06:54.942 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.943 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.943 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:54.943 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787679+0000", 2024-04-26T12:06:54.943 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111159 2024-04-26T12:06:54.943 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.943 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.943 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:54.943 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787777+0000", 2024-04-26T12:06:54.943 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7406999999999998e-05 2024-04-26T12:06:54.943 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.943 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.943 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:54.943 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790076+0000", 2024-04-26T12:06:54.943 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022988330000000001 2024-04-26T12:06:54.943 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.944 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.944 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:54.944 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798900+0000", 2024-04-26T12:06:54.944 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0088247810000000003 2024-04-26T12:06:54.944 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.944 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.944 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:54.944 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798951+0000", 2024-04-26T12:06:54.944 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0568000000000001e-05 2024-04-26T12:06:54.944 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.944 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.944 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:54.944 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.798985+0000", 2024-04-26T12:06:54.944 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:06:54.945 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.945 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:54.945 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.945 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.945 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.945 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:54.945 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:54.945 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 111.139476664, 2024-04-26T12:06:54.945 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018010654000000001, 2024-04-26T12:06:54.945 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:54.945 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:54.945 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:54.945 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.945 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:54.946 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:54.946 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.946 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.946 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.946 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:54.946 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:54.946 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.946 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.946 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.946 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:54.946 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781063+0000", 2024-04-26T12:06:54.946 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:54.946 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.947 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.947 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:54.947 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781067+0000", 2024-04-26T12:06:54.947 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2599999999999999e-06 2024-04-26T12:06:54.947 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.947 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.947 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:54.947 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781080+0000", 2024-04-26T12:06:54.947 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2836999999999999e-05 2024-04-26T12:06:54.947 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.947 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.947 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:54.947 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781085+0000", 2024-04-26T12:06:54.947 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1019999999999996e-06 2024-04-26T12:06:54.947 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.948 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.948 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:54.948 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788644+0000", 2024-04-26T12:06:54.948 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075589189999999999 2024-04-26T12:06:54.948 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.948 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.948 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:54.948 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788720+0000", 2024-04-26T12:06:54.948 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6606999999999993e-05 2024-04-26T12:06:54.948 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.948 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.948 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:54.948 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.788880+0000", 2024-04-26T12:06:54.948 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000159221 2024-04-26T12:06:54.948 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.949 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.949 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:54.949 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.790279+0000", 2024-04-26T12:06:54.949 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001399069 2024-04-26T12:06:54.949 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.949 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.949 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:54.949 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799025+0000", 2024-04-26T12:06:54.949 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0087461039999999993 2024-04-26T12:06:54.949 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.949 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.949 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:54.949 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799053+0000", 2024-04-26T12:06:54.949 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8779999999999999e-05 2024-04-26T12:06:54.949 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.950 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.950 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:54.950 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799074+0000", 2024-04-26T12:06:54.950 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0296999999999999e-05 2024-04-26T12:06:54.950 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.950 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:54.950 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.950 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.950 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.950 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:54.950 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:54.950 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 111.139450098, 2024-04-26T12:06:54.950 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018070471000000001, 2024-04-26T12:06:54.951 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:54.951 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:54.951 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:54.951 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.951 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:54.951 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:54.951 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.951 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.951 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.951 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:54.951 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781090+0000", 2024-04-26T12:06:54.951 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.951 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.951 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.951 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:54.952 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781089+0000", 2024-04-26T12:06:54.952 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:54.952 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.952 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.952 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:54.952 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781092+0000", 2024-04-26T12:06:54.952 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2370000000000001e-06 2024-04-26T12:06:54.952 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.952 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.952 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:54.952 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781100+0000", 2024-04-26T12:06:54.952 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:06:54.952 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.952 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.953 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:54.953 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781106+0000", 2024-04-26T12:06:54.953 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8919999999999997e-06 2024-04-26T12:06:54.953 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.953 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.953 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:54.953 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789165+0000", 2024-04-26T12:06:54.953 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.008059185 2024-04-26T12:06:54.953 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.953 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.953 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:54.953 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789235+0000", 2024-04-26T12:06:54.953 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9797999999999998e-05 2024-04-26T12:06:54.953 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.953 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.954 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:54.954 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789307+0000", 2024-04-26T12:06:54.954 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2754000000000002e-05 2024-04-26T12:06:54.954 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.954 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.954 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:54.954 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792014+0000", 2024-04-26T12:06:54.954 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027066569999999999 2024-04-26T12:06:54.954 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.954 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.954 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:54.954 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799111+0000", 2024-04-26T12:06:54.954 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070974460000000003 2024-04-26T12:06:54.955 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.955 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.955 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:54.955 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799139+0000", 2024-04-26T12:06:54.955 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7243e-05 2024-04-26T12:06:54.955 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.955 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.955 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:54.955 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799160+0000", 2024-04-26T12:06:54.955 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1404e-05 2024-04-26T12:06:54.955 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.955 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:54.955 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.955 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.956 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.956 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:54.956 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:54.956 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 111.13941158599999, 2024-04-26T12:06:54.956 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018104334, 2024-04-26T12:06:54.956 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:54.956 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:54.956 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:54.956 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.956 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:54.956 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:54.956 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.956 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.956 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.957 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:54.957 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:54.957 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.957 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.957 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.957 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:54.957 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781128+0000", 2024-04-26T12:06:54.957 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:54.957 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.957 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.957 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:54.957 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781137+0000", 2024-04-26T12:06:54.957 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:06:54.957 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.957 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.958 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:54.958 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781146+0000", 2024-04-26T12:06:54.958 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5210000000000002e-06 2024-04-26T12:06:54.958 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.958 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.958 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:54.958 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781151+0000", 2024-04-26T12:06:54.958 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:06:54.958 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.958 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.958 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:54.958 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789584+0000", 2024-04-26T12:06:54.958 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084329939999999992 2024-04-26T12:06:54.958 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.958 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.959 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:54.959 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789653+0000", 2024-04-26T12:06:54.959 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8400999999999998e-05 2024-04-26T12:06:54.959 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.959 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.959 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:54.959 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.789799+0000", 2024-04-26T12:06:54.959 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146155 2024-04-26T12:06:54.959 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.959 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.959 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:54.959 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.792023+0000", 2024-04-26T12:06:54.959 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022237960000000001 2024-04-26T12:06:54.959 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.959 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.960 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:54.960 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799187+0000", 2024-04-26T12:06:54.960 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0071647830000000001 2024-04-26T12:06:54.960 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.960 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.960 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:54.960 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799214+0000", 2024-04-26T12:06:54.960 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6690999999999999e-05 2024-04-26T12:06:54.960 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.960 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.960 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:54.960 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.799233+0000", 2024-04-26T12:06:54.960 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8505e-05 2024-04-26T12:06:54.960 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.960 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:54.961 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.961 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.961 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.961 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T12:06:54.961 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:54.961 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 111.139348849, 2024-04-26T12:06:54.961 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015808025999999999, 2024-04-26T12:06:54.961 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:54.961 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:54.961 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:54.961 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.961 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:54.961 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:54.961 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.961 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.962 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.962 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:54.962 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781191+0000", 2024-04-26T12:06:54.962 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.962 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.962 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.962 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:54.962 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781190+0000", 2024-04-26T12:06:54.962 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:54.962 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.962 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.962 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:54.962 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781198+0000", 2024-04-26T12:06:54.962 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5259999999999996e-06 2024-04-26T12:06:54.963 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.963 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.963 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:54.963 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781204+0000", 2024-04-26T12:06:54.963 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4980000000000003e-06 2024-04-26T12:06:54.963 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.963 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.963 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:54.963 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.781209+0000", 2024-04-26T12:06:54.963 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:06:54.963 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.963 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.963 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:54.963 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783672+0000", 2024-04-26T12:06:54.964 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002462615 2024-04-26T12:06:54.964 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.964 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.964 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:54.964 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783752+0000", 2024-04-26T12:06:54.964 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9776000000000003e-05 2024-04-26T12:06:54.964 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.964 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.964 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T12:06:54.964 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.783883+0000", 2024-04-26T12:06:54.964 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000130786 2024-04-26T12:06:54.964 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.964 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.965 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:54.965 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.787626+0000", 2024-04-26T12:06:54.965 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037438300000000001 2024-04-26T12:06:54.965 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.965 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.965 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:54.965 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796872+0000", 2024-04-26T12:06:54.965 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092451500000000006 2024-04-26T12:06:54.965 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.965 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.965 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:54.965 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796962+0000", 2024-04-26T12:06:54.965 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0383999999999994e-05 2024-04-26T12:06:54.965 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.965 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.966 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:54.966 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:05:03.796999+0000", 2024-04-26T12:06:54.966 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7024000000000003e-05 2024-04-26T12:06:54.966 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.966 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:54.966 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.966 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.966 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.966 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:9757 4.13 4:ca460221:::10000002cd3.00000000:head [write 0~2872501] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:06:54.966 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:51.390144+0000", 2024-04-26T12:06:54.966 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 3.5303960170000002, 2024-04-26T12:06:54.966 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017793265999999999, 2024-04-26T12:06:54.967 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:54.967 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:54.967 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:54.967 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:54.967 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:54.967 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 9757 2024-04-26T12:06:54.967 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.967 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:54.967 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.967 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:54.967 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.390144+0000", 2024-04-26T12:06:54.967 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.967 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.967 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.967 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:54.967 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.390144+0000", 2024-04-26T12:06:54.968 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.968 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.968 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.968 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:54.968 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.390142+0000", 2024-04-26T12:06:54.968 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:54.968 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.968 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.968 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:54.968 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.392971+0000", 2024-04-26T12:06:54.968 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028284500000000001 2024-04-26T12:06:54.968 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.968 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.968 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:54.969 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.392984+0000", 2024-04-26T12:06:54.969 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3526000000000001e-05 2024-04-26T12:06:54.969 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.969 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.969 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:54.969 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.392992+0000", 2024-04-26T12:06:54.969 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4919999999999996e-06 2024-04-26T12:06:54.969 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.969 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.969 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:54.969 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.393034+0000", 2024-04-26T12:06:54.969 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2679999999999998e-05 2024-04-26T12:06:54.969 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.969 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.970 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:54.970 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.393149+0000", 2024-04-26T12:06:54.970 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000114795 2024-04-26T12:06:54.970 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.970 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.970 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:54.970 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.407790+0000", 2024-04-26T12:06:54.970 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014641381 2024-04-26T12:06:54.970 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.970 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.970 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:54.970 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.407845+0000", 2024-04-26T12:06:54.970 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.5062999999999998e-05 2024-04-26T12:06:54.971 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.971 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.971 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:54.971 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:51.407937+0000", 2024-04-26T12:06:54.971 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1522999999999998e-05 2024-04-26T12:06:54.971 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.971 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:54.971 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.971 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.971 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.971 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:10914 4.35 4:ac849de4:::1000000313f.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:54.971 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:54.587553+0000", 2024-04-26T12:06:54.972 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.33298708700000001, 2024-04-26T12:06:54.972 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017118267, 2024-04-26T12:06:54.972 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:54.972 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:54.972 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:54.972 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:54.972 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:54.972 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 10914 2024-04-26T12:06:54.972 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.972 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:54.972 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.972 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:54.972 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.587553+0000", 2024-04-26T12:06:54.972 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.973 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.973 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.973 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:54.973 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.587553+0000", 2024-04-26T12:06:54.973 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.973 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.973 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.973 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:54.973 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.587552+0000", 2024-04-26T12:06:54.973 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:54.973 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.973 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.973 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:54.973 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.594224+0000", 2024-04-26T12:06:54.974 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066719120000000003 2024-04-26T12:06:54.974 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.974 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.974 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:54.974 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.594242+0000", 2024-04-26T12:06:54.974 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8179e-05 2024-04-26T12:06:54.974 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.974 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.974 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:54.974 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.594250+0000", 2024-04-26T12:06:54.974 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9459999999999998e-06 2024-04-26T12:06:54.974 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.974 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.974 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:54.975 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.594334+0000", 2024-04-26T12:06:54.975 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3770999999999995e-05 2024-04-26T12:06:54.975 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.975 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.975 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:54.975 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.594517+0000", 2024-04-26T12:06:54.975 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000183399 2024-04-26T12:06:54.975 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.975 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.975 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:54.975 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.594672+0000", 2024-04-26T12:06:54.975 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000154907 2024-04-26T12:06:54.975 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.975 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.975 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:54.976 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.599864+0000", 2024-04-26T12:06:54.976 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051923020000000002 2024-04-26T12:06:54.976 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.976 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.976 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:54.976 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.604605+0000", 2024-04-26T12:06:54.976 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047410660000000004 2024-04-26T12:06:54.976 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.976 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.976 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:54.976 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.604642+0000", 2024-04-26T12:06:54.976 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6893000000000001e-05 2024-04-26T12:06:54.976 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.976 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.977 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:54.977 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.604671+0000", 2024-04-26T12:06:54.977 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8705e-05 2024-04-26T12:06:54.977 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.977 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:54.977 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.977 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.977 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.977 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:10924 4.1a 4:5a6e15a2:::1000000318e.00000000:head [write 0~3538944] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:54.977 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:54.626108+0000", 2024-04-26T12:06:54.977 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.29443134700000001, 2024-04-26T12:06:54.977 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016506340000000001, 2024-04-26T12:06:54.977 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:54.977 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:54.978 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:54.978 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:54.978 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:54.978 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 10924 2024-04-26T12:06:54.978 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.978 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:54.978 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.978 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:54.978 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.626108+0000", 2024-04-26T12:06:54.978 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.978 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.978 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.978 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:54.978 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.626108+0000", 2024-04-26T12:06:54.979 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.979 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.979 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.979 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:54.979 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.626108+0000", 2024-04-26T12:06:54.979 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:54.979 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.979 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.979 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:54.979 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.632106+0000", 2024-04-26T12:06:54.979 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0059987349999999998 2024-04-26T12:06:54.979 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.979 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.979 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:54.980 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.632132+0000", 2024-04-26T12:06:54.980 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5899999999999999e-05 2024-04-26T12:06:54.981 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.982 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.982 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:54.982 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.632142+0000", 2024-04-26T12:06:54.982 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4469999999999995e-06 2024-04-26T12:06:54.982 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.982 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.982 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:54.982 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.632196+0000", 2024-04-26T12:06:54.982 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4691999999999997e-05 2024-04-26T12:06:54.982 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.982 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.982 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:54.982 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.632335+0000", 2024-04-26T12:06:54.983 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013880300000000001 2024-04-26T12:06:54.983 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.983 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.983 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:54.983 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.632435+0000", 2024-04-26T12:06:54.983 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.9728000000000005e-05 2024-04-26T12:06:54.983 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.983 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.983 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:54.983 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.636509+0000", 2024-04-26T12:06:54.983 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004073714 2024-04-26T12:06:54.983 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.983 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.983 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:54.983 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.642549+0000", 2024-04-26T12:06:54.984 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060405169999999996 2024-04-26T12:06:54.984 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.984 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.984 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:54.984 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.642580+0000", 2024-04-26T12:06:54.984 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0991000000000002e-05 2024-04-26T12:06:54.984 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.984 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.984 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:54.984 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.642615+0000", 2024-04-26T12:06:54.984 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4669000000000003e-05 2024-04-26T12:06:54.984 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.984 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:54.984 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.984 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.984 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.985 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:10941 4.c 4:31ba13fb:::100000031a6.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:54.985 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:54.655373+0000", 2024-04-26T12:06:54.985 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.26516662899999999, 2024-04-26T12:06:54.985 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.024374114999999998, 2024-04-26T12:06:54.985 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:54.985 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:54.985 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:54.985 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:54.985 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:54.985 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 10941 2024-04-26T12:06:54.985 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.985 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:54.985 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.985 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:54.985 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.655373+0000", 2024-04-26T12:06:54.986 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.986 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.986 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.986 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:54.986 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.655373+0000", 2024-04-26T12:06:54.986 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.986 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.986 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.986 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:54.986 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.655373+0000", 2024-04-26T12:06:54.986 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:54.986 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.986 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.986 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:54.987 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.662000+0000", 2024-04-26T12:06:54.987 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066275600000000002 2024-04-26T12:06:54.987 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.987 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.987 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:54.987 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.662014+0000", 2024-04-26T12:06:54.987 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3713999999999999e-05 2024-04-26T12:06:54.987 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.987 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.987 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:54.987 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.662022+0000", 2024-04-26T12:06:54.987 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4619999999999996e-06 2024-04-26T12:06:54.987 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.987 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.987 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:54.988 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.662087+0000", 2024-04-26T12:06:54.988 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5053000000000002e-05 2024-04-26T12:06:54.988 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.988 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.988 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:54.988 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.662260+0000", 2024-04-26T12:06:54.988 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000172249 2024-04-26T12:06:54.988 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.988 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.988 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:54.988 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.662422+0000", 2024-04-26T12:06:54.988 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016228600000000001 2024-04-26T12:06:54.988 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.988 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.988 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:54.989 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.669518+0000", 2024-04-26T12:06:54.989 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070963559999999998 2024-04-26T12:06:54.989 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.989 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.989 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:54.989 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.679691+0000", 2024-04-26T12:06:54.989 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010172924 2024-04-26T12:06:54.989 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.989 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.989 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:54.989 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.679723+0000", 2024-04-26T12:06:54.989 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1711999999999997e-05 2024-04-26T12:06:54.989 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.989 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.989 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:54.990 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.679747+0000", 2024-04-26T12:06:54.990 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4324e-05 2024-04-26T12:06:54.990 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.990 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:54.990 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.990 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.990 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.990 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:10969 4.c 4:3083e1fe:::100000031e1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:54.990 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:54.694429+0000", 2024-04-26T12:06:54.990 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.22611119900000001, 2024-04-26T12:06:54.990 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018724652000000001, 2024-04-26T12:06:54.990 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:54.990 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:54.990 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:54.990 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:54.991 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:54.991 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 10969 2024-04-26T12:06:54.991 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.991 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:54.991 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.991 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:54.991 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.694429+0000", 2024-04-26T12:06:54.991 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.991 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.991 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.991 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:54.991 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.694429+0000", 2024-04-26T12:06:54.991 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.991 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.992 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.992 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:54.992 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.694428+0000", 2024-04-26T12:06:54.992 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:54.992 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.992 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.992 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:54.992 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.700363+0000", 2024-04-26T12:06:54.992 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0059349900000000002 2024-04-26T12:06:54.992 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.992 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.992 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:54.992 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.700378+0000", 2024-04-26T12:06:54.992 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4438e-05 2024-04-26T12:06:54.992 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.993 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.993 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:54.993 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.700387+0000", 2024-04-26T12:06:54.993 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4599999999999992e-06 2024-04-26T12:06:54.993 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.993 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.993 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:54.993 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.700434+0000", 2024-04-26T12:06:54.993 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6916999999999998e-05 2024-04-26T12:06:54.993 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.993 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.993 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:54.993 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.700632+0000", 2024-04-26T12:06:54.993 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019746600000000001 2024-04-26T12:06:54.993 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.994 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.994 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:54.994 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.700772+0000", 2024-04-26T12:06:54.994 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000140049 2024-04-26T12:06:54.994 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.994 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.994 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:54.994 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.705882+0000", 2024-04-26T12:06:54.994 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051108459999999996 2024-04-26T12:06:54.994 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.994 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.994 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:54.994 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.713105+0000", 2024-04-26T12:06:54.994 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072226419999999996 2024-04-26T12:06:54.994 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.995 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.995 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:54.995 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.713134+0000", 2024-04-26T12:06:54.995 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8685999999999999e-05 2024-04-26T12:06:54.995 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.995 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.995 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:54.995 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.713153+0000", 2024-04-26T12:06:54.995 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9485999999999999e-05 2024-04-26T12:06:54.995 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.995 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:54.995 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:54.995 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.995 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.995 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11003 4.35 4:ac849de4:::1000000313f.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:54.996 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:54.736969+0000", 2024-04-26T12:06:54.996 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.183571078, 2024-04-26T12:06:54.996 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018926001000000001, 2024-04-26T12:06:54.996 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:54.996 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:54.996 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:54.996 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:54.996 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:54.996 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11003 2024-04-26T12:06:54.996 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.996 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:54.996 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.996 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:54.996 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.736969+0000", 2024-04-26T12:06:54.996 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.997 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.997 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.997 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:54.997 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.736969+0000", 2024-04-26T12:06:54.997 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:54.997 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.997 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.997 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:54.997 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.736968+0000", 2024-04-26T12:06:54.997 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:54.997 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.997 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.997 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:54.997 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.741506+0000", 2024-04-26T12:06:54.997 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045374329999999996 2024-04-26T12:06:54.997 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.998 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.998 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:54.998 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.741518+0000", 2024-04-26T12:06:54.998 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2544000000000001e-05 2024-04-26T12:06:54.998 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.998 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.998 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:54.998 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.741527+0000", 2024-04-26T12:06:54.998 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0739999999999999e-06 2024-04-26T12:06:54.998 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.998 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.998 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:54.998 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.741596+0000", 2024-04-26T12:06:54.998 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8538e-05 2024-04-26T12:06:54.999 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.999 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.999 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:54.999 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.741652+0000", 2024-04-26T12:06:54.999 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6412000000000001e-05 2024-04-26T12:06:54.999 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.999 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.999 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:54.999 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.741752+0000", 2024-04-26T12:06:54.999 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.9596e-05 2024-04-26T12:06:54.999 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:54.999 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:54.999 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:54.999 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.746228+0000", 2024-04-26T12:06:55.000 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044757520000000004 2024-04-26T12:06:55.000 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.000 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.000 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:55.000 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.755822+0000", 2024-04-26T12:06:55.000 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0095943669999999995 2024-04-26T12:06:55.000 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.000 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.000 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:55.000 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.755863+0000", 2024-04-26T12:06:55.000 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1399999999999997e-05 2024-04-26T12:06:55.000 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.000 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.000 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:55.000 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.755895+0000", 2024-04-26T12:06:55.001 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1398e-05 2024-04-26T12:06:55.001 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:55.001 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:55.001 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:55.001 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.001 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.001 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11032 4.39 4:9dcc5ecf:::1000000316e.00000000:head [write 0~3014656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:55.001 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:54.772805+0000", 2024-04-26T12:06:55.001 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.14773433999999999, 2024-04-26T12:06:55.001 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.022448862, 2024-04-26T12:06:55.001 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:55.001 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.001 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:55.001 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:55.002 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:55.002 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11032 2024-04-26T12:06:55.002 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.002 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:55.002 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.002 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:55.002 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.772805+0000", 2024-04-26T12:06:55.002 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:55.002 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.002 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.002 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:55.002 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.772805+0000", 2024-04-26T12:06:55.002 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:55.002 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.003 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.003 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:55.003 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.772805+0000", 2024-04-26T12:06:55.003 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:55.003 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.003 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.003 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:55.003 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.778514+0000", 2024-04-26T12:06:55.003 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057088080000000001 2024-04-26T12:06:55.003 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.003 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.003 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:55.003 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.778524+0000", 2024-04-26T12:06:55.003 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6919999999999997e-06 2024-04-26T12:06:55.003 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.004 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.004 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.004 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.778528+0000", 2024-04-26T12:06:55.004 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3719999999999998e-06 2024-04-26T12:06:55.004 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.004 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.004 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:55.004 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.778602+0000", 2024-04-26T12:06:55.004 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4214999999999993e-05 2024-04-26T12:06:55.004 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.004 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.004 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:55.004 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.778699+0000", 2024-04-26T12:06:55.004 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7029999999999998e-05 2024-04-26T12:06:55.004 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.005 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.005 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:55.005 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.778784+0000", 2024-04-26T12:06:55.005 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4858000000000006e-05 2024-04-26T12:06:55.005 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.005 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.005 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:55.005 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.781179+0000", 2024-04-26T12:06:55.005 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023949510000000002 2024-04-26T12:06:55.005 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.005 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.005 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:55.005 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.795094+0000", 2024-04-26T12:06:55.005 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013915072000000001 2024-04-26T12:06:55.006 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.006 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.006 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:55.006 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.795219+0000", 2024-04-26T12:06:55.006 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012454 2024-04-26T12:06:55.006 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.006 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.006 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:55.006 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.795254+0000", 2024-04-26T12:06:55.006 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5685999999999997e-05 2024-04-26T12:06:55.006 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:55.006 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:55.006 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:55.006 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.007 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.007 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11037 4.38 4:1fa50e65:::10000003117.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:55.007 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:54.782048+0000", 2024-04-26T12:06:55.007 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.13849187800000001, 2024-04-26T12:06:55.007 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017950101, 2024-04-26T12:06:55.007 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:55.007 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.007 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:55.007 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:55.007 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:55.007 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11037 2024-04-26T12:06:55.007 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.007 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:55.007 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.007 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:55.008 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.782048+0000", 2024-04-26T12:06:55.008 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:55.008 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.008 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.008 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:55.008 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.782048+0000", 2024-04-26T12:06:55.008 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:55.008 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.008 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.008 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:55.008 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.782047+0000", 2024-04-26T12:06:55.008 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:55.008 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.008 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.009 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:55.009 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.788751+0000", 2024-04-26T12:06:55.009 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.006703606 2024-04-26T12:06:55.009 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.009 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.009 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:55.009 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.788765+0000", 2024-04-26T12:06:55.009 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4612e-05 2024-04-26T12:06:55.009 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.009 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.009 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.009 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.788779+0000", 2024-04-26T12:06:55.010 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3998e-05 2024-04-26T12:06:55.010 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.010 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.010 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:55.010 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.788848+0000", 2024-04-26T12:06:55.010 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8918999999999995e-05 2024-04-26T12:06:55.010 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.010 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.010 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:55.010 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.788971+0000", 2024-04-26T12:06:55.010 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012228 2024-04-26T12:06:55.010 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.010 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.010 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:55.011 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.789140+0000", 2024-04-26T12:06:55.011 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000169426 2024-04-26T12:06:55.011 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.011 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.011 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:55.011 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.795028+0000", 2024-04-26T12:06:55.011 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.005887649 2024-04-26T12:06:55.011 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.011 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.011 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:55.011 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.799850+0000", 2024-04-26T12:06:55.011 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048219960000000003 2024-04-26T12:06:55.011 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.011 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.011 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:55.011 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.799947+0000", 2024-04-26T12:06:55.012 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6998999999999997e-05 2024-04-26T12:06:55.012 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.012 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.012 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:55.012 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.799998+0000", 2024-04-26T12:06:55.012 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1393000000000001e-05 2024-04-26T12:06:55.012 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:55.012 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:55.012 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:55.012 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.012 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.012 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11045 4.5 4:a214167c:::100000030bc.00000000:head [write 0~4194304 [3@2665254]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:55.013 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:54.788986+0000", 2024-04-26T12:06:55.013 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.131554214, 2024-04-26T12:06:55.013 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016441137000000002, 2024-04-26T12:06:55.013 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:55.013 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.013 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:55.013 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:55.013 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:55.013 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11045 2024-04-26T12:06:55.013 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.013 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:55.013 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.013 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:55.013 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.788986+0000", 2024-04-26T12:06:55.014 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:55.014 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.014 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.014 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:55.014 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.788986+0000", 2024-04-26T12:06:55.014 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:55.014 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.014 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.014 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:55.014 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.788985+0000", 2024-04-26T12:06:55.014 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:55.014 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.015 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.015 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:55.015 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.794616+0000", 2024-04-26T12:06:55.015 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0056307359999999999 2024-04-26T12:06:55.015 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.015 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.015 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:55.015 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.794634+0000", 2024-04-26T12:06:55.015 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8105999999999999e-05 2024-04-26T12:06:55.015 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.015 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.015 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.015 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.794641+0000", 2024-04-26T12:06:55.015 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9580000000000001e-06 2024-04-26T12:06:55.016 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.016 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.016 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:55.016 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.794680+0000", 2024-04-26T12:06:55.016 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9591000000000001e-05 2024-04-26T12:06:55.016 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.016 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.016 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:55.016 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.794756+0000", 2024-04-26T12:06:55.016 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5611000000000005e-05 2024-04-26T12:06:55.016 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.016 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.016 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:55.016 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.805350+0000", 2024-04-26T12:06:55.016 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010593796000000001 2024-04-26T12:06:55.017 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.017 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.017 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:55.017 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.805380+0000", 2024-04-26T12:06:55.017 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9964e-05 2024-04-26T12:06:55.017 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.017 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.017 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:55.017 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.805427+0000", 2024-04-26T12:06:55.017 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6980000000000001e-05 2024-04-26T12:06:55.017 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:55.017 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:55.017 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:55.017 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.018 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.018 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11070 4.30 4:0f7270e5:::100000031f4.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:55.018 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:54.817765+0000", 2024-04-26T12:06:55.018 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.10277526100000001, 2024-04-26T12:06:55.018 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.021136005999999999, 2024-04-26T12:06:55.018 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:55.018 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.018 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:55.018 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:55.018 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:55.018 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11070 2024-04-26T12:06:55.018 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.018 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:55.018 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.019 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:55.019 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.817765+0000", 2024-04-26T12:06:55.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:55.019 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.019 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.019 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:55.019 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.817765+0000", 2024-04-26T12:06:55.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:55.019 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.019 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.019 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:55.019 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.817764+0000", 2024-04-26T12:06:55.020 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:55.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.020 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.020 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:55.020 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.822550+0000", 2024-04-26T12:06:55.020 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047862169999999997 2024-04-26T12:06:55.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.020 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.020 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:55.020 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.822563+0000", 2024-04-26T12:06:55.020 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3144e-05 2024-04-26T12:06:55.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.020 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.020 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.021 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.822570+0000", 2024-04-26T12:06:55.021 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9720000000000003e-06 2024-04-26T12:06:55.021 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.021 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.021 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:55.021 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.822630+0000", 2024-04-26T12:06:55.021 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9552000000000002e-05 2024-04-26T12:06:55.021 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.021 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.021 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:55.021 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.822791+0000", 2024-04-26T12:06:55.021 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000161285 2024-04-26T12:06:55.021 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.021 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.022 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:55.022 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.822965+0000", 2024-04-26T12:06:55.022 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017386499999999999 2024-04-26T12:06:55.022 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.022 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.022 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:55.022 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.830221+0000", 2024-04-26T12:06:55.022 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072562549999999996 2024-04-26T12:06:55.022 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.022 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.022 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:55.022 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.838808+0000", 2024-04-26T12:06:55.022 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0085866190000000002 2024-04-26T12:06:55.022 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.023 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.023 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:55.023 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.838861+0000", 2024-04-26T12:06:55.023 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3544000000000001e-05 2024-04-26T12:06:55.023 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.023 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.023 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:55.023 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.838901+0000", 2024-04-26T12:06:55.023 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9084000000000001e-05 2024-04-26T12:06:55.023 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:55.023 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:55.023 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:55.023 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.024 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11077 4.2b 4:d7f6ff2e:::1000000321c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:55.024 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:54.831642+0000", 2024-04-26T12:06:55.024 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.088898011999999998, 2024-04-26T12:06:55.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.019013932000000001, 2024-04-26T12:06:55.024 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:55.024 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.024 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:55.024 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:55.024 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:55.024 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11077 2024-04-26T12:06:55.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.024 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:55.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:55.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.831642+0000", 2024-04-26T12:06:55.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:55.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:55.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.831642+0000", 2024-04-26T12:06:55.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:55.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:55.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.831641+0000", 2024-04-26T12:06:55.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:55.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:55.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.838330+0000", 2024-04-26T12:06:55.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066895130000000002 2024-04-26T12:06:55.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:55.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.838346+0000", 2024-04-26T12:06:55.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6047000000000001e-05 2024-04-26T12:06:55.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.838353+0000", 2024-04-26T12:06:55.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8719999999999996e-06 2024-04-26T12:06:55.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:55.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.838406+0000", 2024-04-26T12:06:55.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2846000000000002e-05 2024-04-26T12:06:55.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:55.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.838504+0000", 2024-04-26T12:06:55.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7969999999999999e-05 2024-04-26T12:06:55.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:55.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.838652+0000", 2024-04-26T12:06:55.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014813900000000001 2024-04-26T12:06:55.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:55.028 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.843950+0000", 2024-04-26T12:06:55.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052977980000000003 2024-04-26T12:06:55.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:55.028 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.850583+0000", 2024-04-26T12:06:55.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066327729999999998 2024-04-26T12:06:55.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:55.029 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.850623+0000", 2024-04-26T12:06:55.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9978000000000002e-05 2024-04-26T12:06:55.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:55.029 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.850656+0000", 2024-04-26T12:06:55.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3129000000000001e-05 2024-04-26T12:06:55.029 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:55.029 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:55.029 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:55.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.029 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11110 4.35 4:ac22fedc:::10000003251.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:55.030 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:54.875848+0000", 2024-04-26T12:06:55.030 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.044691529000000001, 2024-04-26T12:06:55.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017409937, 2024-04-26T12:06:55.030 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:55.030 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.030 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:55.030 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:55.030 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:55.030 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11110 2024-04-26T12:06:55.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.030 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:55.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.030 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:55.030 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.875848+0000", 2024-04-26T12:06:55.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:55.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:55.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.875848+0000", 2024-04-26T12:06:55.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:55.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:55.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.875846+0000", 2024-04-26T12:06:55.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999981 2024-04-26T12:06:55.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:55.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.882083+0000", 2024-04-26T12:06:55.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0062364370000000001 2024-04-26T12:06:55.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:55.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.882093+0000", 2024-04-26T12:06:55.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0635000000000001e-05 2024-04-26T12:06:55.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.882099+0000", 2024-04-26T12:06:55.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7010000000000001e-06 2024-04-26T12:06:55.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:55.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.882135+0000", 2024-04-26T12:06:55.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5819999999999999e-05 2024-04-26T12:06:55.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:55.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.882226+0000", 2024-04-26T12:06:55.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1065999999999999e-05 2024-04-26T12:06:55.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:55.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.882322+0000", 2024-04-26T12:06:55.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5704000000000004e-05 2024-04-26T12:06:55.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:55.034 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.888011+0000", 2024-04-26T12:06:55.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.005689309 2024-04-26T12:06:55.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:55.034 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.893206+0000", 2024-04-26T12:06:55.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051946709999999997 2024-04-26T12:06:55.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:55.034 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.893231+0000", 2024-04-26T12:06:55.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4919e-05 2024-04-26T12:06:55.035 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.035 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.035 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:55.035 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.893258+0000", 2024-04-26T12:06:55.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7552e-05 2024-04-26T12:06:55.035 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:55.035 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:55.035 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:55.035 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:55.035 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:55.035 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:55.038 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:55.036+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:55.038 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:55.056 INFO:tasks.workunit.client.0.smithi052.stdout:9/219: truncate d3/f7 9653 0 2024-04-26T12:06:55.056 INFO:tasks.workunit.client.0.smithi052.stdout:1/165: dread d0/d2/f2a [0,4194304] 0 2024-04-26T12:06:55.056 INFO:tasks.workunit.client.0.smithi052.stdout:9/220: creat d3/db/d24/f46 x:0 0 0 2024-04-26T12:06:55.056 INFO:tasks.workunit.client.0.smithi052.stdout:2/218: mkdir d0/d7/d16/d3a/d43 0 2024-04-26T12:06:55.056 INFO:tasks.workunit.client.0.smithi052.stdout:8/130: dread d0/d4/d5/f11 [0,4194304] 0 2024-04-26T12:06:55.056 INFO:tasks.workunit.client.0.smithi052.stdout:9/221: readlink d3/l5 0 2024-04-26T12:06:55.056 INFO:tasks.workunit.client.0.smithi052.stdout:6/157: dwrite da/d22/f25 [0,4194304] 0 2024-04-26T12:06:55.056 INFO:tasks.workunit.client.0.smithi052.stdout:3/154: dwrite d2/ff [0,4194304] 0 2024-04-26T12:06:55.056 INFO:tasks.workunit.client.0.smithi052.stdout:9/222: symlink d3/d39/l47 0 2024-04-26T12:06:55.056 INFO:tasks.workunit.client.0.smithi052.stdout:9/223: sync 2024-04-26T12:06:55.056 INFO:tasks.workunit.client.0.smithi052.stdout:3/155: mkdir d2/d4/d31 0 2024-04-26T12:06:55.056 INFO:tasks.workunit.client.0.smithi052.stdout:2/219: write d0/fa [2507072,73129] 0 2024-04-26T12:06:55.057 INFO:tasks.workunit.client.0.smithi052.stdout:8/131: rename d0/d4/d5/f14 to d0/d16/f23 0 2024-04-26T12:06:55.057 INFO:tasks.workunit.client.0.smithi052.stdout:3/156: chown d2/d4/l10 0 1 2024-04-26T12:06:55.057 INFO:tasks.workunit.client.0.smithi052.stdout:7/146: dwrite d1/d1f/f22 [0,4194304] 0 2024-04-26T12:06:55.057 INFO:tasks.workunit.client.0.smithi052.stdout:9/224: mknod d3/db/d10/d2e/d45/c48 0 2024-04-26T12:06:55.057 INFO:tasks.workunit.client.0.smithi052.stdout:3/157: creat d2/d4/dc/d1d/f32 x:0 0 0 2024-04-26T12:06:55.057 INFO:tasks.workunit.client.0.smithi052.stdout:2/220: getdents d0/d7 0 2024-04-26T12:06:55.057 INFO:tasks.workunit.client.0.smithi052.stdout:9/225: truncate d3/db/d10/f1c 4486304 0 2024-04-26T12:06:55.057 INFO:tasks.workunit.client.0.smithi052.stdout:3/158: chown d2/d4/dc/c26 2399709 1 2024-04-26T12:06:55.057 INFO:tasks.workunit.client.0.smithi052.stdout:2/221: symlink d0/d7/d16/l44 0 2024-04-26T12:06:55.057 INFO:tasks.workunit.client.0.smithi052.stdout:9/226: dread - d3/d3b/f3e zero size 2024-04-26T12:06:55.057 INFO:tasks.workunit.client.0.smithi052.stdout:2/222: readlink d0/d7/d16/l2d 0 2024-04-26T12:06:55.057 INFO:tasks.workunit.client.0.smithi052.stdout:3/159: fsync d2/d4/dc/f28 0 2024-04-26T12:06:55.057 INFO:tasks.workunit.client.0.smithi052.stdout:6/158: dwrite da/f32 [0,4194304] 0 2024-04-26T12:06:55.057 INFO:tasks.workunit.client.0.smithi052.stdout:6/159: chown da/f16 68980846 1 2024-04-26T12:06:55.057 INFO:tasks.workunit.client.0.smithi052.stdout:8/132: dwrite d0/d16/f1a [0,4194304] 0 2024-04-26T12:06:55.057 INFO:tasks.workunit.client.0.smithi052.stdout:9/227: mkdir d3/d1b/d49 0 2024-04-26T12:06:55.058 INFO:tasks.workunit.client.0.smithi052.stdout:5/198: dread db/dd/f19 [0,4194304] 0 2024-04-26T12:06:55.058 INFO:tasks.workunit.client.0.smithi052.stdout:3/160: mkdir d2/d4/dc/d33 0 2024-04-26T12:06:55.058 INFO:tasks.workunit.client.0.smithi052.stdout:6/160: write da/d22/f2d [682563,130911] 0 2024-04-26T12:06:55.058 INFO:tasks.workunit.client.0.smithi052.stdout:5/199: stat db/dc/d29/l31 0 2024-04-26T12:06:55.058 INFO:tasks.workunit.client.0.smithi052.stdout:8/133: creat d0/d4/d5/db/d20/f24 x:0 0 0 2024-04-26T12:06:55.058 INFO:tasks.workunit.client.0.smithi052.stdout:9/228: rename d3/db/d10/d2e/d45 to d3/db/d4a 0 2024-04-26T12:06:55.058 INFO:tasks.workunit.client.0.smithi052.stdout:5/200: mkdir db/d47 0 2024-04-26T12:06:55.058 INFO:tasks.workunit.client.0.smithi052.stdout:3/161: write d2/d4/dc/d12/f1e [9312342,127156] 0 2024-04-26T12:06:55.058 INFO:tasks.workunit.client.0.smithi052.stdout:9/229: mknod d3/d23/c4b 0 2024-04-26T12:06:55.058 INFO:tasks.workunit.client.0.smithi052.stdout:7/147: dwrite d1/f17 [0,4194304] 0 2024-04-26T12:06:55.058 INFO:tasks.workunit.client.0.smithi052.stdout:8/134: link d0/f1f d0/d4/dc/f25 0 2024-04-26T12:06:55.058 INFO:tasks.workunit.client.0.smithi052.stdout:3/162: fdatasync d2/d4/f21 0 2024-04-26T12:06:55.058 INFO:tasks.workunit.client.0.smithi052.stdout:7/148: creat d1/d1c/d23/f31 x:0 0 0 2024-04-26T12:06:55.058 INFO:tasks.workunit.client.0.smithi052.stdout:4/164: dread d3/f10 [0,4194304] 0 2024-04-26T12:06:55.059 INFO:tasks.workunit.client.0.smithi052.stdout:2/223: dwrite d0/f1d [0,4194304] 0 2024-04-26T12:06:55.059 INFO:tasks.workunit.client.0.smithi052.stdout:5/201: creat db/dd/d18/d1e/d40/f48 x:0 0 0 2024-04-26T12:06:55.059 INFO:tasks.workunit.client.0.smithi052.stdout:6/161: dread da/d22/f27 [0,4194304] 0 2024-04-26T12:06:55.059 INFO:tasks.workunit.client.0.smithi052.stdout:5/202: chown c8 62153 1 2024-04-26T12:06:55.059 INFO:tasks.workunit.client.0.smithi052.stdout:4/165: rename d3/d22/l28 to d3/d22/l36 0 2024-04-26T12:06:55.059 INFO:tasks.workunit.client.0.smithi052.stdout:6/162: symlink da/d22/l33 0 2024-04-26T12:06:55.059 INFO:tasks.workunit.client.0.smithi052.stdout:8/135: rename d0/d4/d5/db/d1b/f22 to d0/d4/f26 0 2024-04-26T12:06:55.059 INFO:tasks.workunit.client.0.smithi052.stdout:6/163: stat da/f16 0 2024-04-26T12:06:55.059 INFO:tasks.workunit.client.0.smithi052.stdout:9/230: dread d3/db/f20 [0,4194304] 0 2024-04-26T12:06:55.059 INFO:tasks.workunit.client.0.smithi052.stdout:4/166: link d3/d12/c26 d3/c37 0 2024-04-26T12:06:55.059 INFO:tasks.workunit.client.0.smithi052.stdout:6/164: rename c6 to da/d22/d29/c34 0 2024-04-26T12:06:55.059 INFO:tasks.workunit.client.0.smithi052.stdout:7/149: dwrite d1/d1c/f1e [0,4194304] 0 2024-04-26T12:06:55.059 INFO:tasks.workunit.client.0.smithi052.stdout:7/150: stat d1/d1c/d21 0 2024-04-26T12:06:55.059 INFO:tasks.workunit.client.0.smithi052.stdout:5/203: dwrite db/dd/d18/d1e/d40/f48 [0,4194304] 0 2024-04-26T12:06:55.060 INFO:tasks.workunit.client.0.smithi052.stdout:5/204: creat db/dd/d18/d1e/f49 x:0 0 0 2024-04-26T12:06:55.060 INFO:tasks.workunit.client.0.smithi052.stdout:2/224: dread d0/d7/d16/f1a [0,4194304] 0 2024-04-26T12:06:55.060 INFO:tasks.workunit.client.0.smithi052.stdout:0/232: dread d0/d1/d11/f16 [0,4194304] 0 2024-04-26T12:06:55.060 INFO:tasks.workunit.client.0.smithi052.stdout:8/136: dwrite d0/d4/d5/f8 [4194304,4194304] 0 2024-04-26T12:06:55.060 INFO:tasks.workunit.client.0.smithi052.stdout:5/205: rmdir db/dd/d18/d1e 39 2024-04-26T12:06:55.060 INFO:tasks.workunit.client.0.smithi052.stdout:6/165: dwrite da/f12 [0,4194304] 0 2024-04-26T12:06:55.060 INFO:tasks.workunit.client.0.smithi052.stdout:9/231: dwrite d3/db/d24/f2c [0,4194304] 0 2024-04-26T12:06:55.060 INFO:tasks.workunit.client.0.smithi052.stdout:4/167: dwrite d3/d1f/f25 [0,4194304] 0 2024-04-26T12:06:55.060 INFO:tasks.workunit.client.0.smithi052.stdout:8/137: mkdir d0/d4/d5/d27 0 2024-04-26T12:06:55.060 INFO:tasks.workunit.client.0.smithi052.stdout:2/225: getdents d0 0 2024-04-26T12:06:55.060 INFO:tasks.workunit.client.0.smithi052.stdout:7/151: dwrite d1/d1c/d21/f2e [0,4194304] 0 2024-04-26T12:06:55.060 INFO:tasks.workunit.client.0.smithi052.stdout:4/168: chown d3/d22/d30/l35 221 1 2024-04-26T12:06:55.060 INFO:tasks.workunit.client.0.smithi052.stdout:9/232: creat d3/db/d10/d3c/f4c x:0 0 0 2024-04-26T12:06:55.060 INFO:tasks.workunit.client.0.smithi052.stdout:8/138: mkdir d0/d16/d28 0 2024-04-26T12:06:55.061 INFO:tasks.workunit.client.0.smithi052.stdout:7/152: mknod d1/d1c/d21/c32 0 2024-04-26T12:06:55.061 INFO:tasks.workunit.client.0.smithi052.stdout:2/226: truncate d0/f6 747845 0 2024-04-26T12:06:55.061 INFO:tasks.workunit.client.0.smithi052.stdout:5/206: link db/dc/d29/l2c db/dd/d18/d1e/d25/l4a 0 2024-04-26T12:06:55.061 INFO:tasks.workunit.client.0.smithi052.stdout:4/169: chown d3/c8 57 1 2024-04-26T12:06:55.061 INFO:tasks.workunit.client.0.smithi052.stdout:7/153: mkdir d1/d1c/d21/d2f/d33 0 2024-04-26T12:06:55.061 INFO:tasks.workunit.client.0.smithi052.stdout:0/233: dread d0/d1/d11/f16 [0,4194304] 0 2024-04-26T12:06:55.061 INFO:tasks.workunit.client.0.smithi052.stdout:2/227: truncate d0/d7/d16/f38 189594 0 2024-04-26T12:06:55.061 INFO:tasks.workunit.client.0.smithi052.stdout:7/154: symlink d1/d1c/d21/d2f/l34 0 2024-04-26T12:06:55.061 INFO:tasks.workunit.client.0.smithi052.stdout:8/139: rmdir d0 39 2024-04-26T12:06:55.061 INFO:tasks.workunit.client.0.smithi052.stdout:9/233: write d3/db/d10/f1c [862698,96024] 0 2024-04-26T12:06:55.061 INFO:tasks.workunit.client.0.smithi052.stdout:2/228: creat d0/d36/f45 x:0 0 0 2024-04-26T12:06:55.061 INFO:tasks.workunit.client.0.smithi052.stdout:9/234: chown d3/d3b 506367324 1 2024-04-26T12:06:55.061 INFO:tasks.workunit.client.0.smithi052.stdout:8/140: chown d0/d4/d5/c15 5 1 2024-04-26T12:06:55.061 INFO:tasks.workunit.client.0.smithi052.stdout:0/234: truncate d0/d1/d11/f16 1184397 0 2024-04-26T12:06:55.061 INFO:tasks.workunit.client.0.smithi052.stdout:7/155: creat d1/f35 x:0 0 0 2024-04-26T12:06:55.062 INFO:tasks.workunit.client.0.smithi052.stdout:2/229: mknod d0/d7/d22/c46 0 2024-04-26T12:06:55.062 INFO:tasks.workunit.client.0.smithi052.stdout:9/235: unlink d3/db/d10/l30 0 2024-04-26T12:06:55.062 INFO:tasks.workunit.client.0.smithi052.stdout:1/166: dread d0/d2/de/f27 [0,4194304] 0 2024-04-26T12:06:55.062 INFO:tasks.workunit.client.0.smithi052.stdout:4/170: dwrite d3/d12/f20 [4194304,4194304] 0 2024-04-26T12:06:55.062 INFO:tasks.workunit.client.0.smithi052.stdout:7/156: symlink d1/d1f/l36 0 2024-04-26T12:06:55.062 INFO:tasks.workunit.client.0.smithi052.stdout:2/230: chown d0/d7/d16/c20 499834 1 2024-04-26T12:06:55.062 INFO:tasks.workunit.client.0.smithi052.stdout:1/167: creat d0/d2/dd/d2c/f3b x:0 0 0 2024-04-26T12:06:55.062 INFO:tasks.workunit.client.0.smithi052.stdout:8/141: write d0/d4/f26 [339056,94188] 0 2024-04-26T12:06:55.062 INFO:tasks.workunit.client.0.smithi052.stdout:9/236: rename d3/db/d10/d3c/f4c to d3/db/d4a/f4d 0 2024-04-26T12:06:55.062 INFO:tasks.workunit.client.0.smithi052.stdout:7/157: symlink d1/d1c/d21/d2f/d33/l37 0 2024-04-26T12:06:55.062 INFO:tasks.workunit.client.0.smithi052.stdout:5/207: dwrite db/f35 [0,4194304] 0 2024-04-26T12:06:55.062 INFO:tasks.workunit.client.0.smithi052.stdout:0/235: dread d0/d1/f6 [0,4194304] 0 2024-04-26T12:06:55.062 INFO:tasks.workunit.client.0.smithi052.stdout:8/142: creat d0/f29 x:0 0 0 2024-04-26T12:06:55.062 INFO:tasks.workunit.client.0.smithi052.stdout:8/143: stat d0/d4/d5/db/d20/f24 0 2024-04-26T12:06:55.062 INFO:tasks.workunit.client.0.smithi052.stdout:2/231: dwrite d0/f21 [0,4194304] 0 2024-04-26T12:06:55.063 INFO:tasks.workunit.client.0.smithi052.stdout:4/171: dwrite d3/d15/f17 [0,4194304] 0 2024-04-26T12:06:55.063 INFO:tasks.workunit.client.0.smithi052.stdout:5/208: dread db/f38 [0,4194304] 0 2024-04-26T12:06:55.063 INFO:tasks.workunit.client.0.smithi052.stdout:9/237: dwrite d3/db/f20 [0,4194304] 0 2024-04-26T12:06:55.063 INFO:tasks.workunit.client.0.smithi052.stdout:7/158: dwrite d1/d1f/f26 [0,4194304] 0 2024-04-26T12:06:55.063 INFO:tasks.workunit.client.0.smithi052.stdout:4/172: mknod d3/d2e/c38 0 2024-04-26T12:06:55.063 INFO:tasks.workunit.client.0.smithi052.stdout:5/209: fdatasync db/f26 0 2024-04-26T12:06:55.063 INFO:tasks.workunit.client.0.smithi052.stdout:3/163: sync 2024-04-26T12:06:55.063 INFO:tasks.workunit.client.0.smithi052.stdout:0/236: dwrite d0/d1/d1a/f4b [0,4194304] 0 2024-04-26T12:06:55.063 INFO:tasks.workunit.client.0.smithi052.stdout:4/173: truncate d3/f14 3691380 0 2024-04-26T12:06:55.063 INFO:tasks.workunit.client.0.smithi052.stdout:3/164: rename d2/l1a to d2/l34 0 2024-04-26T12:06:55.063 INFO:tasks.workunit.client.0.smithi052.stdout:5/210: write db/f38 [3772906,107139] 0 2024-04-26T12:06:55.063 INFO:tasks.workunit.client.0.smithi052.stdout:2/232: dread d0/d7/f31 [0,4194304] 0 2024-04-26T12:06:55.063 INFO:tasks.workunit.client.0.smithi052.stdout:0/237: chown d0/d1/dd/f28 1848 1 2024-04-26T12:06:55.063 INFO:tasks.workunit.client.0.smithi052.stdout:4/174: write d3/f9 [3221973,120568] 0 2024-04-26T12:06:55.064 INFO:tasks.workunit.client.0.smithi052.stdout:3/165: creat d2/d4/dc/d1d/d25/f35 x:0 0 0 2024-04-26T12:06:55.064 INFO:tasks.workunit.client.0.smithi052.stdout:0/238: unlink d0/c39 0 2024-04-26T12:06:55.064 INFO:tasks.workunit.client.0.smithi052.stdout:3/166: fdatasync d2/d1f/f2c 0 2024-04-26T12:06:55.064 INFO:tasks.workunit.client.0.smithi052.stdout:2/233: rename d0/d7/lf to d0/d7/d2f/d3d/l47 0 2024-04-26T12:06:55.064 INFO:tasks.workunit.client.0.smithi052.stdout:4/175: rename d3/c8 to d3/d15/c39 0 2024-04-26T12:06:55.064 INFO:tasks.workunit.client.0.smithi052.stdout:0/239: symlink d0/d1/d2c/l4d 0 2024-04-26T12:06:55.064 INFO:tasks.workunit.client.0.smithi052.stdout:2/234: truncate d0/d7/d16/f30 923876 0 2024-04-26T12:06:55.064 INFO:tasks.workunit.client.0.smithi052.stdout:5/211: dread db/dd/f19 [0,4194304] 0 2024-04-26T12:06:55.064 INFO:tasks.workunit.client.0.smithi052.stdout:0/240: mkdir d0/d1/d11/d4e 0 2024-04-26T12:06:55.064 INFO:tasks.workunit.client.0.smithi052.stdout:7/159: truncate d1/f14 388629 0 2024-04-26T12:06:55.064 INFO:tasks.workunit.client.0.smithi052.stdout:0/241: stat d0/l2e 0 2024-04-26T12:06:55.064 INFO:tasks.workunit.client.0.smithi052.stdout:9/238: truncate d3/db/f20 5135435 0 2024-04-26T12:06:55.064 INFO:tasks.workunit.client.0.smithi052.stdout:4/176: write d3/d12/f19 [3813003,99524] 0 2024-04-26T12:06:55.064 INFO:tasks.workunit.client.0.smithi052.stdout:5/212: rmdir db/d47 0 2024-04-26T12:06:55.064 INFO:tasks.workunit.client.0.smithi052.stdout:9/239: mknod d3/d1b/c4e 0 2024-04-26T12:06:55.065 INFO:tasks.workunit.client.0.smithi052.stdout:0/242: mkdir d0/d1/d1a/d2a/d4f 0 2024-04-26T12:06:55.065 INFO:tasks.workunit.client.0.smithi052.stdout:0/243: unlink d0/d1/f6 0 2024-04-26T12:06:55.065 INFO:tasks.workunit.client.0.smithi052.stdout:9/240: mknod d3/d1b/d49/c4f 0 2024-04-26T12:06:55.065 INFO:tasks.workunit.client.0.smithi052.stdout:5/213: write db/dc/f1d [4049574,40370] 0 2024-04-26T12:06:55.065 INFO:tasks.workunit.client.0.smithi052.stdout:3/167: dwrite d2/d4/dc/d1d/f32 [0,4194304] 0 2024-04-26T12:06:55.065 INFO:tasks.workunit.client.0.smithi052.stdout:9/241: readlink d3/db/l26 0 2024-04-26T12:06:55.065 INFO:tasks.workunit.client.0.smithi052.stdout:9/242: fsync d3/d3b/f3e 0 2024-04-26T12:06:55.065 INFO:tasks.workunit.client.0.smithi052.stdout:0/244: rename d0/d1/dd/c1d to d0/d1/d11/d4e/c50 0 2024-04-26T12:06:55.065 INFO:tasks.workunit.client.0.smithi052.stdout:3/168: getdents d2/d4/dc/d12 0 2024-04-26T12:06:55.065 INFO:tasks.workunit.client.0.smithi052.stdout:2/235: write d0/f5 [211983,124859] 0 2024-04-26T12:06:55.065 INFO:tasks.workunit.client.0.smithi052.stdout:5/214: getdents db/dd/d18 0 2024-04-26T12:06:55.065 INFO:tasks.workunit.client.0.smithi052.stdout:3/169: fsync d2/fb 0 2024-04-26T12:06:55.065 INFO:tasks.workunit.client.0.smithi052.stdout:2/236: fdatasync d0/f21 0 2024-04-26T12:06:55.065 INFO:tasks.workunit.client.0.smithi052.stdout:7/160: dwrite d1/fd [0,4194304] 0 2024-04-26T12:06:55.065 INFO:tasks.workunit.client.0.smithi052.stdout:5/215: rmdir db/dc/d29/d42 0 2024-04-26T12:06:55.066 INFO:tasks.workunit.client.0.smithi052.stdout:2/237: creat d0/d7/d2f/d3d/f48 x:0 0 0 2024-04-26T12:06:55.066 INFO:tasks.workunit.client.0.smithi052.stdout:5/216: chown db/dd/d18/d1e/d40/d46 106201 1 2024-04-26T12:06:55.066 INFO:tasks.workunit.client.0.smithi052.stdout:3/170: write d2/f29 [812403,108174] 0 2024-04-26T12:06:55.066 INFO:tasks.workunit.client.0.smithi052.stdout:5/217: fsync db/dd/d18/d1e/d40/f48 0 2024-04-26T12:06:55.066 INFO:tasks.workunit.client.0.smithi052.stdout:1/168: dread d0/da/f19 [0,4194304] 0 2024-04-26T12:06:55.066 INFO:tasks.workunit.client.0.smithi052.stdout:1/169: rmdir d0 39 2024-04-26T12:06:55.066 INFO:tasks.workunit.client.0.smithi052.stdout:0/245: dwrite d0/f3 [0,4194304] 0 2024-04-26T12:06:55.066 INFO:tasks.workunit.client.0.smithi052.stdout:5/218: fsync db/dd/d18/d1e/d40/f48 0 2024-04-26T12:06:55.066 INFO:tasks.workunit.client.0.smithi052.stdout:1/170: fsync d0/d2/de/f2d 0 2024-04-26T12:06:55.066 INFO:tasks.workunit.client.0.smithi052.stdout:7/161: dwrite d1/f9 [4194304,4194304] 0 2024-04-26T12:06:55.066 INFO:tasks.workunit.client.0.smithi052.stdout:2/238: dwrite d0/f33 [0,4194304] 0 2024-04-26T12:06:55.066 INFO:tasks.workunit.client.0.smithi052.stdout:5/219: creat db/dd/d18/d1e/d40/d46/f4b x:0 0 0 2024-04-26T12:06:55.066 INFO:tasks.workunit.client.0.smithi052.stdout:5/220: fdatasync db/dd/f27 0 2024-04-26T12:06:55.066 INFO:tasks.workunit.client.0.smithi052.stdout:8/144: dread d0/f2 [0,4194304] 0 2024-04-26T12:06:55.066 INFO:tasks.workunit.client.0.smithi052.stdout:7/162: link d1/d1c/d23/f2c d1/d1c/d21/d2f/f38 0 2024-04-26T12:06:55.067 INFO:tasks.workunit.client.0.smithi052.stdout:7/163: fsync d1/f20 0 2024-04-26T12:06:55.067 INFO:tasks.workunit.client.0.smithi052.stdout:8/145: write d0/d4/f17 [2099162,75893] 0 2024-04-26T12:06:55.067 INFO:tasks.workunit.client.0.smithi052.stdout:7/164: stat d1/d1c/d21/d2f/f38 0 2024-04-26T12:06:55.067 INFO:tasks.workunit.client.0.smithi052.stdout:1/171: dread d0/d2/dd/d1c/d1d/d23/f38 [0,4194304] 0 2024-04-26T12:06:55.067 INFO:tasks.workunit.client.0.smithi052.stdout:8/146: chown d0/d4/d5/c15 804259 1 2024-04-26T12:06:55.067 INFO:tasks.workunit.client.0.smithi052.stdout:7/165: read d1/d1f/f22 [2399915,58327] 0 2024-04-26T12:06:55.067 INFO:tasks.workunit.client.0.smithi052.stdout:1/172: fdatasync d0/d2/f2a 0 2024-04-26T12:06:55.067 INFO:tasks.workunit.client.0.smithi052.stdout:2/239: dwrite d0/d7/d22/f28 [4194304,4194304] 0 2024-04-26T12:06:55.067 INFO:tasks.workunit.client.0.smithi052.stdout:7/166: chown d1/f35 101254604 1 2024-04-26T12:06:55.067 INFO:tasks.workunit.client.0.smithi052.stdout:5/221: dwrite db/dd/d18/d1e/f3a [0,4194304] 0 2024-04-26T12:06:55.067 INFO:tasks.workunit.client.0.smithi052.stdout:1/173: getdents d0/da/d2e 0 2024-04-26T12:06:55.067 INFO:tasks.workunit.client.0.smithi052.stdout:5/222: getdents db/dc/d29 0 2024-04-26T12:06:55.067 INFO:tasks.workunit.client.0.smithi052.stdout:5/223: chown db/l14 207352156 1 2024-04-26T12:06:55.067 INFO:tasks.workunit.client.0.smithi052.stdout:5/224: write db/f35 [1668886,97469] 0 2024-04-26T12:06:55.068 INFO:tasks.workunit.client.0.smithi052.stdout:6/166: sync 2024-04-26T12:06:55.068 INFO:tasks.workunit.client.0.smithi052.stdout:4/177: sync 2024-04-26T12:06:55.068 INFO:tasks.workunit.client.0.smithi052.stdout:2/240: dwrite d0/d7/d16/f38 [0,4194304] 0 2024-04-26T12:06:55.068 INFO:tasks.workunit.client.0.smithi052.stdout:3/171: dread d2/f29 [0,4194304] 0 2024-04-26T12:06:55.068 INFO:tasks.workunit.client.0.smithi052.stdout:4/178: creat d3/d2e/f3a x:0 0 0 2024-04-26T12:06:55.068 INFO:tasks.workunit.client.0.smithi052.stdout:7/167: dwrite d1/f14 [0,4194304] 0 2024-04-26T12:06:55.068 INFO:tasks.workunit.client.0.smithi052.stdout:2/241: mknod d0/d3f/c49 0 2024-04-26T12:06:55.068 INFO:tasks.workunit.client.0.smithi052.stdout:6/167: creat da/d22/d29/d31/f35 x:0 0 0 2024-04-26T12:06:55.068 INFO:tasks.workunit.client.0.smithi052.stdout:0/246: fsync d0/f3 0 2024-04-26T12:06:55.068 INFO:tasks.workunit.client.0.smithi052.stdout:5/225: link db/dd/d18/d1e/f3a db/dd/d18/d1e/d40/d46/f4c 0 2024-04-26T12:06:55.068 INFO:tasks.workunit.client.0.smithi052.stdout:1/174: dwrite d0/d2/dd/d1c/d1d/d23/f30 [0,4194304] 0 2024-04-26T12:06:55.068 INFO:tasks.workunit.client.0.smithi052.stdout:6/168: unlink da/f32 0 2024-04-26T12:06:55.068 INFO:tasks.workunit.client.0.smithi052.stdout:3/172: dread d2/d4/dc/d12/d1c/f20 [0,4194304] 0 2024-04-26T12:06:55.069 INFO:tasks.workunit.client.0.smithi052.stdout:2/242: mkdir d0/d7/d2f/d4a 0 2024-04-26T12:06:55.069 INFO:tasks.workunit.client.0.smithi052.stdout:1/175: chown d0/d2/dd/d1c/d1d 0 1 2024-04-26T12:06:55.069 INFO:tasks.workunit.client.0.smithi052.stdout:6/169: write da/f1d [172241,34866] 0 2024-04-26T12:06:55.069 INFO:tasks.workunit.client.0.smithi052.stdout:0/247: rename d0/d1/dd/f28 to d0/d1/d1a/d2a/f51 0 2024-04-26T12:06:55.069 INFO:tasks.workunit.client.0.smithi052.stdout:6/170: write da/f16 [8247999,52426] 0 2024-04-26T12:06:55.069 INFO:tasks.workunit.client.0.smithi052.stdout:4/179: truncate d3/fd 452073 0 2024-04-26T12:06:55.069 INFO:tasks.workunit.client.0.smithi052.stdout:1/176: mkdir d0/d2/dd/d1c/d3c 0 2024-04-26T12:06:55.069 INFO:tasks.workunit.client.0.smithi052.stdout:3/173: rename d2/d4/dc/d12 to d2/d4/dc/d1d/d25/d36 0 2024-04-26T12:06:55.069 INFO:tasks.workunit.client.0.smithi052.stdout:0/248: fsync d0/f45 0 2024-04-26T12:06:55.069 INFO:tasks.workunit.client.0.smithi052.stdout:4/180: write d3/d15/f17 [2886750,835] 0 2024-04-26T12:06:55.069 INFO:tasks.workunit.client.0.smithi052.stdout:1/177: read - d0/d2/de/f2d zero size 2024-04-26T12:06:55.069 INFO:tasks.workunit.client.0.smithi052.stdout:0/249: read - d0/d1/f41 zero size 2024-04-26T12:06:55.069 INFO:tasks.workunit.client.0.smithi052.stdout:3/174: mkdir d2/d4/dc/d33/d37 0 2024-04-26T12:06:55.069 INFO:tasks.workunit.client.0.smithi052.stdout:7/168: dwrite d1/f7 [4194304,4194304] 0 2024-04-26T12:06:55.070 INFO:tasks.workunit.client.0.smithi052.stdout:5/226: dread db/dd/d18/d1e/f2f [0,4194304] 0 2024-04-26T12:06:55.072 INFO:tasks.workunit.client.0.smithi052.stdout:7/169: stat d1/f9 0 2024-04-26T12:06:55.072 INFO:tasks.workunit.client.0.smithi052.stdout:1/178: mkdir d0/d2/d3d 0 2024-04-26T12:06:55.072 INFO:tasks.workunit.client.0.smithi052.stdout:5/227: stat db/dd/d18/c20 0 2024-04-26T12:06:55.072 INFO:tasks.workunit.client.0.smithi052.stdout:3/175: unlink d2/d4/dc/ce 0 2024-04-26T12:06:55.072 INFO:tasks.workunit.client.0.smithi052.stdout:8/147: sync 2024-04-26T12:06:55.072 INFO:tasks.workunit.client.0.smithi052.stdout:9/243: sync 2024-04-26T12:06:55.072 INFO:tasks.workunit.client.0.smithi052.stdout:4/181: getdents d3/d12/d34 0 2024-04-26T12:06:55.073 INFO:tasks.workunit.client.0.smithi052.stdout:0/250: mkdir d0/d1/d52 0 2024-04-26T12:06:55.073 INFO:tasks.workunit.client.0.smithi052.stdout:2/243: dwrite d0/d7/d16/f1a [0,4194304] 0 2024-04-26T12:06:55.073 INFO:tasks.workunit.client.0.smithi052.stdout:8/148: creat d0/d16/f2a x:0 0 0 2024-04-26T12:06:55.073 INFO:tasks.workunit.client.0.smithi052.stdout:6/171: dread da/f13 [0,4194304] 0 2024-04-26T12:06:55.073 INFO:tasks.workunit.client.0.smithi052.stdout:1/179: rename d0/d2/d3d to d0/d2/dd/d34/d3e 0 2024-04-26T12:06:55.073 INFO:tasks.workunit.client.0.smithi052.stdout:8/149: chown d0/c13 793440 1 2024-04-26T12:06:55.073 INFO:tasks.workunit.client.0.smithi052.stdout:9/244: chown d3/db/d10/f1c 3239 1 2024-04-26T12:06:55.073 INFO:tasks.workunit.client.0.smithi052.stdout:4/182: mknod d3/d1f/d21/c3b 0 2024-04-26T12:06:55.073 INFO:tasks.workunit.client.0.smithi052.stdout:2/244: write d0/d7/d16/f1a [4807658,76156] 0 2024-04-26T12:06:55.073 INFO:tasks.workunit.client.0.smithi052.stdout:3/176: unlink d2/d4/dc/l27 0 2024-04-26T12:06:55.073 INFO:tasks.workunit.client.0.smithi052.stdout:5/228: getdents db/dd/d18/d1e/d3f 0 2024-04-26T12:06:55.073 INFO:tasks.workunit.client.0.smithi052.stdout:6/172: truncate da/f20 743906 0 2024-04-26T12:06:55.073 INFO:tasks.workunit.client.0.smithi052.stdout:9/245: chown d3/d23/l27 1758337161 1 2024-04-26T12:06:55.073 INFO:tasks.workunit.client.0.smithi052.stdout:1/180: creat d0/f3f x:0 0 0 2024-04-26T12:06:55.074 INFO:tasks.workunit.client.0.smithi052.stdout:4/183: fdatasync d3/d2e/f3a 0 2024-04-26T12:06:55.074 INFO:tasks.workunit.client.0.smithi052.stdout:3/177: creat d2/f38 x:0 0 0 2024-04-26T12:06:55.074 INFO:tasks.workunit.client.0.smithi052.stdout:7/170: dwrite d1/f20 [0,4194304] 0 2024-04-26T12:06:55.074 INFO:tasks.workunit.client.0.smithi052.stdout:1/181: truncate d0/d2/f10 1594933 0 2024-04-26T12:06:55.074 INFO:tasks.workunit.client.0.smithi052.stdout:3/178: getdents d2/d4/d31 0 2024-04-26T12:06:55.074 INFO:tasks.workunit.client.0.smithi052.stdout:1/182: mkdir d0/d2/dd/d40 0 2024-04-26T12:06:55.075 INFO:tasks.workunit.client.0.smithi052.stdout:8/150: dwrite d0/d16/f1a [0,4194304] 0 2024-04-26T12:06:55.075 INFO:tasks.workunit.client.0.smithi052.stdout:3/179: write d2/d4/dc/f28 [1694469,21938] 0 2024-04-26T12:06:55.075 INFO:tasks.workunit.client.0.smithi052.stdout:6/173: truncate da/f13 1591636 0 2024-04-26T12:06:55.075 INFO:tasks.workunit.client.0.smithi052.stdout:1/183: chown d0/d2/dd/d1c/d1d 172 1 2024-04-26T12:06:55.075 INFO:tasks.workunit.client.0.smithi052.stdout:5/229: dwrite f1 [0,4194304] 0 2024-04-26T12:06:55.075 INFO:tasks.workunit.client.0.smithi052.stdout:2/245: dwrite d0/d7/d2f/d3d/f48 [0,4194304] 0 2024-04-26T12:06:55.077 INFO:tasks.workunit.client.0.smithi052.stdout:5/230: readlink db/dd/l2d 0 2024-04-26T12:06:55.078 INFO:tasks.workunit.client.0.smithi052.stdout:4/184: dwrite d3/d12/f13 [0,4194304] 0 2024-04-26T12:06:55.079 INFO:tasks.workunit.client.0.smithi052.stdout:0/251: dwrite d0/d1/d11/f16 [0,4194304] 0 2024-04-26T12:06:55.079 INFO:tasks.workunit.client.0.smithi052.stdout:1/184: dread - d0/d2/dd/d2c/f3b zero size 2024-04-26T12:06:55.079 INFO:tasks.workunit.client.0.smithi052.stdout:7/171: dwrite d1/fd [0,4194304] 0 2024-04-26T12:06:55.079 INFO:tasks.workunit.client.0.smithi052.stdout:7/172: dread - d1/d1c/d21/f2b zero size 2024-04-26T12:06:55.080 INFO:tasks.workunit.client.0.smithi052.stdout:5/231: unlink db/dd/c28 0 2024-04-26T12:06:55.080 INFO:tasks.workunit.client.0.smithi052.stdout:1/185: creat d0/d2/dd/d2c/f41 x:0 0 0 2024-04-26T12:06:55.081 INFO:tasks.workunit.client.0.smithi052.stdout:2/246: mkdir d0/d7/d16/d3a/d43/d4b 0 2024-04-26T12:06:55.081 INFO:tasks.workunit.client.0.smithi052.stdout:7/173: getdents d1 0 2024-04-26T12:06:55.082 INFO:tasks.workunit.client.0.smithi052.stdout:5/232: mknod db/dd/d18/d1e/d40/c4d 0 2024-04-26T12:06:55.082 INFO:tasks.workunit.client.0.smithi052.stdout:1/186: mknod d0/d2/dd/d34/d3e/c42 0 2024-04-26T12:06:55.082 INFO:tasks.workunit.client.0.smithi052.stdout:7/174: readlink d1/l1b 0 2024-04-26T12:06:55.083 INFO:tasks.workunit.client.0.smithi052.stdout:5/233: write db/dd/d18/d1e/f36 [802622,84041] 0 2024-04-26T12:06:55.088 INFO:tasks.workunit.client.0.smithi052.stdout:7/175: dread d1/f14 [0,4194304] 0 2024-04-26T12:06:55.088 INFO:tasks.workunit.client.0.smithi052.stdout:2/247: dwrite d0/f4 [4194304,4194304] 0 2024-04-26T12:06:55.088 INFO:tasks.workunit.client.0.smithi052.stdout:7/176: readlink d1/d1f/l36 0 2024-04-26T12:06:55.089 INFO:tasks.workunit.client.0.smithi052.stdout:7/177: fdatasync d1/f6 0 2024-04-26T12:06:55.089 INFO:tasks.workunit.client.0.smithi052.stdout:6/174: write da/f13 [289733,37108] 0 2024-04-26T12:06:55.090 INFO:tasks.workunit.client.0.smithi052.stdout:1/187: dwrite d0/d2/de/f27 [0,4194304] 0 2024-04-26T12:06:55.090 INFO:tasks.workunit.client.0.smithi052.stdout:2/248: mkdir d0/d7/d2f/d4c 0 2024-04-26T12:06:55.091 INFO:tasks.workunit.client.0.smithi052.stdout:7/178: mknod d1/d1f/c39 0 2024-04-26T12:06:55.091 INFO:tasks.workunit.client.0.smithi052.stdout:1/188: stat d0/da/d2e/c35 0 2024-04-26T12:06:55.092 INFO:tasks.workunit.client.0.smithi052.stdout:2/249: mkdir d0/d7/d16/d4d 0 2024-04-26T12:06:55.092 INFO:tasks.workunit.client.0.smithi052.stdout:6/175: truncate da/d22/d29/d31/f35 925917 0 2024-04-26T12:06:55.094 INFO:tasks.workunit.client.0.smithi052.stdout:7/179: getdents d1/d1c/d23 0 2024-04-26T12:06:55.094 INFO:tasks.workunit.client.0.smithi052.stdout:1/189: symlink d0/d2/dd/d34/d3e/l43 0 2024-04-26T12:06:55.094 INFO:tasks.workunit.client.0.smithi052.stdout:0/252: dwrite d0/d1/f24 [0,4194304] 0 2024-04-26T12:06:55.094 INFO:tasks.workunit.client.0.smithi052.stdout:6/176: creat da/d22/d29/f36 x:0 0 0 2024-04-26T12:06:55.095 INFO:tasks.workunit.client.0.smithi052.stdout:2/250: link d0/d7/d2f/l34 d0/d3f/l4e 0 2024-04-26T12:06:55.095 INFO:tasks.workunit.client.0.smithi052.stdout:7/180: mkdir d1/d1c/d21/d2f/d33/d3a 0 2024-04-26T12:06:55.096 INFO:tasks.workunit.client.0.smithi052.stdout:7/181: dread - d1/f16 zero size 2024-04-26T12:06:55.096 INFO:tasks.workunit.client.0.smithi052.stdout:0/253: mknod d0/d1/d52/c53 0 2024-04-26T12:06:55.096 INFO:tasks.workunit.client.0.smithi052.stdout:1/190: getdents d0/d2/dd/d1c/d1d 0 2024-04-26T12:06:55.096 INFO:tasks.workunit.client.0.smithi052.stdout:2/251: write d0/d7/d16/f1a [1218310,85827] 0 2024-04-26T12:06:55.097 INFO:tasks.workunit.client.0.smithi052.stdout:2/252: read d0/f1d [3721542,67396] 0 2024-04-26T12:06:55.098 INFO:tasks.workunit.client.0.smithi052.stdout:0/254: chown d0/f9 171800 1 2024-04-26T12:06:55.098 INFO:tasks.workunit.client.0.smithi052.stdout:1/191: truncate d0/d2/dd/d2c/f3b 462746 0 2024-04-26T12:06:55.098 INFO:tasks.workunit.client.0.smithi052.stdout:0/255: mkdir d0/d1/d54 0 2024-04-26T12:06:55.098 INFO:tasks.workunit.client.0.smithi052.stdout:2/253: symlink d0/d7/d2f/d4a/l4f 0 2024-04-26T12:06:55.098 INFO:tasks.workunit.client.0.smithi052.stdout:0/256: readlink d0/l7 0 2024-04-26T12:06:55.099 INFO:tasks.workunit.client.0.smithi052.stdout:1/192: link d0/d2/f2a d0/d2/de/f44 0 2024-04-26T12:06:55.099 INFO:tasks.workunit.client.0.smithi052.stdout:2/254: symlink d0/d3f/l50 0 2024-04-26T12:06:55.099 INFO:tasks.workunit.client.0.smithi052.stdout:0/257: mknod d0/d1/dd/c55 0 2024-04-26T12:06:55.100 INFO:tasks.workunit.client.0.smithi052.stdout:1/193: rename d0/d2/dd/d2c/f41 to d0/da/f45 0 2024-04-26T12:06:55.100 INFO:tasks.workunit.client.0.smithi052.stdout:2/255: link d0/d7/d2f/d4a/l4f d0/d36/l51 0 2024-04-26T12:06:55.101 INFO:tasks.workunit.client.0.smithi052.stdout:2/256: mknod d0/d7/d16/d4d/c52 0 2024-04-26T12:06:55.104 INFO:tasks.workunit.client.0.smithi052.stdout:2/257: chown d0/d7/d2f/d3d/l47 448192029 1 2024-04-26T12:06:55.104 INFO:tasks.workunit.client.0.smithi052.stdout:0/258: dwrite d0/f9 [8388608,4194304] 0 2024-04-26T12:06:55.105 INFO:tasks.workunit.client.0.smithi052.stdout:0/259: symlink d0/d1/d2c/l56 0 2024-04-26T12:06:55.106 INFO:tasks.workunit.client.0.smithi052.stdout:1/194: dwrite d0/f3f [0,4194304] 0 2024-04-26T12:06:55.108 INFO:tasks.workunit.client.0.smithi052.stdout:1/195: write d0/d2/dd/d2c/f3b [703285,51690] 0 2024-04-26T12:06:55.108 INFO:tasks.workunit.client.0.smithi052.stdout:8/151: sync 2024-04-26T12:06:55.108 INFO:tasks.workunit.client.0.smithi052.stdout:3/180: sync 2024-04-26T12:06:55.108 INFO:tasks.workunit.client.0.smithi052.stdout:4/185: sync 2024-04-26T12:06:55.109 INFO:tasks.workunit.client.0.smithi052.stdout:3/181: symlink d2/d4/dc/l39 0 2024-04-26T12:06:55.109 INFO:tasks.workunit.client.0.smithi052.stdout:4/186: symlink d3/l3c 0 2024-04-26T12:06:55.109 INFO:tasks.workunit.client.0.smithi052.stdout:2/258: truncate d0/d7/d16/f38 3403914 0 2024-04-26T12:06:55.111 INFO:tasks.workunit.client.0.smithi052.stdout:0/260: rename d0/d1/d2c/l56 to d0/d1/d1a/d20/d47/l57 0 2024-04-26T12:06:55.111 INFO:tasks.workunit.client.0.smithi052.stdout:8/152: link d0/d4/d5/f8 d0/d4/d1c/f2b 0 2024-04-26T12:06:55.112 INFO:tasks.workunit.client.0.smithi052.stdout:0/261: fdatasync d0/d1/d1a/f37 0 2024-04-26T12:06:55.112 INFO:tasks.workunit.client.0.smithi052.stdout:0/262: fsync d0/f49 0 2024-04-26T12:06:55.113 INFO:tasks.workunit.client.0.smithi052.stdout:1/196: rename d0/da/f45 to d0/da/d3a/f46 0 2024-04-26T12:06:55.113 INFO:tasks.workunit.client.0.smithi052.stdout:8/153: fdatasync d0/d4/d1c/f2b 0 2024-04-26T12:06:55.114 INFO:tasks.workunit.client.0.smithi052.stdout:4/187: getdents d3/d22 0 2024-04-26T12:06:55.114 INFO:tasks.workunit.client.0.smithi052.stdout:1/197: fdatasync d0/da/f2f 0 2024-04-26T12:06:55.114 INFO:tasks.workunit.client.0.smithi052.stdout:3/182: dwrite d2/d1f/f2c [0,4194304] 0 2024-04-26T12:06:55.116 INFO:tasks.workunit.client.0.smithi052.stdout:2/259: dwrite d0/d7/d16/f40 [0,4194304] 0 2024-04-26T12:06:55.116 INFO:tasks.workunit.client.0.smithi052.stdout:3/183: read - d2/f2f zero size 2024-04-26T12:06:55.116 INFO:tasks.workunit.client.0.smithi052.stdout:0/263: getdents d0/d26/d36 0 2024-04-26T12:06:55.116 INFO:tasks.workunit.client.0.smithi052.stdout:4/188: mknod d3/d1f/c3d 0 2024-04-26T12:06:55.117 INFO:tasks.workunit.client.0.smithi052.stdout:8/154: rename d0/d4/dc/f25 to d0/d4/d1c/f2c 0 2024-04-26T12:06:55.117 INFO:tasks.workunit.client.0.smithi052.stdout:2/260: write d0/f6 [751675,11655] 0 2024-04-26T12:06:55.118 INFO:tasks.workunit.client.0.smithi052.stdout:4/189: rename d3/d1f/f24 to d3/d2b/f3e 0 2024-04-26T12:06:55.119 INFO:tasks.workunit.client.0.smithi052.stdout:3/184: creat d2/d4/dc/d33/d37/f3a x:0 0 0 2024-04-26T12:06:55.119 INFO:tasks.workunit.client.0.smithi052.stdout:2/261: stat d0/d7/d16/c2a 0 2024-04-26T12:06:55.119 INFO:tasks.workunit.client.0.smithi052.stdout:9/246: dread d3/db/d13/f29 [4194304,4194304] 0 2024-04-26T12:06:55.120 INFO:tasks.workunit.client.0.smithi052.stdout:1/198: write d0/d2/de/f44 [5565384,55047] 0 2024-04-26T12:06:55.120 INFO:tasks.workunit.client.0.smithi052.stdout:4/190: creat d3/d1f/f3f x:0 0 0 2024-04-26T12:06:55.121 INFO:tasks.workunit.client.0.smithi052.stdout:3/185: write d2/f7 [1492182,58158] 0 2024-04-26T12:06:55.122 INFO:tasks.workunit.client.0.smithi052.stdout:8/155: rename d0/d4/d5/db/lf to d0/d4/d5/db/d1b/l2d 0 2024-04-26T12:06:55.122 INFO:tasks.workunit.client.0.smithi052.stdout:4/191: mkdir d3/d2b/d40 0 2024-04-26T12:06:55.123 INFO:tasks.workunit.client.0.smithi052.stdout:9/247: rename d3/c31 to d3/db/d24/c50 0 2024-04-26T12:06:55.123 INFO:tasks.workunit.client.0.smithi052.stdout:3/186: chown d2/d4/d2a/d2d/f2e 0 1 2024-04-26T12:06:55.124 INFO:tasks.workunit.client.0.smithi052.stdout:4/192: mknod d3/d22/d30/c41 0 2024-04-26T12:06:55.124 INFO:tasks.workunit.client.0.smithi052.stdout:5/234: sync 2024-04-26T12:06:55.124 INFO:tasks.workunit.client.0.smithi052.stdout:8/156: write d0/d4/d1c/f2c [64611,65264] 0 2024-04-26T12:06:55.124 INFO:tasks.workunit.client.0.smithi052.stdout:4/193: readlink d3/lf 0 2024-04-26T12:06:55.125 INFO:tasks.workunit.client.0.smithi052.stdout:0/264: dwrite d0/f49 [0,4194304] 0 2024-04-26T12:06:55.125 INFO:tasks.workunit.client.0.smithi052.stdout:9/248: link d3/db/f20 d3/db/d13/f51 0 2024-04-26T12:06:55.126 INFO:tasks.workunit.client.0.smithi052.stdout:5/235: symlink db/dd/d34/l4e 0 2024-04-26T12:06:55.126 INFO:tasks.workunit.client.0.smithi052.stdout:8/157: readlink d0/d4/d5/db/d1b/l2d 0 2024-04-26T12:06:55.126 INFO:tasks.workunit.client.0.smithi052.stdout:4/194: write d3/d15/f17 [4045805,80385] 0 2024-04-26T12:06:55.127 INFO:tasks.workunit.client.0.smithi052.stdout:3/187: link d2/d4/dc/d1d/d25/d36/f1e d2/d4/dc/d1d/d25/f3b 0 2024-04-26T12:06:55.127 INFO:tasks.workunit.client.0.smithi052.stdout:0/265: creat d0/d1/d2c/d42/f58 x:0 0 0 2024-04-26T12:06:55.129 INFO:tasks.workunit.client.0.smithi052.stdout:5/236: write db/dc/f12 [3804569,97965] 0 2024-04-26T12:06:55.129 INFO:tasks.workunit.client.0.smithi052.stdout:8/158: chown d0/d4/d5/db/d20/f24 73118894 1 2024-04-26T12:06:55.129 INFO:tasks.workunit.client.0.smithi052.stdout:1/199: dwrite d0/d2/dd/f32 [0,4194304] 0 2024-04-26T12:06:55.129 INFO:tasks.workunit.client.0.smithi052.stdout:4/195: link d3/d12/f19 d3/d22/d30/f42 0 2024-04-26T12:06:55.130 INFO:tasks.workunit.client.0.smithi052.stdout:3/188: creat d2/d4/dc/d1d/d25/d36/d1c/f3c x:0 0 0 2024-04-26T12:06:55.130 INFO:tasks.workunit.client.0.smithi052.stdout:8/159: write d0/d16/f1a [1988500,97050] 0 2024-04-26T12:06:55.133 INFO:tasks.workunit.client.0.smithi052.stdout:1/200: symlink d0/d2/dd/d2c/l47 0 2024-04-26T12:06:55.133 INFO:tasks.workunit.client.0.smithi052.stdout:7/182: dread d1/f7 [0,4194304] 0 2024-04-26T12:06:55.133 INFO:tasks.workunit.client.0.smithi052.stdout:9/249: truncate d3/db/d13/f29 3083762 0 2024-04-26T12:06:55.134 INFO:tasks.workunit.client.0.smithi052.stdout:5/237: rename db/dd/d18/c20 to db/dd/d18/d1e/d40/c4f 0 2024-04-26T12:06:55.135 INFO:tasks.workunit.client.0.smithi052.stdout:3/189: chown d2/d4/dc/d1d/d25/f2b 278718245 1 2024-04-26T12:06:55.135 INFO:tasks.workunit.client.0.smithi052.stdout:5/238: sync 2024-04-26T12:06:55.135 INFO:tasks.workunit.client.0.smithi052.stdout:6/177: dread da/ff [0,4194304] 0 2024-04-26T12:06:55.135 INFO:tasks.workunit.client.0.smithi052.stdout:9/250: chown d3/c36 26 1 2024-04-26T12:06:55.136 INFO:tasks.workunit.client.0.smithi052.stdout:7/183: readlink d1/d1c/d21/d2f/d33/l37 0 2024-04-26T12:06:55.136 INFO:tasks.workunit.client.0.smithi052.stdout:8/160: write d0/d4/d1c/f2c [628096,93406] 0 2024-04-26T12:06:55.137 INFO:tasks.workunit.client.0.smithi052.stdout:1/201: getdents d0/da/d2e 0 2024-04-26T12:06:55.137 INFO:tasks.workunit.client.0.smithi052.stdout:6/178: creat da/f37 x:0 0 0 2024-04-26T12:06:55.137 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:55.135+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:55.137 INFO:tasks.workunit.client.0.smithi052.stdout:9/251: unlink d3/db/l26 0 2024-04-26T12:06:55.138 INFO:tasks.workunit.client.0.smithi052.stdout:8/161: stat d0/d4/d5/db/d1b 0 2024-04-26T12:06:55.138 INFO:tasks.workunit.client.0.smithi052.stdout:0/266: dwrite d0/d1/d1a/d2a/f51 [4194304,4194304] 0 2024-04-26T12:06:55.138 INFO:tasks.workunit.client.0.smithi052.stdout:2/262: dread d0/f5 [0,4194304] 0 2024-04-26T12:06:55.139 INFO:tasks.workunit.client.0.smithi052.stdout:4/196: dwrite d3/d12/f18 [0,4194304] 0 2024-04-26T12:06:55.140 INFO:tasks.workunit.client.0.smithi052.stdout:2/263: dread - d0/d36/f45 zero size 2024-04-26T12:06:55.140 INFO:tasks.workunit.client.0.smithi052.stdout:8/162: unlink d0/d4/l1e 0 2024-04-26T12:06:55.142 INFO:tasks.workunit.client.0.smithi052.stdout:9/252: rename d3/d39 to d3/db/d52 0 2024-04-26T12:06:55.142 INFO:tasks.workunit.client.0.smithi052.stdout:2/264: chown d0/d3f 399 1 2024-04-26T12:06:55.142 INFO:tasks.workunit.client.0.smithi052.stdout:3/190: truncate d2/d4/dc/d1d/d25/f3b 5602413 0 2024-04-26T12:06:55.143 INFO:tasks.workunit.client.0.smithi052.stdout:8/163: creat d0/d4/d5/db/d1b/f2e x:0 0 0 2024-04-26T12:06:55.143 INFO:tasks.workunit.client.0.smithi052.stdout:4/197: mkdir d3/d12/d34/d43 0 2024-04-26T12:06:55.146 INFO:tasks.workunit.client.0.smithi052.stdout:8/164: chown d0/d4/d1c 0 1 2024-04-26T12:06:55.146 INFO:tasks.workunit.client.0.smithi052.stdout:0/267: rename d0/l2e to d0/d1/dd/l59 0 2024-04-26T12:06:55.146 INFO:tasks.workunit.client.0.smithi052.stdout:3/191: creat d2/f3d x:0 0 0 2024-04-26T12:06:55.147 INFO:tasks.workunit.client.0.smithi052.stdout:6/179: truncate da/f1b 1959599 0 2024-04-26T12:06:55.147 INFO:tasks.workunit.client.0.smithi052.stdout:7/184: dwrite d1/f9 [4194304,4194304] 0 2024-04-26T12:06:55.148 INFO:tasks.workunit.client.0.smithi052.stdout:3/192: chown d2/d4/l10 1 1 2024-04-26T12:06:55.148 INFO:tasks.workunit.client.0.smithi052.stdout:8/165: rmdir d0/d16 39 2024-04-26T12:06:55.149 INFO:tasks.workunit.client.0.smithi052.stdout:5/239: chown db/dd/d18/d1e/c22 54407 1 2024-04-26T12:06:55.149 INFO:tasks.workunit.client.0.smithi052.stdout:1/202: dwrite d0/d2/dd/d1c/d1d/d23/f38 [0,4194304] 0 2024-04-26T12:06:55.149 INFO:tasks.workunit.client.0.smithi052.stdout:0/268: mkdir d0/d5a 0 2024-04-26T12:06:55.149 INFO:tasks.workunit.client.0.smithi052.stdout:9/253: dwrite d3/db/d2b/f2f [4194304,4194304] 0 2024-04-26T12:06:55.150 INFO:tasks.workunit.client.0.smithi052.stdout:7/185: mknod d1/c3b 0 2024-04-26T12:06:55.150 INFO:tasks.workunit.client.0.smithi052.stdout:6/180: creat da/d22/d29/f38 x:0 0 0 2024-04-26T12:06:55.150 INFO:tasks.workunit.client.0.smithi052.stdout:8/166: chown d0/d16/d28 306 1 2024-04-26T12:06:55.151 INFO:tasks.workunit.client.0.smithi052.stdout:1/203: stat d0/d2/f10 0 2024-04-26T12:06:55.151 INFO:tasks.workunit.client.0.smithi052.stdout:9/254: creat d3/d1b/f53 x:0 0 0 2024-04-26T12:06:55.152 INFO:tasks.workunit.client.0.smithi052.stdout:6/181: mkdir da/d22/d29/d31/d39 0 2024-04-26T12:06:55.153 INFO:tasks.workunit.client.0.smithi052.stdout:1/204: mknod d0/da/c48 0 2024-04-26T12:06:55.153 INFO:tasks.workunit.client.0.smithi052.stdout:8/167: read d0/f1f [665997,90773] 0 2024-04-26T12:06:55.153 INFO:tasks.workunit.client.0.smithi052.stdout:2/265: truncate d0/d7/d16/f1a 2993149 0 2024-04-26T12:06:55.154 INFO:tasks.workunit.client.0.smithi052.stdout:9/255: mkdir d3/db/d10/d54 0 2024-04-26T12:06:55.155 INFO:tasks.workunit.client.0.smithi052.stdout:7/186: mknod d1/d1f/c3c 0 2024-04-26T12:06:55.156 INFO:tasks.workunit.client.0.smithi052.stdout:4/198: truncate d3/d12/f20 926905 0 2024-04-26T12:06:55.156 INFO:tasks.workunit.client.0.smithi052.stdout:3/193: truncate d2/d4/dc/f28 305522 0 2024-04-26T12:06:55.157 INFO:tasks.workunit.client.0.smithi052.stdout:9/256: readlink d3/db/d52/l47 0 2024-04-26T12:06:55.157 INFO:tasks.workunit.client.0.smithi052.stdout:8/168: mknod d0/d4/d5/d27/c2f 0 2024-04-26T12:06:55.157 INFO:tasks.workunit.client.0.smithi052.stdout:6/182: rename da/d22/f2c to da/d22/d29/d31/f3a 0 2024-04-26T12:06:55.157 INFO:tasks.workunit.client.0.smithi052.stdout:2/266: mkdir d0/d7/d53 0 2024-04-26T12:06:55.158 INFO:tasks.workunit.client.0.smithi052.stdout:1/205: symlink d0/d2/dd/d40/l49 0 2024-04-26T12:06:55.158 INFO:tasks.workunit.client.0.smithi052.stdout:3/194: unlink d2/d4/dc/d1d/d25/f35 0 2024-04-26T12:06:55.158 INFO:tasks.workunit.client.0.smithi052.stdout:7/187: mknod d1/d1c/d21/d2f/c3d 0 2024-04-26T12:06:55.159 INFO:tasks.workunit.client.0.smithi052.stdout:6/183: creat da/d22/f3b x:0 0 0 2024-04-26T12:06:55.160 INFO:tasks.workunit.client.0.smithi052.stdout:2/267: truncate d0/f15 661095 0 2024-04-26T12:06:55.160 INFO:tasks.workunit.client.0.smithi052.stdout:3/195: write d2/f7 [1669859,73298] 0 2024-04-26T12:06:55.161 INFO:tasks.workunit.client.0.smithi052.stdout:0/269: dwrite d0/d1/d1a/f4b [4194304,4194304] 0 2024-04-26T12:06:55.161 INFO:tasks.workunit.client.0.smithi052.stdout:5/240: dwrite db/dd/d18/d1e/f3b [0,4194304] 0 2024-04-26T12:06:55.161 INFO:tasks.workunit.client.0.smithi052.stdout:7/188: write d1/f16 [267970,129388] 0 2024-04-26T12:06:55.163 INFO:tasks.workunit.client.0.smithi052.stdout:7/189: unlink d1/c24 0 2024-04-26T12:06:55.164 INFO:tasks.workunit.client.0.smithi052.stdout:2/268: mknod d0/d7/c54 0 2024-04-26T12:06:55.165 INFO:tasks.workunit.client.0.smithi052.stdout:3/196: write d2/d4/dc/d1d/d25/f2b [298525,119318] 0 2024-04-26T12:06:55.166 INFO:tasks.workunit.client.0.smithi052.stdout:4/199: truncate d3/d12/f13 3003531 0 2024-04-26T12:06:55.167 INFO:tasks.workunit.client.0.smithi052.stdout:2/269: rename d0 to d0/d7/d2f/d3d/d55 22 2024-04-26T12:06:55.168 INFO:tasks.workunit.client.0.smithi052.stdout:9/257: dwrite d3/db/d10/f1c [0,4194304] 0 2024-04-26T12:06:55.168 INFO:tasks.workunit.client.0.smithi052.stdout:3/197: write d2/d4/f21 [3598007,81859] 0 2024-04-26T12:06:55.168 INFO:tasks.workunit.client.0.smithi052.stdout:5/241: rename db/dd/d18/d1e/d40 to db/dd/d18/d1e/d50 0 2024-04-26T12:06:55.169 INFO:tasks.workunit.client.0.smithi052.stdout:1/206: dread d0/d2/dd/f32 [0,4194304] 0 2024-04-26T12:06:55.169 INFO:tasks.workunit.client.0.smithi052.stdout:2/270: mkdir d0/d3f/d56 0 2024-04-26T12:06:55.169 INFO:tasks.workunit.client.0.smithi052.stdout:4/200: mkdir d3/d44 0 2024-04-26T12:06:55.170 INFO:tasks.workunit.client.0.smithi052.stdout:5/242: mknod db/dd/d34/c51 0 2024-04-26T12:06:55.170 INFO:tasks.workunit.client.0.smithi052.stdout:6/184: dread da/f20 [0,4194304] 0 2024-04-26T12:06:55.171 INFO:tasks.workunit.client.0.smithi052.stdout:2/271: mkdir d0/d36/d57 0 2024-04-26T12:06:55.171 INFO:tasks.workunit.client.0.smithi052.stdout:0/270: dwrite d0/f9 [8388608,4194304] 0 2024-04-26T12:06:55.173 INFO:tasks.workunit.client.0.smithi052.stdout:5/243: fdatasync db/dd/d18/d1e/d25/f24 0 2024-04-26T12:06:55.173 INFO:tasks.workunit.client.0.smithi052.stdout:2/272: creat d0/d36/d57/f58 x:0 0 0 2024-04-26T12:06:55.174 INFO:tasks.workunit.client.0.smithi052.stdout:0/271: read - d0/d1/d2c/d42/f58 zero size 2024-04-26T12:06:55.177 INFO:tasks.workunit.client.0.smithi052.stdout:3/198: dread d2/d4/dc/d1d/f32 [0,4194304] 0 2024-04-26T12:06:55.178 INFO:tasks.workunit.client.0.smithi052.stdout:9/258: dwrite d3/db/d10/f18 [0,4194304] 0 2024-04-26T12:06:55.178 INFO:tasks.workunit.client.0.smithi052.stdout:4/201: stat d3/d12/f13 0 2024-04-26T12:06:55.180 INFO:tasks.workunit.client.0.smithi052.stdout:7/190: dread d1/f6 [0,4194304] 0 2024-04-26T12:06:55.180 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:55.180 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:55.181 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.181 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4564.0:11319 4.38 e53/16 4:1dee5ab9:::10000003268.00000001:head v 53'151, mlcod=53'149)", 2024-04-26T12:06:55.181 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:55.168626+0000", 2024-04-26T12:06:55.181 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.011578032, 2024-04-26T12:06:55.181 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011597483, 2024-04-26T12:06:55.181 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:55.181 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:55.181 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:55.181 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.181 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:55.181 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:55.168626+0000", 2024-04-26T12:06:55.181 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.181 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.182 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.182 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:55.182 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:55.168626+0000", 2024-04-26T12:06:55.182 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.182 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.182 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.182 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:55.182 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:55.168626+0000", 2024-04-26T12:06:55.182 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:55.182 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.182 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.182 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:55.182 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:55.175636+0000", 2024-04-26T12:06:55.182 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0070101870000000002 2024-04-26T12:06:55.183 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.186 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.186 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:55.186 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:55.175648+0000", 2024-04-26T12:06:55.186 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2102e-05 2024-04-26T12:06:55.186 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.186 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.186 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.186 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:55.175654+0000", 2024-04-26T12:06:55.186 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3559999999999998e-06 2024-04-26T12:06:55.186 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.187 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.187 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:55.187 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:55.175747+0000", 2024-04-26T12:06:55.187 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2621000000000006e-05 2024-04-26T12:06:55.187 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.187 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.187 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:55.187 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:55.175764+0000", 2024-04-26T12:06:55.187 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.702e-05 2024-04-26T12:06:55.187 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.187 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:55.187 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.188 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.188 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.188 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:11327 4.1e 4:7bca95e0:::1000000312d.00000000:head [write 0~4194304 [3@4194304] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:55.188 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:55.169064+0000", 2024-04-26T12:06:55.188 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.011140215, 2024-04-26T12:06:55.188 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011223044, 2024-04-26T12:06:55.188 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:55.188 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:06:55.188 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:55.188 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:55.188 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:55.188 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 11327 2024-04-26T12:06:55.188 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.188 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:55.188 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.189 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:55.189 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:55.169064+0000", 2024-04-26T12:06:55.189 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.189 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.189 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.189 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:55.189 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:55.169064+0000", 2024-04-26T12:06:55.189 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.189 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.189 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.189 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:55.189 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:55.169063+0000", 2024-04-26T12:06:55.189 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:55.189 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.189 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.190 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:55.190 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:55.176364+0000", 2024-04-26T12:06:55.190 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073005850000000001 2024-04-26T12:06:55.190 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.190 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.190 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:55.190 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:55.176373+0000", 2024-04-26T12:06:55.190 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6549999999999993e-06 2024-04-26T12:06:55.190 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.190 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.190 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.190 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:55.176379+0000", 2024-04-26T12:06:55.190 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0580000000000003e-06 2024-04-26T12:06:55.191 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.191 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.191 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:55.191 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:55.176418+0000", 2024-04-26T12:06:55.191 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9555000000000003e-05 2024-04-26T12:06:55.191 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.191 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.191 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:55.191 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:55.176628+0000", 2024-04-26T12:06:55.191 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000209681 2024-04-26T12:06:55.191 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.191 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.191 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:55.191 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:55.176842+0000", 2024-04-26T12:06:55.192 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021380600000000001 2024-04-26T12:06:55.192 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.192 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:55.192 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.192 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.192 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-04-26T12:06:55.192 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 2 2024-04-26T12:06:55.192 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:55.196 INFO:tasks.workunit.client.0.smithi052.stdout:9/259: mkdir d3/db/d10/d55 0 2024-04-26T12:06:55.196 INFO:tasks.workunit.client.0.smithi052.stdout:6/185: dwrite da/f37 [0,4194304] 0 2024-04-26T12:06:55.196 INFO:tasks.workunit.client.0.smithi052.stdout:4/202: mkdir d3/d12/d34/d45 0 2024-04-26T12:06:55.196 INFO:tasks.workunit.client.0.smithi052.stdout:6/186: sync 2024-04-26T12:06:55.196 INFO:tasks.workunit.client.0.smithi052.stdout:4/203: read d3/d12/f13 [704147,90567] 0 2024-04-26T12:06:55.196 INFO:tasks.workunit.client.0.smithi052.stdout:1/207: dread d0/d2/dd/d1c/d1d/d23/f38 [4194304,4194304] 0 2024-04-26T12:06:55.196 INFO:tasks.workunit.client.0.smithi052.stdout:9/260: write d3/db/d2b/f2f [8504849,1808] 0 2024-04-26T12:06:55.196 INFO:tasks.workunit.client.0.smithi052.stdout:6/187: chown da/d22/d29/c30 250 1 2024-04-26T12:06:55.196 INFO:tasks.workunit.client.0.smithi052.stdout:2/273: dwrite d0/f6 [0,4194304] 0 2024-04-26T12:06:55.196 INFO:tasks.workunit.client.0.smithi052.stdout:4/204: rename d3/d15 to d3/d15/d46 22 2024-04-26T12:06:55.196 INFO:tasks.workunit.client.0.smithi052.stdout:5/244: dwrite db/f26 [0,4194304] 0 2024-04-26T12:06:55.196 INFO:tasks.workunit.client.0.smithi052.stdout:0/272: dwrite d0/d1/f41 [0,4194304] 0 2024-04-26T12:06:55.197 INFO:tasks.workunit.client.0.smithi052.stdout:6/188: dread - da/d22/d29/f2f zero size 2024-04-26T12:06:55.197 INFO:tasks.workunit.client.0.smithi052.stdout:4/205: unlink d3/d22/l29 0 2024-04-26T12:06:55.197 INFO:tasks.workunit.client.0.smithi052.stdout:2/274: write d0/d7/d22/f23 [199048,45582] 0 2024-04-26T12:06:55.197 INFO:tasks.workunit.client.0.smithi052.stdout:9/261: creat d3/db/d10/d54/f56 x:0 0 0 2024-04-26T12:06:55.197 INFO:tasks.workunit.client.0.smithi052.stdout:7/191: dread d1/f8 [0,4194304] 0 2024-04-26T12:06:55.197 INFO:tasks.workunit.client.0.smithi052.stdout:6/189: mkdir da/d22/d3c 0 2024-04-26T12:06:55.197 INFO:tasks.workunit.client.0.smithi052.stdout:4/206: creat d3/d12/d34/d45/f47 x:0 0 0 2024-04-26T12:06:55.197 INFO:tasks.workunit.client.0.smithi052.stdout:3/199: dwrite d2/d4/d2a/d2d/f2e [0,4194304] 0 2024-04-26T12:06:55.197 INFO:tasks.workunit.client.0.smithi052.stdout:8/169: dread d0/d4/d5/f8 [4194304,4194304] 0 2024-04-26T12:06:55.197 INFO:tasks.workunit.client.0.smithi052.stdout:2/275: creat d0/d7/d16/d3a/f59 x:0 0 0 2024-04-26T12:06:55.197 INFO:tasks.workunit.client.0.smithi052.stdout:7/192: unlink d1/d1f/l36 0 2024-04-26T12:06:55.197 INFO:tasks.workunit.client.0.smithi052.stdout:1/208: read d0/d2/dd/f14 [3504200,75313] 0 2024-04-26T12:06:55.197 INFO:tasks.workunit.client.0.smithi052.stdout:4/207: creat d3/d44/f48 x:0 0 0 2024-04-26T12:06:55.197 INFO:tasks.workunit.client.0.smithi052.stdout:3/200: chown d2/d4/c18 446 1 2024-04-26T12:06:55.199 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:55.200 INFO:tasks.workunit.client.0.smithi052.stdout:7/193: mknod d1/c3e 0 2024-04-26T12:06:55.200 INFO:tasks.workunit.client.0.smithi052.stdout:2/276: mkdir d0/d7/d2f/d4a/d5a 0 2024-04-26T12:06:55.200 INFO:tasks.workunit.client.0.smithi052.stdout:1/209: creat d0/f4a x:0 0 0 2024-04-26T12:06:55.200 INFO:tasks.workunit.client.0.smithi052.stdout:5/245: dread db/f38 [0,4194304] 0 2024-04-26T12:06:55.200 INFO:tasks.workunit.client.0.smithi052.stdout:4/208: truncate d3/d1f/f3f 1038117 0 2024-04-26T12:06:55.200 INFO:tasks.workunit.client.0.smithi052.stdout:8/170: link d0/d4/d1c/f2c d0/d4/f30 0 2024-04-26T12:06:55.200 INFO:tasks.workunit.client.0.smithi052.stdout:3/201: chown d2/d4/c17 0 1 2024-04-26T12:06:55.201 INFO:tasks.workunit.client.0.smithi052.stdout:0/273: dwrite d0/d1/f13 [0,4194304] 0 2024-04-26T12:06:55.201 INFO:tasks.workunit.client.0.smithi052.stdout:2/277: mknod d0/d7/c5b 0 2024-04-26T12:06:55.201 INFO:tasks.workunit.client.0.smithi052.stdout:4/209: chown d3/d12/d34/d45 14 1 2024-04-26T12:06:55.202 INFO:tasks.workunit.client.0.smithi052.stdout:5/246: mkdir db/dc/d29/d52 0 2024-04-26T12:06:55.202 INFO:tasks.workunit.client.0.smithi052.stdout:1/210: mkdir d0/d2/de/d4b 0 2024-04-26T12:06:55.203 INFO:tasks.workunit.client.0.smithi052.stdout:4/210: mknod d3/d12/c49 0 2024-04-26T12:06:55.203 INFO:tasks.workunit.client.0.smithi052.stdout:9/262: dwrite d3/db/d10/d3c/d40/f42 [0,4194304] 0 2024-04-26T12:06:55.204 INFO:tasks.workunit.client.0.smithi052.stdout:2/278: symlink d0/d7/d16/l5c 0 2024-04-26T12:06:55.205 INFO:tasks.workunit.client.0.smithi052.stdout:6/190: dwrite da/d22/d29/f2f [0,4194304] 0 2024-04-26T12:06:55.205 INFO:tasks.workunit.client.0.smithi052.stdout:7/194: getdents d1/d1c/d21 0 2024-04-26T12:06:55.206 INFO:tasks.workunit.client.0.smithi052.stdout:4/211: fdatasync d3/d12/f20 0 2024-04-26T12:06:55.206 INFO:tasks.workunit.client.0.smithi052.stdout:0/274: truncate d0/d1/d1a/d20/f3a 4408273 0 2024-04-26T12:06:55.207 INFO:tasks.workunit.client.0.smithi052.stdout:5/247: rename c8 to db/dc/c53 0 2024-04-26T12:06:55.207 INFO:tasks.workunit.client.0.smithi052.stdout:2/279: mknod d0/d7/d16/d4d/c5d 0 2024-04-26T12:06:55.207 INFO:tasks.workunit.client.0.smithi052.stdout:7/195: rmdir d1/d1f 39 2024-04-26T12:06:55.207 INFO:tasks.workunit.client.0.smithi052.stdout:9/263: creat d3/db/d10/d55/f57 x:0 0 0 2024-04-26T12:06:55.208 INFO:tasks.workunit.client.0.smithi052.stdout:5/248: fdatasync db/dc/f12 0 2024-04-26T12:06:55.208 INFO:tasks.workunit.client.0.smithi052.stdout:0/275: rmdir d0/d1/dd 39 2024-04-26T12:06:55.208 INFO:tasks.workunit.client.0.smithi052.stdout:6/191: mknod da/d22/d3c/c3d 0 2024-04-26T12:06:55.209 INFO:tasks.workunit.client.0.smithi052.stdout:2/280: chown d0/d7/c54 166 1 2024-04-26T12:06:55.209 INFO:tasks.workunit.client.0.smithi052.stdout:8/171: dread d0/d4/f26 [0,4194304] 0 2024-04-26T12:06:55.210 INFO:tasks.workunit.client.0.smithi052.stdout:4/212: mknod d3/d12/d34/d45/c4a 0 2024-04-26T12:06:55.210 INFO:tasks.workunit.client.0.smithi052.stdout:0/276: chown d0/d1/d1a/d2a 3574 1 2024-04-26T12:06:55.210 INFO:tasks.workunit.client.0.smithi052.stdout:5/249: creat db/dc/f54 x:0 0 0 2024-04-26T12:06:55.210 INFO:tasks.workunit.client.0.smithi052.stdout:7/196: chown d1/d1f/f22 2077977 1 2024-04-26T12:06:55.210 INFO:tasks.workunit.client.0.smithi052.stdout:6/192: symlink da/l3e 0 2024-04-26T12:06:55.210 INFO:tasks.workunit.client.0.smithi052.stdout:3/202: dread d2/d4/d2a/d2d/f2e [0,4194304] 0 2024-04-26T12:06:55.212 INFO:tasks.workunit.client.0.smithi052.stdout:2/281: creat d0/d7/d16/d3a/f5e x:0 0 0 2024-04-26T12:06:55.212 INFO:tasks.workunit.client.0.smithi052.stdout:4/213: chown d3/d1f/f3f 31861834 1 2024-04-26T12:06:55.212 INFO:tasks.workunit.client.0.smithi052.stdout:7/197: write d1/f12 [681883,21821] 0 2024-04-26T12:06:55.212 INFO:tasks.workunit.client.0.smithi052.stdout:8/172: mknod d0/d4/d5/db/d20/c31 0 2024-04-26T12:06:55.212 INFO:tasks.workunit.client.0.smithi052.stdout:1/211: dwrite d0/f20 [0,4194304] 0 2024-04-26T12:06:55.212 INFO:tasks.workunit.client.0.smithi052.stdout:0/277: truncate d0/f9 13939921 0 2024-04-26T12:06:55.214 INFO:tasks.workunit.client.0.smithi052.stdout:3/203: creat d2/d4/f3e x:0 0 0 2024-04-26T12:06:55.214 INFO:tasks.workunit.client.0.smithi052.stdout:5/250: symlink db/dd/d18/d1e/d3f/l55 0 2024-04-26T12:06:55.214 INFO:tasks.workunit.client.0.smithi052.stdout:4/214: dread - d3/d44/f48 zero size 2024-04-26T12:06:55.214 INFO:tasks.workunit.client.0.smithi052.stdout:8/173: chown d0/d4/d5/db/d20 2481 1 2024-04-26T12:06:55.215 INFO:tasks.workunit.client.0.smithi052.stdout:0/278: unlink d0/f9 0 2024-04-26T12:06:55.216 INFO:tasks.workunit.client.0.smithi052.stdout:2/282: chown d0/d36/d57/f58 2 1 2024-04-26T12:06:55.216 INFO:tasks.workunit.client.0.smithi052.stdout:5/251: rmdir db 39 2024-04-26T12:06:55.217 INFO:tasks.workunit.client.0.smithi052.stdout:4/215: dread - d3/f2f zero size 2024-04-26T12:06:55.217 INFO:tasks.workunit.client.0.smithi052.stdout:7/198: truncate d1/f27 725920 0 2024-04-26T12:06:55.217 INFO:tasks.workunit.client.0.smithi052.stdout:0/279: unlink d0/d1/d1a/f37 0 2024-04-26T12:06:55.218 INFO:tasks.workunit.client.0.smithi052.stdout:9/264: truncate d3/db/d2b/f2f 2927181 0 2024-04-26T12:06:55.218 INFO:tasks.workunit.client.0.smithi052.stdout:1/212: symlink d0/d2/de/d4b/l4c 0 2024-04-26T12:06:55.218 INFO:tasks.workunit.client.0.smithi052.stdout:3/204: mkdir d2/d4/dc/d1d/d3f 0 2024-04-26T12:06:55.218 INFO:tasks.workunit.client.0.smithi052.stdout:8/174: creat d0/d16/d28/f32 x:0 0 0 2024-04-26T12:06:55.218 INFO:tasks.workunit.client.0.smithi052.stdout:4/216: write d3/d1f/f25 [2698869,20776] 0 2024-04-26T12:06:55.219 INFO:tasks.workunit.client.0.smithi052.stdout:6/193: dwrite da/f13 [0,4194304] 0 2024-04-26T12:06:55.219 INFO:tasks.workunit.client.0.smithi052.stdout:7/199: unlink d1/f9 0 2024-04-26T12:06:55.219 INFO:tasks.workunit.client.0.smithi052.stdout:0/280: rename d0/d1/d11/d4e to d0/d5b 0 2024-04-26T12:06:55.219 INFO:tasks.workunit.client.0.smithi052.stdout:4/217: unlink d3/d1f/f3f 0 2024-04-26T12:06:55.220 INFO:tasks.workunit.client.0.smithi052.stdout:3/205: write d2/d4/f3e [344619,121097] 0 2024-04-26T12:06:55.221 INFO:tasks.workunit.client.0.smithi052.stdout:2/283: getdents d0/d7/d16/d3a 0 2024-04-26T12:06:55.221 INFO:tasks.workunit.client.0.smithi052.stdout:6/194: creat da/f3f x:0 0 0 2024-04-26T12:06:55.221 INFO:tasks.workunit.client.0.smithi052.stdout:7/200: write d1/f12 [349950,7596] 0 2024-04-26T12:06:55.223 INFO:tasks.workunit.client.0.smithi052.stdout:0/281: rmdir d0/d1/d2c 39 2024-04-26T12:06:55.223 INFO:tasks.workunit.client.0.smithi052.stdout:3/206: chown d2/d4/d2a/d2d/f2e 70556429 1 2024-04-26T12:06:55.223 INFO:tasks.workunit.client.0.smithi052.stdout:6/195: read da/f13 [833103,23244] 0 2024-04-26T12:06:55.225 INFO:tasks.workunit.client.0.smithi052.stdout:0/282: fdatasync d0/f49 0 2024-04-26T12:06:55.226 INFO:tasks.workunit.client.0.smithi052.stdout:7/201: mknod d1/d1f/c3f 0 2024-04-26T12:06:55.227 INFO:tasks.workunit.client.0.smithi052.stdout:3/207: dread - d2/d4/dc/d33/d37/f3a zero size 2024-04-26T12:06:55.227 INFO:tasks.workunit.client.0.smithi052.stdout:5/252: dwrite db/dd/d18/d1e/f3a [0,4194304] 0 2024-04-26T12:06:55.228 INFO:tasks.workunit.client.0.smithi052.stdout:6/196: creat da/d22/d3c/f40 x:0 0 0 2024-04-26T12:06:55.230 INFO:tasks.workunit.client.0.smithi052.stdout:1/213: dwrite d0/d2/de/f27 [0,4194304] 0 2024-04-26T12:06:55.230 INFO:tasks.workunit.client.0.smithi052.stdout:8/175: dwrite d0/d4/d5/f11 [0,4194304] 0 2024-04-26T12:06:55.231 INFO:tasks.workunit.client.0.smithi052.stdout:7/202: creat d1/d1c/d21/d2f/d33/d3a/f40 x:0 0 0 2024-04-26T12:06:55.233 INFO:tasks.workunit.client.0.smithi052.stdout:8/176: mknod d0/c33 0 2024-04-26T12:06:55.233 INFO:tasks.workunit.client.0.smithi052.stdout:7/203: write d1/f27 [1202973,105271] 0 2024-04-26T12:06:55.234 INFO:tasks.workunit.client.0.smithi052.stdout:3/208: write d2/d4/dc/d1d/d25/d36/d1c/f20 [319575,46137] 0 2024-04-26T12:06:55.235 INFO:tasks.workunit.client.0.smithi052.stdout:7/204: symlink d1/l41 0 2024-04-26T12:06:55.236 INFO:tasks.workunit.client.0.smithi052.stdout:1/214: link d0/d2/dd/d2c/f3b d0/da/d3a/f4d 0 2024-04-26T12:06:55.237 INFO:tasks.workunit.client.0.smithi052.stdout:7/205: creat d1/d1c/f42 x:0 0 0 2024-04-26T12:06:55.237 INFO:tasks.workunit.client.0.smithi052.stdout:4/218: dread d3/d12/f20 [0,4194304] 0 2024-04-26T12:06:55.237 INFO:tasks.workunit.client.0.smithi052.stdout:8/177: rename d0/d4/l9 to d0/d4/d5/db/d20/l34 0 2024-04-26T12:06:55.238 INFO:tasks.workunit.client.0.smithi052.stdout:7/206: fsync d1/f10 0 2024-04-26T12:06:55.238 INFO:tasks.workunit.client.0.smithi052.stdout:1/215: write d0/d2/f6 [4156563,95273] 0 2024-04-26T12:06:55.238 INFO:tasks.workunit.client.0.smithi052.stdout:5/253: dwrite db/dd/f27 [0,4194304] 0 2024-04-26T12:06:55.239 INFO:tasks.workunit.client.0.smithi052.stdout:0/283: dwrite d0/d1/d1a/d20/f3a [4194304,4194304] 0 2024-04-26T12:06:55.239 INFO:tasks.workunit.client.0.smithi052.stdout:4/219: dread - d3/d1f/d21/f32 zero size 2024-04-26T12:06:55.240 INFO:tasks.workunit.client.0.smithi052.stdout:8/178: truncate d0/d4/d1c/f2c 885643 0 2024-04-26T12:06:55.240 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:55.239+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:55.241 INFO:tasks.workunit.client.0.smithi052.stdout:1/216: rmdir d0/d2/dd/d34/d3e 39 2024-04-26T12:06:55.241 INFO:tasks.workunit.client.0.smithi052.stdout:5/254: symlink db/dc/d29/l56 0 2024-04-26T12:06:55.241 INFO:tasks.workunit.client.0.smithi052.stdout:7/207: rename d1/lc to d1/d1c/d21/d2f/d33/l43 0 2024-04-26T12:06:55.243 INFO:tasks.workunit.client.0.smithi052.stdout:7/208: chown d1/d1f/c3c 5819 1 2024-04-26T12:06:55.243 INFO:tasks.workunit.client.0.smithi052.stdout:5/255: rmdir db/dd/d34 39 2024-04-26T12:06:55.243 INFO:tasks.workunit.client.0.smithi052.stdout:1/217: creat d0/d2/dd/d34/f4e x:0 0 0 2024-04-26T12:06:55.244 INFO:tasks.workunit.client.0.smithi052.stdout:1/218: unlink d0/c33 0 2024-04-26T12:06:55.245 INFO:tasks.workunit.client.0.smithi052.stdout:7/209: write d1/fb [42490,100345] 0 2024-04-26T12:06:55.246 INFO:tasks.workunit.client.0.smithi052.stdout:1/219: creat d0/da/f4f x:0 0 0 2024-04-26T12:06:55.246 INFO:tasks.workunit.client.0.smithi052.stdout:5/256: rename db/dd/d18/d1e/f3b to db/dd/d34/f57 0 2024-04-26T12:06:55.246 INFO:tasks.workunit.client.0.smithi052.stdout:0/284: dwrite d0/d1/d11/f16 [4194304,4194304] 0 2024-04-26T12:06:55.247 INFO:tasks.workunit.client.0.smithi052.stdout:1/220: fsync d0/f3f 0 2024-04-26T12:06:55.247 INFO:tasks.workunit.client.0.smithi052.stdout:0/285: chown d0/d1/d52 363 1 2024-04-26T12:06:55.247 INFO:tasks.workunit.client.0.smithi052.stdout:1/221: readlink d0/d2/dd/l36 0 2024-04-26T12:06:55.248 INFO:tasks.workunit.client.0.smithi052.stdout:5/257: rename db/dd/f19 to db/dd/d18/d1e/d3f/f58 0 2024-04-26T12:06:55.248 INFO:tasks.workunit.client.0.smithi052.stdout:0/286: chown d0/d1/d1a/d2a/d32/c40 110 1 2024-04-26T12:06:55.249 INFO:tasks.workunit.client.0.smithi052.stdout:1/222: sync 2024-04-26T12:06:55.249 INFO:tasks.workunit.client.0.smithi052.stdout:5/258: chown db/dd/d18/d1e/d25/f32 28 1 2024-04-26T12:06:55.249 INFO:tasks.workunit.client.0.smithi052.stdout:5/259: mkdir db/dc/d29/d59 0 2024-04-26T12:06:55.251 INFO:tasks.workunit.client.0.smithi052.stdout:0/287: creat d0/d1/f5c x:0 0 0 2024-04-26T12:06:55.251 INFO:tasks.workunit.client.0.smithi052.stdout:1/223: link d0/d1e/f29 d0/d2/dd/d1c/d1d/f50 0 2024-04-26T12:06:55.251 INFO:tasks.workunit.client.0.smithi052.stdout:5/260: symlink db/dd/d18/d1e/d25/l5a 0 2024-04-26T12:06:55.251 INFO:tasks.workunit.client.0.smithi052.stdout:3/209: dread d2/d4/f3e [0,4194304] 0 2024-04-26T12:06:55.254 INFO:tasks.workunit.client.0.smithi052.stdout:7/210: dwrite d1/fa [0,4194304] 0 2024-04-26T12:06:55.254 INFO:tasks.workunit.client.0.smithi052.stdout:1/224: creat d0/d2/dd/d1c/f51 x:0 0 0 2024-04-26T12:06:55.254 INFO:tasks.workunit.client.0.smithi052.stdout:3/210: creat d2/d4/d2a/d2d/f40 x:0 0 0 2024-04-26T12:06:55.255 INFO:tasks.workunit.client.0.smithi052.stdout:9/265: dread d3/db/d13/f29 [0,4194304] 0 2024-04-26T12:06:55.255 INFO:tasks.workunit.client.0.smithi052.stdout:1/225: mkdir d0/da/d3a/d52 0 2024-04-26T12:06:55.256 INFO:tasks.workunit.client.0.smithi052.stdout:8/179: read d0/d4/f17 [63643,61210] 0 2024-04-26T12:06:55.257 INFO:tasks.workunit.client.0.smithi052.stdout:1/226: write d0/d1e/f29 [3162593,50920] 0 2024-04-26T12:06:55.257 INFO:tasks.workunit.client.0.smithi052.stdout:0/288: dread d0/d1/d11/f16 [4194304,4194304] 0 2024-04-26T12:06:55.257 INFO:tasks.workunit.client.0.smithi052.stdout:2/284: dread d0/d7/d22/f28 [0,4194304] 0 2024-04-26T12:06:55.259 INFO:tasks.workunit.client.0.smithi052.stdout:1/227: dread - d0/d2/dd/d1c/f51 zero size 2024-04-26T12:06:55.259 INFO:tasks.workunit.client.0.smithi052.stdout:0/289: write d0/d3d/f3f [5844692,97116] 0 2024-04-26T12:06:55.259 INFO:tasks.workunit.client.0.smithi052.stdout:3/211: dread d2/d4/dc/d1d/f32 [0,4194304] 0 2024-04-26T12:06:55.261 INFO:tasks.workunit.client.0.smithi052.stdout:3/212: unlink d2/fb 0 2024-04-26T12:06:55.261 INFO:tasks.workunit.client.0.smithi052.stdout:1/228: write d0/d2/dd/d1c/d1d/f50 [4075508,41823] 0 2024-04-26T12:06:55.262 INFO:tasks.workunit.client.0.smithi052.stdout:0/290: mknod d0/d1/d1a/d2a/d32/c5d 0 2024-04-26T12:06:55.264 INFO:tasks.workunit.client.0.smithi052.stdout:0/291: read d0/d1/f41 [4059783,128561] 0 2024-04-26T12:06:55.265 INFO:tasks.workunit.client.0.smithi052.stdout:1/229: rename d0/d2/l22 to d0/l53 0 2024-04-26T12:06:55.270 INFO:tasks.workunit.client.0.smithi052.stdout:9/266: dwrite d3/db/d13/f29 [0,4194304] 0 2024-04-26T12:06:55.270 INFO:tasks.workunit.client.0.smithi052.stdout:8/180: dwrite d0/d4/d1c/f2c [0,4194304] 0 2024-04-26T12:06:55.270 INFO:tasks.workunit.client.0.smithi052.stdout:1/230: mknod d0/d2/de/c54 0 2024-04-26T12:06:55.270 INFO:tasks.workunit.client.0.smithi052.stdout:2/285: dwrite d0/d36/d57/f58 [0,4194304] 0 2024-04-26T12:06:55.272 INFO:tasks.workunit.client.0.smithi052.stdout:1/231: chown d0/d1e 134 1 2024-04-26T12:06:55.272 INFO:tasks.workunit.client.0.smithi052.stdout:1/232: sync 2024-04-26T12:06:55.273 INFO:tasks.workunit.client.0.smithi052.stdout:6/197: dread da/f1d [0,4194304] 0 2024-04-26T12:06:55.273 INFO:tasks.workunit.client.0.smithi052.stdout:2/286: stat d0/d7/d16/l2d 0 2024-04-26T12:06:55.274 INFO:tasks.workunit.client.0.smithi052.stdout:8/181: creat d0/d4/dc/f35 x:0 0 0 2024-04-26T12:06:55.274 INFO:tasks.workunit.client.0.smithi052.stdout:3/213: dwrite d2/f3d [0,4194304] 0 2024-04-26T12:06:55.274 INFO:tasks.workunit.client.0.smithi052.stdout:9/267: rmdir d3/db/d10/d55 39 2024-04-26T12:06:55.274 INFO:tasks.workunit.client.0.smithi052.stdout:6/198: symlink da/d22/l41 0 2024-04-26T12:06:55.275 INFO:tasks.workunit.client.0.smithi052.stdout:9/268: read d3/db/d13/f29 [519466,28599] 0 2024-04-26T12:06:55.276 INFO:tasks.workunit.client.0.smithi052.stdout:0/292: dwrite d0/d1/f13 [0,4194304] 0 2024-04-26T12:06:55.276 INFO:tasks.workunit.client.0.smithi052.stdout:8/182: creat d0/d4/d1c/f36 x:0 0 0 2024-04-26T12:06:55.276 INFO:tasks.workunit.client.0.smithi052.stdout:6/199: rename da/l26 to da/l42 0 2024-04-26T12:06:55.277 INFO:tasks.workunit.client.0.smithi052.stdout:9/269: mknod d3/db/d52/c58 0 2024-04-26T12:06:55.277 INFO:tasks.workunit.client.0.smithi052.stdout:0/293: write d0/fe [2419073,64078] 0 2024-04-26T12:06:55.278 INFO:tasks.workunit.client.0.smithi052.stdout:6/200: chown da/ff 16557 1 2024-04-26T12:06:55.279 INFO:tasks.workunit.client.0.smithi052.stdout:9/270: symlink d3/db/d10/d54/l59 0 2024-04-26T12:06:55.280 INFO:tasks.workunit.client.0.smithi052.stdout:8/183: truncate d0/d4/d5/f8 7132599 0 2024-04-26T12:06:55.280 INFO:tasks.workunit.client.0.smithi052.stdout:6/201: rename da/d22/d29/d31/f35 to da/f43 0 2024-04-26T12:06:55.281 INFO:tasks.workunit.client.0.smithi052.stdout:2/287: dwrite d0/d36/f45 [0,4194304] 0 2024-04-26T12:06:55.281 INFO:tasks.workunit.client.0.smithi052.stdout:2/288: sync 2024-04-26T12:06:55.281 INFO:tasks.workunit.client.0.smithi052.stdout:9/271: mknod d3/db/d10/d3c/c5a 0 2024-04-26T12:06:55.282 INFO:tasks.workunit.client.0.smithi052.stdout:0/294: mknod d0/d1/d1a/d20/c5e 0 2024-04-26T12:06:55.284 INFO:tasks.workunit.client.0.smithi052.stdout:3/214: dwrite d2/d4/dc/d1d/d25/d36/d1c/f3c [0,4194304] 0 2024-04-26T12:06:55.284 INFO:tasks.workunit.client.0.smithi052.stdout:7/211: dread d1/f27 [0,4194304] 0 2024-04-26T12:06:55.286 INFO:tasks.workunit.client.0.smithi052.stdout:8/184: rename d0/d4/d5/db/d1b/f2e to d0/d4/dc/f37 0 2024-04-26T12:06:55.292 INFO:tasks.workunit.client.0.smithi052.stdout:8/185: read - d0/d4/d5/db/d20/f24 zero size 2024-04-26T12:06:55.296 INFO:tasks.workunit.client.0.smithi052.stdout:6/202: dwrite da/f16 [4194304,4194304] 0 2024-04-26T12:06:55.297 INFO:tasks.workunit.client.0.smithi052.stdout:0/295: dwrite d0/d1/d11/f43 [0,4194304] 0 2024-04-26T12:06:55.297 INFO:tasks.workunit.client.0.smithi052.stdout:3/215: dwrite d2/f38 [0,4194304] 0 2024-04-26T12:06:55.297 INFO:tasks.workunit.client.0.smithi052.stdout:2/289: dwrite d0/d7/d22/f28 [4194304,4194304] 0 2024-04-26T12:06:55.297 INFO:tasks.workunit.client.0.smithi052.stdout:8/186: write d0/f29 [304639,12848] 0 2024-04-26T12:06:55.299 INFO:tasks.workunit.client.0.smithi052.stdout:9/272: dwrite d3/db/d10/f38 [0,4194304] 0 2024-04-26T12:06:55.299 INFO:tasks.workunit.client.0.smithi052.stdout:4/220: dread d3/f16 [0,4194304] 0 2024-04-26T12:06:55.299 INFO:tasks.workunit.client.0.smithi052.stdout:2/290: fsync d0/fa 0 2024-04-26T12:06:55.299 INFO:tasks.workunit.client.0.smithi052.stdout:0/296: mknod d0/d1/d1a/c5f 0 2024-04-26T12:06:55.300 INFO:tasks.workunit.client.0.smithi052.stdout:9/273: creat d3/db/f5b x:0 0 0 2024-04-26T12:06:55.300 INFO:tasks.workunit.client.0.smithi052.stdout:6/203: rename da/l3e to da/d22/d29/d31/d39/l44 0 2024-04-26T12:06:55.301 INFO:tasks.workunit.client.0.smithi052.stdout:2/291: rmdir d0/d3f 39 2024-04-26T12:06:55.301 INFO:tasks.workunit.client.0.smithi052.stdout:5/261: dread db/dd/d18/d1e/d25/f24 [0,4194304] 0 2024-04-26T12:06:55.303 INFO:tasks.workunit.client.0.smithi052.stdout:1/233: dread d0/d2/dd/d2c/f3b [0,4194304] 0 2024-04-26T12:06:55.303 INFO:tasks.workunit.client.0.smithi052.stdout:2/292: fdatasync d0/d7/d16/f1c 0 2024-04-26T12:06:55.304 INFO:tasks.workunit.client.0.smithi052.stdout:6/204: write da/f3f [367176,11063] 0 2024-04-26T12:06:55.305 INFO:tasks.workunit.client.0.smithi052.stdout:1/234: creat d0/f55 x:0 0 0 2024-04-26T12:06:55.306 INFO:tasks.workunit.client.0.smithi052.stdout:5/262: mknod db/dd/d18/d1e/d50/d46/c5b 0 2024-04-26T12:06:55.307 INFO:tasks.workunit.client.0.smithi052.stdout:1/235: unlink d0/d2/f31 0 2024-04-26T12:06:55.307 INFO:tasks.workunit.client.0.smithi052.stdout:6/205: unlink da/c17 0 2024-04-26T12:06:55.308 INFO:tasks.workunit.client.0.smithi052.stdout:3/216: dwrite d2/d4/dc/d33/d37/f3a [0,4194304] 0 2024-04-26T12:06:55.308 INFO:tasks.workunit.client.0.smithi052.stdout:0/297: dread d0/d1/f41 [4194304,4194304] 0 2024-04-26T12:06:55.309 INFO:tasks.workunit.client.0.smithi052.stdout:5/263: mkdir db/d5c 0 2024-04-26T12:06:55.309 INFO:tasks.workunit.client.0.smithi052.stdout:3/217: mkdir d2/d4/d41 0 2024-04-26T12:06:55.310 INFO:tasks.workunit.client.0.smithi052.stdout:9/274: dread d3/db/d10/f1c [0,4194304] 0 2024-04-26T12:06:55.310 INFO:tasks.workunit.client.0.smithi052.stdout:2/293: getdents d0/d7/d16/d3a/d43 0 2024-04-26T12:06:55.312 INFO:tasks.workunit.client.0.smithi052.stdout:8/187: dwrite d0/d4/dc/f37 [0,4194304] 0 2024-04-26T12:06:55.313 INFO:tasks.workunit.client.0.smithi052.stdout:6/206: mknod da/d22/d3c/c45 0 2024-04-26T12:06:55.313 INFO:tasks.workunit.client.0.smithi052.stdout:3/218: chown d2/d1f/c24 204 1 2024-04-26T12:06:55.313 INFO:tasks.workunit.client.0.smithi052.stdout:3/219: chown d2 360 1 2024-04-26T12:06:55.313 INFO:tasks.workunit.client.0.smithi052.stdout:0/298: fsync d0/d1/d11/f17 0 2024-04-26T12:06:55.314 INFO:tasks.workunit.client.0.smithi052.stdout:6/207: symlink da/d22/d29/l46 0 2024-04-26T12:06:55.314 INFO:tasks.workunit.client.0.smithi052.stdout:9/275: fdatasync d3/db/d10/f1c 0 2024-04-26T12:06:55.315 INFO:tasks.workunit.client.0.smithi052.stdout:1/236: write d0/da/f19 [1290660,97679] 0 2024-04-26T12:06:55.315 INFO:tasks.workunit.client.0.smithi052.stdout:8/188: link d0/d4/d1c/f2c d0/d4/f38 0 2024-04-26T12:06:55.317 INFO:tasks.workunit.client.0.smithi052.stdout:6/208: creat da/d22/f47 x:0 0 0 2024-04-26T12:06:55.317 INFO:tasks.workunit.client.0.smithi052.stdout:0/299: getdents d0/d5b 0 2024-04-26T12:06:55.318 INFO:tasks.workunit.client.0.smithi052.stdout:9/276: mkdir d3/db/d10/d2e/d5c 0 2024-04-26T12:06:55.318 INFO:tasks.workunit.client.0.smithi052.stdout:3/220: unlink d2/d4/d2a/d2d/f40 0 2024-04-26T12:06:55.319 INFO:tasks.workunit.client.0.smithi052.stdout:8/189: mknod d0/d4/d1c/c39 0 2024-04-26T12:06:55.320 INFO:tasks.workunit.client.0.smithi052.stdout:6/209: rmdir da/d22/d29/d31/d39 39 2024-04-26T12:06:55.320 INFO:tasks.workunit.client.0.smithi052.stdout:4/221: dwrite d3/d22/d30/f42 [0,4194304] 0 2024-04-26T12:06:55.321 INFO:tasks.workunit.client.0.smithi052.stdout:3/221: fdatasync d2/d4/dc/f1b 0 2024-04-26T12:06:55.322 INFO:tasks.workunit.client.0.smithi052.stdout:8/190: write d0/d4/d1c/f36 [537333,104417] 0 2024-04-26T12:06:55.322 INFO:tasks.workunit.client.0.smithi052.stdout:5/264: dwrite db/dd/d18/d1e/d25/f32 [0,4194304] 0 2024-04-26T12:06:55.322 INFO:tasks.workunit.client.0.smithi052.stdout:5/265: sync 2024-04-26T12:06:55.323 INFO:tasks.workunit.client.0.smithi052.stdout:4/222: chown d3/c37 4704465 1 2024-04-26T12:06:55.323 INFO:tasks.workunit.client.0.smithi052.stdout:2/294: dwrite d0/d7/d2f/d3d/f3e [0,4194304] 0 2024-04-26T12:06:55.323 INFO:tasks.workunit.client.0.smithi052.stdout:6/210: creat da/d22/d29/d31/d39/f48 x:0 0 0 2024-04-26T12:06:55.324 INFO:tasks.workunit.client.0.smithi052.stdout:8/191: symlink d0/d4/d5/db/l3a 0 2024-04-26T12:06:55.325 INFO:tasks.workunit.client.0.smithi052.stdout:5/266: fdatasync db/dd/d18/d1e/d50/f48 0 2024-04-26T12:06:55.326 INFO:tasks.workunit.client.0.smithi052.stdout:4/223: write d3/d12/f1e [3226559,60480] 0 2024-04-26T12:06:55.326 INFO:tasks.workunit.client.0.smithi052.stdout:9/277: truncate d3/db/d10/f18 292729 0 2024-04-26T12:06:55.326 INFO:tasks.workunit.client.0.smithi052.stdout:8/192: stat d0/c13 0 2024-04-26T12:06:55.326 INFO:tasks.workunit.client.0.smithi052.stdout:6/211: unlink f9 0 2024-04-26T12:06:55.327 INFO:tasks.workunit.client.0.smithi052.stdout:1/237: dwrite d0/d2/f24 [0,4194304] 0 2024-04-26T12:06:55.328 INFO:tasks.workunit.client.0.smithi052.stdout:4/224: mkdir d3/d44/d4b 0 2024-04-26T12:06:55.329 INFO:tasks.workunit.client.0.smithi052.stdout:9/278: readlink d3/d1b/l2a 0 2024-04-26T12:06:55.329 INFO:tasks.workunit.client.0.smithi052.stdout:5/267: dread - db/dd/d18/d1e/f49 zero size 2024-04-26T12:06:55.330 INFO:tasks.workunit.client.0.smithi052.stdout:5/268: sync 2024-04-26T12:06:55.330 INFO:tasks.workunit.client.0.smithi052.stdout:5/269: sync 2024-04-26T12:06:55.332 INFO:tasks.workunit.client.0.smithi052.stdout:6/212: write da/d22/d29/f2f [3927662,54699] 0 2024-04-26T12:06:55.332 INFO:tasks.workunit.client.0.smithi052.stdout:7/212: dread d1/f10 [0,4194304] 0 2024-04-26T12:06:55.333 INFO:tasks.workunit.client.0.smithi052.stdout:2/295: truncate d0/d7/fe 5850359 0 2024-04-26T12:06:55.333 INFO:tasks.workunit.client.0.smithi052.stdout:1/238: mkdir d0/d2/de/d4b/d56 0 2024-04-26T12:06:55.334 INFO:tasks.workunit.client.0.smithi052.stdout:0/300: dwrite d0/d1/dd/f19 [0,4194304] 0 2024-04-26T12:06:55.334 INFO:tasks.workunit.client.0.smithi052.stdout:8/193: symlink d0/d4/d5/d27/l3b 0 2024-04-26T12:06:55.335 INFO:tasks.workunit.client.0.smithi052.stdout:4/225: symlink d3/d2b/d40/l4c 0 2024-04-26T12:06:55.335 INFO:tasks.workunit.client.0.smithi052.stdout:3/222: dwrite d2/d4/dc/d1d/d25/f2b [0,4194304] 0 2024-04-26T12:06:55.336 INFO:tasks.workunit.client.0.smithi052.stdout:4/226: write d3/d15/f2a [849552,21386] 0 2024-04-26T12:06:55.337 INFO:tasks.workunit.client.0.smithi052.stdout:6/213: creat da/d22/d29/d31/f49 x:0 0 0 2024-04-26T12:06:55.337 INFO:tasks.workunit.client.0.smithi052.stdout:0/301: chown d0/d1/d1a/d20/c29 219779 1 2024-04-26T12:06:55.337 INFO:tasks.workunit.client.0.smithi052.stdout:9/279: dread d3/f7 [0,4194304] 0 2024-04-26T12:06:55.338 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:55.337+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:55.338 INFO:tasks.workunit.client.0.smithi052.stdout:7/213: link d1/d1c/d21/d2f/c3d d1/d1c/c44 0 2024-04-26T12:06:55.338 INFO:tasks.workunit.client.0.smithi052.stdout:2/296: getdents d0/d7/d16 0 2024-04-26T12:06:55.339 INFO:tasks.workunit.client.0.smithi052.stdout:0/302: symlink d0/l60 0 2024-04-26T12:06:55.339 INFO:tasks.workunit.client.0.smithi052.stdout:9/280: stat d3 0 2024-04-26T12:06:55.339 INFO:tasks.workunit.client.0.smithi052.stdout:3/223: rename d2/c9 to d2/d4/dc/d1d/d25/c42 0 2024-04-26T12:06:55.340 INFO:tasks.workunit.client.0.smithi052.stdout:7/214: mkdir d1/d45 0 2024-04-26T12:06:55.340 INFO:tasks.workunit.client.0.smithi052.stdout:6/214: creat da/d22/d29/d31/f4a x:0 0 0 2024-04-26T12:06:55.341 INFO:tasks.workunit.client.0.smithi052.stdout:0/303: write d0/d1/f41 [1749365,126706] 0 2024-04-26T12:06:55.341 INFO:tasks.workunit.client.0.smithi052.stdout:4/227: rename d3/f16 to d3/d2e/f4d 0 2024-04-26T12:06:55.342 INFO:tasks.workunit.client.0.smithi052.stdout:3/224: mkdir d2/d4/dc/d1d/d43 0 2024-04-26T12:06:55.343 INFO:tasks.workunit.client.0.smithi052.stdout:6/215: dread - da/d22/d3c/f40 zero size 2024-04-26T12:06:55.343 INFO:tasks.workunit.client.0.smithi052.stdout:4/228: creat d3/d22/f4e x:0 0 0 2024-04-26T12:06:55.344 INFO:tasks.workunit.client.0.smithi052.stdout:5/270: dwrite db/f38 [4194304,4194304] 0 2024-04-26T12:06:55.345 INFO:tasks.workunit.client.0.smithi052.stdout:8/194: dwrite d0/d4/dc/f35 [0,4194304] 0 2024-04-26T12:06:55.345 INFO:tasks.workunit.client.0.smithi052.stdout:1/239: dwrite d0/d2/dd/d1c/d1d/f37 [0,4194304] 0 2024-04-26T12:06:55.345 INFO:tasks.workunit.client.0.smithi052.stdout:6/216: fsync da/f13 0 2024-04-26T12:06:55.345 INFO:tasks.workunit.client.0.smithi052.stdout:5/271: read db/f35 [7123198,110127] 0 2024-04-26T12:06:55.346 INFO:tasks.workunit.client.0.smithi052.stdout:8/195: chown d0/f29 39583169 1 2024-04-26T12:06:55.346 INFO:tasks.workunit.client.0.smithi052.stdout:8/196: sync 2024-04-26T12:06:55.346 INFO:tasks.workunit.client.0.smithi052.stdout:4/229: truncate d3/d2e/f3a 959181 0 2024-04-26T12:06:55.347 INFO:tasks.workunit.client.0.smithi052.stdout:1/240: creat d0/d2/dd/d1c/f57 x:0 0 0 2024-04-26T12:06:55.347 INFO:tasks.workunit.client.0.smithi052.stdout:6/217: creat da/d22/d3c/f4b x:0 0 0 2024-04-26T12:06:55.349 INFO:tasks.workunit.client.0.smithi052.stdout:0/304: truncate d0/d1/d11/f31 2028263 0 2024-04-26T12:06:55.349 INFO:tasks.workunit.client.0.smithi052.stdout:7/215: write d1/d1c/d21/d2f/f38 [36984,83528] 0 2024-04-26T12:06:55.349 INFO:tasks.workunit.client.0.smithi052.stdout:0/305: sync 2024-04-26T12:06:55.350 INFO:tasks.workunit.client.0.smithi052.stdout:8/197: rmdir d0/d4/d5/db/d20 39 2024-04-26T12:06:55.350 INFO:tasks.workunit.client.0.smithi052.stdout:2/297: chown d0/d7/fe 1142982 1 2024-04-26T12:06:55.350 INFO:tasks.workunit.client.0.smithi052.stdout:6/218: creat da/d22/d29/f4c x:0 0 0 2024-04-26T12:06:55.350 INFO:tasks.workunit.client.0.smithi052.stdout:4/230: creat d3/f4f x:0 0 0 2024-04-26T12:06:55.352 INFO:tasks.workunit.client.0.smithi052.stdout:1/241: getdents d0/d1e 0 2024-04-26T12:06:55.352 INFO:tasks.workunit.client.0.smithi052.stdout:6/219: readlink da/d22/l41 0 2024-04-26T12:06:55.352 INFO:tasks.workunit.client.0.smithi052.stdout:0/306: stat d0/d1/d1a/d2a/d32/c40 0 2024-04-26T12:06:55.353 INFO:tasks.workunit.client.0.smithi052.stdout:8/198: rmdir d0/d4/d5/db 39 2024-04-26T12:06:55.353 INFO:tasks.workunit.client.0.smithi052.stdout:3/225: dwrite d2/d4/dc/f1b [0,4194304] 0 2024-04-26T12:06:55.353 INFO:tasks.workunit.client.0.smithi052.stdout:6/220: stat da/l21 0 2024-04-26T12:06:55.355 INFO:tasks.workunit.client.0.smithi052.stdout:7/216: creat d1/d1c/d21/d2f/f46 x:0 0 0 2024-04-26T12:06:55.355 INFO:tasks.workunit.client.0.smithi052.stdout:4/231: creat d3/d22/d30/f50 x:0 0 0 2024-04-26T12:06:55.357 INFO:tasks.workunit.client.0.smithi052.stdout:3/226: write d2/d1f/f2c [1074132,19474] 0 2024-04-26T12:06:55.357 INFO:tasks.workunit.client.0.smithi052.stdout:7/217: fsync d1/f12 0 2024-04-26T12:06:55.357 INFO:tasks.workunit.client.0.smithi052.stdout:6/221: dread - da/d22/d29/d31/f49 zero size 2024-04-26T12:06:55.358 INFO:tasks.workunit.client.0.smithi052.stdout:9/281: dwrite d3/db/d13/f51 [4194304,4194304] 0 2024-04-26T12:06:55.359 INFO:tasks.workunit.client.0.smithi052.stdout:4/232: creat d3/d12/d34/d45/f51 x:0 0 0 2024-04-26T12:06:55.360 INFO:tasks.workunit.client.0.smithi052.stdout:7/218: chown d1/d1f/l2d 56 1 2024-04-26T12:06:55.361 INFO:tasks.workunit.client.0.smithi052.stdout:3/227: rename d2/d4/l10 to d2/d4/d31/l44 0 2024-04-26T12:06:55.362 INFO:tasks.workunit.client.0.smithi052.stdout:2/298: dwrite d0/f33 [0,4194304] 0 2024-04-26T12:06:55.363 INFO:tasks.workunit.client.0.smithi052.stdout:4/233: creat d3/d22/f52 x:0 0 0 2024-04-26T12:06:55.364 INFO:tasks.workunit.client.0.smithi052.stdout:6/222: creat da/d22/d29/d31/f4d x:0 0 0 2024-04-26T12:06:55.365 INFO:tasks.workunit.client.0.smithi052.stdout:7/219: creat d1/f47 x:0 0 0 2024-04-26T12:06:55.365 INFO:tasks.workunit.client.0.smithi052.stdout:8/199: dread d0/d4/d5/f11 [0,4194304] 0 2024-04-26T12:06:55.365 INFO:tasks.workunit.client.0.smithi052.stdout:2/299: chown d0/d7/l32 915269 1 2024-04-26T12:06:55.366 INFO:tasks.workunit.client.0.smithi052.stdout:3/228: rename d2/d4/dc/c19 to d2/d4/dc/c45 0 2024-04-26T12:06:55.366 INFO:tasks.workunit.client.0.smithi052.stdout:4/234: write d3/d12/f18 [1853223,83178] 0 2024-04-26T12:06:55.366 INFO:tasks.workunit.client.0.smithi052.stdout:0/307: dwrite d0/d1/d11/f43 [0,4194304] 0 2024-04-26T12:06:55.366 INFO:tasks.workunit.client.0.smithi052.stdout:1/242: dwrite d0/d2/dd/f32 [0,4194304] 0 2024-04-26T12:06:55.368 INFO:tasks.workunit.client.0.smithi052.stdout:6/223: mknod da/d22/d29/d31/d39/c4e 0 2024-04-26T12:06:55.368 INFO:tasks.workunit.client.0.smithi052.stdout:4/235: dread - d3/d22/f23 zero size 2024-04-26T12:06:55.368 INFO:tasks.workunit.client.0.smithi052.stdout:1/243: fdatasync d0/d2/dd/d1c/f51 0 2024-04-26T12:06:55.370 INFO:tasks.workunit.client.0.smithi052.stdout:4/236: write d3/f4f [877390,8777] 0 2024-04-26T12:06:55.371 INFO:tasks.workunit.client.0.smithi052.stdout:3/229: mknod d2/d4/dc/d1d/d43/c46 0 2024-04-26T12:06:55.371 INFO:tasks.workunit.client.0.smithi052.stdout:2/300: rename d0/d7/d16/d3a/d43 to d0/d7/d2f/d5f 0 2024-04-26T12:06:55.373 INFO:tasks.workunit.client.0.smithi052.stdout:0/308: write d0/d1/d11/f31 [2353337,54729] 0 2024-04-26T12:06:55.373 INFO:tasks.workunit.client.0.smithi052.stdout:9/282: dwrite d3/db/f5b [0,4194304] 0 2024-04-26T12:06:55.374 INFO:tasks.workunit.client.0.smithi052.stdout:6/224: getdents da/d22/d29/d31 0 2024-04-26T12:06:55.374 INFO:tasks.workunit.client.0.smithi052.stdout:2/301: chown d0/d36/l51 1 1 2024-04-26T12:06:55.374 INFO:tasks.workunit.client.0.smithi052.stdout:9/283: chown d3/d1b/l41 3003251 1 2024-04-26T12:06:55.375 INFO:tasks.workunit.client.0.smithi052.stdout:4/237: dread d3/d12/f20 [0,4194304] 0 2024-04-26T12:06:55.376 INFO:tasks.workunit.client.0.smithi052.stdout:0/309: readlink d0/d1/d1a/d20/d47/l48 0 2024-04-26T12:06:55.377 INFO:tasks.workunit.client.0.smithi052.stdout:3/230: write d2/d4/dc/d1d/d25/f3b [868386,27249] 0 2024-04-26T12:06:55.377 INFO:tasks.workunit.client.0.smithi052.stdout:8/200: dwrite d0/d4/dc/f37 [0,4194304] 0 2024-04-26T12:06:55.378 INFO:tasks.workunit.client.0.smithi052.stdout:7/220: dwrite d1/d1c/d21/d2f/f38 [0,4194304] 0 2024-04-26T12:06:55.379 INFO:tasks.workunit.client.0.smithi052.stdout:9/284: dread - d3/db/d4a/f4d zero size 2024-04-26T12:06:55.380 INFO:tasks.workunit.client.0.smithi052.stdout:0/310: creat d0/d1/d11/f61 x:0 0 0 2024-04-26T12:06:55.380 INFO:tasks.workunit.client.0.smithi052.stdout:4/238: write d3/d12/f1a [191223,35926] 0 2024-04-26T12:06:55.380 INFO:tasks.workunit.client.0.smithi052.stdout:4/239: fsync d3/d22/d30/f50 0 2024-04-26T12:06:55.380 INFO:tasks.workunit.client.0.smithi052.stdout:3/231: getdents d2/d4/d41 0 2024-04-26T12:06:55.380 INFO:tasks.workunit.client.0.smithi052.stdout:8/201: mkdir d0/d4/d5/d3c 0 2024-04-26T12:06:55.380 INFO:tasks.workunit.client.0.smithi052.stdout:7/221: creat d1/d1c/d21/d2f/f48 x:0 0 0 2024-04-26T12:06:55.381 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:55.381 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:55.381 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:55.381 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:55.381 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:55.382 INFO:tasks.workunit.client.0.smithi052.stdout:4/240: mkdir d3/d15/d53 0 2024-04-26T12:06:55.382 INFO:tasks.workunit.client.0.smithi052.stdout:7/222: dread - d1/d1c/d21/d2f/f46 zero size 2024-04-26T12:06:55.382 INFO:tasks.workunit.client.0.smithi052.stdout:3/232: unlink d2/d4/d31/l44 0 2024-04-26T12:06:55.382 INFO:tasks.workunit.client.0.smithi052.stdout:8/202: chown d0/d4/d1c/f36 334694853 1 2024-04-26T12:06:55.383 INFO:tasks.workunit.client.0.smithi052.stdout:4/241: mknod d3/d12/c54 0 2024-04-26T12:06:55.384 INFO:tasks.workunit.client.0.smithi052.stdout:7/223: unlink d1/f8 0 2024-04-26T12:06:55.384 INFO:tasks.workunit.client.0.smithi052.stdout:6/225: dwrite da/f1d [0,4194304] 0 2024-04-26T12:06:55.384 INFO:tasks.workunit.client.0.smithi052.stdout:9/285: rename d3/d1b/f53 to d3/db/d10/d55/f5d 0 2024-04-26T12:06:55.384 INFO:tasks.workunit.client.0.smithi052.stdout:4/242: readlink d3/d2b/d40/l4c 0 2024-04-26T12:06:55.385 INFO:tasks.workunit.client.0.smithi052.stdout:9/286: read - d3/db/d10/d55/f5d zero size 2024-04-26T12:06:55.386 INFO:tasks.workunit.client.0.smithi052.stdout:3/233: rename d2/d4/dc/d1d/d25/d36/f1e to d2/d4/dc/f47 0 2024-04-26T12:06:55.386 INFO:tasks.workunit.client.0.smithi052.stdout:6/226: creat da/d22/d29/d31/f4f x:0 0 0 2024-04-26T12:06:55.386 INFO:tasks.workunit.client.0.smithi052.stdout:8/203: chown d0/d4/d5/db/d20/c31 6599 1 2024-04-26T12:06:55.386 INFO:tasks.workunit.client.0.smithi052.stdout:4/243: fsync d3/d12/d34/d45/f51 0 2024-04-26T12:06:55.386 INFO:tasks.workunit.client.0.smithi052.stdout:6/227: stat da/le 0 2024-04-26T12:06:55.386 INFO:tasks.workunit.client.0.smithi052.stdout:4/244: stat d3/d44/d4b 0 2024-04-26T12:06:55.387 INFO:tasks.workunit.client.0.smithi052.stdout:3/234: write d2/d4/dc/d33/d37/f3a [3980559,112369] 0 2024-04-26T12:06:55.391 INFO:tasks.workunit.client.0.smithi052.stdout:8/204: creat d0/d4/dc/f3d x:0 0 0 2024-04-26T12:06:55.391 INFO:tasks.workunit.client.0.smithi052.stdout:6/228: write da/d22/f25 [2653960,111472] 0 2024-04-26T12:06:55.391 INFO:tasks.workunit.client.0.smithi052.stdout:8/205: chown d0/d4/f26 1630 1 2024-04-26T12:06:55.391 INFO:tasks.workunit.client.0.smithi052.stdout:7/224: dread d1/fa [0,4194304] 0 2024-04-26T12:06:55.391 INFO:tasks.workunit.client.0.smithi052.stdout:7/225: stat d1/d1c/d21/f2b 0 2024-04-26T12:06:55.391 INFO:tasks.workunit.client.0.smithi052.stdout:4/245: rmdir d3 39 2024-04-26T12:06:55.391 INFO:tasks.workunit.client.0.smithi052.stdout:9/287: dread d3/db/d10/d3c/d40/f42 [0,4194304] 0 2024-04-26T12:06:55.391 INFO:tasks.workunit.client.0.smithi052.stdout:3/235: fsync d2/d4/dc/f47 0 2024-04-26T12:06:55.392 INFO:tasks.workunit.client.0.smithi052.stdout:4/246: chown d3/d2b/f3e 0 1 2024-04-26T12:06:55.392 INFO:tasks.workunit.client.0.smithi052.stdout:3/236: fdatasync d2/d4/dc/d1d/d25/f3b 0 2024-04-26T12:06:55.392 INFO:tasks.workunit.client.0.smithi052.stdout:7/226: creat d1/d1c/d21/d2f/d33/f49 x:0 0 0 2024-04-26T12:06:55.392 INFO:tasks.workunit.client.0.smithi052.stdout:6/229: rename da/d22/d3c/c45 to da/d22/d29/d31/d39/c50 0 2024-04-26T12:06:55.393 INFO:tasks.workunit.client.0.smithi052.stdout:4/247: symlink d3/d1f/d21/l55 0 2024-04-26T12:06:55.393 INFO:tasks.workunit.client.0.smithi052.stdout:6/230: mkdir da/d51 0 2024-04-26T12:06:55.393 INFO:tasks.workunit.client.0.smithi052.stdout:6/231: readlink da/l23 0 2024-04-26T12:06:55.393 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:55.394 INFO:tasks.workunit.client.0.smithi052.stdout:3/237: link d2/d4/dc/c26 d2/d4/c48 0 2024-04-26T12:06:55.394 INFO:tasks.workunit.client.0.smithi052.stdout:4/248: write d3/d2b/f3e [1807418,110066] 0 2024-04-26T12:06:55.395 INFO:tasks.workunit.client.0.smithi052.stdout:4/249: chown d3/lf 1745902 1 2024-04-26T12:06:55.398 INFO:tasks.workunit.client.0.smithi052.stdout:4/250: unlink d3/l11 0 2024-04-26T12:06:55.401 INFO:tasks.workunit.client.0.smithi052.stdout:3/238: truncate d2/d4/dc/f28 155949 0 2024-04-26T12:06:55.402 INFO:tasks.workunit.client.0.smithi052.stdout:9/288: dwrite d3/db/d10/f1c [0,4194304] 0 2024-04-26T12:06:55.402 INFO:tasks.workunit.client.0.smithi052.stdout:4/251: dread - d3/d12/d34/d45/f47 zero size 2024-04-26T12:06:55.402 INFO:tasks.workunit.client.0.smithi052.stdout:7/227: dwrite d1/f6 [0,4194304] 0 2024-04-26T12:06:55.402 INFO:tasks.workunit.client.0.smithi052.stdout:3/239: mknod d2/c49 0 2024-04-26T12:06:55.403 INFO:tasks.workunit.client.0.smithi052.stdout:8/206: dwrite d0/d4/d1c/f2b [4194304,4194304] 0 2024-04-26T12:06:55.403 INFO:tasks.workunit.client.0.smithi052.stdout:4/252: unlink d3/l1d 0 2024-04-26T12:06:55.403 INFO:tasks.workunit.client.0.smithi052.stdout:7/228: chown d1/f15 586397041 1 2024-04-26T12:06:55.404 INFO:tasks.workunit.client.0.smithi052.stdout:6/232: dwrite da/d22/f47 [0,4194304] 0 2024-04-26T12:06:55.404 INFO:tasks.workunit.client.0.smithi052.stdout:8/207: write d0/d4/d5/f8 [7224209,30880] 0 2024-04-26T12:06:55.405 INFO:tasks.workunit.client.0.smithi052.stdout:7/229: dread - d1/d1c/d21/d2f/f48 zero size 2024-04-26T12:06:55.406 INFO:tasks.workunit.client.0.smithi052.stdout:9/289: truncate d3/db/d2b/f2f 2703727 0 2024-04-26T12:06:55.406 INFO:tasks.workunit.client.0.smithi052.stdout:6/233: creat da/d22/f52 x:0 0 0 2024-04-26T12:06:55.406 INFO:tasks.workunit.client.0.smithi052.stdout:3/240: creat d2/d4/dc/d1d/d25/d36/d1c/f4a x:0 0 0 2024-04-26T12:06:55.406 INFO:tasks.workunit.client.0.smithi052.stdout:4/253: symlink d3/d1f/d21/l56 0 2024-04-26T12:06:55.406 INFO:tasks.workunit.client.0.smithi052.stdout:8/208: unlink d0/d4/d5/db/c19 0 2024-04-26T12:06:55.407 INFO:tasks.workunit.client.0.smithi052.stdout:8/209: write d0/f29 [540561,11854] 0 2024-04-26T12:06:55.408 INFO:tasks.workunit.client.0.smithi052.stdout:8/210: mkdir d0/d3e 0 2024-04-26T12:06:55.410 INFO:tasks.workunit.client.0.smithi052.stdout:8/211: unlink d0/d4/dc/f35 0 2024-04-26T12:06:55.410 INFO:tasks.workunit.client.0.smithi052.stdout:3/241: read d2/d4/f21 [1861255,62929] 0 2024-04-26T12:06:55.411 INFO:tasks.workunit.client.0.smithi052.stdout:8/212: unlink d0/d4/dc/f37 0 2024-04-26T12:06:55.411 INFO:tasks.workunit.client.0.smithi052.stdout:3/242: fsync d2/d1f/f2c 0 2024-04-26T12:06:55.411 INFO:tasks.workunit.client.0.smithi052.stdout:7/230: dwrite d1/d1f/f26 [0,4194304] 0 2024-04-26T12:06:55.415 INFO:tasks.workunit.client.0.smithi052.stdout:2/302: dread d0/d7/f10 [0,4194304] 0 2024-04-26T12:06:55.416 INFO:tasks.workunit.client.0.smithi052.stdout:2/303: creat d0/d7/d2f/d4c/f60 x:0 0 0 2024-04-26T12:06:55.417 INFO:tasks.workunit.client.0.smithi052.stdout:2/304: chown d0/d7/d2f/d5f 2 1 2024-04-26T12:06:55.418 INFO:tasks.workunit.client.0.smithi052.stdout:9/290: link d3/db/d2b/f2f d3/d1b/f5e 0 2024-04-26T12:06:55.419 INFO:tasks.workunit.client.0.smithi052.stdout:6/234: read da/f1c [1738323,15500] 0 2024-04-26T12:06:55.419 INFO:tasks.workunit.client.0.smithi052.stdout:7/231: dwrite d1/d1f/f22 [4194304,4194304] 0 2024-04-26T12:06:55.419 INFO:tasks.workunit.client.0.smithi052.stdout:2/305: link d0/d7/fe d0/d7/d53/f61 0 2024-04-26T12:06:55.419 INFO:tasks.workunit.client.0.smithi052.stdout:6/235: chown da/c19 335 1 2024-04-26T12:06:55.420 INFO:tasks.workunit.client.0.smithi052.stdout:9/291: truncate d3/db/d10/d55/f57 958496 0 2024-04-26T12:06:55.420 INFO:tasks.workunit.client.0.smithi052.stdout:6/236: chown da/d22/d29/f36 4400877 1 2024-04-26T12:06:55.421 INFO:tasks.workunit.client.0.smithi052.stdout:6/237: readlink da/d22/l33 0 2024-04-26T12:06:55.421 INFO:tasks.workunit.client.0.smithi052.stdout:9/292: rmdir d3/d1b/d49 39 2024-04-26T12:06:55.421 INFO:tasks.workunit.client.0.smithi052.stdout:6/238: stat c7 0 2024-04-26T12:06:55.422 INFO:tasks.workunit.client.0.smithi052.stdout:9/293: symlink d3/d23/l5f 0 2024-04-26T12:06:55.422 INFO:tasks.workunit.client.0.smithi052.stdout:5/272: dread db/dc/f1d [0,4194304] 0 2024-04-26T12:06:55.423 INFO:tasks.workunit.client.0.smithi052.stdout:3/243: dread d2/f29 [0,4194304] 0 2024-04-26T12:06:55.423 INFO:tasks.workunit.client.0.smithi052.stdout:6/239: creat da/f53 x:0 0 0 2024-04-26T12:06:55.423 INFO:tasks.workunit.client.0.smithi052.stdout:3/244: chown d2/f7 31 1 2024-04-26T12:06:55.423 INFO:tasks.workunit.client.0.smithi052.stdout:9/294: fdatasync d3/f7 0 2024-04-26T12:06:55.424 INFO:tasks.workunit.client.0.smithi052.stdout:6/240: write da/d22/d29/d31/f4f [675553,22314] 0 2024-04-26T12:06:55.424 INFO:tasks.workunit.client.0.smithi052.stdout:5/273: write db/dd/d18/d1e/d50/d46/f4b [21902,26724] 0 2024-04-26T12:06:55.425 INFO:tasks.workunit.client.0.smithi052.stdout:7/232: truncate d1/d1c/d23/f25 274140 0 2024-04-26T12:06:55.425 INFO:tasks.workunit.client.0.smithi052.stdout:3/245: getdents d2/d4/dc/d1d/d3f 0 2024-04-26T12:06:55.426 INFO:tasks.workunit.client.0.smithi052.stdout:9/295: getdents d3/db/d10 0 2024-04-26T12:06:55.427 INFO:tasks.workunit.client.0.smithi052.stdout:5/274: creat db/dd/d18/d1e/d3f/f5d x:0 0 0 2024-04-26T12:06:55.428 INFO:tasks.workunit.client.0.smithi052.stdout:0/311: dread d0/d1/d1a/d2a/f51 [0,4194304] 0 2024-04-26T12:06:55.428 INFO:tasks.workunit.client.0.smithi052.stdout:8/213: fsync d0/f29 0 2024-04-26T12:06:55.428 INFO:tasks.workunit.client.0.smithi052.stdout:3/246: dread d2/d4/f3e [0,4194304] 0 2024-04-26T12:06:55.429 INFO:tasks.workunit.client.0.smithi052.stdout:6/241: link da/d22/d29/f2f da/d22/d29/d31/f54 0 2024-04-26T12:06:55.429 INFO:tasks.workunit.client.0.smithi052.stdout:9/296: truncate d3/db/d10/f18 925745 0 2024-04-26T12:06:55.430 INFO:tasks.workunit.client.0.smithi052.stdout:4/254: dread d3/fd [0,4194304] 0 2024-04-26T12:06:55.430 INFO:tasks.workunit.client.0.smithi052.stdout:2/306: dwrite d0/f4 [0,4194304] 0 2024-04-26T12:06:55.430 INFO:tasks.workunit.client.0.smithi052.stdout:8/214: symlink d0/d4/l3f 0 2024-04-26T12:06:55.430 INFO:tasks.workunit.client.0.smithi052.stdout:6/242: readlink da/le 0 2024-04-26T12:06:55.431 INFO:tasks.workunit.client.0.smithi052.stdout:1/244: dread d0/d2/f2a [0,4194304] 0 2024-04-26T12:06:55.431 INFO:tasks.workunit.client.0.smithi052.stdout:9/297: symlink d3/d3b/l60 0 2024-04-26T12:06:55.432 INFO:tasks.workunit.client.0.smithi052.stdout:9/298: chown d3/db/d2b 16048 1 2024-04-26T12:06:55.432 INFO:tasks.workunit.client.0.smithi052.stdout:0/312: link d0/d5b/c50 d0/d1/d2c/c62 0 2024-04-26T12:06:55.432 INFO:tasks.workunit.client.0.smithi052.stdout:3/247: symlink d2/d4/d41/l4b 0 2024-04-26T12:06:55.433 INFO:tasks.workunit.client.0.smithi052.stdout:4/255: creat d3/f57 x:0 0 0 2024-04-26T12:06:55.433 INFO:tasks.workunit.client.0.smithi052.stdout:7/233: dread d1/f10 [0,4194304] 0 2024-04-26T12:06:55.433 INFO:tasks.workunit.client.0.smithi052.stdout:2/307: getdents d0/d7/d22 0 2024-04-26T12:06:55.433 INFO:tasks.workunit.client.0.smithi052.stdout:6/243: write da/d22/d3c/f4b [805760,103857] 0 2024-04-26T12:06:55.433 INFO:tasks.workunit.client.0.smithi052.stdout:1/245: rename d0/d2 to d0/d2/dd/d1c/d1d/d23/d58 22 2024-04-26T12:06:55.434 INFO:tasks.workunit.client.0.smithi052.stdout:7/234: rename d1 to d1/d1c/d21/d4a 22 2024-04-26T12:06:55.434 INFO:tasks.workunit.client.0.smithi052.stdout:9/299: write d3/db/f5b [2218221,82334] 0 2024-04-26T12:06:55.434 INFO:tasks.workunit.client.0.smithi052.stdout:0/313: creat d0/d26/d36/f63 x:0 0 0 2024-04-26T12:06:55.435 INFO:tasks.workunit.client.0.smithi052.stdout:4/256: creat d3/d44/f58 x:0 0 0 2024-04-26T12:06:55.435 INFO:tasks.workunit.client.0.smithi052.stdout:6/244: creat da/d22/d29/f55 x:0 0 0 2024-04-26T12:06:55.435 INFO:tasks.workunit.client.0.smithi052.stdout:8/215: truncate d0/d4/d5/db/d20/f24 420411 0 2024-04-26T12:06:55.436 INFO:tasks.workunit.client.0.smithi052.stdout:3/248: rename d2/l34 to d2/d4/dc/d1d/d25/d36/l4c 0 2024-04-26T12:06:55.436 INFO:tasks.workunit.client.0.smithi052.stdout:4/257: mkdir d3/d12/d59 0 2024-04-26T12:06:55.436 INFO:tasks.workunit.client.0.smithi052.stdout:9/300: creat d3/db/d2b/f61 x:0 0 0 2024-04-26T12:06:55.437 INFO:tasks.workunit.client.0.smithi052.stdout:6/245: symlink da/d51/l56 0 2024-04-26T12:06:55.437 INFO:tasks.workunit.client.0.smithi052.stdout:1/246: write d0/d2/dd/d1c/d1d/d23/f38 [768311,88028] 0 2024-04-26T12:06:55.437 INFO:tasks.workunit.client.0.smithi052.stdout:9/301: chown d3/db/d52 687 1 2024-04-26T12:06:55.438 INFO:tasks.workunit.client.0.smithi052.stdout:2/308: rename d0/d7/d16/l44 to d0/d7/d2f/d5f/l62 0 2024-04-26T12:06:55.438 INFO:tasks.workunit.client.0.smithi052.stdout:4/258: write d3/d1f/f25 [2605356,20614] 0 2024-04-26T12:06:55.438 INFO:tasks.workunit.client.0.smithi052.stdout:6/246: readlink da/d22/l41 0 2024-04-26T12:06:55.438 INFO:tasks.workunit.client.0.smithi052.stdout:3/249: mkdir d2/d4/d2a/d2d/d4d 0 2024-04-26T12:06:55.439 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:55.437+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:55.439 INFO:tasks.workunit.client.0.smithi052.stdout:0/314: rename d0/f45 to d0/d1/d1a/f64 0 2024-04-26T12:06:55.439 INFO:tasks.workunit.client.0.smithi052.stdout:2/309: chown d0/d7/d53/f61 754 1 2024-04-26T12:06:55.439 INFO:tasks.workunit.client.0.smithi052.stdout:6/247: symlink da/d22/d3c/l57 0 2024-04-26T12:06:55.439 INFO:tasks.workunit.client.0.smithi052.stdout:8/216: read d0/d4/d5/fe [3324091,81873] 0 2024-04-26T12:06:55.440 INFO:tasks.workunit.client.0.smithi052.stdout:9/302: getdents d3/d1b 0 2024-04-26T12:06:55.440 INFO:tasks.workunit.client.0.smithi052.stdout:2/310: rmdir d0/d7/d22 39 2024-04-26T12:06:55.440 INFO:tasks.workunit.client.0.smithi052.stdout:7/235: rename d1/d1c/d21/d2f/d33/l37 to d1/d45/l4b 0 2024-04-26T12:06:55.442 INFO:tasks.workunit.client.0.smithi052.stdout:6/248: creat da/d22/d3c/f58 x:0 0 0 2024-04-26T12:06:55.442 INFO:tasks.workunit.client.0.smithi052.stdout:0/315: link d0/d26/c38 d0/d3c/c65 0 2024-04-26T12:06:55.442 INFO:tasks.workunit.client.0.smithi052.stdout:9/303: fsync d3/db/d24/f46 0 2024-04-26T12:06:55.442 INFO:tasks.workunit.client.0.smithi052.stdout:8/217: chown d0/d4/d5/db/d20 874085217 1 2024-04-26T12:06:55.442 INFO:tasks.workunit.client.0.smithi052.stdout:2/311: write d0/f4 [4469685,128941] 0 2024-04-26T12:06:55.443 INFO:tasks.workunit.client.0.smithi052.stdout:5/275: dread db/dd/d18/d1e/d3f/f58 [0,4194304] 0 2024-04-26T12:06:55.443 INFO:tasks.workunit.client.0.smithi052.stdout:6/249: unlink da/c1a 0 2024-04-26T12:06:55.443 INFO:tasks.workunit.client.0.smithi052.stdout:8/218: stat d0/d4/d5/f8 0 2024-04-26T12:06:55.443 INFO:tasks.workunit.client.0.smithi052.stdout:9/304: stat d3/d1b/d49 0 2024-04-26T12:06:55.444 INFO:tasks.workunit.client.0.smithi052.stdout:0/316: creat d0/f66 x:0 0 0 2024-04-26T12:06:55.444 INFO:tasks.workunit.client.0.smithi052.stdout:4/259: dread d3/d12/f1e [0,4194304] 0 2024-04-26T12:06:55.444 INFO:tasks.workunit.client.0.smithi052.stdout:5/276: chown db/dc/c13 235183 1 2024-04-26T12:06:55.444 INFO:tasks.workunit.client.0.smithi052.stdout:2/312: write d0/d7/f31 [2404486,49462] 0 2024-04-26T12:06:55.445 INFO:tasks.workunit.client.0.smithi052.stdout:9/305: mknod d3/db/d24/c62 0 2024-04-26T12:06:55.445 INFO:tasks.workunit.client.0.smithi052.stdout:1/247: dwrite d0/d2/f10 [0,4194304] 0 2024-04-26T12:06:55.445 INFO:tasks.workunit.client.0.smithi052.stdout:6/250: symlink da/d22/d29/l59 0 2024-04-26T12:06:55.445 INFO:tasks.workunit.client.0.smithi052.stdout:8/219: rmdir d0/d4/d5/db 39 2024-04-26T12:06:55.446 INFO:tasks.workunit.client.0.smithi052.stdout:3/250: stat d2/d4/dc/d1d/d25/d36/l4c 0 2024-04-26T12:06:55.447 INFO:tasks.workunit.client.0.smithi052.stdout:6/251: creat da/d22/d29/f5a x:0 0 0 2024-04-26T12:06:55.447 INFO:tasks.workunit.client.0.smithi052.stdout:7/236: getdents d1/d1f 0 2024-04-26T12:06:55.448 INFO:tasks.workunit.client.0.smithi052.stdout:2/313: symlink d0/d3f/l63 0 2024-04-26T12:06:55.449 INFO:tasks.workunit.client.0.smithi052.stdout:0/317: getdents d0/d1/d1a/d20/d47 0 2024-04-26T12:06:55.449 INFO:tasks.workunit.client.0.smithi052.stdout:6/252: creat da/d51/f5b x:0 0 0 2024-04-26T12:06:55.449 INFO:tasks.workunit.client.0.smithi052.stdout:7/237: mkdir d1/d45/d4c 0 2024-04-26T12:06:55.450 INFO:tasks.workunit.client.0.smithi052.stdout:1/248: getdents d0/da 0 2024-04-26T12:06:55.450 INFO:tasks.workunit.client.0.smithi052.stdout:4/260: dread d3/f4f [0,4194304] 0 2024-04-26T12:06:55.450 INFO:tasks.workunit.client.0.smithi052.stdout:2/314: write d0/f4 [2162780,117426] 0 2024-04-26T12:06:55.450 INFO:tasks.workunit.client.0.smithi052.stdout:3/251: readlink d2/d4/dc/d1d/d25/d36/d1c/l30 0 2024-04-26T12:06:55.451 INFO:tasks.workunit.client.0.smithi052.stdout:2/315: chown d0/d36/d57 2835 1 2024-04-26T12:06:55.451 INFO:tasks.workunit.client.0.smithi052.stdout:8/220: getdents d0/d4/d5/db/d20 0 2024-04-26T12:06:55.451 INFO:tasks.workunit.client.0.smithi052.stdout:9/306: dread d3/db/d10/f1c [0,4194304] 0 2024-04-26T12:06:55.452 INFO:tasks.workunit.client.0.smithi052.stdout:7/238: mkdir d1/d45/d4c/d4d 0 2024-04-26T12:06:55.452 INFO:tasks.workunit.client.0.smithi052.stdout:4/261: creat d3/d15/f5a x:0 0 0 2024-04-26T12:06:55.452 INFO:tasks.workunit.client.0.smithi052.stdout:1/249: truncate d0/f3f 1001003 0 2024-04-26T12:06:55.452 INFO:tasks.workunit.client.0.smithi052.stdout:8/221: rename d0/d4 to d0/d4/d5/d40 22 2024-04-26T12:06:55.453 INFO:tasks.workunit.client.0.smithi052.stdout:2/316: unlink d0/d7/d2f/d3d/l47 0 2024-04-26T12:06:55.453 INFO:tasks.workunit.client.0.smithi052.stdout:3/252: getdents d2/d4/d41 0 2024-04-26T12:06:55.453 INFO:tasks.workunit.client.0.smithi052.stdout:6/253: getdents da/d22/d29/d31/d39 0 2024-04-26T12:06:55.453 INFO:tasks.workunit.client.0.smithi052.stdout:7/239: rename d1/fd to d1/d1c/d21/d2f/f4e 0 2024-04-26T12:06:55.455 INFO:tasks.workunit.client.0.smithi052.stdout:1/250: mknod d0/d2/dd/d1c/d3c/c59 0 2024-04-26T12:06:55.455 INFO:tasks.workunit.client.0.smithi052.stdout:8/222: mkdir d0/d4/d5/db/d20/d41 0 2024-04-26T12:06:55.456 INFO:tasks.workunit.client.0.smithi052.stdout:2/317: creat d0/d3f/d56/f64 x:0 0 0 2024-04-26T12:06:55.457 INFO:tasks.workunit.client.0.smithi052.stdout:3/253: getdents d2 0 2024-04-26T12:06:55.458 INFO:tasks.workunit.client.0.smithi052.stdout:8/223: write d0/d4/d1c/f36 [508642,87584] 0 2024-04-26T12:06:55.459 INFO:tasks.workunit.client.0.smithi052.stdout:2/318: rmdir d0/d36/d57 39 2024-04-26T12:06:55.459 INFO:tasks.workunit.client.0.smithi052.stdout:1/251: link d0/da/c48 d0/d2/de/c5a 0 2024-04-26T12:06:55.460 INFO:tasks.workunit.client.0.smithi052.stdout:8/224: fdatasync d0/d4/f38 0 2024-04-26T12:06:55.460 INFO:tasks.workunit.client.0.smithi052.stdout:4/262: dwrite d3/d12/f1e [0,4194304] 0 2024-04-26T12:06:55.462 INFO:tasks.workunit.client.0.smithi052.stdout:1/252: mknod d0/da/d3a/c5b 0 2024-04-26T12:06:55.462 INFO:tasks.workunit.client.0.smithi052.stdout:5/277: dread db/dd/f27 [0,4194304] 0 2024-04-26T12:06:55.463 INFO:tasks.workunit.client.0.smithi052.stdout:8/225: creat d0/d3e/f42 x:0 0 0 2024-04-26T12:06:55.463 INFO:tasks.workunit.client.0.smithi052.stdout:3/254: truncate d2/d4/dc/d1d/d25/f3b 5700292 0 2024-04-26T12:06:55.463 INFO:tasks.workunit.client.0.smithi052.stdout:6/254: dwrite da/f3f [0,4194304] 0 2024-04-26T12:06:55.463 INFO:tasks.workunit.client.0.smithi052.stdout:7/240: dread d1/d1c/d23/f2c [0,4194304] 0 2024-04-26T12:06:55.465 INFO:tasks.workunit.client.0.smithi052.stdout:2/319: link d0/d7/d16/c27 d0/d7/c65 0 2024-04-26T12:06:55.466 INFO:tasks.workunit.client.0.smithi052.stdout:3/255: write d2/d1f/f2c [5071825,17118] 0 2024-04-26T12:06:55.466 INFO:tasks.workunit.client.0.smithi052.stdout:7/241: rmdir d1/d45/d4c 39 2024-04-26T12:06:55.467 INFO:tasks.workunit.client.0.smithi052.stdout:6/255: mknod da/d22/d29/d31/d39/c5c 0 2024-04-26T12:06:55.467 INFO:tasks.workunit.client.0.smithi052.stdout:2/320: fdatasync d0/d36/f45 0 2024-04-26T12:06:55.469 INFO:tasks.workunit.client.0.smithi052.stdout:7/242: creat d1/d45/d4c/f4f x:0 0 0 2024-04-26T12:06:55.469 INFO:tasks.workunit.client.0.smithi052.stdout:6/256: mkdir da/d5d 0 2024-04-26T12:06:55.470 INFO:tasks.workunit.client.0.smithi052.stdout:3/256: mkdir d2/d4/dc/d1d/d25/d36/d1c/d4e 0 2024-04-26T12:06:55.472 INFO:tasks.workunit.client.0.smithi052.stdout:2/321: symlink d0/d7/d2f/d5f/d4b/l66 0 2024-04-26T12:06:55.472 INFO:tasks.workunit.client.0.smithi052.stdout:9/307: dread d3/d1b/f5e [0,4194304] 0 2024-04-26T12:06:55.473 INFO:tasks.workunit.client.0.smithi052.stdout:1/253: dwrite d0/f20 [0,4194304] 0 2024-04-26T12:06:55.474 INFO:tasks.workunit.client.0.smithi052.stdout:0/318: sync 2024-04-26T12:06:55.474 INFO:tasks.workunit.client.0.smithi052.stdout:6/257: read da/d22/f25 [1457416,95101] 0 2024-04-26T12:06:55.474 INFO:tasks.workunit.client.0.smithi052.stdout:4/263: dwrite d3/d12/f19 [0,4194304] 0 2024-04-26T12:06:55.475 INFO:tasks.workunit.client.0.smithi052.stdout:3/257: mknod d2/d4/d2a/d2d/d4d/c4f 0 2024-04-26T12:06:55.475 INFO:tasks.workunit.client.0.smithi052.stdout:5/278: dwrite db/f35 [0,4194304] 0 2024-04-26T12:06:55.476 INFO:tasks.workunit.client.0.smithi052.stdout:1/254: stat d0/d2/dd/d40/l49 0 2024-04-26T12:06:55.478 INFO:tasks.workunit.client.0.smithi052.stdout:8/226: dwrite d0/d4/d1c/f2c [0,4194304] 0 2024-04-26T12:06:55.478 INFO:tasks.workunit.client.0.smithi052.stdout:3/258: creat d2/d4/dc/d1d/d25/d36/f50 x:0 0 0 2024-04-26T12:06:55.479 INFO:tasks.workunit.client.0.smithi052.stdout:2/322: link d0/d7/d16/c27 d0/d7/d16/d3a/c67 0 2024-04-26T12:06:55.479 INFO:tasks.workunit.client.0.smithi052.stdout:1/255: write d0/da/f19 [1676339,88644] 0 2024-04-26T12:06:55.480 INFO:tasks.workunit.client.0.smithi052.stdout:7/243: dread d1/d1f/f26 [0,4194304] 0 2024-04-26T12:06:55.480 INFO:tasks.workunit.client.0.smithi052.stdout:2/323: dread - d0/d7/f3c zero size 2024-04-26T12:06:55.481 INFO:tasks.workunit.client.0.smithi052.stdout:7/244: chown d1/d1f/c39 62588 1 2024-04-26T12:06:55.482 INFO:tasks.workunit.client.0.smithi052.stdout:2/324: fdatasync d0/d7/d2f/d3d/f48 0 2024-04-26T12:06:55.482 INFO:tasks.workunit.client.0.smithi052.stdout:3/259: unlink d2/f7 0 2024-04-26T12:06:55.482 INFO:tasks.workunit.client.0.smithi052.stdout:5/279: link db/dd/d34/l4e db/dd/d18/d1e/d50/l5e 0 2024-04-26T12:06:55.483 INFO:tasks.workunit.client.0.smithi052.stdout:1/256: symlink d0/d2/dd/d1c/d1d/l5c 0 2024-04-26T12:06:55.484 INFO:tasks.workunit.client.0.smithi052.stdout:4/264: read d3/fb [607778,127684] 0 2024-04-26T12:06:55.484 INFO:tasks.workunit.client.0.smithi052.stdout:7/245: chown d1/d1c/d21/d2f/l34 134624274 1 2024-04-26T12:06:55.484 INFO:tasks.workunit.client.0.smithi052.stdout:6/258: dwrite da/f13 [4194304,4194304] 0 2024-04-26T12:06:55.485 INFO:tasks.workunit.client.0.smithi052.stdout:1/257: stat d0/d2/dd/d2c/l47 0 2024-04-26T12:06:55.485 INFO:tasks.workunit.client.0.smithi052.stdout:2/325: chown d0/d7/c35 4258314 1 2024-04-26T12:06:55.485 INFO:tasks.workunit.client.0.smithi052.stdout:4/265: fdatasync d3/f57 0 2024-04-26T12:06:55.485 INFO:tasks.workunit.client.0.smithi052.stdout:9/308: dwrite d3/db/d10/d3c/d40/f42 [0,4194304] 0 2024-04-26T12:06:55.487 INFO:tasks.workunit.client.0.smithi052.stdout:1/258: fdatasync d0/d2/f10 0 2024-04-26T12:06:55.487 INFO:tasks.workunit.client.0.smithi052.stdout:2/326: fdatasync d0/d7/d16/d3a/f5e 0 2024-04-26T12:06:55.487 INFO:tasks.workunit.client.0.smithi052.stdout:6/259: readlink da/d22/d3c/l57 0 2024-04-26T12:06:55.487 INFO:tasks.workunit.client.0.smithi052.stdout:3/260: link d2/d4/dc/d1d/d25/f3b d2/d4/dc/d33/d37/f51 0 2024-04-26T12:06:55.487 INFO:tasks.workunit.client.0.smithi052.stdout:5/280: rename db/dd/d18/d1e to db/dc/d5f 0 2024-04-26T12:06:55.488 INFO:tasks.workunit.client.0.smithi052.stdout:7/246: sync 2024-04-26T12:06:55.488 INFO:tasks.workunit.client.0.smithi052.stdout:9/309: rename d3/db/d10 to d3/db/d10/d3c/d63 22 2024-04-26T12:06:55.488 INFO:tasks.workunit.client.0.smithi052.stdout:2/327: sync 2024-04-26T12:06:55.489 INFO:tasks.workunit.client.0.smithi052.stdout:3/261: unlink d2/d4/dc/f28 0 2024-04-26T12:06:55.490 INFO:tasks.workunit.client.0.smithi052.stdout:1/259: rename d0/da/d2e/f1a to d0/d2/de/d4b/d56/f5d 0 2024-04-26T12:06:55.490 INFO:tasks.workunit.client.0.smithi052.stdout:6/260: getdents da/d22/d29/d31/d39 0 2024-04-26T12:06:55.490 INFO:tasks.workunit.client.0.smithi052.stdout:9/310: stat d3/db/d52/l47 0 2024-04-26T12:06:55.490 INFO:tasks.workunit.client.0.smithi052.stdout:2/328: fdatasync d0/d7/d16/f30 0 2024-04-26T12:06:55.492 INFO:tasks.workunit.client.0.smithi052.stdout:7/247: getdents d1 0 2024-04-26T12:06:55.492 INFO:tasks.workunit.client.0.smithi052.stdout:9/311: symlink d3/db/d10/l64 0 2024-04-26T12:06:55.493 INFO:tasks.workunit.client.0.smithi052.stdout:6/261: truncate f2 4149383 0 2024-04-26T12:06:55.494 INFO:tasks.workunit.client.0.smithi052.stdout:4/266: dwrite d3/f1c [0,4194304] 0 2024-04-26T12:06:55.494 INFO:tasks.workunit.client.0.smithi052.stdout:7/248: creat d1/d1c/d23/f50 x:0 0 0 2024-04-26T12:06:55.494 INFO:tasks.workunit.client.0.smithi052.stdout:6/262: unlink da/d22/d29/f2f 0 2024-04-26T12:06:55.495 INFO:tasks.workunit.client.0.smithi052.stdout:3/262: dwrite d2/f3d [0,4194304] 0 2024-04-26T12:06:55.495 INFO:tasks.workunit.client.0.smithi052.stdout:4/267: creat d3/d2b/d40/f5b x:0 0 0 2024-04-26T12:06:55.495 INFO:tasks.workunit.client.0.smithi052.stdout:7/249: mknod d1/d1f/c51 0 2024-04-26T12:06:55.495 INFO:tasks.workunit.client.0.smithi052.stdout:8/227: dread d0/f2 [0,4194304] 0 2024-04-26T12:06:55.496 INFO:tasks.workunit.client.0.smithi052.stdout:1/260: truncate d0/d2/dd/f14 2165809 0 2024-04-26T12:06:55.496 INFO:tasks.workunit.client.0.smithi052.stdout:9/312: write d3/d1b/f5e [2846438,19430] 0 2024-04-26T12:06:55.497 INFO:tasks.workunit.client.0.smithi052.stdout:4/268: write d3/d12/f1a [4966514,37991] 0 2024-04-26T12:06:55.497 INFO:tasks.workunit.client.0.smithi052.stdout:3/263: dread d2/f29 [0,4194304] 0 2024-04-26T12:06:55.498 INFO:tasks.workunit.client.0.smithi052.stdout:7/250: link d1/l11 d1/d45/d4c/l52 0 2024-04-26T12:06:55.498 INFO:tasks.workunit.client.0.smithi052.stdout:1/261: read - d0/d2/de/f2d zero size 2024-04-26T12:06:55.498 INFO:tasks.workunit.client.0.smithi052.stdout:6/263: dread da/ff [8388608,4194304] 0 2024-04-26T12:06:55.498 INFO:tasks.workunit.client.0.smithi052.stdout:8/228: write d0/d4/d5/db/d20/f24 [321889,102269] 0 2024-04-26T12:06:55.499 INFO:tasks.workunit.client.0.smithi052.stdout:2/329: dread d0/f15 [0,4194304] 0 2024-04-26T12:06:55.499 INFO:tasks.workunit.client.0.smithi052.stdout:7/251: chown d1/d1c/d21 98121 1 2024-04-26T12:06:55.499 INFO:tasks.workunit.client.0.smithi052.stdout:4/269: chown d3/d22/d30/f50 120951 1 2024-04-26T12:06:55.499 INFO:tasks.workunit.client.0.smithi052.stdout:9/313: creat d3/db/d52/f65 x:0 0 0 2024-04-26T12:06:55.500 INFO:tasks.workunit.client.0.smithi052.stdout:3/264: dread d2/d4/f3e [0,4194304] 0 2024-04-26T12:06:55.500 INFO:tasks.workunit.client.0.smithi052.stdout:8/229: chown d0/d4 1049763372 1 2024-04-26T12:06:55.500 INFO:tasks.workunit.client.0.smithi052.stdout:6/264: creat da/d22/d3c/f5e x:0 0 0 2024-04-26T12:06:55.500 INFO:tasks.workunit.client.0.smithi052.stdout:8/230: chown d0/d4/d5/d3c 19686459 1 2024-04-26T12:06:55.501 INFO:tasks.workunit.client.0.smithi052.stdout:7/252: creat d1/d1c/d21/f53 x:0 0 0 2024-04-26T12:06:55.501 INFO:tasks.workunit.client.0.smithi052.stdout:1/262: symlink d0/d2/dd/d34/l5e 0 2024-04-26T12:06:55.501 INFO:tasks.workunit.client.0.smithi052.stdout:6/265: fsync da/d22/d29/f38 0 2024-04-26T12:06:55.501 INFO:tasks.workunit.client.0.smithi052.stdout:4/270: creat d3/d22/d30/f5c x:0 0 0 2024-04-26T12:06:55.501 INFO:tasks.workunit.client.0.smithi052.stdout:3/265: read d2/d4/f3e [208109,123490] 0 2024-04-26T12:06:55.502 INFO:tasks.workunit.client.0.smithi052.stdout:2/330: creat d0/f68 x:0 0 0 2024-04-26T12:06:55.502 INFO:tasks.workunit.client.0.smithi052.stdout:9/314: write d3/db/d13/f29 [1905522,60852] 0 2024-04-26T12:06:55.502 INFO:tasks.workunit.client.0.smithi052.stdout:1/263: chown d0/da/d3a/c5b 1704 1 2024-04-26T12:06:55.502 INFO:tasks.workunit.client.0.smithi052.stdout:9/315: read - d3/d3b/f3e zero size 2024-04-26T12:06:55.503 INFO:tasks.workunit.client.0.smithi052.stdout:4/271: rename d3/d15/f5a to d3/d12/d34/d43/f5d 0 2024-04-26T12:06:55.503 INFO:tasks.workunit.client.0.smithi052.stdout:8/231: dread d0/f2 [0,4194304] 0 2024-04-26T12:06:55.504 INFO:tasks.workunit.client.0.smithi052.stdout:3/266: write d2/d4/d2a/d2d/f2e [2973876,127596] 0 2024-04-26T12:06:55.504 INFO:tasks.workunit.client.0.smithi052.stdout:1/264: creat d0/d2/de/f5f x:0 0 0 2024-04-26T12:06:55.504 INFO:tasks.workunit.client.0.smithi052.stdout:6/266: symlink da/d22/d29/d31/l5f 0 2024-04-26T12:06:55.505 INFO:tasks.workunit.client.0.smithi052.stdout:8/232: symlink d0/d3e/l43 0 2024-04-26T12:06:55.506 INFO:tasks.workunit.client.0.smithi052.stdout:3/267: unlink d2/d4/d2a/d2d/d4d/c4f 0 2024-04-26T12:06:55.507 INFO:tasks.workunit.client.0.smithi052.stdout:6/267: chown da/d22/d29/d31/f3a 9177644 1 2024-04-26T12:06:55.508 INFO:tasks.workunit.client.0.smithi052.stdout:8/233: creat d0/f44 x:0 0 0 2024-04-26T12:06:55.509 INFO:tasks.workunit.client.0.smithi052.stdout:1/265: rename d0/d2/dd/d2c to d0/d2/de/d4b/d60 0 2024-04-26T12:06:55.509 INFO:tasks.workunit.client.0.smithi052.stdout:3/268: chown d2/d4/dc/d1d/d25/d36 1793192 1 2024-04-26T12:06:55.511 INFO:tasks.workunit.client.0.smithi052.stdout:6/268: rename da/d22/d29/l59 to da/l60 0 2024-04-26T12:06:55.511 INFO:tasks.workunit.client.0.smithi052.stdout:9/316: dwrite d3/db/d13/f29 [4194304,4194304] 0 2024-04-26T12:06:55.511 INFO:tasks.workunit.client.0.smithi052.stdout:1/266: truncate d0/f3f 1606833 0 2024-04-26T12:06:55.512 INFO:tasks.workunit.client.0.smithi052.stdout:2/331: dwrite d0/d7/d53/f61 [0,4194304] 0 2024-04-26T12:06:55.512 INFO:tasks.workunit.client.0.smithi052.stdout:4/272: dread d3/d12/f19 [0,4194304] 0 2024-04-26T12:06:55.514 INFO:tasks.workunit.client.0.smithi052.stdout:6/269: truncate da/d22/f2d 1768010 0 2024-04-26T12:06:55.515 INFO:tasks.workunit.client.0.smithi052.stdout:4/273: rename d3/d22/d30/f50 to d3/d12/d34/d45/f5e 0 2024-04-26T12:06:55.516 INFO:tasks.workunit.client.0.smithi052.stdout:1/267: creat d0/d2/dd/d1c/d1d/d23/f61 x:0 0 0 2024-04-26T12:06:55.517 INFO:tasks.workunit.client.0.smithi052.stdout:4/274: chown d3/d22/f4e 89 1 2024-04-26T12:06:55.517 INFO:tasks.workunit.client.0.smithi052.stdout:3/269: dread d2/d4/dc/f1b [0,4194304] 0 2024-04-26T12:06:55.519 INFO:tasks.workunit.client.0.smithi052.stdout:4/275: chown d3/d12/d34/d43/f5d 345102010 1 2024-04-26T12:06:55.519 INFO:tasks.workunit.client.0.smithi052.stdout:2/332: write d0/d7/d2f/d4c/f60 [129968,44083] 0 2024-04-26T12:06:55.520 INFO:tasks.workunit.client.0.smithi052.stdout:8/234: truncate d0/d4/d5/f8 7599364 0 2024-04-26T12:06:55.520 INFO:tasks.workunit.client.0.smithi052.stdout:9/317: mknod d3/db/d10/d2e/d5c/c66 0 2024-04-26T12:06:55.520 INFO:tasks.workunit.client.0.smithi052.stdout:9/318: dread - d3/db/d2b/f61 zero size 2024-04-26T12:06:55.520 INFO:tasks.workunit.client.0.smithi052.stdout:1/268: symlink d0/da/l62 0 2024-04-26T12:06:55.520 INFO:tasks.workunit.client.0.smithi052.stdout:3/270: write d2/d4/f21 [3010106,78610] 0 2024-04-26T12:06:55.521 INFO:tasks.workunit.client.0.smithi052.stdout:8/235: dread d0/f2 [0,4194304] 0 2024-04-26T12:06:55.521 INFO:tasks.workunit.client.0.smithi052.stdout:4/276: write d3/d12/d34/d45/f5e [748383,50941] 0 2024-04-26T12:06:55.522 INFO:tasks.workunit.client.0.smithi052.stdout:9/319: write d3/db/d10/d55/f57 [1924639,6812] 0 2024-04-26T12:06:55.522 INFO:tasks.workunit.client.0.smithi052.stdout:0/319: dread d0/d1/f24 [0,4194304] 0 2024-04-26T12:06:55.522 INFO:tasks.workunit.client.0.smithi052.stdout:3/271: chown d2/d4/dc/c26 189514364 1 2024-04-26T12:06:55.522 INFO:tasks.workunit.client.0.smithi052.stdout:1/269: rename d0/d2/dd/d1c/d1d/d23/f30 to d0/da/d3a/f63 0 2024-04-26T12:06:55.522 INFO:tasks.workunit.client.0.smithi052.stdout:1/270: dread - d0/f55 zero size 2024-04-26T12:06:55.522 INFO:tasks.workunit.client.0.smithi052.stdout:8/236: write d0/d4/f17 [855884,65909] 0 2024-04-26T12:06:55.523 INFO:tasks.workunit.client.0.smithi052.stdout:9/320: rename d3/l5 to d3/d1b/l67 0 2024-04-26T12:06:55.523 INFO:tasks.workunit.client.0.smithi052.stdout:0/320: chown d0/d1/d2c/c2f 24 1 2024-04-26T12:06:55.523 INFO:tasks.workunit.client.0.smithi052.stdout:3/272: readlink d2/d4/dc/d1d/d25/d36/d1c/l30 0 2024-04-26T12:06:55.523 INFO:tasks.workunit.client.0.smithi052.stdout:8/237: mkdir d0/d4/dc/d45 0 2024-04-26T12:06:55.525 INFO:tasks.workunit.client.0.smithi052.stdout:0/321: mkdir d0/d1/d1a/d2a/d4f/d67 0 2024-04-26T12:06:55.525 INFO:tasks.workunit.client.0.smithi052.stdout:8/238: chown d0/d3e/f42 4710 1 2024-04-26T12:06:55.527 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:06:55.529 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:536 3.2 3:4272d415:::200.0000000b:head [write 405817~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.0023316929999999, 2024-04-26T12:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053030282999999998, 2024-04-26T12:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524136+0000", 2024-04-26T12:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524139+0000", 2024-04-26T12:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2919999999999998e-06 2024-04-26T12:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524144+0000", 2024-04-26T12:06:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.502e-06 2024-04-26T12:06:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524149+0000", 2024-04-26T12:06:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7310000000000001e-06 2024-04-26T12:06:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570935+0000", 2024-04-26T12:06:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.046785603000000002 2024-04-26T12:06:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570981+0000", 2024-04-26T12:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6085999999999999e-05 2024-04-26T12:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577039+0000", 2024-04-26T12:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060582099999999996 2024-04-26T12:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577081+0000", 2024-04-26T12:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1927e-05 2024-04-26T12:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577167+0000", 2024-04-26T12:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6311999999999996e-05 2024-04-26T12:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:537 3.2 3:4272d415:::200.0000000b:head [write 407216~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.0023157549999999, 2024-04-26T12:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053131411000000003, 2024-04-26T12:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524152+0000", 2024-04-26T12:06:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524157+0000", 2024-04-26T12:06:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3529999999999997e-06 2024-04-26T12:06:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524162+0000", 2024-04-26T12:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5910000000000003e-06 2024-04-26T12:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524170+0000", 2024-04-26T12:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571323+0000", 2024-04-26T12:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047153289000000001 2024-04-26T12:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571367+0000", 2024-04-26T12:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4205000000000001e-05 2024-04-26T12:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577174+0000", 2024-04-26T12:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058072250000000001 2024-04-26T12:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577218+0000", 2024-04-26T12:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3294999999999998e-05 2024-04-26T12:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577284+0000", 2024-04-26T12:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6483999999999996e-05 2024-04-26T12:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:538 3.2 3:4272d415:::200.0000000b:head [write 408629~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.002295055, 2024-04-26T12:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053241841999999998, 2024-04-26T12:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524178+0000", 2024-04-26T12:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1420000000000001e-06 2024-04-26T12:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524184+0000", 2024-04-26T12:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4240000000000001e-06 2024-04-26T12:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524188+0000", 2024-04-26T12:06:55.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2710000000000003e-06 2024-04-26T12:06:55.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571623+0000", 2024-04-26T12:06:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047435119999999997 2024-04-26T12:06:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571668+0000", 2024-04-26T12:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5377000000000003e-05 2024-04-26T12:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577292+0000", 2024-04-26T12:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0056232030000000002 2024-04-26T12:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577330+0000", 2024-04-26T12:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8748999999999998e-05 2024-04-26T12:06:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577415+0000", 2024-04-26T12:06:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4913000000000005e-05 2024-04-26T12:06:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:539 3.2 3:4272d415:::200.0000000b:head [write 410547~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:06:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.0022769229999999, 2024-04-26T12:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053372670999999997, 2024-04-26T12:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524191+0000", 2024-04-26T12:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524199+0000", 2024-04-26T12:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6520000000000006e-06 2024-04-26T12:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524205+0000", 2024-04-26T12:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524209+0000", 2024-04-26T12:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.335e-06 2024-04-26T12:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572320+0000", 2024-04-26T12:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048110992999999998 2024-04-26T12:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572364+0000", 2024-04-26T12:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4577999999999999e-05 2024-04-26T12:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577426+0000", 2024-04-26T12:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050615139999999996 2024-04-26T12:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577480+0000", 2024-04-26T12:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3599e-05 2024-04-26T12:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577564+0000", 2024-04-26T12:06:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4699999999999999e-05 2024-04-26T12:06:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:540 3.2 3:4272d415:::200.0000000b:head [write 411948~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:06:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.0022559049999999, 2024-04-26T12:06:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053497045999999999, 2024-04-26T12:06:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524212+0000", 2024-04-26T12:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524215+0000", 2024-04-26T12:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.559e-06 2024-04-26T12:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524220+0000", 2024-04-26T12:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2920000000000003e-06 2024-04-26T12:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524224+0000", 2024-04-26T12:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3680000000000004e-06 2024-04-26T12:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572619+0000", 2024-04-26T12:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048394549000000002 2024-04-26T12:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572669+0000", 2024-04-26T12:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0249e-05 2024-04-26T12:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577575+0000", 2024-04-26T12:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049053329999999996 2024-04-26T12:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577625+0000", 2024-04-26T12:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0274e-05 2024-04-26T12:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577710+0000", 2024-04-26T12:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4741999999999996e-05 2024-04-26T12:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:543 3.2 3:4272d415:::200.0000000b:head [write 413907~2485 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.0021862109999999, 2024-04-26T12:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053578708000000003, 2024-04-26T12:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524287+0000", 2024-04-26T12:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2190000000000003e-06 2024-04-26T12:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524294+0000", 2024-04-26T12:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5660000000000003e-06 2024-04-26T12:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524298+0000", 2024-04-26T12:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3900000000000003e-06 2024-04-26T12:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572992+0000", 2024-04-26T12:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048693835999999997 2024-04-26T12:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573045+0000", 2024-04-26T12:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2793000000000001e-05 2024-04-26T12:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577721+0000", 2024-04-26T12:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046760550000000001 2024-04-26T12:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577777+0000", 2024-04-26T12:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5908000000000001e-05 2024-04-26T12:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577861+0000", 2024-04-26T12:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4337000000000002e-05 2024-04-26T12:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:544 3.2 3:4272d415:::200.0000000b:head [write 416392~3872 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.0021664889999999, 2024-04-26T12:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054810527999999997, 2024-04-26T12:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524307+0000", 2024-04-26T12:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1580000000000004e-06 2024-04-26T12:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524312+0000", 2024-04-26T12:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6380000000000001e-06 2024-04-26T12:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524317+0000", 2024-04-26T12:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4000000000000002e-06 2024-04-26T12:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573348+0000", 2024-04-26T12:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049031433999999999 2024-04-26T12:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573393+0000", 2024-04-26T12:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4536999999999997e-05 2024-04-26T12:06:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578978+0000", 2024-04-26T12:06:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055848299999999998 2024-04-26T12:06:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579031+0000", 2024-04-26T12:06:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3708000000000001e-05 2024-04-26T12:06:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579113+0000", 2024-04-26T12:06:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1258e-05 2024-04-26T12:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:545 3.2 3:4272d415:::200.0000000b:head [write 420264~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.002147863, 2024-04-26T12:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054927386000000002, 2024-04-26T12:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524320+0000", 2024-04-26T12:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524325+0000", 2024-04-26T12:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5249999999999999e-06 2024-04-26T12:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524330+0000", 2024-04-26T12:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5629999999999999e-06 2024-04-26T12:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524335+0000", 2024-04-26T12:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.685e-06 2024-04-26T12:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573727+0000", 2024-04-26T12:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049392034000000001 2024-04-26T12:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573775+0000", 2024-04-26T12:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7435999999999998e-05 2024-04-26T12:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579120+0000", 2024-04-26T12:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0053452949999999999 2024-04-26T12:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579167+0000", 2024-04-26T12:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7240000000000002e-05 2024-04-26T12:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579248+0000", 2024-04-26T12:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0947999999999998e-05 2024-04-26T12:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 422222~8537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.0021295459999999, 2024-04-26T12:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055065936000000003, 2024-04-26T12:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:06:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:06:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524347+0000", 2024-04-26T12:06:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7129999999999994e-06 2024-04-26T12:06:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524357+0000", 2024-04-26T12:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0232e-05 2024-04-26T12:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524362+0000", 2024-04-26T12:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574119+0000", 2024-04-26T12:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049756727000000001 2024-04-26T12:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574166+0000", 2024-04-26T12:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7086000000000003e-05 2024-04-26T12:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579261+0000", 2024-04-26T12:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050948310000000002 2024-04-26T12:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579316+0000", 2024-04-26T12:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5068000000000002e-05 2024-04-26T12:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579405+0000", 2024-04-26T12:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9251000000000003e-05 2024-04-26T12:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 430759~2035 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.0021025560000001, 2024-04-26T12:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055164950999999997, 2024-04-26T12:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524368+0000", 2024-04-26T12:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.57e-06 2024-04-26T12:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524375+0000", 2024-04-26T12:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6170000000000003e-06 2024-04-26T12:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524380+0000", 2024-04-26T12:06:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2700000000000004e-06 2024-04-26T12:06:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574639+0000", 2024-04-26T12:06:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050259459999999999 2024-04-26T12:06:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574687+0000", 2024-04-26T12:06:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7608999999999998e-05 2024-04-26T12:06:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.577 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:55.577 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579414+0000", 2024-04-26T12:06:55.577 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047268750000000002 2024-04-26T12:06:55.577 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.577 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.577 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:55.577 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579456+0000", 2024-04-26T12:06:55.577 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1885000000000003e-05 2024-04-26T12:06:55.577 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.577 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.577 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:55.577 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579531+0000", 2024-04-26T12:06:55.577 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5053000000000001e-05 2024-04-26T12:06:55.577 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.578 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:55.578 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.578 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.578 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.578 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 432794~10523 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:55.578 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:06:55.578 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.0011118320000001, 2024-04-26T12:06:55.578 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054314727, 2024-04-26T12:06:55.578 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:55.578 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.578 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:55.578 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.578 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:55.579 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:06:55.579 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.579 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.579 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.579 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:55.579 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:06:55.579 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.579 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.579 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.579 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:55.579 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525356+0000", 2024-04-26T12:06:55.579 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:55.579 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.579 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.580 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:55.580 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525414+0000", 2024-04-26T12:06:55.580 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8148e-05 2024-04-26T12:06:55.580 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.580 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.580 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:55.580 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525423+0000", 2024-04-26T12:06:55.580 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9749999999999996e-06 2024-04-26T12:06:55.580 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.580 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.580 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.580 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525428+0000", 2024-04-26T12:06:55.580 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0270000000000003e-06 2024-04-26T12:06:55.580 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574950+0000", 2024-04-26T12:06:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049521840999999997 2024-04-26T12:06:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575002+0000", 2024-04-26T12:06:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1586999999999999e-05 2024-04-26T12:06:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579543+0000", 2024-04-26T12:06:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045416340000000001 2024-04-26T12:06:55.582 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.582 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.582 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:55.582 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579587+0000", 2024-04-26T12:06:55.582 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3875999999999998e-05 2024-04-26T12:06:55.582 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.582 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.582 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:55.582 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579671+0000", 2024-04-26T12:06:55.582 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4351999999999995e-05 2024-04-26T12:06:55.582 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.582 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:55.583 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.583 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.583 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.583 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 443317~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:55.583 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:06:55.583 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.001035857, 2024-04-26T12:06:55.583 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054381889000000003, 2024-04-26T12:06:55.583 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:55.583 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.583 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:55.583 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.583 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:55.583 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:06:55.583 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.584 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.584 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.584 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:55.584 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:06:55.584 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.584 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.584 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.584 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:55.584 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525432+0000", 2024-04-26T12:06:55.584 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:55.584 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.584 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.584 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:55.584 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525435+0000", 2024-04-26T12:06:55.585 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3070000000000001e-06 2024-04-26T12:06:55.585 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.585 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.585 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:55.585 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525439+0000", 2024-04-26T12:06:55.585 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.104e-06 2024-04-26T12:06:55.585 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.585 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.585 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.585 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525442+0000", 2024-04-26T12:06:55.585 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0460000000000001e-06 2024-04-26T12:06:55.585 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.585 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.586 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:55.586 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575405+0000", 2024-04-26T12:06:55.586 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049963059999999997 2024-04-26T12:06:55.586 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.586 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.586 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:55.586 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575450+0000", 2024-04-26T12:06:55.586 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5034000000000003e-05 2024-04-26T12:06:55.586 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.586 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.586 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:55.586 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579680+0000", 2024-04-26T12:06:55.586 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042302260000000001 2024-04-26T12:06:55.586 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579737+0000", 2024-04-26T12:06:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7241000000000003e-05 2024-04-26T12:06:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579815+0000", 2024-04-26T12:06:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7278000000000001e-05 2024-04-26T12:06:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 445275~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:06:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.0006086810000001, 2024-04-26T12:06:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054094668999999998, 2024-04-26T12:06:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:06:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:06:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525859+0000", 2024-04-26T12:06:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525864+0000", 2024-04-26T12:06:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:06:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525872+0000", 2024-04-26T12:06:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6790000000000005e-06 2024-04-26T12:06:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525877+0000", 2024-04-26T12:06:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0529999999999997e-06 2024-04-26T12:06:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575723+0000", 2024-04-26T12:06:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049846469999999997 2024-04-26T12:06:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575770+0000", 2024-04-26T12:06:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6387999999999997e-05 2024-04-26T12:06:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579823+0000", 2024-04-26T12:06:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0040534189999999999 2024-04-26T12:06:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579869+0000", 2024-04-26T12:06:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6218999999999999e-05 2024-04-26T12:06:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:55.592 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579954+0000", 2024-04-26T12:06:55.592 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5315999999999994e-05 2024-04-26T12:06:55.592 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.592 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:55.592 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.592 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.592 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.592 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:551 3.2 3:4272d415:::200.0000000b:head [write 448232~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:55.592 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:06:55.592 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.0001612470000001, 2024-04-26T12:06:55.592 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053798273000000001, 2024-04-26T12:06:55.592 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:55.592 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.592 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:06:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:06:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:06:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:55.594 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.594 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.594 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:55.594 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526310+0000", 2024-04-26T12:06:55.594 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5279999999999999e-06 2024-04-26T12:06:55.594 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.594 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.594 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:55.594 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526317+0000", 2024-04-26T12:06:55.594 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8430000000000004e-06 2024-04-26T12:06:55.594 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.594 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.594 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.594 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526322+0000", 2024-04-26T12:06:55.595 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3340000000000001e-06 2024-04-26T12:06:55.595 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.595 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.595 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:55.595 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576135+0000", 2024-04-26T12:06:55.595 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049812113999999998 2024-04-26T12:06:55.595 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.595 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.595 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:55.595 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576186+0000", 2024-04-26T12:06:55.595 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1443999999999997e-05 2024-04-26T12:06:55.598 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.598 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.598 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:55.598 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579962+0000", 2024-04-26T12:06:55.598 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037763359999999999 2024-04-26T12:06:55.598 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.598 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.599 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:55.599 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580016+0000", 2024-04-26T12:06:55.599 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3421000000000002e-05 2024-04-26T12:06:55.599 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.599 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.599 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:55.599 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580106+0000", 2024-04-26T12:06:55.599 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9790000000000006e-05 2024-04-26T12:06:55.599 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.599 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:55.599 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.599 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.599 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.600 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 450189~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:55.600 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:06:55.600 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.000081118, 2024-04-26T12:06:55.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055070796999999998, 2024-04-26T12:06:55.600 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:55.600 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.600 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:55.600 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.600 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:55.600 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:06:55.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.600 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.601 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.601 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:55.601 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:06:55.601 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.601 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.601 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.601 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:55.601 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:06:55.601 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:55.601 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.601 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.601 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:55.601 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526390+0000", 2024-04-26T12:06:55.601 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8559999999999998e-06 2024-04-26T12:06:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526395+0000", 2024-04-26T12:06:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3319999999999999e-06 2024-04-26T12:06:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526399+0000", 2024-04-26T12:06:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.619e-06 2024-04-26T12:06:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576476+0000", 2024-04-26T12:06:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050077643999999998 2024-04-26T12:06:55.603 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.603 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.603 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:55.603 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576524+0000", 2024-04-26T12:06:55.603 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7184000000000001e-05 2024-04-26T12:06:55.603 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.603 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.603 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:55.603 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581347+0000", 2024-04-26T12:06:55.603 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0048231919999999996 2024-04-26T12:06:55.603 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.603 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.603 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:55.603 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581398+0000", 2024-04-26T12:06:55.604 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1345999999999999e-05 2024-04-26T12:06:55.604 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.604 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.604 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:55.604 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581458+0000", 2024-04-26T12:06:55.604 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0081000000000003e-05 2024-04-26T12:06:55.604 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.604 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:55.604 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.604 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.604 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.604 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 452113~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:55.604 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:06:55.604 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.99996990200000002, 2024-04-26T12:06:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055041448, 2024-04-26T12:06:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:06:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:06:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:55.606 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526498+0000", 2024-04-26T12:06:55.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:55.606 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.606 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:55.606 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526540+0000", 2024-04-26T12:06:55.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2267e-05 2024-04-26T12:06:55.606 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.606 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:55.606 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526547+0000", 2024-04-26T12:06:55.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7000000000000002e-06 2024-04-26T12:06:55.606 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.607 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.607 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.607 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526550+0000", 2024-04-26T12:06:55.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0299999999999998e-06 2024-04-26T12:06:55.607 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.607 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.607 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:55.607 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577902+0000", 2024-04-26T12:06:55.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051351648999999999 2024-04-26T12:06:55.607 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.607 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.607 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:55.607 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577953+0000", 2024-04-26T12:06:55.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1289000000000003e-05 2024-04-26T12:06:55.607 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.608 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.608 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:55.608 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581464+0000", 2024-04-26T12:06:55.608 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035111259999999998 2024-04-26T12:06:55.608 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.608 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.608 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:55.608 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581490+0000", 2024-04-26T12:06:55.608 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5717000000000001e-05 2024-04-26T12:06:55.608 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.608 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.608 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:55.608 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581540+0000", 2024-04-26T12:06:55.608 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0287999999999997e-05 2024-04-26T12:06:55.608 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.609 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:55.609 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.609 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.609 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.609 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 454070~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:55.609 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:06:55.609 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.99941295299999999, 2024-04-26T12:06:55.609 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054564161, 2024-04-26T12:06:55.609 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:55.609 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.609 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:55.609 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.609 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:55.609 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:06:55.609 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.610 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.610 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.610 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:55.610 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:06:55.610 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.610 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.610 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.610 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:55.610 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527055+0000", 2024-04-26T12:06:55.610 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:55.610 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.610 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.610 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:55.610 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527058+0000", 2024-04-26T12:06:55.610 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9890000000000001e-06 2024-04-26T12:06:55.611 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.611 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.611 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:55.611 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527066+0000", 2024-04-26T12:06:55.611 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4730000000000003e-06 2024-04-26T12:06:55.611 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.611 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.611 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.611 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527069+0000", 2024-04-26T12:06:55.611 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5810000000000001e-06 2024-04-26T12:06:55.611 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.611 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.611 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:55.611 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578308+0000", 2024-04-26T12:06:55.611 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051238911999999998 2024-04-26T12:06:55.612 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.612 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.612 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:55.612 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578391+0000", 2024-04-26T12:06:55.612 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2713999999999994e-05 2024-04-26T12:06:55.612 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.612 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.612 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:55.612 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581548+0000", 2024-04-26T12:06:55.612 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031577530000000001 2024-04-26T12:06:55.612 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.612 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.612 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:55.612 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581574+0000", 2024-04-26T12:06:55.612 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5350999999999998e-05 2024-04-26T12:06:55.612 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.613 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.613 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:55.613 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581620+0000", 2024-04-26T12:06:55.613 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5868999999999997e-05 2024-04-26T12:06:55.613 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.613 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:55.613 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.613 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.613 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.613 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 456028~3870 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:55.613 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:06:55.613 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.99765671099999997, 2024-04-26T12:06:55.613 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055118997000000003, 2024-04-26T12:06:55.613 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:55.613 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.614 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:55.614 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.614 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:55.614 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:06:55.614 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.614 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.614 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.614 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:55.614 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:06:55.614 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.614 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.614 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.614 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:55.615 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528811+0000", 2024-04-26T12:06:55.615 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:55.615 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.615 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.615 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:55.615 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528887+0000", 2024-04-26T12:06:55.615 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5977999999999997e-05 2024-04-26T12:06:55.615 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.615 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.615 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:55.615 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528897+0000", 2024-04-26T12:06:55.615 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8730000000000002e-06 2024-04-26T12:06:55.615 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.615 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.615 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.616 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528901+0000", 2024-04-26T12:06:55.616 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4880000000000001e-06 2024-04-26T12:06:55.616 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.616 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.616 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:55.616 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580146+0000", 2024-04-26T12:06:55.616 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051244242000000002 2024-04-26T12:06:55.616 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.616 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.616 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:55.616 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580227+0000", 2024-04-26T12:06:55.616 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1044000000000005e-05 2024-04-26T12:06:55.616 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.616 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.616 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:55.617 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583864+0000", 2024-04-26T12:06:55.617 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036374419999999998 2024-04-26T12:06:55.617 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.617 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.617 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:55.617 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583894+0000", 2024-04-26T12:06:55.617 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9828999999999999e-05 2024-04-26T12:06:55.617 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.617 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.617 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:55.617 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583931+0000", 2024-04-26T12:06:55.617 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6908e-05 2024-04-26T12:06:55.617 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.617 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:55.618 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.618 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.618 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.618 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 459898~2037 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:55.618 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:06:55.618 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.99726872, 2024-04-26T12:06:55.618 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055925713000000002, 2024-04-26T12:06:55.618 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:55.618 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.618 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:55.618 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.618 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:55.619 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:06:55.619 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.619 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.619 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.619 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:55.619 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:06:55.619 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.619 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.619 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.619 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:55.619 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529199+0000", 2024-04-26T12:06:55.619 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:55.619 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.619 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.620 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:55.620 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529203+0000", 2024-04-26T12:06:55.620 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:06:55.620 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.620 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.620 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:55.620 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529209+0000", 2024-04-26T12:06:55.620 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7939999999999999e-06 2024-04-26T12:06:55.620 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.620 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.620 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.620 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529212+0000", 2024-04-26T12:06:55.620 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7290000000000002e-06 2024-04-26T12:06:55.620 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.621 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.621 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:55.621 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580784+0000", 2024-04-26T12:06:55.621 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051572073000000003 2024-04-26T12:06:55.621 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.621 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.621 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:55.621 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580883+0000", 2024-04-26T12:06:55.621 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8330000000000002e-05 2024-04-26T12:06:55.621 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.621 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.621 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:55.621 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585050+0000", 2024-04-26T12:06:55.621 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041670209999999999 2024-04-26T12:06:55.621 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.622 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.622 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:55.622 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585088+0000", 2024-04-26T12:06:55.622 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8559999999999997e-05 2024-04-26T12:06:55.622 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.622 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.622 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:55.622 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585125+0000", 2024-04-26T12:06:55.622 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7197999999999999e-05 2024-04-26T12:06:55.622 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.622 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:55.622 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.622 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.622 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.623 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 461935~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:55.623 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:06:55.623 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.99654626599999996, 2024-04-26T12:06:55.623 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055266150999999999, 2024-04-26T12:06:55.623 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:55.623 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:55.623 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:55.623 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.623 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:55.623 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:06:55.623 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.623 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.623 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.623 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:55.623 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:06:55.624 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:55.624 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.624 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.624 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:55.624 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529921+0000", 2024-04-26T12:06:55.624 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:55.624 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.624 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.624 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:55.624 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529956+0000", 2024-04-26T12:06:55.624 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4687000000000002e-05 2024-04-26T12:06:55.624 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.624 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.624 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:55.625 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529966+0000", 2024-04-26T12:06:55.625 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0392e-05 2024-04-26T12:06:55.625 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.625 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.625 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.625 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529978+0000", 2024-04-26T12:06:55.625 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1348e-05 2024-04-26T12:06:55.625 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.625 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.625 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:55.625 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581659+0000", 2024-04-26T12:06:55.625 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051681454000000002 2024-04-26T12:06:55.625 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.625 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.625 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:55.626 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581746+0000", 2024-04-26T12:06:55.626 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6305999999999997e-05 2024-04-26T12:06:55.626 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.626 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.626 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:55.626 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585131+0000", 2024-04-26T12:06:55.626 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033853199999999998 2024-04-26T12:06:55.626 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.626 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.626 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:55.626 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585154+0000", 2024-04-26T12:06:55.626 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3258999999999999e-05 2024-04-26T12:06:55.626 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:55.626 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:55.627 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:55.627 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585188+0000", 2024-04-26T12:06:55.627 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4236000000000002e-05 2024-04-26T12:06:55.627 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.627 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:55.627 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.627 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:55.627 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:55.627 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:55.628 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:55.627+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:55.629 INFO:tasks.workunit.client.0.smithi052.stdout:3/273: getdents d2/d4/dc/d1d/d25/d36/d1c/d4e 0 2024-04-26T12:06:55.629 INFO:tasks.workunit.client.0.smithi052.stdout:0/322: mknod d0/d1/d11/c68 0 2024-04-26T12:06:55.630 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:55.644 INFO:tasks.workunit.client.0.smithi052.stdout:8/239: read - d0/d16/d28/f32 zero size 2024-04-26T12:06:55.644 INFO:tasks.workunit.client.0.smithi052.stdout:7/253: dread d1/d1f/f22 [0,4194304] 0 2024-04-26T12:06:55.644 INFO:tasks.workunit.client.0.smithi052.stdout:5/281: dread db/dc/f12 [0,4194304] 0 2024-04-26T12:06:55.644 INFO:tasks.workunit.client.0.smithi052.stdout:4/277: dwrite d3/d22/f52 [0,4194304] 0 2024-04-26T12:06:55.644 INFO:tasks.workunit.client.0.smithi052.stdout:3/274: chown d2/f29 2 1 2024-04-26T12:06:55.644 INFO:tasks.workunit.client.0.smithi052.stdout:8/240: fdatasync d0/d4/dc/f3d 0 2024-04-26T12:06:55.644 INFO:tasks.workunit.client.0.smithi052.stdout:2/333: dwrite d0/d7/d16/f38 [0,4194304] 0 2024-04-26T12:06:55.644 INFO:tasks.workunit.client.0.smithi052.stdout:5/282: fsync db/dc/f12 0 2024-04-26T12:06:55.645 INFO:tasks.workunit.client.0.smithi052.stdout:8/241: chown d0/d4/d1c/c39 59441 1 2024-04-26T12:06:55.645 INFO:tasks.workunit.client.0.smithi052.stdout:1/271: dwrite d0/d2/f6 [0,4194304] 0 2024-04-26T12:06:55.645 INFO:tasks.workunit.client.0.smithi052.stdout:9/321: dwrite d3/db/d10/f38 [0,4194304] 0 2024-04-26T12:06:55.645 INFO:tasks.workunit.client.0.smithi052.stdout:8/242: fsync d0/f1f 0 2024-04-26T12:06:55.645 INFO:tasks.workunit.client.0.smithi052.stdout:1/272: dread - d0/da/d3a/f46 zero size 2024-04-26T12:06:55.645 INFO:tasks.workunit.client.0.smithi052.stdout:6/270: dread da/f37 [0,4194304] 0 2024-04-26T12:06:55.645 INFO:tasks.workunit.client.0.smithi052.stdout:0/323: dread d0/f3 [4194304,4194304] 0 2024-04-26T12:06:55.645 INFO:tasks.workunit.client.0.smithi052.stdout:4/278: symlink d3/d12/d34/d45/l5f 0 2024-04-26T12:06:55.645 INFO:tasks.workunit.client.0.smithi052.stdout:1/273: creat d0/f64 x:0 0 0 2024-04-26T12:06:55.645 INFO:tasks.workunit.client.0.smithi052.stdout:7/254: creat d1/d1c/d21/d2f/f54 x:0 0 0 2024-04-26T12:06:55.645 INFO:tasks.workunit.client.0.smithi052.stdout:9/322: creat d3/db/d2b/f68 x:0 0 0 2024-04-26T12:06:55.645 INFO:tasks.workunit.client.0.smithi052.stdout:8/243: creat d0/d16/f46 x:0 0 0 2024-04-26T12:06:55.645 INFO:tasks.workunit.client.0.smithi052.stdout:6/271: mkdir da/d22/d29/d61 0 2024-04-26T12:06:55.645 INFO:tasks.workunit.client.0.smithi052.stdout:2/334: creat d0/d7/d2f/d4a/d5a/f69 x:0 0 0 2024-04-26T12:06:55.645 INFO:tasks.workunit.client.0.smithi052.stdout:0/324: creat d0/d1/d11/f69 x:0 0 0 2024-04-26T12:06:55.645 INFO:tasks.workunit.client.0.smithi052.stdout:1/274: dread - d0/f55 zero size 2024-04-26T12:06:55.646 INFO:tasks.workunit.client.0.smithi052.stdout:7/255: mkdir d1/d1f/d55 0 2024-04-26T12:06:55.646 INFO:tasks.workunit.client.0.smithi052.stdout:4/279: unlink d3/d12/f13 0 2024-04-26T12:06:55.646 INFO:tasks.workunit.client.0.smithi052.stdout:5/283: mkdir db/dd/d18/d60 0 2024-04-26T12:06:55.646 INFO:tasks.workunit.client.0.smithi052.stdout:2/335: write d0/d7/d2f/d4c/f60 [902615,13709] 0 2024-04-26T12:06:55.646 INFO:tasks.workunit.client.0.smithi052.stdout:0/325: unlink d0/d1/d2c/c35 0 2024-04-26T12:06:55.646 INFO:tasks.workunit.client.0.smithi052.stdout:1/275: read - d0/d2/dd/d34/f4e zero size 2024-04-26T12:06:55.646 INFO:tasks.workunit.client.0.smithi052.stdout:8/244: mknod d0/d4/d5/db/c47 0 2024-04-26T12:06:55.646 INFO:tasks.workunit.client.0.smithi052.stdout:7/256: write d1/d1f/f26 [3301914,76900] 0 2024-04-26T12:06:55.646 INFO:tasks.workunit.client.0.smithi052.stdout:1/276: unlink d0/d1e/f29 0 2024-04-26T12:06:55.646 INFO:tasks.workunit.client.0.smithi052.stdout:5/284: truncate db/dd/f27 4503224 0 2024-04-26T12:06:55.646 INFO:tasks.workunit.client.0.smithi052.stdout:4/280: creat d3/d12/d59/f60 x:0 0 0 2024-04-26T12:06:55.646 INFO:tasks.workunit.client.0.smithi052.stdout:4/281: fdatasync d3/d2b/f3e 0 2024-04-26T12:06:55.646 INFO:tasks.workunit.client.0.smithi052.stdout:7/257: read - d1/d1c/d21/f53 zero size 2024-04-26T12:06:55.646 INFO:tasks.workunit.client.0.smithi052.stdout:7/258: fdatasync d1/d1c/d21/d2f/f48 0 2024-04-26T12:06:55.646 INFO:tasks.workunit.client.0.smithi052.stdout:8/245: getdents d0/d4/d5/db/d1b 0 2024-04-26T12:06:55.647 INFO:tasks.workunit.client.0.smithi052.stdout:1/277: unlink d0/d2/dd/d1c/d1d/l5c 0 2024-04-26T12:06:55.647 INFO:tasks.workunit.client.0.smithi052.stdout:6/272: dwrite da/d22/d29/f4c [0,4194304] 0 2024-04-26T12:06:55.647 INFO:tasks.workunit.client.0.smithi052.stdout:9/323: dwrite d3/db/d10/d3c/d40/f42 [0,4194304] 0 2024-04-26T12:06:55.647 INFO:tasks.workunit.client.0.smithi052.stdout:8/246: creat d0/d16/d28/f48 x:0 0 0 2024-04-26T12:06:55.647 INFO:tasks.workunit.client.0.smithi052.stdout:3/275: dread d2/d4/f21 [0,4194304] 0 2024-04-26T12:06:55.647 INFO:tasks.workunit.client.0.smithi052.stdout:6/273: creat da/d51/f62 x:0 0 0 2024-04-26T12:06:55.647 INFO:tasks.workunit.client.0.smithi052.stdout:3/276: chown d2/d4/c48 548 1 2024-04-26T12:06:55.647 INFO:tasks.workunit.client.0.smithi052.stdout:6/274: write da/d22/f24 [346103,115852] 0 2024-04-26T12:06:55.647 INFO:tasks.workunit.client.0.smithi052.stdout:9/324: rename d3/db/d13/c16 to d3/db/c69 0 2024-04-26T12:06:55.647 INFO:tasks.workunit.client.0.smithi052.stdout:2/336: dwrite d0/f12 [0,4194304] 0 2024-04-26T12:06:55.647 INFO:tasks.workunit.client.0.smithi052.stdout:1/278: truncate d0/d2/dd/d1c/d1d/d23/f2b 399733 0 2024-04-26T12:06:55.647 INFO:tasks.workunit.client.0.smithi052.stdout:8/247: symlink d0/d16/d28/l49 0 2024-04-26T12:06:55.647 INFO:tasks.workunit.client.0.smithi052.stdout:2/337: mknod d0/d7/c6a 0 2024-04-26T12:06:55.647 INFO:tasks.workunit.client.0.smithi052.stdout:5/285: dwrite db/dc/d5f/d50/f48 [0,4194304] 0 2024-04-26T12:06:55.647 INFO:tasks.workunit.client.0.smithi052.stdout:1/279: dread d0/d2/f2a [0,4194304] 0 2024-04-26T12:06:55.648 INFO:tasks.workunit.client.0.smithi052.stdout:5/286: chown db/dd/d34/f57 0 1 2024-04-26T12:06:55.648 INFO:tasks.workunit.client.0.smithi052.stdout:1/280: chown d0/d2/dd/d34 34647 1 2024-04-26T12:06:55.648 INFO:tasks.workunit.client.0.smithi052.stdout:8/248: dwrite d0/d4/d1c/f36 [0,4194304] 0 2024-04-26T12:06:55.648 INFO:tasks.workunit.client.0.smithi052.stdout:6/275: dwrite da/d22/f27 [0,4194304] 0 2024-04-26T12:06:55.648 INFO:tasks.workunit.client.0.smithi052.stdout:8/249: dread d0/d4/d5/f11 [0,4194304] 0 2024-04-26T12:06:55.648 INFO:tasks.workunit.client.0.smithi052.stdout:1/281: mknod d0/c65 0 2024-04-26T12:06:55.648 INFO:tasks.workunit.client.0.smithi052.stdout:1/282: write d0/d2/dd/d1c/f57 [128785,29224] 0 2024-04-26T12:06:55.648 INFO:tasks.workunit.client.0.smithi052.stdout:7/259: dread d1/ff [0,4194304] 0 2024-04-26T12:06:55.648 INFO:tasks.workunit.client.0.smithi052.stdout:6/276: mkdir da/d63 0 2024-04-26T12:06:55.648 INFO:tasks.workunit.client.0.smithi052.stdout:4/282: dread d3/d2b/f3e [0,4194304] 0 2024-04-26T12:06:55.648 INFO:tasks.workunit.client.0.smithi052.stdout:0/326: truncate d0/d1/f24 284435 0 2024-04-26T12:06:55.648 INFO:tasks.workunit.client.0.smithi052.stdout:3/277: write d2/d4/dc/f47 [6115747,40662] 0 2024-04-26T12:06:55.648 INFO:tasks.workunit.client.0.smithi052.stdout:2/338: link d0/d7/f3c d0/d7/d53/f6b 0 2024-04-26T12:06:55.648 INFO:tasks.workunit.client.0.smithi052.stdout:9/325: link d3/db/d24/c62 d3/db/d10/d54/c6a 0 2024-04-26T12:06:55.649 INFO:tasks.workunit.client.0.smithi052.stdout:5/287: truncate f1 5301824 0 2024-04-26T12:06:55.649 INFO:tasks.workunit.client.0.smithi052.stdout:7/260: unlink d1/d1c/d21/f2b 0 2024-04-26T12:06:55.649 INFO:tasks.workunit.client.0.smithi052.stdout:2/339: fsync d0/d36/f45 0 2024-04-26T12:06:55.649 INFO:tasks.workunit.client.0.smithi052.stdout:8/250: link d0/f29 d0/d3e/f4a 0 2024-04-26T12:06:55.649 INFO:tasks.workunit.client.0.smithi052.stdout:5/288: fsync db/dc/f54 0 2024-04-26T12:06:55.649 INFO:tasks.workunit.client.0.smithi052.stdout:6/277: write da/ff [6438680,125304] 0 2024-04-26T12:06:55.649 INFO:tasks.workunit.client.0.smithi052.stdout:4/283: creat d3/d12/d34/d45/f61 x:0 0 0 2024-04-26T12:06:55.649 INFO:tasks.workunit.client.0.smithi052.stdout:0/327: mknod d0/d1/c6a 0 2024-04-26T12:06:55.649 INFO:tasks.workunit.client.0.smithi052.stdout:4/284: readlink l0 0 2024-04-26T12:06:55.649 INFO:tasks.workunit.client.0.smithi052.stdout:1/283: creat d0/d2/dd/d34/f66 x:0 0 0 2024-04-26T12:06:55.649 INFO:tasks.workunit.client.0.smithi052.stdout:8/251: rename d0 to d0/d4b 22 2024-04-26T12:06:55.649 INFO:tasks.workunit.client.0.smithi052.stdout:5/289: fdatasync db/dd/f27 0 2024-04-26T12:06:55.649 INFO:tasks.workunit.client.0.smithi052.stdout:4/285: chown d3/d1f/d21 22 1 2024-04-26T12:06:55.649 INFO:tasks.workunit.client.0.smithi052.stdout:3/278: creat d2/d4/dc/d1d/d25/d36/d1c/d4e/f52 x:0 0 0 2024-04-26T12:06:55.650 INFO:tasks.workunit.client.0.smithi052.stdout:2/340: symlink d0/d7/d2f/d5f/d4b/l6c 0 2024-04-26T12:06:55.650 INFO:tasks.workunit.client.0.smithi052.stdout:6/278: dread da/f43 [0,4194304] 0 2024-04-26T12:06:55.650 INFO:tasks.workunit.client.0.smithi052.stdout:4/286: dread - d3/d12/d59/f60 zero size 2024-04-26T12:06:55.650 INFO:tasks.workunit.client.0.smithi052.stdout:6/279: mkdir da/d5d/d64 0 2024-04-26T12:06:55.650 INFO:tasks.workunit.client.0.smithi052.stdout:4/287: symlink d3/d44/l62 0 2024-04-26T12:06:55.650 INFO:tasks.workunit.client.0.smithi052.stdout:3/279: chown d2/d4/dc/d1d/d25/d36/d1c/d4e/f52 98 1 2024-04-26T12:06:55.650 INFO:tasks.workunit.client.0.smithi052.stdout:5/290: dread db/dc/d5f/d3f/f58 [0,4194304] 0 2024-04-26T12:06:55.650 INFO:tasks.workunit.client.0.smithi052.stdout:2/341: truncate d0/d7/d2f/d4a/d5a/f69 1026452 0 2024-04-26T12:06:55.650 INFO:tasks.workunit.client.0.smithi052.stdout:9/326: dwrite d3/db/d10/d55/f5d [0,4194304] 0 2024-04-26T12:06:55.650 INFO:tasks.workunit.client.0.smithi052.stdout:7/261: dwrite d1/d1c/d23/f2c [0,4194304] 0 2024-04-26T12:06:55.650 INFO:tasks.workunit.client.0.smithi052.stdout:4/288: mknod d3/d44/d4b/c63 0 2024-04-26T12:06:55.650 INFO:tasks.workunit.client.0.smithi052.stdout:8/252: dwrite d0/d16/d28/f32 [0,4194304] 0 2024-04-26T12:06:55.650 INFO:tasks.workunit.client.0.smithi052.stdout:3/280: symlink d2/d4/dc/d33/l53 0 2024-04-26T12:06:55.650 INFO:tasks.workunit.client.0.smithi052.stdout:5/291: fsync db/dc/d5f/d3f/f58 0 2024-04-26T12:06:55.650 INFO:tasks.workunit.client.0.smithi052.stdout:2/342: rename d0/d7/d2f/d4a to d0/d3f/d56/d6d 0 2024-04-26T12:06:55.651 INFO:tasks.workunit.client.0.smithi052.stdout:4/289: mkdir d3/d12/d64 0 2024-04-26T12:06:55.651 INFO:tasks.workunit.client.0.smithi052.stdout:8/253: stat d0/d4/d1c/f2b 0 2024-04-26T12:06:55.651 INFO:tasks.workunit.client.0.smithi052.stdout:7/262: link d1/d1c/d21/d2f/d33/l43 d1/d1c/l56 0 2024-04-26T12:06:55.651 INFO:tasks.workunit.client.0.smithi052.stdout:2/343: dread - d0/d7/d16/d3a/f5e zero size 2024-04-26T12:06:55.651 INFO:tasks.workunit.client.0.smithi052.stdout:4/290: dread - d3/d22/f23 zero size 2024-04-26T12:06:55.651 INFO:tasks.workunit.client.0.smithi052.stdout:5/292: fsync db/dc/d5f/d25/f32 0 2024-04-26T12:06:55.651 INFO:tasks.workunit.client.0.smithi052.stdout:7/263: stat d1/d1c/f1e 0 2024-04-26T12:06:55.651 INFO:tasks.workunit.client.0.smithi052.stdout:8/254: write d0/d16/d28/f48 [483637,48560] 0 2024-04-26T12:06:55.651 INFO:tasks.workunit.client.0.smithi052.stdout:0/328: dread d0/d1/dd/f19 [0,4194304] 0 2024-04-26T12:06:55.651 INFO:tasks.workunit.client.0.smithi052.stdout:6/280: dwrite da/d22/d3c/f58 [0,4194304] 0 2024-04-26T12:06:55.651 INFO:tasks.workunit.client.0.smithi052.stdout:2/344: chown d0/d7/d2f/c37 9462063 1 2024-04-26T12:06:55.651 INFO:tasks.workunit.client.0.smithi052.stdout:4/291: fsync d3/d12/f1a 0 2024-04-26T12:06:55.651 INFO:tasks.workunit.client.0.smithi052.stdout:5/293: rmdir db/dc/d5f/d50 39 2024-04-26T12:06:55.651 INFO:tasks.workunit.client.0.smithi052.stdout:9/327: dwrite d3/db/d10/d3c/d40/f42 [4194304,4194304] 0 2024-04-26T12:06:55.652 INFO:tasks.workunit.client.0.smithi052.stdout:2/345: stat d0/d7/d16/d3a/f59 0 2024-04-26T12:06:55.652 INFO:tasks.workunit.client.0.smithi052.stdout:4/292: chown l0 16057693 1 2024-04-26T12:06:55.652 INFO:tasks.workunit.client.0.smithi052.stdout:6/281: mknod da/d5d/c65 0 2024-04-26T12:06:55.652 INFO:tasks.workunit.client.0.smithi052.stdout:2/346: chown d0/d3f/d56/d6d/d5a 1759072521 1 2024-04-26T12:06:55.652 INFO:tasks.workunit.client.0.smithi052.stdout:0/329: creat d0/d1/d52/f6b x:0 0 0 2024-04-26T12:06:55.652 INFO:tasks.workunit.client.0.smithi052.stdout:9/328: unlink d3/db/d24/c3f 0 2024-04-26T12:06:55.652 INFO:tasks.workunit.client.0.smithi052.stdout:3/281: dwrite d2/f2f [0,4194304] 0 2024-04-26T12:06:55.652 INFO:tasks.workunit.client.0.smithi052.stdout:5/294: mknod db/dd/d18/d60/c61 0 2024-04-26T12:06:55.653 INFO:tasks.workunit.client.0.smithi052.stdout:0/330: fdatasync d0/d1/f5c 0 2024-04-26T12:06:55.653 INFO:tasks.workunit.client.0.smithi052.stdout:4/293: rename d3/d1f/d21/l56 to d3/l65 0 2024-04-26T12:06:55.653 INFO:tasks.workunit.client.0.smithi052.stdout:6/282: creat da/d22/d3c/f66 x:0 0 0 2024-04-26T12:06:55.653 INFO:tasks.workunit.client.0.smithi052.stdout:7/264: rmdir d1/d1c 39 2024-04-26T12:06:55.653 INFO:tasks.workunit.client.0.smithi052.stdout:5/295: fdatasync db/dc/d5f/f36 0 2024-04-26T12:06:55.653 INFO:tasks.workunit.client.0.smithi052.stdout:9/329: write d3/db/f20 [2879695,37279] 0 2024-04-26T12:06:55.653 INFO:tasks.workunit.client.0.smithi052.stdout:8/255: dread d0/d4/f30 [0,4194304] 0 2024-04-26T12:06:55.653 INFO:tasks.workunit.client.0.smithi052.stdout:6/283: read - da/d22/f52 zero size 2024-04-26T12:06:55.653 INFO:tasks.workunit.client.0.smithi052.stdout:9/330: symlink d3/db/d52/l6b 0 2024-04-26T12:06:55.653 INFO:tasks.workunit.client.0.smithi052.stdout:4/294: creat d3/d1f/d21/f66 x:0 0 0 2024-04-26T12:06:55.653 INFO:tasks.workunit.client.0.smithi052.stdout:7/265: fsync d1/d1c/d23/f25 0 2024-04-26T12:06:55.654 INFO:tasks.workunit.client.0.smithi052.stdout:5/296: link db/f35 db/d5c/f62 0 2024-04-26T12:06:55.654 INFO:tasks.workunit.client.0.smithi052.stdout:4/295: mkdir d3/d12/d34/d45/d67 0 2024-04-26T12:06:55.654 INFO:tasks.workunit.client.0.smithi052.stdout:7/266: chown d1/l41 87838 1 2024-04-26T12:06:55.654 INFO:tasks.workunit.client.0.smithi052.stdout:5/297: chown db/dd/d18/c30 78314 1 2024-04-26T12:06:55.654 INFO:tasks.workunit.client.0.smithi052.stdout:5/298: rmdir db/dd 39 2024-04-26T12:06:55.654 INFO:tasks.workunit.client.0.smithi052.stdout:7/267: fsync d1/ff 0 2024-04-26T12:06:55.654 INFO:tasks.workunit.client.0.smithi052.stdout:2/347: dwrite d0/d3f/d56/d6d/d5a/f69 [0,4194304] 0 2024-04-26T12:06:55.654 INFO:tasks.workunit.client.0.smithi052.stdout:7/268: creat d1/d45/d4c/f57 x:0 0 0 2024-04-26T12:06:55.654 INFO:tasks.workunit.client.0.smithi052.stdout:6/284: dwrite da/ff [8388608,4194304] 0 2024-04-26T12:06:55.654 INFO:tasks.workunit.client.0.smithi052.stdout:7/269: mknod d1/d45/d4c/d4d/c58 0 2024-04-26T12:06:55.654 INFO:tasks.workunit.client.0.smithi052.stdout:4/296: dwrite d3/d12/d34/d45/f61 [0,4194304] 0 2024-04-26T12:06:55.654 INFO:tasks.workunit.client.0.smithi052.stdout:8/256: read d0/d4/d5/fe [205613,123650] 0 2024-04-26T12:06:55.654 INFO:tasks.workunit.client.0.smithi052.stdout:1/284: sync 2024-04-26T12:06:55.655 INFO:tasks.workunit.client.0.smithi052.stdout:9/331: sync 2024-04-26T12:06:55.655 INFO:tasks.workunit.client.0.smithi052.stdout:5/299: dread db/dc/d5f/d50/f48 [0,4194304] 0 2024-04-26T12:06:55.655 INFO:tasks.workunit.client.0.smithi052.stdout:7/270: symlink d1/l59 0 2024-04-26T12:06:55.655 INFO:tasks.workunit.client.0.smithi052.stdout:2/348: write d0/d7/d53/f6b [182683,25444] 0 2024-04-26T12:06:55.655 INFO:tasks.workunit.client.0.smithi052.stdout:8/257: write d0/d4/f38 [1758445,58499] 0 2024-04-26T12:06:55.658 INFO:tasks.workunit.client.0.smithi052.stdout:2/349: rmdir d0/d7/d16/d4d 39 2024-04-26T12:06:55.658 INFO:tasks.workunit.client.0.smithi052.stdout:9/332: rename d3/d23/l27 to d3/l6c 0 2024-04-26T12:06:55.658 INFO:tasks.workunit.client.0.smithi052.stdout:9/333: chown d3/db/c69 21 1 2024-04-26T12:06:55.658 INFO:tasks.workunit.client.0.smithi052.stdout:6/285: dwrite da/ff [12582912,4194304] 0 2024-04-26T12:06:55.658 INFO:tasks.workunit.client.0.smithi052.stdout:9/334: mknod d3/db/d10/d54/c6d 0 2024-04-26T12:06:55.658 INFO:tasks.workunit.client.0.smithi052.stdout:6/286: read - da/d22/d29/d31/f4a zero size 2024-04-26T12:06:55.658 INFO:tasks.workunit.client.0.smithi052.stdout:7/271: dwrite d1/ff [0,4194304] 0 2024-04-26T12:06:55.658 INFO:tasks.workunit.client.0.smithi052.stdout:7/272: write d1/f20 [2392033,7776] 0 2024-04-26T12:06:55.658 INFO:tasks.workunit.client.0.smithi052.stdout:6/287: chown da/d22/d29/c34 129254044 1 2024-04-26T12:06:55.658 INFO:tasks.workunit.client.0.smithi052.stdout:8/258: truncate d0/d4/f26 2159459 0 2024-04-26T12:06:55.659 INFO:tasks.workunit.client.0.smithi052.stdout:8/259: unlink d0/f2 0 2024-04-26T12:06:55.659 INFO:tasks.workunit.client.0.smithi052.stdout:7/273: write d1/d1c/d21/d2f/f38 [4365539,102476] 0 2024-04-26T12:06:55.659 INFO:tasks.workunit.client.0.smithi052.stdout:5/300: truncate db/dc/d5f/f3a 2269386 0 2024-04-26T12:06:55.659 INFO:tasks.workunit.client.0.smithi052.stdout:2/350: truncate d0/d7/d16/f40 2165336 0 2024-04-26T12:06:55.659 INFO:tasks.workunit.client.0.smithi052.stdout:8/260: dread - d0/d4/dc/f3d zero size 2024-04-26T12:06:55.659 INFO:tasks.workunit.client.0.smithi052.stdout:9/335: truncate d3/db/d13/f29 4761289 0 2024-04-26T12:06:55.659 INFO:tasks.workunit.client.0.smithi052.stdout:5/301: chown db/dc/c53 2132 1 2024-04-26T12:06:55.659 INFO:tasks.workunit.client.0.smithi052.stdout:9/336: fdatasync d3/db/d2b/f2f 0 2024-04-26T12:06:55.659 INFO:tasks.workunit.client.0.smithi052.stdout:7/274: truncate d1/d1c/d21/d2f/f54 773936 0 2024-04-26T12:06:55.659 INFO:tasks.workunit.client.0.smithi052.stdout:5/302: readlink db/l2b 0 2024-04-26T12:06:55.659 INFO:tasks.workunit.client.0.smithi052.stdout:8/261: creat d0/d4/d5/d27/f4c x:0 0 0 2024-04-26T12:06:55.659 INFO:tasks.workunit.client.0.smithi052.stdout:2/351: creat d0/d7/d53/f6e x:0 0 0 2024-04-26T12:06:55.659 INFO:tasks.workunit.client.0.smithi052.stdout:7/275: read d1/ff [2796973,10052] 0 2024-04-26T12:06:55.659 INFO:tasks.workunit.client.0.smithi052.stdout:5/303: mkdir db/dc/d5f/d63 0 2024-04-26T12:06:55.659 INFO:tasks.workunit.client.0.smithi052.stdout:8/262: write d0/d4/dc/f3d [643382,7720] 0 2024-04-26T12:06:55.660 INFO:tasks.workunit.client.0.smithi052.stdout:7/276: mknod d1/d45/d4c/d4d/c5a 0 2024-04-26T12:06:55.660 INFO:tasks.workunit.client.0.smithi052.stdout:6/288: dwrite da/d22/d3c/f5e [0,4194304] 0 2024-04-26T12:06:55.660 INFO:tasks.workunit.client.0.smithi052.stdout:5/304: write db/dc/d5f/d25/f24 [3672771,60471] 0 2024-04-26T12:06:55.660 INFO:tasks.workunit.client.0.smithi052.stdout:8/263: stat d0/d4/d5/db/l3a 0 2024-04-26T12:06:55.660 INFO:tasks.workunit.client.0.smithi052.stdout:7/277: chown d1/d45 839639088 1 2024-04-26T12:06:55.660 INFO:tasks.workunit.client.0.smithi052.stdout:6/289: write da/d22/d29/f36 [560651,42477] 0 2024-04-26T12:06:55.661 INFO:tasks.workunit.client.0.smithi052.stdout:7/278: readlink d1/l1d 0 2024-04-26T12:06:55.661 INFO:tasks.workunit.client.0.smithi052.stdout:6/290: write da/ff [3863556,55516] 0 2024-04-26T12:06:55.662 INFO:tasks.workunit.client.0.smithi052.stdout:6/291: fdatasync da/d22/f27 0 2024-04-26T12:06:55.663 INFO:tasks.workunit.client.0.smithi052.stdout:7/279: dread - d1/d1c/d21/d2f/f48 zero size 2024-04-26T12:06:55.663 INFO:tasks.workunit.client.0.smithi052.stdout:2/352: dwrite d0/d7/f31 [0,4194304] 0 2024-04-26T12:06:55.665 INFO:tasks.workunit.client.0.smithi052.stdout:5/305: truncate db/dc/d5f/d50/f48 1955948 0 2024-04-26T12:06:55.666 INFO:tasks.workunit.client.0.smithi052.stdout:8/264: dwrite d0/d16/f2a [0,4194304] 0 2024-04-26T12:06:55.666 INFO:tasks.workunit.client.0.smithi052.stdout:2/353: symlink d0/d7/d53/l6f 0 2024-04-26T12:06:55.666 INFO:tasks.workunit.client.0.smithi052.stdout:7/280: fsync d1/d1c/d21/d2f/f4e 0 2024-04-26T12:06:55.667 INFO:tasks.workunit.client.0.smithi052.stdout:0/331: sync 2024-04-26T12:06:55.667 INFO:tasks.workunit.client.0.smithi052.stdout:3/282: sync 2024-04-26T12:06:55.667 INFO:tasks.workunit.client.0.smithi052.stdout:5/306: chown db/dc/d5f/d50/c4f 95 1 2024-04-26T12:06:55.667 INFO:tasks.workunit.client.0.smithi052.stdout:1/285: sync 2024-04-26T12:06:55.667 INFO:tasks.workunit.client.0.smithi052.stdout:2/354: write d0/d7/d53/f6e [837617,38079] 0 2024-04-26T12:06:55.668 INFO:tasks.workunit.client.0.smithi052.stdout:7/281: mknod d1/d1f/c5b 0 2024-04-26T12:06:55.668 INFO:tasks.workunit.client.0.smithi052.stdout:8/265: write d0/d4/d5/f11 [2102204,62137] 0 2024-04-26T12:06:55.669 INFO:tasks.workunit.client.0.smithi052.stdout:1/286: creat d0/f67 x:0 0 0 2024-04-26T12:06:55.669 INFO:tasks.workunit.client.0.smithi052.stdout:6/292: truncate da/d22/f25 6428718 0 2024-04-26T12:06:55.669 INFO:tasks.workunit.client.0.smithi052.stdout:0/332: truncate d0/d1/d52/f6b 728151 0 2024-04-26T12:06:55.669 INFO:tasks.workunit.client.0.smithi052.stdout:3/283: creat d2/d4/d31/f54 x:0 0 0 2024-04-26T12:06:55.669 INFO:tasks.workunit.client.0.smithi052.stdout:7/282: chown d1/l5 46 1 2024-04-26T12:06:55.669 INFO:tasks.workunit.client.0.smithi052.stdout:5/307: write db/dd/d34/f57 [3792927,101182] 0 2024-04-26T12:06:55.670 INFO:tasks.workunit.client.0.smithi052.stdout:1/287: creat d0/f68 x:0 0 0 2024-04-26T12:06:55.671 INFO:tasks.workunit.client.0.smithi052.stdout:6/293: write da/d22/d3c/f58 [1772119,109133] 0 2024-04-26T12:06:55.671 INFO:tasks.workunit.client.0.smithi052.stdout:0/333: dread - d0/d26/d36/f4c zero size 2024-04-26T12:06:55.671 INFO:tasks.workunit.client.0.smithi052.stdout:7/283: dread - d1/d1c/d21/d2f/d33/d3a/f40 zero size 2024-04-26T12:06:55.671 INFO:tasks.workunit.client.0.smithi052.stdout:3/284: write d2/f29 [1091454,106214] 0 2024-04-26T12:06:55.673 INFO:tasks.workunit.client.0.smithi052.stdout:6/294: write da/f43 [1624138,23583] 0 2024-04-26T12:06:55.673 INFO:tasks.workunit.client.0.smithi052.stdout:3/285: unlink d2/d4/dc/f47 0 2024-04-26T12:06:55.674 INFO:tasks.workunit.client.0.smithi052.stdout:3/286: readlink d2/d4/dc/d1d/d25/d36/l4c 0 2024-04-26T12:06:55.675 INFO:tasks.workunit.client.0.smithi052.stdout:8/266: truncate d0/d4/d5/fe 1360876 0 2024-04-26T12:06:55.677 INFO:tasks.workunit.client.0.smithi052.stdout:3/287: mkdir d2/d4/dc/d33/d37/d55 0 2024-04-26T12:06:55.677 INFO:tasks.workunit.client.0.smithi052.stdout:7/284: link d1/c3e d1/d1c/d21/d2f/d33/d3a/c5c 0 2024-04-26T12:06:55.677 INFO:tasks.workunit.client.0.smithi052.stdout:2/355: dwrite d0/d7/d16/f24 [0,4194304] 0 2024-04-26T12:06:55.679 INFO:tasks.workunit.client.0.smithi052.stdout:8/267: link d0/d4/dc/f3d d0/d4/f4d 0 2024-04-26T12:06:55.679 INFO:tasks.workunit.client.0.smithi052.stdout:2/356: creat d0/d3f/d56/d6d/f70 x:0 0 0 2024-04-26T12:06:55.679 INFO:tasks.workunit.client.0.smithi052.stdout:7/285: rename d1/d1f/c5b to d1/c5d 0 2024-04-26T12:06:55.681 INFO:tasks.workunit.client.0.smithi052.stdout:6/295: dwrite da/d22/f47 [4194304,4194304] 0 2024-04-26T12:06:55.681 INFO:tasks.workunit.client.0.smithi052.stdout:2/357: chown d0/d7/d16/c18 14 1 2024-04-26T12:06:55.681 INFO:tasks.workunit.client.0.smithi052.stdout:8/268: rename d0/d3e/l43 to d0/d4/d5/db/l4e 0 2024-04-26T12:06:55.683 INFO:tasks.workunit.client.0.smithi052.stdout:2/358: write d0/f6 [759848,124108] 0 2024-04-26T12:06:55.685 INFO:tasks.workunit.client.0.smithi052.stdout:8/269: rename d0/f1f to d0/d16/d28/f4f 0 2024-04-26T12:06:55.685 INFO:tasks.workunit.client.0.smithi052.stdout:2/359: write d0/f6 [911918,111673] 0 2024-04-26T12:06:55.685 INFO:tasks.workunit.client.0.smithi052.stdout:3/288: dwrite d2/d4/f21 [0,4194304] 0 2024-04-26T12:06:55.687 INFO:tasks.workunit.client.0.smithi052.stdout:2/360: symlink d0/l71 0 2024-04-26T12:06:55.687 INFO:tasks.workunit.client.0.smithi052.stdout:6/296: rename da/d22/d29/d31/d39/c50 to da/d22/d29/d31/c67 0 2024-04-26T12:06:55.687 INFO:tasks.workunit.client.0.smithi052.stdout:9/337: dread d3/db/d13/f51 [4194304,4194304] 0 2024-04-26T12:06:55.688 INFO:tasks.workunit.client.0.smithi052.stdout:3/289: chown d2/d4/dc/c45 41 1 2024-04-26T12:06:55.688 INFO:tasks.workunit.client.0.smithi052.stdout:6/297: mkdir da/d5d/d64/d68 0 2024-04-26T12:06:55.688 INFO:tasks.workunit.client.0.smithi052.stdout:9/338: creat d3/db/d10/d55/f6e x:0 0 0 2024-04-26T12:06:55.689 INFO:tasks.workunit.client.0.smithi052.stdout:9/339: creat d3/d1b/f6f x:0 0 0 2024-04-26T12:06:55.691 INFO:tasks.workunit.client.0.smithi052.stdout:9/340: mknod d3/db/d10/d3c/c70 0 2024-04-26T12:06:55.691 INFO:tasks.workunit.client.0.smithi052.stdout:0/334: truncate d0/d1/d1a/f4b 7197031 0 2024-04-26T12:06:55.692 INFO:tasks.workunit.client.0.smithi052.stdout:0/335: fdatasync d0/f49 0 2024-04-26T12:06:55.692 INFO:tasks.workunit.client.0.smithi052.stdout:8/270: dwrite d0/d4/d5/db/d20/f24 [0,4194304] 0 2024-04-26T12:06:55.693 INFO:tasks.workunit.client.0.smithi052.stdout:8/271: sync 2024-04-26T12:06:55.695 INFO:tasks.workunit.client.0.smithi052.stdout:0/336: dread d0/d1/f24 [0,4194304] 0 2024-04-26T12:06:55.695 INFO:tasks.workunit.client.0.smithi052.stdout:2/361: truncate d0/d7/f10 1825876 0 2024-04-26T12:06:55.695 INFO:tasks.workunit.client.0.smithi052.stdout:8/272: write d0/d16/d28/f48 [753318,44091] 0 2024-04-26T12:06:55.695 INFO:tasks.workunit.client.0.smithi052.stdout:9/341: rename d3/db/d10/d55/f5d to d3/db/d10/d2e/f71 0 2024-04-26T12:06:55.696 INFO:tasks.workunit.client.0.smithi052.stdout:0/337: chown d0/d1/f24 54 1 2024-04-26T12:06:55.696 INFO:tasks.workunit.client.0.smithi052.stdout:8/273: readlink d0/d4/d5/db/d1b/l2d 0 2024-04-26T12:06:55.697 INFO:tasks.workunit.client.0.smithi052.stdout:4/297: dread d3/d12/f1a [0,4194304] 0 2024-04-26T12:06:55.698 INFO:tasks.workunit.client.0.smithi052.stdout:3/290: truncate d2/d4/dc/d1d/d25/f3b 5071799 0 2024-04-26T12:06:55.698 INFO:tasks.workunit.client.0.smithi052.stdout:2/362: rmdir d0/d7/d16/d4d 39 2024-04-26T12:06:55.698 INFO:tasks.workunit.client.0.smithi052.stdout:9/342: link d3/d1b/f6f d3/d1b/d49/f72 0 2024-04-26T12:06:55.699 INFO:tasks.workunit.client.0.smithi052.stdout:0/338: creat d0/d3c/f6c x:0 0 0 2024-04-26T12:06:55.699 INFO:tasks.workunit.client.0.smithi052.stdout:4/298: symlink d3/d12/d34/l68 0 2024-04-26T12:06:55.699 INFO:tasks.workunit.client.0.smithi052.stdout:8/274: unlink d0/d4/d5/db/d1b/l2d 0 2024-04-26T12:06:55.699 INFO:tasks.workunit.client.0.smithi052.stdout:2/363: unlink d0/d7/c2e 0 2024-04-26T12:06:55.700 INFO:tasks.workunit.client.0.smithi052.stdout:0/339: dread - d0/d26/d36/f63 zero size 2024-04-26T12:06:55.702 INFO:tasks.workunit.client.0.smithi052.stdout:2/364: fsync d0/d7/f39 0 2024-04-26T12:06:55.703 INFO:tasks.workunit.client.0.smithi052.stdout:0/340: unlink d0/d1/d2c/c2f 0 2024-04-26T12:06:55.703 INFO:tasks.workunit.client.0.smithi052.stdout:9/343: link d3/c3d d3/d1b/d49/c73 0 2024-04-26T12:06:55.704 INFO:tasks.workunit.client.0.smithi052.stdout:6/298: dread da/d22/d29/d31/f3a [0,4194304] 0 2024-04-26T12:06:55.705 INFO:tasks.workunit.client.0.smithi052.stdout:0/341: symlink d0/d1/d52/l6d 0 2024-04-26T12:06:55.705 INFO:tasks.workunit.client.0.smithi052.stdout:2/365: mknod d0/d36/c72 0 2024-04-26T12:06:55.705 INFO:tasks.workunit.client.0.smithi052.stdout:8/275: write d0/d4/d1c/f2b [8057135,123308] 0 2024-04-26T12:06:55.707 INFO:tasks.workunit.client.0.smithi052.stdout:3/291: dwrite d2/d4/f21 [0,4194304] 0 2024-04-26T12:06:55.707 INFO:tasks.workunit.client.0.smithi052.stdout:1/288: dread d0/d2/dd/d1c/d1d/f50 [0,4194304] 0 2024-04-26T12:06:55.707 INFO:tasks.workunit.client.0.smithi052.stdout:6/299: creat da/d51/f69 x:0 0 0 2024-04-26T12:06:55.709 INFO:tasks.workunit.client.0.smithi052.stdout:4/299: dwrite d3/f14 [0,4194304] 0 2024-04-26T12:06:55.710 INFO:tasks.workunit.client.0.smithi052.stdout:3/292: rename d2 to d2/d4/dc/d1d/d3f/d56 22 2024-04-26T12:06:55.713 INFO:tasks.workunit.client.0.smithi052.stdout:4/300: mkdir d3/d22/d69 0 2024-04-26T12:06:55.714 INFO:tasks.workunit.client.0.smithi052.stdout:3/293: fdatasync d2/d4/dc/d1d/d25/f2b 0 2024-04-26T12:06:55.715 INFO:tasks.workunit.client.0.smithi052.stdout:2/366: rename d0/d7/d2f/d5f to d0/d3f/d56/d6d/d5a/d73 0 2024-04-26T12:06:55.716 INFO:tasks.workunit.client.0.smithi052.stdout:4/301: mknod d3/d44/d4b/c6a 0 2024-04-26T12:06:55.716 INFO:tasks.workunit.client.0.smithi052.stdout:7/286: dread d1/f17 [0,4194304] 0 2024-04-26T12:06:55.717 INFO:tasks.workunit.client.0.smithi052.stdout:5/308: dread db/f1f [0,4194304] 0 2024-04-26T12:06:55.719 INFO:tasks.workunit.client.0.smithi052.stdout:3/294: mknod d2/d4/dc/d33/d37/d55/c57 0 2024-04-26T12:06:55.719 INFO:tasks.workunit.client.0.smithi052.stdout:9/344: dwrite d3/db/d13/f51 [0,4194304] 0 2024-04-26T12:06:55.720 INFO:tasks.workunit.client.0.smithi052.stdout:8/276: dwrite d0/f44 [0,4194304] 0 2024-04-26T12:06:55.721 INFO:tasks.workunit.client.0.smithi052.stdout:2/367: rename d0/d7/d53/f61 to d0/d3f/d56/f74 0 2024-04-26T12:06:55.721 INFO:tasks.workunit.client.0.smithi052.stdout:6/300: dwrite da/d22/d29/d31/f3a [0,4194304] 0 2024-04-26T12:06:55.722 INFO:tasks.workunit.client.0.smithi052.stdout:9/345: dread - d3/d1b/d49/f72 zero size 2024-04-26T12:06:55.722 INFO:tasks.workunit.client.0.smithi052.stdout:8/277: write d0/d16/d28/f32 [2740584,37914] 0 2024-04-26T12:06:55.722 INFO:tasks.workunit.client.0.smithi052.stdout:7/287: truncate d1/d1c/d23/f25 1319505 0 2024-04-26T12:06:55.723 INFO:tasks.workunit.client.0.smithi052.stdout:5/309: rename db/dc/d5f/d25 to db/dd/d18/d60/d64 0 2024-04-26T12:06:55.724 INFO:tasks.workunit.client.0.smithi052.stdout:6/301: creat da/d63/f6a x:0 0 0 2024-04-26T12:06:55.724 INFO:tasks.workunit.client.0.smithi052.stdout:5/310: mknod db/dd/d34/c65 0 2024-04-26T12:06:55.725 INFO:tasks.workunit.client.0.smithi052.stdout:7/288: symlink d1/d45/d4c/l5e 0 2024-04-26T12:06:55.725 INFO:tasks.workunit.client.0.smithi052.stdout:6/302: rmdir da/d5d/d64 39 2024-04-26T12:06:55.727 INFO:tasks.workunit.client.0.smithi052.stdout:9/346: truncate d3/db/d2b/f2f 1864116 0 2024-04-26T12:06:55.727 INFO:tasks.workunit.client.0.smithi052.stdout:5/311: mknod db/dd/d18/d60/c66 0 2024-04-26T12:06:55.728 INFO:tasks.workunit.client.0.smithi052.stdout:2/368: dread d0/d7/f31 [0,4194304] 0 2024-04-26T12:06:55.728 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:55.727+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:55.729 INFO:tasks.workunit.client.0.smithi052.stdout:9/347: write d3/db/f20 [2471478,39929] 0 2024-04-26T12:06:55.729 INFO:tasks.workunit.client.0.smithi052.stdout:6/303: link f2 da/d22/d29/d31/f6b 0 2024-04-26T12:06:55.730 INFO:tasks.workunit.client.0.smithi052.stdout:2/369: dread - d0/d7/d16/d3a/f5e zero size 2024-04-26T12:06:55.731 INFO:tasks.workunit.client.0.smithi052.stdout:9/348: truncate d3/db/d2b/f61 28920 0 2024-04-26T12:06:55.733 INFO:tasks.workunit.client.0.smithi052.stdout:2/370: write d0/d7/d16/f1c [5163432,22469] 0 2024-04-26T12:06:55.733 INFO:tasks.workunit.client.0.smithi052.stdout:7/289: truncate d1/f7 84536 0 2024-04-26T12:06:55.733 INFO:tasks.workunit.client.0.smithi052.stdout:3/295: dwrite d2/d4/dc/d33/d37/f51 [4194304,4194304] 0 2024-04-26T12:06:55.735 INFO:tasks.workunit.client.0.smithi052.stdout:9/349: rename d3/db/d10/l1a to d3/d1b/d49/l74 0 2024-04-26T12:06:55.737 INFO:tasks.workunit.client.0.smithi052.stdout:5/312: dwrite db/dc/d5f/d50/d46/f4b [0,4194304] 0 2024-04-26T12:06:55.738 INFO:tasks.workunit.client.0.smithi052.stdout:8/278: fsync d0/d16/d28/f32 0 2024-04-26T12:06:55.738 INFO:tasks.workunit.client.0.smithi052.stdout:2/371: write d0/d7/f31 [4612931,13490] 0 2024-04-26T12:06:55.739 INFO:tasks.workunit.client.0.smithi052.stdout:9/350: chown d3/d1b/f6f 318 1 2024-04-26T12:06:55.739 INFO:tasks.workunit.client.0.smithi052.stdout:5/313: mknod db/dc/c67 0 2024-04-26T12:06:55.741 INFO:tasks.workunit.client.0.smithi052.stdout:6/304: dread da/d22/d3c/f4b [0,4194304] 0 2024-04-26T12:06:55.742 INFO:tasks.workunit.client.0.smithi052.stdout:2/372: creat d0/d7/d16/f75 x:0 0 0 2024-04-26T12:06:55.743 INFO:tasks.workunit.client.0.smithi052.stdout:7/290: dwrite d1/d1c/d21/d2f/f48 [0,4194304] 0 2024-04-26T12:06:55.744 INFO:tasks.workunit.client.0.smithi052.stdout:3/296: dwrite d2/d4/dc/f1b [0,4194304] 0 2024-04-26T12:06:55.744 INFO:tasks.workunit.client.0.smithi052.stdout:8/279: rename d0/d4/d5/db/d20/l34 to d0/d3e/l50 0 2024-04-26T12:06:55.745 INFO:tasks.workunit.client.0.smithi052.stdout:0/342: sync 2024-04-26T12:06:55.745 INFO:tasks.workunit.client.0.smithi052.stdout:6/305: symlink da/d22/l6c 0 2024-04-26T12:06:55.747 INFO:tasks.workunit.client.0.smithi052.stdout:2/373: mknod d0/d36/d57/c76 0 2024-04-26T12:06:55.747 INFO:tasks.workunit.client.0.smithi052.stdout:0/343: chown d0/d1/d1a/d2a/d32 18475 1 2024-04-26T12:06:55.747 INFO:tasks.workunit.client.0.smithi052.stdout:3/297: chown d2/d4/dc/d1d/d25/f3b 277293460 1 2024-04-26T12:06:55.748 INFO:tasks.workunit.client.0.smithi052.stdout:5/314: link db/l2b db/dc/d5f/l68 0 2024-04-26T12:06:55.748 INFO:tasks.workunit.client.0.smithi052.stdout:7/291: mknod d1/d45/d4c/d4d/c5f 0 2024-04-26T12:06:55.749 INFO:tasks.workunit.client.0.smithi052.stdout:2/374: chown d0/d3f/l50 3 1 2024-04-26T12:06:55.749 INFO:tasks.workunit.client.0.smithi052.stdout:6/306: dread - da/d22/d29/f38 zero size 2024-04-26T12:06:55.749 INFO:tasks.workunit.client.0.smithi052.stdout:5/315: mkdir db/dd/d34/d69 0 2024-04-26T12:06:55.750 INFO:tasks.workunit.client.0.smithi052.stdout:7/292: creat d1/d1f/f60 x:0 0 0 2024-04-26T12:06:55.750 INFO:tasks.workunit.client.0.smithi052.stdout:0/344: chown d0/d1/d11/f4a 13373 1 2024-04-26T12:06:55.750 INFO:tasks.workunit.client.0.smithi052.stdout:2/375: chown d0/f68 367098141 1 2024-04-26T12:06:55.751 INFO:tasks.workunit.client.0.smithi052.stdout:0/345: chown d0/d1/d54 250888 1 2024-04-26T12:06:55.751 INFO:tasks.workunit.client.0.smithi052.stdout:6/307: chown f2 13 1 2024-04-26T12:06:55.752 INFO:tasks.workunit.client.0.smithi052.stdout:9/351: dwrite d3/db/d10/d54/f56 [0,4194304] 0 2024-04-26T12:06:55.752 INFO:tasks.workunit.client.0.smithi052.stdout:5/316: mknod db/dd/d18/d60/d64/c6a 0 2024-04-26T12:06:55.752 INFO:tasks.workunit.client.0.smithi052.stdout:2/376: mkdir d0/d77 0 2024-04-26T12:06:55.752 INFO:tasks.workunit.client.0.smithi052.stdout:7/293: write d1/f15 [2118552,81481] 0 2024-04-26T12:06:55.753 INFO:tasks.workunit.client.0.smithi052.stdout:4/302: dread d3/d15/f17 [0,4194304] 0 2024-04-26T12:06:55.753 INFO:tasks.workunit.client.0.smithi052.stdout:9/352: mknod d3/d23/c75 0 2024-04-26T12:06:55.753 INFO:tasks.workunit.client.0.smithi052.stdout:6/308: mkdir da/d22/d6d 0 2024-04-26T12:06:55.754 INFO:tasks.workunit.client.0.smithi052.stdout:3/298: truncate d2/d4/dc/d33/d37/f3a 1642811 0 2024-04-26T12:06:55.754 INFO:tasks.workunit.client.0.smithi052.stdout:5/317: fdatasync f1 0 2024-04-26T12:06:55.755 INFO:tasks.workunit.client.0.smithi052.stdout:7/294: fdatasync d1/d1c/d21/d2f/f46 0 2024-04-26T12:06:55.755 INFO:tasks.workunit.client.0.smithi052.stdout:4/303: mkdir d3/d12/d59/d6b 0 2024-04-26T12:06:55.755 INFO:tasks.workunit.client.0.smithi052.stdout:2/377: rename d0/f68 to d0/d7/d2f/f78 0 2024-04-26T12:06:55.755 INFO:tasks.workunit.client.0.smithi052.stdout:6/309: chown da/d22/d29/d31/f4f 139871 1 2024-04-26T12:06:55.756 INFO:tasks.workunit.client.0.smithi052.stdout:9/353: symlink d3/db/d10/d3c/l76 0 2024-04-26T12:06:55.756 INFO:tasks.workunit.client.0.smithi052.stdout:2/378: truncate d0/f15 812259 0 2024-04-26T12:06:55.756 INFO:tasks.workunit.client.0.smithi052.stdout:5/318: symlink db/dc/d5f/d3f/l6b 0 2024-04-26T12:06:55.756 INFO:tasks.workunit.client.0.smithi052.stdout:6/310: chown da/d51/l56 46917 1 2024-04-26T12:06:55.757 INFO:tasks.workunit.client.0.smithi052.stdout:5/319: write db/dc/f12 [894381,48799] 0 2024-04-26T12:06:55.757 INFO:tasks.workunit.client.0.smithi052.stdout:3/299: getdents d2/d4/dc/d33/d37 0 2024-04-26T12:06:55.758 INFO:tasks.workunit.client.0.smithi052.stdout:6/311: write da/d22/d29/d31/f4a [183892,90669] 0 2024-04-26T12:06:55.758 INFO:tasks.workunit.client.0.smithi052.stdout:3/300: chown d2/ff 422588747 1 2024-04-26T12:06:55.758 INFO:tasks.workunit.client.0.smithi052.stdout:9/354: creat d3/db/d10/d2e/f77 x:0 0 0 2024-04-26T12:06:55.758 INFO:tasks.workunit.client.0.smithi052.stdout:4/304: truncate d3/d22/d30/f42 3649693 0 2024-04-26T12:06:55.759 INFO:tasks.workunit.client.0.smithi052.stdout:6/312: write da/d51/f69 [193798,32851] 0 2024-04-26T12:06:55.759 INFO:tasks.workunit.client.0.smithi052.stdout:5/320: read db/dc/d5f/f36 [849624,79370] 0 2024-04-26T12:06:55.760 INFO:tasks.workunit.client.0.smithi052.stdout:2/379: link d0/d7/d2f/c37 d0/d3f/d56/d6d/d5a/d73/d4b/c79 0 2024-04-26T12:06:55.762 INFO:tasks.workunit.client.0.smithi052.stdout:8/280: dread d0/d4/dc/f3d [0,4194304] 0 2024-04-26T12:06:55.762 INFO:tasks.workunit.client.0.smithi052.stdout:4/305: write d3/d15/f17 [2545741,83050] 0 2024-04-26T12:06:55.763 INFO:tasks.workunit.client.0.smithi052.stdout:6/313: dread - da/d22/d29/d31/f4d zero size 2024-04-26T12:06:55.764 INFO:tasks.workunit.client.0.smithi052.stdout:5/321: read db/dc/d5f/f2f [3306146,121073] 0 2024-04-26T12:06:55.765 INFO:tasks.workunit.client.0.smithi052.stdout:2/380: write d0/d7/d2f/f78 [696552,96919] 0 2024-04-26T12:06:55.766 INFO:tasks.workunit.client.0.smithi052.stdout:8/281: write d0/d4/d5/d27/f4c [1030521,42148] 0 2024-04-26T12:06:55.766 INFO:tasks.workunit.client.0.smithi052.stdout:6/314: mkdir da/d22/d3c/d6e 0 2024-04-26T12:06:55.767 INFO:tasks.workunit.client.0.smithi052.stdout:4/306: mkdir d3/d12/d34/d45/d67/d6c 0 2024-04-26T12:06:55.767 INFO:tasks.workunit.client.0.smithi052.stdout:7/295: dwrite d1/f7 [0,4194304] 0 2024-04-26T12:06:55.770 INFO:tasks.workunit.client.0.smithi052.stdout:9/355: dwrite d3/db/d2b/f61 [0,4194304] 0 2024-04-26T12:06:55.770 INFO:tasks.workunit.client.0.smithi052.stdout:6/315: rmdir da/d22/d29/d61 0 2024-04-26T12:06:55.771 INFO:tasks.workunit.client.0.smithi052.stdout:2/381: link d0/d7/d2f/d3d/f3e d0/d7/d53/f7a 0 2024-04-26T12:06:55.772 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:55.772 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:55.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.772 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1204 3.0 3:07a02702:::200.0000000c:head [write 4076194~17942 [fadvise_dontneed] in=17942b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:55.772 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:55.771502+0000", 2024-04-26T12:06:55.772 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00019670199999999999, 2024-04-26T12:06:55.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000216636, 2024-04-26T12:06:55.772 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:55.772 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T12:06:55.773 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:55.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:55.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.771502+0000", 2024-04-26T12:06:55.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:55.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:55.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.771502+0000", 2024-04-26T12:06:55.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:55.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:55.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.771501+0000", 2024-04-26T12:06:55.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:55.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:55.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.771518+0000", 2024-04-26T12:06:55.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6572e-05 2024-04-26T12:06:55.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:55.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.771531+0000", 2024-04-26T12:06:55.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3876000000000001e-05 2024-04-26T12:06:55.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:55.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.771555+0000", 2024-04-26T12:06:55.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3770000000000001e-05 2024-04-26T12:06:55.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:55.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.771616+0000", 2024-04-26T12:06:55.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0982e-05 2024-04-26T12:06:55.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:55.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:55.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:55.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.771664+0000", 2024-04-26T12:06:55.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8275000000000001e-05 2024-04-26T12:06:55.776 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:55.776 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:55.776 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:55.776 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:55.776 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-04-26T12:06:55.776 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 1 2024-04-26T12:06:55.776 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:55.778 INFO:tasks.workunit.client.0.smithi052.stdout:5/322: dread db/dc/d5f/d3f/f58 [0,4194304] 0 2024-04-26T12:06:55.778 INFO:tasks.workunit.client.0.smithi052.stdout:4/307: getdents d3/d12/d59 0 2024-04-26T12:06:55.778 INFO:tasks.workunit.client.0.smithi052.stdout:9/356: creat d3/db/d4a/f78 x:0 0 0 2024-04-26T12:06:55.778 INFO:tasks.workunit.client.0.smithi052.stdout:2/382: creat d0/d3f/d56/d6d/f7b x:0 0 0 2024-04-26T12:06:55.778 INFO:tasks.workunit.client.0.smithi052.stdout:6/316: mkdir da/d22/d29/d31/d6f 0 2024-04-26T12:06:55.779 INFO:tasks.workunit.client.0.smithi052.stdout:3/301: dwrite d2/d4/dc/d33/d37/f3a [0,4194304] 0 2024-04-26T12:06:55.779 INFO:tasks.workunit.client.0.smithi052.stdout:4/308: fdatasync d3/d12/f1e 0 2024-04-26T12:06:55.779 INFO:tasks.workunit.client.0.smithi052.stdout:1/289: sync 2024-04-26T12:06:55.779 INFO:tasks.workunit.client.0.smithi052.stdout:9/357: creat d3/db/d13/f79 x:0 0 0 2024-04-26T12:06:55.779 INFO:tasks.workunit.client.0.smithi052.stdout:6/317: dread - da/d22/d29/f5a zero size 2024-04-26T12:06:55.779 INFO:tasks.workunit.client.0.smithi052.stdout:3/302: creat d2/d4/d2a/f58 x:0 0 0 2024-04-26T12:06:55.779 INFO:tasks.workunit.client.0.smithi052.stdout:4/309: mknod d3/d12/c6d 0 2024-04-26T12:06:55.779 INFO:tasks.workunit.client.0.smithi052.stdout:8/282: truncate d0/d16/f23 3611963 0 2024-04-26T12:06:55.779 INFO:tasks.workunit.client.0.smithi052.stdout:1/290: creat d0/d2/de/d4b/d60/f69 x:0 0 0 2024-04-26T12:06:55.779 INFO:tasks.workunit.client.0.smithi052.stdout:9/358: truncate d3/db/d10/d55/f57 2830616 0 2024-04-26T12:06:55.779 INFO:tasks.workunit.client.0.smithi052.stdout:4/310: rmdir d3/d12/d34 39 2024-04-26T12:06:55.780 INFO:tasks.workunit.client.0.smithi052.stdout:1/291: unlink d0/da/d3a/f4d 0 2024-04-26T12:06:55.780 INFO:tasks.workunit.client.0.smithi052.stdout:6/318: rename da/d22/d3c/f5e to da/d22/d3c/d6e/f70 0 2024-04-26T12:06:55.780 INFO:tasks.workunit.client.0.smithi052.stdout:8/283: write d0/d4/dc/f3d [1560721,74113] 0 2024-04-26T12:06:55.781 INFO:tasks.workunit.client.0.smithi052.stdout:9/359: unlink d3/db/d13/c37 0 2024-04-26T12:06:55.781 INFO:tasks.workunit.client.0.smithi052.stdout:6/319: fdatasync da/d22/d3c/f58 0 2024-04-26T12:06:55.781 INFO:tasks.workunit.client.0.smithi052.stdout:3/303: rename d2/d4/dc/d33/d37/d55 to d2/d4/d41/d59 0 2024-04-26T12:06:55.782 INFO:tasks.workunit.client.0.smithi052.stdout:0/346: dread d0/d1/d1a/d2a/f51 [4194304,4194304] 0 2024-04-26T12:06:55.783 INFO:tasks.workunit.client.0.smithi052.stdout:1/292: symlink d0/d2/de/d4b/l6a 0 2024-04-26T12:06:55.783 INFO:tasks.workunit.client.0.smithi052.stdout:8/284: rename d0/d16/d28/f48 to d0/d4/f51 0 2024-04-26T12:06:55.783 INFO:tasks.workunit.client.0.smithi052.stdout:5/323: dwrite db/dd/d34/f57 [0,4194304] 0 2024-04-26T12:06:55.783 INFO:tasks.workunit.client.0.smithi052.stdout:9/360: write d3/db/d13/f79 [104420,92260] 0 2024-04-26T12:06:55.784 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:55.785 INFO:tasks.workunit.client.0.smithi052.stdout:3/304: symlink d2/d4/dc/d1d/d25/d36/l5a 0 2024-04-26T12:06:55.785 INFO:tasks.workunit.client.0.smithi052.stdout:6/320: write da/d22/d29/d31/d39/f48 [52305,2863] 0 2024-04-26T12:06:55.785 INFO:tasks.workunit.client.0.smithi052.stdout:9/361: mknod d3/db/d10/d54/c7a 0 2024-04-26T12:06:55.786 INFO:tasks.workunit.client.0.smithi052.stdout:0/347: write d0/d1/d2c/d42/f58 [231711,116063] 0 2024-04-26T12:06:55.786 INFO:tasks.workunit.client.0.smithi052.stdout:5/324: creat db/dd/d18/f6c x:0 0 0 2024-04-26T12:06:55.787 INFO:tasks.workunit.client.0.smithi052.stdout:3/305: rename d2/d4/dc/d1d/d25/d36/l4c to d2/d4/d41/l5b 0 2024-04-26T12:06:55.789 INFO:tasks.workunit.client.0.smithi052.stdout:6/321: mknod da/d5d/d64/d68/c71 0 2024-04-26T12:06:55.789 INFO:tasks.workunit.client.0.smithi052.stdout:5/325: write db/dd/f27 [3647902,103582] 0 2024-04-26T12:06:55.789 INFO:tasks.workunit.client.0.smithi052.stdout:0/348: chown d0/d1/d11/c25 818188671 1 2024-04-26T12:06:55.792 INFO:tasks.workunit.client.0.smithi052.stdout:8/285: dread d0/d16/d28/f4f [0,4194304] 0 2024-04-26T12:06:55.793 INFO:tasks.workunit.client.0.smithi052.stdout:1/293: dwrite d0/f4a [0,4194304] 0 2024-04-26T12:06:55.794 INFO:tasks.workunit.client.0.smithi052.stdout:5/326: creat db/dc/d29/f6d x:0 0 0 2024-04-26T12:06:55.795 INFO:tasks.workunit.client.0.smithi052.stdout:9/362: write d3/db/d13/f29 [1156362,17989] 0 2024-04-26T12:06:55.795 INFO:tasks.workunit.client.0.smithi052.stdout:4/311: dwrite d3/fd [0,4194304] 0 2024-04-26T12:06:55.797 INFO:tasks.workunit.client.0.smithi052.stdout:5/327: rmdir db/dd/d34 39 2024-04-26T12:06:55.797 INFO:tasks.workunit.client.0.smithi052.stdout:3/306: dread d2/d4/f3e [0,4194304] 0 2024-04-26T12:06:55.798 INFO:tasks.workunit.client.0.smithi052.stdout:1/294: write d0/d2/de/f2d [482827,110061] 0 2024-04-26T12:06:55.802 INFO:tasks.workunit.client.0.smithi052.stdout:1/295: stat d0/c65 0 2024-04-26T12:06:55.802 INFO:tasks.workunit.client.0.smithi052.stdout:3/307: truncate d2/f38 5081771 0 2024-04-26T12:06:55.802 INFO:tasks.workunit.client.0.smithi052.stdout:0/349: dread d0/d1/dd/f19 [0,4194304] 0 2024-04-26T12:06:55.802 INFO:tasks.workunit.client.0.smithi052.stdout:7/296: dread d1/f14 [0,4194304] 0 2024-04-26T12:06:55.803 INFO:tasks.workunit.client.0.smithi052.stdout:5/328: getdents db/dc/d5f/d50/d46 0 2024-04-26T12:06:55.804 INFO:tasks.workunit.client.0.smithi052.stdout:0/350: rename d0/d1/d11/f31 to d0/d1/d1a/d20/f6e 0 2024-04-26T12:06:55.804 INFO:tasks.workunit.client.0.smithi052.stdout:9/363: dread d3/db/d10/d54/f56 [0,4194304] 0 2024-04-26T12:06:55.805 INFO:tasks.workunit.client.0.smithi052.stdout:5/329: write db/f1f [4858619,115003] 0 2024-04-26T12:06:55.805 INFO:tasks.workunit.client.0.smithi052.stdout:7/297: read d1/d1f/f22 [182675,38202] 0 2024-04-26T12:06:55.805 INFO:tasks.workunit.client.0.smithi052.stdout:4/312: read d3/d12/f1e [510390,97930] 0 2024-04-26T12:06:55.805 INFO:tasks.workunit.client.0.smithi052.stdout:0/351: read d0/d1/f13 [2649248,61567] 0 2024-04-26T12:06:55.806 INFO:tasks.workunit.client.0.smithi052.stdout:9/364: write d3/db/d10/d54/f56 [4806289,22775] 0 2024-04-26T12:06:55.807 INFO:tasks.workunit.client.0.smithi052.stdout:7/298: fsync d1/d1c/d21/d2f/f54 0 2024-04-26T12:06:55.808 INFO:tasks.workunit.client.0.smithi052.stdout:5/330: mkdir db/dc/d29/d52/d6e 0 2024-04-26T12:06:55.808 INFO:tasks.workunit.client.0.smithi052.stdout:9/365: rename d3/db/d13/c34 to d3/db/c7b 0 2024-04-26T12:06:55.810 INFO:tasks.workunit.client.0.smithi052.stdout:3/308: dwrite d2/d4/dc/d1d/d25/d36/d1c/f4a [0,4194304] 0 2024-04-26T12:06:55.810 INFO:tasks.workunit.client.0.smithi052.stdout:7/299: symlink d1/d1c/d21/d2f/d33/l61 0 2024-04-26T12:06:55.810 INFO:tasks.workunit.client.0.smithi052.stdout:6/322: dread da/f11 [0,4194304] 0 2024-04-26T12:06:55.811 INFO:tasks.workunit.client.0.smithi052.stdout:0/352: write d0/f3 [8443794,49001] 0 2024-04-26T12:06:55.812 INFO:tasks.workunit.client.0.smithi052.stdout:3/309: stat d2/d4/dc/d1d/d25/d36/d1c/f4a 0 2024-04-26T12:06:55.813 INFO:tasks.workunit.client.0.smithi052.stdout:6/323: creat da/d63/f72 x:0 0 0 2024-04-26T12:06:55.814 INFO:tasks.workunit.client.0.smithi052.stdout:0/353: rmdir d0/d1/d1a 39 2024-04-26T12:06:55.814 INFO:tasks.workunit.client.0.smithi052.stdout:4/313: dwrite d3/d2b/f3e [0,4194304] 0 2024-04-26T12:06:55.814 INFO:tasks.workunit.client.0.smithi052.stdout:3/310: rmdir d2/d4/dc 39 2024-04-26T12:06:55.815 INFO:tasks.workunit.client.0.smithi052.stdout:3/311: fsync d2/f2f 0 2024-04-26T12:06:55.815 INFO:tasks.workunit.client.0.smithi052.stdout:2/383: dread d0/f21 [0,4194304] 0 2024-04-26T12:06:55.816 INFO:tasks.workunit.client.0.smithi052.stdout:6/324: chown da/d22/d29/l2b 68331 1 2024-04-26T12:06:55.817 INFO:tasks.workunit.client.0.smithi052.stdout:4/314: write d3/d44/f58 [275168,68088] 0 2024-04-26T12:06:55.817 INFO:tasks.workunit.client.0.smithi052.stdout:5/331: read db/dc/d5f/f2f [3481219,103320] 0 2024-04-26T12:06:55.818 INFO:tasks.workunit.client.0.smithi052.stdout:3/312: mkdir d2/d4/d41/d5c 0 2024-04-26T12:06:55.818 INFO:tasks.workunit.client.0.smithi052.stdout:8/286: dread d0/d4/d5/f8 [4194304,4194304] 0 2024-04-26T12:06:55.819 INFO:tasks.workunit.client.0.smithi052.stdout:6/325: symlink da/d22/d6d/l73 0 2024-04-26T12:06:55.819 INFO:tasks.workunit.client.0.smithi052.stdout:4/315: creat d3/d2e/f6e x:0 0 0 2024-04-26T12:06:55.820 INFO:tasks.workunit.client.0.smithi052.stdout:3/313: stat d2/d4/dc/d1d/d25/d36/d1c 0 2024-04-26T12:06:55.820 INFO:tasks.workunit.client.0.smithi052.stdout:4/316: symlink d3/d22/d30/l6f 0 2024-04-26T12:06:55.820 INFO:tasks.workunit.client.0.smithi052.stdout:7/300: dwrite d1/f10 [0,4194304] 0 2024-04-26T12:06:55.820 INFO:tasks.workunit.client.0.smithi052.stdout:5/332: chown db/dd/d34/l4e 776962 1 2024-04-26T12:06:55.821 INFO:tasks.workunit.client.0.smithi052.stdout:8/287: write d0/d4/d1c/f2b [7401232,39576] 0 2024-04-26T12:06:55.822 INFO:tasks.workunit.client.0.smithi052.stdout:4/317: creat d3/d22/d30/f70 x:0 0 0 2024-04-26T12:06:55.823 INFO:tasks.workunit.client.0.smithi052.stdout:7/301: symlink d1/d45/l62 0 2024-04-26T12:06:55.823 INFO:tasks.workunit.client.0.smithi052.stdout:3/314: getdents d2/d4/dc/d1d/d25 0 2024-04-26T12:06:55.824 INFO:tasks.workunit.client.0.smithi052.stdout:2/384: dread d0/d7/d53/f6e [0,4194304] 0 2024-04-26T12:06:55.824 INFO:tasks.workunit.client.0.smithi052.stdout:7/302: chown d1/d1c/d23 8083 1 2024-04-26T12:06:55.825 INFO:tasks.workunit.client.0.smithi052.stdout:5/333: getdents db/dc/d5f/d50 0 2024-04-26T12:06:55.825 INFO:tasks.workunit.client.0.smithi052.stdout:4/318: readlink d3/d12/d34/d45/l5f 0 2024-04-26T12:06:55.825 INFO:tasks.workunit.client.0.smithi052.stdout:3/315: fsync d2/d4/d2a/f58 0 2024-04-26T12:06:55.825 INFO:tasks.workunit.client.0.smithi052.stdout:9/366: dread d3/db/d10/f18 [0,4194304] 0 2024-04-26T12:06:55.825 INFO:tasks.workunit.client.0.smithi052.stdout:4/319: readlink d3/l3c 0 2024-04-26T12:06:55.825 INFO:tasks.workunit.client.0.smithi052.stdout:7/303: write d1/f20 [3279933,50742] 0 2024-04-26T12:06:55.826 INFO:tasks.workunit.client.0.smithi052.stdout:2/385: mknod d0/d36/c7c 0 2024-04-26T12:06:55.826 INFO:tasks.workunit.client.0.smithi052.stdout:6/326: dread da/d22/d29/f36 [0,4194304] 0 2024-04-26T12:06:55.826 INFO:tasks.workunit.client.0.smithi052.stdout:4/320: write d3/f1c [4795461,91261] 0 2024-04-26T12:06:55.828 INFO:tasks.workunit.client.0.smithi052.stdout:6/327: stat da/d22/d29/d31/d39/l44 0 2024-04-26T12:06:55.828 INFO:tasks.workunit.client.0.smithi052.stdout:3/316: read d2/f29 [966426,63761] 0 2024-04-26T12:06:55.829 INFO:tasks.workunit.client.0.smithi052.stdout:2/386: symlink d0/d7/d16/l7d 0 2024-04-26T12:06:55.829 INFO:tasks.workunit.client.0.smithi052.stdout:6/328: mkdir da/d22/d3c/d74 0 2024-04-26T12:06:55.830 INFO:tasks.workunit.client.0.smithi052.stdout:4/321: getdents d3/d22/d69 0 2024-04-26T12:06:55.830 INFO:tasks.workunit.client.0.smithi052.stdout:7/304: rename d1/d1c/c44 to d1/d1c/d21/d2f/c63 0 2024-04-26T12:06:55.831 INFO:tasks.workunit.client.0.smithi052.stdout:6/329: rmdir da/d22/d3c/d6e 39 2024-04-26T12:06:55.831 INFO:tasks.workunit.client.0.smithi052.stdout:1/296: dread d0/d2/f18 [0,4194304] 0 2024-04-26T12:06:55.831 INFO:tasks.workunit.client.0.smithi052.stdout:0/354: dwrite d0/d1/d11/f17 [0,4194304] 0 2024-04-26T12:06:55.832 INFO:tasks.workunit.client.0.smithi052.stdout:3/317: write d2/d4/dc/d33/d37/f3a [5229382,54866] 0 2024-04-26T12:06:55.832 INFO:tasks.workunit.client.0.smithi052.stdout:7/305: read - d1/d1c/f42 zero size 2024-04-26T12:06:55.834 INFO:tasks.workunit.client.0.smithi052.stdout:1/297: rmdir d0/da 39 2024-04-26T12:06:55.834 INFO:tasks.workunit.client.0.smithi052.stdout:5/334: dwrite db/dd/d18/d60/d64/f32 [0,4194304] 0 2024-04-26T12:06:55.836 INFO:tasks.workunit.client.0.smithi052.stdout:0/355: readlink d0/d1/d1a/d20/d47/l48 0 2024-04-26T12:06:55.837 INFO:tasks.workunit.client.0.smithi052.stdout:7/306: write d1/d1c/d21/d2f/d33/d3a/f40 [517251,109061] 0 2024-04-26T12:06:55.838 INFO:tasks.workunit.client.0.smithi052.stdout:5/335: creat db/dd/d18/f6f x:0 0 0 2024-04-26T12:06:55.838 INFO:tasks.workunit.client.0.smithi052.stdout:1/298: write d0/da/d3a/f63 [3964109,128477] 0 2024-04-26T12:06:55.839 INFO:tasks.workunit.client.0.smithi052.stdout:0/356: unlink d0/d1/dd/l59 0 2024-04-26T12:06:55.840 INFO:tasks.workunit.client.0.smithi052.stdout:1/299: stat d0/d2/de/d4b 0 2024-04-26T12:06:55.841 INFO:tasks.workunit.client.0.smithi052.stdout:7/307: mkdir d1/d1c/d21/d2f/d33/d3a/d64 0 2024-04-26T12:06:55.841 INFO:tasks.workunit.client.0.smithi052.stdout:6/330: dwrite da/f1e [0,4194304] 0 2024-04-26T12:06:55.842 INFO:tasks.workunit.client.0.smithi052.stdout:9/367: truncate d3/db/d10/d3c/d40/f42 7025645 0 2024-04-26T12:06:55.842 INFO:tasks.workunit.client.0.smithi052.stdout:0/357: write d0/d1/d52/f6b [861050,59335] 0 2024-04-26T12:06:55.843 INFO:tasks.workunit.client.0.smithi052.stdout:2/387: dwrite d0/d36/f45 [4194304,4194304] 0 2024-04-26T12:06:55.843 INFO:tasks.workunit.client.0.smithi052.stdout:1/300: fdatasync d0/f64 0 2024-04-26T12:06:55.844 INFO:tasks.workunit.client.0.smithi052.stdout:3/318: dread d2/d4/dc/d1d/d25/d36/d1c/f4a [0,4194304] 0 2024-04-26T12:06:55.846 INFO:tasks.workunit.client.0.smithi052.stdout:7/308: chown d1/d1c/d21/d2f/f54 834577719 1 2024-04-26T12:06:55.846 INFO:tasks.workunit.client.0.smithi052.stdout:1/301: mknod d0/d2/dd/c6b 0 2024-04-26T12:06:55.846 INFO:tasks.workunit.client.0.smithi052.stdout:0/358: write d0/d1/d11/f17 [1985136,4128] 0 2024-04-26T12:06:55.846 INFO:tasks.workunit.client.0.smithi052.stdout:9/368: getdents d3 0 2024-04-26T12:06:55.847 INFO:tasks.workunit.client.0.smithi052.stdout:3/319: fdatasync d2/d4/dc/d1d/d25/f2b 0 2024-04-26T12:06:55.847 INFO:tasks.workunit.client.0.smithi052.stdout:5/336: dread db/dc/d5f/f36 [0,4194304] 0 2024-04-26T12:06:55.847 INFO:tasks.workunit.client.0.smithi052.stdout:2/388: creat d0/d36/f7e x:0 0 0 2024-04-26T12:06:55.850 INFO:tasks.workunit.client.0.smithi052.stdout:4/322: dwrite d3/f10 [0,4194304] 0 2024-04-26T12:06:55.850 INFO:tasks.workunit.client.0.smithi052.stdout:3/320: write d2/d4/dc/f1b [231331,2573] 0 2024-04-26T12:06:55.850 INFO:tasks.workunit.client.0.smithi052.stdout:5/337: write db/f26 [4326001,83031] 0 2024-04-26T12:06:55.851 INFO:tasks.workunit.client.0.smithi052.stdout:0/359: rmdir d0/d1/d1a/d2a/d4f/d67 0 2024-04-26T12:06:55.852 INFO:tasks.workunit.client.0.smithi052.stdout:4/323: mkdir d3/d22/d30/d71 0 2024-04-26T12:06:55.853 INFO:tasks.workunit.client.0.smithi052.stdout:3/321: mknod d2/d4/d41/d5c/c5d 0 2024-04-26T12:06:55.855 INFO:tasks.workunit.client.0.smithi052.stdout:0/360: write d0/d1/f5c [681670,14617] 0 2024-04-26T12:06:55.856 INFO:tasks.workunit.client.0.smithi052.stdout:3/322: write d2/f38 [3914420,3189] 0 2024-04-26T12:06:55.857 INFO:tasks.workunit.client.0.smithi052.stdout:5/338: dread db/dc/d5f/f36 [0,4194304] 0 2024-04-26T12:06:55.857 INFO:tasks.workunit.client.0.smithi052.stdout:7/309: dwrite d1/f7 [0,4194304] 0 2024-04-26T12:06:55.857 INFO:tasks.workunit.client.0.smithi052.stdout:0/361: fdatasync d0/fe 0 2024-04-26T12:06:55.857 INFO:tasks.workunit.client.0.smithi052.stdout:2/389: dwrite d0/f12 [0,4194304] 0 2024-04-26T12:06:55.857 INFO:tasks.workunit.client.0.smithi052.stdout:1/302: dwrite d0/d2/f24 [4194304,4194304] 0 2024-04-26T12:06:55.859 INFO:tasks.workunit.client.0.smithi052.stdout:1/303: symlink d0/d2/de/l6c 0 2024-04-26T12:06:55.859 INFO:tasks.workunit.client.0.smithi052.stdout:0/362: rmdir d0/d1/d1a/d20/d47 39 2024-04-26T12:06:55.860 INFO:tasks.workunit.client.0.smithi052.stdout:2/390: readlink d0/d3f/d56/d6d/d5a/d73/l62 0 2024-04-26T12:06:55.860 INFO:tasks.workunit.client.0.smithi052.stdout:3/323: rename d2/d4/f21 to d2/d4/dc/d1d/d3f/f5e 0 2024-04-26T12:06:55.861 INFO:tasks.workunit.client.0.smithi052.stdout:7/310: truncate d1/d1c/d21/d2f/f54 676112 0 2024-04-26T12:06:55.861 INFO:tasks.workunit.client.0.smithi052.stdout:1/304: fsync d0/d2/dd/d1c/d1d/d23/f61 0 2024-04-26T12:06:55.861 INFO:tasks.workunit.client.0.smithi052.stdout:4/324: read d3/d22/f52 [394675,61123] 0 2024-04-26T12:06:55.862 INFO:tasks.workunit.client.0.smithi052.stdout:0/363: mknod d0/d1/d1a/d20/c6f 0 2024-04-26T12:06:55.862 INFO:tasks.workunit.client.0.smithi052.stdout:7/311: readlink d1/l41 0 2024-04-26T12:06:55.862 INFO:tasks.workunit.client.0.smithi052.stdout:2/391: getdents d0/d36 0 2024-04-26T12:06:55.863 INFO:tasks.workunit.client.0.smithi052.stdout:1/305: creat d0/d2/de/d4b/d56/f6d x:0 0 0 2024-04-26T12:06:55.863 INFO:tasks.workunit.client.0.smithi052.stdout:7/312: truncate d1/f16 1117884 0 2024-04-26T12:06:55.864 INFO:tasks.workunit.client.0.smithi052.stdout:0/364: truncate d0/d1/d2c/d42/f58 1336682 0 2024-04-26T12:06:55.865 INFO:tasks.workunit.client.0.smithi052.stdout:7/313: mkdir d1/d1c/d65 0 2024-04-26T12:06:55.866 INFO:tasks.workunit.client.0.smithi052.stdout:0/365: mkdir d0/d1/d2c/d42/d70 0 2024-04-26T12:06:55.866 INFO:tasks.workunit.client.0.smithi052.stdout:7/314: mknod d1/d1f/c66 0 2024-04-26T12:06:55.866 INFO:tasks.workunit.client.0.smithi052.stdout:1/306: getdents d0/d2/dd/d40 0 2024-04-26T12:06:55.866 INFO:tasks.workunit.client.0.smithi052.stdout:0/366: chown d0/d26 580 1 2024-04-26T12:06:55.866 INFO:tasks.workunit.client.0.smithi052.stdout:4/325: dread d3/f14 [0,4194304] 0 2024-04-26T12:06:55.866 INFO:tasks.workunit.client.0.smithi052.stdout:1/307: chown d0/d2/c5 15913081 1 2024-04-26T12:06:55.866 INFO:tasks.workunit.client.0.smithi052.stdout:8/288: sync 2024-04-26T12:06:55.867 INFO:tasks.workunit.client.0.smithi052.stdout:1/308: fdatasync d0/f20 0 2024-04-26T12:06:55.867 INFO:tasks.workunit.client.0.smithi052.stdout:4/326: mknod d3/d12/c72 0 2024-04-26T12:06:55.867 INFO:tasks.workunit.client.0.smithi052.stdout:8/289: stat d0/d3e 0 2024-04-26T12:06:55.868 INFO:tasks.workunit.client.0.smithi052.stdout:1/309: creat d0/d2/dd/f6e x:0 0 0 2024-04-26T12:06:55.868 INFO:tasks.workunit.client.0.smithi052.stdout:8/290: symlink d0/d4/d5/d27/l52 0 2024-04-26T12:06:55.868 INFO:tasks.workunit.client.0.smithi052.stdout:4/327: write d3/f4f [1381203,46380] 0 2024-04-26T12:06:55.869 INFO:tasks.workunit.client.0.smithi052.stdout:1/310: chown d0/d2/dd/d40/l49 607951 1 2024-04-26T12:06:55.869 INFO:tasks.workunit.client.0.smithi052.stdout:8/291: read d0/d4/f26 [526350,29991] 0 2024-04-26T12:06:55.869 INFO:tasks.workunit.client.0.smithi052.stdout:4/328: dread - d3/d12/d34/d45/f47 zero size 2024-04-26T12:06:55.870 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:55.869+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:55.870 INFO:tasks.workunit.client.0.smithi052.stdout:0/367: dread d0/d1/d2c/d42/f58 [0,4194304] 0 2024-04-26T12:06:55.870 INFO:tasks.workunit.client.0.smithi052.stdout:4/329: write d3/f9 [4282512,65754] 0 2024-04-26T12:06:55.872 INFO:tasks.workunit.client.0.smithi052.stdout:4/330: rename d3/ce to d3/d15/c73 0 2024-04-26T12:06:55.873 INFO:tasks.workunit.client.0.smithi052.stdout:4/331: chown d3/d15/d53 5359 1 2024-04-26T12:06:55.874 INFO:tasks.workunit.client.0.smithi052.stdout:8/292: dread d0/f44 [0,4194304] 0 2024-04-26T12:06:55.875 INFO:tasks.workunit.client.0.smithi052.stdout:3/324: truncate d2/d4/dc/f1b 2981808 0 2024-04-26T12:06:55.877 INFO:tasks.workunit.client.0.smithi052.stdout:1/311: dwrite d0/d2/f10 [0,4194304] 0 2024-04-26T12:06:55.878 INFO:tasks.workunit.client.0.smithi052.stdout:5/339: dwrite db/dc/d5f/f3a [0,4194304] 0 2024-04-26T12:06:55.879 INFO:tasks.workunit.client.0.smithi052.stdout:8/293: chown d0/d4/d5/db/d20 0 1 2024-04-26T12:06:55.879 INFO:tasks.workunit.client.0.smithi052.stdout:4/332: rename d3/f14 to d3/d22/d30/d71/f74 0 2024-04-26T12:06:55.879 INFO:tasks.workunit.client.0.smithi052.stdout:7/315: write d1/d1c/d21/d2f/f54 [579567,87254] 0 2024-04-26T12:06:55.880 INFO:tasks.workunit.client.0.smithi052.stdout:5/340: dread - db/dc/d5f/f49 zero size 2024-04-26T12:06:55.880 INFO:tasks.workunit.client.0.smithi052.stdout:0/368: dwrite d0/d1/d1a/f64 [0,4194304] 0 2024-04-26T12:06:55.880 INFO:tasks.workunit.client.0.smithi052.stdout:1/312: rmdir d0/d2/dd/d40 39 2024-04-26T12:06:55.882 INFO:tasks.workunit.client.0.smithi052.stdout:7/316: truncate d1/f47 841598 0 2024-04-26T12:06:55.882 INFO:tasks.workunit.client.0.smithi052.stdout:3/325: link d2/d4/dc/d33/d37/f51 d2/d4/dc/d1d/d43/f5f 0 2024-04-26T12:06:55.883 INFO:tasks.workunit.client.0.smithi052.stdout:5/341: rename db/dc/d29 to db/dd/d34/d70 0 2024-04-26T12:06:55.883 INFO:tasks.workunit.client.0.smithi052.stdout:7/317: sync 2024-04-26T12:06:55.883 INFO:tasks.workunit.client.0.smithi052.stdout:6/331: dread da/d22/d29/f4c [0,4194304] 0 2024-04-26T12:06:55.883 INFO:tasks.workunit.client.0.smithi052.stdout:3/326: write d2/f3d [85829,105992] 0 2024-04-26T12:06:55.884 INFO:tasks.workunit.client.0.smithi052.stdout:5/342: stat db/dc 0 2024-04-26T12:06:55.884 INFO:tasks.workunit.client.0.smithi052.stdout:0/369: symlink d0/d1/d2c/l71 0 2024-04-26T12:06:55.884 INFO:tasks.workunit.client.0.smithi052.stdout:8/294: getdents d0/d4/d5/d27 0 2024-04-26T12:06:55.884 INFO:tasks.workunit.client.0.smithi052.stdout:1/313: rename d0/da/d2e/c35 to d0/d2/de/c6f 0 2024-04-26T12:06:55.886 INFO:tasks.workunit.client.0.smithi052.stdout:6/332: mknod da/d22/d29/d31/d6f/c75 0 2024-04-26T12:06:55.886 INFO:tasks.workunit.client.0.smithi052.stdout:9/369: dread d3/db/d24/f2c [0,4194304] 0 2024-04-26T12:06:55.887 INFO:tasks.workunit.client.0.smithi052.stdout:6/333: symlink da/d51/l76 0 2024-04-26T12:06:55.888 INFO:tasks.workunit.client.0.smithi052.stdout:0/370: getdents d0/d1/d1a/d20/d47 0 2024-04-26T12:06:55.888 INFO:tasks.workunit.client.0.smithi052.stdout:9/370: fdatasync d3/db/d4a/f78 0 2024-04-26T12:06:55.888 INFO:tasks.workunit.client.0.smithi052.stdout:1/314: fsync d0/d2/de/d4b/d60/f3b 0 2024-04-26T12:06:55.889 INFO:tasks.workunit.client.0.smithi052.stdout:6/334: rename da/c18 to da/c77 0 2024-04-26T12:06:55.890 INFO:tasks.workunit.client.0.smithi052.stdout:3/327: truncate d2/d4/dc/d1d/d25/d36/d1c/f20 1597034 0 2024-04-26T12:06:55.890 INFO:tasks.workunit.client.0.smithi052.stdout:0/371: mkdir d0/d1/dd/d72 0 2024-04-26T12:06:55.890 INFO:tasks.workunit.client.0.smithi052.stdout:1/315: chown d0/d2/de/f2d 0 1 2024-04-26T12:06:55.891 INFO:tasks.workunit.client.0.smithi052.stdout:7/318: truncate d1/f6 522374 0 2024-04-26T12:06:55.891 INFO:tasks.workunit.client.0.smithi052.stdout:9/371: chown d3/db/d10/d3c/d40/f42 47 1 2024-04-26T12:06:55.891 INFO:tasks.workunit.client.0.smithi052.stdout:6/335: stat da/d22/d29/l2a 0 2024-04-26T12:06:55.892 INFO:tasks.workunit.client.0.smithi052.stdout:3/328: chown d2/d4/dc/d1d/d25 18 1 2024-04-26T12:06:55.892 INFO:tasks.workunit.client.0.smithi052.stdout:1/316: chown d0/d2/de/f44 51704962 1 2024-04-26T12:06:55.892 INFO:tasks.workunit.client.0.smithi052.stdout:7/319: fdatasync d1/d45/d4c/f4f 0 2024-04-26T12:06:55.893 INFO:tasks.workunit.client.0.smithi052.stdout:8/295: dwrite d0/d16/f46 [0,4194304] 0 2024-04-26T12:06:55.894 INFO:tasks.workunit.client.0.smithi052.stdout:5/343: dwrite db/dc/d5f/f49 [0,4194304] 0 2024-04-26T12:06:55.894 INFO:tasks.workunit.client.0.smithi052.stdout:6/336: write da/f12 [768809,70110] 0 2024-04-26T12:06:55.894 INFO:tasks.workunit.client.0.smithi052.stdout:7/320: creat d1/d1c/d21/f67 x:0 0 0 2024-04-26T12:06:55.895 INFO:tasks.workunit.client.0.smithi052.stdout:1/317: stat d0/d2/dd/d34 0 2024-04-26T12:06:55.895 INFO:tasks.workunit.client.0.smithi052.stdout:3/329: creat d2/d4/dc/d1d/f60 x:0 0 0 2024-04-26T12:06:55.898 INFO:tasks.workunit.client.0.smithi052.stdout:9/372: rename d3/d1b/l41 to d3/d1b/d49/l7c 0 2024-04-26T12:06:55.898 INFO:tasks.workunit.client.0.smithi052.stdout:6/337: unlink da/d22/d6d/l73 0 2024-04-26T12:06:55.898 INFO:tasks.workunit.client.0.smithi052.stdout:8/296: rename d0/d4 to d0/d4/d53 22 2024-04-26T12:06:55.898 INFO:tasks.workunit.client.0.smithi052.stdout:2/392: dread d0/d7/d16/f1c [0,4194304] 0 2024-04-26T12:06:55.900 INFO:tasks.workunit.client.0.smithi052.stdout:0/372: dwrite d0/d1/f41 [4194304,4194304] 0 2024-04-26T12:06:55.900 INFO:tasks.workunit.client.0.smithi052.stdout:3/330: mkdir d2/d4/dc/d1d/d25/d61 0 2024-04-26T12:06:55.900 INFO:tasks.workunit.client.0.smithi052.stdout:6/338: creat da/d63/f78 x:0 0 0 2024-04-26T12:06:55.902 INFO:tasks.workunit.client.0.smithi052.stdout:5/344: rename db/f26 to db/dd/d18/f71 0 2024-04-26T12:06:55.902 INFO:tasks.workunit.client.0.smithi052.stdout:8/297: getdents d0/d4/d5 0 2024-04-26T12:06:55.902 INFO:tasks.workunit.client.0.smithi052.stdout:0/373: mknod d0/d3c/c73 0 2024-04-26T12:06:55.903 INFO:tasks.workunit.client.0.smithi052.stdout:1/318: rename d0/d2/de/f2d to d0/d2/de/d4b/f70 0 2024-04-26T12:06:55.903 INFO:tasks.workunit.client.0.smithi052.stdout:3/331: mknod d2/d4/c62 0 2024-04-26T12:06:55.904 INFO:tasks.workunit.client.0.smithi052.stdout:4/333: dread d3/d12/f20 [0,4194304] 0 2024-04-26T12:06:55.906 INFO:tasks.workunit.client.0.smithi052.stdout:9/373: dwrite d3/db/d13/f51 [0,4194304] 0 2024-04-26T12:06:55.907 INFO:tasks.workunit.client.0.smithi052.stdout:1/319: symlink d0/d2/dd/d40/l71 0 2024-04-26T12:06:55.910 INFO:tasks.workunit.client.0.smithi052.stdout:5/345: truncate db/dc/d5f/f2f 2366577 0 2024-04-26T12:06:55.911 INFO:tasks.workunit.client.0.smithi052.stdout:9/374: mknod d3/db/d10/d2e/c7d 0 2024-04-26T12:06:55.911 INFO:tasks.workunit.client.0.smithi052.stdout:2/393: dwrite d0/d7/d16/f1c [0,4194304] 0 2024-04-26T12:06:55.911 INFO:tasks.workunit.client.0.smithi052.stdout:1/320: chown d0/d2/de/f5f 94576746 1 2024-04-26T12:06:55.912 INFO:tasks.workunit.client.0.smithi052.stdout:3/332: creat d2/d4/dc/d1d/d25/d61/f63 x:0 0 0 2024-04-26T12:06:55.912 INFO:tasks.workunit.client.0.smithi052.stdout:4/334: link d3/d22/d30/f70 d3/d44/d4b/f75 0 2024-04-26T12:06:55.914 INFO:tasks.workunit.client.0.smithi052.stdout:8/298: dwrite d0/d4/d5/f11 [0,4194304] 0 2024-04-26T12:06:55.915 INFO:tasks.workunit.client.0.smithi052.stdout:4/335: fdatasync d3/d15/f17 0 2024-04-26T12:06:55.915 INFO:tasks.workunit.client.0.smithi052.stdout:9/375: truncate d3/db/d4a/f4d 796661 0 2024-04-26T12:06:55.916 INFO:tasks.workunit.client.0.smithi052.stdout:6/339: dwrite da/d22/d29/f38 [0,4194304] 0 2024-04-26T12:06:55.918 INFO:tasks.workunit.client.0.smithi052.stdout:0/374: dwrite d0/d1/f13 [0,4194304] 0 2024-04-26T12:06:55.921 INFO:tasks.workunit.client.0.smithi052.stdout:5/346: rename db/dd/d18/d60/d64/c6a to db/dd/d18/c72 0 2024-04-26T12:06:55.921 INFO:tasks.workunit.client.0.smithi052.stdout:6/340: mknod da/d22/d29/d31/d6f/c79 0 2024-04-26T12:06:55.923 INFO:tasks.workunit.client.0.smithi052.stdout:4/336: getdents d3/d12/d34/d45 0 2024-04-26T12:06:55.924 INFO:tasks.workunit.client.0.smithi052.stdout:6/341: stat da/d22/d29/f4c 0 2024-04-26T12:06:55.924 INFO:tasks.workunit.client.0.smithi052.stdout:8/299: rename d0/d4/d5/db/c47 to d0/d16/d28/c54 0 2024-04-26T12:06:55.926 INFO:tasks.workunit.client.0.smithi052.stdout:5/347: creat db/dd/f73 x:0 0 0 2024-04-26T12:06:55.926 INFO:tasks.workunit.client.0.smithi052.stdout:4/337: mkdir d3/d15/d76 0 2024-04-26T12:06:55.927 INFO:tasks.workunit.client.0.smithi052.stdout:1/321: dwrite d0/d2/dd/f32 [0,4194304] 0 2024-04-26T12:06:55.927 INFO:tasks.workunit.client.0.smithi052.stdout:1/322: sync 2024-04-26T12:06:55.929 INFO:tasks.workunit.client.0.smithi052.stdout:2/394: dwrite d0/d3f/d56/f64 [0,4194304] 0 2024-04-26T12:06:55.929 INFO:tasks.workunit.client.0.smithi052.stdout:3/333: dwrite d2/d4/dc/d33/d37/f3a [4194304,4194304] 0 2024-04-26T12:06:55.929 INFO:tasks.workunit.client.0.smithi052.stdout:6/342: write da/f20 [1306030,117064] 0 2024-04-26T12:06:55.930 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:55.928+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:55.930 INFO:tasks.workunit.client.0.smithi052.stdout:8/300: creat d0/d4/d5/d3c/f55 x:0 0 0 2024-04-26T12:06:55.933 INFO:tasks.workunit.client.0.smithi052.stdout:1/323: write d0/da/f19 [3098519,10989] 0 2024-04-26T12:06:55.933 INFO:tasks.workunit.client.0.smithi052.stdout:9/376: dwrite d3/db/d10/d2e/f71 [0,4194304] 0 2024-04-26T12:06:55.933 INFO:tasks.workunit.client.0.smithi052.stdout:8/301: unlink d0/d16/d28/f32 0 2024-04-26T12:06:55.933 INFO:tasks.workunit.client.0.smithi052.stdout:5/348: truncate db/f38 2421690 0 2024-04-26T12:06:55.933 INFO:tasks.workunit.client.0.smithi052.stdout:7/321: dread d1/fa [0,4194304] 0 2024-04-26T12:06:55.934 INFO:tasks.workunit.client.0.smithi052.stdout:0/375: dwrite d0/d26/d36/f63 [0,4194304] 0 2024-04-26T12:06:55.934 INFO:tasks.workunit.client.0.smithi052.stdout:4/338: write d3/d2e/f3a [1159041,15023] 0 2024-04-26T12:06:55.934 INFO:tasks.workunit.client.0.smithi052.stdout:6/343: readlink da/d22/d29/d31/l5f 0 2024-04-26T12:06:55.937 INFO:tasks.workunit.client.0.smithi052.stdout:1/324: creat d0/da/d3a/d52/f72 x:0 0 0 2024-04-26T12:06:55.938 INFO:tasks.workunit.client.0.smithi052.stdout:0/376: mkdir d0/d26/d74 0 2024-04-26T12:06:55.938 INFO:tasks.workunit.client.0.smithi052.stdout:8/302: mknod d0/d16/d28/c56 0 2024-04-26T12:06:55.938 INFO:tasks.workunit.client.0.smithi052.stdout:4/339: creat d3/d22/d30/d71/f77 x:0 0 0 2024-04-26T12:06:55.938 INFO:tasks.workunit.client.0.smithi052.stdout:9/377: truncate d3/db/d10/d3c/d40/f42 2064213 0 2024-04-26T12:06:55.939 INFO:tasks.workunit.client.0.smithi052.stdout:6/344: mkdir da/d22/d29/d31/d6f/d7a 0 2024-04-26T12:06:55.939 INFO:tasks.workunit.client.0.smithi052.stdout:7/322: getdents d1/d1c/d65 0 2024-04-26T12:06:55.939 INFO:tasks.workunit.client.0.smithi052.stdout:0/377: dread - d0/d1/d11/f69 zero size 2024-04-26T12:06:55.940 INFO:tasks.workunit.client.0.smithi052.stdout:2/395: dwrite d0/d7/d2f/d3d/f48 [0,4194304] 0 2024-04-26T12:06:55.941 INFO:tasks.workunit.client.0.smithi052.stdout:8/303: mkdir d0/d4/d5/d27/d57 0 2024-04-26T12:06:55.941 INFO:tasks.workunit.client.0.smithi052.stdout:4/340: creat d3/d22/d30/d71/f78 x:0 0 0 2024-04-26T12:06:55.942 INFO:tasks.workunit.client.0.smithi052.stdout:9/378: dread - d3/db/d10/d2e/f77 zero size 2024-04-26T12:06:55.944 INFO:tasks.workunit.client.0.smithi052.stdout:7/323: chown d1/d1f/f22 2 1 2024-04-26T12:06:55.945 INFO:tasks.workunit.client.0.smithi052.stdout:3/334: truncate d2/d4/dc/d1d/f32 3986973 0 2024-04-26T12:06:55.945 INFO:tasks.workunit.client.0.smithi052.stdout:4/341: chown d3/c37 0 1 2024-04-26T12:06:55.946 INFO:tasks.workunit.client.0.smithi052.stdout:0/378: chown d0/d1/f13 107380110 1 2024-04-26T12:06:55.946 INFO:tasks.workunit.client.0.smithi052.stdout:5/349: dwrite db/dc/d5f/d3f/f58 [0,4194304] 0 2024-04-26T12:06:55.946 INFO:tasks.workunit.client.0.smithi052.stdout:1/325: rename d0/d2/de/c5a to d0/d2/dd/d1c/d1d/d23/c73 0 2024-04-26T12:06:55.947 INFO:tasks.workunit.client.0.smithi052.stdout:8/304: mkdir d0/d4/dc/d45/d58 0 2024-04-26T12:06:55.949 INFO:tasks.workunit.client.0.smithi052.stdout:7/324: mkdir d1/d1c/d21/d2f/d68 0 2024-04-26T12:06:55.949 INFO:tasks.workunit.client.0.smithi052.stdout:5/350: chown db/c1a 281720472 1 2024-04-26T12:06:55.950 INFO:tasks.workunit.client.0.smithi052.stdout:4/342: creat d3/d12/d64/f79 x:0 0 0 2024-04-26T12:06:55.950 INFO:tasks.workunit.client.0.smithi052.stdout:1/326: truncate d0/d2/dd/f6e 635210 0 2024-04-26T12:06:55.950 INFO:tasks.workunit.client.0.smithi052.stdout:9/379: rmdir d3/db/d10/d3c/d40 39 2024-04-26T12:06:55.951 INFO:tasks.workunit.client.0.smithi052.stdout:8/305: rmdir d0/d4/d5/db/d1b 0 2024-04-26T12:06:55.952 INFO:tasks.workunit.client.0.smithi052.stdout:7/325: readlink d1/d1c/d21/d2f/d33/l43 0 2024-04-26T12:06:55.952 INFO:tasks.workunit.client.0.smithi052.stdout:1/327: write d0/d2/f6 [7097986,85069] 0 2024-04-26T12:06:55.952 INFO:tasks.workunit.client.0.smithi052.stdout:4/343: mknod d3/d12/d34/d43/c7a 0 2024-04-26T12:06:55.954 INFO:tasks.workunit.client.0.smithi052.stdout:9/380: symlink d3/db/d10/d54/l7e 0 2024-04-26T12:06:55.954 INFO:tasks.workunit.client.0.smithi052.stdout:3/335: write d2/d4/dc/d1d/d25/f3b [3116006,49166] 0 2024-04-26T12:06:55.955 INFO:tasks.workunit.client.0.smithi052.stdout:4/344: unlink d3/f9 0 2024-04-26T12:06:55.955 INFO:tasks.workunit.client.0.smithi052.stdout:0/379: dwrite d0/d3d/f3f [4194304,4194304] 0 2024-04-26T12:06:55.955 INFO:tasks.workunit.client.0.smithi052.stdout:7/326: read d1/f18 [1751611,60035] 0 2024-04-26T12:06:55.956 INFO:tasks.workunit.client.0.smithi052.stdout:4/345: stat d3/d2b/d40/f5b 0 2024-04-26T12:06:55.957 INFO:tasks.workunit.client.0.smithi052.stdout:0/380: chown d0/l60 2442053 1 2024-04-26T12:06:55.958 INFO:tasks.workunit.client.0.smithi052.stdout:7/327: mknod d1/d1c/c69 0 2024-04-26T12:06:55.958 INFO:tasks.workunit.client.0.smithi052.stdout:3/336: rename d2/f38 to d2/d4/f64 0 2024-04-26T12:06:55.959 INFO:tasks.workunit.client.0.smithi052.stdout:4/346: creat d3/d12/d34/d43/f7b x:0 0 0 2024-04-26T12:06:55.959 INFO:tasks.workunit.client.0.smithi052.stdout:5/351: dwrite db/f1f [0,4194304] 0 2024-04-26T12:06:55.960 INFO:tasks.workunit.client.0.smithi052.stdout:7/328: stat d1/d1c/d21/d2f/d68 0 2024-04-26T12:06:55.960 INFO:tasks.workunit.client.0.smithi052.stdout:9/381: rename d3/db/d24 to d3/d23/d7f 0 2024-04-26T12:06:55.961 INFO:tasks.workunit.client.0.smithi052.stdout:5/352: chown c9 1780236 1 2024-04-26T12:06:55.961 INFO:tasks.workunit.client.0.smithi052.stdout:4/347: creat d3/d22/d69/f7c x:0 0 0 2024-04-26T12:06:55.961 INFO:tasks.workunit.client.0.smithi052.stdout:8/306: dwrite d0/d16/f1a [0,4194304] 0 2024-04-26T12:06:55.961 INFO:tasks.workunit.client.0.smithi052.stdout:3/337: symlink d2/d4/dc/d1d/d25/d36/l65 0 2024-04-26T12:06:55.962 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:55.962 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:06:55.962 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:06:55.962 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:06:55.962 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:55.963 INFO:tasks.workunit.client.0.smithi052.stdout:8/307: fdatasync d0/f44 0 2024-04-26T12:06:55.963 INFO:tasks.workunit.client.0.smithi052.stdout:9/382: mknod d3/db/d10/d54/c80 0 2024-04-26T12:06:55.963 INFO:tasks.workunit.client.0.smithi052.stdout:7/329: creat d1/d1c/d21/d2f/d33/f6a x:0 0 0 2024-04-26T12:06:55.963 INFO:tasks.workunit.client.0.smithi052.stdout:8/308: stat d0/d4/c10 0 2024-04-26T12:06:55.964 INFO:tasks.workunit.client.0.smithi052.stdout:3/338: rename d2/ff to d2/d4/d41/f66 0 2024-04-26T12:06:55.967 INFO:tasks.workunit.client.0.smithi052.stdout:9/383: link d3/d23/c4b d3/db/d10/c81 0 2024-04-26T12:06:55.967 INFO:tasks.workunit.client.0.smithi052.stdout:7/330: rename d1/d1c/d21/d2f/c3d to d1/d45/d4c/d4d/c6b 0 2024-04-26T12:06:55.967 INFO:tasks.workunit.client.0.smithi052.stdout:3/339: symlink d2/d4/dc/d1d/d25/d36/d1c/l67 0 2024-04-26T12:06:55.967 INFO:tasks.workunit.client.0.smithi052.stdout:9/384: mkdir d3/d82 0 2024-04-26T12:06:55.967 INFO:tasks.workunit.client.0.smithi052.stdout:7/331: symlink d1/d1c/d23/l6c 0 2024-04-26T12:06:55.967 INFO:tasks.workunit.client.0.smithi052.stdout:3/340: mkdir d2/d4/dc/d68 0 2024-04-26T12:06:55.967 INFO:tasks.workunit.client.0.smithi052.stdout:3/341: stat d2/d4/dc 0 2024-04-26T12:06:55.967 INFO:tasks.workunit.client.0.smithi052.stdout:7/332: symlink d1/d1c/d23/l6d 0 2024-04-26T12:06:55.968 INFO:tasks.workunit.client.0.smithi052.stdout:3/342: rmdir d2/d4/d41 39 2024-04-26T12:06:55.970 INFO:tasks.workunit.client.0.smithi052.stdout:8/309: read d0/d4/f4d [53350,76185] 0 2024-04-26T12:06:55.972 INFO:tasks.workunit.client.0.smithi052.stdout:8/310: chown d0/d4/f30 0 1 2024-04-26T12:06:55.974 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:55.975 INFO:tasks.workunit.client.0.smithi052.stdout:4/348: dwrite d3/d12/f1e [0,4194304] 0 2024-04-26T12:06:55.975 INFO:tasks.workunit.client.0.smithi052.stdout:8/311: creat d0/f59 x:0 0 0 2024-04-26T12:06:55.975 INFO:tasks.workunit.client.0.smithi052.stdout:3/343: dwrite d2/d4/f3e [0,4194304] 0 2024-04-26T12:06:55.975 INFO:tasks.workunit.client.0.smithi052.stdout:3/344: stat d2/c49 0 2024-04-26T12:06:55.978 INFO:tasks.workunit.client.0.smithi052.stdout:1/328: dread d0/da/d3a/f63 [0,4194304] 0 2024-04-26T12:06:55.979 INFO:tasks.workunit.client.0.smithi052.stdout:6/345: dread da/f16 [0,4194304] 0 2024-04-26T12:06:55.980 INFO:tasks.workunit.client.0.smithi052.stdout:2/396: dread d0/fa [0,4194304] 0 2024-04-26T12:06:55.980 INFO:tasks.workunit.client.0.smithi052.stdout:1/329: stat d0/d2/de/d4b/l6a 0 2024-04-26T12:06:55.982 INFO:tasks.workunit.client.0.smithi052.stdout:6/346: write da/f12 [1321956,80371] 0 2024-04-26T12:06:55.982 INFO:tasks.workunit.client.0.smithi052.stdout:8/312: dwrite d0/f59 [0,4194304] 0 2024-04-26T12:06:55.983 INFO:tasks.workunit.client.0.smithi052.stdout:4/349: dwrite d3/d12/d34/d45/f51 [0,4194304] 0 2024-04-26T12:06:55.984 INFO:tasks.workunit.client.0.smithi052.stdout:7/333: dwrite d1/d1c/d23/f25 [0,4194304] 0 2024-04-26T12:06:55.984 INFO:tasks.workunit.client.0.smithi052.stdout:6/347: symlink da/d22/d29/l7b 0 2024-04-26T12:06:55.985 INFO:tasks.workunit.client.0.smithi052.stdout:1/330: creat d0/d2/de/d4b/d56/f74 x:0 0 0 2024-04-26T12:06:55.988 INFO:tasks.workunit.client.0.smithi052.stdout:4/350: creat d3/d2b/f7d x:0 0 0 2024-04-26T12:06:55.989 INFO:tasks.workunit.client.0.smithi052.stdout:7/334: link d1/d1f/l2d d1/d1c/l6e 0 2024-04-26T12:06:55.989 INFO:tasks.workunit.client.0.smithi052.stdout:1/331: symlink d0/d2/l75 0 2024-04-26T12:06:55.989 INFO:tasks.workunit.client.0.smithi052.stdout:7/335: creat d1/d1c/d23/f6f x:0 0 0 2024-04-26T12:06:55.990 INFO:tasks.workunit.client.0.smithi052.stdout:7/336: read d1/d1c/d23/f25 [2916923,88427] 0 2024-04-26T12:06:55.990 INFO:tasks.workunit.client.0.smithi052.stdout:2/397: read d0/d7/d53/f6b [61725,66766] 0 2024-04-26T12:06:55.991 INFO:tasks.workunit.client.0.smithi052.stdout:7/337: creat d1/d45/d4c/d4d/f70 x:0 0 0 2024-04-26T12:06:55.991 INFO:tasks.workunit.client.0.smithi052.stdout:2/398: readlink d0/d7/d16/l7d 0 2024-04-26T12:06:55.991 INFO:tasks.workunit.client.0.smithi052.stdout:1/332: rmdir d0/da/d3a 39 2024-04-26T12:06:55.993 INFO:tasks.workunit.client.0.smithi052.stdout:2/399: unlink d0/d7/d2f/d3d/f48 0 2024-04-26T12:06:55.994 INFO:tasks.workunit.client.0.smithi052.stdout:2/400: rename d0/d3f/d56/d6d/d5a/d73/d4b/c79 to d0/d3f/d56/d6d/d5a/d73/d4b/c7f 0 2024-04-26T12:06:55.995 INFO:tasks.workunit.client.0.smithi052.stdout:2/401: link d0/f33 d0/d3f/f80 0 2024-04-26T12:06:55.995 INFO:tasks.workunit.client.0.smithi052.stdout:2/402: chown d0/f15 3978981 1 2024-04-26T12:06:55.996 INFO:tasks.workunit.client.0.smithi052.stdout:2/403: rename d0/d7/l32 to d0/d3f/d56/l81 0 2024-04-26T12:06:55.997 INFO:tasks.workunit.client.0.smithi052.stdout:2/404: rmdir d0/d77 0 2024-04-26T12:06:56.000 INFO:tasks.workunit.client.0.smithi052.stdout:1/333: dread d0/d2/de/d4b/f70 [0,4194304] 0 2024-04-26T12:06:56.000 INFO:tasks.workunit.client.0.smithi052.stdout:0/381: sync 2024-04-26T12:06:56.006 INFO:tasks.workunit.client.0.smithi052.stdout:0/382: rmdir d0/d1/d1a/d2a/d32 39 2024-04-26T12:06:56.007 INFO:tasks.workunit.client.0.smithi052.stdout:1/334: dwrite d0/f68 [0,4194304] 0 2024-04-26T12:06:56.007 INFO:tasks.workunit.client.0.smithi052.stdout:8/313: dread d0/d16/f23 [0,4194304] 0 2024-04-26T12:06:56.007 INFO:tasks.workunit.client.0.smithi052.stdout:8/314: mknod d0/d4/dc/d45/c5a 0 2024-04-26T12:06:56.007 INFO:tasks.workunit.client.0.smithi052.stdout:8/315: readlink d0/d16/l1d 0 2024-04-26T12:06:56.008 INFO:tasks.workunit.client.0.smithi052.stdout:8/316: creat d0/d4/dc/d45/d58/f5b x:0 0 0 2024-04-26T12:06:56.009 INFO:tasks.workunit.client.0.smithi052.stdout:2/405: dwrite d0/d7/f10 [0,4194304] 0 2024-04-26T12:06:56.009 INFO:tasks.workunit.client.0.smithi052.stdout:8/317: symlink d0/l5c 0 2024-04-26T12:06:56.010 INFO:tasks.workunit.client.0.smithi052.stdout:2/406: mkdir d0/d3f/d56/d6d/d5a/d82 0 2024-04-26T12:06:56.011 INFO:tasks.workunit.client.0.smithi052.stdout:8/318: getdents d0/d4/d1c 0 2024-04-26T12:06:56.011 INFO:tasks.workunit.client.0.smithi052.stdout:8/319: creat d0/d4/d5/d3c/f5d x:0 0 0 2024-04-26T12:06:56.012 INFO:tasks.workunit.client.0.smithi052.stdout:2/407: link d0/d3f/d56/d6d/d5a/f69 d0/d7/f83 0 2024-04-26T12:06:56.012 INFO:tasks.workunit.client.0.smithi052.stdout:8/320: read d0/d4/f30 [403612,122164] 0 2024-04-26T12:06:56.013 INFO:tasks.workunit.client.0.smithi052.stdout:1/335: dwrite d0/d2/dd/d1c/d1d/f50 [0,4194304] 0 2024-04-26T12:06:56.014 INFO:tasks.workunit.client.0.smithi052.stdout:1/336: chown d0/f67 18549682 1 2024-04-26T12:06:56.014 INFO:tasks.workunit.client.0.smithi052.stdout:8/321: link d0/d4/d5/fe d0/d4/d5/db/f5e 0 2024-04-26T12:06:56.015 INFO:tasks.workunit.client.0.smithi052.stdout:1/337: rename d0/f3f to d0/da/d2e/f76 0 2024-04-26T12:06:56.018 INFO:tasks.workunit.client.0.smithi052.stdout:1/338: creat d0/d2/dd/d40/f77 x:0 0 0 2024-04-26T12:06:56.018 INFO:tasks.workunit.client.0.smithi052.stdout:2/408: truncate d0/d7/d16/f38 989117 0 2024-04-26T12:06:56.018 INFO:tasks.workunit.client.0.smithi052.stdout:6/348: sync 2024-04-26T12:06:56.018 INFO:tasks.workunit.client.0.smithi052.stdout:7/338: sync 2024-04-26T12:06:56.018 INFO:tasks.workunit.client.0.smithi052.stdout:3/345: sync 2024-04-26T12:06:56.018 INFO:tasks.workunit.client.0.smithi052.stdout:5/353: sync 2024-04-26T12:06:56.018 INFO:tasks.workunit.client.0.smithi052.stdout:4/351: sync 2024-04-26T12:06:56.018 INFO:tasks.workunit.client.0.smithi052.stdout:9/385: sync 2024-04-26T12:06:56.019 INFO:tasks.workunit.client.0.smithi052.stdout:0/383: sync 2024-04-26T12:06:56.019 INFO:tasks.workunit.client.0.smithi052.stdout:2/409: fdatasync d0/f12 0 2024-04-26T12:06:56.019 INFO:tasks.workunit.client.0.smithi052.stdout:8/322: symlink d0/d4/d5/db/d20/d41/l5f 0 2024-04-26T12:06:56.019 INFO:tasks.workunit.client.0.smithi052.stdout:5/354: fdatasync db/dc/d5f/f49 0 2024-04-26T12:06:56.020 INFO:tasks.workunit.client.0.smithi052.stdout:7/339: mknod d1/d1c/c71 0 2024-04-26T12:06:56.020 INFO:tasks.workunit.client.0.smithi052.stdout:9/386: rmdir d3/db 39 2024-04-26T12:06:56.020 INFO:tasks.workunit.client.0.smithi052.stdout:4/352: mknod d3/d12/c7e 0 2024-04-26T12:06:56.020 INFO:tasks.workunit.client.0.smithi052.stdout:0/384: truncate d0/d1/d11/f4a 837945 0 2024-04-26T12:06:56.020 INFO:tasks.workunit.client.0.smithi052.stdout:6/349: write da/d63/f6a [62697,61539] 0 2024-04-26T12:06:56.020 INFO:tasks.workunit.client.0.smithi052.stdout:7/340: truncate d1/f20 5226357 0 2024-04-26T12:06:56.021 INFO:tasks.workunit.client.0.smithi052.stdout:1/339: write d0/d2/de/d4b/d56/f5d [4938668,2735] 0 2024-04-26T12:06:56.021 INFO:tasks.workunit.client.0.smithi052.stdout:9/387: mknod d3/db/c83 0 2024-04-26T12:06:56.022 INFO:tasks.workunit.client.0.smithi052.stdout:7/341: fsync d1/f47 0 2024-04-26T12:06:56.022 INFO:tasks.workunit.client.0.smithi052.stdout:0/385: symlink d0/d1/d2c/d42/d70/l75 0 2024-04-26T12:06:56.022 INFO:tasks.workunit.client.0.smithi052.stdout:6/350: mkdir da/d22/d3c/d6e/d7c 0 2024-04-26T12:06:56.024 INFO:tasks.workunit.client.0.smithi052.stdout:9/388: creat d3/db/d2b/f84 x:0 0 0 2024-04-26T12:06:56.024 INFO:tasks.workunit.client.0.smithi052.stdout:1/340: mkdir d0/da/d2e/d78 0 2024-04-26T12:06:56.024 INFO:tasks.workunit.client.0.smithi052.stdout:7/342: creat d1/d1f/f72 x:0 0 0 2024-04-26T12:06:56.025 INFO:tasks.workunit.client.0.smithi052.stdout:0/386: rename d0/l60 to d0/d26/l76 0 2024-04-26T12:06:56.026 INFO:tasks.workunit.client.0.smithi052.stdout:6/351: truncate da/d22/f3b 1008961 0 2024-04-26T12:06:56.026 INFO:tasks.workunit.client.0.smithi052.stdout:7/343: dread - d1/f35 zero size 2024-04-26T12:06:56.027 INFO:tasks.workunit.client.0.smithi052.stdout:5/355: dread db/dc/d5f/d3f/f58 [0,4194304] 0 2024-04-26T12:06:56.027 INFO:tasks.workunit.client.0.smithi052.stdout:1/341: chown d0/d2/de/d4b/d56/f6d 12 1 2024-04-26T12:06:56.027 INFO:tasks.workunit.client.0.smithi052.stdout:8/323: dwrite d0/d4/f26 [0,4194304] 0 2024-04-26T12:06:56.027 INFO:tasks.workunit.client.0.smithi052.stdout:2/410: dwrite d0/d3f/d56/d6d/f70 [0,4194304] 0 2024-04-26T12:06:56.028 INFO:tasks.workunit.client.0.smithi052.stdout:6/352: chown da/f1d 5785 1 2024-04-26T12:06:56.028 INFO:tasks.workunit.client.0.smithi052.stdout:0/387: unlink d0/d3c/f6c 0 2024-04-26T12:06:56.028 INFO:tasks.workunit.client.0.smithi052.stdout:6/353: fdatasync da/f1e 0 2024-04-26T12:06:56.029 INFO:tasks.workunit.client.0.smithi052.stdout:3/346: write d2/d4/dc/d1d/f32 [4468171,27780] 0 2024-04-26T12:06:56.031 INFO:tasks.workunit.client.0.smithi052.stdout:8/324: unlink d0/d4/d5/d27/l3b 0 2024-04-26T12:06:56.032 INFO:tasks.workunit.client.0.smithi052.stdout:1/342: creat d0/d1e/f79 x:0 0 0 2024-04-26T12:06:56.033 INFO:tasks.workunit.client.0.smithi052.stdout:8/325: symlink d0/d4/dc/l60 0 2024-04-26T12:06:56.033 INFO:tasks.workunit.client.0.smithi052.stdout:3/347: write d2/d4/dc/d1d/d25/d36/d1c/f20 [1558825,88625] 0 2024-04-26T12:06:56.034 INFO:tasks.workunit.client.0.smithi052.stdout:5/356: dread db/dc/d5f/f49 [0,4194304] 0 2024-04-26T12:06:56.034 INFO:tasks.workunit.client.0.smithi052.stdout:1/343: rename d0/d2/dd/l36 to d0/l7a 0 2024-04-26T12:06:56.034 INFO:tasks.workunit.client.0.smithi052.stdout:8/326: creat d0/d4/d5/f61 x:0 0 0 2024-04-26T12:06:56.035 INFO:tasks.workunit.client.0.smithi052.stdout:6/354: dread da/f1e [0,4194304] 0 2024-04-26T12:06:56.035 INFO:tasks.workunit.client.0.smithi052.stdout:1/344: unlink d0/d2/dd/c6b 0 2024-04-26T12:06:56.035 INFO:tasks.workunit.client.0.smithi052.stdout:8/327: symlink d0/l62 0 2024-04-26T12:06:56.036 INFO:tasks.workunit.client.0.smithi052.stdout:5/357: rename db/dc/d5f/d63 to db/dc/d5f/d50/d46/d74 0 2024-04-26T12:06:56.037 INFO:tasks.workunit.client.0.smithi052.stdout:6/355: creat da/d22/d3c/d6e/d7c/f7d x:0 0 0 2024-04-26T12:06:56.037 INFO:tasks.workunit.client.0.smithi052.stdout:2/411: truncate d0/d7/d53/f6b 103925 0 2024-04-26T12:06:56.038 INFO:tasks.workunit.client.0.smithi052.stdout:1/345: symlink d0/d2/de/d4b/d60/l7b 0 2024-04-26T12:06:56.039 INFO:tasks.workunit.client.0.smithi052.stdout:6/356: fdatasync da/f1c 0 2024-04-26T12:06:56.040 INFO:tasks.workunit.client.0.smithi052.stdout:2/412: readlink d0/d7/d16/l5c 0 2024-04-26T12:06:56.041 INFO:tasks.workunit.client.0.smithi052.stdout:6/357: read - da/d22/d3c/f66 zero size 2024-04-26T12:06:56.042 INFO:tasks.workunit.client.0.smithi052.stdout:5/358: link db/dd/c41 db/dc/d5f/d50/d46/c75 0 2024-04-26T12:06:56.042 INFO:tasks.workunit.client.0.smithi052.stdout:1/346: symlink d0/d2/de/d4b/d60/l7c 0 2024-04-26T12:06:56.042 INFO:tasks.workunit.client.0.smithi052.stdout:3/348: dwrite d2/f2f [4194304,4194304] 0 2024-04-26T12:06:56.043 INFO:tasks.workunit.client.0.smithi052.stdout:0/388: dwrite d0/d1/d1a/d20/f6e [0,4194304] 0 2024-04-26T12:06:56.044 INFO:tasks.workunit.client.0.smithi052.stdout:1/347: write d0/d2/dd/f6e [382440,122027] 0 2024-04-26T12:06:56.044 INFO:tasks.workunit.client.0.smithi052.stdout:2/413: rename d0/d36/d57/f58 to d0/d7/d22/f84 0 2024-04-26T12:06:56.045 INFO:tasks.workunit.client.0.smithi052.stdout:5/359: chown db/dc/d5f/d50/c44 8 1 2024-04-26T12:06:56.045 INFO:tasks.workunit.client.0.smithi052.stdout:3/349: write d2/d4/f64 [2146448,22489] 0 2024-04-26T12:06:56.045 INFO:tasks.workunit.client.0.smithi052.stdout:0/389: write d0/d1/dd/f19 [3915103,82065] 0 2024-04-26T12:06:56.046 INFO:tasks.workunit.client.0.smithi052.stdout:8/328: truncate d0/d16/f2a 946932 0 2024-04-26T12:06:56.046 INFO:tasks.workunit.client.0.smithi052.stdout:6/358: rename da/d22/d29/d31/d6f/d7a to da/d22/d3c/d74/d7e 0 2024-04-26T12:06:56.046 INFO:tasks.workunit.client.0.smithi052.stdout:2/414: truncate d0/d36/f7e 374824 0 2024-04-26T12:06:56.047 INFO:tasks.workunit.client.0.smithi052.stdout:1/348: mknod d0/d2/dd/d40/c7d 0 2024-04-26T12:06:56.047 INFO:tasks.workunit.client.0.smithi052.stdout:3/350: write d2/d4/d2a/d2d/f2e [419321,35407] 0 2024-04-26T12:06:56.047 INFO:tasks.workunit.client.0.smithi052.stdout:5/360: creat db/dd/d34/d69/f76 x:0 0 0 2024-04-26T12:06:56.047 INFO:tasks.workunit.client.0.smithi052.stdout:8/329: mkdir d0/d16/d63 0 2024-04-26T12:06:56.053 INFO:tasks.workunit.client.0.smithi052.stdout:8/330: creat d0/f64 x:0 0 0 2024-04-26T12:06:56.055 INFO:tasks.workunit.client.0.smithi052.stdout:5/361: unlink db/d5c/f62 0 2024-04-26T12:06:56.056 INFO:tasks.workunit.client.0.smithi052.stdout:9/389: dread d3/db/d13/f29 [0,4194304] 0 2024-04-26T12:06:56.057 INFO:tasks.workunit.client.0.smithi052.stdout:0/390: dwrite d0/f3 [0,4194304] 0 2024-04-26T12:06:56.058 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:56.057+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:56.059 INFO:tasks.workunit.client.0.smithi052.stdout:2/415: dwrite d0/d36/f45 [0,4194304] 0 2024-04-26T12:06:56.060 INFO:tasks.workunit.client.0.smithi052.stdout:1/349: dwrite d0/da/d3a/f63 [0,4194304] 0 2024-04-26T12:06:56.060 INFO:tasks.workunit.client.0.smithi052.stdout:7/344: dread d1/d1c/f1e [0,4194304] 0 2024-04-26T12:06:56.061 INFO:tasks.workunit.client.0.smithi052.stdout:0/391: mknod d0/d3c/c77 0 2024-04-26T12:06:56.061 INFO:tasks.workunit.client.0.smithi052.stdout:5/362: chown db/dc/d5f/d50/d46/c75 22114 1 2024-04-26T12:06:56.061 INFO:tasks.workunit.client.0.smithi052.stdout:3/351: dwrite d2/d4/d2a/d2d/f2e [0,4194304] 0 2024-04-26T12:06:56.061 INFO:tasks.workunit.client.0.smithi052.stdout:2/416: chown d0/d7/d16/d3a 23 1 2024-04-26T12:06:56.062 INFO:tasks.workunit.client.0.smithi052.stdout:1/350: symlink d0/d2/l7e 0 2024-04-26T12:06:56.063 INFO:tasks.workunit.client.0.smithi052.stdout:0/392: chown d0/d26/d74 3 1 2024-04-26T12:06:56.064 INFO:tasks.workunit.client.0.smithi052.stdout:3/352: symlink d2/d4/dc/l69 0 2024-04-26T12:06:56.065 INFO:tasks.workunit.client.0.smithi052.stdout:0/393: readlink d0/d1/d1a/d20/l27 0 2024-04-26T12:06:56.065 INFO:tasks.workunit.client.0.smithi052.stdout:6/359: dwrite f2 [0,4194304] 0 2024-04-26T12:06:56.066 INFO:tasks.workunit.client.0.smithi052.stdout:2/417: creat d0/d3f/d56/d6d/d5a/d73/f85 x:0 0 0 2024-04-26T12:06:56.067 INFO:tasks.workunit.client.0.smithi052.stdout:1/351: unlink d0/d2/dd/d34/d3e/c42 0 2024-04-26T12:06:56.067 INFO:tasks.workunit.client.0.smithi052.stdout:0/394: fdatasync d0/f49 0 2024-04-26T12:06:56.069 INFO:tasks.workunit.client.0.smithi052.stdout:3/353: chown d2/d4/d41/d5c/c5d 5 1 2024-04-26T12:06:56.070 INFO:tasks.workunit.client.0.smithi052.stdout:9/390: dread d3/f7 [0,4194304] 0 2024-04-26T12:06:56.070 INFO:tasks.workunit.client.0.smithi052.stdout:5/363: dread db/dc/d5f/f49 [0,4194304] 0 2024-04-26T12:06:56.071 INFO:tasks.workunit.client.0.smithi052.stdout:6/360: chown da/d22/l28 390917135 1 2024-04-26T12:06:56.071 INFO:tasks.workunit.client.0.smithi052.stdout:2/418: fdatasync d0/d7/d16/f1c 0 2024-04-26T12:06:56.071 INFO:tasks.workunit.client.0.smithi052.stdout:7/345: dwrite d1/ff [0,4194304] 0 2024-04-26T12:06:56.072 INFO:tasks.workunit.client.0.smithi052.stdout:3/354: fsync d2/d4/d2a/f58 0 2024-04-26T12:06:56.072 INFO:tasks.workunit.client.0.smithi052.stdout:2/419: mkdir d0/d7/d22/d86 0 2024-04-26T12:06:56.073 INFO:tasks.workunit.client.0.smithi052.stdout:9/391: write d3/db/d10/d54/f56 [4021765,71585] 0 2024-04-26T12:06:56.073 INFO:tasks.workunit.client.0.smithi052.stdout:5/364: write db/dc/d5f/d3f/f5d [930913,48233] 0 2024-04-26T12:06:56.075 INFO:tasks.workunit.client.0.smithi052.stdout:2/420: creat d0/d7/d22/f87 x:0 0 0 2024-04-26T12:06:56.075 INFO:tasks.workunit.client.0.smithi052.stdout:3/355: unlink d2/d4/dc/d1d/d43/c46 0 2024-04-26T12:06:56.079 INFO:tasks.workunit.client.0.smithi052.stdout:5/365: readlink db/dc/d5f/l3c 0 2024-04-26T12:06:56.080 INFO:tasks.workunit.client.0.smithi052.stdout:8/331: dwrite d0/d4/d5/db/f5e [0,4194304] 0 2024-04-26T12:06:56.081 INFO:tasks.workunit.client.0.smithi052.stdout:2/421: creat d0/d3f/d56/d6d/d5a/f88 x:0 0 0 2024-04-26T12:06:56.081 INFO:tasks.workunit.client.0.smithi052.stdout:0/395: dwrite d0/d26/d36/f63 [0,4194304] 0 2024-04-26T12:06:56.081 INFO:tasks.workunit.client.0.smithi052.stdout:9/392: write d3/db/d10/d2e/f71 [4222867,89250] 0 2024-04-26T12:06:56.082 INFO:tasks.workunit.client.0.smithi052.stdout:1/352: dwrite d0/d2/dd/d40/f77 [0,4194304] 0 2024-04-26T12:06:56.084 INFO:tasks.workunit.client.0.smithi052.stdout:6/361: dwrite f2 [4194304,4194304] 0 2024-04-26T12:06:56.084 INFO:tasks.workunit.client.0.smithi052.stdout:5/366: symlink db/dd/d18/d60/d64/l77 0 2024-04-26T12:06:56.084 INFO:tasks.workunit.client.0.smithi052.stdout:2/422: symlink d0/d3f/d56/d6d/l89 0 2024-04-26T12:06:56.084 INFO:tasks.workunit.client.0.smithi052.stdout:8/332: mknod d0/d16/d28/c65 0 2024-04-26T12:06:56.084 INFO:tasks.workunit.client.0.smithi052.stdout:3/356: rename d2/d4/dc/d1d/d43 to d2/d4/d31/d6a 0 2024-04-26T12:06:56.086 INFO:tasks.workunit.client.0.smithi052.stdout:7/346: dwrite d1/d1c/d21/d2f/f38 [0,4194304] 0 2024-04-26T12:06:56.086 INFO:tasks.workunit.client.0.smithi052.stdout:2/423: creat d0/d7/d16/d3a/f8a x:0 0 0 2024-04-26T12:06:56.087 INFO:tasks.workunit.client.0.smithi052.stdout:6/362: unlink da/d22/d3c/f40 0 2024-04-26T12:06:56.087 INFO:tasks.workunit.client.0.smithi052.stdout:8/333: unlink d0/d4/l3f 0 2024-04-26T12:06:56.087 INFO:tasks.workunit.client.0.smithi052.stdout:9/393: rename d3/db/d10/f18 to d3/db/d10/f85 0 2024-04-26T12:06:56.087 INFO:tasks.workunit.client.0.smithi052.stdout:5/367: write db/dc/d5f/d3f/f58 [5127732,26446] 0 2024-04-26T12:06:56.089 INFO:tasks.workunit.client.0.smithi052.stdout:9/394: dread - d3/d1b/f6f zero size 2024-04-26T12:06:56.090 INFO:tasks.workunit.client.0.smithi052.stdout:7/347: link d1/d45/d4c/f4f d1/d1c/d21/f73 0 2024-04-26T12:06:56.090 INFO:tasks.workunit.client.0.smithi052.stdout:6/363: creat da/d22/d29/d31/f7f x:0 0 0 2024-04-26T12:06:56.090 INFO:tasks.workunit.client.0.smithi052.stdout:8/334: truncate d0/d3e/f4a 257064 0 2024-04-26T12:06:56.091 INFO:tasks.workunit.client.0.smithi052.stdout:5/368: mkdir db/dd/d34/d70/d78 0 2024-04-26T12:06:56.091 INFO:tasks.workunit.client.0.smithi052.stdout:1/353: dread d0/d2/dd/d1c/f57 [0,4194304] 0 2024-04-26T12:06:56.093 INFO:tasks.workunit.client.0.smithi052.stdout:0/396: dwrite d0/d26/d36/f4c [0,4194304] 0 2024-04-26T12:06:56.093 INFO:tasks.workunit.client.0.smithi052.stdout:7/348: chown d1/d1c/d21/d2f/d68 1947043 1 2024-04-26T12:06:56.094 INFO:tasks.workunit.client.0.smithi052.stdout:8/335: creat d0/f66 x:0 0 0 2024-04-26T12:06:56.094 INFO:tasks.workunit.client.0.smithi052.stdout:6/364: fdatasync da/d22/d29/d31/f4f 0 2024-04-26T12:06:56.094 INFO:tasks.workunit.client.0.smithi052.stdout:5/369: fdatasync db/dc/d5f/f2f 0 2024-04-26T12:06:56.095 INFO:tasks.workunit.client.0.smithi052.stdout:9/395: rename d3/d1b/l67 to d3/db/d10/d2e/d5c/l86 0 2024-04-26T12:06:56.095 INFO:tasks.workunit.client.0.smithi052.stdout:6/365: chown da/f1e 872 1 2024-04-26T12:06:56.095 INFO:tasks.workunit.client.0.smithi052.stdout:1/354: write d0/d2/de/d4b/f70 [358217,48485] 0 2024-04-26T12:06:56.096 INFO:tasks.workunit.client.0.smithi052.stdout:7/349: stat d1/d1c/l6e 0 2024-04-26T12:06:56.096 INFO:tasks.workunit.client.0.smithi052.stdout:0/397: readlink d0/d1/d1a/d20/l27 0 2024-04-26T12:06:56.096 INFO:tasks.workunit.client.0.smithi052.stdout:8/336: symlink d0/d16/d28/l67 0 2024-04-26T12:06:56.096 INFO:tasks.workunit.client.0.smithi052.stdout:5/370: stat db/dd/d18/c72 0 2024-04-26T12:06:56.097 INFO:tasks.workunit.client.0.smithi052.stdout:7/350: readlink d1/d1f/l2a 0 2024-04-26T12:06:56.097 INFO:tasks.workunit.client.0.smithi052.stdout:9/396: creat d3/f87 x:0 0 0 2024-04-26T12:06:56.097 INFO:tasks.workunit.client.0.smithi052.stdout:8/337: unlink d0/d4/d5/db/l3a 0 2024-04-26T12:06:56.098 INFO:tasks.workunit.client.0.smithi052.stdout:1/355: unlink d0/da/d2e/f76 0 2024-04-26T12:06:56.098 INFO:tasks.workunit.client.0.smithi052.stdout:7/351: dread - d1/d1c/d21/f67 zero size 2024-04-26T12:06:56.099 INFO:tasks.workunit.client.0.smithi052.stdout:2/424: dwrite d0/d7/f83 [0,4194304] 0 2024-04-26T12:06:56.099 INFO:tasks.workunit.client.0.smithi052.stdout:5/371: creat db/dc/d5f/d50/d46/f79 x:0 0 0 2024-04-26T12:06:56.099 INFO:tasks.workunit.client.0.smithi052.stdout:9/397: chown d3/f7 7382642 1 2024-04-26T12:06:56.100 INFO:tasks.workunit.client.0.smithi052.stdout:2/425: write d0/d7/d22/f23 [323561,123430] 0 2024-04-26T12:06:56.100 INFO:tasks.workunit.client.0.smithi052.stdout:7/352: symlink d1/d45/d4c/l74 0 2024-04-26T12:06:56.100 INFO:tasks.workunit.client.0.smithi052.stdout:5/372: write db/dc/d5f/f36 [1391335,30284] 0 2024-04-26T12:06:56.101 INFO:tasks.workunit.client.0.smithi052.stdout:7/353: chown d1/d1c/d23/l30 1062421 1 2024-04-26T12:06:56.102 INFO:tasks.workunit.client.0.smithi052.stdout:1/356: read d0/d2/f24 [3858159,103929] 0 2024-04-26T12:06:56.102 INFO:tasks.workunit.client.0.smithi052.stdout:2/426: getdents d0/d7/d53 0 2024-04-26T12:06:56.102 INFO:tasks.workunit.client.0.smithi052.stdout:7/354: chown d1/d1c/d21/d2f/l34 14309 1 2024-04-26T12:06:56.102 INFO:tasks.workunit.client.0.smithi052.stdout:6/366: read da/d22/d29/d31/d39/f48 [19676,88495] 0 2024-04-26T12:06:56.103 INFO:tasks.workunit.client.0.smithi052.stdout:1/357: write d0/d2/f6 [1405262,58047] 0 2024-04-26T12:06:56.103 INFO:tasks.workunit.client.0.smithi052.stdout:6/367: readlink da/le 0 2024-04-26T12:06:56.103 INFO:tasks.workunit.client.0.smithi052.stdout:7/355: write d1/d1c/d21/f53 [909199,120248] 0 2024-04-26T12:06:56.104 INFO:tasks.workunit.client.0.smithi052.stdout:2/427: rename d0/d7/d22/d86 to d0/d7/d16/d4d/d8b 0 2024-04-26T12:06:56.104 INFO:tasks.workunit.client.0.smithi052.stdout:1/358: readlink d0/d2/dd/l39 0 2024-04-26T12:06:56.104 INFO:tasks.workunit.client.0.smithi052.stdout:6/368: rmdir da/d22/d29/d31/d6f 39 2024-04-26T12:06:56.104 INFO:tasks.workunit.client.0.smithi052.stdout:7/356: fdatasync d1/d1c/d21/d2f/f4e 0 2024-04-26T12:06:56.105 INFO:tasks.workunit.client.0.smithi052.stdout:6/369: rename da to da/d22/d3c/d6e/d7c/d80 22 2024-04-26T12:06:56.105 INFO:tasks.workunit.client.0.smithi052.stdout:7/357: write d1/f35 [35302,46015] 0 2024-04-26T12:06:56.105 INFO:tasks.workunit.client.0.smithi052.stdout:6/370: stat da/f1d 0 2024-04-26T12:06:56.106 INFO:tasks.workunit.client.0.smithi052.stdout:9/398: write d3/db/d10/d3c/d40/f42 [2620977,92565] 0 2024-04-26T12:06:56.106 INFO:tasks.workunit.client.0.smithi052.stdout:7/358: read d1/d1c/f1e [1336938,105223] 0 2024-04-26T12:06:56.108 INFO:tasks.workunit.client.0.smithi052.stdout:9/399: dread - d3/db/d10/d55/f6e zero size 2024-04-26T12:06:56.108 INFO:tasks.workunit.client.0.smithi052.stdout:0/398: dwrite d0/d1/d1a/f4b [4194304,4194304] 0 2024-04-26T12:06:56.109 INFO:tasks.workunit.client.0.smithi052.stdout:9/400: readlink d3/d1b/d49/l74 0 2024-04-26T12:06:56.110 INFO:tasks.workunit.client.0.smithi052.stdout:5/373: write db/dc/d5f/f2f [2324874,77315] 0 2024-04-26T12:06:56.111 INFO:tasks.workunit.client.0.smithi052.stdout:2/428: write d0/d7/d16/f1a [3957965,116829] 0 2024-04-26T12:06:56.111 INFO:tasks.workunit.client.0.smithi052.stdout:0/399: creat d0/d1/d1a/d2a/d32/f78 x:0 0 0 2024-04-26T12:06:56.111 INFO:tasks.workunit.client.0.smithi052.stdout:7/359: write d1/d1c/d21/f73 [129024,47049] 0 2024-04-26T12:06:56.113 INFO:tasks.workunit.client.0.smithi052.stdout:6/371: dwrite da/f1e [4194304,4194304] 0 2024-04-26T12:06:56.114 INFO:tasks.workunit.client.0.smithi052.stdout:9/401: link d3/db/d10/f38 d3/d23/f88 0 2024-04-26T12:06:56.115 INFO:tasks.workunit.client.0.smithi052.stdout:0/400: mkdir d0/d1/dd/d79 0 2024-04-26T12:06:56.115 INFO:tasks.workunit.client.0.smithi052.stdout:7/360: chown d1/f17 2190665 1 2024-04-26T12:06:56.115 INFO:tasks.workunit.client.0.smithi052.stdout:5/374: creat db/dc/d5f/f7a x:0 0 0 2024-04-26T12:06:56.117 INFO:tasks.workunit.client.0.smithi052.stdout:0/401: fdatasync d0/d1/d1a/d20/f3a 0 2024-04-26T12:06:56.117 INFO:tasks.workunit.client.0.smithi052.stdout:3/357: dread d2/d4/dc/d1d/d25/d36/d1c/f4a [0,4194304] 0 2024-04-26T12:06:56.117 INFO:tasks.workunit.client.0.smithi052.stdout:2/429: getdents d0/d7/d2f/d4c 0 2024-04-26T12:06:56.117 INFO:tasks.workunit.client.0.smithi052.stdout:6/372: rmdir da/d22/d6d 0 2024-04-26T12:06:56.117 INFO:tasks.workunit.client.0.smithi052.stdout:5/375: creat db/dd/d34/d70/f7b x:0 0 0 2024-04-26T12:06:56.117 INFO:tasks.workunit.client.0.smithi052.stdout:9/402: creat d3/db/d10/d54/f89 x:0 0 0 2024-04-26T12:06:56.118 INFO:tasks.workunit.client.0.smithi052.stdout:7/361: rename d1/d1c/d21/d2f/d33 to d1/d1c/d21/d2f/d33/d3a/d75 22 2024-04-26T12:06:56.118 INFO:tasks.workunit.client.0.smithi052.stdout:6/373: symlink da/d5d/d64/d68/l81 0 2024-04-26T12:06:56.118 INFO:tasks.workunit.client.0.smithi052.stdout:5/376: chown db/l14 3911252 1 2024-04-26T12:06:56.119 INFO:tasks.workunit.client.0.smithi052.stdout:1/359: dwrite d0/d2/dd/f14 [0,4194304] 0 2024-04-26T12:06:56.121 INFO:tasks.workunit.client.0.smithi052.stdout:6/374: mknod da/d22/d3c/c82 0 2024-04-26T12:06:56.121 INFO:tasks.workunit.client.0.smithi052.stdout:9/403: rmdir d3/db/d10/d55 39 2024-04-26T12:06:56.122 INFO:tasks.workunit.client.0.smithi052.stdout:7/362: rename d1/d1c/d21/c32 to d1/d1c/d21/d2f/d68/c76 0 2024-04-26T12:06:56.124 INFO:tasks.workunit.client.0.smithi052.stdout:6/375: rmdir da/d22/d3c/d6e/d7c 39 2024-04-26T12:06:56.124 INFO:tasks.workunit.client.0.smithi052.stdout:8/338: dread d0/d4/d1c/f36 [0,4194304] 0 2024-04-26T12:06:56.124 INFO:tasks.workunit.client.0.smithi052.stdout:5/377: truncate db/dc/d5f/f49 1359471 0 2024-04-26T12:06:56.125 INFO:tasks.workunit.client.0.smithi052.stdout:9/404: chown d3/db/d10/c81 6249568 1 2024-04-26T12:06:56.125 INFO:tasks.workunit.client.0.smithi052.stdout:8/339: chown d0/d4/dc/d45 926099 1 2024-04-26T12:06:56.126 INFO:tasks.workunit.client.0.smithi052.stdout:0/402: dwrite d0/d1/d11/f17 [4194304,4194304] 0 2024-04-26T12:06:56.126 INFO:tasks.workunit.client.0.smithi052.stdout:7/363: creat d1/d1c/d21/d2f/d33/d3a/d64/f77 x:0 0 0 2024-04-26T12:06:56.126 INFO:tasks.workunit.client.0.smithi052.stdout:2/430: dwrite d0/d7/f39 [0,4194304] 0 2024-04-26T12:06:56.127 INFO:tasks.workunit.client.0.smithi052.stdout:7/364: stat d1/d1f/f60 0 2024-04-26T12:06:56.127 INFO:tasks.workunit.client.0.smithi052.stdout:3/358: dread d2/d4/dc/d1d/d25/d36/d1c/f4a [0,4194304] 0 2024-04-26T12:06:56.128 INFO:tasks.workunit.client.0.smithi052.stdout:0/403: stat d0/d1/d1a/d20/f3a 0 2024-04-26T12:06:56.130 INFO:tasks.workunit.client.0.smithi052.stdout:2/431: fsync d0/d7/fe 0 2024-04-26T12:06:56.130 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:56.129+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:56.131 INFO:tasks.workunit.client.0.smithi052.stdout:3/359: mkdir d2/d4/d6b 0 2024-04-26T12:06:56.132 INFO:tasks.workunit.client.0.smithi052.stdout:1/360: dwrite d0/d2/f2a [0,4194304] 0 2024-04-26T12:06:56.134 INFO:tasks.workunit.client.0.smithi052.stdout:5/378: link db/dc/d5f/l45 db/dc/d5f/d50/d46/d74/l7c 0 2024-04-26T12:06:56.135 INFO:tasks.workunit.client.0.smithi052.stdout:7/365: link d1/d1c/d21/d2f/d33/f6a d1/d1c/d23/f78 0 2024-04-26T12:06:56.135 INFO:tasks.workunit.client.0.smithi052.stdout:6/376: dwrite da/d22/d29/f2e [0,4194304] 0 2024-04-26T12:06:56.135 INFO:tasks.workunit.client.0.smithi052.stdout:2/432: write d0/d7/d53/f6e [895707,65631] 0 2024-04-26T12:06:56.136 INFO:tasks.workunit.client.0.smithi052.stdout:7/366: chown d1 3033427 1 2024-04-26T12:06:56.136 INFO:tasks.workunit.client.0.smithi052.stdout:3/360: readlink d2/d4/dc/d1d/d25/d36/d1c/l67 0 2024-04-26T12:06:56.136 INFO:tasks.workunit.client.0.smithi052.stdout:9/405: dwrite d3/db/d2b/f84 [0,4194304] 0 2024-04-26T12:06:56.136 INFO:tasks.workunit.client.0.smithi052.stdout:2/433: mkdir d0/d7/d2f/d8c 0 2024-04-26T12:06:56.137 INFO:tasks.workunit.client.0.smithi052.stdout:5/379: truncate db/dc/f54 624685 0 2024-04-26T12:06:56.137 INFO:tasks.workunit.client.0.smithi052.stdout:6/377: fsync da/d22/d29/d31/f4f 0 2024-04-26T12:06:56.137 INFO:tasks.workunit.client.0.smithi052.stdout:1/361: chown d0/d2/de/d4b/d60/l7b 1640 1 2024-04-26T12:06:56.137 INFO:tasks.workunit.client.0.smithi052.stdout:3/361: read d2/f2f [7582608,25874] 0 2024-04-26T12:06:56.138 INFO:tasks.workunit.client.0.smithi052.stdout:5/380: mkdir db/dd/d18/d60/d7d 0 2024-04-26T12:06:56.138 INFO:tasks.workunit.client.0.smithi052.stdout:7/367: truncate d1/d45/d4c/f4f 922384 0 2024-04-26T12:06:56.139 INFO:tasks.workunit.client.0.smithi052.stdout:6/378: read - da/d22/d29/d31/f49 zero size 2024-04-26T12:06:56.139 INFO:tasks.workunit.client.0.smithi052.stdout:2/434: rename d0/d36/d57 to d0/d3f/d56/d8d 0 2024-04-26T12:06:56.139 INFO:tasks.workunit.client.0.smithi052.stdout:8/340: dwrite d0/d4/d5/db/f5e [0,4194304] 0 2024-04-26T12:06:56.140 INFO:tasks.workunit.client.0.smithi052.stdout:7/368: fdatasync d1/d1f/f60 0 2024-04-26T12:06:56.140 INFO:tasks.workunit.client.0.smithi052.stdout:5/381: symlink db/l7e 0 2024-04-26T12:06:56.142 INFO:tasks.workunit.client.0.smithi052.stdout:8/341: rmdir d0/d4/d5/d3c 39 2024-04-26T12:06:56.142 INFO:tasks.workunit.client.0.smithi052.stdout:2/435: mknod d0/d7/d2f/d4c/c8e 0 2024-04-26T12:06:56.143 INFO:tasks.workunit.client.0.smithi052.stdout:0/404: read d0/d1/d2c/d42/f58 [32379,110028] 0 2024-04-26T12:06:56.143 INFO:tasks.workunit.client.0.smithi052.stdout:9/406: dread d3/db/d2b/f84 [0,4194304] 0 2024-04-26T12:06:56.143 INFO:tasks.workunit.client.0.smithi052.stdout:5/382: rename db/dc/d5f/c22 to db/dd/c7f 0 2024-04-26T12:06:56.144 INFO:tasks.workunit.client.0.smithi052.stdout:7/369: link d1/d1c/d21/f73 d1/d45/d4c/d4d/f79 0 2024-04-26T12:06:56.145 INFO:tasks.workunit.client.0.smithi052.stdout:1/362: dwrite d0/d2/dd/d34/f4e [0,4194304] 0 2024-04-26T12:06:56.145 INFO:tasks.workunit.client.0.smithi052.stdout:2/436: truncate d0/d7/f3c 1005780 0 2024-04-26T12:06:56.146 INFO:tasks.workunit.client.0.smithi052.stdout:7/370: mknod d1/c7a 0 2024-04-26T12:06:56.146 INFO:tasks.workunit.client.0.smithi052.stdout:4/353: sync 2024-04-26T12:06:56.147 INFO:tasks.workunit.client.0.smithi052.stdout:2/437: chown d0/d7/d2f/f78 28614253 1 2024-04-26T12:06:56.148 INFO:tasks.workunit.client.0.smithi052.stdout:7/371: write d1/ff [4154565,99660] 0 2024-04-26T12:06:56.150 INFO:tasks.workunit.client.0.smithi052.stdout:8/342: dwrite d0/f64 [0,4194304] 0 2024-04-26T12:06:56.150 INFO:tasks.workunit.client.0.smithi052.stdout:1/363: rename d0/d2/dd/d1c/d3c/c59 to d0/d2/dd/d1c/d1d/d23/c7f 0 2024-04-26T12:06:56.151 INFO:tasks.workunit.client.0.smithi052.stdout:2/438: mkdir d0/d3f/d56/d6d/d5a/d73/d4b/d8f 0 2024-04-26T12:06:56.152 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:56.152 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:56.152 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:56.152 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:56.152 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.152 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:10941 4.c 4:31ba13fb:::100000031a6.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:56.152 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:54.655373+0000", 2024-04-26T12:06:56.152 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 1.492685797, 2024-04-26T12:06:56.152 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.024374114999999998, 2024-04-26T12:06:56.152 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:56.153 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.153 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:56.153 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:56.153 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:56.153 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 10941 2024-04-26T12:06:56.153 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.153 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:56.153 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.153 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:56.153 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.655373+0000", 2024-04-26T12:06:56.153 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.153 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.153 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.153 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:56.154 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.655373+0000", 2024-04-26T12:06:56.154 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.154 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.154 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.154 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:56.154 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.655373+0000", 2024-04-26T12:06:56.154 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:56.154 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.154 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.154 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:56.154 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.662000+0000", 2024-04-26T12:06:56.154 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066275600000000002 2024-04-26T12:06:56.154 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.154 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.154 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:56.155 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.662014+0000", 2024-04-26T12:06:56.155 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3713999999999999e-05 2024-04-26T12:06:56.155 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.155 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.155 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.155 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.662022+0000", 2024-04-26T12:06:56.155 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4619999999999996e-06 2024-04-26T12:06:56.155 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.155 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.155 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:56.155 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.662087+0000", 2024-04-26T12:06:56.155 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5053000000000002e-05 2024-04-26T12:06:56.155 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.155 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.155 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:56.156 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.662260+0000", 2024-04-26T12:06:56.156 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000172249 2024-04-26T12:06:56.156 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.156 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.156 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:56.156 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.662422+0000", 2024-04-26T12:06:56.156 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016228600000000001 2024-04-26T12:06:56.156 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.156 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.156 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:56.156 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.669518+0000", 2024-04-26T12:06:56.156 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070963559999999998 2024-04-26T12:06:56.156 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.156 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.156 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:56.157 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.679691+0000", 2024-04-26T12:06:56.157 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010172924 2024-04-26T12:06:56.157 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.157 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.157 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:56.157 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.679723+0000", 2024-04-26T12:06:56.157 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1711999999999997e-05 2024-04-26T12:06:56.157 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.157 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.157 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:56.157 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.679747+0000", 2024-04-26T12:06:56.157 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4324e-05 2024-04-26T12:06:56.157 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.157 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:56.158 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.158 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.158 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.158 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11032 4.39 4:9dcc5ecf:::1000000316e.00000000:head [write 0~3014656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:56.158 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:54.772805+0000", 2024-04-26T12:06:56.158 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 1.3752535080000001, 2024-04-26T12:06:56.158 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.022448862, 2024-04-26T12:06:56.158 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:56.158 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.158 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:56.158 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:56.158 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:56.158 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11032 2024-04-26T12:06:56.158 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.158 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:56.159 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.159 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:56.159 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.772805+0000", 2024-04-26T12:06:56.159 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.159 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.159 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.159 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:56.159 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.772805+0000", 2024-04-26T12:06:56.159 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.159 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.159 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.159 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:56.159 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.772805+0000", 2024-04-26T12:06:56.159 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:56.160 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.160 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.160 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:56.160 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.778514+0000", 2024-04-26T12:06:56.160 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057088080000000001 2024-04-26T12:06:56.160 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.160 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.160 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:56.160 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.778524+0000", 2024-04-26T12:06:56.160 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6919999999999997e-06 2024-04-26T12:06:56.160 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.160 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.160 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.160 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.778528+0000", 2024-04-26T12:06:56.160 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3719999999999998e-06 2024-04-26T12:06:56.161 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.161 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.161 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:56.161 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.778602+0000", 2024-04-26T12:06:56.161 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4214999999999993e-05 2024-04-26T12:06:56.161 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.161 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.161 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:56.161 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.778699+0000", 2024-04-26T12:06:56.161 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7029999999999998e-05 2024-04-26T12:06:56.161 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.161 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.161 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:56.161 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.778784+0000", 2024-04-26T12:06:56.162 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4858000000000006e-05 2024-04-26T12:06:56.162 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.162 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.162 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:56.162 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.781179+0000", 2024-04-26T12:06:56.162 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023949510000000002 2024-04-26T12:06:56.162 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.162 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.162 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:56.162 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.795094+0000", 2024-04-26T12:06:56.162 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013915072000000001 2024-04-26T12:06:56.162 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.162 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.162 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:56.163 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.795219+0000", 2024-04-26T12:06:56.163 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012454 2024-04-26T12:06:56.163 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.163 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.163 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:56.163 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.795254+0000", 2024-04-26T12:06:56.163 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5685999999999997e-05 2024-04-26T12:06:56.163 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.163 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:56.163 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.163 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.163 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.163 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11070 4.30 4:0f7270e5:::100000031f4.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:56.163 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:54.817765+0000", 2024-04-26T12:06:56.164 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 1.3302944290000001, 2024-04-26T12:06:56.164 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.021136005999999999, 2024-04-26T12:06:56.164 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:56.164 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.164 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:56.164 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:56.164 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:56.164 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11070 2024-04-26T12:06:56.164 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.164 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:56.164 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.164 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:56.164 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.817765+0000", 2024-04-26T12:06:56.165 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.165 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.165 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.165 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:56.165 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.817765+0000", 2024-04-26T12:06:56.165 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.165 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.165 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.165 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:56.165 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.817764+0000", 2024-04-26T12:06:56.165 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:56.165 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.165 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.165 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:56.166 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.822550+0000", 2024-04-26T12:06:56.166 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047862169999999997 2024-04-26T12:06:56.166 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.166 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.166 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:56.166 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.822563+0000", 2024-04-26T12:06:56.166 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3144e-05 2024-04-26T12:06:56.166 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.166 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.166 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.166 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.822570+0000", 2024-04-26T12:06:56.166 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9720000000000003e-06 2024-04-26T12:06:56.167 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.167 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.167 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:56.167 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.822630+0000", 2024-04-26T12:06:56.167 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9552000000000002e-05 2024-04-26T12:06:56.167 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.167 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.167 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:56.167 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.822791+0000", 2024-04-26T12:06:56.167 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000161285 2024-04-26T12:06:56.167 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.167 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.167 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:56.167 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.822965+0000", 2024-04-26T12:06:56.168 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017386499999999999 2024-04-26T12:06:56.168 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.168 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.168 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:56.168 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.830221+0000", 2024-04-26T12:06:56.168 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072562549999999996 2024-04-26T12:06:56.168 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.168 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.168 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:56.168 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.838808+0000", 2024-04-26T12:06:56.168 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0085866190000000002 2024-04-26T12:06:56.168 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.168 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.168 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:56.168 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.838861+0000", 2024-04-26T12:06:56.169 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3544000000000001e-05 2024-04-26T12:06:56.169 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.169 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.169 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:56.169 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.838901+0000", 2024-04-26T12:06:56.169 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9084000000000001e-05 2024-04-26T12:06:56.169 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.169 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:56.169 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.169 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.169 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.169 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11245 4.35 4:ae938551:::100000031b5.00000000:head [write 0~4194304 [2@388629]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:56.169 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:55.045091+0000", 2024-04-26T12:06:56.169 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 1.1029680319999999, 2024-04-26T12:06:56.170 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028137703, 2024-04-26T12:06:56.170 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:56.170 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.170 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:56.170 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:56.170 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:56.170 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11245 2024-04-26T12:06:56.170 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.170 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:56.170 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.170 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:56.170 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.045091+0000", 2024-04-26T12:06:56.170 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.170 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.170 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.171 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:56.171 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.045091+0000", 2024-04-26T12:06:56.171 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.171 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.171 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.171 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:56.171 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.045090+0000", 2024-04-26T12:06:56.171 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:56.171 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.171 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.171 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:56.171 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.052909+0000", 2024-04-26T12:06:56.171 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078183969999999995 2024-04-26T12:06:56.171 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.171 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.171 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:56.172 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.052927+0000", 2024-04-26T12:06:56.172 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8887999999999999e-05 2024-04-26T12:06:56.172 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.172 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.172 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.172 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.052934+0000", 2024-04-26T12:06:56.172 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3969999999999999e-06 2024-04-26T12:06:56.172 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.172 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.172 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:56.172 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.052974+0000", 2024-04-26T12:06:56.172 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9681999999999997e-05 2024-04-26T12:06:56.172 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.172 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.172 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:56.173 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.053038+0000", 2024-04-26T12:06:56.173 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4919000000000006e-05 2024-04-26T12:06:56.173 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.173 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.173 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:56.173 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.053137+0000", 2024-04-26T12:06:56.173 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8257999999999993e-05 2024-04-26T12:06:56.173 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.173 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.173 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:56.173 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.056689+0000", 2024-04-26T12:06:56.173 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035521960000000001 2024-04-26T12:06:56.173 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.173 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.173 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:56.174 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.073132+0000", 2024-04-26T12:06:56.174 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016443600999999999 2024-04-26T12:06:56.174 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.174 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.174 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:56.174 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.073194+0000", 2024-04-26T12:06:56.174 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1927999999999994e-05 2024-04-26T12:06:56.174 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.174 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.174 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:56.174 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.073229+0000", 2024-04-26T12:06:56.174 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4190000000000003e-05 2024-04-26T12:06:56.174 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.174 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:56.175 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.175 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.176 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.176 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11251 4.18 4:184fae4a:::1000000316d.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:56.176 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:55.059341+0000", 2024-04-26T12:06:56.176 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 1.088718157, 2024-04-26T12:06:56.176 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.027390274999999999, 2024-04-26T12:06:56.176 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:56.177 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.177 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:56.177 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:56.177 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:56.177 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11251 2024-04-26T12:06:56.177 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.177 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:56.177 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.177 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:56.177 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.059341+0000", 2024-04-26T12:06:56.177 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.177 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.177 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.177 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:56.178 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.059341+0000", 2024-04-26T12:06:56.178 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.178 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.178 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.178 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:56.178 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.059339+0000", 2024-04-26T12:06:56.178 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:56.178 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.178 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.178 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:56.178 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.066860+0000", 2024-04-26T12:06:56.178 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075208380000000002 2024-04-26T12:06:56.178 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.178 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.178 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:56.179 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.066878+0000", 2024-04-26T12:06:56.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7414e-05 2024-04-26T12:06:56.179 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.179 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.179 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.179 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.066887+0000", 2024-04-26T12:06:56.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.8969999999999997e-06 2024-04-26T12:06:56.179 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.179 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.179 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:56.179 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.066995+0000", 2024-04-26T12:06:56.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010816599999999999 2024-04-26T12:06:56.179 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.179 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.179 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:56.180 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.067098+0000", 2024-04-26T12:06:56.180 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000103354 2024-04-26T12:06:56.180 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.180 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.180 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:56.180 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.067263+0000", 2024-04-26T12:06:56.180 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000165021 2024-04-26T12:06:56.180 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.180 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.180 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:56.181 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.078893+0000", 2024-04-26T12:06:56.181 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.011629509999999999 2024-04-26T12:06:56.181 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.181 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.181 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:56.181 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.086675+0000", 2024-04-26T12:06:56.181 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0077823700000000003 2024-04-26T12:06:56.181 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.181 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.182 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:56.182 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.086707+0000", 2024-04-26T12:06:56.182 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2113999999999998e-05 2024-04-26T12:06:56.182 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.182 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.183 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:56.183 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.086731+0000", 2024-04-26T12:06:56.183 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3875000000000001e-05 2024-04-26T12:06:56.183 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.183 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:56.183 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.183 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.183 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.183 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11253 4.30 4:0f7270e5:::100000031f4.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:56.183 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:55.067009+0000", 2024-04-26T12:06:56.183 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 1.081050107, 2024-04-26T12:06:56.183 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.020852518, 2024-04-26T12:06:56.184 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:56.184 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.184 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:56.184 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:56.184 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:56.184 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11253 2024-04-26T12:06:56.184 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.184 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:56.184 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.184 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:56.184 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.067009+0000", 2024-04-26T12:06:56.184 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.184 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.184 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.185 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:56.185 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.067009+0000", 2024-04-26T12:06:56.185 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.185 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.185 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.185 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:56.185 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.067007+0000", 2024-04-26T12:06:56.185 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:56.185 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.185 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.185 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:56.185 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.073530+0000", 2024-04-26T12:06:56.186 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065225090000000001 2024-04-26T12:06:56.186 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.186 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.186 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:56.186 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.073543+0000", 2024-04-26T12:06:56.186 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3390000000000001e-05 2024-04-26T12:06:56.186 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.186 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.186 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.186 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.073551+0000", 2024-04-26T12:06:56.186 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4800000000000004e-06 2024-04-26T12:06:56.186 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.186 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.186 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:56.186 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.073601+0000", 2024-04-26T12:06:56.187 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9917999999999999e-05 2024-04-26T12:06:56.187 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.187 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.187 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:56.187 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.073724+0000", 2024-04-26T12:06:56.187 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012357000000000001 2024-04-26T12:06:56.187 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.187 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.187 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:56.187 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.073876+0000", 2024-04-26T12:06:56.187 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015201200000000001 2024-04-26T12:06:56.187 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.187 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.187 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:56.187 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.079890+0000", 2024-04-26T12:06:56.188 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060135459999999998 2024-04-26T12:06:56.188 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.188 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.188 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:56.188 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.087820+0000", 2024-04-26T12:06:56.188 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079305120000000007 2024-04-26T12:06:56.188 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.188 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.188 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:56.188 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.087844+0000", 2024-04-26T12:06:56.188 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3578999999999999e-05 2024-04-26T12:06:56.188 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.188 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.188 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:56.189 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.087861+0000", 2024-04-26T12:06:56.189 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7448999999999998e-05 2024-04-26T12:06:56.189 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.189 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:56.189 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.189 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.189 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.189 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11391 4.2b 4:d5e3748c:::10000003177.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:56.189 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:55.239584+0000", 2024-04-26T12:06:56.189 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.90847539200000005, 2024-04-26T12:06:56.189 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.025307432000000001, 2024-04-26T12:06:56.189 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:56.189 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.189 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:56.189 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:56.190 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:56.190 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11391 2024-04-26T12:06:56.190 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.190 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:56.190 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.190 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:56.190 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.239584+0000", 2024-04-26T12:06:56.190 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.190 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.190 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.190 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:56.190 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.239584+0000", 2024-04-26T12:06:56.190 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.191 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.191 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.191 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:56.191 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.239583+0000", 2024-04-26T12:06:56.191 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:56.191 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.191 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.191 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:56.191 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.249188+0000", 2024-04-26T12:06:56.191 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096058910000000001 2024-04-26T12:06:56.191 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.191 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.191 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:56.191 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.249201+0000", 2024-04-26T12:06:56.192 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2194e-05 2024-04-26T12:06:56.192 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.192 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.192 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.192 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.249208+0000", 2024-04-26T12:06:56.192 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1269999999999997e-06 2024-04-26T12:06:56.192 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.192 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.192 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:56.192 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.249250+0000", 2024-04-26T12:06:56.192 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1863999999999998e-05 2024-04-26T12:06:56.192 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.192 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.192 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:56.192 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.249395+0000", 2024-04-26T12:06:56.193 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014560800000000001 2024-04-26T12:06:56.193 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.193 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.193 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:56.193 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.249572+0000", 2024-04-26T12:06:56.193 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000177162 2024-04-26T12:06:56.193 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.193 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.193 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:56.193 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.254630+0000", 2024-04-26T12:06:56.193 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050573650000000003 2024-04-26T12:06:56.193 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.193 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.193 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:56.193 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.264808+0000", 2024-04-26T12:06:56.194 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010178008000000001 2024-04-26T12:06:56.194 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.194 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.194 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:56.194 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.264851+0000", 2024-04-26T12:06:56.194 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2840999999999999e-05 2024-04-26T12:06:56.194 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.194 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.194 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:56.194 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.264891+0000", 2024-04-26T12:06:56.194 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0379000000000001e-05 2024-04-26T12:06:56.194 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.198 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:56.198 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.198 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.198 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.198 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11458 4.20 4:056c8c0f:::100000032bf.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:56.198 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:55.309668+0000", 2024-04-26T12:06:56.198 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.838391314, 2024-04-26T12:06:56.198 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.021404586999999999, 2024-04-26T12:06:56.198 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:56.198 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.198 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:56.199 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:56.199 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:56.199 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11458 2024-04-26T12:06:56.199 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.199 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:56.199 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.199 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:56.199 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.309668+0000", 2024-04-26T12:06:56.199 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.199 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.199 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.199 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:56.199 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.309668+0000", 2024-04-26T12:06:56.199 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.200 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.200 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.200 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:56.200 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.309667+0000", 2024-04-26T12:06:56.200 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:56.200 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.200 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.200 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:56.200 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.319289+0000", 2024-04-26T12:06:56.200 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096224320000000002 2024-04-26T12:06:56.200 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.200 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.200 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:56.200 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.319301+0000", 2024-04-26T12:06:56.200 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1762e-05 2024-04-26T12:06:56.201 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.201 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.201 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.201 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.319306+0000", 2024-04-26T12:06:56.201 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4040000000000003e-06 2024-04-26T12:06:56.201 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.201 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.201 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:56.201 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.319335+0000", 2024-04-26T12:06:56.201 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8830999999999999e-05 2024-04-26T12:06:56.201 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.201 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.201 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:56.201 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.319429+0000", 2024-04-26T12:06:56.202 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.3399000000000005e-05 2024-04-26T12:06:56.202 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.202 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.202 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:56.202 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.319502+0000", 2024-04-26T12:06:56.202 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3662e-05 2024-04-26T12:06:56.202 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.202 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.202 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:56.202 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.324460+0000", 2024-04-26T12:06:56.202 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0049573619999999999 2024-04-26T12:06:56.202 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.202 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.202 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:56.202 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.331023+0000", 2024-04-26T12:06:56.203 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065635759999999998 2024-04-26T12:06:56.203 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.203 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.203 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:56.203 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.331051+0000", 2024-04-26T12:06:56.203 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7860000000000001e-05 2024-04-26T12:06:56.203 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.203 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.203 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:56.203 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.331072+0000", 2024-04-26T12:06:56.203 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1157000000000001e-05 2024-04-26T12:06:56.203 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.203 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:56.203 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.203 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.204 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.204 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11470 4.39 4:9dcc5ecf:::1000000316e.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:56.204 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:55.328413+0000", 2024-04-26T12:06:56.204 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.81964597100000003, 2024-04-26T12:06:56.204 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.020453282999999999, 2024-04-26T12:06:56.204 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:56.204 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.204 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:56.204 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:56.204 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:56.204 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11470 2024-04-26T12:06:56.204 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.204 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:56.204 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.204 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:56.205 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.328413+0000", 2024-04-26T12:06:56.205 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.205 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.205 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:56.205 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.328413+0000", 2024-04-26T12:06:56.205 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.205 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.205 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:56.205 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.328412+0000", 2024-04-26T12:06:56.205 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:56.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.206 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.206 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:56.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.336792+0000", 2024-04-26T12:06:56.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0083802049999999999 2024-04-26T12:06:56.206 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.206 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.206 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:56.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.336806+0000", 2024-04-26T12:06:56.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3403e-05 2024-04-26T12:06:56.206 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.206 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.206 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.336812+0000", 2024-04-26T12:06:56.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2199999999999997e-06 2024-04-26T12:06:56.207 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.207 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.207 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:56.207 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.336850+0000", 2024-04-26T12:06:56.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8115999999999999e-05 2024-04-26T12:06:56.207 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.207 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.207 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:56.207 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.336931+0000", 2024-04-26T12:06:56.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1336999999999997e-05 2024-04-26T12:06:56.207 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.207 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.207 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:56.207 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.337026+0000", 2024-04-26T12:06:56.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4253999999999996e-05 2024-04-26T12:06:56.208 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.208 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.208 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:56.208 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.341463+0000", 2024-04-26T12:06:56.208 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044370240000000003 2024-04-26T12:06:56.208 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.208 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.208 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:56.208 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.348775+0000", 2024-04-26T12:06:56.208 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0073120950000000002 2024-04-26T12:06:56.208 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.208 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.208 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:56.208 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.348827+0000", 2024-04-26T12:06:56.209 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2465e-05 2024-04-26T12:06:56.209 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.209 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.209 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:56.209 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.348866+0000", 2024-04-26T12:06:56.209 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8943999999999998e-05 2024-04-26T12:06:56.209 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.209 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:56.209 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.209 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.209 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.209 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11483 4.2b 4:d52318fe:::100000031d9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:56.209 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:55.353948+0000", 2024-04-26T12:06:56.209 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.794111126, 2024-04-26T12:06:56.209 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.02069735, 2024-04-26T12:06:56.209 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:56.210 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.210 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:56.210 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:56.210 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:56.210 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11483 2024-04-26T12:06:56.210 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.210 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:56.210 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.210 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:56.210 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.353948+0000", 2024-04-26T12:06:56.210 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.210 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.210 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.210 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:56.210 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.353948+0000", 2024-04-26T12:06:56.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.211 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.211 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:56.211 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.353947+0000", 2024-04-26T12:06:56.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:56.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.211 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.211 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:56.211 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.361875+0000", 2024-04-26T12:06:56.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079280319999999998 2024-04-26T12:06:56.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.211 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.212 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:56.212 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.361891+0000", 2024-04-26T12:06:56.212 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.594e-05 2024-04-26T12:06:56.212 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.212 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.212 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.212 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.361898+0000", 2024-04-26T12:06:56.212 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8360000000000003e-06 2024-04-26T12:06:56.212 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.212 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.212 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:56.212 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.361963+0000", 2024-04-26T12:06:56.212 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5382000000000005e-05 2024-04-26T12:06:56.212 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.212 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.213 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:56.213 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.362038+0000", 2024-04-26T12:06:56.213 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4678999999999994e-05 2024-04-26T12:06:56.213 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.213 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.213 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:56.213 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.362286+0000", 2024-04-26T12:06:56.213 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00024835599999999998 2024-04-26T12:06:56.213 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.213 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.213 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:56.213 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.367852+0000", 2024-04-26T12:06:56.213 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055659469999999999 2024-04-26T12:06:56.213 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.214 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.214 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:56.214 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.374567+0000", 2024-04-26T12:06:56.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0067153769999999998 2024-04-26T12:06:56.214 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.214 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.214 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:56.214 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.374611+0000", 2024-04-26T12:06:56.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3378999999999999e-05 2024-04-26T12:06:56.214 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.214 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.214 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:56.214 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.374645+0000", 2024-04-26T12:06:56.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4427000000000001e-05 2024-04-26T12:06:56.214 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.215 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:56.215 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.215 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.215 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.215 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11524 4.1b 4:daa3bd89:::100000030e4.00000000:head [write 0~4194304 [2@509948]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:56.215 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:55.406070+0000", 2024-04-26T12:06:56.215 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.74198871700000002, 2024-04-26T12:06:56.215 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.020362464, 2024-04-26T12:06:56.215 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:56.215 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.215 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:56.215 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:56.215 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:56.215 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11524 2024-04-26T12:06:56.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.216 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:56.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.216 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:56.216 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.406070+0000", 2024-04-26T12:06:56.216 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.216 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:56.216 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.406070+0000", 2024-04-26T12:06:56.216 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.216 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:56.216 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.406069+0000", 2024-04-26T12:06:56.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:56.217 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.217 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:56.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.411382+0000", 2024-04-26T12:06:56.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0053122459999999996 2024-04-26T12:06:56.217 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.217 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:56.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.411395+0000", 2024-04-26T12:06:56.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3645999999999999e-05 2024-04-26T12:06:56.217 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.217 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.411401+0000", 2024-04-26T12:06:56.218 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:06:56.218 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.218 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.218 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:56.218 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.411436+0000", 2024-04-26T12:06:56.218 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5642999999999997e-05 2024-04-26T12:06:56.218 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.218 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.218 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:56.218 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.411509+0000", 2024-04-26T12:06:56.218 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3044000000000001e-05 2024-04-26T12:06:56.218 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.218 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.218 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:56.219 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.411615+0000", 2024-04-26T12:06:56.219 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010593400000000001 2024-04-26T12:06:56.219 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.219 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.219 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:56.219 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.416898+0000", 2024-04-26T12:06:56.219 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052827220000000001 2024-04-26T12:06:56.219 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.219 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.219 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:56.219 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.426355+0000", 2024-04-26T12:06:56.219 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094575040000000003 2024-04-26T12:06:56.219 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.220 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.220 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:56.220 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.426398+0000", 2024-04-26T12:06:56.220 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2148999999999999e-05 2024-04-26T12:06:56.220 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.220 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.220 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:56.220 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.426433+0000", 2024-04-26T12:06:56.220 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5160000000000002e-05 2024-04-26T12:06:56.220 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.220 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:56.220 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.220 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.220 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.220 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11594 4.1a 4:5a8c04dd:::10000003276.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:56.221 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:55.483124+0000", 2024-04-26T12:06:56.221 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.66493486800000001, 2024-04-26T12:06:56.221 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.021466275999999999, 2024-04-26T12:06:56.221 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:56.221 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.221 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:56.221 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:56.221 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:56.221 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11594 2024-04-26T12:06:56.221 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.221 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:56.221 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.221 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:56.221 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.483124+0000", 2024-04-26T12:06:56.221 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.221 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.222 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.222 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:56.222 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.483124+0000", 2024-04-26T12:06:56.222 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.222 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.222 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.222 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:56.222 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.483124+0000", 2024-04-26T12:06:56.222 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:56.222 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.222 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.222 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:56.222 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.486907+0000", 2024-04-26T12:06:56.222 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037830229999999999 2024-04-26T12:06:56.222 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.223 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.223 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:56.223 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.486923+0000", 2024-04-26T12:06:56.223 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6155999999999999e-05 2024-04-26T12:06:56.223 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.223 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.223 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.223 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.486931+0000", 2024-04-26T12:06:56.223 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2640000000000008e-06 2024-04-26T12:06:56.223 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.223 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.223 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:56.223 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.486976+0000", 2024-04-26T12:06:56.223 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5157999999999997e-05 2024-04-26T12:06:56.223 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.224 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.224 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:56.224 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.487058+0000", 2024-04-26T12:06:56.224 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1615999999999999e-05 2024-04-26T12:06:56.224 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.224 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.224 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:56.224 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.487222+0000", 2024-04-26T12:06:56.224 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016448999999999999 2024-04-26T12:06:56.224 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.224 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.224 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:56.224 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.493611+0000", 2024-04-26T12:06:56.224 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0063889230000000003 2024-04-26T12:06:56.224 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.225 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.225 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:56.225 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.504522+0000", 2024-04-26T12:06:56.225 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010910926 2024-04-26T12:06:56.225 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.225 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.225 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:56.225 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.504559+0000", 2024-04-26T12:06:56.225 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6875999999999997e-05 2024-04-26T12:06:56.225 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.225 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.225 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:56.225 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.504590+0000", 2024-04-26T12:06:56.225 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1350000000000003e-05 2024-04-26T12:06:56.225 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.226 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:56.226 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.226 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.226 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.226 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11718 4.1a 4:5a6e15a2:::1000000318e.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:56.226 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:55.650439+0000", 2024-04-26T12:06:56.226 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.49761972100000001, 2024-04-26T12:06:56.226 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.024223921999999998, 2024-04-26T12:06:56.226 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:56.226 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.226 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:56.226 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:56.226 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:56.226 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11718 2024-04-26T12:06:56.226 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.227 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:56.227 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.227 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:56.227 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.650439+0000", 2024-04-26T12:06:56.227 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.227 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.227 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.227 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:56.227 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.650439+0000", 2024-04-26T12:06:56.227 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.227 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.227 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.227 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:56.227 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.650439+0000", 2024-04-26T12:06:56.228 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:56.228 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.228 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.228 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:56.228 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.656857+0000", 2024-04-26T12:06:56.228 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064187699999999999 2024-04-26T12:06:56.228 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.228 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.228 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:56.228 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.656873+0000", 2024-04-26T12:06:56.228 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5562000000000001e-05 2024-04-26T12:06:56.228 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.228 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.228 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.229 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.656882+0000", 2024-04-26T12:06:56.229 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7390000000000005e-06 2024-04-26T12:06:56.229 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.229 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.229 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:56.229 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.656953+0000", 2024-04-26T12:06:56.229 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0987000000000003e-05 2024-04-26T12:06:56.229 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.229 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.229 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:56.229 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.657041+0000", 2024-04-26T12:06:56.229 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.8362999999999994e-05 2024-04-26T12:06:56.229 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.229 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.229 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:56.229 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.657169+0000", 2024-04-26T12:06:56.230 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012784800000000001 2024-04-26T12:06:56.230 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.230 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.230 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:56.230 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.664934+0000", 2024-04-26T12:06:56.230 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0077649299999999997 2024-04-26T12:06:56.230 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.230 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.230 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:56.230 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.674572+0000", 2024-04-26T12:06:56.230 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096380460000000008 2024-04-26T12:06:56.230 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.230 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.230 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:56.230 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.674620+0000", 2024-04-26T12:06:56.231 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7939999999999998e-05 2024-04-26T12:06:56.231 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.231 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.231 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:56.231 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.674663+0000", 2024-04-26T12:06:56.231 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3368000000000002e-05 2024-04-26T12:06:56.231 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.231 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:56.231 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.231 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.231 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.231 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11734 4.25 4:a73d06bd:::100000031db.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:56.231 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:55.664244+0000", 2024-04-26T12:06:56.231 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.48381509099999997, 2024-04-26T12:06:56.231 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.020690671000000001, 2024-04-26T12:06:56.232 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:56.232 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.232 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:56.232 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:56.232 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:56.232 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11734 2024-04-26T12:06:56.232 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.232 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:56.232 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.232 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:56.232 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.664244+0000", 2024-04-26T12:06:56.232 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.232 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.233 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.233 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:56.233 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.664244+0000", 2024-04-26T12:06:56.233 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.233 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.233 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.233 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:56.233 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.664243+0000", 2024-04-26T12:06:56.233 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:56.233 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.233 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.233 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:56.233 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.670971+0000", 2024-04-26T12:06:56.233 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0067282649999999998 2024-04-26T12:06:56.233 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.234 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:56.234 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.670981+0000", 2024-04-26T12:06:56.234 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5510000000000005e-06 2024-04-26T12:06:56.234 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.234 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.234 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.670986+0000", 2024-04-26T12:06:56.234 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3419999999999998e-06 2024-04-26T12:06:56.234 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.234 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:56.234 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.671028+0000", 2024-04-26T12:06:56.235 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1807999999999997e-05 2024-04-26T12:06:56.235 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.235 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.235 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:56.235 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.671117+0000", 2024-04-26T12:06:56.235 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.8994999999999998e-05 2024-04-26T12:06:56.235 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.235 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.235 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:56.235 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.684818+0000", 2024-04-26T12:06:56.235 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013700524 2024-04-26T12:06:56.235 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.235 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.235 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:56.236 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.684860+0000", 2024-04-26T12:06:56.236 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2858000000000002e-05 2024-04-26T12:06:56.236 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.236 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.236 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:56.236 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.684935+0000", 2024-04-26T12:06:56.236 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4105999999999998e-05 2024-04-26T12:06:56.236 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.236 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:56.236 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.236 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.236 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.236 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11803 4.2b 4:d52318fe:::100000031d9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:56.236 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:55.744640+0000", 2024-04-26T12:06:56.236 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.40341911000000003, 2024-04-26T12:06:56.237 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.020487928999999998, 2024-04-26T12:06:56.237 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:56.237 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.237 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:56.237 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:56.237 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:56.237 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11803 2024-04-26T12:06:56.237 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.237 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:56.237 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.237 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:56.237 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.744640+0000", 2024-04-26T12:06:56.237 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.237 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.237 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.238 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:56.238 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.744640+0000", 2024-04-26T12:06:56.238 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.238 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.238 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.238 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:56.238 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.744639+0000", 2024-04-26T12:06:56.238 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:56.238 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.238 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.238 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:56.238 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.751234+0000", 2024-04-26T12:06:56.238 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0065944949999999997 2024-04-26T12:06:56.239 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.239 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.239 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:56.239 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.751245+0000", 2024-04-26T12:06:56.239 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1644000000000001e-05 2024-04-26T12:06:56.239 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.239 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.239 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.239 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.751251+0000", 2024-04-26T12:06:56.239 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9909999999999999e-06 2024-04-26T12:06:56.239 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.239 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.239 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:56.239 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.751295+0000", 2024-04-26T12:06:56.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4150999999999998e-05 2024-04-26T12:06:56.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.240 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:56.240 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.751385+0000", 2024-04-26T12:06:56.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9596000000000001e-05 2024-04-26T12:06:56.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.240 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:56.240 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.751516+0000", 2024-04-26T12:06:56.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013091700000000001 2024-04-26T12:06:56.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.240 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:56.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.756781+0000", 2024-04-26T12:06:56.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052651709999999999 2024-04-26T12:06:56.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:56.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.765078+0000", 2024-04-26T12:06:56.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0082971980000000004 2024-04-26T12:06:56.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:56.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.765107+0000", 2024-04-26T12:06:56.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8479e-05 2024-04-26T12:06:56.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:56.242 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.765128+0000", 2024-04-26T12:06:56.242 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0976999999999999e-05 2024-04-26T12:06:56.242 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.242 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:56.242 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.242 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.242 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.242 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11876 4.a 4:53b9bbce:::10000003342.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:56.242 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:55.810594+0000", 2024-04-26T12:06:56.242 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.33746520400000002, 2024-04-26T12:06:56.242 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.025845051000000001, 2024-04-26T12:06:56.242 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:56.242 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.242 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:56.242 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:56.243 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:56.243 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11876 2024-04-26T12:06:56.243 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.243 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:56.243 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.243 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:56.243 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.810594+0000", 2024-04-26T12:06:56.243 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.243 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.243 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.243 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:56.243 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.810594+0000", 2024-04-26T12:06:56.243 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.243 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.243 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.244 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:56.244 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.810593+0000", 2024-04-26T12:06:56.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:56.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.244 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:56.244 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.816125+0000", 2024-04-26T12:06:56.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055319929999999998 2024-04-26T12:06:56.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.244 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:56.244 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.816135+0000", 2024-04-26T12:06:56.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.9550000000000004e-06 2024-04-26T12:06:56.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.816139+0000", 2024-04-26T12:06:56.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1579999999999998e-06 2024-04-26T12:06:56.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:56.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.816180+0000", 2024-04-26T12:06:56.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0892000000000001e-05 2024-04-26T12:06:56.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:56.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.816340+0000", 2024-04-26T12:06:56.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015960700000000001 2024-04-26T12:06:56.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.246 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:56.246 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.816434+0000", 2024-04-26T12:06:56.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4729999999999996e-05 2024-04-26T12:06:56.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.246 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:56.246 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.823977+0000", 2024-04-26T12:06:56.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075424480000000002 2024-04-26T12:06:56.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.246 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:56.246 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.836338+0000", 2024-04-26T12:06:56.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.01236081 2024-04-26T12:06:56.247 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:56.247 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.836394+0000", 2024-04-26T12:06:56.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6613000000000002e-05 2024-04-26T12:06:56.247 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:56.247 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.836439+0000", 2024-04-26T12:06:56.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4577999999999999e-05 2024-04-26T12:06:56.247 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.247 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:56.247 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.248 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.248 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11999 4.a 4:51730b5b:::100000030d3.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:56.248 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:55.956329+0000", 2024-04-26T12:06:56.248 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.19173017000000001, 2024-04-26T12:06:56.248 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.020100957999999999, 2024-04-26T12:06:56.248 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:56.248 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.248 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:56.248 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:56.248 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:56.248 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11999 2024-04-26T12:06:56.248 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.248 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:56.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.249 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:56.249 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.956329+0000", 2024-04-26T12:06:56.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.249 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:56.249 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.956329+0000", 2024-04-26T12:06:56.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.249 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:56.249 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.956328+0000", 2024-04-26T12:06:56.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:56.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:56.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.960357+0000", 2024-04-26T12:06:56.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004029024 2024-04-26T12:06:56.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:56.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.960370+0000", 2024-04-26T12:06:56.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.341e-05 2024-04-26T12:06:56.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.960378+0000", 2024-04-26T12:06:56.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0020000000000006e-06 2024-04-26T12:06:56.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:56.251 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.960422+0000", 2024-04-26T12:06:56.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3687999999999999e-05 2024-04-26T12:06:56.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:56.251 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.960500+0000", 2024-04-26T12:06:56.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8162000000000001e-05 2024-04-26T12:06:56.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:56.251 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.960639+0000", 2024-04-26T12:06:56.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013880399999999999 2024-04-26T12:06:56.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:56.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.966271+0000", 2024-04-26T12:06:56.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0056318690000000003 2024-04-26T12:06:56.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:56.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.976341+0000", 2024-04-26T12:06:56.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010070285999999999 2024-04-26T12:06:56.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:56.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.976389+0000", 2024-04-26T12:06:56.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7379000000000002e-05 2024-04-26T12:06:56.253 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.253 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.253 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:56.253 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.976430+0000", 2024-04-26T12:06:56.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.121e-05 2024-04-26T12:06:56.253 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.253 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:56.253 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.253 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.253 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.253 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:12041 4.1a 4:5a8c04dd:::10000003276.00000000:head [write 0~4194304 [2@2159459]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:56.253 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:56.027896+0000", 2024-04-26T12:06:56.253 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.120163292, 2024-04-26T12:06:56.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.022164183, 2024-04-26T12:06:56.253 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:56.254 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.254 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:56.254 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:56.254 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:56.254 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 12041 2024-04-26T12:06:56.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.254 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:56.254 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.254 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:56.254 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.027896+0000", 2024-04-26T12:06:56.254 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.254 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.254 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:56.255 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.027896+0000", 2024-04-26T12:06:56.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.255 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.255 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.255 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:56.255 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.027895+0000", 2024-04-26T12:06:56.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:56.255 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.255 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.255 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:56.255 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.034131+0000", 2024-04-26T12:06:56.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0062361309999999998 2024-04-26T12:06:56.255 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.255 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.256 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:56.256 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.034141+0000", 2024-04-26T12:06:56.256 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.9240000000000002e-06 2024-04-26T12:06:56.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.256 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.256 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.034146+0000", 2024-04-26T12:06:56.256 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2619999999999998e-06 2024-04-26T12:06:56.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.256 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:56.256 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.034214+0000", 2024-04-26T12:06:56.256 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8330000000000005e-05 2024-04-26T12:06:56.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:56.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.034288+0000", 2024-04-26T12:06:56.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3496000000000002e-05 2024-04-26T12:06:56.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:56.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.034376+0000", 2024-04-26T12:06:56.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.8471e-05 2024-04-26T12:06:56.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:56.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.038867+0000", 2024-04-26T12:06:56.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044908830000000002 2024-04-26T12:06:56.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:56.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.050008+0000", 2024-04-26T12:06:56.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.011140807000000001 2024-04-26T12:06:56.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.258 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:56.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.050037+0000", 2024-04-26T12:06:56.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9420999999999998e-05 2024-04-26T12:06:56.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.258 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:56.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.050060+0000", 2024-04-26T12:06:56.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2589e-05 2024-04-26T12:06:56.258 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.259 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:56.259 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.259 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.259 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:12066 4.3a 4:5c040806:::1000000328e.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:56.259 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:56.059790+0000", 2024-04-26T12:06:56.259 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.088268615999999994, 2024-04-26T12:06:56.259 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.020989975000000001, 2024-04-26T12:06:56.259 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:56.259 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.259 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:56.259 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:56.259 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:56.259 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 12066 2024-04-26T12:06:56.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.260 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:56.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:56.260 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.059790+0000", 2024-04-26T12:06:56.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:56.260 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.059790+0000", 2024-04-26T12:06:56.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:56.260 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.059789+0000", 2024-04-26T12:06:56.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:56.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.261 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:56.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.068221+0000", 2024-04-26T12:06:56.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084314569999999998 2024-04-26T12:06:56.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.261 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:56.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.068236+0000", 2024-04-26T12:06:56.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5441999999999999e-05 2024-04-26T12:06:56.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.261 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.068245+0000", 2024-04-26T12:06:56.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7739999999999993e-06 2024-04-26T12:06:56.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:56.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.068422+0000", 2024-04-26T12:06:56.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000177493 2024-04-26T12:06:56.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:56.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.068523+0000", 2024-04-26T12:06:56.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010074800000000001 2024-04-26T12:06:56.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:56.263 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.068654+0000", 2024-04-26T12:06:56.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013083300000000001 2024-04-26T12:06:56.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.263 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:56.263 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.078187+0000", 2024-04-26T12:06:56.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.009532535 2024-04-26T12:06:56.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.263 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:56.263 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.080702+0000", 2024-04-26T12:06:56.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0025154729999999998 2024-04-26T12:06:56.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.263 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:56.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.080745+0000", 2024-04-26T12:06:56.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2577000000000002e-05 2024-04-26T12:06:56.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:56.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.080780+0000", 2024-04-26T12:06:56.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5648999999999997e-05 2024-04-26T12:06:56.264 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.264 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:56.264 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.264 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:12071 4.1a 4:5a6e15a2:::1000000318e.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:56.264 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:56.074124+0000", 2024-04-26T12:06:56.265 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.073934888000000004, 2024-04-26T12:06:56.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.020575907000000001, 2024-04-26T12:06:56.265 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:56.265 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.265 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:56.265 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:56.265 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:56.265 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 12071 2024-04-26T12:06:56.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.265 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:56.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:56.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.074124+0000", 2024-04-26T12:06:56.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:56.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.074124+0000", 2024-04-26T12:06:56.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:56.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:56.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.074122+0000", 2024-04-26T12:06:56.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:56.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:56.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.078714+0000", 2024-04-26T12:06:56.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045920429999999996 2024-04-26T12:06:56.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.267 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:56.267 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.078728+0000", 2024-04-26T12:06:56.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3867e-05 2024-04-26T12:06:56.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.267 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.267 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.078736+0000", 2024-04-26T12:06:56.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6930000000000007e-06 2024-04-26T12:06:56.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:56.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.078786+0000", 2024-04-26T12:06:56.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9877999999999999e-05 2024-04-26T12:06:56.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:56.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.078958+0000", 2024-04-26T12:06:56.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000172127 2024-04-26T12:06:56.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:56.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.079088+0000", 2024-04-26T12:06:56.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012995500000000001 2024-04-26T12:06:56.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:56.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.084041+0000", 2024-04-26T12:06:56.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00495255 2024-04-26T12:06:56.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:56.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.094593+0000", 2024-04-26T12:06:56.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010552532 2024-04-26T12:06:56.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:56.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.094658+0000", 2024-04-26T12:06:56.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4449999999999994e-05 2024-04-26T12:06:56.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:56.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:56.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:56.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.094700+0000", 2024-04-26T12:06:56.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2425000000000001e-05 2024-04-26T12:06:56.270 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.270 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:56.270 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.270 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:56.270 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:56.270 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:56.273 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:56.277 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:56.270+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:56.298 INFO:tasks.workunit.client.0.smithi052.stdout:8/343: fdatasync d0/d4/d5/db/d20/f24 0 2024-04-26T12:06:56.298 INFO:tasks.workunit.client.0.smithi052.stdout:9/407: dwrite d3/db/f20 [8388608,4194304] 0 2024-04-26T12:06:56.298 INFO:tasks.workunit.client.0.smithi052.stdout:1/364: getdents d0/d2/de/d4b/d60 0 2024-04-26T12:06:56.298 INFO:tasks.workunit.client.0.smithi052.stdout:8/344: mkdir d0/d4/dc/d68 0 2024-04-26T12:06:56.298 INFO:tasks.workunit.client.0.smithi052.stdout:1/365: read d0/d2/dd/d40/f77 [2005341,13423] 0 2024-04-26T12:06:56.298 INFO:tasks.workunit.client.0.smithi052.stdout:2/439: link d0/d3f/d56/f74 d0/d36/f90 0 2024-04-26T12:06:56.298 INFO:tasks.workunit.client.0.smithi052.stdout:8/345: mkdir d0/d4/d5/d27/d69 0 2024-04-26T12:06:56.298 INFO:tasks.workunit.client.0.smithi052.stdout:1/366: write d0/d2/dd/d40/f77 [2863953,66439] 0 2024-04-26T12:06:56.298 INFO:tasks.workunit.client.0.smithi052.stdout:2/440: truncate d0/d7/d16/f40 101073 0 2024-04-26T12:06:56.298 INFO:tasks.workunit.client.0.smithi052.stdout:1/367: read - d0/d2/de/d4b/d60/f69 zero size 2024-04-26T12:06:56.299 INFO:tasks.workunit.client.0.smithi052.stdout:5/383: write db/dc/d5f/d50/f48 [2174829,82712] 0 2024-04-26T12:06:56.299 INFO:tasks.workunit.client.0.smithi052.stdout:1/368: rename d0/d2/de/d4b/l4c to d0/d2/de/d4b/d60/l80 0 2024-04-26T12:06:56.299 INFO:tasks.workunit.client.0.smithi052.stdout:0/405: write d0/d1/d2c/d42/f58 [808571,54270] 0 2024-04-26T12:06:56.299 INFO:tasks.workunit.client.0.smithi052.stdout:5/384: rmdir db/dd/d34 39 2024-04-26T12:06:56.299 INFO:tasks.workunit.client.0.smithi052.stdout:8/346: dread d0/d4/f26 [0,4194304] 0 2024-04-26T12:06:56.299 INFO:tasks.workunit.client.0.smithi052.stdout:7/372: dread d1/d45/d4c/f4f [0,4194304] 0 2024-04-26T12:06:56.299 INFO:tasks.workunit.client.0.smithi052.stdout:1/369: chown d0/d2/de/d4b/d56/f74 101 1 2024-04-26T12:06:56.299 INFO:tasks.workunit.client.0.smithi052.stdout:8/347: creat d0/d16/d28/f6a x:0 0 0 2024-04-26T12:06:56.299 INFO:tasks.workunit.client.0.smithi052.stdout:7/373: rmdir d1/d1c/d21/d2f 39 2024-04-26T12:06:56.299 INFO:tasks.workunit.client.0.smithi052.stdout:2/441: dwrite d0/d7/d16/d3a/f59 [0,4194304] 0 2024-04-26T12:06:56.299 INFO:tasks.workunit.client.0.smithi052.stdout:5/385: creat db/dd/d34/d70/f80 x:0 0 0 2024-04-26T12:06:56.299 INFO:tasks.workunit.client.0.smithi052.stdout:8/348: symlink d0/d4/d5/db/l6b 0 2024-04-26T12:06:56.299 INFO:tasks.workunit.client.0.smithi052.stdout:1/370: rename d0/da/d3a to d0/d2/dd/d40/d81 0 2024-04-26T12:06:56.299 INFO:tasks.workunit.client.0.smithi052.stdout:8/349: chown d0/d4/d5/d27/d69 105 1 2024-04-26T12:06:56.300 INFO:tasks.workunit.client.0.smithi052.stdout:7/374: rename d1/d1f/c3c to d1/d45/d4c/d4d/c7b 0 2024-04-26T12:06:56.300 INFO:tasks.workunit.client.0.smithi052.stdout:0/406: dwrite d0/d1/f5c [0,4194304] 0 2024-04-26T12:06:56.300 INFO:tasks.workunit.client.0.smithi052.stdout:1/371: dread - d0/d2/dd/d34/f66 zero size 2024-04-26T12:06:56.300 INFO:tasks.workunit.client.0.smithi052.stdout:0/407: creat d0/f7a x:0 0 0 2024-04-26T12:06:56.300 INFO:tasks.workunit.client.0.smithi052.stdout:7/375: write d1/d45/d4c/f4f [167223,5368] 0 2024-04-26T12:06:56.300 INFO:tasks.workunit.client.0.smithi052.stdout:0/408: write d0/d3d/f3f [631920,69717] 0 2024-04-26T12:06:56.300 INFO:tasks.workunit.client.0.smithi052.stdout:7/376: dread - d1/d1c/d23/f78 zero size 2024-04-26T12:06:56.300 INFO:tasks.workunit.client.0.smithi052.stdout:1/372: link d0/d2/dd/d40/d81/d52/f72 d0/d2/dd/d1c/f82 0 2024-04-26T12:06:56.300 INFO:tasks.workunit.client.0.smithi052.stdout:5/386: dwrite db/dd/d18/f71 [4194304,4194304] 0 2024-04-26T12:06:56.300 INFO:tasks.workunit.client.0.smithi052.stdout:0/409: read d0/d1/f41 [7804253,41814] 0 2024-04-26T12:06:56.300 INFO:tasks.workunit.client.0.smithi052.stdout:9/408: dwrite d3/f7 [0,4194304] 0 2024-04-26T12:06:56.300 INFO:tasks.workunit.client.0.smithi052.stdout:3/362: dread d2/f29 [0,4194304] 0 2024-04-26T12:06:56.300 INFO:tasks.workunit.client.0.smithi052.stdout:7/377: chown d1/d1c/d21/f2e 5963 1 2024-04-26T12:06:56.300 INFO:tasks.workunit.client.0.smithi052.stdout:3/363: chown d2/d4/d2a/f58 501058 1 2024-04-26T12:06:56.301 INFO:tasks.workunit.client.0.smithi052.stdout:1/373: unlink d0/d2/de/d4b/d60/l47 0 2024-04-26T12:06:56.301 INFO:tasks.workunit.client.0.smithi052.stdout:5/387: write db/dc/d5f/f36 [955109,56071] 0 2024-04-26T12:06:56.301 INFO:tasks.workunit.client.0.smithi052.stdout:1/374: readlink d0/l53 0 2024-04-26T12:06:56.301 INFO:tasks.workunit.client.0.smithi052.stdout:7/378: write d1/fa [1810156,98541] 0 2024-04-26T12:06:56.301 INFO:tasks.workunit.client.0.smithi052.stdout:0/410: link d0/d1/d1a/d2a/d32/c40 d0/c7b 0 2024-04-26T12:06:56.301 INFO:tasks.workunit.client.0.smithi052.stdout:9/409: truncate d3/d1b/d49/f72 649047 0 2024-04-26T12:06:56.301 INFO:tasks.workunit.client.0.smithi052.stdout:8/350: truncate d0/d16/f46 2126761 0 2024-04-26T12:06:56.301 INFO:tasks.workunit.client.0.smithi052.stdout:3/364: dread - d2/d4/dc/d1d/f60 zero size 2024-04-26T12:06:56.301 INFO:tasks.workunit.client.0.smithi052.stdout:9/410: creat d3/d1b/d49/f8a x:0 0 0 2024-04-26T12:06:56.301 INFO:tasks.workunit.client.0.smithi052.stdout:8/351: mknod d0/d3e/c6c 0 2024-04-26T12:06:56.301 INFO:tasks.workunit.client.0.smithi052.stdout:1/375: unlink d0/d2/de/d4b/d60/l7b 0 2024-04-26T12:06:56.301 INFO:tasks.workunit.client.0.smithi052.stdout:3/365: symlink d2/d4/dc/d1d/d3f/l6c 0 2024-04-26T12:06:56.301 INFO:tasks.workunit.client.0.smithi052.stdout:9/411: creat d3/d82/f8b x:0 0 0 2024-04-26T12:06:56.301 INFO:tasks.workunit.client.0.smithi052.stdout:8/352: read d0/d16/d28/f4f [1247368,60934] 0 2024-04-26T12:06:56.301 INFO:tasks.workunit.client.0.smithi052.stdout:9/412: rmdir d3/db/d10 39 2024-04-26T12:06:56.301 INFO:tasks.workunit.client.0.smithi052.stdout:3/366: read d2/d4/dc/d1d/f32 [3801280,61742] 0 2024-04-26T12:06:56.302 INFO:tasks.workunit.client.0.smithi052.stdout:8/353: truncate d0/d16/f2a 1410527 0 2024-04-26T12:06:56.302 INFO:tasks.workunit.client.0.smithi052.stdout:9/413: mknod d3/db/c8c 0 2024-04-26T12:06:56.302 INFO:tasks.workunit.client.0.smithi052.stdout:5/388: read db/dc/f54 [395461,80209] 0 2024-04-26T12:06:56.302 INFO:tasks.workunit.client.0.smithi052.stdout:0/411: dwrite d0/d1/d11/f61 [0,4194304] 0 2024-04-26T12:06:56.302 INFO:tasks.workunit.client.0.smithi052.stdout:7/379: dwrite d1/d1c/d21/d2f/f4e [0,4194304] 0 2024-04-26T12:06:56.302 INFO:tasks.workunit.client.0.smithi052.stdout:3/367: write d2/d4/dc/d1d/d25/d61/f63 [245757,35327] 0 2024-04-26T12:06:56.302 INFO:tasks.workunit.client.0.smithi052.stdout:9/414: dread - d3/db/d10/d55/f6e zero size 2024-04-26T12:06:56.302 INFO:tasks.workunit.client.0.smithi052.stdout:8/354: unlink d0/d16/f46 0 2024-04-26T12:06:56.302 INFO:tasks.workunit.client.0.smithi052.stdout:1/376: rename d0/d2/de to d0/d83 0 2024-04-26T12:06:56.302 INFO:tasks.workunit.client.0.smithi052.stdout:3/368: creat d2/f6d x:0 0 0 2024-04-26T12:06:56.302 INFO:tasks.workunit.client.0.smithi052.stdout:2/442: dread d0/d7/d22/f84 [0,4194304] 0 2024-04-26T12:06:56.302 INFO:tasks.workunit.client.0.smithi052.stdout:7/380: mknod d1/d45/c7c 0 2024-04-26T12:06:56.302 INFO:tasks.workunit.client.0.smithi052.stdout:5/389: chown db/dc/f12 64029948 1 2024-04-26T12:06:56.302 INFO:tasks.workunit.client.0.smithi052.stdout:1/377: read - d0/d2/dd/d1c/d1d/d23/f61 zero size 2024-04-26T12:06:56.302 INFO:tasks.workunit.client.0.smithi052.stdout:2/443: unlink d0/f5 0 2024-04-26T12:06:56.303 INFO:tasks.workunit.client.0.smithi052.stdout:8/355: write d0/d4/d5/fe [441095,30461] 0 2024-04-26T12:06:56.303 INFO:tasks.workunit.client.0.smithi052.stdout:9/415: creat d3/db/d10/d2e/d5c/f8d x:0 0 0 2024-04-26T12:06:56.303 INFO:tasks.workunit.client.0.smithi052.stdout:5/390: read db/dc/d5f/d3f/f58 [2274836,111566] 0 2024-04-26T12:06:56.303 INFO:tasks.workunit.client.0.smithi052.stdout:2/444: read d0/f12 [1639010,22928] 0 2024-04-26T12:06:56.303 INFO:tasks.workunit.client.0.smithi052.stdout:6/379: sync 2024-04-26T12:06:56.303 INFO:tasks.workunit.client.0.smithi052.stdout:0/412: sync 2024-04-26T12:06:56.303 INFO:tasks.workunit.client.0.smithi052.stdout:9/416: truncate d3/d1b/d49/f8a 680345 0 2024-04-26T12:06:56.303 INFO:tasks.workunit.client.0.smithi052.stdout:4/354: dread d3/d1f/f25 [0,4194304] 0 2024-04-26T12:06:56.303 INFO:tasks.workunit.client.0.smithi052.stdout:0/413: stat d0/d1/d52/c53 0 2024-04-26T12:06:56.303 INFO:tasks.workunit.client.0.smithi052.stdout:8/356: getdents d0/d4/d5/d27/d57 0 2024-04-26T12:06:56.303 INFO:tasks.workunit.client.0.smithi052.stdout:1/378: getdents d0/d2/dd/d40/d81 0 2024-04-26T12:06:56.303 INFO:tasks.workunit.client.0.smithi052.stdout:2/445: mkdir d0/d3f/d56/d6d/d5a/d82/d91 0 2024-04-26T12:06:56.303 INFO:tasks.workunit.client.0.smithi052.stdout:8/357: chown d0/f44 95823 1 2024-04-26T12:06:56.303 INFO:tasks.workunit.client.0.smithi052.stdout:5/391: rename db/dd/d34/d70/c37 to db/dd/d34/d69/c81 0 2024-04-26T12:06:56.303 INFO:tasks.workunit.client.0.smithi052.stdout:1/379: unlink d0/d2/dd/d1c/f51 0 2024-04-26T12:06:56.304 INFO:tasks.workunit.client.0.smithi052.stdout:7/381: dread d1/ff [0,4194304] 0 2024-04-26T12:06:56.304 INFO:tasks.workunit.client.0.smithi052.stdout:3/369: dwrite d2/d1f/f2c [4194304,4194304] 0 2024-04-26T12:06:56.304 INFO:tasks.workunit.client.0.smithi052.stdout:0/414: write d0/d1/d11/f16 [213565,69636] 0 2024-04-26T12:06:56.304 INFO:tasks.workunit.client.0.smithi052.stdout:9/417: truncate d3/db/d52/f65 614608 0 2024-04-26T12:06:56.304 INFO:tasks.workunit.client.0.smithi052.stdout:2/446: creat d0/d7/d2f/d3d/f92 x:0 0 0 2024-04-26T12:06:56.304 INFO:tasks.workunit.client.0.smithi052.stdout:5/392: creat db/dd/d34/f82 x:0 0 0 2024-04-26T12:06:56.304 INFO:tasks.workunit.client.0.smithi052.stdout:7/382: rmdir d1/d45 39 2024-04-26T12:06:56.304 INFO:tasks.workunit.client.0.smithi052.stdout:1/380: dread - d0/da/f4f zero size 2024-04-26T12:06:56.304 INFO:tasks.workunit.client.0.smithi052.stdout:8/358: mknod d0/d4/d5/d27/d69/c6d 0 2024-04-26T12:06:56.304 INFO:tasks.workunit.client.0.smithi052.stdout:6/380: dwrite da/d63/f6a [0,4194304] 0 2024-04-26T12:06:56.304 INFO:tasks.workunit.client.0.smithi052.stdout:0/415: creat d0/d1/d1a/d2a/d4f/f7c x:0 0 0 2024-04-26T12:06:56.304 INFO:tasks.workunit.client.0.smithi052.stdout:7/383: creat d1/d1c/d21/d2f/f7d x:0 0 0 2024-04-26T12:06:56.304 INFO:tasks.workunit.client.0.smithi052.stdout:4/355: dwrite d3/d12/f18 [4194304,4194304] 0 2024-04-26T12:06:56.304 INFO:tasks.workunit.client.0.smithi052.stdout:8/359: creat d0/d4/dc/d68/f6e x:0 0 0 2024-04-26T12:06:56.304 INFO:tasks.workunit.client.0.smithi052.stdout:6/381: creat da/f83 x:0 0 0 2024-04-26T12:06:56.304 INFO:tasks.workunit.client.0.smithi052.stdout:5/393: chown db/dc/d5f/d50/d46/f79 133279863 1 2024-04-26T12:06:56.305 INFO:tasks.workunit.client.0.smithi052.stdout:7/384: unlink d1/d1f/l2a 0 2024-04-26T12:06:56.305 INFO:tasks.workunit.client.0.smithi052.stdout:2/447: rename d0/d7/d2f/d3d/f3e to d0/d3f/d56/d6d/d5a/d82/f93 0 2024-04-26T12:06:56.305 INFO:tasks.workunit.client.0.smithi052.stdout:0/416: symlink d0/d1/d1a/d20/l7d 0 2024-04-26T12:06:56.305 INFO:tasks.workunit.client.0.smithi052.stdout:4/356: mknod d3/d12/c7f 0 2024-04-26T12:06:56.305 INFO:tasks.workunit.client.0.smithi052.stdout:6/382: write da/d22/f3b [1159939,17510] 0 2024-04-26T12:06:56.305 INFO:tasks.workunit.client.0.smithi052.stdout:4/357: unlink d3/d44/f58 0 2024-04-26T12:06:56.305 INFO:tasks.workunit.client.0.smithi052.stdout:0/417: creat d0/d26/f7e x:0 0 0 2024-04-26T12:06:56.305 INFO:tasks.workunit.client.0.smithi052.stdout:2/448: creat d0/d7/d16/d4d/f94 x:0 0 0 2024-04-26T12:06:56.305 INFO:tasks.workunit.client.0.smithi052.stdout:5/394: creat db/dd/d18/d60/f83 x:0 0 0 2024-04-26T12:06:56.305 INFO:tasks.workunit.client.0.smithi052.stdout:6/383: mknod da/d5d/d64/c84 0 2024-04-26T12:06:56.305 INFO:tasks.workunit.client.0.smithi052.stdout:3/370: sync 2024-04-26T12:06:56.305 INFO:tasks.workunit.client.0.smithi052.stdout:4/358: getdents d3/d12/d64 0 2024-04-26T12:06:56.305 INFO:tasks.workunit.client.0.smithi052.stdout:2/449: readlink d0/d3f/d56/d6d/l4f 0 2024-04-26T12:06:56.305 INFO:tasks.workunit.client.0.smithi052.stdout:6/384: stat da/d22/d29/d31/f49 0 2024-04-26T12:06:56.305 INFO:tasks.workunit.client.0.smithi052.stdout:5/395: write db/dc/f54 [1648336,100508] 0 2024-04-26T12:06:56.305 INFO:tasks.workunit.client.0.smithi052.stdout:9/418: dwrite d3/db/d10/d2e/d5c/f8d [0,4194304] 0 2024-04-26T12:06:56.306 INFO:tasks.workunit.client.0.smithi052.stdout:4/359: mknod d3/d12/d59/c80 0 2024-04-26T12:06:56.306 INFO:tasks.workunit.client.0.smithi052.stdout:0/418: rename d0/d1/d1a/d2a/f51 to d0/d26/d74/f7f 0 2024-04-26T12:06:56.306 INFO:tasks.workunit.client.0.smithi052.stdout:7/385: read d1/f14 [1942644,31579] 0 2024-04-26T12:06:56.306 INFO:tasks.workunit.client.0.smithi052.stdout:3/371: mknod d2/d4/dc/d33/d37/c6e 0 2024-04-26T12:06:56.306 INFO:tasks.workunit.client.0.smithi052.stdout:7/386: sync 2024-04-26T12:06:56.306 INFO:tasks.workunit.client.0.smithi052.stdout:1/381: dwrite d0/d2/dd/d40/f77 [0,4194304] 0 2024-04-26T12:06:56.306 INFO:tasks.workunit.client.0.smithi052.stdout:1/382: readlink d0/d2/l7e 0 2024-04-26T12:06:56.306 INFO:tasks.workunit.client.0.smithi052.stdout:8/360: dwrite d0/d4/d5/db/d20/f24 [0,4194304] 0 2024-04-26T12:06:56.306 INFO:tasks.workunit.client.0.smithi052.stdout:3/372: creat d2/d4/dc/f6f x:0 0 0 2024-04-26T12:06:56.306 INFO:tasks.workunit.client.0.smithi052.stdout:7/387: rmdir d1/d45/d4c/d4d 39 2024-04-26T12:06:56.306 INFO:tasks.workunit.client.0.smithi052.stdout:4/360: truncate d3/d12/d64/f79 74595 0 2024-04-26T12:06:56.306 INFO:tasks.workunit.client.0.smithi052.stdout:2/450: rename d0/d36/f45 to d0/d7/f95 0 2024-04-26T12:06:56.306 INFO:tasks.workunit.client.0.smithi052.stdout:9/419: getdents d3/d23 0 2024-04-26T12:06:56.306 INFO:tasks.workunit.client.0.smithi052.stdout:8/361: stat d0/d4/d5/d3c/f55 0 2024-04-26T12:06:56.307 INFO:tasks.workunit.client.0.smithi052.stdout:0/419: rename d0/d1/d2c/d42/f58 to d0/d3c/f80 0 2024-04-26T12:06:56.307 INFO:tasks.workunit.client.0.smithi052.stdout:2/451: stat d0/d3f/d56/d6d/d5a/f88 0 2024-04-26T12:06:56.307 INFO:tasks.workunit.client.0.smithi052.stdout:3/373: readlink d2/d4/dc/d1d/d25/d36/d1c/l67 0 2024-04-26T12:06:56.307 INFO:tasks.workunit.client.0.smithi052.stdout:5/396: rename db/dd/d34/d70/d52 to db/dd/d34/d70/d52/d6e/d84 22 2024-04-26T12:06:56.307 INFO:tasks.workunit.client.0.smithi052.stdout:7/388: creat d1/d45/d4c/d4d/f7e x:0 0 0 2024-04-26T12:06:56.307 INFO:tasks.workunit.client.0.smithi052.stdout:0/420: chown d0/d26/f7e 0 1 2024-04-26T12:06:56.307 INFO:tasks.workunit.client.0.smithi052.stdout:8/362: chown d0/d4/d5/c6 48 1 2024-04-26T12:06:56.307 INFO:tasks.workunit.client.0.smithi052.stdout:8/363: chown d0/d4/dc/d45/c5a 9 1 2024-04-26T12:06:56.307 INFO:tasks.workunit.client.0.smithi052.stdout:8/364: fsync d0/f66 0 2024-04-26T12:06:56.307 INFO:tasks.workunit.client.0.smithi052.stdout:5/397: unlink db/dd/d18/d60/d64/f32 0 2024-04-26T12:06:56.307 INFO:tasks.workunit.client.0.smithi052.stdout:3/374: write d2/d4/dc/f1b [1593540,66264] 0 2024-04-26T12:06:56.307 INFO:tasks.workunit.client.0.smithi052.stdout:6/385: truncate f2 7938269 0 2024-04-26T12:06:56.307 INFO:tasks.workunit.client.0.smithi052.stdout:2/452: creat d0/d36/f96 x:0 0 0 2024-04-26T12:06:56.307 INFO:tasks.workunit.client.0.smithi052.stdout:0/421: rmdir d0/d1 39 2024-04-26T12:06:56.308 INFO:tasks.workunit.client.0.smithi052.stdout:3/375: creat d2/d4/dc/d1d/d3f/f70 x:0 0 0 2024-04-26T12:06:56.308 INFO:tasks.workunit.client.0.smithi052.stdout:5/398: getdents db/dd/d18/d60/d7d 0 2024-04-26T12:06:56.308 INFO:tasks.workunit.client.0.smithi052.stdout:6/386: creat da/d22/d3c/f85 x:0 0 0 2024-04-26T12:06:56.308 INFO:tasks.workunit.client.0.smithi052.stdout:1/383: truncate d0/d2/dd/d1c/d1d/f50 1397348 0 2024-04-26T12:06:56.308 INFO:tasks.workunit.client.0.smithi052.stdout:5/399: fsync db/dc/d5f/d3f/f5d 0 2024-04-26T12:06:56.308 INFO:tasks.workunit.client.0.smithi052.stdout:6/387: chown da/d22/d3c/f58 135880 1 2024-04-26T12:06:56.308 INFO:tasks.workunit.client.0.smithi052.stdout:0/422: symlink d0/d1/dd/d72/l81 0 2024-04-26T12:06:56.308 INFO:tasks.workunit.client.0.smithi052.stdout:5/400: unlink db/dc/c53 0 2024-04-26T12:06:56.308 INFO:tasks.workunit.client.0.smithi052.stdout:0/423: mknod d0/d3d/c82 0 2024-04-26T12:06:56.308 INFO:tasks.workunit.client.0.smithi052.stdout:4/361: dwrite d3/d2e/f4d [0,4194304] 0 2024-04-26T12:06:56.308 INFO:tasks.workunit.client.0.smithi052.stdout:9/420: truncate d3/db/d10/d55/f57 539644 0 2024-04-26T12:06:56.308 INFO:tasks.workunit.client.0.smithi052.stdout:0/424: creat d0/d1/d1a/d20/f83 x:0 0 0 2024-04-26T12:06:56.308 INFO:tasks.workunit.client.0.smithi052.stdout:2/453: unlink d0/d7/d53/f6e 0 2024-04-26T12:06:56.308 INFO:tasks.workunit.client.0.smithi052.stdout:8/365: dread d0/d4/dc/f3d [0,4194304] 0 2024-04-26T12:06:56.308 INFO:tasks.workunit.client.0.smithi052.stdout:6/388: fsync da/d22/d29/d31/f6b 0 2024-04-26T12:06:56.309 INFO:tasks.workunit.client.0.smithi052.stdout:9/421: truncate d3/d1b/f5e 2708332 0 2024-04-26T12:06:56.309 INFO:tasks.workunit.client.0.smithi052.stdout:8/366: stat d0/l62 0 2024-04-26T12:06:56.309 INFO:tasks.workunit.client.0.smithi052.stdout:0/425: mkdir d0/d1/d1a/d20/d47/d84 0 2024-04-26T12:06:56.309 INFO:tasks.workunit.client.0.smithi052.stdout:4/362: dread d3/d12/d64/f79 [0,4194304] 0 2024-04-26T12:06:56.309 INFO:tasks.workunit.client.0.smithi052.stdout:3/376: dwrite d2/d4/dc/d1d/f32 [4194304,4194304] 0 2024-04-26T12:06:56.309 INFO:tasks.workunit.client.0.smithi052.stdout:1/384: dwrite d0/d2/dd/d1c/d1d/d23/f2b [0,4194304] 0 2024-04-26T12:06:56.309 INFO:tasks.workunit.client.0.smithi052.stdout:6/389: write da/d22/d29/f55 [271239,106436] 0 2024-04-26T12:06:56.309 INFO:tasks.workunit.client.0.smithi052.stdout:9/422: creat d3/d82/f8e x:0 0 0 2024-04-26T12:06:56.309 INFO:tasks.workunit.client.0.smithi052.stdout:0/426: mkdir d0/d26/d85 0 2024-04-26T12:06:56.309 INFO:tasks.workunit.client.0.smithi052.stdout:4/363: creat d3/d22/d30/d71/f81 x:0 0 0 2024-04-26T12:06:56.309 INFO:tasks.workunit.client.0.smithi052.stdout:8/367: mkdir d0/d16/d63/d6f 0 2024-04-26T12:06:56.309 INFO:tasks.workunit.client.0.smithi052.stdout:9/423: dread - d3/db/d10/d55/f6e zero size 2024-04-26T12:06:56.309 INFO:tasks.workunit.client.0.smithi052.stdout:2/454: getdents d0/d7/d2f/d4c 0 2024-04-26T12:06:56.309 INFO:tasks.workunit.client.0.smithi052.stdout:3/377: creat d2/d4/d41/d59/f71 x:0 0 0 2024-04-26T12:06:56.309 INFO:tasks.workunit.client.0.smithi052.stdout:1/385: dread - d0/d2/dd/d40/d81/d52/f72 zero size 2024-04-26T12:06:56.309 INFO:tasks.workunit.client.0.smithi052.stdout:8/368: dread - d0/d4/d5/d3c/f55 zero size 2024-04-26T12:06:56.310 INFO:tasks.workunit.client.0.smithi052.stdout:0/427: write d0/d1/d11/f16 [5724774,104776] 0 2024-04-26T12:06:56.310 INFO:tasks.workunit.client.0.smithi052.stdout:9/424: readlink d3/db/d52/l47 0 2024-04-26T12:06:56.310 INFO:tasks.workunit.client.0.smithi052.stdout:4/364: write d3/d22/d30/f5c [1006552,8607] 0 2024-04-26T12:06:56.310 INFO:tasks.workunit.client.0.smithi052.stdout:3/378: symlink d2/d4/l72 0 2024-04-26T12:06:56.310 INFO:tasks.workunit.client.0.smithi052.stdout:2/455: write d0/d7/d16/d4d/f94 [69306,95417] 0 2024-04-26T12:06:56.310 INFO:tasks.workunit.client.0.smithi052.stdout:8/369: chown d0/d4/d5/db/l6b 453 1 2024-04-26T12:06:56.310 INFO:tasks.workunit.client.0.smithi052.stdout:4/365: chown d3/d22/d30/d71 20 1 2024-04-26T12:06:56.310 INFO:tasks.workunit.client.0.smithi052.stdout:7/389: dread d1/d1c/d21/d2f/f48 [0,4194304] 0 2024-04-26T12:06:56.310 INFO:tasks.workunit.client.0.smithi052.stdout:2/456: fsync d0/f4 0 2024-04-26T12:06:56.310 INFO:tasks.workunit.client.0.smithi052.stdout:9/425: write d3/db/d10/f1c [3897911,70703] 0 2024-04-26T12:06:56.310 INFO:tasks.workunit.client.0.smithi052.stdout:4/366: readlink d3/d2b/d40/l4c 0 2024-04-26T12:06:56.310 INFO:tasks.workunit.client.0.smithi052.stdout:6/390: dwrite da/d22/f24 [0,4194304] 0 2024-04-26T12:06:56.310 INFO:tasks.workunit.client.0.smithi052.stdout:4/367: write d3/d15/f17 [758048,5187] 0 2024-04-26T12:06:56.310 INFO:tasks.workunit.client.0.smithi052.stdout:7/390: creat d1/d1c/d21/f7f x:0 0 0 2024-04-26T12:06:56.310 INFO:tasks.workunit.client.0.smithi052.stdout:9/426: write d3/db/d2b/f61 [365852,58460] 0 2024-04-26T12:06:56.311 INFO:tasks.workunit.client.0.smithi052.stdout:4/368: write d3/d12/d59/f60 [846832,95986] 0 2024-04-26T12:06:56.311 INFO:tasks.workunit.client.0.smithi052.stdout:1/386: truncate d0/d2/f24 2540844 0 2024-04-26T12:06:56.311 INFO:tasks.workunit.client.0.smithi052.stdout:0/428: dwrite d0/d1/f24 [4194304,4194304] 0 2024-04-26T12:06:56.311 INFO:tasks.workunit.client.0.smithi052.stdout:3/379: dwrite d2/d4/dc/d1d/f60 [0,4194304] 0 2024-04-26T12:06:56.311 INFO:tasks.workunit.client.0.smithi052.stdout:7/391: getdents d1/d1c/d23 0 2024-04-26T12:06:56.311 INFO:tasks.workunit.client.0.smithi052.stdout:5/401: dread db/f1f [0,4194304] 0 2024-04-26T12:06:56.311 INFO:tasks.workunit.client.0.smithi052.stdout:0/429: mknod d0/d1/d52/c86 0 2024-04-26T12:06:56.311 INFO:tasks.workunit.client.0.smithi052.stdout:7/392: readlink d1/d45/l62 0 2024-04-26T12:06:56.311 INFO:tasks.workunit.client.0.smithi052.stdout:1/387: fdatasync d0/d2/dd/d1c/f82 0 2024-04-26T12:06:56.311 INFO:tasks.workunit.client.0.smithi052.stdout:4/369: read d3/d12/d34/d45/f51 [967287,83200] 0 2024-04-26T12:06:56.311 INFO:tasks.workunit.client.0.smithi052.stdout:6/391: dwrite da/d22/d29/f55 [0,4194304] 0 2024-04-26T12:06:56.311 INFO:tasks.workunit.client.0.smithi052.stdout:0/430: write d0/d1/d1a/d20/f83 [701084,21987] 0 2024-04-26T12:06:56.311 INFO:tasks.workunit.client.0.smithi052.stdout:7/393: link d1/f35 d1/d1c/d21/d2f/f80 0 2024-04-26T12:06:56.311 INFO:tasks.workunit.client.0.smithi052.stdout:2/457: dwrite d0/d7/f3c [0,4194304] 0 2024-04-26T12:06:56.311 INFO:tasks.workunit.client.0.smithi052.stdout:4/370: dread - d3/d12/d34/d45/f47 zero size 2024-04-26T12:06:56.312 INFO:tasks.workunit.client.0.smithi052.stdout:7/394: write d1/f14 [2766183,60210] 0 2024-04-26T12:06:56.312 INFO:tasks.workunit.client.0.smithi052.stdout:4/371: creat d3/d12/d59/f82 x:0 0 0 2024-04-26T12:06:56.312 INFO:tasks.workunit.client.0.smithi052.stdout:9/427: dwrite d3/db/d10/d3c/d40/f42 [0,4194304] 0 2024-04-26T12:06:56.312 INFO:tasks.workunit.client.0.smithi052.stdout:7/395: mkdir d1/d1c/d23/d81 0 2024-04-26T12:06:56.312 INFO:tasks.workunit.client.0.smithi052.stdout:9/428: rename d3/d1b to d3/d82/d8f 0 2024-04-26T12:06:56.312 INFO:tasks.workunit.client.0.smithi052.stdout:4/372: chown d3/d12/f19 2246372 1 2024-04-26T12:06:56.312 INFO:tasks.workunit.client.0.smithi052.stdout:9/429: fdatasync d3/f7 0 2024-04-26T12:06:56.312 INFO:tasks.workunit.client.0.smithi052.stdout:4/373: creat d3/d15/f83 x:0 0 0 2024-04-26T12:06:56.312 INFO:tasks.workunit.client.0.smithi052.stdout:6/392: dwrite da/d22/d29/f5a [0,4194304] 0 2024-04-26T12:06:56.312 INFO:tasks.workunit.client.0.smithi052.stdout:1/388: dwrite d0/d2/dd/d1c/d1d/d23/f38 [4194304,4194304] 0 2024-04-26T12:06:56.312 INFO:tasks.workunit.client.0.smithi052.stdout:9/430: mknod d3/d82/d8f/d49/c90 0 2024-04-26T12:06:56.312 INFO:tasks.workunit.client.0.smithi052.stdout:0/431: dread d0/d26/d36/f4c [0,4194304] 0 2024-04-26T12:06:56.312 INFO:tasks.workunit.client.0.smithi052.stdout:7/396: chown d1/d1c/d21/d2f/d33/d3a/d64/f77 228890 1 2024-04-26T12:06:56.312 INFO:tasks.workunit.client.0.smithi052.stdout:6/393: creat da/d5d/d64/d68/f86 x:0 0 0 2024-04-26T12:06:56.312 INFO:tasks.workunit.client.0.smithi052.stdout:4/374: write d3/d22/d30/f42 [3188256,12973] 0 2024-04-26T12:06:56.313 INFO:tasks.workunit.client.0.smithi052.stdout:2/458: dwrite d0/d7/f31 [0,4194304] 0 2024-04-26T12:06:56.313 INFO:tasks.workunit.client.0.smithi052.stdout:7/397: fdatasync d1/d1c/d21/f53 0 2024-04-26T12:06:56.313 INFO:tasks.workunit.client.0.smithi052.stdout:5/402: dwrite db/f38 [0,4194304] 0 2024-04-26T12:06:56.313 INFO:tasks.workunit.client.0.smithi052.stdout:9/431: write d3/db/d4a/f4d [1121419,65463] 0 2024-04-26T12:06:56.313 INFO:tasks.workunit.client.0.smithi052.stdout:4/375: fdatasync d3/d2b/f7d 0 2024-04-26T12:06:56.313 INFO:tasks.workunit.client.0.smithi052.stdout:1/389: write d0/d2/dd/d34/f4e [3749300,58862] 0 2024-04-26T12:06:56.313 INFO:tasks.workunit.client.0.smithi052.stdout:0/432: write d0/d1/d1a/d2a/d32/f78 [685146,51194] 0 2024-04-26T12:06:56.313 INFO:tasks.workunit.client.0.smithi052.stdout:6/394: mkdir da/d22/d3c/d74/d87 0 2024-04-26T12:06:56.313 INFO:tasks.workunit.client.0.smithi052.stdout:7/398: dread - d1/d1c/d23/f50 zero size 2024-04-26T12:06:56.313 INFO:tasks.workunit.client.0.smithi052.stdout:9/432: mknod d3/db/d2b/c91 0 2024-04-26T12:06:56.313 INFO:tasks.workunit.client.0.smithi052.stdout:4/376: read - d3/d44/d4b/f75 zero size 2024-04-26T12:06:56.313 INFO:tasks.workunit.client.0.smithi052.stdout:2/459: creat d0/d3f/d56/d6d/f97 x:0 0 0 2024-04-26T12:06:56.313 INFO:tasks.workunit.client.0.smithi052.stdout:8/370: dread d0/d4/f17 [0,4194304] 0 2024-04-26T12:06:56.313 INFO:tasks.workunit.client.0.smithi052.stdout:6/395: creat da/d63/f88 x:0 0 0 2024-04-26T12:06:56.313 INFO:tasks.workunit.client.0.smithi052.stdout:0/433: mknod d0/d26/d74/c87 0 2024-04-26T12:06:56.313 INFO:tasks.workunit.client.0.smithi052.stdout:1/390: fsync d0/d83/d4b/d60/f69 0 2024-04-26T12:06:56.314 INFO:tasks.workunit.client.0.smithi052.stdout:9/433: mknod d3/db/d10/d3c/c92 0 2024-04-26T12:06:56.314 INFO:tasks.workunit.client.0.smithi052.stdout:5/403: rename db/dd/d18/d60/d64/l2e to db/dc/d5f/d50/l85 0 2024-04-26T12:06:56.314 INFO:tasks.workunit.client.0.smithi052.stdout:7/399: creat d1/d1f/d55/f82 x:0 0 0 2024-04-26T12:06:56.314 INFO:tasks.workunit.client.0.smithi052.stdout:0/434: creat d0/d5a/f88 x:0 0 0 2024-04-26T12:06:56.314 INFO:tasks.workunit.client.0.smithi052.stdout:9/434: write d3/db/d10/d2e/d5c/f8d [4992284,1724] 0 2024-04-26T12:06:56.314 INFO:tasks.workunit.client.0.smithi052.stdout:1/391: rename d0/d2/dd/d40/l49 to d0/d2/l84 0 2024-04-26T12:06:56.314 INFO:tasks.workunit.client.0.smithi052.stdout:6/396: getdents da 0 2024-04-26T12:06:56.314 INFO:tasks.workunit.client.0.smithi052.stdout:5/404: mknod db/dd/d34/d70/d59/c86 0 2024-04-26T12:06:56.314 INFO:tasks.workunit.client.0.smithi052.stdout:2/460: dread d0/d36/f7e [0,4194304] 0 2024-04-26T12:06:56.314 INFO:tasks.workunit.client.0.smithi052.stdout:7/400: chown d1/d1c/d23/f50 2 1 2024-04-26T12:06:56.314 INFO:tasks.workunit.client.0.smithi052.stdout:0/435: creat d0/d1/dd/d72/f89 x:0 0 0 2024-04-26T12:06:56.314 INFO:tasks.workunit.client.0.smithi052.stdout:5/405: stat db/l7e 0 2024-04-26T12:06:56.314 INFO:tasks.workunit.client.0.smithi052.stdout:6/397: mkdir da/d22/d3c/d74/d7e/d89 0 2024-04-26T12:06:56.314 INFO:tasks.workunit.client.0.smithi052.stdout:1/392: mknod d0/d2/dd/d1c/d1d/d23/c85 0 2024-04-26T12:06:56.315 INFO:tasks.workunit.client.0.smithi052.stdout:4/377: dwrite d3/f10 [0,4194304] 0 2024-04-26T12:06:56.315 INFO:tasks.workunit.client.0.smithi052.stdout:2/461: getdents d0/d7/d16/d4d 0 2024-04-26T12:06:56.315 INFO:tasks.workunit.client.0.smithi052.stdout:9/435: link d3/db/d2b/f68 d3/db/d10/d54/f93 0 2024-04-26T12:06:56.315 INFO:tasks.workunit.client.0.smithi052.stdout:9/436: sync 2024-04-26T12:06:56.315 INFO:tasks.workunit.client.0.smithi052.stdout:8/371: dwrite d0/d4/f17 [4194304,4194304] 0 2024-04-26T12:06:56.315 INFO:tasks.workunit.client.0.smithi052.stdout:0/436: link d0/d1/d2c/l71 d0/d26/l8a 0 2024-04-26T12:06:56.315 INFO:tasks.workunit.client.0.smithi052.stdout:1/393: write d0/d83/d4b/f70 [1368037,1793] 0 2024-04-26T12:06:56.315 INFO:tasks.workunit.client.0.smithi052.stdout:6/398: mknod da/d22/d3c/d6e/d7c/c8a 0 2024-04-26T12:06:56.315 INFO:tasks.workunit.client.0.smithi052.stdout:5/406: rename db/dd/d34/d70/d52 to db/dd/d18/d60/d7d/d87 0 2024-04-26T12:06:56.315 INFO:tasks.workunit.client.0.smithi052.stdout:9/437: write d3/f7 [2643387,128987] 0 2024-04-26T12:06:56.315 INFO:tasks.workunit.client.0.smithi052.stdout:1/394: stat d0/d83/d4b/d60/l80 0 2024-04-26T12:06:56.315 INFO:tasks.workunit.client.0.smithi052.stdout:8/372: creat d0/f70 x:0 0 0 2024-04-26T12:06:56.315 INFO:tasks.workunit.client.0.smithi052.stdout:4/378: link d3/d12/c7e d3/d22/d69/c84 0 2024-04-26T12:06:56.315 INFO:tasks.workunit.client.0.smithi052.stdout:6/399: mkdir da/d22/d3c/d74/d7e/d8b 0 2024-04-26T12:06:56.315 INFO:tasks.workunit.client.0.smithi052.stdout:1/395: mknod d0/d83/c86 0 2024-04-26T12:06:56.316 INFO:tasks.workunit.client.0.smithi052.stdout:7/401: dwrite d1/d1c/f42 [0,4194304] 0 2024-04-26T12:06:56.316 INFO:tasks.workunit.client.0.smithi052.stdout:4/379: symlink d3/d44/l85 0 2024-04-26T12:06:56.316 INFO:tasks.workunit.client.0.smithi052.stdout:0/437: link d0/d1/d1a/d20/c29 d0/d5a/c8b 0 2024-04-26T12:06:56.316 INFO:tasks.workunit.client.0.smithi052.stdout:8/373: rename d0/d4/dc/f3d to d0/f71 0 2024-04-26T12:06:56.316 INFO:tasks.workunit.client.0.smithi052.stdout:1/396: write d0/f20 [4358357,60300] 0 2024-04-26T12:06:56.316 INFO:tasks.workunit.client.0.smithi052.stdout:2/462: dread d0/d7/f3c [0,4194304] 0 2024-04-26T12:06:56.316 INFO:tasks.workunit.client.0.smithi052.stdout:7/402: write d1/d1c/f42 [2679935,108229] 0 2024-04-26T12:06:56.316 INFO:tasks.workunit.client.0.smithi052.stdout:4/380: mkdir d3/d12/d34/d45/d67/d6c/d86 0 2024-04-26T12:06:56.316 INFO:tasks.workunit.client.0.smithi052.stdout:1/397: symlink d0/d2/dd/d40/l87 0 2024-04-26T12:06:56.321 INFO:tasks.workunit.client.0.smithi052.stdout:7/403: getdents d1/d1c/d23/d81 0 2024-04-26T12:06:56.322 INFO:tasks.workunit.client.0.smithi052.stdout:0/438: getdents d0/d1 0 2024-04-26T12:06:56.322 INFO:tasks.workunit.client.0.smithi052.stdout:4/381: unlink d3/d22/d69/c84 0 2024-04-26T12:06:56.322 INFO:tasks.workunit.client.0.smithi052.stdout:2/463: link d0/d7/c2c d0/d3f/d56/d6d/d5a/d73/d4b/c98 0 2024-04-26T12:06:56.322 INFO:tasks.workunit.client.0.smithi052.stdout:2/464: sync 2024-04-26T12:06:56.322 INFO:tasks.workunit.client.0.smithi052.stdout:5/407: dwrite db/dc/d5f/d50/d46/f79 [0,4194304] 0 2024-04-26T12:06:56.322 INFO:tasks.workunit.client.0.smithi052.stdout:1/398: getdents d0/da 0 2024-04-26T12:06:56.322 INFO:tasks.workunit.client.0.smithi052.stdout:4/382: mknod d3/d44/c87 0 2024-04-26T12:06:56.322 INFO:tasks.workunit.client.0.smithi052.stdout:3/380: dread d2/f3d [0,4194304] 0 2024-04-26T12:06:56.322 INFO:tasks.workunit.client.0.smithi052.stdout:0/439: write d0/d1/d1a/d20/f83 [663263,33369] 0 2024-04-26T12:06:56.322 INFO:tasks.workunit.client.0.smithi052.stdout:2/465: read d0/d7/d53/f6b [295716,58340] 0 2024-04-26T12:06:56.322 INFO:tasks.workunit.client.0.smithi052.stdout:4/383: dread - d3/f57 zero size 2024-04-26T12:06:56.322 INFO:tasks.workunit.client.0.smithi052.stdout:7/404: write d1/d1c/d21/d2f/f7d [308167,3581] 0 2024-04-26T12:06:56.323 INFO:tasks.workunit.client.0.smithi052.stdout:4/384: chown d3/f2f 7108 1 2024-04-26T12:06:56.323 INFO:tasks.workunit.client.0.smithi052.stdout:2/466: unlink d0/d7/d16/c41 0 2024-04-26T12:06:56.323 INFO:tasks.workunit.client.0.smithi052.stdout:0/440: mknod d0/d1/d54/c8c 0 2024-04-26T12:06:56.323 INFO:tasks.workunit.client.0.smithi052.stdout:1/399: getdents d0/d2/dd/d34/d3e 0 2024-04-26T12:06:56.323 INFO:tasks.workunit.client.0.smithi052.stdout:4/385: write d3/f10 [277659,15941] 0 2024-04-26T12:06:56.323 INFO:tasks.workunit.client.0.smithi052.stdout:0/441: stat d0/d26/d36 0 2024-04-26T12:06:56.323 INFO:tasks.workunit.client.0.smithi052.stdout:7/405: truncate d1/d1c/d23/f31 101022 0 2024-04-26T12:06:56.323 INFO:tasks.workunit.client.0.smithi052.stdout:1/400: dread - d0/d83/f5f zero size 2024-04-26T12:06:56.323 INFO:tasks.workunit.client.0.smithi052.stdout:2/467: getdents d0/d7/d2f 0 2024-04-26T12:06:56.323 INFO:tasks.workunit.client.0.smithi052.stdout:0/442: chown d0/d1/f13 3 1 2024-04-26T12:06:56.323 INFO:tasks.workunit.client.0.smithi052.stdout:7/406: unlink d1/d1f/l2d 0 2024-04-26T12:06:56.323 INFO:tasks.workunit.client.0.smithi052.stdout:3/381: truncate d2/d4/dc/d1d/d25/d36/d1c/d4e/f52 163913 0 2024-04-26T12:06:56.323 INFO:tasks.workunit.client.0.smithi052.stdout:4/386: creat d3/d12/d34/d45/f88 x:0 0 0 2024-04-26T12:06:56.323 INFO:tasks.workunit.client.0.smithi052.stdout:1/401: stat d0/d2/dd/d1c/d1d/d23/c7f 0 2024-04-26T12:06:56.324 INFO:tasks.workunit.client.0.smithi052.stdout:2/468: dread - d0/d36/f96 zero size 2024-04-26T12:06:56.324 INFO:tasks.workunit.client.0.smithi052.stdout:7/407: mkdir d1/d1c/d23/d83 0 2024-04-26T12:06:56.324 INFO:tasks.workunit.client.0.smithi052.stdout:9/438: dwrite d3/db/d2b/f2f [0,4194304] 0 2024-04-26T12:06:56.324 INFO:tasks.workunit.client.0.smithi052.stdout:0/443: chown d0/d5b/c50 13149 1 2024-04-26T12:06:56.324 INFO:tasks.workunit.client.0.smithi052.stdout:4/387: dread - d3/d44/d4b/f75 zero size 2024-04-26T12:06:56.324 INFO:tasks.workunit.client.0.smithi052.stdout:9/439: symlink d3/db/d2b/l94 0 2024-04-26T12:06:56.324 INFO:tasks.workunit.client.0.smithi052.stdout:8/374: dwrite d0/d3e/f4a [0,4194304] 0 2024-04-26T12:06:56.324 INFO:tasks.workunit.client.0.smithi052.stdout:2/469: mkdir d0/d3f/d56/d8d/d99 0 2024-04-26T12:06:56.324 INFO:tasks.workunit.client.0.smithi052.stdout:2/470: chown d0/d7 93 1 2024-04-26T12:06:56.324 INFO:tasks.workunit.client.0.smithi052.stdout:0/444: unlink d0/d1/d1a/d2a/d32/c40 0 2024-04-26T12:06:56.324 INFO:tasks.workunit.client.0.smithi052.stdout:3/382: link d2/d4/dc/d1d/d25/d36/d1c/d4e/f52 d2/f73 0 2024-04-26T12:06:56.324 INFO:tasks.workunit.client.0.smithi052.stdout:7/408: symlink d1/d1c/d21/d2f/d68/l84 0 2024-04-26T12:06:56.324 INFO:tasks.workunit.client.0.smithi052.stdout:4/388: rmdir d3/d1f 39 2024-04-26T12:06:56.325 INFO:tasks.workunit.client.0.smithi052.stdout:8/375: fsync d0/f71 0 2024-04-26T12:06:56.325 INFO:tasks.workunit.client.0.smithi052.stdout:1/402: rename d0/da/d2e/d78 to d0/d2/d88 0 2024-04-26T12:06:56.325 INFO:tasks.workunit.client.0.smithi052.stdout:0/445: stat d0/d1/d1a/d20 0 2024-04-26T12:06:56.325 INFO:tasks.workunit.client.0.smithi052.stdout:9/440: chown d3/l6c 9042 1 2024-04-26T12:06:56.325 INFO:tasks.workunit.client.0.smithi052.stdout:2/471: creat d0/f9a x:0 0 0 2024-04-26T12:06:56.325 INFO:tasks.workunit.client.0.smithi052.stdout:4/389: dread - d3/d22/f23 zero size 2024-04-26T12:06:56.325 INFO:tasks.workunit.client.0.smithi052.stdout:1/403: write d0/d2/f10 [2774453,107279] 0 2024-04-26T12:06:56.325 INFO:tasks.workunit.client.0.smithi052.stdout:9/441: mknod d3/c95 0 2024-04-26T12:06:56.325 INFO:tasks.workunit.client.0.smithi052.stdout:6/400: dread f2 [0,4194304] 0 2024-04-26T12:06:56.325 INFO:tasks.workunit.client.0.smithi052.stdout:4/390: write d3/d12/f19 [1796845,61984] 0 2024-04-26T12:06:56.325 INFO:tasks.workunit.client.0.smithi052.stdout:0/446: getdents d0/d1/d1a 0 2024-04-26T12:06:56.325 INFO:tasks.workunit.client.0.smithi052.stdout:9/442: write d3/db/d10/f1c [5252584,111216] 0 2024-04-26T12:06:56.325 INFO:tasks.workunit.client.0.smithi052.stdout:1/404: write d0/d2/f18 [603764,9380] 0 2024-04-26T12:06:56.325 INFO:tasks.workunit.client.0.smithi052.stdout:2/472: write d0/d7/d53/f6b [1817138,22416] 0 2024-04-26T12:06:56.325 INFO:tasks.workunit.client.0.smithi052.stdout:4/391: creat d3/d1f/f89 x:0 0 0 2024-04-26T12:06:56.326 INFO:tasks.workunit.client.0.smithi052.stdout:0/447: symlink d0/d1/d1a/d2a/d4f/l8d 0 2024-04-26T12:06:56.326 INFO:tasks.workunit.client.0.smithi052.stdout:1/405: unlink d0/da/l62 0 2024-04-26T12:06:56.326 INFO:tasks.workunit.client.0.smithi052.stdout:3/383: read d2/d4/f64 [3526840,82705] 0 2024-04-26T12:06:56.326 INFO:tasks.workunit.client.0.smithi052.stdout:4/392: write d3/f10 [4757202,65265] 0 2024-04-26T12:06:56.326 INFO:tasks.workunit.client.0.smithi052.stdout:2/473: dread - d0/d3f/d56/d6d/f7b zero size 2024-04-26T12:06:56.327 INFO:tasks.workunit.client.0.smithi052.stdout:0/448: write d0/d1/d1a/f64 [1040114,90318] 0 2024-04-26T12:06:56.327 INFO:tasks.workunit.client.0.smithi052.stdout:3/384: write d2/d4/d31/f54 [864867,30963] 0 2024-04-26T12:06:56.327 INFO:tasks.workunit.client.0.smithi052.stdout:7/409: dread d1/d1c/d21/d2f/f54 [0,4194304] 0 2024-04-26T12:06:56.327 INFO:tasks.workunit.client.0.smithi052.stdout:2/474: write d0/d3f/d56/f64 [3444034,89459] 0 2024-04-26T12:06:56.327 INFO:tasks.workunit.client.0.smithi052.stdout:8/376: dwrite d0/d4/d1c/f2b [8388608,4194304] 0 2024-04-26T12:06:56.327 INFO:tasks.workunit.client.0.smithi052.stdout:6/401: dwrite da/f1e [4194304,4194304] 0 2024-04-26T12:06:56.328 INFO:tasks.workunit.client.0.smithi052.stdout:6/402: stat da/d22/d29/d31/d39/f48 0 2024-04-26T12:06:56.328 INFO:tasks.workunit.client.0.smithi052.stdout:8/377: creat d0/d4/dc/f72 x:0 0 0 2024-04-26T12:06:56.328 INFO:tasks.workunit.client.0.smithi052.stdout:0/449: unlink d0/d1/d2c/l71 0 2024-04-26T12:06:56.329 INFO:tasks.workunit.client.0.smithi052.stdout:3/385: mknod d2/d4/dc/d68/c74 0 2024-04-26T12:06:56.330 INFO:tasks.workunit.client.0.smithi052.stdout:9/443: dwrite d3/db/d52/f65 [0,4194304] 0 2024-04-26T12:06:56.331 INFO:tasks.workunit.client.0.smithi052.stdout:3/386: mkdir d2/d4/dc/d33/d75 0 2024-04-26T12:06:56.331 INFO:tasks.workunit.client.0.smithi052.stdout:7/410: chown d1/d1c/d23/l30 0 1 2024-04-26T12:06:56.332 INFO:tasks.workunit.client.0.smithi052.stdout:6/403: rename da/le to da/d22/d29/d31/d6f/l8c 0 2024-04-26T12:06:56.334 INFO:tasks.workunit.client.0.smithi052.stdout:4/393: dwrite d3/d1f/d21/f32 [0,4194304] 0 2024-04-26T12:06:56.334 INFO:tasks.workunit.client.0.smithi052.stdout:3/387: fsync d2/d1f/f2c 0 2024-04-26T12:06:56.334 INFO:tasks.workunit.client.0.smithi052.stdout:9/444: write d3/db/d4a/f4d [1715652,79859] 0 2024-04-26T12:06:56.336 INFO:tasks.workunit.client.0.smithi052.stdout:0/450: dwrite d0/f66 [0,4194304] 0 2024-04-26T12:06:56.337 INFO:tasks.workunit.client.0.smithi052.stdout:7/411: unlink d1/d1c/d21/d2f/d33/d3a/d64/f77 0 2024-04-26T12:06:56.338 INFO:tasks.workunit.client.0.smithi052.stdout:1/406: dwrite d0/da/f4f [0,4194304] 0 2024-04-26T12:06:56.338 INFO:tasks.workunit.client.0.smithi052.stdout:5/408: dread db/dd/d34/f57 [0,4194304] 0 2024-04-26T12:06:56.339 INFO:tasks.workunit.client.0.smithi052.stdout:6/404: rmdir da/d22/d3c/d74/d7e/d89 0 2024-04-26T12:06:56.339 INFO:tasks.workunit.client.0.smithi052.stdout:9/445: rmdir d3/db/d10/d3c/d40 39 2024-04-26T12:06:56.339 INFO:tasks.workunit.client.0.smithi052.stdout:6/405: sync 2024-04-26T12:06:56.340 INFO:tasks.workunit.client.0.smithi052.stdout:7/412: unlink d1/d1c/d23/l30 0 2024-04-26T12:06:56.340 INFO:tasks.workunit.client.0.smithi052.stdout:0/451: creat d0/d26/d36/f8e x:0 0 0 2024-04-26T12:06:56.340 INFO:tasks.workunit.client.0.smithi052.stdout:3/388: getdents d2/d4 0 2024-04-26T12:06:56.341 INFO:tasks.workunit.client.0.smithi052.stdout:7/413: read - d1/d1f/f60 zero size 2024-04-26T12:06:56.341 INFO:tasks.workunit.client.0.smithi052.stdout:6/406: symlink da/l8d 0 2024-04-26T12:06:56.342 INFO:tasks.workunit.client.0.smithi052.stdout:1/407: chown d0/d2/dd/d1c/d1d/f37 63034122 1 2024-04-26T12:06:56.344 INFO:tasks.workunit.client.0.smithi052.stdout:7/414: creat d1/d1c/d23/f85 x:0 0 0 2024-04-26T12:06:56.345 INFO:tasks.workunit.client.0.smithi052.stdout:1/408: fsync d0/d83/d4b/f70 0 2024-04-26T12:06:56.345 INFO:tasks.workunit.client.0.smithi052.stdout:5/409: link db/dd/d34/d70/l2c db/dd/d18/d60/l88 0 2024-04-26T12:06:56.346 INFO:tasks.workunit.client.0.smithi052.stdout:6/407: creat da/d22/d3c/d6e/d7c/f8e x:0 0 0 2024-04-26T12:06:56.347 INFO:tasks.workunit.client.0.smithi052.stdout:7/415: chown d1/l11 22584797 1 2024-04-26T12:06:56.348 INFO:tasks.workunit.client.0.smithi052.stdout:4/394: dwrite d3/fd [4194304,4194304] 0 2024-04-26T12:06:56.348 INFO:tasks.workunit.client.0.smithi052.stdout:3/389: dread d2/d4/dc/d1d/d25/d36/d1c/d4e/f52 [0,4194304] 0 2024-04-26T12:06:56.348 INFO:tasks.workunit.client.0.smithi052.stdout:4/395: sync 2024-04-26T12:06:56.349 INFO:tasks.workunit.client.0.smithi052.stdout:6/408: write da/d51/f69 [156166,86613] 0 2024-04-26T12:06:56.350 INFO:tasks.workunit.client.0.smithi052.stdout:2/475: dread d0/fa [0,4194304] 0 2024-04-26T12:06:56.350 INFO:tasks.workunit.client.0.smithi052.stdout:1/409: unlink d0/d2/dd/d1c/d1d/d23/f38 0 2024-04-26T12:06:56.350 INFO:tasks.workunit.client.0.smithi052.stdout:4/396: readlink d3/d22/d30/l6f 0 2024-04-26T12:06:56.350 INFO:tasks.workunit.client.0.smithi052.stdout:8/378: dread d0/d4/d1c/f2b [4194304,4194304] 0 2024-04-26T12:06:56.351 INFO:tasks.workunit.client.0.smithi052.stdout:6/409: chown da/d22/f47 15549549 1 2024-04-26T12:06:56.351 INFO:tasks.workunit.client.0.smithi052.stdout:9/446: dwrite d3/db/d10/d3c/d40/f42 [0,4194304] 0 2024-04-26T12:06:56.352 INFO:tasks.workunit.client.0.smithi052.stdout:7/416: symlink d1/d1c/d21/d2f/d33/d3a/l86 0 2024-04-26T12:06:56.353 INFO:tasks.workunit.client.0.smithi052.stdout:5/410: dread db/dd/d18/f71 [4194304,4194304] 0 2024-04-26T12:06:56.353 INFO:tasks.workunit.client.0.smithi052.stdout:4/397: mknod d3/d1f/d21/c8a 0 2024-04-26T12:06:56.353 INFO:tasks.workunit.client.0.smithi052.stdout:8/379: creat d0/d16/f73 x:0 0 0 2024-04-26T12:06:56.354 INFO:tasks.workunit.client.0.smithi052.stdout:1/410: symlink d0/d2/dd/d34/l89 0 2024-04-26T12:06:56.355 INFO:tasks.workunit.client.0.smithi052.stdout:3/390: truncate d2/d1f/f2c 5253024 0 2024-04-26T12:06:56.355 INFO:tasks.workunit.client.0.smithi052.stdout:0/452: dread - d0/d26/d36/f8e zero size 2024-04-26T12:06:56.355 INFO:tasks.workunit.client.0.smithi052.stdout:5/411: creat db/dd/d34/d69/f89 x:0 0 0 2024-04-26T12:06:56.356 INFO:tasks.workunit.client.0.smithi052.stdout:6/410: rename da/d22/d29/f36 to da/d22/d3c/d6e/f8f 0 2024-04-26T12:06:56.356 INFO:tasks.workunit.client.0.smithi052.stdout:9/447: getdents d3/db/d13 0 2024-04-26T12:06:56.357 INFO:tasks.workunit.client.0.smithi052.stdout:4/398: creat d3/d12/f8b x:0 0 0 2024-04-26T12:06:56.357 INFO:tasks.workunit.client.0.smithi052.stdout:3/391: write d2/d4/dc/d1d/d25/f3b [8161484,44429] 0 2024-04-26T12:06:56.358 INFO:tasks.workunit.client.0.smithi052.stdout:5/412: mkdir db/dd/d34/d69/d8a 0 2024-04-26T12:06:56.359 INFO:tasks.workunit.client.0.smithi052.stdout:1/411: fsync d0/d2/dd/d1c/d1d/f50 0 2024-04-26T12:06:56.359 INFO:tasks.workunit.client.0.smithi052.stdout:8/380: rename d0/d4/d5/f11 to d0/d16/f74 0 2024-04-26T12:06:56.359 INFO:tasks.workunit.client.0.smithi052.stdout:6/411: chown da/d22/f25 39267 1 2024-04-26T12:06:56.360 INFO:tasks.workunit.client.0.smithi052.stdout:2/476: dwrite d0/d7/d2f/d3d/f92 [0,4194304] 0 2024-04-26T12:06:56.360 INFO:tasks.workunit.client.0.smithi052.stdout:3/392: stat d2/d4/d41/d59/f71 0 2024-04-26T12:06:56.361 INFO:tasks.workunit.client.0.smithi052.stdout:6/412: readlink da/d22/d29/l2b 0 2024-04-26T12:06:56.361 INFO:tasks.workunit.client.0.smithi052.stdout:4/399: write d3/d22/d30/d71/f81 [290556,105758] 0 2024-04-26T12:06:56.361 INFO:tasks.workunit.client.0.smithi052.stdout:1/412: creat d0/d83/d4b/d60/f8a x:0 0 0 2024-04-26T12:06:56.363 INFO:tasks.workunit.client.0.smithi052.stdout:7/417: dwrite d1/d45/d4c/d4d/f79 [0,4194304] 0 2024-04-26T12:06:56.363 INFO:tasks.workunit.client.0.smithi052.stdout:4/400: write d3/f57 [235797,105656] 0 2024-04-26T12:06:56.364 INFO:tasks.workunit.client.0.smithi052.stdout:3/393: write d2/d4/dc/d1d/d3f/f70 [398891,72122] 0 2024-04-26T12:06:56.364 INFO:tasks.workunit.client.0.smithi052.stdout:8/381: rename d0/d16/d63/d6f to d0/d4/dc/d45/d75 0 2024-04-26T12:06:56.364 INFO:tasks.workunit.client.0.smithi052.stdout:7/418: chown d1/f12 12 1 2024-04-26T12:06:56.364 INFO:tasks.workunit.client.0.smithi052.stdout:5/413: rename db/dd/d34/d70/f7b to db/dd/d34/d69/d8a/f8b 0 2024-04-26T12:06:56.365 INFO:tasks.workunit.client.0.smithi052.stdout:8/382: dread - d0/d16/d28/f6a zero size 2024-04-26T12:06:56.366 INFO:tasks.workunit.client.0.smithi052.stdout:2/477: rename d0/d7/d53 to d0/d7/d2f/d9b 0 2024-04-26T12:06:56.366 INFO:tasks.workunit.client.0.smithi052.stdout:7/419: mknod d1/d1f/d55/c87 0 2024-04-26T12:06:56.366 INFO:tasks.workunit.client.0.smithi052.stdout:4/401: getdents d3/d12/d34/d43 0 2024-04-26T12:06:56.366 INFO:tasks.workunit.client.0.smithi052.stdout:5/414: creat db/dd/d34/d70/d59/f8c x:0 0 0 2024-04-26T12:06:56.367 INFO:tasks.workunit.client.0.smithi052.stdout:3/394: rename d2/d4/dc/f1b to d2/d4/d6b/f76 0 2024-04-26T12:06:56.368 INFO:tasks.workunit.client.0.smithi052.stdout:4/402: creat d3/d22/d69/f8c x:0 0 0 2024-04-26T12:06:56.369 INFO:tasks.workunit.client.0.smithi052.stdout:2/478: getdents d0 0 2024-04-26T12:06:56.369 INFO:tasks.workunit.client.0.smithi052.stdout:3/395: fsync d2/f3d 0 2024-04-26T12:06:56.372 INFO:tasks.workunit.client.0.smithi052.stdout:1/413: dwrite d0/d2/dd/d34/f66 [0,4194304] 0 2024-04-26T12:06:56.372 INFO:tasks.workunit.client.0.smithi052.stdout:4/403: truncate d3/d22/d69/f8c 491474 0 2024-04-26T12:06:56.373 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:56.371+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:56.373 INFO:tasks.workunit.client.0.smithi052.stdout:2/479: mkdir d0/d3f/d56/d6d/d5a/d73/d4b/d9c 0 2024-04-26T12:06:56.373 INFO:tasks.workunit.client.0.smithi052.stdout:8/383: dwrite d0/d16/f1a [0,4194304] 0 2024-04-26T12:06:56.374 INFO:tasks.workunit.client.0.smithi052.stdout:1/414: chown d0/d2/c21 1 1 2024-04-26T12:06:56.376 INFO:tasks.workunit.client.0.smithi052.stdout:7/420: dwrite d1/d45/d4c/d4d/f7e [0,4194304] 0 2024-04-26T12:06:56.376 INFO:tasks.workunit.client.0.smithi052.stdout:8/384: write d0/d4/d5/f61 [1008992,23355] 0 2024-04-26T12:06:56.376 INFO:tasks.workunit.client.0.smithi052.stdout:2/480: creat d0/d3f/d56/d8d/f9d x:0 0 0 2024-04-26T12:06:56.376 INFO:tasks.workunit.client.0.smithi052.stdout:6/413: truncate da/f1d 2664289 0 2024-04-26T12:06:56.377 INFO:tasks.workunit.client.0.smithi052.stdout:1/415: mknod d0/d2/dd/d1c/d3c/c8b 0 2024-04-26T12:06:56.379 INFO:tasks.workunit.client.0.smithi052.stdout:5/415: truncate db/dc/d5f/d50/f48 927783 0 2024-04-26T12:06:56.379 INFO:tasks.workunit.client.0.smithi052.stdout:6/414: rename da/d63/f88 to da/d5d/f90 0 2024-04-26T12:06:56.380 INFO:tasks.workunit.client.0.smithi052.stdout:3/396: dwrite d2/d4/dc/d1d/d25/d36/f50 [0,4194304] 0 2024-04-26T12:06:56.381 INFO:tasks.workunit.client.0.smithi052.stdout:1/416: link d0/d2/c21 d0/d2/dd/d1c/d1d/c8c 0 2024-04-26T12:06:56.381 INFO:tasks.workunit.client.0.smithi052.stdout:5/416: mknod db/dd/d18/d60/c8d 0 2024-04-26T12:06:56.381 INFO:tasks.workunit.client.0.smithi052.stdout:7/421: rename d1/d1c/d23/d83 to d1/d1c/d23/d81/d88 0 2024-04-26T12:06:56.381 INFO:tasks.workunit.client.0.smithi052.stdout:3/397: symlink d2/d4/d2a/d2d/l77 0 2024-04-26T12:06:56.381 INFO:tasks.workunit.client.0.smithi052.stdout:5/417: chown db/dc/c67 6386 1 2024-04-26T12:06:56.381 INFO:tasks.workunit.client.0.smithi052.stdout:6/415: mknod da/d22/d29/d31/c91 0 2024-04-26T12:06:56.382 INFO:tasks.workunit.client.0.smithi052.stdout:5/418: chown db/dd 2 1 2024-04-26T12:06:56.382 INFO:tasks.workunit.client.0.smithi052.stdout:3/398: fsync d2/d4/dc/d1d/d25/f3b 0 2024-04-26T12:06:56.382 INFO:tasks.workunit.client.0.smithi052.stdout:6/416: mkdir da/d22/d3c/d6e/d92 0 2024-04-26T12:06:56.383 INFO:tasks.workunit.client.0.smithi052.stdout:3/399: creat d2/d4/d2a/d2d/f78 x:0 0 0 2024-04-26T12:06:56.383 INFO:tasks.workunit.client.0.smithi052.stdout:6/417: mknod da/d22/d3c/d74/d87/c93 0 2024-04-26T12:06:56.384 INFO:tasks.workunit.client.0.smithi052.stdout:6/418: mkdir da/d22/d3c/d6e/d7c/d94 0 2024-04-26T12:06:56.386 INFO:tasks.workunit.client.0.smithi052.stdout:6/419: write da/d22/d29/d31/f3a [4143274,95361] 0 2024-04-26T12:06:56.387 INFO:tasks.workunit.client.0.smithi052.stdout:5/419: dwrite db/dd/d18/f6f [0,4194304] 0 2024-04-26T12:06:56.387 INFO:tasks.workunit.client.0.smithi052.stdout:6/420: fdatasync da/d22/d29/f2e 0 2024-04-26T12:06:56.388 INFO:tasks.workunit.client.0.smithi052.stdout:6/421: mkdir da/d22/d3c/d6e/d95 0 2024-04-26T12:06:56.388 INFO:tasks.workunit.client.0.smithi052.stdout:5/420: read f1 [2723752,98953] 0 2024-04-26T12:06:56.389 INFO:tasks.workunit.client.0.smithi052.stdout:6/422: chown da/d22/d29/f2e 417912216 1 2024-04-26T12:06:56.389 INFO:tasks.workunit.client.0.smithi052.stdout:5/421: fsync db/dd/f73 0 2024-04-26T12:06:56.389 INFO:tasks.workunit.client.0.smithi052.stdout:0/453: dread d0/d1/d1a/f64 [0,4194304] 0 2024-04-26T12:06:56.389 INFO:tasks.workunit.client.0.smithi052.stdout:6/423: chown da/d22/d3c/d6e/d7c/d94 5934 1 2024-04-26T12:06:56.390 INFO:tasks.workunit.client.0.smithi052.stdout:5/422: chown db/dd/d18/d60/c8d 29196950 1 2024-04-26T12:06:56.390 INFO:tasks.workunit.client.0.smithi052.stdout:0/454: mknod d0/d26/c8f 0 2024-04-26T12:06:56.391 INFO:tasks.workunit.client.0.smithi052.stdout:0/455: mknod d0/d1/d54/c90 0 2024-04-26T12:06:56.391 INFO:tasks.workunit.client.0.smithi052.stdout:5/423: creat db/dc/d5f/d50/d46/d74/f8e x:0 0 0 2024-04-26T12:06:56.392 INFO:tasks.workunit.client.0.smithi052.stdout:0/456: write d0/d1/d1a/d2a/d4f/f7c [219823,91222] 0 2024-04-26T12:06:56.393 INFO:tasks.workunit.client.0.smithi052.stdout:0/457: write d0/d1/d11/f16 [3797513,54052] 0 2024-04-26T12:06:56.395 INFO:tasks.workunit.client.0.smithi052.stdout:7/422: truncate d1/f18 2302167 0 2024-04-26T12:06:56.396 INFO:tasks.workunit.client.0.smithi052.stdout:5/424: dwrite db/dd/f27 [0,4194304] 0 2024-04-26T12:06:56.397 INFO:tasks.workunit.client.0.smithi052.stdout:7/423: readlink d1/d1c/d23/l6d 0 2024-04-26T12:06:56.398 INFO:tasks.workunit.client.0.smithi052.stdout:5/425: creat db/dc/d5f/f8f x:0 0 0 2024-04-26T12:06:56.398 INFO:tasks.workunit.client.0.smithi052.stdout:7/424: write d1/d45/d4c/f4f [600468,14308] 0 2024-04-26T12:06:56.399 INFO:tasks.workunit.client.0.smithi052.stdout:0/458: dwrite d0/d3d/f3f [4194304,4194304] 0 2024-04-26T12:06:56.400 INFO:tasks.workunit.client.0.smithi052.stdout:7/425: creat d1/d45/d4c/f89 x:0 0 0 2024-04-26T12:06:56.401 INFO:tasks.workunit.client.0.smithi052.stdout:0/459: fsync d0/d26/d36/f4c 0 2024-04-26T12:06:56.402 INFO:tasks.workunit.client.0.smithi052.stdout:7/426: unlink d1/d45/d4c/d4d/c6b 0 2024-04-26T12:06:56.403 INFO:tasks.workunit.client.0.smithi052.stdout:0/460: mknod d0/d1/d54/c91 0 2024-04-26T12:06:56.404 INFO:tasks.workunit.client.0.smithi052.stdout:7/427: truncate d1/f47 191388 0 2024-04-26T12:06:56.404 INFO:tasks.workunit.client.0.smithi052.stdout:5/426: dwrite db/dd/f27 [0,4194304] 0 2024-04-26T12:06:56.405 INFO:tasks.workunit.client.0.smithi052.stdout:6/424: dwrite da/f1b [0,4194304] 0 2024-04-26T12:06:56.406 INFO:tasks.workunit.client.0.smithi052.stdout:0/461: truncate d0/d1/d1a/d2a/d32/f78 1534429 0 2024-04-26T12:06:56.406 INFO:tasks.workunit.client.0.smithi052.stdout:6/425: unlink c4 0 2024-04-26T12:06:56.408 INFO:tasks.workunit.client.0.smithi052.stdout:6/426: mkdir da/d22/d3c/d6e/d92/d96 0 2024-04-26T12:06:56.409 INFO:tasks.workunit.client.0.smithi052.stdout:9/448: dread d3/d23/d7f/f2c [0,4194304] 0 2024-04-26T12:06:56.409 INFO:tasks.workunit.client.0.smithi052.stdout:5/427: dread db/dd/d34/f57 [0,4194304] 0 2024-04-26T12:06:56.410 INFO:tasks.workunit.client.0.smithi052.stdout:9/449: rename d3/db/d10/d55 to d3/db/d10/d3c/d40/d96 0 2024-04-26T12:06:56.410 INFO:tasks.workunit.client.0.smithi052.stdout:6/427: read da/d63/f6a [1437958,16384] 0 2024-04-26T12:06:56.414 INFO:tasks.workunit.client.0.smithi052.stdout:9/450: creat d3/db/d10/d54/f97 x:0 0 0 2024-04-26T12:06:56.414 INFO:tasks.workunit.client.0.smithi052.stdout:6/428: mkdir da/d22/d97 0 2024-04-26T12:06:56.414 INFO:tasks.workunit.client.0.smithi052.stdout:3/400: dread d2/d4/dc/d1d/d3f/f70 [0,4194304] 0 2024-04-26T12:06:56.415 INFO:tasks.workunit.client.0.smithi052.stdout:9/451: creat d3/d23/f98 x:0 0 0 2024-04-26T12:06:56.415 INFO:tasks.workunit.client.0.smithi052.stdout:3/401: readlink d2/d4/dc/d1d/d25/d36/l65 0 2024-04-26T12:06:56.415 INFO:tasks.workunit.client.0.smithi052.stdout:9/452: truncate d3/d23/f88 264920 0 2024-04-26T12:06:56.415 INFO:tasks.workunit.client.0.smithi052.stdout:5/428: dwrite db/f38 [0,4194304] 0 2024-04-26T12:06:56.415 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:56.415 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:56.415 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.416 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:12328 4.b 4:d3ea317a:::10000003266.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:56.416 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:56.374605+0000", 2024-04-26T12:06:56.416 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.040640127999999998, 2024-04-26T12:06:56.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.040660960000000003, 2024-04-26T12:06:56.416 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:56.416 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:06:56.416 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:56.416 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:56.416 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:56.416 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 12328 2024-04-26T12:06:56.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.416 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:56.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.416 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:56.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.374605+0000", 2024-04-26T12:06:56.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:56.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.374605+0000", 2024-04-26T12:06:56.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:56.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.374604+0000", 2024-04-26T12:06:56.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:56.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.418 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:56.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.383135+0000", 2024-04-26T12:06:56.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0085313490000000006 2024-04-26T12:06:56.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.418 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:56.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.383160+0000", 2024-04-26T12:06:56.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5537999999999998e-05 2024-04-26T12:06:56.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.418 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.383173+0000", 2024-04-26T12:06:56.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2883e-05 2024-04-26T12:06:56.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.419 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:56.419 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.383222+0000", 2024-04-26T12:06:56.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8328999999999998e-05 2024-04-26T12:06:56.419 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.419 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:56.419 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.383304+0000", 2024-04-26T12:06:56.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2412999999999999e-05 2024-04-26T12:06:56.419 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.419 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:06:56.419 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.383431+0000", 2024-04-26T12:06:56.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012707800000000001 2024-04-26T12:06:56.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:56.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.389638+0000", 2024-04-26T12:06:56.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062064279999999999 2024-04-26T12:06:56.420 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.420 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:56.420 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.420 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4564.0:12353 4.4 4:23f20836:::100000031e8.00000000:head [write 0~4194304 [2@1959599] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:56.420 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:56.405980+0000", 2024-04-26T12:06:56.420 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0092648680000000008, 2024-04-26T12:06:56.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0093385020000000003, 2024-04-26T12:06:56.421 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:56.421 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:56.421 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-04-26T12:06:56.421 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4564", 2024-04-26T12:06:56.421 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:56.421 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 12353 2024-04-26T12:06:56.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.421 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:56.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.421 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:56.421 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.405980+0000", 2024-04-26T12:06:56.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.422 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:56.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.405980+0000", 2024-04-26T12:06:56.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.422 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.422 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:56.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.405978+0000", 2024-04-26T12:06:56.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:56.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.422 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.422 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:56.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.414650+0000", 2024-04-26T12:06:56.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0086713339999999993 2024-04-26T12:06:56.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:56.423 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.414668+0000", 2024-04-26T12:06:56.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8178000000000001e-05 2024-04-26T12:06:56.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.423 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.414676+0000", 2024-04-26T12:06:56.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.8010000000000004e-06 2024-04-26T12:06:56.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:56.423 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.414747+0000", 2024-04-26T12:06:56.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1497999999999999e-05 2024-04-26T12:06:56.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.424 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.424 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:56.424 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.414855+0000", 2024-04-26T12:06:56.424 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000107749 2024-04-26T12:06:56.424 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.424 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:56.424 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.424 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.424 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.424 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4564.0:12340 4.38 e53/16 4:1c8d9fef:::100000033ed.00000000:head v 53'161, mlcod=53'157)", 2024-04-26T12:06:56.424 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:56.408383+0000", 2024-04-26T12:06:56.424 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00686157, 2024-04-26T12:06:56.424 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0069702380000000001, 2024-04-26T12:06:56.424 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:56.424 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:06:56.425 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:56.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.425 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:56.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.408383+0000", 2024-04-26T12:06:56.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.425 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.425 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:56.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.408383+0000", 2024-04-26T12:06:56.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.425 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.425 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:56.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.408383+0000", 2024-04-26T12:06:56.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:56.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:56.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.414807+0000", 2024-04-26T12:06:56.426 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0064241710000000002 2024-04-26T12:06:56.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:56.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.414819+0000", 2024-04-26T12:06:56.426 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1766999999999999e-05 2024-04-26T12:06:56.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.414825+0000", 2024-04-26T12:06:56.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5200000000000003e-06 2024-04-26T12:06:56.427 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.427 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:56.427 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.414861+0000", 2024-04-26T12:06:56.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5879e-05 2024-04-26T12:06:56.427 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.427 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:56.427 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:56.414877+0000", 2024-04-26T12:06:56.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5526e-05 2024-04-26T12:06:56.427 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.427 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:56.427 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.428 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.428 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-04-26T12:06:56.428 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 3 2024-04-26T12:06:56.428 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:56.429 INFO:tasks.workunit.client.0.smithi052.stdout:5/429: mknod db/dc/d5f/c90 0 2024-04-26T12:06:56.430 INFO:tasks.workunit.client.0.smithi052.stdout:4/404: sync 2024-04-26T12:06:56.430 INFO:tasks.workunit.client.0.smithi052.stdout:9/453: truncate d3/db/d10/f85 1460382 0 2024-04-26T12:06:56.430 INFO:tasks.workunit.client.0.smithi052.stdout:9/454: creat d3/f99 x:0 0 0 2024-04-26T12:06:56.430 INFO:tasks.workunit.client.0.smithi052.stdout:3/402: dwrite d2/d4/dc/f6f [0,4194304] 0 2024-04-26T12:06:56.430 INFO:tasks.workunit.client.0.smithi052.stdout:9/455: rename d3/db/d2b/f68 to d3/db/d13/f9a 0 2024-04-26T12:06:56.430 INFO:tasks.workunit.client.0.smithi052.stdout:3/403: dread - d2/d4/d2a/f58 zero size 2024-04-26T12:06:56.430 INFO:tasks.workunit.client.0.smithi052.stdout:4/405: dwrite d3/d22/d30/f42 [4194304,4194304] 0 2024-04-26T12:06:56.430 INFO:tasks.workunit.client.0.smithi052.stdout:9/456: link d3/db/d10/d2e/d5c/l86 d3/db/d10/d3c/d40/d96/l9b 0 2024-04-26T12:06:56.430 INFO:tasks.workunit.client.0.smithi052.stdout:4/406: symlink d3/d12/d34/d45/d67/d6c/l8d 0 2024-04-26T12:06:56.430 INFO:tasks.workunit.client.0.smithi052.stdout:7/428: fsync d1/ff 0 2024-04-26T12:06:56.430 INFO:tasks.workunit.client.0.smithi052.stdout:3/404: dwrite d2/f3d [0,4194304] 0 2024-04-26T12:06:56.430 INFO:tasks.workunit.client.0.smithi052.stdout:3/405: readlink d2/d4/d41/l5b 0 2024-04-26T12:06:56.430 INFO:tasks.workunit.client.0.smithi052.stdout:8/385: dread d0/d4/d1c/f2c [0,4194304] 0 2024-04-26T12:06:56.432 INFO:tasks.workunit.client.0.smithi052.stdout:3/406: creat d2/d4/f79 x:0 0 0 2024-04-26T12:06:56.432 INFO:tasks.workunit.client.0.smithi052.stdout:9/457: dwrite d3/db/d10/d2e/d5c/f8d [4194304,4194304] 0 2024-04-26T12:06:56.432 INFO:tasks.workunit.client.0.smithi052.stdout:3/407: chown d2/f29 3234818 1 2024-04-26T12:06:56.432 INFO:tasks.workunit.client.0.smithi052.stdout:9/458: chown d3/db/d4a 1247582 1 2024-04-26T12:06:56.432 INFO:tasks.workunit.client.0.smithi052.stdout:7/429: dread d1/d45/d4c/f4f [0,4194304] 0 2024-04-26T12:06:56.432 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:56.434 INFO:tasks.workunit.client.0.smithi052.stdout:8/386: creat d0/d4/d5/d27/d69/f76 x:0 0 0 2024-04-26T12:06:56.434 INFO:tasks.workunit.client.0.smithi052.stdout:7/430: stat d1/d1c/f42 0 2024-04-26T12:06:56.434 INFO:tasks.workunit.client.0.smithi052.stdout:9/459: symlink d3/db/d2b/l9c 0 2024-04-26T12:06:56.434 INFO:tasks.workunit.client.0.smithi052.stdout:7/431: fdatasync d1/d1c/f42 0 2024-04-26T12:06:56.434 INFO:tasks.workunit.client.0.smithi052.stdout:1/417: sync 2024-04-26T12:06:56.434 INFO:tasks.workunit.client.0.smithi052.stdout:2/481: sync 2024-04-26T12:06:56.434 INFO:tasks.workunit.client.0.smithi052.stdout:4/407: sync 2024-04-26T12:06:56.434 INFO:tasks.workunit.client.0.smithi052.stdout:7/432: creat d1/d1c/d23/d81/d88/f8a x:0 0 0 2024-04-26T12:06:56.435 INFO:tasks.workunit.client.0.smithi052.stdout:7/433: readlink d1/l11 0 2024-04-26T12:06:56.435 INFO:tasks.workunit.client.0.smithi052.stdout:2/482: symlink d0/d7/d22/l9e 0 2024-04-26T12:06:56.435 INFO:tasks.workunit.client.0.smithi052.stdout:1/418: chown d0/d2/dd/d1c/d1d/f50 29860 1 2024-04-26T12:06:56.435 INFO:tasks.workunit.client.0.smithi052.stdout:8/387: dread d0/d4/f38 [0,4194304] 0 2024-04-26T12:06:56.437 INFO:tasks.workunit.client.0.smithi052.stdout:1/419: creat d0/d2/dd/d40/d81/d52/f8d x:0 0 0 2024-04-26T12:06:56.437 INFO:tasks.workunit.client.0.smithi052.stdout:2/483: rename d0/d3f/d56/d6d/d5a/f88 to d0/d7/d22/f9f 0 2024-04-26T12:06:56.438 INFO:tasks.workunit.client.0.smithi052.stdout:9/460: dwrite d3/db/d10/f1c [0,4194304] 0 2024-04-26T12:06:56.439 INFO:tasks.workunit.client.0.smithi052.stdout:2/484: creat d0/d3f/d56/d6d/fa0 x:0 0 0 2024-04-26T12:06:56.439 INFO:tasks.workunit.client.0.smithi052.stdout:1/420: creat d0/d83/d4b/f8e x:0 0 0 2024-04-26T12:06:56.440 INFO:tasks.workunit.client.0.smithi052.stdout:9/461: chown d3/d82/d8f/f5e 5569 1 2024-04-26T12:06:56.440 INFO:tasks.workunit.client.0.smithi052.stdout:2/485: fdatasync d0/d7/d16/f24 0 2024-04-26T12:06:56.441 INFO:tasks.workunit.client.0.smithi052.stdout:9/462: chown d3/d82/f8e 7914905 1 2024-04-26T12:06:56.441 INFO:tasks.workunit.client.0.smithi052.stdout:1/421: write d0/da/f19 [189914,52380] 0 2024-04-26T12:06:56.442 INFO:tasks.workunit.client.0.smithi052.stdout:1/422: chown d0/d83/d4b 16173 1 2024-04-26T12:06:56.442 INFO:tasks.workunit.client.0.smithi052.stdout:7/434: unlink d1/d1c/d21/d2f/d33/l61 0 2024-04-26T12:06:56.443 INFO:tasks.workunit.client.0.smithi052.stdout:9/463: chown d3/db/d10/d3c/d40/f42 22061032 1 2024-04-26T12:06:56.443 INFO:tasks.workunit.client.0.smithi052.stdout:1/423: write d0/f20 [4417900,5244] 0 2024-04-26T12:06:56.444 INFO:tasks.workunit.client.0.smithi052.stdout:8/388: dwrite d0/d4/d5/d3c/f5d [0,4194304] 0 2024-04-26T12:06:56.445 INFO:tasks.workunit.client.0.smithi052.stdout:9/464: link d3/db/d10/c81 d3/db/c9d 0 2024-04-26T12:06:56.445 INFO:tasks.workunit.client.0.smithi052.stdout:1/424: link d0/d2/f18 d0/d83/d4b/f8f 0 2024-04-26T12:06:56.448 INFO:tasks.workunit.client.0.smithi052.stdout:1/425: write d0/d2/dd/d1c/d1d/d23/f2b [3687062,125203] 0 2024-04-26T12:06:56.448 INFO:tasks.workunit.client.0.smithi052.stdout:0/462: dread d0/d1/d11/f17 [0,4194304] 0 2024-04-26T12:06:56.448 INFO:tasks.workunit.client.0.smithi052.stdout:8/389: dread d0/d4/f38 [0,4194304] 0 2024-04-26T12:06:56.449 INFO:tasks.workunit.client.0.smithi052.stdout:1/426: unlink d0/d83/d4b/d60/f3b 0 2024-04-26T12:06:56.451 INFO:tasks.workunit.client.0.smithi052.stdout:1/427: mkdir d0/d2/dd/d1c/d90 0 2024-04-26T12:06:56.451 INFO:tasks.workunit.client.0.smithi052.stdout:9/465: dwrite d3/d3b/f3e [0,4194304] 0 2024-04-26T12:06:56.453 INFO:tasks.workunit.client.0.smithi052.stdout:9/466: symlink d3/d23/l9e 0 2024-04-26T12:06:56.454 INFO:tasks.workunit.client.0.smithi052.stdout:5/430: dread db/dc/d5f/d50/d46/f4c [0,4194304] 0 2024-04-26T12:06:56.454 INFO:tasks.workunit.client.0.smithi052.stdout:0/463: dwrite d0/d1/f12 [8388608,4194304] 0 2024-04-26T12:06:56.456 INFO:tasks.workunit.client.0.smithi052.stdout:5/431: truncate db/dd/f27 5012518 0 2024-04-26T12:06:56.456 INFO:tasks.workunit.client.0.smithi052.stdout:0/464: fdatasync d0/d1/d1a/f4b 0 2024-04-26T12:06:56.456 INFO:tasks.workunit.client.0.smithi052.stdout:8/390: dwrite d0/d4/d5/d27/d69/f76 [0,4194304] 0 2024-04-26T12:06:56.457 INFO:tasks.workunit.client.0.smithi052.stdout:9/467: dread d3/d82/d8f/d49/f72 [0,4194304] 0 2024-04-26T12:06:56.457 INFO:tasks.workunit.client.0.smithi052.stdout:7/435: sync 2024-04-26T12:06:56.457 INFO:tasks.workunit.client.0.smithi052.stdout:6/429: write da/f1d [3588404,67335] 0 2024-04-26T12:06:56.457 INFO:tasks.workunit.client.0.smithi052.stdout:8/391: readlink d0/l62 0 2024-04-26T12:06:56.458 INFO:tasks.workunit.client.0.smithi052.stdout:9/468: write d3/d82/f8e [512401,48590] 0 2024-04-26T12:06:56.459 INFO:tasks.workunit.client.0.smithi052.stdout:5/432: fdatasync db/dd/d34/f57 0 2024-04-26T12:06:56.459 INFO:tasks.workunit.client.0.smithi052.stdout:7/436: symlink d1/d1f/d55/l8b 0 2024-04-26T12:06:56.460 INFO:tasks.workunit.client.0.smithi052.stdout:0/465: link d0/d3d/f3f d0/d26/d36/f92 0 2024-04-26T12:06:56.460 INFO:tasks.workunit.client.0.smithi052.stdout:3/408: chown d2/d4/d41/d59/c57 53217316 1 2024-04-26T12:06:56.461 INFO:tasks.workunit.client.0.smithi052.stdout:7/437: creat d1/d1f/f8c x:0 0 0 2024-04-26T12:06:56.462 INFO:tasks.workunit.client.0.smithi052.stdout:1/428: rename d0/d83/d4b/d60 to d0/d2/dd/d1c/d1d/d91 0 2024-04-26T12:06:56.462 INFO:tasks.workunit.client.0.smithi052.stdout:6/430: truncate da/d22/d3c/f58 4615351 0 2024-04-26T12:06:56.463 INFO:tasks.workunit.client.0.smithi052.stdout:9/469: mknod d3/d23/d7f/c9f 0 2024-04-26T12:06:56.463 INFO:tasks.workunit.client.0.smithi052.stdout:8/392: mknod d0/d4/d5/d27/d57/c77 0 2024-04-26T12:06:56.465 INFO:tasks.workunit.client.0.smithi052.stdout:0/466: write d0/d1/d52/f6b [1433337,42648] 0 2024-04-26T12:06:56.465 INFO:tasks.workunit.client.0.smithi052.stdout:6/431: fsync da/f37 0 2024-04-26T12:06:56.465 INFO:tasks.workunit.client.0.smithi052.stdout:5/433: readlink db/dd/d18/d60/d64/l4a 0 2024-04-26T12:06:56.465 INFO:tasks.workunit.client.0.smithi052.stdout:4/408: dwrite d3/d22/d30/f70 [0,4194304] 0 2024-04-26T12:06:56.466 INFO:tasks.workunit.client.0.smithi052.stdout:2/486: dwrite d0/d36/f90 [0,4194304] 0 2024-04-26T12:06:56.467 INFO:tasks.workunit.client.0.smithi052.stdout:1/429: symlink d0/d2/dd/d40/l92 0 2024-04-26T12:06:56.467 INFO:tasks.workunit.client.0.smithi052.stdout:0/467: fdatasync d0/d1/d11/f4a 0 2024-04-26T12:06:56.467 INFO:tasks.workunit.client.0.smithi052.stdout:7/438: readlink d1/d1c/d21/d2f/d68/l84 0 2024-04-26T12:06:56.468 INFO:tasks.workunit.client.0.smithi052.stdout:9/470: symlink d3/db/d2b/la0 0 2024-04-26T12:06:56.468 INFO:tasks.workunit.client.0.smithi052.stdout:5/434: stat db/dc/d5f/l3c 0 2024-04-26T12:06:56.468 INFO:tasks.workunit.client.0.smithi052.stdout:0/468: stat d0/d1/d11/f16 0 2024-04-26T12:06:56.468 INFO:tasks.workunit.client.0.smithi052.stdout:1/430: write d0/f20 [4289182,36450] 0 2024-04-26T12:06:56.470 INFO:tasks.workunit.client.0.smithi052.stdout:8/393: creat d0/f78 x:0 0 0 2024-04-26T12:06:56.470 INFO:tasks.workunit.client.0.smithi052.stdout:6/432: creat da/d22/d3c/d74/d7e/f98 x:0 0 0 2024-04-26T12:06:56.470 INFO:tasks.workunit.client.0.smithi052.stdout:9/471: dread d3/d82/d8f/d49/f72 [0,4194304] 0 2024-04-26T12:06:56.471 INFO:tasks.workunit.client.0.smithi052.stdout:5/435: readlink db/dd/d34/d70/l31 0 2024-04-26T12:06:56.471 INFO:tasks.workunit.client.0.smithi052.stdout:0/469: symlink d0/d26/l93 0 2024-04-26T12:06:56.472 INFO:tasks.workunit.client.0.smithi052.stdout:2/487: creat d0/d3f/d56/d6d/d5a/d73/d4b/d8f/fa1 x:0 0 0 2024-04-26T12:06:56.472 INFO:tasks.workunit.client.0.smithi052.stdout:1/431: mknod d0/d2/dd/d34/c93 0 2024-04-26T12:06:56.473 INFO:tasks.workunit.client.0.smithi052.stdout:9/472: fdatasync d3/db/d10/d3c/d40/d96/f6e 0 2024-04-26T12:06:56.473 INFO:tasks.workunit.client.0.smithi052.stdout:8/394: fsync d0/d16/f2a 0 2024-04-26T12:06:56.473 INFO:tasks.workunit.client.0.smithi052.stdout:4/409: getdents d3/d12 0 2024-04-26T12:06:56.473 INFO:tasks.workunit.client.0.smithi052.stdout:7/439: getdents d1/d1c/d21/d2f/d33/d3a 0 2024-04-26T12:06:56.474 INFO:tasks.workunit.client.0.smithi052.stdout:6/433: rename da/d22/d3c/d6e to da/d22/d3c/d74/d99 0 2024-04-26T12:06:56.474 INFO:tasks.workunit.client.0.smithi052.stdout:5/436: mkdir db/dc/d5f/d50/d91 0 2024-04-26T12:06:56.474 INFO:tasks.workunit.client.0.smithi052.stdout:4/410: rmdir d3/d44/d4b 39 2024-04-26T12:06:56.474 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:56.472+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:56.475 INFO:tasks.workunit.client.0.smithi052.stdout:1/432: stat d0/d2/dd/d34/c93 0 2024-04-26T12:06:56.475 INFO:tasks.workunit.client.0.smithi052.stdout:8/395: dread - d0/f70 zero size 2024-04-26T12:06:56.475 INFO:tasks.workunit.client.0.smithi052.stdout:5/437: rmdir db/dd 39 2024-04-26T12:06:56.475 INFO:tasks.workunit.client.0.smithi052.stdout:4/411: symlink d3/d15/l8e 0 2024-04-26T12:06:56.475 INFO:tasks.workunit.client.0.smithi052.stdout:1/433: write d0/d2/f6 [242499,81844] 0 2024-04-26T12:06:56.476 INFO:tasks.workunit.client.0.smithi052.stdout:7/440: rename d1/c13 to d1/d45/d4c/c8d 0 2024-04-26T12:06:56.476 INFO:tasks.workunit.client.0.smithi052.stdout:5/438: dread - db/dd/d34/d70/f80 zero size 2024-04-26T12:06:56.477 INFO:tasks.workunit.client.0.smithi052.stdout:4/412: dread - d3/d12/d34/d45/f88 zero size 2024-04-26T12:06:56.477 INFO:tasks.workunit.client.0.smithi052.stdout:7/441: sync 2024-04-26T12:06:56.477 INFO:tasks.workunit.client.0.smithi052.stdout:8/396: write d0/d4/d5/d27/f4c [1973340,28689] 0 2024-04-26T12:06:56.477 INFO:tasks.workunit.client.0.smithi052.stdout:6/434: rename da/d22/d29/d31/c91 to da/d63/c9a 0 2024-04-26T12:06:56.478 INFO:tasks.workunit.client.0.smithi052.stdout:7/442: creat d1/d1c/d23/d81/f8e x:0 0 0 2024-04-26T12:06:56.478 INFO:tasks.workunit.client.0.smithi052.stdout:4/413: unlink d3/d12/d59/f60 0 2024-04-26T12:06:56.478 INFO:tasks.workunit.client.0.smithi052.stdout:6/435: rmdir da/d22/d29/d31/d6f 39 2024-04-26T12:06:56.478 INFO:tasks.workunit.client.0.smithi052.stdout:0/470: dwrite d0/d1/f24 [4194304,4194304] 0 2024-04-26T12:06:56.480 INFO:tasks.workunit.client.0.smithi052.stdout:3/409: dread d2/d4/d31/f54 [0,4194304] 0 2024-04-26T12:06:56.481 INFO:tasks.workunit.client.0.smithi052.stdout:4/414: dread - d3/d12/d34/d45/f47 zero size 2024-04-26T12:06:56.481 INFO:tasks.workunit.client.0.smithi052.stdout:6/436: creat da/d5d/f9b x:0 0 0 2024-04-26T12:06:56.482 INFO:tasks.workunit.client.0.smithi052.stdout:0/471: truncate d0/d26/f7e 501876 0 2024-04-26T12:06:56.482 INFO:tasks.workunit.client.0.smithi052.stdout:4/415: stat d3/d12/d34 0 2024-04-26T12:06:56.483 INFO:tasks.workunit.client.0.smithi052.stdout:3/410: creat d2/d4/dc/f7a x:0 0 0 2024-04-26T12:06:56.483 INFO:tasks.workunit.client.0.smithi052.stdout:6/437: mkdir da/d5d/d9c 0 2024-04-26T12:06:56.485 INFO:tasks.workunit.client.0.smithi052.stdout:6/438: stat da/f1b 0 2024-04-26T12:06:56.485 INFO:tasks.workunit.client.0.smithi052.stdout:8/397: dwrite d0/d3e/f4a [0,4194304] 0 2024-04-26T12:06:56.485 INFO:tasks.workunit.client.0.smithi052.stdout:5/439: dwrite db/dc/d5f/d50/d46/f4b [0,4194304] 0 2024-04-26T12:06:56.486 INFO:tasks.workunit.client.0.smithi052.stdout:3/411: mkdir d2/d4/d6b/d7b 0 2024-04-26T12:06:56.487 INFO:tasks.workunit.client.0.smithi052.stdout:7/443: dwrite d1/d1c/d23/f50 [0,4194304] 0 2024-04-26T12:06:56.487 INFO:tasks.workunit.client.0.smithi052.stdout:5/440: read - db/dd/d34/d70/f80 zero size 2024-04-26T12:06:56.488 INFO:tasks.workunit.client.0.smithi052.stdout:5/441: chown db/dd/d34/c65 2 1 2024-04-26T12:06:56.488 INFO:tasks.workunit.client.0.smithi052.stdout:6/439: mknod da/d22/d29/d31/c9d 0 2024-04-26T12:06:56.488 INFO:tasks.workunit.client.0.smithi052.stdout:5/442: sync 2024-04-26T12:06:56.489 INFO:tasks.workunit.client.0.smithi052.stdout:8/398: getdents d0 0 2024-04-26T12:06:56.490 INFO:tasks.workunit.client.0.smithi052.stdout:2/488: write d0/f33 [2625132,62991] 0 2024-04-26T12:06:56.491 INFO:tasks.workunit.client.0.smithi052.stdout:2/489: readlink d0/d3f/l50 0 2024-04-26T12:06:56.493 INFO:tasks.workunit.client.0.smithi052.stdout:8/399: link d0/d4/d5/fe d0/d4/dc/d68/f79 0 2024-04-26T12:06:56.494 INFO:tasks.workunit.client.0.smithi052.stdout:8/400: creat d0/f7a x:0 0 0 2024-04-26T12:06:56.495 INFO:tasks.workunit.client.0.smithi052.stdout:9/473: dwrite d3/d82/d8f/f6f [0,4194304] 0 2024-04-26T12:06:56.496 INFO:tasks.workunit.client.0.smithi052.stdout:8/401: fdatasync d0/d4/f4d 0 2024-04-26T12:06:56.496 INFO:tasks.workunit.client.0.smithi052.stdout:6/440: dwrite da/d22/d3c/d74/d99/f70 [0,4194304] 0 2024-04-26T12:06:56.496 INFO:tasks.workunit.client.0.smithi052.stdout:5/443: dwrite db/dc/d5f/f7a [0,4194304] 0 2024-04-26T12:06:56.498 INFO:tasks.workunit.client.0.smithi052.stdout:8/402: write d0/d3e/f42 [339120,104416] 0 2024-04-26T12:06:56.498 INFO:tasks.workunit.client.0.smithi052.stdout:4/416: write d3/d12/f20 [493278,3276] 0 2024-04-26T12:06:56.499 INFO:tasks.workunit.client.0.smithi052.stdout:9/474: getdents d3/db 0 2024-04-26T12:06:56.499 INFO:tasks.workunit.client.0.smithi052.stdout:0/472: truncate d0/d1/d11/f17 6533940 0 2024-04-26T12:06:56.499 INFO:tasks.workunit.client.0.smithi052.stdout:7/444: truncate d1/f7 3129825 0 2024-04-26T12:06:56.499 INFO:tasks.workunit.client.0.smithi052.stdout:3/412: truncate d2/d4/dc/d1d/d3f/f5e 450428 0 2024-04-26T12:06:56.500 INFO:tasks.workunit.client.0.smithi052.stdout:4/417: write d3/d15/f17 [5001782,10502] 0 2024-04-26T12:06:56.500 INFO:tasks.workunit.client.0.smithi052.stdout:1/434: dread d0/d2/dd/f32 [0,4194304] 0 2024-04-26T12:06:56.501 INFO:tasks.workunit.client.0.smithi052.stdout:5/444: mkdir db/dd/d34/d70/d78/d92 0 2024-04-26T12:06:56.501 INFO:tasks.workunit.client.0.smithi052.stdout:9/475: chown d3/db/c83 3 1 2024-04-26T12:06:56.503 INFO:tasks.workunit.client.0.smithi052.stdout:2/490: truncate d0/d7/f39 334200 0 2024-04-26T12:06:56.503 INFO:tasks.workunit.client.0.smithi052.stdout:0/473: mknod d0/d1/d2c/c94 0 2024-04-26T12:06:56.503 INFO:tasks.workunit.client.0.smithi052.stdout:6/441: creat da/d22/d3c/d74/d99/d92/d96/f9e x:0 0 0 2024-04-26T12:06:56.503 INFO:tasks.workunit.client.0.smithi052.stdout:1/435: fdatasync d0/d2/dd/d34/f4e 0 2024-04-26T12:06:56.503 INFO:tasks.workunit.client.0.smithi052.stdout:6/442: write da/d51/f69 [883668,117885] 0 2024-04-26T12:06:56.503 INFO:tasks.workunit.client.0.smithi052.stdout:7/445: creat d1/d1c/d21/d2f/d33/d3a/f8f x:0 0 0 2024-04-26T12:06:56.503 INFO:tasks.workunit.client.0.smithi052.stdout:3/413: unlink d2/d4/d41/d59/c57 0 2024-04-26T12:06:56.503 INFO:tasks.workunit.client.0.smithi052.stdout:8/403: mkdir d0/d4/d5/db/d20/d7b 0 2024-04-26T12:06:56.503 INFO:tasks.workunit.client.0.smithi052.stdout:2/491: creat d0/d3f/d56/d6d/d5a/fa2 x:0 0 0 2024-04-26T12:06:56.503 INFO:tasks.workunit.client.0.smithi052.stdout:5/445: rename db/dc/d5f/d3f to db/dd/d34/d69/d93 0 2024-04-26T12:06:56.504 INFO:tasks.workunit.client.0.smithi052.stdout:5/446: chown db/f1f 45007 1 2024-04-26T12:06:56.504 INFO:tasks.workunit.client.0.smithi052.stdout:1/436: creat d0/d2/dd/d1c/d1d/d91/f94 x:0 0 0 2024-04-26T12:06:56.504 INFO:tasks.workunit.client.0.smithi052.stdout:2/492: chown d0/d3f/d56/d6d/d5a/fa2 407379113 1 2024-04-26T12:06:56.504 INFO:tasks.workunit.client.0.smithi052.stdout:7/446: rename d1/d1f/c39 to d1/d1c/d23/c90 0 2024-04-26T12:06:56.505 INFO:tasks.workunit.client.0.smithi052.stdout:3/414: chown d2/d4/dc/d1d/d25/d36/d1c/f20 4986255 1 2024-04-26T12:06:56.506 INFO:tasks.workunit.client.0.smithi052.stdout:5/447: fsync db/dd/d18/f71 0 2024-04-26T12:06:56.506 INFO:tasks.workunit.client.0.smithi052.stdout:1/437: rmdir d0/d2/dd/d1c/d90 0 2024-04-26T12:06:56.507 INFO:tasks.workunit.client.0.smithi052.stdout:7/447: creat d1/d1c/d21/d2f/d68/f91 x:0 0 0 2024-04-26T12:06:56.508 INFO:tasks.workunit.client.0.smithi052.stdout:9/476: fdatasync d3/d82/d8f/d49/f72 0 2024-04-26T12:06:56.508 INFO:tasks.workunit.client.0.smithi052.stdout:3/415: mkdir d2/d4/d6b/d7b/d7c 0 2024-04-26T12:06:56.509 INFO:tasks.workunit.client.0.smithi052.stdout:1/438: mkdir d0/d2/dd/d34/d95 0 2024-04-26T12:06:56.510 INFO:tasks.workunit.client.0.smithi052.stdout:0/474: dwrite d0/d3c/f80 [0,4194304] 0 2024-04-26T12:06:56.511 INFO:tasks.workunit.client.0.smithi052.stdout:6/443: dwrite da/d5d/f9b [0,4194304] 0 2024-04-26T12:06:56.511 INFO:tasks.workunit.client.0.smithi052.stdout:5/448: rename db/dc/d5f/f49 to db/dd/d34/d70/d78/f94 0 2024-04-26T12:06:56.511 INFO:tasks.workunit.client.0.smithi052.stdout:1/439: chown d0/f55 4793 1 2024-04-26T12:06:56.512 INFO:tasks.workunit.client.0.smithi052.stdout:9/477: creat d3/d23/d7f/fa1 x:0 0 0 2024-04-26T12:06:56.513 INFO:tasks.workunit.client.0.smithi052.stdout:6/444: symlink da/d5d/l9f 0 2024-04-26T12:06:56.513 INFO:tasks.workunit.client.0.smithi052.stdout:0/475: creat d0/d1/d54/f95 x:0 0 0 2024-04-26T12:06:56.513 INFO:tasks.workunit.client.0.smithi052.stdout:1/440: write d0/d2/f6 [3597991,95950] 0 2024-04-26T12:06:56.514 INFO:tasks.workunit.client.0.smithi052.stdout:3/416: link d2/d4/dc/d33/d37/f3a d2/d4/d6b/d7b/f7d 0 2024-04-26T12:06:56.514 INFO:tasks.workunit.client.0.smithi052.stdout:5/449: creat db/dd/d34/d70/d59/f95 x:0 0 0 2024-04-26T12:06:56.514 INFO:tasks.workunit.client.0.smithi052.stdout:6/445: read - da/d63/f78 zero size 2024-04-26T12:06:56.515 INFO:tasks.workunit.client.0.smithi052.stdout:2/493: dwrite d0/d7/d22/f87 [0,4194304] 0 2024-04-26T12:06:56.515 INFO:tasks.workunit.client.0.smithi052.stdout:4/418: dread d3/d15/f17 [4194304,4194304] 0 2024-04-26T12:06:56.515 INFO:tasks.workunit.client.0.smithi052.stdout:0/476: write d0/d1/d54/f95 [423235,81428] 0 2024-04-26T12:06:56.516 INFO:tasks.workunit.client.0.smithi052.stdout:9/478: link d3/db/c7b d3/db/d10/d3c/d40/ca2 0 2024-04-26T12:06:56.516 INFO:tasks.workunit.client.0.smithi052.stdout:3/417: chown d2/d4/dc/d1d/d25 58036080 1 2024-04-26T12:06:56.516 INFO:tasks.workunit.client.0.smithi052.stdout:5/450: symlink db/dd/l96 0 2024-04-26T12:06:56.516 INFO:tasks.workunit.client.0.smithi052.stdout:6/446: unlink da/d22/d29/d31/d39/c4e 0 2024-04-26T12:06:56.517 INFO:tasks.workunit.client.0.smithi052.stdout:2/494: unlink d0/d36/l51 0 2024-04-26T12:06:56.518 INFO:tasks.workunit.client.0.smithi052.stdout:9/479: dread - d3/f87 zero size 2024-04-26T12:06:56.518 INFO:tasks.workunit.client.0.smithi052.stdout:3/418: stat d2/d4/d2a/d2d/f78 0 2024-04-26T12:06:56.518 INFO:tasks.workunit.client.0.smithi052.stdout:6/447: write da/d22/d29/d31/f49 [602303,50041] 0 2024-04-26T12:06:56.520 INFO:tasks.workunit.client.0.smithi052.stdout:5/451: mknod db/dd/d34/d69/d93/c97 0 2024-04-26T12:06:56.522 INFO:tasks.workunit.client.0.smithi052.stdout:9/480: write d3/d82/d8f/d49/f8a [867306,15453] 0 2024-04-26T12:06:56.523 INFO:tasks.workunit.client.0.smithi052.stdout:8/404: truncate d0/d4/d1c/f36 2580952 0 2024-04-26T12:06:56.523 INFO:tasks.workunit.client.0.smithi052.stdout:0/477: dread d0/f66 [0,4194304] 0 2024-04-26T12:06:56.524 INFO:tasks.workunit.client.0.smithi052.stdout:3/419: creat d2/d4/dc/d1d/d3f/f7e x:0 0 0 2024-04-26T12:06:56.525 INFO:tasks.workunit.client.0.smithi052.stdout:0/478: symlink d0/d1/d11/l96 0 2024-04-26T12:06:56.525 INFO:tasks.workunit.client.0.smithi052.stdout:3/420: stat d2/f6d 0 2024-04-26T12:06:56.526 INFO:tasks.workunit.client.0.smithi052.stdout:8/405: unlink d0/f44 0 2024-04-26T12:06:56.526 INFO:tasks.workunit.client.0.smithi052.stdout:4/419: dwrite d3/d22/f23 [0,4194304] 0 2024-04-26T12:06:56.527 INFO:tasks.workunit.client.0.smithi052.stdout:9/481: mkdir d3/d82/da3 0 2024-04-26T12:06:56.528 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-26T12:06:56.528 INFO:tasks.workunit.client.0.smithi052.stdout:6/448: getdents da/d22/d3c/d74/d99/d92 0 2024-04-26T12:06:56.528 INFO:tasks.workunit.client.0.smithi052.stdout:0/479: write d0/d1/d1a/d20/f83 [885641,108043] 0 2024-04-26T12:06:56.528 INFO:tasks.workunit.client.0.smithi052.stdout:5/452: link db/dd/d18/d60/c8d db/dd/c98 0 2024-04-26T12:06:56.529 INFO:tasks.workunit.client.0.smithi052.stdout:3/421: creat d2/d4/d31/f7f x:0 0 0 2024-04-26T12:06:56.529 INFO:tasks.workunit.client.0.smithi052.stdout:2/495: dread d0/d7/d2f/f78 [0,4194304] 0 2024-04-26T12:06:56.530 INFO:tasks.workunit.client.0.smithi052.stdout:9/482: mkdir d3/d82/d8f/d49/da4 0 2024-04-26T12:06:56.530 INFO:tasks.workunit.client.0.smithi052.stdout:4/420: write d3/d2e/f3a [1295268,109663] 0 2024-04-26T12:06:56.530 INFO:tasks.workunit.client.0.smithi052.stdout:2/496: mknod d0/d7/d22/ca3 0 2024-04-26T12:06:56.531 INFO:tasks.workunit.client.0.smithi052.stdout:3/422: mkdir d2/d80 0 2024-04-26T12:06:56.531 INFO:tasks.workunit.client.0.smithi052.stdout:6/449: creat da/d22/d3c/d74/fa0 x:0 0 0 2024-04-26T12:06:56.532 INFO:tasks.workunit.client.0.smithi052.stdout:2/497: fdatasync d0/f9a 0 2024-04-26T12:06:56.532 INFO:tasks.workunit.client.0.smithi052.stdout:8/406: rename d0/d4/d1c/c39 to d0/d4/d5/db/c7c 0 2024-04-26T12:06:56.533 INFO:tasks.workunit.client.0.smithi052.stdout:9/483: creat d3/db/d10/d3c/fa5 x:0 0 0 2024-04-26T12:06:56.534 INFO:tasks.workunit.client.0.smithi052.stdout:6/450: rename da/d22/f27 to da/d5d/fa1 0 2024-04-26T12:06:56.534 INFO:tasks.workunit.client.0.smithi052.stdout:8/407: creat d0/d16/d28/f7d x:0 0 0 2024-04-26T12:06:56.535 INFO:tasks.workunit.client.0.smithi052.stdout:2/498: mkdir d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4 0 2024-04-26T12:06:56.535 INFO:tasks.workunit.client.0.smithi052.stdout:6/451: mkdir da/da2 0 2024-04-26T12:06:56.535 INFO:tasks.workunit.client.0.smithi052.stdout:5/453: dread db/dc/d5f/d50/d46/f4c [0,4194304] 0 2024-04-26T12:06:56.538 INFO:tasks.workunit.client.0.smithi052.stdout:3/423: truncate d2/d4/dc/d1d/d25/f2b 4190310 0 2024-04-26T12:06:56.539 INFO:tasks.workunit.client.0.smithi052.stdout:8/408: read d0/d4/d5/fe [1473424,127674] 0 2024-04-26T12:06:56.542 INFO:tasks.workunit.client.0.smithi052.stdout:6/452: chown da/d22/d3c/d74/d99/f70 61 1 2024-04-26T12:06:56.543 INFO:tasks.workunit.client.0.smithi052.stdout:7/448: dread d1/f20 [0,4194304] 0 2024-04-26T12:06:56.548 INFO:tasks.workunit.client.0.smithi052.stdout:3/424: dread d2/d4/dc/f6f [0,4194304] 0 2024-04-26T12:06:56.548 INFO:tasks.workunit.client.0.smithi052.stdout:4/421: write d3/d12/d64/f79 [554460,46746] 0 2024-04-26T12:06:56.548 INFO:tasks.workunit.client.0.smithi052.stdout:9/484: dwrite d3/db/d10/d3c/fa5 [0,4194304] 0 2024-04-26T12:06:56.549 INFO:tasks.workunit.client.0.smithi052.stdout:6/453: write da/d22/d3c/d74/d99/d7c/f8e [369140,115451] 0 2024-04-26T12:06:56.550 INFO:tasks.workunit.client.0.smithi052.stdout:5/454: dread db/dc/f54 [0,4194304] 0 2024-04-26T12:06:56.550 INFO:tasks.workunit.client.0.smithi052.stdout:3/425: fsync d2/d4/f79 0 2024-04-26T12:06:56.552 INFO:tasks.workunit.client.0.smithi052.stdout:5/455: write db/dd/f73 [546127,26769] 0 2024-04-26T12:06:56.553 INFO:tasks.workunit.client.0.smithi052.stdout:1/441: dread d0/d2/dd/d40/d81/f63 [0,4194304] 0 2024-04-26T12:06:56.553 INFO:tasks.workunit.client.0.smithi052.stdout:1/442: dread - d0/d2/dd/d1c/f82 zero size 2024-04-26T12:06:56.555 INFO:tasks.workunit.client.0.smithi052.stdout:0/480: dread d0/d1/d1a/d20/f3a [0,4194304] 0 2024-04-26T12:06:56.559 INFO:tasks.workunit.client.0.smithi052.stdout:2/499: mknod d0/d3f/d56/d6d/d5a/d82/ca5 0 2024-04-26T12:06:56.559 INFO:tasks.workunit.client.0.smithi052.stdout:7/449: mkdir d1/d1c/d21/d2f/d33/d92 0 2024-04-26T12:06:56.559 INFO:tasks.workunit.client.0.smithi052.stdout:9/485: rmdir d3/d82 39 2024-04-26T12:06:56.560 INFO:tasks.workunit.client.0.smithi052.stdout:4/422: rename d3/d22/f23 to d3/d12/d34/d45/d67/d6c/f8f 0 2024-04-26T12:06:56.560 INFO:tasks.workunit.client.0.smithi052.stdout:5/456: mknod db/d5c/c99 0 2024-04-26T12:06:56.560 INFO:tasks.workunit.client.0.smithi052.stdout:0/481: mkdir d0/d1/dd/d72/d97 0 2024-04-26T12:06:56.560 INFO:tasks.workunit.client.0.smithi052.stdout:6/454: symlink da/d5d/d9c/la3 0 2024-04-26T12:06:56.560 INFO:tasks.workunit.client.0.smithi052.stdout:2/500: mknod d0/d3f/d56/ca6 0 2024-04-26T12:06:56.561 INFO:tasks.workunit.client.0.smithi052.stdout:1/443: rename d0/d2/dd/d40/l71 to d0/d2/dd/d1c/d1d/d91/l96 0 2024-04-26T12:06:56.562 INFO:tasks.workunit.client.0.smithi052.stdout:0/482: creat d0/d26/d36/f98 x:0 0 0 2024-04-26T12:06:56.562 INFO:tasks.workunit.client.0.smithi052.stdout:6/455: mknod da/d51/ca4 0 2024-04-26T12:06:56.562 INFO:tasks.workunit.client.0.smithi052.stdout:5/457: creat db/dd/d18/d60/f9a x:0 0 0 2024-04-26T12:06:56.562 INFO:tasks.workunit.client.0.smithi052.stdout:2/501: write d0/d3f/f80 [3408686,82497] 0 2024-04-26T12:06:56.562 INFO:tasks.workunit.client.0.smithi052.stdout:0/483: stat d0/d1/dd 0 2024-04-26T12:06:56.564 INFO:tasks.workunit.client.0.smithi052.stdout:9/486: getdents d3/d82 0 2024-04-26T12:06:56.564 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:06:56.565 INFO:tasks.workunit.client.0.smithi052.stdout:2/502: symlink d0/d7/d16/d3a/la7 0 2024-04-26T12:06:56.565 INFO:tasks.workunit.client.0.smithi052.stdout:5/458: getdents db/dd/d34/d70/d78 0 2024-04-26T12:06:56.567 INFO:tasks.workunit.client.0.smithi052.stdout:9/487: rename d3/db/c7b to d3/d82/da3/ca6 0 2024-04-26T12:06:56.568 INFO:tasks.workunit.client.0.smithi052.stdout:5/459: chown db/dd/d18/f71 48129 1 2024-04-26T12:06:56.568 INFO:tasks.workunit.client.0.smithi052.stdout:4/423: dwrite d3/d15/f83 [0,4194304] 0 2024-04-26T12:06:56.570 INFO:tasks.workunit.client.0.smithi052.stdout:1/444: dwrite d0/f64 [0,4194304] 0 2024-04-26T12:06:56.572 INFO:tasks.workunit.client.0.smithi052.stdout:5/460: mkdir db/dd/d34/d9b 0 2024-04-26T12:06:56.572 INFO:tasks.workunit.client.0.smithi052.stdout:4/424: mknod d3/d2b/d40/c90 0 2024-04-26T12:06:56.572 INFO:tasks.workunit.client.0.smithi052.stdout:6/456: dwrite da/d5d/d64/d68/f86 [0,4194304] 0 2024-04-26T12:06:56.573 INFO:tasks.workunit.client.0.smithi052.stdout:2/503: rename d0/d3f/d56/d6d/d5a/d73/l62 to d0/d3f/d56/d6d/d5a/d73/d4b/d9c/la8 0 2024-04-26T12:06:56.573 INFO:tasks.workunit.client.0.smithi052.stdout:1/445: stat d0/d2 0 2024-04-26T12:06:56.573 INFO:tasks.workunit.client.0.smithi052.stdout:4/425: mkdir d3/d12/d34/d91 0 2024-04-26T12:06:56.574 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:56.573+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:56.574 INFO:tasks.workunit.client.0.smithi052.stdout:2/504: creat d0/d7/d2f/d4c/fa9 x:0 0 0 2024-04-26T12:06:56.574 INFO:tasks.workunit.client.0.smithi052.stdout:5/461: mkdir db/dd/d18/d60/d64/d9c 0 2024-04-26T12:06:56.576 INFO:tasks.workunit.client.0.smithi052.stdout:4/426: write d3/d2e/f4d [3120561,12842] 0 2024-04-26T12:06:56.577 INFO:tasks.workunit.client.0.smithi052.stdout:5/462: write db/dd/d34/f57 [2039878,668] 0 2024-04-26T12:06:56.578 INFO:tasks.workunit.client.0.smithi052.stdout:4/427: write d3/d12/d59/f82 [572838,46980] 0 2024-04-26T12:06:56.578 INFO:tasks.workunit.client.0.smithi052.stdout:5/463: stat db/d5c 0 2024-04-26T12:06:56.579 INFO:tasks.workunit.client.0.smithi052.stdout:4/428: dread - d3/d44/f48 zero size 2024-04-26T12:06:56.581 INFO:tasks.workunit.client.0.smithi052.stdout:2/505: unlink d0/d7/d22/c46 0 2024-04-26T12:06:56.583 INFO:tasks.workunit.client.0.smithi052.stdout:2/506: read - d0/d3f/d56/d6d/f97 zero size 2024-04-26T12:06:56.588 INFO:tasks.workunit.client.0.smithi052.stdout:6/457: dread da/d22/d29/f4c [0,4194304] 0 2024-04-26T12:06:56.589 INFO:tasks.workunit.client.0.smithi052.stdout:6/458: write da/d51/f5b [1013282,111169] 0 2024-04-26T12:06:56.590 INFO:tasks.workunit.client.0.smithi052.stdout:0/484: dread d0/d26/d36/f63 [0,4194304] 0 2024-04-26T12:06:56.590 INFO:tasks.workunit.client.0.smithi052.stdout:6/459: read - da/d63/f78 zero size 2024-04-26T12:06:56.592 INFO:tasks.workunit.client.0.smithi052.stdout:4/429: mkdir d3/d22/d30/d71/d92 0 2024-04-26T12:06:56.592 INFO:tasks.workunit.client.0.smithi052.stdout:6/460: stat da/d22/d3c/d74/d99/f70 0 2024-04-26T12:06:56.593 INFO:tasks.workunit.client.0.smithi052.stdout:1/446: rmdir d0/d2/dd 39 2024-04-26T12:06:56.593 INFO:tasks.workunit.client.0.smithi052.stdout:5/464: write db/dc/f1d [4245302,49780] 0 2024-04-26T12:06:56.593 INFO:tasks.workunit.client.0.smithi052.stdout:7/450: truncate d1/f14 3119633 0 2024-04-26T12:06:56.593 INFO:tasks.workunit.client.0.smithi052.stdout:3/426: sync 2024-04-26T12:06:56.593 INFO:tasks.workunit.client.0.smithi052.stdout:9/488: write d3/db/d10/f38 [1190805,27136] 0 2024-04-26T12:06:56.593 INFO:tasks.workunit.client.0.smithi052.stdout:2/507: chown d0/d7/f10 673111 1 2024-04-26T12:06:56.594 INFO:tasks.workunit.client.0.smithi052.stdout:8/409: write d0/d4/d1c/f36 [903618,29103] 0 2024-04-26T12:06:56.594 INFO:tasks.workunit.client.0.smithi052.stdout:0/485: mknod d0/d1/d2c/c99 0 2024-04-26T12:06:56.595 INFO:tasks.workunit.client.0.smithi052.stdout:6/461: symlink da/d22/d3c/d74/d87/la5 0 2024-04-26T12:06:56.596 INFO:tasks.workunit.client.0.smithi052.stdout:0/486: readlink d0/d26/l3e 0 2024-04-26T12:06:56.596 INFO:tasks.workunit.client.0.smithi052.stdout:1/447: chown d0/d2/dd/d40/f77 2894794 1 2024-04-26T12:06:56.598 INFO:tasks.workunit.client.0.smithi052.stdout:8/410: readlink d0/d4/d5/l18 0 2024-04-26T12:06:56.598 INFO:tasks.workunit.client.0.smithi052.stdout:6/462: fdatasync da/d22/d29/f2e 0 2024-04-26T12:06:56.598 INFO:tasks.workunit.client.0.smithi052.stdout:7/451: rename d1/d1c/d23/l6c to d1/d1c/d21/d2f/d33/d92/l93 0 2024-04-26T12:06:56.599 INFO:tasks.workunit.client.0.smithi052.stdout:0/487: stat d0/d1/d11/c25 0 2024-04-26T12:06:56.600 INFO:tasks.workunit.client.0.smithi052.stdout:4/430: dread d3/f4f [0,4194304] 0 2024-04-26T12:06:56.603 INFO:tasks.workunit.client.0.smithi052.stdout:3/427: dwrite d2/d4/dc/d1d/f60 [4194304,4194304] 0 2024-04-26T12:06:56.603 INFO:tasks.workunit.client.0.smithi052.stdout:5/465: dwrite db/f35 [0,4194304] 0 2024-04-26T12:06:56.604 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:56.604 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:56.604 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:56.604 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:56.604 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:56.605 INFO:tasks.workunit.client.0.smithi052.stdout:1/448: write d0/d2/dd/d1c/d1d/d91/f94 [400637,108273] 0 2024-04-26T12:06:56.605 INFO:tasks.workunit.client.0.smithi052.stdout:6/463: write da/d22/d3c/d74/d99/f70 [4085947,60642] 0 2024-04-26T12:06:56.605 INFO:tasks.workunit.client.0.smithi052.stdout:2/508: dwrite d0/d7/f83 [0,4194304] 0 2024-04-26T12:06:56.605 INFO:tasks.workunit.client.0.smithi052.stdout:0/488: chown d0/f49 2632526 1 2024-04-26T12:06:56.608 INFO:tasks.workunit.client.0.smithi052.stdout:3/428: write d2/d4/d2a/f58 [246679,9688] 0 2024-04-26T12:06:56.609 INFO:tasks.workunit.client.0.smithi052.stdout:0/489: creat d0/d3c/f9a x:0 0 0 2024-04-26T12:06:56.610 INFO:tasks.workunit.client.0.smithi052.stdout:5/466: symlink db/dc/d5f/d50/d46/l9d 0 2024-04-26T12:06:56.610 INFO:tasks.workunit.client.0.smithi052.stdout:9/489: dwrite d3/d82/d8f/d49/f8a [0,4194304] 0 2024-04-26T12:06:56.611 INFO:tasks.workunit.client.0.smithi052.stdout:1/449: mknod d0/d83/d4b/c97 0 2024-04-26T12:06:56.611 INFO:tasks.workunit.client.0.smithi052.stdout:2/509: mknod d0/d7/d16/d3a/caa 0 2024-04-26T12:06:56.612 INFO:tasks.workunit.client.0.smithi052.stdout:8/411: dwrite d0/f7a [0,4194304] 0 2024-04-26T12:06:56.612 INFO:tasks.workunit.client.0.smithi052.stdout:3/429: fsync d2/d4/dc/f7a 0 2024-04-26T12:06:56.613 INFO:tasks.workunit.client.0.smithi052.stdout:7/452: dwrite d1/f10 [4194304,4194304] 0 2024-04-26T12:06:56.613 INFO:tasks.workunit.client.0.smithi052.stdout:2/510: stat d0/d7/d2f 0 2024-04-26T12:06:56.613 INFO:tasks.workunit.client.0.smithi052.stdout:9/490: mkdir d3/db/d10/d3c/d40/d96/da7 0 2024-04-26T12:06:56.613 INFO:tasks.workunit.client.0.smithi052.stdout:6/464: creat da/d22/d29/d31/fa6 x:0 0 0 2024-04-26T12:06:56.619 INFO:tasks.workunit.client.0.smithi052.stdout:5/467: rmdir db/dd/d34/d9b 0 2024-04-26T12:06:56.619 INFO:tasks.workunit.client.0.smithi052.stdout:3/430: write d2/d4/dc/d1d/d25/d61/f63 [111652,19191] 0 2024-04-26T12:06:56.620 INFO:tasks.workunit.client.0.smithi052.stdout:8/412: symlink d0/l7e 0 2024-04-26T12:06:56.620 INFO:tasks.workunit.client.0.smithi052.stdout:9/491: truncate d3/d23/f88 1388246 0 2024-04-26T12:06:56.620 INFO:tasks.workunit.client.0.smithi052.stdout:3/431: read - d2/d4/dc/f7a zero size 2024-04-26T12:06:56.620 INFO:tasks.workunit.client.0.smithi052.stdout:9/492: chown d3/f99 352 1 2024-04-26T12:06:56.620 INFO:tasks.workunit.client.0.smithi052.stdout:5/468: chown db/dd/d34/d69/f89 6088175 1 2024-04-26T12:06:56.620 INFO:tasks.workunit.client.0.smithi052.stdout:0/490: dwrite d0/d1/d1a/d20/f3a [0,4194304] 0 2024-04-26T12:06:56.620 INFO:tasks.workunit.client.0.smithi052.stdout:3/432: chown d2/d4/dc/d1d/f60 5758 1 2024-04-26T12:06:56.620 INFO:tasks.workunit.client.0.smithi052.stdout:9/493: truncate d3/db/d13/f79 1039306 0 2024-04-26T12:06:56.620 INFO:tasks.workunit.client.0.smithi052.stdout:0/491: mknod d0/d1/dd/c9b 0 2024-04-26T12:06:56.621 INFO:tasks.workunit.client.0.smithi052.stdout:3/433: mkdir d2/d4/d81 0 2024-04-26T12:06:56.621 INFO:tasks.workunit.client.0.smithi052.stdout:0/492: stat d0/d5a/f88 0 2024-04-26T12:06:56.621 INFO:tasks.workunit.client.0.smithi052.stdout:5/469: rename db/dd/c1c to db/dc/d5f/d50/d91/c9e 0 2024-04-26T12:06:56.622 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:56.623 INFO:tasks.workunit.client.0.smithi052.stdout:8/413: dwrite d0/f59 [0,4194304] 0 2024-04-26T12:06:56.623 INFO:tasks.workunit.client.0.smithi052.stdout:5/470: dread - db/dd/d34/f82 zero size 2024-04-26T12:06:56.625 INFO:tasks.workunit.client.0.smithi052.stdout:5/471: readlink db/dd/d34/d70/l31 0 2024-04-26T12:06:56.626 INFO:tasks.workunit.client.0.smithi052.stdout:0/493: write d0/d1/d11/f17 [828401,104510] 0 2024-04-26T12:06:56.626 INFO:tasks.workunit.client.0.smithi052.stdout:7/453: dwrite d1/f7 [0,4194304] 0 2024-04-26T12:06:56.626 INFO:tasks.workunit.client.0.smithi052.stdout:8/414: creat d0/d4/d5/db/d20/f7f x:0 0 0 2024-04-26T12:06:56.626 INFO:tasks.workunit.client.0.smithi052.stdout:7/454: fdatasync d1/d1c/d21/f2e 0 2024-04-26T12:06:56.626 INFO:tasks.workunit.client.0.smithi052.stdout:1/450: sync 2024-04-26T12:06:56.626 INFO:tasks.workunit.client.0.smithi052.stdout:9/494: sync 2024-04-26T12:06:56.626 INFO:tasks.workunit.client.0.smithi052.stdout:8/415: fdatasync d0/d4/d5/d3c/f5d 0 2024-04-26T12:06:56.627 INFO:tasks.workunit.client.0.smithi052.stdout:5/472: symlink db/dd/d34/d69/l9f 0 2024-04-26T12:06:56.627 INFO:tasks.workunit.client.0.smithi052.stdout:7/455: stat d1/f18 0 2024-04-26T12:06:56.629 INFO:tasks.workunit.client.0.smithi052.stdout:7/456: symlink d1/d1c/d23/d81/d88/l94 0 2024-04-26T12:06:56.629 INFO:tasks.workunit.client.0.smithi052.stdout:5/473: mkdir db/dd/d18/d60/d64/d9c/da0 0 2024-04-26T12:06:56.629 INFO:tasks.workunit.client.0.smithi052.stdout:9/495: rename d3/db/d10/d54/l7e to d3/db/d10/la8 0 2024-04-26T12:06:56.630 INFO:tasks.workunit.client.0.smithi052.stdout:1/451: write d0/d2/dd/d1c/d1d/f50 [176603,33542] 0 2024-04-26T12:06:56.631 INFO:tasks.workunit.client.0.smithi052.stdout:5/474: chown db/dd/d18/d60/f83 48235217 1 2024-04-26T12:06:56.631 INFO:tasks.workunit.client.0.smithi052.stdout:7/457: write d1/d1c/d21/d2f/f48 [3434692,41491] 0 2024-04-26T12:06:56.632 INFO:tasks.workunit.client.0.smithi052.stdout:2/511: read d0/d7/d2f/d3d/f92 [110316,83888] 0 2024-04-26T12:06:56.632 INFO:tasks.workunit.client.0.smithi052.stdout:5/475: stat db/dd/d18/f6c 0 2024-04-26T12:06:56.633 INFO:tasks.workunit.client.0.smithi052.stdout:7/458: chown d1/d1f/d55/c87 452490 1 2024-04-26T12:06:56.634 INFO:tasks.workunit.client.0.smithi052.stdout:8/416: dwrite d0/d4/dc/d45/d58/f5b [0,4194304] 0 2024-04-26T12:06:56.634 INFO:tasks.workunit.client.0.smithi052.stdout:7/459: write d1/d1f/f26 [5076890,6915] 0 2024-04-26T12:06:56.635 INFO:tasks.workunit.client.0.smithi052.stdout:5/476: mknod db/dd/d34/d69/ca1 0 2024-04-26T12:06:56.639 INFO:tasks.workunit.client.0.smithi052.stdout:9/496: dread d3/db/d10/d2e/d5c/f8d [4194304,4194304] 0 2024-04-26T12:06:56.639 INFO:tasks.workunit.client.0.smithi052.stdout:7/460: readlink d1/d45/d4c/l5e 0 2024-04-26T12:06:56.639 INFO:tasks.workunit.client.0.smithi052.stdout:5/477: creat db/dc/d5f/fa2 x:0 0 0 2024-04-26T12:06:56.640 INFO:tasks.workunit.client.0.smithi052.stdout:2/512: dwrite d0/f12 [0,4194304] 0 2024-04-26T12:06:56.641 INFO:tasks.workunit.client.0.smithi052.stdout:9/497: dread - d3/db/d10/d54/f93 zero size 2024-04-26T12:06:56.642 INFO:tasks.workunit.client.0.smithi052.stdout:5/478: write db/dd/d18/f6f [5009725,122419] 0 2024-04-26T12:06:56.642 INFO:tasks.workunit.client.0.smithi052.stdout:1/452: dwrite d0/d2/dd/f32 [0,4194304] 0 2024-04-26T12:06:56.644 INFO:tasks.workunit.client.0.smithi052.stdout:5/479: write db/f38 [2382377,25744] 0 2024-04-26T12:06:56.644 INFO:tasks.workunit.client.0.smithi052.stdout:2/513: read d0/d7/d16/d4d/f94 [70770,49645] 0 2024-04-26T12:06:56.645 INFO:tasks.workunit.client.0.smithi052.stdout:7/461: dread d1/d1c/d21/d2f/f80 [0,4194304] 0 2024-04-26T12:06:56.647 INFO:tasks.workunit.client.0.smithi052.stdout:8/417: dwrite d0/d16/f1a [4194304,4194304] 0 2024-04-26T12:06:56.647 INFO:tasks.workunit.client.0.smithi052.stdout:5/480: write db/dd/d18/d60/f83 [80325,5273] 0 2024-04-26T12:06:56.650 INFO:tasks.workunit.client.0.smithi052.stdout:7/462: creat d1/d1c/d21/d2f/d33/f95 x:0 0 0 2024-04-26T12:06:56.650 INFO:tasks.workunit.client.0.smithi052.stdout:8/418: mkdir d0/d4/dc/d80 0 2024-04-26T12:06:56.650 INFO:tasks.workunit.client.0.smithi052.stdout:5/481: creat db/dc/d5f/d50/d46/d74/fa3 x:0 0 0 2024-04-26T12:06:56.650 INFO:tasks.workunit.client.0.smithi052.stdout:7/463: mknod d1/d1f/d55/c96 0 2024-04-26T12:06:56.650 INFO:tasks.workunit.client.0.smithi052.stdout:7/464: stat d1/l5 0 2024-04-26T12:06:56.651 INFO:tasks.workunit.client.0.smithi052.stdout:9/498: truncate d3/d82/d8f/d49/f8a 3314044 0 2024-04-26T12:06:56.651 INFO:tasks.workunit.client.0.smithi052.stdout:7/465: stat d1/c1a 0 2024-04-26T12:06:56.652 INFO:tasks.workunit.client.0.smithi052.stdout:2/514: dwrite d0/d3f/f80 [0,4194304] 0 2024-04-26T12:06:56.654 INFO:tasks.workunit.client.0.smithi052.stdout:9/499: mknod d3/db/d10/d3c/d40/ca9 0 2024-04-26T12:06:56.654 INFO:tasks.workunit.client.0.smithi052.stdout:1/453: dwrite d0/d2/dd/d1c/d1d/d23/f2b [4194304,4194304] 0 2024-04-26T12:06:56.655 INFO:tasks.workunit.client.0.smithi052.stdout:7/466: truncate d1/d45/d4c/f89 73643 0 2024-04-26T12:06:56.655 INFO:tasks.workunit.client.0.smithi052.stdout:2/515: write d0/d7/f31 [3832834,129650] 0 2024-04-26T12:06:56.656 INFO:tasks.workunit.client.0.smithi052.stdout:4/431: dread d3/d12/d34/d45/f61 [0,4194304] 0 2024-04-26T12:06:56.657 INFO:tasks.workunit.client.0.smithi052.stdout:5/482: dwrite db/dc/d5f/d50/d46/d74/fa3 [0,4194304] 0 2024-04-26T12:06:56.657 INFO:tasks.workunit.client.0.smithi052.stdout:3/434: dread d2/d4/dc/d1d/d25/d36/d1c/f20 [0,4194304] 0 2024-04-26T12:06:56.658 INFO:tasks.workunit.client.0.smithi052.stdout:1/454: creat d0/d2/dd/d40/d81/d52/f98 x:0 0 0 2024-04-26T12:06:56.658 INFO:tasks.workunit.client.0.smithi052.stdout:2/516: unlink d0/d3f/d56/f74 0 2024-04-26T12:06:56.659 INFO:tasks.workunit.client.0.smithi052.stdout:0/494: sync 2024-04-26T12:06:56.660 INFO:tasks.workunit.client.0.smithi052.stdout:1/455: mknod d0/c99 0 2024-04-26T12:06:56.660 INFO:tasks.workunit.client.0.smithi052.stdout:5/483: symlink db/dd/d18/d60/d64/d9c/da0/la4 0 2024-04-26T12:06:56.661 INFO:tasks.workunit.client.0.smithi052.stdout:4/432: creat d3/d12/d34/d45/d67/d6c/d86/f93 x:0 0 0 2024-04-26T12:06:56.661 INFO:tasks.workunit.client.0.smithi052.stdout:0/495: fdatasync d0/d1/f41 0 2024-04-26T12:06:56.663 INFO:tasks.workunit.client.0.smithi052.stdout:1/456: mkdir d0/d2/dd/d40/d81/d9a 0 2024-04-26T12:06:56.663 INFO:tasks.workunit.client.0.smithi052.stdout:2/517: truncate d0/d7/f39 415273 0 2024-04-26T12:06:56.663 INFO:tasks.workunit.client.0.smithi052.stdout:3/435: fsync d2/d4/dc/d1d/d25/d36/d1c/f20 0 2024-04-26T12:06:56.663 INFO:tasks.workunit.client.0.smithi052.stdout:6/465: dread da/d22/d29/d31/f3a [0,4194304] 0 2024-04-26T12:06:56.663 INFO:tasks.workunit.client.0.smithi052.stdout:4/433: mknod d3/d12/d34/d91/c94 0 2024-04-26T12:06:56.664 INFO:tasks.workunit.client.0.smithi052.stdout:0/496: mknod d0/d1/dd/d72/d97/c9c 0 2024-04-26T12:06:56.664 INFO:tasks.workunit.client.0.smithi052.stdout:7/467: dwrite d1/d45/d4c/f4f [0,4194304] 0 2024-04-26T12:06:56.665 INFO:tasks.workunit.client.0.smithi052.stdout:5/484: link db/dd/d18/d60/d64/d9c/da0/la4 db/dd/la5 0 2024-04-26T12:06:56.666 INFO:tasks.workunit.client.0.smithi052.stdout:4/434: creat d3/d2e/f95 x:0 0 0 2024-04-26T12:06:56.667 INFO:tasks.workunit.client.0.smithi052.stdout:2/518: rename d0/d3f/d56/l81 to d0/d7/d22/lab 0 2024-04-26T12:06:56.667 INFO:tasks.workunit.client.0.smithi052.stdout:3/436: write d2/d4/d6b/f76 [169332,122338] 0 2024-04-26T12:06:56.667 INFO:tasks.workunit.client.0.smithi052.stdout:7/468: mknod d1/c97 0 2024-04-26T12:06:56.667 INFO:tasks.workunit.client.0.smithi052.stdout:4/435: sync 2024-04-26T12:06:56.667 INFO:tasks.workunit.client.0.smithi052.stdout:0/497: rmdir d0/d1/d2c/d42 39 2024-04-26T12:06:56.667 INFO:tasks.workunit.client.0.smithi052.stdout:6/466: creat da/d22/d3c/d74/d99/d7c/d94/fa7 x:0 0 0 2024-04-26T12:06:56.667 INFO:tasks.workunit.client.0.smithi052.stdout:5/485: rmdir db/dd/d34/d70/d78 39 2024-04-26T12:06:56.667 INFO:tasks.workunit.client.0.smithi052.stdout:4/436: dread - d3/d1f/f89 zero size 2024-04-26T12:06:56.669 INFO:tasks.workunit.client.0.smithi052.stdout:1/457: write d0/d2/f24 [1582938,78542] 0 2024-04-26T12:06:56.669 INFO:tasks.workunit.client.0.smithi052.stdout:2/519: chown d0/d7/d16/d3a/c67 1 1 2024-04-26T12:06:56.669 INFO:tasks.workunit.client.0.smithi052.stdout:4/437: mkdir d3/d12/d59/d96 0 2024-04-26T12:06:56.669 INFO:tasks.workunit.client.0.smithi052.stdout:6/467: rename da/d22/d29/l46 to da/da2/la8 0 2024-04-26T12:06:56.669 INFO:tasks.workunit.client.0.smithi052.stdout:4/438: sync 2024-04-26T12:06:56.670 INFO:tasks.workunit.client.0.smithi052.stdout:0/498: rename d0/d1/d1a/d2a to d0/d5b/d9d 0 2024-04-26T12:06:56.670 INFO:tasks.workunit.client.0.smithi052.stdout:5/486: truncate db/dc/d5f/d50/f48 1674786 0 2024-04-26T12:06:56.671 INFO:tasks.workunit.client.0.smithi052.stdout:7/469: truncate d1/d1c/d21/d2f/f80 974093 0 2024-04-26T12:06:56.671 INFO:tasks.workunit.client.0.smithi052.stdout:7/470: sync 2024-04-26T12:06:56.672 INFO:tasks.workunit.client.0.smithi052.stdout:4/439: creat d3/d22/d30/d71/f97 x:0 0 0 2024-04-26T12:06:56.673 INFO:tasks.workunit.client.0.smithi052.stdout:0/499: rename d0/d26/f7e to d0/d26/d36/f9e 0 2024-04-26T12:06:56.673 INFO:tasks.workunit.client.0.smithi052.stdout:2/520: mknod d0/d3f/d56/d6d/d5a/cac 0 2024-04-26T12:06:56.673 INFO:tasks.workunit.client.0.smithi052.stdout:7/471: dread - d1/d1f/f8c zero size 2024-04-26T12:06:56.674 INFO:tasks.workunit.client.0.smithi052.stdout:5/487: creat db/dd/d34/d69/fa6 x:0 0 0 2024-04-26T12:06:56.674 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:56.673+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:56.675 INFO:tasks.workunit.client.0.smithi052.stdout:3/437: dwrite d2/d4/dc/d1d/d25/d61/f63 [0,4194304] 0 2024-04-26T12:06:56.676 INFO:tasks.workunit.client.0.smithi052.stdout:1/458: truncate d0/f64 3267156 0 2024-04-26T12:06:56.677 INFO:tasks.workunit.client.0.smithi052.stdout:2/521: creat d0/d3f/d56/d6d/d5a/fad x:0 0 0 2024-04-26T12:06:56.677 INFO:tasks.workunit.client.0.smithi052.stdout:7/472: symlink d1/d1c/d21/d2f/d33/d92/l98 0 2024-04-26T12:06:56.678 INFO:tasks.workunit.client.0.smithi052.stdout:4/440: link d3/d12/f19 d3/d12/d34/f98 0 2024-04-26T12:06:56.678 INFO:tasks.workunit.client.0.smithi052.stdout:5/488: fsync db/dd/d34/d69/d93/f5d 0 2024-04-26T12:06:56.679 INFO:tasks.workunit.client.0.smithi052.stdout:6/468: dwrite da/d5d/f9b [0,4194304] 0 2024-04-26T12:06:56.681 INFO:tasks.workunit.client.0.smithi052.stdout:6/469: rmdir da 39 2024-04-26T12:06:56.681 INFO:tasks.workunit.client.0.smithi052.stdout:1/459: fdatasync d0/d2/dd/d40/d81/d52/f72 0 2024-04-26T12:06:56.681 INFO:tasks.workunit.client.0.smithi052.stdout:7/473: dread - d1/d1c/d23/f85 zero size 2024-04-26T12:06:56.682 INFO:tasks.workunit.client.0.smithi052.stdout:5/489: write db/dd/d18/d60/f83 [156132,17945] 0 2024-04-26T12:06:56.682 INFO:tasks.workunit.client.0.smithi052.stdout:3/438: dread d2/d4/d31/f54 [0,4194304] 0 2024-04-26T12:06:56.682 INFO:tasks.workunit.client.0.smithi052.stdout:4/441: write d3/d2e/f6e [288928,24559] 0 2024-04-26T12:06:56.683 INFO:tasks.workunit.client.0.smithi052.stdout:0/500: dwrite d0/d1/d11/f61 [0,4194304] 0 2024-04-26T12:06:56.683 INFO:tasks.workunit.client.0.smithi052.stdout:1/460: rmdir d0/d2/dd/d40 39 2024-04-26T12:06:56.684 INFO:tasks.workunit.client.0.smithi052.stdout:6/470: read da/d22/d29/f4c [1635471,116826] 0 2024-04-26T12:06:56.686 INFO:tasks.workunit.client.0.smithi052.stdout:5/490: creat db/dd/d18/d60/d7d/d87/fa7 x:0 0 0 2024-04-26T12:06:56.687 INFO:tasks.workunit.client.0.smithi052.stdout:3/439: getdents d2/d4/d41/d59 0 2024-04-26T12:06:56.687 INFO:tasks.workunit.client.0.smithi052.stdout:6/471: write da/d22/d29/d31/f4f [115293,9514] 0 2024-04-26T12:06:56.688 INFO:tasks.workunit.client.0.smithi052.stdout:2/522: dwrite d0/fa [0,4194304] 0 2024-04-26T12:06:56.688 INFO:tasks.workunit.client.0.smithi052.stdout:1/461: truncate d0/d2/dd/d1c/d1d/d91/f69 718862 0 2024-04-26T12:06:56.689 INFO:tasks.workunit.client.0.smithi052.stdout:5/491: creat db/dc/d5f/d50/d91/fa8 x:0 0 0 2024-04-26T12:06:56.689 INFO:tasks.workunit.client.0.smithi052.stdout:5/492: sync 2024-04-26T12:06:56.690 INFO:tasks.workunit.client.0.smithi052.stdout:3/440: creat d2/d4/dc/d1d/d25/d61/f82 x:0 0 0 2024-04-26T12:06:56.690 INFO:tasks.workunit.client.0.smithi052.stdout:1/462: unlink d0/d2/dd/d1c/d1d/d23/f2b 0 2024-04-26T12:06:56.692 INFO:tasks.workunit.client.0.smithi052.stdout:3/441: readlink d2/d4/dc/d33/l53 0 2024-04-26T12:06:56.692 INFO:tasks.workunit.client.0.smithi052.stdout:7/474: dwrite d1/d1c/d21/d2f/d33/d3a/f40 [0,4194304] 0 2024-04-26T12:06:56.692 INFO:tasks.workunit.client.0.smithi052.stdout:2/523: truncate d0/d7/d16/d4d/f94 271846 0 2024-04-26T12:06:56.693 INFO:tasks.workunit.client.0.smithi052.stdout:5/493: write db/f38 [3461801,81137] 0 2024-04-26T12:06:56.693 INFO:tasks.workunit.client.0.smithi052.stdout:1/463: write d0/f20 [4240559,55192] 0 2024-04-26T12:06:56.693 INFO:tasks.workunit.client.0.smithi052.stdout:8/419: dread d0/d4/d5/db/d20/f24 [0,4194304] 0 2024-04-26T12:06:56.693 INFO:tasks.workunit.client.0.smithi052.stdout:8/420: sync 2024-04-26T12:06:56.694 INFO:tasks.workunit.client.0.smithi052.stdout:7/475: write d1/d1f/f60 [694416,116137] 0 2024-04-26T12:06:56.694 INFO:tasks.workunit.client.0.smithi052.stdout:5/494: dread - db/dd/d34/d69/f76 zero size 2024-04-26T12:06:56.696 INFO:tasks.workunit.client.0.smithi052.stdout:8/421: creat d0/d4/d5/d27/f81 x:0 0 0 2024-04-26T12:06:56.696 INFO:tasks.workunit.client.0.smithi052.stdout:5/495: fsync db/dc/d5f/fa2 0 2024-04-26T12:06:56.697 INFO:tasks.workunit.client.0.smithi052.stdout:6/472: truncate da/d22/d29/f55 2922123 0 2024-04-26T12:06:56.697 INFO:tasks.workunit.client.0.smithi052.stdout:1/464: rename d0/d2/dd/d34/d3e to d0/d2/dd/d1c/d3c/d9b 0 2024-04-26T12:06:56.698 INFO:tasks.workunit.client.0.smithi052.stdout:6/473: symlink da/d22/d3c/la9 0 2024-04-26T12:06:56.698 INFO:tasks.workunit.client.0.smithi052.stdout:9/500: dread d3/db/d2b/f2f [0,4194304] 0 2024-04-26T12:06:56.700 INFO:tasks.workunit.client.0.smithi052.stdout:8/422: truncate d0/d4/dc/f72 725687 0 2024-04-26T12:06:56.700 INFO:tasks.workunit.client.0.smithi052.stdout:1/465: dread - d0/d83/d4b/d56/f6d zero size 2024-04-26T12:06:56.700 INFO:tasks.workunit.client.0.smithi052.stdout:4/442: dread d3/d12/d59/f82 [0,4194304] 0 2024-04-26T12:06:56.701 INFO:tasks.workunit.client.0.smithi052.stdout:4/443: fdatasync d3/fd 0 2024-04-26T12:06:56.701 INFO:tasks.workunit.client.0.smithi052.stdout:3/442: truncate d2/d4/dc/d1d/d25/d36/d1c/f4a 2230467 0 2024-04-26T12:06:56.702 INFO:tasks.workunit.client.0.smithi052.stdout:6/474: symlink da/d22/d3c/d74/d99/d92/d96/laa 0 2024-04-26T12:06:56.702 INFO:tasks.workunit.client.0.smithi052.stdout:9/501: truncate d3/d23/f98 749050 0 2024-04-26T12:06:56.702 INFO:tasks.workunit.client.0.smithi052.stdout:4/444: creat d3/d15/f99 x:0 0 0 2024-04-26T12:06:56.703 INFO:tasks.workunit.client.0.smithi052.stdout:6/475: readlink da/d22/d29/d31/d39/l44 0 2024-04-26T12:06:56.705 INFO:tasks.workunit.client.0.smithi052.stdout:4/445: write d3/d12/f18 [7509014,106349] 0 2024-04-26T12:06:56.705 INFO:tasks.workunit.client.0.smithi052.stdout:7/476: dwrite d1/d1c/d21/d2f/f4e [0,4194304] 0 2024-04-26T12:06:56.705 INFO:tasks.workunit.client.0.smithi052.stdout:1/466: rename d0/d2/dd/d1c/d3c/d9b/l43 to d0/d2/dd/d34/d95/l9c 0 2024-04-26T12:06:56.706 INFO:tasks.workunit.client.0.smithi052.stdout:5/496: dread db/dc/d5f/d50/d46/d74/fa3 [0,4194304] 0 2024-04-26T12:06:56.707 INFO:tasks.workunit.client.0.smithi052.stdout:5/497: chown db/dc 17 1 2024-04-26T12:06:56.707 INFO:tasks.workunit.client.0.smithi052.stdout:7/477: write d1/d1f/d55/f82 [819168,94472] 0 2024-04-26T12:06:56.708 INFO:tasks.workunit.client.0.smithi052.stdout:1/467: creat d0/d83/d4b/d56/f9d x:0 0 0 2024-04-26T12:06:56.708 INFO:tasks.workunit.client.0.smithi052.stdout:6/476: creat da/d22/d3c/d74/d99/d92/fab x:0 0 0 2024-04-26T12:06:56.709 INFO:tasks.workunit.client.0.smithi052.stdout:5/498: readlink db/dd/d34/d69/l9f 0 2024-04-26T12:06:56.709 INFO:tasks.workunit.client.0.smithi052.stdout:6/477: readlink da/d22/d3c/l57 0 2024-04-26T12:06:56.710 INFO:tasks.workunit.client.0.smithi052.stdout:6/478: chown da/l42 251 1 2024-04-26T12:06:56.710 INFO:tasks.workunit.client.0.smithi052.stdout:7/478: rename d1/d1c/d23/f6f to d1/d1c/d23/d81/f99 0 2024-04-26T12:06:56.710 INFO:tasks.workunit.client.0.smithi052.stdout:6/479: sync 2024-04-26T12:06:56.710 INFO:tasks.workunit.client.0.smithi052.stdout:2/524: dread d0/f1d [0,4194304] 0 2024-04-26T12:06:56.711 INFO:tasks.workunit.client.0.smithi052.stdout:2/525: stat d0/d7/d2f 0 2024-04-26T12:06:56.711 INFO:tasks.workunit.client.0.smithi052.stdout:7/479: chown d1/f35 64002 1 2024-04-26T12:06:56.711 INFO:tasks.workunit.client.0.smithi052.stdout:1/468: rename d0/d2/dd/d40/f77 to d0/d2/d88/f9e 0 2024-04-26T12:06:56.711 INFO:tasks.workunit.client.0.smithi052.stdout:9/502: read d3/db/d10/d54/f56 [4552537,15975] 0 2024-04-26T12:06:56.712 INFO:tasks.workunit.client.0.smithi052.stdout:6/480: mkdir da/d22/d3c/d74/d99/d95/dac 0 2024-04-26T12:06:56.713 INFO:tasks.workunit.client.0.smithi052.stdout:2/526: creat d0/d3f/d56/d8d/fae x:0 0 0 2024-04-26T12:06:56.713 INFO:tasks.workunit.client.0.smithi052.stdout:1/469: unlink d0/d2/dd/d1c/d1d/d23/c7f 0 2024-04-26T12:06:56.714 INFO:tasks.workunit.client.0.smithi052.stdout:4/446: dwrite d3/d12/f1a [4194304,4194304] 0 2024-04-26T12:06:56.714 INFO:tasks.workunit.client.0.smithi052.stdout:9/503: fdatasync d3/db/d10/d3c/d40/f42 0 2024-04-26T12:06:56.714 INFO:tasks.workunit.client.0.smithi052.stdout:7/480: write d1/d45/d4c/f89 [261733,13136] 0 2024-04-26T12:06:56.714 INFO:tasks.workunit.client.0.smithi052.stdout:0/501: dread d0/d1/dd/f19 [0,4194304] 0 2024-04-26T12:06:56.715 INFO:tasks.workunit.client.0.smithi052.stdout:7/481: stat d1/f35 0 2024-04-26T12:06:56.716 INFO:tasks.workunit.client.0.smithi052.stdout:1/470: chown d0/d2/dd/d40/l92 3352 1 2024-04-26T12:06:56.717 INFO:tasks.workunit.client.0.smithi052.stdout:7/482: stat d1/d1c/d23/f50 0 2024-04-26T12:06:56.717 INFO:tasks.workunit.client.0.smithi052.stdout:9/504: mkdir d3/db/d10/daa 0 2024-04-26T12:06:56.717 INFO:tasks.workunit.client.0.smithi052.stdout:4/447: rename d3/d1f/f89 to d3/d12/f9a 0 2024-04-26T12:06:56.718 INFO:tasks.workunit.client.0.smithi052.stdout:0/502: symlink d0/d1/dd/d72/l9f 0 2024-04-26T12:06:56.719 INFO:tasks.workunit.client.0.smithi052.stdout:7/483: creat d1/d1c/f9a x:0 0 0 2024-04-26T12:06:56.720 INFO:tasks.workunit.client.0.smithi052.stdout:2/527: link d0/d7/c35 d0/d3f/d56/d6d/d5a/d73/d4b/d8f/caf 0 2024-04-26T12:06:56.721 INFO:tasks.workunit.client.0.smithi052.stdout:9/505: getdents d3/db/d10/d3c/d40/d96/da7 0 2024-04-26T12:06:56.722 INFO:tasks.workunit.client.0.smithi052.stdout:7/484: chown d1/d1c/d21/d2f/f7d 121058331 1 2024-04-26T12:06:56.722 INFO:tasks.workunit.client.0.smithi052.stdout:2/528: write d0/d3f/d56/d6d/d5a/f69 [4104635,102339] 0 2024-04-26T12:06:56.723 INFO:tasks.workunit.client.0.smithi052.stdout:6/481: dwrite da/d22/d29/d31/f7f [0,4194304] 0 2024-04-26T12:06:56.724 INFO:tasks.workunit.client.0.smithi052.stdout:8/423: dread d0/f64 [0,4194304] 0 2024-04-26T12:06:56.724 INFO:tasks.workunit.client.0.smithi052.stdout:9/506: truncate d3/d3b/f3e 5008584 0 2024-04-26T12:06:56.726 INFO:tasks.workunit.client.0.smithi052.stdout:6/482: creat da/d5d/d64/fad x:0 0 0 2024-04-26T12:06:56.726 INFO:tasks.workunit.client.0.smithi052.stdout:8/424: dread - d0/d4/dc/d68/f6e zero size 2024-04-26T12:06:56.726 INFO:tasks.workunit.client.0.smithi052.stdout:4/448: rmdir d3/d12/d34/d45/d67/d6c/d86 39 2024-04-26T12:06:56.728 INFO:tasks.workunit.client.0.smithi052.stdout:7/485: creat d1/d1c/d21/d2f/f9b x:0 0 0 2024-04-26T12:06:56.728 INFO:tasks.workunit.client.0.smithi052.stdout:6/483: dread - da/d22/d3c/f85 zero size 2024-04-26T12:06:56.729 INFO:tasks.workunit.client.0.smithi052.stdout:4/449: mkdir d3/d12/d34/d9b 0 2024-04-26T12:06:56.729 INFO:tasks.workunit.client.0.smithi052.stdout:9/507: link d3/c3d d3/d82/d8f/cab 0 2024-04-26T12:06:56.730 INFO:tasks.workunit.client.0.smithi052.stdout:8/425: chown d0/d4/d5/db/f5e 63 1 2024-04-26T12:06:56.730 INFO:tasks.workunit.client.0.smithi052.stdout:6/484: chown da/d5d/f90 34 1 2024-04-26T12:06:56.731 INFO:tasks.workunit.client.0.smithi052.stdout:0/503: dwrite d0/d1/d11/f61 [0,4194304] 0 2024-04-26T12:06:56.731 INFO:tasks.workunit.client.0.smithi052.stdout:4/450: read d3/d15/f83 [292320,38150] 0 2024-04-26T12:06:56.731 INFO:tasks.workunit.client.0.smithi052.stdout:9/508: readlink d3/db/d10/d2e/d5c/l86 0 2024-04-26T12:06:56.732 INFO:tasks.workunit.client.0.smithi052.stdout:2/529: dwrite d0/d7/f31 [4194304,4194304] 0 2024-04-26T12:06:56.733 INFO:tasks.workunit.client.0.smithi052.stdout:4/451: dread - d3/d2e/f95 zero size 2024-04-26T12:06:56.734 INFO:tasks.workunit.client.0.smithi052.stdout:0/504: chown d0/d1/d1a/f64 25361 1 2024-04-26T12:06:56.734 INFO:tasks.workunit.client.0.smithi052.stdout:6/485: symlink da/d22/d3c/d74/d99/lae 0 2024-04-26T12:06:56.735 INFO:tasks.workunit.client.0.smithi052.stdout:9/509: rmdir d3/db/d10/d2e/d5c 39 2024-04-26T12:06:56.735 INFO:tasks.workunit.client.0.smithi052.stdout:1/471: dread d0/d2/f6 [4194304,4194304] 0 2024-04-26T12:06:56.735 INFO:tasks.workunit.client.0.smithi052.stdout:7/486: dread d1/d45/d4c/d4d/f79 [0,4194304] 0 2024-04-26T12:06:56.736 INFO:tasks.workunit.client.0.smithi052.stdout:4/452: symlink d3/d22/d30/d71/d92/l9c 0 2024-04-26T12:06:56.736 INFO:tasks.workunit.client.0.smithi052.stdout:2/530: write d0/f6 [4676867,115298] 0 2024-04-26T12:06:56.737 INFO:tasks.workunit.client.0.smithi052.stdout:9/510: creat d3/d3b/fac x:0 0 0 2024-04-26T12:06:56.737 INFO:tasks.workunit.client.0.smithi052.stdout:6/486: read da/f12 [918488,127279] 0 2024-04-26T12:06:56.737 INFO:tasks.workunit.client.0.smithi052.stdout:1/472: read - d0/d2/dd/d40/d81/f46 zero size 2024-04-26T12:06:56.737 INFO:tasks.workunit.client.0.smithi052.stdout:0/505: creat d0/d1/d1a/d20/fa0 x:0 0 0 2024-04-26T12:06:56.738 INFO:tasks.workunit.client.0.smithi052.stdout:2/531: creat d0/fb0 x:0 0 0 2024-04-26T12:06:56.739 INFO:tasks.workunit.client.0.smithi052.stdout:5/499: dread f1 [0,4194304] 0 2024-04-26T12:06:56.739 INFO:tasks.workunit.client.0.smithi052.stdout:6/487: write da/d5d/d64/fad [69810,61261] 0 2024-04-26T12:06:56.740 INFO:tasks.workunit.client.0.smithi052.stdout:2/532: dread - d0/d7/d22/f9f zero size 2024-04-26T12:06:56.740 INFO:tasks.workunit.client.0.smithi052.stdout:4/453: unlink d3/d12/d34/f98 0 2024-04-26T12:06:56.740 INFO:tasks.workunit.client.0.smithi052.stdout:3/443: dread d2/d4/dc/d1d/d25/f2b [0,4194304] 0 2024-04-26T12:06:56.741 INFO:tasks.workunit.client.0.smithi052.stdout:9/511: creat d3/d23/d7f/fad x:0 0 0 2024-04-26T12:06:56.742 INFO:tasks.workunit.client.0.smithi052.stdout:0/506: getdents d0/d5b/d9d 0 2024-04-26T12:06:56.742 INFO:tasks.workunit.client.0.smithi052.stdout:7/487: rename d1/d1c/d23/d81/d88/l94 to d1/d1c/d23/d81/d88/l9c 0 2024-04-26T12:06:56.743 INFO:tasks.workunit.client.0.smithi052.stdout:4/454: write d3/d22/d30/d71/f78 [743094,83486] 0 2024-04-26T12:06:56.743 INFO:tasks.workunit.client.0.smithi052.stdout:6/488: mknod da/d22/d3c/d74/d99/d95/caf 0 2024-04-26T12:06:56.743 INFO:tasks.workunit.client.0.smithi052.stdout:2/533: read d0/d7/f10 [3730138,94924] 0 2024-04-26T12:06:56.744 INFO:tasks.workunit.client.0.smithi052.stdout:3/444: write d2/d4/dc/d1d/d25/d61/f63 [4668805,120563] 0 2024-04-26T12:06:56.744 INFO:tasks.workunit.client.0.smithi052.stdout:0/507: symlink d0/d1/d54/la1 0 2024-04-26T12:06:56.744 INFO:tasks.workunit.client.0.smithi052.stdout:7/488: write d1/d45/d4c/d4d/f79 [1326175,88052] 0 2024-04-26T12:06:56.745 INFO:tasks.workunit.client.0.smithi052.stdout:6/489: dread - da/d63/f72 zero size 2024-04-26T12:06:56.745 INFO:tasks.workunit.client.0.smithi052.stdout:4/455: write d3/f1c [4800518,745] 0 2024-04-26T12:06:56.746 INFO:tasks.workunit.client.0.smithi052.stdout:2/534: mknod d0/d7/d2f/d4c/cb1 0 2024-04-26T12:06:56.747 INFO:tasks.workunit.client.0.smithi052.stdout:2/535: stat d0 0 2024-04-26T12:06:56.747 INFO:tasks.workunit.client.0.smithi052.stdout:0/508: creat d0/d1/dd/fa2 x:0 0 0 2024-04-26T12:06:56.747 INFO:tasks.workunit.client.0.smithi052.stdout:6/490: mknod da/d5d/d9c/cb0 0 2024-04-26T12:06:56.747 INFO:tasks.workunit.client.0.smithi052.stdout:3/445: fdatasync d2/d4/dc/d1d/d25/d36/d1c/f20 0 2024-04-26T12:06:56.749 INFO:tasks.workunit.client.0.smithi052.stdout:9/512: dwrite d3/d23/d7f/fad [0,4194304] 0 2024-04-26T12:06:56.750 INFO:tasks.workunit.client.0.smithi052.stdout:4/456: truncate d3/d22/d30/d71/f77 257730 0 2024-04-26T12:06:56.750 INFO:tasks.workunit.client.0.smithi052.stdout:7/489: symlink d1/d1c/d23/d81/d88/l9d 0 2024-04-26T12:06:56.751 INFO:tasks.workunit.client.0.smithi052.stdout:4/457: fdatasync d3/f2f 0 2024-04-26T12:06:56.751 INFO:tasks.workunit.client.0.smithi052.stdout:6/491: write da/d5d/d64/d68/f86 [924097,13774] 0 2024-04-26T12:06:56.751 INFO:tasks.workunit.client.0.smithi052.stdout:3/446: rename d2/d4/dc/d1d/d25/d36/f50 to d2/d4/d41/d5c/f83 0 2024-04-26T12:06:56.752 INFO:tasks.workunit.client.0.smithi052.stdout:7/490: symlink d1/d45/d4c/l9e 0 2024-04-26T12:06:56.753 INFO:tasks.workunit.client.0.smithi052.stdout:3/447: chown d2/d4/dc/d68 5 1 2024-04-26T12:06:56.753 INFO:tasks.workunit.client.0.smithi052.stdout:4/458: dread - d3/d1f/d21/f66 zero size 2024-04-26T12:06:56.753 INFO:tasks.workunit.client.0.smithi052.stdout:6/492: chown da/d5d/d64/d68/f86 66504145 1 2024-04-26T12:06:56.753 INFO:tasks.workunit.client.0.smithi052.stdout:9/513: write d3/db/d10/d2e/d5c/f8d [4085478,97719] 0 2024-04-26T12:06:56.754 INFO:tasks.workunit.client.0.smithi052.stdout:3/448: chown d2/d4/d2a/d2d 7509 1 2024-04-26T12:06:56.754 INFO:tasks.workunit.client.0.smithi052.stdout:4/459: write d3/d2e/f6e [582697,113512] 0 2024-04-26T12:06:56.755 INFO:tasks.workunit.client.0.smithi052.stdout:7/491: link d1/d1f/f26 d1/f9f 0 2024-04-26T12:06:56.755 INFO:tasks.workunit.client.0.smithi052.stdout:9/514: fdatasync d3/db/d10/d3c/d40/f42 0 2024-04-26T12:06:56.755 INFO:tasks.workunit.client.0.smithi052.stdout:7/492: readlink d1/l41 0 2024-04-26T12:06:56.755 INFO:tasks.workunit.client.0.smithi052.stdout:6/493: creat da/d22/d3c/d74/d99/d7c/fb1 x:0 0 0 2024-04-26T12:06:56.756 INFO:tasks.workunit.client.0.smithi052.stdout:9/515: symlink d3/d3b/lae 0 2024-04-26T12:06:56.756 INFO:tasks.workunit.client.0.smithi052.stdout:6/494: readlink da/d22/d29/d31/d39/l44 0 2024-04-26T12:06:56.756 INFO:tasks.workunit.client.0.smithi052.stdout:6/495: readlink da/d5d/l9f 0 2024-04-26T12:06:56.757 INFO:tasks.workunit.client.0.smithi052.stdout:7/493: dread d1/d45/d4c/f89 [0,4194304] 0 2024-04-26T12:06:56.759 INFO:tasks.workunit.client.0.smithi052.stdout:7/494: rename d1/f17 to d1/d1c/d21/d2f/d68/fa0 0 2024-04-26T12:06:56.759 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:56.759 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:56.759 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:56.759 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:56.760 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.760 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:536 3.2 3:4272d415:::200.0000000b:head [write 405817~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:56.760 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:06:56.760 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.2335337480000002, 2024-04-26T12:06:56.760 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053030282999999998, 2024-04-26T12:06:56.760 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:56.760 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.760 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:56.760 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.760 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:56.760 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:06:56.760 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.760 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.761 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.761 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:56.761 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:06:56.761 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.761 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.761 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.761 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:56.761 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524136+0000", 2024-04-26T12:06:56.761 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:56.761 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.761 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.761 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:56.761 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524139+0000", 2024-04-26T12:06:56.761 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2919999999999998e-06 2024-04-26T12:06:56.762 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.762 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.762 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:56.762 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524144+0000", 2024-04-26T12:06:56.762 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.502e-06 2024-04-26T12:06:56.762 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.762 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.762 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.762 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524149+0000", 2024-04-26T12:06:56.762 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7310000000000001e-06 2024-04-26T12:06:56.762 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.762 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.762 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:56.762 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570935+0000", 2024-04-26T12:06:56.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.046785603000000002 2024-04-26T12:06:56.763 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.763 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:56.763 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570981+0000", 2024-04-26T12:06:56.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6085999999999999e-05 2024-04-26T12:06:56.763 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.763 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:56.763 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577039+0000", 2024-04-26T12:06:56.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060582099999999996 2024-04-26T12:06:56.763 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.763 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:56.764 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577081+0000", 2024-04-26T12:06:56.764 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1927e-05 2024-04-26T12:06:56.764 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.764 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.764 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:56.764 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577167+0000", 2024-04-26T12:06:56.764 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6311999999999996e-05 2024-04-26T12:06:56.764 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.764 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:56.764 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.764 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.764 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.764 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:537 3.2 3:4272d415:::200.0000000b:head [write 407216~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:56.764 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:06:56.765 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.2335178099999999, 2024-04-26T12:06:56.765 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053131411000000003, 2024-04-26T12:06:56.765 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:56.765 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.765 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:56.765 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.765 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:56.765 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:06:56.765 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.765 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.765 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.765 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:56.765 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:06:56.765 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.766 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.766 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:56.766 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524152+0000", 2024-04-26T12:06:56.766 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:56.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.766 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.766 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:56.766 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524157+0000", 2024-04-26T12:06:56.766 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3529999999999997e-06 2024-04-26T12:06:56.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.766 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.766 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:56.766 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524162+0000", 2024-04-26T12:06:56.766 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5910000000000003e-06 2024-04-26T12:06:56.767 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.767 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.767 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.767 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524170+0000", 2024-04-26T12:06:56.767 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:06:56.767 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.767 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.767 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:56.767 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571323+0000", 2024-04-26T12:06:56.767 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047153289000000001 2024-04-26T12:06:56.767 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.767 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.767 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:56.768 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571367+0000", 2024-04-26T12:06:56.768 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4205000000000001e-05 2024-04-26T12:06:56.768 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.768 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.768 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:56.768 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577174+0000", 2024-04-26T12:06:56.768 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058072250000000001 2024-04-26T12:06:56.768 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.768 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.768 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:56.768 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577218+0000", 2024-04-26T12:06:56.768 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3294999999999998e-05 2024-04-26T12:06:56.768 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.768 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.769 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:56.769 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577284+0000", 2024-04-26T12:06:56.769 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6483999999999996e-05 2024-04-26T12:06:56.769 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.769 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:56.769 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.769 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.769 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.769 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:538 3.2 3:4272d415:::200.0000000b:head [write 408629~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:56.769 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:06:56.769 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.2334971100000001, 2024-04-26T12:06:56.769 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053241841999999998, 2024-04-26T12:06:56.769 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:56.769 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.770 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:56.770 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.770 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:56.770 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:06:56.770 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.770 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.770 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:56.770 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:06:56.770 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.770 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.770 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:56.770 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:06:56.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:56.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.771 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.771 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:56.771 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524178+0000", 2024-04-26T12:06:56.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1420000000000001e-06 2024-04-26T12:06:56.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.771 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.771 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:56.771 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524184+0000", 2024-04-26T12:06:56.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4240000000000001e-06 2024-04-26T12:06:56.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.771 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.771 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524188+0000", 2024-04-26T12:06:56.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2710000000000003e-06 2024-04-26T12:06:56.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:56.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571623+0000", 2024-04-26T12:06:56.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047435119999999997 2024-04-26T12:06:56.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:56.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571668+0000", 2024-04-26T12:06:56.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5377000000000003e-05 2024-04-26T12:06:56.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.773 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.773 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:56.773 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577292+0000", 2024-04-26T12:06:56.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0056232030000000002 2024-04-26T12:06:56.773 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.773 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.773 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:56.773 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577330+0000", 2024-04-26T12:06:56.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8748999999999998e-05 2024-04-26T12:06:56.773 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.773 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.773 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:56.773 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577415+0000", 2024-04-26T12:06:56.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4913000000000005e-05 2024-04-26T12:06:56.774 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.774 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:56.774 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.774 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.774 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.774 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:539 3.2 3:4272d415:::200.0000000b:head [write 410547~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:56.774 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:06:56.774 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.2334789779999999, 2024-04-26T12:06:56.774 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053372670999999997, 2024-04-26T12:06:56.774 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:56.774 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.774 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:56.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:56.775 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:06:56.775 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.775 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:56.775 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:06:56.775 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.775 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:56.775 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524191+0000", 2024-04-26T12:06:56.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:56.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:56.776 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524199+0000", 2024-04-26T12:06:56.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6520000000000006e-06 2024-04-26T12:06:56.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:56.776 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524205+0000", 2024-04-26T12:06:56.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:06:56.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.777 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524209+0000", 2024-04-26T12:06:56.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.335e-06 2024-04-26T12:06:56.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.777 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:56.777 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572320+0000", 2024-04-26T12:06:56.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048110992999999998 2024-04-26T12:06:56.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.777 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:56.777 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572364+0000", 2024-04-26T12:06:56.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4577999999999999e-05 2024-04-26T12:06:56.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:56.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577426+0000", 2024-04-26T12:06:56.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050615139999999996 2024-04-26T12:06:56.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:56.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577480+0000", 2024-04-26T12:06:56.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3599e-05 2024-04-26T12:06:56.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:56.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577564+0000", 2024-04-26T12:06:56.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4699999999999999e-05 2024-04-26T12:06:56.779 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.779 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:56.779 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.779 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.779 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.779 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:540 3.2 3:4272d415:::200.0000000b:head [write 411948~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:56.779 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:06:56.779 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.23345796, 2024-04-26T12:06:56.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053497045999999999, 2024-04-26T12:06:56.779 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:56.779 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.779 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:56.779 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.779 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:56.780 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:06:56.780 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.780 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.780 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.780 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:56.780 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:06:56.780 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.780 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.780 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.780 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:56.780 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524212+0000", 2024-04-26T12:06:56.780 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:56.780 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.780 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.781 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:56.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524215+0000", 2024-04-26T12:06:56.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.559e-06 2024-04-26T12:06:56.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.781 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:56.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524220+0000", 2024-04-26T12:06:56.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2920000000000003e-06 2024-04-26T12:06:56.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.781 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524224+0000", 2024-04-26T12:06:56.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3680000000000004e-06 2024-04-26T12:06:56.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:56.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572619+0000", 2024-04-26T12:06:56.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048394549000000002 2024-04-26T12:06:56.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:56.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572669+0000", 2024-04-26T12:06:56.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0249e-05 2024-04-26T12:06:56.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:56.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577575+0000", 2024-04-26T12:06:56.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049053329999999996 2024-04-26T12:06:56.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.783 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.783 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:56.783 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577625+0000", 2024-04-26T12:06:56.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0274e-05 2024-04-26T12:06:56.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.783 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.783 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:56.783 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577710+0000", 2024-04-26T12:06:56.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4741999999999996e-05 2024-04-26T12:06:56.783 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.783 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:56.783 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.784 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:543 3.2 3:4272d415:::200.0000000b:head [write 413907~2485 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:56.784 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:06:56.784 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.233388266, 2024-04-26T12:06:56.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053578708000000003, 2024-04-26T12:06:56.784 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:56.784 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.784 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:56.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:56.784 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:06:56.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.785 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:56.785 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:06:56.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.785 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.785 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.785 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:56.785 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:06:56.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:56.785 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.785 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.785 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:56.785 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524287+0000", 2024-04-26T12:06:56.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2190000000000003e-06 2024-04-26T12:06:56.786 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.786 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.786 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:56.786 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524294+0000", 2024-04-26T12:06:56.786 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5660000000000003e-06 2024-04-26T12:06:56.786 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.786 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.786 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.786 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524298+0000", 2024-04-26T12:06:56.786 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3900000000000003e-06 2024-04-26T12:06:56.786 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.786 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.786 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:56.787 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572992+0000", 2024-04-26T12:06:56.787 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048693835999999997 2024-04-26T12:06:56.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.787 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.787 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:56.787 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573045+0000", 2024-04-26T12:06:56.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2793000000000001e-05 2024-04-26T12:06:56.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.790 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.790 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:56.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577721+0000", 2024-04-26T12:06:56.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046760550000000001 2024-04-26T12:06:56.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.791 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:56.791 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577777+0000", 2024-04-26T12:06:56.791 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5908000000000001e-05 2024-04-26T12:06:56.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.791 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:56.791 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577861+0000", 2024-04-26T12:06:56.791 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4337000000000002e-05 2024-04-26T12:06:56.791 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.791 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:56.791 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.792 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.792 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:544 3.2 3:4272d415:::200.0000000b:head [write 416392~3872 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:56.792 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:06:56.792 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.2333685440000002, 2024-04-26T12:06:56.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054810527999999997, 2024-04-26T12:06:56.792 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:56.792 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.792 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:56.792 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.792 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:56.792 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:06:56.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.792 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:56.793 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:06:56.793 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:56.793 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:06:56.793 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:56.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:56.793 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524307+0000", 2024-04-26T12:06:56.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1580000000000004e-06 2024-04-26T12:06:56.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:56.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524312+0000", 2024-04-26T12:06:56.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6380000000000001e-06 2024-04-26T12:06:56.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524317+0000", 2024-04-26T12:06:56.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4000000000000002e-06 2024-04-26T12:06:56.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:56.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573348+0000", 2024-04-26T12:06:56.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049031433999999999 2024-04-26T12:06:56.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:56.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573393+0000", 2024-04-26T12:06:56.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4536999999999997e-05 2024-04-26T12:06:56.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:56.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578978+0000", 2024-04-26T12:06:56.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055848299999999998 2024-04-26T12:06:56.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:56.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579031+0000", 2024-04-26T12:06:56.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3708000000000001e-05 2024-04-26T12:06:56.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:56.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579113+0000", 2024-04-26T12:06:56.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1258e-05 2024-04-26T12:06:56.796 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.796 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:56.797 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.797 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:545 3.2 3:4272d415:::200.0000000b:head [write 420264~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:56.797 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:06:56.797 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.233349918, 2024-04-26T12:06:56.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054927386000000002, 2024-04-26T12:06:56.797 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:56.797 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.797 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:56.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.797 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:56.797 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:06:56.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.798 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.798 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:56.798 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:06:56.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.798 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.798 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:56.798 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524320+0000", 2024-04-26T12:06:56.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:56.798 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:56.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524325+0000", 2024-04-26T12:06:56.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5249999999999999e-06 2024-04-26T12:06:56.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:56.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524330+0000", 2024-04-26T12:06:56.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5629999999999999e-06 2024-04-26T12:06:56.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524335+0000", 2024-04-26T12:06:56.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.685e-06 2024-04-26T12:06:56.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:56.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573727+0000", 2024-04-26T12:06:56.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049392034000000001 2024-04-26T12:06:56.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:56.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573775+0000", 2024-04-26T12:06:56.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7435999999999998e-05 2024-04-26T12:06:56.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:56.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579120+0000", 2024-04-26T12:06:56.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0053452949999999999 2024-04-26T12:06:56.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:56.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579167+0000", 2024-04-26T12:06:56.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7240000000000002e-05 2024-04-26T12:06:56.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:56.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579248+0000", 2024-04-26T12:06:56.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0947999999999998e-05 2024-04-26T12:06:56.802 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.802 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:56.802 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.802 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 422222~8537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:56.803 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:06:56.803 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.2333316010000002, 2024-04-26T12:06:56.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055065936000000003, 2024-04-26T12:06:56.803 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:56.803 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.803 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:56.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.803 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:56.804 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:06:56.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:56.804 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:06:56.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:56.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:06:56.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:56.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:56.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524347+0000", 2024-04-26T12:06:56.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7129999999999994e-06 2024-04-26T12:06:56.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:56.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524357+0000", 2024-04-26T12:06:56.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0232e-05 2024-04-26T12:06:56.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524362+0000", 2024-04-26T12:06:56.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:06:56.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:56.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574119+0000", 2024-04-26T12:06:56.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049756727000000001 2024-04-26T12:06:56.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:56.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574166+0000", 2024-04-26T12:06:56.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7086000000000003e-05 2024-04-26T12:06:56.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:56.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579261+0000", 2024-04-26T12:06:56.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050948310000000002 2024-04-26T12:06:56.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:56.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579316+0000", 2024-04-26T12:06:56.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5068000000000002e-05 2024-04-26T12:06:56.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.809 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:56.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579405+0000", 2024-04-26T12:06:56.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9251000000000003e-05 2024-04-26T12:06:56.809 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.809 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:56.810 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.810 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 430759~2035 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:56.810 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:06:56.810 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.2333046109999999, 2024-04-26T12:06:56.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055164950999999997, 2024-04-26T12:06:56.810 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:56.810 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.811 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:56.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.811 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:56.811 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:06:56.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.811 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.811 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:56.811 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:06:56.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:56.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:06:56.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:56.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:56.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524368+0000", 2024-04-26T12:06:56.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.57e-06 2024-04-26T12:06:56.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:56.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524375+0000", 2024-04-26T12:06:56.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6170000000000003e-06 2024-04-26T12:06:56.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524380+0000", 2024-04-26T12:06:56.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2700000000000004e-06 2024-04-26T12:06:56.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:56.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574639+0000", 2024-04-26T12:06:56.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050259459999999999 2024-04-26T12:06:56.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:56.815 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574687+0000", 2024-04-26T12:06:56.815 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7608999999999998e-05 2024-04-26T12:06:56.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.815 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:56.815 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579414+0000", 2024-04-26T12:06:56.815 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047268750000000002 2024-04-26T12:06:56.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.815 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:56.815 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579456+0000", 2024-04-26T12:06:56.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1885000000000003e-05 2024-04-26T12:06:56.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.816 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:56.816 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579531+0000", 2024-04-26T12:06:56.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5053000000000001e-05 2024-04-26T12:06:56.816 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.816 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:56.816 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.817 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 432794~10523 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:56.817 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:06:56.817 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.2323138870000001, 2024-04-26T12:06:56.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054314727, 2024-04-26T12:06:56.817 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:56.817 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.817 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:56.817 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:56.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:06:56.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:56.818 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:06:56.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:56.818 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525356+0000", 2024-04-26T12:06:56.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:56.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.819 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.819 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:56.819 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525414+0000", 2024-04-26T12:06:56.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8148e-05 2024-04-26T12:06:56.819 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.819 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.819 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:56.819 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525423+0000", 2024-04-26T12:06:56.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9749999999999996e-06 2024-04-26T12:06:56.819 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.819 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.819 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.819 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525428+0000", 2024-04-26T12:06:56.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0270000000000003e-06 2024-04-26T12:06:56.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.822 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:56.822 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574950+0000", 2024-04-26T12:06:56.822 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049521840999999997 2024-04-26T12:06:56.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.822 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:56.822 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575002+0000", 2024-04-26T12:06:56.822 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1586999999999999e-05 2024-04-26T12:06:56.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.822 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:56.822 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579543+0000", 2024-04-26T12:06:56.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045416340000000001 2024-04-26T12:06:56.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:56.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579587+0000", 2024-04-26T12:06:56.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3875999999999998e-05 2024-04-26T12:06:56.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:56.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579671+0000", 2024-04-26T12:06:56.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4351999999999995e-05 2024-04-26T12:06:56.823 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.823 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:56.823 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.824 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 443317~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:56.824 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:06:56.824 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.232237912, 2024-04-26T12:06:56.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054381889000000003, 2024-04-26T12:06:56.824 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:56.824 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.824 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:56.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:56.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:06:56.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:56.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:06:56.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:56.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525432+0000", 2024-04-26T12:06:56.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:56.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:56.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525435+0000", 2024-04-26T12:06:56.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3070000000000001e-06 2024-04-26T12:06:56.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:56.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525439+0000", 2024-04-26T12:06:56.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.104e-06 2024-04-26T12:06:56.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525442+0000", 2024-04-26T12:06:56.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0460000000000001e-06 2024-04-26T12:06:56.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:56.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575405+0000", 2024-04-26T12:06:56.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049963059999999997 2024-04-26T12:06:56.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:56.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575450+0000", 2024-04-26T12:06:56.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5034000000000003e-05 2024-04-26T12:06:56.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:56.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579680+0000", 2024-04-26T12:06:56.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042302260000000001 2024-04-26T12:06:56.828 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.828 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.828 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:56.828 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579737+0000", 2024-04-26T12:06:56.828 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7241000000000003e-05 2024-04-26T12:06:56.828 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.828 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.828 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:56.828 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579815+0000", 2024-04-26T12:06:56.828 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7278000000000001e-05 2024-04-26T12:06:56.828 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.828 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:56.828 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.828 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.829 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 445275~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:56.829 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:06:56.829 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.2318107359999999, 2024-04-26T12:06:56.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054094668999999998, 2024-04-26T12:06:56.829 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:56.829 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.829 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:56.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:56.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:06:56.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:56.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:06:56.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:56.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525859+0000", 2024-04-26T12:06:56.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:56.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:56.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525864+0000", 2024-04-26T12:06:56.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:06:56.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.831 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:56.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525872+0000", 2024-04-26T12:06:56.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6790000000000005e-06 2024-04-26T12:06:56.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.831 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525877+0000", 2024-04-26T12:06:56.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0529999999999997e-06 2024-04-26T12:06:56.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.831 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:56.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575723+0000", 2024-04-26T12:06:56.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049846469999999997 2024-04-26T12:06:56.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:56.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575770+0000", 2024-04-26T12:06:56.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6387999999999997e-05 2024-04-26T12:06:56.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:56.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579823+0000", 2024-04-26T12:06:56.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0040534189999999999 2024-04-26T12:06:56.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.833 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:56.833 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579869+0000", 2024-04-26T12:06:56.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6218999999999999e-05 2024-04-26T12:06:56.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.833 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:56.833 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579954+0000", 2024-04-26T12:06:56.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5315999999999994e-05 2024-04-26T12:06:56.833 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.833 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:56.833 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.834 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:551 3.2 3:4272d415:::200.0000000b:head [write 448232~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:56.834 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:06:56.834 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.2313633020000001, 2024-04-26T12:06:56.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053798273000000001, 2024-04-26T12:06:56.834 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:56.834 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.834 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:56.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.834 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:56.834 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:06:56.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.834 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:56.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:06:56.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:56.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:06:56.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:56.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:56.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526310+0000", 2024-04-26T12:06:56.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5279999999999999e-06 2024-04-26T12:06:56.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:56.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526317+0000", 2024-04-26T12:06:56.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8430000000000004e-06 2024-04-26T12:06:56.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526322+0000", 2024-04-26T12:06:56.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3340000000000001e-06 2024-04-26T12:06:56.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:56.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576135+0000", 2024-04-26T12:06:56.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049812113999999998 2024-04-26T12:06:56.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:56.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576186+0000", 2024-04-26T12:06:56.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1443999999999997e-05 2024-04-26T12:06:56.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:56.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579962+0000", 2024-04-26T12:06:56.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037763359999999999 2024-04-26T12:06:56.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.838 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:56.838 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580016+0000", 2024-04-26T12:06:56.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3421000000000002e-05 2024-04-26T12:06:56.838 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.838 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:56.838 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580106+0000", 2024-04-26T12:06:56.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9790000000000006e-05 2024-04-26T12:06:56.838 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.838 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:56.838 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.838 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.839 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 450189~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:56.839 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:06:56.839 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.231283173, 2024-04-26T12:06:56.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055070796999999998, 2024-04-26T12:06:56.839 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:56.839 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.839 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:56.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:56.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:06:56.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:56.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:06:56.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:56.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:06:56.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:56.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:56.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526390+0000", 2024-04-26T12:06:56.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8559999999999998e-06 2024-04-26T12:06:56.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:56.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526395+0000", 2024-04-26T12:06:56.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3319999999999999e-06 2024-04-26T12:06:56.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526399+0000", 2024-04-26T12:06:56.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.619e-06 2024-04-26T12:06:56.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:56.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576476+0000", 2024-04-26T12:06:56.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050077643999999998 2024-04-26T12:06:56.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:56.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576524+0000", 2024-04-26T12:06:56.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7184000000000001e-05 2024-04-26T12:06:56.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:56.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581347+0000", 2024-04-26T12:06:56.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0048231919999999996 2024-04-26T12:06:56.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:56.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581398+0000", 2024-04-26T12:06:56.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1345999999999999e-05 2024-04-26T12:06:56.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:56.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581458+0000", 2024-04-26T12:06:56.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0081000000000003e-05 2024-04-26T12:06:56.843 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.843 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:56.843 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.844 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.844 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 452113~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:56.844 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:06:56.844 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.2311719569999999, 2024-04-26T12:06:56.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055041448, 2024-04-26T12:06:56.844 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:56.844 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.844 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:56.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.844 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:56.844 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:06:56.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:56.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:06:56.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:56.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526498+0000", 2024-04-26T12:06:56.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:56.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:56.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526540+0000", 2024-04-26T12:06:56.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2267e-05 2024-04-26T12:06:56.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.846 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:56.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526547+0000", 2024-04-26T12:06:56.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7000000000000002e-06 2024-04-26T12:06:56.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.846 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526550+0000", 2024-04-26T12:06:56.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0299999999999998e-06 2024-04-26T12:06:56.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:56.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577902+0000", 2024-04-26T12:06:56.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051351648999999999 2024-04-26T12:06:56.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:56.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577953+0000", 2024-04-26T12:06:56.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1289000000000003e-05 2024-04-26T12:06:56.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:56.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581464+0000", 2024-04-26T12:06:56.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035111259999999998 2024-04-26T12:06:56.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:56.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581490+0000", 2024-04-26T12:06:56.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5717000000000001e-05 2024-04-26T12:06:56.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:56.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581540+0000", 2024-04-26T12:06:56.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0287999999999997e-05 2024-04-26T12:06:56.848 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.849 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:56.849 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.849 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 454070~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:56.849 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:06:56.849 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.230615008, 2024-04-26T12:06:56.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054564161, 2024-04-26T12:06:56.849 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:56.849 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.849 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:56.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:56.850 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:06:56.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.850 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:56.850 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:06:56.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.850 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:56.850 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527055+0000", 2024-04-26T12:06:56.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:56.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:56.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527058+0000", 2024-04-26T12:06:56.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9890000000000001e-06 2024-04-26T12:06:56.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:56.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527066+0000", 2024-04-26T12:06:56.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4730000000000003e-06 2024-04-26T12:06:56.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527069+0000", 2024-04-26T12:06:56.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5810000000000001e-06 2024-04-26T12:06:56.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:56.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578308+0000", 2024-04-26T12:06:56.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051238911999999998 2024-04-26T12:06:56.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:56.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578391+0000", 2024-04-26T12:06:56.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2713999999999994e-05 2024-04-26T12:06:56.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:56.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581548+0000", 2024-04-26T12:06:56.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031577530000000001 2024-04-26T12:06:56.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:56.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581574+0000", 2024-04-26T12:06:56.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5350999999999998e-05 2024-04-26T12:06:56.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:56.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581620+0000", 2024-04-26T12:06:56.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5868999999999997e-05 2024-04-26T12:06:56.854 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.854 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:56.854 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.854 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 456028~3870 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:56.854 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:06:56.854 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.2288587660000001, 2024-04-26T12:06:56.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055118997000000003, 2024-04-26T12:06:56.854 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:56.854 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.854 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:56.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:56.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:06:56.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:56.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:06:56.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:56.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528811+0000", 2024-04-26T12:06:56.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:56.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:56.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528887+0000", 2024-04-26T12:06:56.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5977999999999997e-05 2024-04-26T12:06:56.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:56.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528897+0000", 2024-04-26T12:06:56.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8730000000000002e-06 2024-04-26T12:06:56.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528901+0000", 2024-04-26T12:06:56.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4880000000000001e-06 2024-04-26T12:06:56.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:56.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580146+0000", 2024-04-26T12:06:56.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051244242000000002 2024-04-26T12:06:56.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:56.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580227+0000", 2024-04-26T12:06:56.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1044000000000005e-05 2024-04-26T12:06:56.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:56.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583864+0000", 2024-04-26T12:06:56.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036374419999999998 2024-04-26T12:06:56.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:56.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583894+0000", 2024-04-26T12:06:56.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9828999999999999e-05 2024-04-26T12:06:56.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:56.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583931+0000", 2024-04-26T12:06:56.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6908e-05 2024-04-26T12:06:56.859 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.859 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:56.859 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.859 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 459898~2037 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:56.859 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:06:56.859 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.2284707749999999, 2024-04-26T12:06:56.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055925713000000002, 2024-04-26T12:06:56.859 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:56.859 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.860 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:56.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:56.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:06:56.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:56.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:06:56.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:56.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529199+0000", 2024-04-26T12:06:56.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:56.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:56.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529203+0000", 2024-04-26T12:06:56.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:06:56.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:56.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529209+0000", 2024-04-26T12:06:56.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7939999999999999e-06 2024-04-26T12:06:56.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529212+0000", 2024-04-26T12:06:56.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7290000000000002e-06 2024-04-26T12:06:56.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:56.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580784+0000", 2024-04-26T12:06:56.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051572073000000003 2024-04-26T12:06:56.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:56.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580883+0000", 2024-04-26T12:06:56.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8330000000000002e-05 2024-04-26T12:06:56.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:56.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585050+0000", 2024-04-26T12:06:56.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041670209999999999 2024-04-26T12:06:56.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:56.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585088+0000", 2024-04-26T12:06:56.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8559999999999997e-05 2024-04-26T12:06:56.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:56.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585125+0000", 2024-04-26T12:06:56.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7197999999999999e-05 2024-04-26T12:06:56.864 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.864 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:56.864 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.864 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 461935~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:56.864 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:06:56.864 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.227748321, 2024-04-26T12:06:56.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055266150999999999, 2024-04-26T12:06:56.864 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:56.864 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:56.864 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:56.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:56.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:06:56.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:56.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:06:56.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:56.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:56.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529921+0000", 2024-04-26T12:06:56.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:56.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:56.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529956+0000", 2024-04-26T12:06:56.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4687000000000002e-05 2024-04-26T12:06:56.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:56.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529966+0000", 2024-04-26T12:06:56.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0392e-05 2024-04-26T12:06:56.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:56.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529978+0000", 2024-04-26T12:06:56.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1348e-05 2024-04-26T12:06:56.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:56.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581659+0000", 2024-04-26T12:06:56.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051681454000000002 2024-04-26T12:06:56.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:56.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581746+0000", 2024-04-26T12:06:56.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6305999999999997e-05 2024-04-26T12:06:56.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:56.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585131+0000", 2024-04-26T12:06:56.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033853199999999998 2024-04-26T12:06:56.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:56.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585154+0000", 2024-04-26T12:06:56.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3258999999999999e-05 2024-04-26T12:06:56.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:56.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:56.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:56.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585188+0000", 2024-04-26T12:06:56.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4236000000000002e-05 2024-04-26T12:06:56.868 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.868 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:56.869 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.869 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:56.869 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:56.869 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:56.870 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:56.870 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:56.787+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:56.872 INFO:tasks.workunit.client.0.smithi052.stdout:7/495: creat d1/d45/d4c/d4d/fa1 x:0 0 0 2024-04-26T12:06:56.872 INFO:tasks.workunit.client.0.smithi052.stdout:9/516: truncate d3/db/d10/f38 769097 0 2024-04-26T12:06:56.872 INFO:tasks.workunit.client.0.smithi052.stdout:7/496: rename d1/d1f/c3f to d1/ca2 0 2024-04-26T12:06:56.872 INFO:tasks.workunit.client.0.smithi052.stdout:5/500: dread db/dd/d34/f57 [0,4194304] 0 2024-04-26T12:06:56.872 INFO:tasks.workunit.client.0.smithi052.stdout:9/517: link d3/c36 d3/caf 0 2024-04-26T12:06:56.873 INFO:tasks.workunit.client.0.smithi052.stdout:7/497: chown d1/f35 7298333 1 2024-04-26T12:06:56.873 INFO:tasks.workunit.client.0.smithi052.stdout:7/498: chown d1/d1c/d23/f2c 3 1 2024-04-26T12:06:56.873 INFO:tasks.workunit.client.0.smithi052.stdout:9/518: write d3/db/d10/d54/f56 [2035867,101296] 0 2024-04-26T12:06:56.873 INFO:tasks.workunit.client.0.smithi052.stdout:9/519: fdatasync d3/d23/f98 0 2024-04-26T12:06:56.873 INFO:tasks.workunit.client.0.smithi052.stdout:7/499: symlink d1/d1c/d21/d2f/d33/d3a/d64/la3 0 2024-04-26T12:06:56.873 INFO:tasks.workunit.client.0.smithi052.stdout:9/520: mkdir d3/d3b/db0 0 2024-04-26T12:06:56.873 INFO:tasks.workunit.client.0.smithi052.stdout:7/500: write d1/d1c/f9a [185405,29474] 0 2024-04-26T12:06:56.873 INFO:tasks.workunit.client.0.smithi052.stdout:9/521: link d3/f87 d3/db/d52/fb1 0 2024-04-26T12:06:56.873 INFO:tasks.workunit.client.0.smithi052.stdout:7/501: creat d1/d1c/d23/d81/fa4 x:0 0 0 2024-04-26T12:06:56.873 INFO:tasks.workunit.client.0.smithi052.stdout:9/522: creat d3/d23/d7f/fb2 x:0 0 0 2024-04-26T12:06:56.873 INFO:tasks.workunit.client.0.smithi052.stdout:8/426: sync 2024-04-26T12:06:56.873 INFO:tasks.workunit.client.0.smithi052.stdout:7/502: write d1/d1c/d21/d2f/d68/f91 [323374,96733] 0 2024-04-26T12:06:56.873 INFO:tasks.workunit.client.0.smithi052.stdout:9/523: dread - d3/db/d10/d2e/f77 zero size 2024-04-26T12:06:56.873 INFO:tasks.workunit.client.0.smithi052.stdout:7/503: chown d1/c97 7860708 1 2024-04-26T12:06:56.874 INFO:tasks.workunit.client.0.smithi052.stdout:8/427: rename d0/d16/f74 to d0/d4/f82 0 2024-04-26T12:06:56.874 INFO:tasks.workunit.client.0.smithi052.stdout:9/524: chown d3/db/d10/d3c/c92 1547083 1 2024-04-26T12:06:56.874 INFO:tasks.workunit.client.0.smithi052.stdout:8/428: write d0/f64 [3305941,71056] 0 2024-04-26T12:06:56.874 INFO:tasks.workunit.client.0.smithi052.stdout:8/429: stat d0/d16/f23 0 2024-04-26T12:06:56.874 INFO:tasks.workunit.client.0.smithi052.stdout:0/509: dread d0/d1/d1a/f64 [0,4194304] 0 2024-04-26T12:06:56.874 INFO:tasks.workunit.client.0.smithi052.stdout:8/430: mkdir d0/d4/d1c/d83 0 2024-04-26T12:06:56.874 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:56.874 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:56.875 INFO:tasks.workunit.client.0.smithi052.stdout:5/501: dread db/dc/d5f/f2f [0,4194304] 0 2024-04-26T12:06:56.875 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:06:56.880 INFO:tasks.workunit.client.0.smithi052.stdout:0/510: creat d0/d1/d1a/d20/d47/d84/fa3 x:0 0 0 2024-04-26T12:06:56.880 INFO:tasks.workunit.client.0.smithi052.stdout:7/504: dwrite d1/d1f/f60 [0,4194304] 0 2024-04-26T12:06:56.880 INFO:tasks.workunit.client.0.smithi052.stdout:7/505: stat d1/d45/d4c/f4f 0 2024-04-26T12:06:56.880 INFO:tasks.workunit.client.0.smithi052.stdout:7/506: creat d1/d1c/d23/d81/fa5 x:0 0 0 2024-04-26T12:06:56.880 INFO:tasks.workunit.client.0.smithi052.stdout:2/536: dread d0/d7/d16/f1e [0,4194304] 0 2024-04-26T12:06:56.880 INFO:tasks.workunit.client.0.smithi052.stdout:5/502: rename db/dd/d18/d60/d7d to db/dd/d34/d69/d8a/da9 0 2024-04-26T12:06:56.880 INFO:tasks.workunit.client.0.smithi052.stdout:5/503: creat db/dd/d34/d69/faa x:0 0 0 2024-04-26T12:06:56.880 INFO:tasks.workunit.client.0.smithi052.stdout:7/507: chown d1/d45/d4c/d4d/f70 20 1 2024-04-26T12:06:56.880 INFO:tasks.workunit.client.0.smithi052.stdout:2/537: write d0/d7/d22/f28 [307809,71516] 0 2024-04-26T12:06:56.880 INFO:tasks.workunit.client.0.smithi052.stdout:3/449: dread d2/d4/d41/f66 [0,4194304] 0 2024-04-26T12:06:56.881 INFO:tasks.workunit.client.0.smithi052.stdout:5/504: symlink db/dd/d34/d70/d59/lab 0 2024-04-26T12:06:56.881 INFO:tasks.workunit.client.0.smithi052.stdout:0/511: dwrite d0/d3c/f9a [0,4194304] 0 2024-04-26T12:06:56.881 INFO:tasks.workunit.client.0.smithi052.stdout:3/450: stat d2/d1f/f2c 0 2024-04-26T12:06:56.881 INFO:tasks.workunit.client.0.smithi052.stdout:6/496: dread da/ff [0,4194304] 0 2024-04-26T12:06:56.881 INFO:tasks.workunit.client.0.smithi052.stdout:7/508: mknod d1/d1c/d23/d81/d88/ca6 0 2024-04-26T12:06:56.881 INFO:tasks.workunit.client.0.smithi052.stdout:0/512: mkdir d0/d5b/d9d/d4f/da4 0 2024-04-26T12:06:56.881 INFO:tasks.workunit.client.0.smithi052.stdout:2/538: link d0/d7/d16/f75 d0/d7/d2f/fb2 0 2024-04-26T12:06:56.881 INFO:tasks.workunit.client.0.smithi052.stdout:3/451: creat d2/d4/dc/d33/d75/f84 x:0 0 0 2024-04-26T12:06:56.881 INFO:tasks.workunit.client.0.smithi052.stdout:0/513: mkdir d0/d1/d2c/d42/da5 0 2024-04-26T12:06:56.881 INFO:tasks.workunit.client.0.smithi052.stdout:2/539: creat d0/d7/d2f/fb3 x:0 0 0 2024-04-26T12:06:56.881 INFO:tasks.workunit.client.0.smithi052.stdout:7/509: getdents d1/d1c/d21/d2f/d68 0 2024-04-26T12:06:56.881 INFO:tasks.workunit.client.0.smithi052.stdout:2/540: chown d0/d3f/d56/d6d/d5a/f69 4603 1 2024-04-26T12:06:56.881 INFO:tasks.workunit.client.0.smithi052.stdout:0/514: mkdir d0/d26/d74/da6 0 2024-04-26T12:06:56.882 INFO:tasks.workunit.client.0.smithi052.stdout:3/452: symlink d2/d4/dc/d1d/d25/d36/l85 0 2024-04-26T12:06:56.882 INFO:tasks.workunit.client.0.smithi052.stdout:0/515: unlink d0/d3c/c73 0 2024-04-26T12:06:56.882 INFO:tasks.workunit.client.0.smithi052.stdout:2/541: creat d0/d3f/d56/d6d/d5a/d82/fb4 x:0 0 0 2024-04-26T12:06:56.882 INFO:tasks.workunit.client.0.smithi052.stdout:6/497: dwrite da/d22/d29/d31/f4d [0,4194304] 0 2024-04-26T12:06:56.882 INFO:tasks.workunit.client.0.smithi052.stdout:8/431: dread d0/d4/f51 [0,4194304] 0 2024-04-26T12:06:56.882 INFO:tasks.workunit.client.0.smithi052.stdout:5/505: dread db/dd/d18/d60/f83 [0,4194304] 0 2024-04-26T12:06:56.882 INFO:tasks.workunit.client.0.smithi052.stdout:0/516: mknod d0/d1/d1a/ca7 0 2024-04-26T12:06:56.882 INFO:tasks.workunit.client.0.smithi052.stdout:8/432: readlink d0/d4/d5/db/l6b 0 2024-04-26T12:06:56.882 INFO:tasks.workunit.client.0.smithi052.stdout:7/510: dwrite d1/f10 [8388608,4194304] 0 2024-04-26T12:06:56.882 INFO:tasks.workunit.client.0.smithi052.stdout:2/542: unlink d0/d3f/d56/d6d/d5a/d82/ca5 0 2024-04-26T12:06:56.882 INFO:tasks.workunit.client.0.smithi052.stdout:0/517: unlink d0/d26/c8f 0 2024-04-26T12:06:56.882 INFO:tasks.workunit.client.0.smithi052.stdout:3/453: write d2/d4/dc/d1d/d3f/f5e [945382,84739] 0 2024-04-26T12:06:56.882 INFO:tasks.workunit.client.0.smithi052.stdout:2/543: fsync d0/d3f/d56/d6d/d5a/f69 0 2024-04-26T12:06:56.882 INFO:tasks.workunit.client.0.smithi052.stdout:5/506: write db/dc/d5f/f3a [3629754,6301] 0 2024-04-26T12:06:56.883 INFO:tasks.workunit.client.0.smithi052.stdout:3/454: read - d2/d4/dc/f7a zero size 2024-04-26T12:06:56.883 INFO:tasks.workunit.client.0.smithi052.stdout:5/507: write db/dd/d34/d69/f76 [779779,64304] 0 2024-04-26T12:06:56.883 INFO:tasks.workunit.client.0.smithi052.stdout:7/511: creat d1/d1c/d21/d2f/fa7 x:0 0 0 2024-04-26T12:06:56.883 INFO:tasks.workunit.client.0.smithi052.stdout:6/498: dread da/d22/d29/d31/f3a [0,4194304] 0 2024-04-26T12:06:56.883 INFO:tasks.workunit.client.0.smithi052.stdout:1/473: sync 2024-04-26T12:06:56.883 INFO:tasks.workunit.client.0.smithi052.stdout:9/525: dread d3/d82/d8f/f6f [0,4194304] 0 2024-04-26T12:06:56.883 INFO:tasks.workunit.client.0.smithi052.stdout:5/508: creat db/dd/d18/d60/d64/d9c/fac x:0 0 0 2024-04-26T12:06:56.883 INFO:tasks.workunit.client.0.smithi052.stdout:7/512: rename d1/l59 to d1/d1f/d55/la8 0 2024-04-26T12:06:56.883 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:56.885 INFO:tasks.workunit.client.0.smithi052.stdout:8/433: dwrite d0/d4/d5/f61 [0,4194304] 0 2024-04-26T12:06:56.885 INFO:tasks.workunit.client.0.smithi052.stdout:9/526: chown d3/db/d52 29551189 1 2024-04-26T12:06:56.885 INFO:tasks.workunit.client.0.smithi052.stdout:6/499: dread da/d22/d29/d31/d39/f48 [0,4194304] 0 2024-04-26T12:06:56.885 INFO:tasks.workunit.client.0.smithi052.stdout:0/518: dwrite d0/d5b/d9d/d32/f78 [0,4194304] 0 2024-04-26T12:06:56.885 INFO:tasks.workunit.client.0.smithi052.stdout:2/544: dwrite d0/f1d [4194304,4194304] 0 2024-04-26T12:06:56.885 INFO:tasks.workunit.client.0.smithi052.stdout:8/434: chown d0/d4/f30 0 1 2024-04-26T12:06:56.885 INFO:tasks.workunit.client.0.smithi052.stdout:9/527: creat d3/db/d13/fb3 x:0 0 0 2024-04-26T12:06:56.885 INFO:tasks.workunit.client.0.smithi052.stdout:0/519: symlink d0/d26/d74/la8 0 2024-04-26T12:06:56.886 INFO:tasks.workunit.client.0.smithi052.stdout:7/513: getdents d1/d1c/d21/d2f/d68 0 2024-04-26T12:06:56.886 INFO:tasks.workunit.client.0.smithi052.stdout:6/500: chown da/d22/d29/d31/l5f 4513341 1 2024-04-26T12:06:56.886 INFO:tasks.workunit.client.0.smithi052.stdout:2/545: creat d0/d7/d2f/d3d/fb5 x:0 0 0 2024-04-26T12:06:56.886 INFO:tasks.workunit.client.0.smithi052.stdout:5/509: mknod db/dd/d34/d69/d8a/da9/d87/d6e/cad 0 2024-04-26T12:06:56.886 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:06:56.887 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:06:56.899 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:56.890+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:56.902 INFO:tasks.workunit.client.0.smithi052.stdout:8/435: mkdir d0/d4/dc/d68/d84 0 2024-04-26T12:06:56.902 INFO:tasks.workunit.client.0.smithi052.stdout:5/510: truncate db/dd/d18/f6c 933557 0 2024-04-26T12:06:56.902 INFO:tasks.workunit.client.0.smithi052.stdout:9/528: creat d3/db/d10/d3c/d40/d96/da7/fb4 x:0 0 0 2024-04-26T12:06:56.902 INFO:tasks.workunit.client.0.smithi052.stdout:9/529: readlink d3/db/d52/l47 0 2024-04-26T12:06:56.902 INFO:tasks.workunit.client.0.smithi052.stdout:8/436: creat d0/d4/dc/d68/d84/f85 x:0 0 0 2024-04-26T12:06:56.902 INFO:tasks.workunit.client.0.smithi052.stdout:2/546: dread d0/d7/d16/f40 [0,4194304] 0 2024-04-26T12:06:56.902 INFO:tasks.workunit.client.0.smithi052.stdout:8/437: mkdir d0/d4/d5/d86 0 2024-04-26T12:06:56.902 INFO:tasks.workunit.client.0.smithi052.stdout:5/511: rename db/c16 to db/dd/d34/d70/d59/cae 0 2024-04-26T12:06:56.902 INFO:tasks.workunit.client.0.smithi052.stdout:7/514: dread d1/d1c/d21/d2f/f4e [0,4194304] 0 2024-04-26T12:06:56.903 INFO:tasks.workunit.client.0.smithi052.stdout:2/547: creat d0/d3f/d56/d6d/d5a/fb6 x:0 0 0 2024-04-26T12:06:56.903 INFO:tasks.workunit.client.0.smithi052.stdout:5/512: mkdir db/dd/daf 0 2024-04-26T12:06:56.903 INFO:tasks.workunit.client.0.smithi052.stdout:0/520: dwrite d0/d26/d36/f4c [0,4194304] 0 2024-04-26T12:06:56.903 INFO:tasks.workunit.client.0.smithi052.stdout:6/501: dwrite da/d22/d29/d31/f7f [0,4194304] 0 2024-04-26T12:06:56.903 INFO:tasks.workunit.client.0.smithi052.stdout:9/530: truncate d3/db/d10/d3c/d40/f42 5054339 0 2024-04-26T12:06:56.903 INFO:tasks.workunit.client.0.smithi052.stdout:8/438: truncate d0/f71 1181958 0 2024-04-26T12:06:56.903 INFO:tasks.workunit.client.0.smithi052.stdout:7/515: chown d1/d45/d4c/d4d/fa1 77 1 2024-04-26T12:06:56.903 INFO:tasks.workunit.client.0.smithi052.stdout:1/474: dread d0/d2/dd/d34/f4e [0,4194304] 0 2024-04-26T12:06:56.903 INFO:tasks.workunit.client.0.smithi052.stdout:5/513: write db/dc/d5f/f8f [243527,118513] 0 2024-04-26T12:06:56.903 INFO:tasks.workunit.client.0.smithi052.stdout:2/548: link d0/d3f/d56/d6d/d5a/fad d0/d7/d2f/d8c/fb7 0 2024-04-26T12:06:56.903 INFO:tasks.workunit.client.0.smithi052.stdout:7/516: read - d1/d1c/d23/d81/fa5 zero size 2024-04-26T12:06:56.903 INFO:tasks.workunit.client.0.smithi052.stdout:0/521: chown d0/d1/dd/d72/d97/c9c 12249 1 2024-04-26T12:06:56.903 INFO:tasks.workunit.client.0.smithi052.stdout:9/531: rename d3/d82 to d3/db/d10/d3c/d40/d96/db5 0 2024-04-26T12:06:56.904 INFO:tasks.workunit.client.0.smithi052.stdout:2/549: readlink d0/d7/d16/l5c 0 2024-04-26T12:06:56.904 INFO:tasks.workunit.client.0.smithi052.stdout:1/475: dread - d0/d83/d4b/d56/f74 zero size 2024-04-26T12:06:56.904 INFO:tasks.workunit.client.0.smithi052.stdout:5/514: unlink db/dd/d18/d60/d64/l77 0 2024-04-26T12:06:56.904 INFO:tasks.workunit.client.0.smithi052.stdout:8/439: mkdir d0/d3e/d87 0 2024-04-26T12:06:56.904 INFO:tasks.workunit.client.0.smithi052.stdout:5/515: readlink db/l2b 0 2024-04-26T12:06:56.904 INFO:tasks.workunit.client.0.smithi052.stdout:6/502: rename da/d22/d3c/la9 to da/d5d/d64/d68/lb2 0 2024-04-26T12:06:56.904 INFO:tasks.workunit.client.0.smithi052.stdout:0/522: mkdir d0/d5b/d9d/d4f/da4/da9 0 2024-04-26T12:06:56.904 INFO:tasks.workunit.client.0.smithi052.stdout:1/476: chown d0/d2/dd/d40/l87 1500964 1 2024-04-26T12:06:56.904 INFO:tasks.workunit.client.0.smithi052.stdout:9/532: write d3/db/d10/d2e/f71 [2957557,37766] 0 2024-04-26T12:06:56.904 INFO:tasks.workunit.client.0.smithi052.stdout:5/516: readlink db/dc/d5f/d50/l85 0 2024-04-26T12:06:56.904 INFO:tasks.workunit.client.0.smithi052.stdout:6/503: dread - da/d22/d3c/d74/d99/d92/fab zero size 2024-04-26T12:06:56.904 INFO:tasks.workunit.client.0.smithi052.stdout:8/440: creat d0/d4/d5/d27/d57/f88 x:0 0 0 2024-04-26T12:06:56.904 INFO:tasks.workunit.client.0.smithi052.stdout:1/477: rename d0/d83/d4b/f70 to d0/d2/dd/d1c/d1d/f9f 0 2024-04-26T12:06:56.904 INFO:tasks.workunit.client.0.smithi052.stdout:9/533: rename d3/db/d10/d3c/d40/d96/db5/d8f/d49/f72 to d3/db/fb6 0 2024-04-26T12:06:56.904 INFO:tasks.workunit.client.0.smithi052.stdout:7/517: dwrite d1/d1f/f8c [0,4194304] 0 2024-04-26T12:06:56.905 INFO:tasks.workunit.client.0.smithi052.stdout:1/478: fdatasync d0/d2/dd/d40/d81/d52/f72 0 2024-04-26T12:06:56.905 INFO:tasks.workunit.client.0.smithi052.stdout:7/518: fsync d1/d1c/d21/f2e 0 2024-04-26T12:06:56.905 INFO:tasks.workunit.client.0.smithi052.stdout:0/523: dwrite d0/f66 [0,4194304] 0 2024-04-26T12:06:56.905 INFO:tasks.workunit.client.0.smithi052.stdout:9/534: creat d3/d3b/fb7 x:0 0 0 2024-04-26T12:06:56.905 INFO:tasks.workunit.client.0.smithi052.stdout:0/524: fdatasync d0/d1/d11/f16 0 2024-04-26T12:06:56.905 INFO:tasks.workunit.client.0.smithi052.stdout:7/519: mknod d1/d1c/d23/ca9 0 2024-04-26T12:06:56.905 INFO:tasks.workunit.client.0.smithi052.stdout:6/504: dread da/d22/d29/d31/f3a [0,4194304] 0 2024-04-26T12:06:56.905 INFO:tasks.workunit.client.0.smithi052.stdout:9/535: creat d3/fb8 x:0 0 0 2024-04-26T12:06:56.905 INFO:tasks.workunit.client.0.smithi052.stdout:5/517: dwrite db/dd/d34/d69/fa6 [0,4194304] 0 2024-04-26T12:06:56.905 INFO:tasks.workunit.client.0.smithi052.stdout:8/441: dwrite d0/f7a [4194304,4194304] 0 2024-04-26T12:06:56.905 INFO:tasks.workunit.client.0.smithi052.stdout:9/536: creat d3/db/d4a/fb9 x:0 0 0 2024-04-26T12:06:56.905 INFO:tasks.workunit.client.0.smithi052.stdout:7/520: chown d1/d1c/d23/d81/fa4 213666175 1 2024-04-26T12:06:56.905 INFO:tasks.workunit.client.0.smithi052.stdout:8/442: mkdir d0/d4/dc/d45/d58/d89 0 2024-04-26T12:06:56.906 INFO:tasks.workunit.client.0.smithi052.stdout:6/505: truncate da/d22/d29/f2e 227808 0 2024-04-26T12:06:56.906 INFO:tasks.workunit.client.0.smithi052.stdout:1/479: dwrite d0/d2/dd/f14 [0,4194304] 0 2024-04-26T12:06:56.906 INFO:tasks.workunit.client.0.smithi052.stdout:8/443: fdatasync d0/d4/dc/d68/f6e 0 2024-04-26T12:06:56.906 INFO:tasks.workunit.client.0.smithi052.stdout:6/506: creat da/d22/d3c/d74/d99/d92/fb3 x:0 0 0 2024-04-26T12:06:56.906 INFO:tasks.workunit.client.0.smithi052.stdout:8/444: mkdir d0/d4/d5/d27/d57/d8a 0 2024-04-26T12:06:56.906 INFO:tasks.workunit.client.0.smithi052.stdout:0/525: dwrite d0/f7a [0,4194304] 0 2024-04-26T12:06:56.906 INFO:tasks.workunit.client.0.smithi052.stdout:1/480: rename d0/d83/f44 to d0/d2/dd/d40/d81/d52/fa0 0 2024-04-26T12:06:56.906 INFO:tasks.workunit.client.0.smithi052.stdout:8/445: write d0/f78 [249701,15630] 0 2024-04-26T12:06:56.906 INFO:tasks.workunit.client.0.smithi052.stdout:6/507: link da/d22/d29/l2b da/d22/d3c/lb4 0 2024-04-26T12:06:56.906 INFO:tasks.workunit.client.0.smithi052.stdout:8/446: chown d0/d4/d5/d3c/f5d 112 1 2024-04-26T12:06:56.906 INFO:tasks.workunit.client.0.smithi052.stdout:7/521: dwrite d1/d1c/d21/d2f/d33/d3a/f40 [0,4194304] 0 2024-04-26T12:06:56.906 INFO:tasks.workunit.client.0.smithi052.stdout:3/455: sync 2024-04-26T12:06:56.906 INFO:tasks.workunit.client.0.smithi052.stdout:4/460: sync 2024-04-26T12:06:56.907 INFO:tasks.workunit.client.0.smithi052.stdout:6/508: truncate da/f37 3780161 0 2024-04-26T12:06:56.907 INFO:tasks.workunit.client.0.smithi052.stdout:2/550: dread d0/d36/f90 [0,4194304] 0 2024-04-26T12:06:56.907 INFO:tasks.workunit.client.0.smithi052.stdout:8/447: mkdir d0/d16/d63/d8b 0 2024-04-26T12:06:56.907 INFO:tasks.workunit.client.0.smithi052.stdout:7/522: unlink d1/ce 0 2024-04-26T12:06:56.907 INFO:tasks.workunit.client.0.smithi052.stdout:8/448: chown d0/d3e/f42 3 1 2024-04-26T12:06:56.907 INFO:tasks.workunit.client.0.smithi052.stdout:7/523: fdatasync d1/d1f/f8c 0 2024-04-26T12:06:56.907 INFO:tasks.workunit.client.0.smithi052.stdout:1/481: dwrite d0/da/f4f [0,4194304] 0 2024-04-26T12:06:56.907 INFO:tasks.workunit.client.0.smithi052.stdout:0/526: dwrite d0/d1/d1a/d20/f3a [4194304,4194304] 0 2024-04-26T12:06:56.907 INFO:tasks.workunit.client.0.smithi052.stdout:3/456: write d2/d4/dc/d1d/d25/d36/d1c/f3c [2258563,24158] 0 2024-04-26T12:06:56.907 INFO:tasks.workunit.client.0.smithi052.stdout:4/461: rename d3/d2e/f3a to d3/d44/f9d 0 2024-04-26T12:06:56.907 INFO:tasks.workunit.client.0.smithi052.stdout:7/524: fdatasync d1/d1c/d23/d81/d88/f8a 0 2024-04-26T12:06:56.907 INFO:tasks.workunit.client.0.smithi052.stdout:2/551: rename d0/d3f/d56/d6d/d5a/d82/fb4 to d0/d7/d22/fb8 0 2024-04-26T12:06:56.908 INFO:tasks.workunit.client.0.smithi052.stdout:0/527: write d0/f66 [3356825,118268] 0 2024-04-26T12:06:56.908 INFO:tasks.workunit.client.0.smithi052.stdout:1/482: getdents d0/d2/d88 0 2024-04-26T12:06:56.908 INFO:tasks.workunit.client.0.smithi052.stdout:4/462: getdents d3/d15/d76 0 2024-04-26T12:06:56.908 INFO:tasks.workunit.client.0.smithi052.stdout:7/525: mknod d1/d1c/d23/d81/caa 0 2024-04-26T12:06:56.908 INFO:tasks.workunit.client.0.smithi052.stdout:2/552: mkdir d0/d3f/d56/d8d/d99/db9 0 2024-04-26T12:06:56.908 INFO:tasks.workunit.client.0.smithi052.stdout:4/463: chown d3/d22/d30/d71/d92 7044 1 2024-04-26T12:06:56.908 INFO:tasks.workunit.client.0.smithi052.stdout:7/526: fsync d1/d1c/f1e 0 2024-04-26T12:06:56.908 INFO:tasks.workunit.client.0.smithi052.stdout:3/457: unlink d2/d4/dc/d1d/d25/d36/l65 0 2024-04-26T12:06:56.908 INFO:tasks.workunit.client.0.smithi052.stdout:6/509: dwrite da/d22/d3c/f66 [0,4194304] 0 2024-04-26T12:06:56.908 INFO:tasks.workunit.client.0.smithi052.stdout:1/483: fdatasync d0/d2/dd/d1c/d1d/d23/f61 0 2024-04-26T12:06:56.908 INFO:tasks.workunit.client.0.smithi052.stdout:0/528: write d0/d5b/d9d/d32/f78 [795336,70814] 0 2024-04-26T12:06:56.908 INFO:tasks.workunit.client.0.smithi052.stdout:2/553: mknod d0/d3f/cba 0 2024-04-26T12:06:56.908 INFO:tasks.workunit.client.0.smithi052.stdout:8/449: dwrite d0/d4/f17 [0,4194304] 0 2024-04-26T12:06:56.909 INFO:tasks.workunit.client.0.smithi052.stdout:7/527: stat d1/d1c/d23/d81/d88 0 2024-04-26T12:06:56.909 INFO:tasks.workunit.client.0.smithi052.stdout:0/529: mknod d0/d26/d74/caa 0 2024-04-26T12:06:56.909 INFO:tasks.workunit.client.0.smithi052.stdout:6/510: unlink da/d5d/d64/d68/lb2 0 2024-04-26T12:06:56.909 INFO:tasks.workunit.client.0.smithi052.stdout:8/450: rmdir d0/d4/d5/d27/d69 39 2024-04-26T12:06:56.909 INFO:tasks.workunit.client.0.smithi052.stdout:4/464: write d3/d12/d34/d43/f5d [837988,26249] 0 2024-04-26T12:06:56.909 INFO:tasks.workunit.client.0.smithi052.stdout:3/458: creat d2/d4/dc/d1d/d25/d36/f86 x:0 0 0 2024-04-26T12:06:56.909 INFO:tasks.workunit.client.0.smithi052.stdout:7/528: write d1/d1c/d21/d2f/f9b [242369,23152] 0 2024-04-26T12:06:56.909 INFO:tasks.workunit.client.0.smithi052.stdout:8/451: stat d0/d4/d5/d3c/f55 0 2024-04-26T12:06:56.909 INFO:tasks.workunit.client.0.smithi052.stdout:1/484: rename d0/d2/dd/d40/d81/d52/fa0 to d0/d2/dd/d1c/d1d/d23/fa1 0 2024-04-26T12:06:56.909 INFO:tasks.workunit.client.0.smithi052.stdout:7/529: rename d1/d45 to d1/dab 0 2024-04-26T12:06:56.909 INFO:tasks.workunit.client.0.smithi052.stdout:1/485: write d0/f67 [155424,65543] 0 2024-04-26T12:06:56.909 INFO:tasks.workunit.client.0.smithi052.stdout:4/465: rename d3/ca to d3/d12/d34/d9b/c9e 0 2024-04-26T12:06:56.909 INFO:tasks.workunit.client.0.smithi052.stdout:7/530: write d1/dab/d4c/f57 [231284,94882] 0 2024-04-26T12:06:56.909 INFO:tasks.workunit.client.0.smithi052.stdout:4/466: read d3/d15/f83 [284410,79559] 0 2024-04-26T12:06:56.910 INFO:tasks.workunit.client.0.smithi052.stdout:8/452: rename d0/d16/d28/f4f to d0/d4/d5/f8c 0 2024-04-26T12:06:56.910 INFO:tasks.workunit.client.0.smithi052.stdout:7/531: readlink d1/d1c/d21/d2f/d68/l84 0 2024-04-26T12:06:56.910 INFO:tasks.workunit.client.0.smithi052.stdout:2/554: dwrite d0/d3f/d56/d6d/d5a/fad [0,4194304] 0 2024-04-26T12:06:56.910 INFO:tasks.workunit.client.0.smithi052.stdout:4/467: fdatasync d3/d44/d4b/f75 0 2024-04-26T12:06:56.910 INFO:tasks.workunit.client.0.smithi052.stdout:8/453: chown d0/d4/f30 54357597 1 2024-04-26T12:06:56.910 INFO:tasks.workunit.client.0.smithi052.stdout:3/459: dwrite d2/f73 [0,4194304] 0 2024-04-26T12:06:56.910 INFO:tasks.workunit.client.0.smithi052.stdout:4/468: readlink d3/d12/l2c 0 2024-04-26T12:06:56.910 INFO:tasks.workunit.client.0.smithi052.stdout:2/555: read d0/d7/d2f/d8c/fb7 [4072388,12692] 0 2024-04-26T12:06:56.910 INFO:tasks.workunit.client.0.smithi052.stdout:6/511: dwrite da/d22/f52 [0,4194304] 0 2024-04-26T12:06:56.910 INFO:tasks.workunit.client.0.smithi052.stdout:7/532: read d1/f12 [283726,52896] 0 2024-04-26T12:06:56.910 INFO:tasks.workunit.client.0.smithi052.stdout:2/556: unlink d0/f1d 0 2024-04-26T12:06:56.910 INFO:tasks.workunit.client.0.smithi052.stdout:8/454: truncate d0/d4/f38 4144022 0 2024-04-26T12:06:56.910 INFO:tasks.workunit.client.0.smithi052.stdout:4/469: getdents d3/d12/d34/d9b 0 2024-04-26T12:06:56.911 INFO:tasks.workunit.client.0.smithi052.stdout:6/512: write da/f53 [658723,97185] 0 2024-04-26T12:06:56.911 INFO:tasks.workunit.client.0.smithi052.stdout:7/533: write d1/dab/d4c/d4d/fa1 [657921,33520] 0 2024-04-26T12:06:56.911 INFO:tasks.workunit.client.0.smithi052.stdout:9/537: dread d3/db/d13/f29 [0,4194304] 0 2024-04-26T12:06:56.911 INFO:tasks.workunit.client.0.smithi052.stdout:2/557: symlink d0/d3f/d56/d6d/d5a/d73/d4b/d9c/lbb 0 2024-04-26T12:06:56.911 INFO:tasks.workunit.client.0.smithi052.stdout:3/460: truncate d2/d4/dc/d1d/d25/f2b 3753478 0 2024-04-26T12:06:56.911 INFO:tasks.workunit.client.0.smithi052.stdout:9/538: write d3/db/f20 [7382536,86978] 0 2024-04-26T12:06:56.911 INFO:tasks.workunit.client.0.smithi052.stdout:6/513: symlink da/d22/d3c/d74/d99/d92/d96/lb5 0 2024-04-26T12:06:56.911 INFO:tasks.workunit.client.0.smithi052.stdout:7/534: creat d1/d1c/d23/d81/d88/fac x:0 0 0 2024-04-26T12:06:56.911 INFO:tasks.workunit.client.0.smithi052.stdout:4/470: write d3/d12/d34/d45/d67/d6c/d86/f93 [873479,15653] 0 2024-04-26T12:06:56.911 INFO:tasks.workunit.client.0.smithi052.stdout:8/455: link d0/d4/d5/d27/c2f d0/d4/dc/c8d 0 2024-04-26T12:06:56.911 INFO:tasks.workunit.client.0.smithi052.stdout:3/461: write d2/d4/d41/d5c/f83 [2839163,83647] 0 2024-04-26T12:06:56.911 INFO:tasks.workunit.client.0.smithi052.stdout:4/471: read - d3/d22/d30/d71/f97 zero size 2024-04-26T12:06:56.911 INFO:tasks.workunit.client.0.smithi052.stdout:6/514: dread da/d22/d29/d31/d39/f48 [0,4194304] 0 2024-04-26T12:06:56.911 INFO:tasks.workunit.client.0.smithi052.stdout:7/535: write d1/d1c/d21/d2f/d33/f49 [969504,109619] 0 2024-04-26T12:06:56.912 INFO:tasks.workunit.client.0.smithi052.stdout:4/472: fdatasync d3/d12/f20 0 2024-04-26T12:06:56.912 INFO:tasks.workunit.client.0.smithi052.stdout:3/462: write d2/d4/d41/d5c/f83 [1049698,24167] 0 2024-04-26T12:06:56.912 INFO:tasks.workunit.client.0.smithi052.stdout:8/456: creat d0/d4/d5/d27/f8e x:0 0 0 2024-04-26T12:06:56.912 INFO:tasks.workunit.client.0.smithi052.stdout:7/536: symlink d1/d1f/d55/lad 0 2024-04-26T12:06:56.912 INFO:tasks.workunit.client.0.smithi052.stdout:6/515: creat da/d22/d97/fb6 x:0 0 0 2024-04-26T12:06:56.912 INFO:tasks.workunit.client.0.smithi052.stdout:4/473: mknod d3/d22/d69/c9f 0 2024-04-26T12:06:56.912 INFO:tasks.workunit.client.0.smithi052.stdout:0/530: dread d0/f3 [8388608,4194304] 0 2024-04-26T12:06:56.912 INFO:tasks.workunit.client.0.smithi052.stdout:3/463: symlink d2/d4/d41/d5c/l87 0 2024-04-26T12:06:56.912 INFO:tasks.workunit.client.0.smithi052.stdout:4/474: mkdir d3/d22/d30/da0 0 2024-04-26T12:06:56.912 INFO:tasks.workunit.client.0.smithi052.stdout:6/516: creat da/da2/fb7 x:0 0 0 2024-04-26T12:06:56.912 INFO:tasks.workunit.client.0.smithi052.stdout:8/457: mkdir d0/d4/dc/d45/d58/d8f 0 2024-04-26T12:06:56.912 INFO:tasks.workunit.client.0.smithi052.stdout:0/531: creat d0/d1/dd/fab x:0 0 0 2024-04-26T12:06:56.912 INFO:tasks.workunit.client.0.smithi052.stdout:2/558: dwrite d0/f12 [4194304,4194304] 0 2024-04-26T12:06:56.912 INFO:tasks.workunit.client.0.smithi052.stdout:8/458: symlink d0/l90 0 2024-04-26T12:06:56.913 INFO:tasks.workunit.client.0.smithi052.stdout:1/486: sync 2024-04-26T12:06:56.913 INFO:tasks.workunit.client.0.smithi052.stdout:6/517: creat da/d22/d3c/d74/d87/fb8 x:0 0 0 2024-04-26T12:06:56.913 INFO:tasks.workunit.client.0.smithi052.stdout:3/464: rename d2/d4/f79 to d2/d4/dc/d33/d37/f88 0 2024-04-26T12:06:56.913 INFO:tasks.workunit.client.0.smithi052.stdout:0/532: read - d0/d1/d1a/d20/d47/d84/fa3 zero size 2024-04-26T12:06:56.913 INFO:tasks.workunit.client.0.smithi052.stdout:1/487: dread - d0/d83/d4b/d56/f9d zero size 2024-04-26T12:06:56.913 INFO:tasks.workunit.client.0.smithi052.stdout:4/475: write d3/d22/d30/f42 [1433534,128035] 0 2024-04-26T12:06:56.913 INFO:tasks.workunit.client.0.smithi052.stdout:6/518: write da/d51/f62 [960690,50308] 0 2024-04-26T12:06:56.913 INFO:tasks.workunit.client.0.smithi052.stdout:8/459: read - d0/d4/dc/d68/f6e zero size 2024-04-26T12:06:56.913 INFO:tasks.workunit.client.0.smithi052.stdout:2/559: truncate d0/d7/fe 2645258 0 2024-04-26T12:06:56.913 INFO:tasks.workunit.client.0.smithi052.stdout:0/533: read d0/f49 [92083,121860] 0 2024-04-26T12:06:56.913 INFO:tasks.workunit.client.0.smithi052.stdout:8/460: creat d0/d4/dc/d45/d58/d8f/f91 x:0 0 0 2024-04-26T12:06:56.913 INFO:tasks.workunit.client.0.smithi052.stdout:7/537: dwrite d1/d1c/d21/f67 [0,4194304] 0 2024-04-26T12:06:56.914 INFO:tasks.workunit.client.0.smithi052.stdout:4/476: rename d3/d22/d30/da0 to d3/d12/d34/d43/da1 0 2024-04-26T12:06:56.916 INFO:tasks.workunit.client.0.smithi052.stdout:0/534: creat d0/d1/dd/d72/d97/fac x:0 0 0 2024-04-26T12:06:56.916 INFO:tasks.workunit.client.0.smithi052.stdout:3/465: link d2/d4/dc/d1d/d3f/l6c d2/d4/d41/d59/l89 0 2024-04-26T12:06:56.916 INFO:tasks.workunit.client.0.smithi052.stdout:9/539: dwrite d3/db/d10/d3c/d40/d96/db5/d8f/d49/f8a [0,4194304] 0 2024-04-26T12:06:56.917 INFO:tasks.workunit.client.0.smithi052.stdout:9/540: stat d3/d23/f98 0 2024-04-26T12:06:56.917 INFO:tasks.workunit.client.0.smithi052.stdout:0/535: write d0/d1/d11/f4a [796361,25123] 0 2024-04-26T12:06:56.917 INFO:tasks.workunit.client.0.smithi052.stdout:1/488: dwrite d0/f55 [0,4194304] 0 2024-04-26T12:06:56.917 INFO:tasks.workunit.client.0.smithi052.stdout:8/461: creat d0/d4/d5/db/d20/d7b/f92 x:0 0 0 2024-04-26T12:06:56.917 INFO:tasks.workunit.client.0.smithi052.stdout:4/477: creat d3/d12/fa2 x:0 0 0 2024-04-26T12:06:56.917 INFO:tasks.workunit.client.0.smithi052.stdout:2/560: creat d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/fbc x:0 0 0 2024-04-26T12:06:56.917 INFO:tasks.workunit.client.0.smithi052.stdout:1/489: chown d0/d83 11197 1 2024-04-26T12:06:56.917 INFO:tasks.workunit.client.0.smithi052.stdout:4/478: readlink d3/d22/d30/l6f 0 2024-04-26T12:06:56.917 INFO:tasks.workunit.client.0.smithi052.stdout:8/462: readlink d0/l5c 0 2024-04-26T12:06:56.917 INFO:tasks.workunit.client.0.smithi052.stdout:2/561: write d0/fa [4901595,107166] 0 2024-04-26T12:06:56.917 INFO:tasks.workunit.client.0.smithi052.stdout:9/541: fsync d3/db/d52/fb1 0 2024-04-26T12:06:56.917 INFO:tasks.workunit.client.0.smithi052.stdout:7/538: link d1/d1f/f26 d1/dab/d4c/fae 0 2024-04-26T12:06:56.917 INFO:tasks.workunit.client.0.smithi052.stdout:4/479: mknod d3/d2e/ca3 0 2024-04-26T12:06:56.917 INFO:tasks.workunit.client.0.smithi052.stdout:8/463: write d0/d4/d5/db/f5e [782056,62809] 0 2024-04-26T12:06:56.918 INFO:tasks.workunit.client.0.smithi052.stdout:7/539: write d1/f18 [554762,6942] 0 2024-04-26T12:06:56.918 INFO:tasks.workunit.client.0.smithi052.stdout:5/518: dread db/dd/d34/d69/d93/f58 [0,4194304] 0 2024-04-26T12:06:56.918 INFO:tasks.workunit.client.0.smithi052.stdout:9/542: write d3/db/d10/d2e/f77 [722445,78106] 0 2024-04-26T12:06:56.918 INFO:tasks.workunit.client.0.smithi052.stdout:1/490: rename d0/d2/dd/d1c/d1d/d91/f69 to d0/d83/d4b/d56/fa2 0 2024-04-26T12:06:56.918 INFO:tasks.workunit.client.0.smithi052.stdout:2/562: truncate d0/d7/d16/d3a/f8a 889061 0 2024-04-26T12:06:56.918 INFO:tasks.workunit.client.0.smithi052.stdout:4/480: creat d3/d2e/fa4 x:0 0 0 2024-04-26T12:06:56.918 INFO:tasks.workunit.client.0.smithi052.stdout:7/540: write d1/f7 [899579,130002] 0 2024-04-26T12:06:56.918 INFO:tasks.workunit.client.0.smithi052.stdout:9/543: unlink d3/d23/d7f/c9f 0 2024-04-26T12:06:56.918 INFO:tasks.workunit.client.0.smithi052.stdout:3/466: dwrite d2/d4/d41/d59/f71 [0,4194304] 0 2024-04-26T12:06:56.919 INFO:tasks.workunit.client.0.smithi052.stdout:0/536: dwrite d0/d1/dd/d72/d97/fac [0,4194304] 0 2024-04-26T12:06:56.919 INFO:tasks.workunit.client.0.smithi052.stdout:6/519: dread da/f37 [0,4194304] 0 2024-04-26T12:06:56.919 INFO:tasks.workunit.client.0.smithi052.stdout:5/519: fsync db/dd/d34/d70/d78/f94 0 2024-04-26T12:06:56.919 INFO:tasks.workunit.client.0.smithi052.stdout:8/464: creat d0/d4/d5/d86/f93 x:0 0 0 2024-04-26T12:06:56.919 INFO:tasks.workunit.client.0.smithi052.stdout:3/467: mkdir d2/d4/dc/d33/d8a 0 2024-04-26T12:06:56.919 INFO:tasks.workunit.client.0.smithi052.stdout:7/541: mknod d1/d1c/d21/d2f/d33/caf 0 2024-04-26T12:06:56.920 INFO:tasks.workunit.client.0.smithi052.stdout:0/537: symlink d0/d3d/lad 0 2024-04-26T12:06:56.920 INFO:tasks.workunit.client.0.smithi052.stdout:2/563: symlink d0/d3f/d56/d8d/d99/db9/lbd 0 2024-04-26T12:06:56.920 INFO:tasks.workunit.client.0.smithi052.stdout:4/481: creat d3/d12/d34/d45/d67/fa5 x:0 0 0 2024-04-26T12:06:56.920 INFO:tasks.workunit.client.0.smithi052.stdout:3/468: readlink d2/d4/dc/d1d/d25/d36/l85 0 2024-04-26T12:06:56.921 INFO:tasks.workunit.client.0.smithi052.stdout:1/491: dread d0/f55 [0,4194304] 0 2024-04-26T12:06:56.921 INFO:tasks.workunit.client.0.smithi052.stdout:7/542: chown d1/d1c/d21/d2f/d33/d92/l98 8491616 1 2024-04-26T12:06:56.922 INFO:tasks.workunit.client.0.smithi052.stdout:8/465: creat d0/d4/dc/d45/d75/f94 x:0 0 0 2024-04-26T12:06:56.923 INFO:tasks.workunit.client.0.smithi052.stdout:3/469: unlink d2/d4/d31/f54 0 2024-04-26T12:06:56.923 INFO:tasks.workunit.client.0.smithi052.stdout:9/544: write d3/db/d10/d54/f93 [463223,88539] 0 2024-04-26T12:06:56.923 INFO:tasks.workunit.client.0.smithi052.stdout:4/482: creat d3/d44/d4b/fa6 x:0 0 0 2024-04-26T12:06:56.924 INFO:tasks.workunit.client.0.smithi052.stdout:6/520: mkdir da/d22/d3c/d74/d99/d95/dac/db9 0 2024-04-26T12:06:56.924 INFO:tasks.workunit.client.0.smithi052.stdout:1/492: symlink d0/d2/dd/d1c/d3c/la3 0 2024-04-26T12:06:56.925 INFO:tasks.workunit.client.0.smithi052.stdout:4/483: chown d3/d1f/d21 0 1 2024-04-26T12:06:56.925 INFO:tasks.workunit.client.0.smithi052.stdout:3/470: symlink d2/d4/d6b/d7b/l8b 0 2024-04-26T12:06:56.926 INFO:tasks.workunit.client.0.smithi052.stdout:6/521: chown da/d22/d3c/d74/d99/d95/dac 941 1 2024-04-26T12:06:56.927 INFO:tasks.workunit.client.0.smithi052.stdout:9/545: symlink d3/db/d10/d2e/d5c/lba 0 2024-04-26T12:06:56.928 INFO:tasks.workunit.client.0.smithi052.stdout:3/471: symlink d2/d4/d2a/l8c 0 2024-04-26T12:06:56.929 INFO:tasks.workunit.client.0.smithi052.stdout:5/520: dwrite db/dd/d18/d60/f9a [0,4194304] 0 2024-04-26T12:06:56.929 INFO:tasks.workunit.client.0.smithi052.stdout:1/493: symlink d0/d2/dd/d1c/d3c/d9b/la4 0 2024-04-26T12:06:56.929 INFO:tasks.workunit.client.0.smithi052.stdout:2/564: dwrite d0/d3f/f80 [0,4194304] 0 2024-04-26T12:06:56.931 INFO:tasks.workunit.client.0.smithi052.stdout:4/484: write d3/d12/d34/d45/d67/d6c/d86/f93 [499875,109808] 0 2024-04-26T12:06:56.931 INFO:tasks.workunit.client.0.smithi052.stdout:9/546: creat d3/db/d10/d3c/d40/fbb x:0 0 0 2024-04-26T12:06:56.933 INFO:tasks.workunit.client.0.smithi052.stdout:0/538: dwrite d0/d3d/f3f [4194304,4194304] 0 2024-04-26T12:06:56.933 INFO:tasks.workunit.client.0.smithi052.stdout:3/472: symlink d2/d4/d6b/d7b/l8d 0 2024-04-26T12:06:56.933 INFO:tasks.workunit.client.0.smithi052.stdout:5/521: write db/dc/d5f/d50/d91/fa8 [413536,130470] 0 2024-04-26T12:06:56.934 INFO:tasks.workunit.client.0.smithi052.stdout:9/547: chown d3/db/d2b/f61 141103 1 2024-04-26T12:06:56.935 INFO:tasks.workunit.client.0.smithi052.stdout:5/522: creat db/dd/d34/d69/fb0 x:0 0 0 2024-04-26T12:06:56.937 INFO:tasks.workunit.client.0.smithi052.stdout:3/473: getdents d2/d4/dc/d1d/d25/d36 0 2024-04-26T12:06:56.938 INFO:tasks.workunit.client.0.smithi052.stdout:6/522: dwrite da/d22/d3c/d74/d99/d7c/f7d [0,4194304] 0 2024-04-26T12:06:56.938 INFO:tasks.workunit.client.0.smithi052.stdout:5/523: mknod db/dd/d34/d70/d59/cb1 0 2024-04-26T12:06:56.940 INFO:tasks.workunit.client.0.smithi052.stdout:4/485: dread d3/d22/d30/d71/f77 [0,4194304] 0 2024-04-26T12:06:56.942 INFO:tasks.workunit.client.0.smithi052.stdout:3/474: write d2/d4/f3e [4133993,43035] 0 2024-04-26T12:06:56.942 INFO:tasks.workunit.client.0.smithi052.stdout:6/523: fsync da/d22/d29/f55 0 2024-04-26T12:06:56.944 INFO:tasks.workunit.client.0.smithi052.stdout:0/539: dwrite d0/d26/d36/f92 [8388608,4194304] 0 2024-04-26T12:06:56.946 INFO:tasks.workunit.client.0.smithi052.stdout:1/494: dwrite d0/d2/f2a [8388608,4194304] 0 2024-04-26T12:06:56.947 INFO:tasks.workunit.client.0.smithi052.stdout:6/524: write da/d22/f2d [2256909,23297] 0 2024-04-26T12:06:56.948 INFO:tasks.workunit.client.0.smithi052.stdout:2/565: dwrite d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/fbc [0,4194304] 0 2024-04-26T12:06:56.948 INFO:tasks.workunit.client.0.smithi052.stdout:9/548: dwrite d3/db/d10/d3c/d40/f42 [0,4194304] 0 2024-04-26T12:06:56.949 INFO:tasks.workunit.client.0.smithi052.stdout:6/525: mkdir da/dba 0 2024-04-26T12:06:56.949 INFO:tasks.workunit.client.0.smithi052.stdout:7/543: dread d1/d1c/d21/f2e [0,4194304] 0 2024-04-26T12:06:56.950 INFO:tasks.workunit.client.0.smithi052.stdout:0/540: rename d0/d1/dd/d72/f89 to d0/d1/d52/fae 0 2024-04-26T12:06:56.951 INFO:tasks.workunit.client.0.smithi052.stdout:1/495: chown d0/d2/dd/d40/d81/f63 229 1 2024-04-26T12:06:56.951 INFO:tasks.workunit.client.0.smithi052.stdout:2/566: mknod d0/d3f/d56/d6d/d5a/d73/cbe 0 2024-04-26T12:06:56.952 INFO:tasks.workunit.client.0.smithi052.stdout:0/541: dread - d0/d1/dd/fa2 zero size 2024-04-26T12:06:56.952 INFO:tasks.workunit.client.0.smithi052.stdout:6/526: rename da/f11 to da/d22/d3c/d74/d7e/fbb 0 2024-04-26T12:06:56.952 INFO:tasks.workunit.client.0.smithi052.stdout:4/486: dwrite d3/fb [0,4194304] 0 2024-04-26T12:06:56.953 INFO:tasks.workunit.client.0.smithi052.stdout:5/524: dwrite db/dd/d34/d69/f76 [0,4194304] 0 2024-04-26T12:06:56.953 INFO:tasks.workunit.client.0.smithi052.stdout:2/567: truncate d0/d7/d16/f75 150828 0 2024-04-26T12:06:56.953 INFO:tasks.workunit.client.0.smithi052.stdout:0/542: rmdir d0/d1/d2c/d42/d70 39 2024-04-26T12:06:56.953 INFO:tasks.workunit.client.0.smithi052.stdout:1/496: write d0/d2/dd/d40/d81/d52/f98 [660169,46194] 0 2024-04-26T12:06:56.954 INFO:tasks.workunit.client.0.smithi052.stdout:6/527: write da/d22/d29/d31/f6b [3718731,120341] 0 2024-04-26T12:06:56.954 INFO:tasks.workunit.client.0.smithi052.stdout:4/487: read d3/d22/d30/f42 [4323987,61873] 0 2024-04-26T12:06:56.954 INFO:tasks.workunit.client.0.smithi052.stdout:2/568: rmdir d0/d7/d22 39 2024-04-26T12:06:56.955 INFO:tasks.workunit.client.0.smithi052.stdout:5/525: truncate db/dd/d18/f71 5845417 0 2024-04-26T12:06:56.956 INFO:tasks.workunit.client.0.smithi052.stdout:0/543: rename d0/d26/l93 to d0/d1/d2c/d42/d70/laf 0 2024-04-26T12:06:56.957 INFO:tasks.workunit.client.0.smithi052.stdout:4/488: link d3/d12/l2c d3/d12/d34/la7 0 2024-04-26T12:06:56.957 INFO:tasks.workunit.client.0.smithi052.stdout:2/569: truncate d0/d7/d16/f1c 3493783 0 2024-04-26T12:06:56.957 INFO:tasks.workunit.client.0.smithi052.stdout:4/489: read - d3/d2b/f7d zero size 2024-04-26T12:06:56.958 INFO:tasks.workunit.client.0.smithi052.stdout:2/570: write d0/d7/f3c [4434813,83156] 0 2024-04-26T12:06:56.958 INFO:tasks.workunit.client.0.smithi052.stdout:3/475: truncate d2/d4/dc/d1d/f60 8355748 0 2024-04-26T12:06:56.959 INFO:tasks.workunit.client.0.smithi052.stdout:9/549: truncate d3/db/d13/f79 806285 0 2024-04-26T12:06:56.959 INFO:tasks.workunit.client.0.smithi052.stdout:7/544: write d1/d1c/d21/d2f/d33/f6a [5014,110775] 0 2024-04-26T12:06:56.962 INFO:tasks.workunit.client.0.smithi052.stdout:2/571: creat d0/d3f/d56/d8d/d99/fbf x:0 0 0 2024-04-26T12:06:56.963 INFO:tasks.workunit.client.0.smithi052.stdout:1/497: dwrite d0/d2/dd/d1c/d1d/d91/f8a [0,4194304] 0 2024-04-26T12:06:56.965 INFO:tasks.workunit.client.0.smithi052.stdout:7/545: mknod d1/d1c/d65/cb0 0 2024-04-26T12:06:56.966 INFO:tasks.workunit.client.0.smithi052.stdout:8/466: dread d0/d4/dc/d45/d58/f5b [0,4194304] 0 2024-04-26T12:06:56.967 INFO:tasks.workunit.client.0.smithi052.stdout:0/544: dwrite d0/d26/d36/f98 [0,4194304] 0 2024-04-26T12:06:56.968 INFO:tasks.workunit.client.0.smithi052.stdout:4/490: dwrite d3/d12/fa2 [0,4194304] 0 2024-04-26T12:06:56.968 INFO:tasks.workunit.client.0.smithi052.stdout:8/467: chown d0/d16/d28/f6a 29835 1 2024-04-26T12:06:56.969 INFO:tasks.workunit.client.0.smithi052.stdout:2/572: mknod d0/d7/d2f/d8c/cc0 0 2024-04-26T12:06:56.969 INFO:tasks.workunit.client.0.smithi052.stdout:3/476: truncate d2/d4/d41/f66 215579 0 2024-04-26T12:06:56.970 INFO:tasks.workunit.client.0.smithi052.stdout:1/498: truncate d0/d2/dd/d40/d81/d52/f8d 130852 0 2024-04-26T12:06:56.970 INFO:tasks.workunit.client.0.smithi052.stdout:3/477: unlink d2/f6d 0 2024-04-26T12:06:56.972 INFO:tasks.workunit.client.0.smithi052.stdout:7/546: creat d1/d1c/d21/d2f/fb1 x:0 0 0 2024-04-26T12:06:56.972 INFO:tasks.workunit.client.0.smithi052.stdout:9/550: dwrite d3/db/d10/d3c/d40/d96/db5/d8f/f5e [0,4194304] 0 2024-04-26T12:06:56.972 INFO:tasks.workunit.client.0.smithi052.stdout:2/573: mkdir d0/d36/dc1 0 2024-04-26T12:06:56.973 INFO:tasks.workunit.client.0.smithi052.stdout:7/547: write d1/d1c/d23/d81/d88/f8a [654618,61876] 0 2024-04-26T12:06:56.974 INFO:tasks.workunit.client.0.smithi052.stdout:9/551: write d3/db/d10/d2e/f71 [1601252,50840] 0 2024-04-26T12:06:56.975 INFO:tasks.workunit.client.0.smithi052.stdout:5/526: dread db/dc/d5f/f36 [0,4194304] 0 2024-04-26T12:06:56.976 INFO:tasks.workunit.client.0.smithi052.stdout:0/545: dwrite d0/d1/dd/fab [0,4194304] 0 2024-04-26T12:06:56.978 INFO:tasks.workunit.client.0.smithi052.stdout:0/546: readlink d0/d1/d1a/d20/l27 0 2024-04-26T12:06:56.978 INFO:tasks.workunit.client.0.smithi052.stdout:9/552: write d3/db/d2b/f61 [2451400,28302] 0 2024-04-26T12:06:56.980 INFO:tasks.workunit.client.0.smithi052.stdout:1/499: dwrite d0/d83/d4b/d56/f5d [0,4194304] 0 2024-04-26T12:06:56.981 INFO:tasks.workunit.client.0.smithi052.stdout:8/468: dwrite d0/d4/d5/f8c [4194304,4194304] 0 2024-04-26T12:06:56.981 INFO:tasks.workunit.client.0.smithi052.stdout:6/528: read da/d22/d29/f55 [316309,122026] 0 2024-04-26T12:06:56.982 INFO:tasks.workunit.client.0.smithi052.stdout:4/491: dwrite d3/d12/d34/d45/f5e [0,4194304] 0 2024-04-26T12:06:56.985 INFO:tasks.workunit.client.0.smithi052.stdout:8/469: creat d0/d16/d63/f95 x:0 0 0 2024-04-26T12:06:56.986 INFO:tasks.workunit.client.0.smithi052.stdout:4/492: creat d3/d22/d30/d71/d92/fa8 x:0 0 0 2024-04-26T12:06:56.986 INFO:tasks.workunit.client.0.smithi052.stdout:3/478: truncate d2/d4/f64 1137061 0 2024-04-26T12:06:56.987 INFO:tasks.workunit.client.0.smithi052.stdout:6/529: rename da/l60 to da/d22/d3c/d74/d99/d95/dac/db9/lbc 0 2024-04-26T12:06:56.987 INFO:tasks.workunit.client.0.smithi052.stdout:4/493: fdatasync d3/f57 0 2024-04-26T12:06:56.988 INFO:tasks.workunit.client.0.smithi052.stdout:1/500: link d0/d2/dd/d1c/d1d/d91/l80 d0/d2/dd/d1c/d1d/d91/la5 0 2024-04-26T12:06:56.991 INFO:tasks.workunit.client.0.smithi052.stdout:3/479: chown d2/d4/dc/d33/l53 54197974 1 2024-04-26T12:06:56.991 INFO:tasks.workunit.client.0.smithi052.stdout:5/527: dwrite db/dc/d5f/d50/d46/d74/fa3 [0,4194304] 0 2024-04-26T12:06:56.991 INFO:tasks.workunit.client.0.smithi052.stdout:6/530: fsync da/d22/f47 0 2024-04-26T12:06:56.991 INFO:tasks.workunit.client.0.smithi052.stdout:8/470: link d0/d4/d5/d3c/f5d d0/d4/d5/db/f96 0 2024-04-26T12:06:56.991 INFO:tasks.workunit.client.0.smithi052.stdout:0/547: dwrite d0/d1/d1a/d20/f6e [4194304,4194304] 0 2024-04-26T12:06:56.992 INFO:tasks.workunit.client.0.smithi052.stdout:8/471: readlink d0/l7e 0 2024-04-26T12:06:56.992 INFO:tasks.workunit.client.0.smithi052.stdout:4/494: mknod d3/d12/d59/d96/ca9 0 2024-04-26T12:06:56.992 INFO:tasks.workunit.client.0.smithi052.stdout:5/528: unlink db/dd/l2d 0 2024-04-26T12:06:56.992 INFO:tasks.workunit.client.0.smithi052.stdout:3/480: fdatasync d2/f3d 0 2024-04-26T12:06:56.992 INFO:tasks.workunit.client.0.smithi052.stdout:0/548: stat d0/d5b/d9d/d4f/f7c 0 2024-04-26T12:06:56.992 INFO:tasks.workunit.client.0.smithi052.stdout:1/501: mkdir d0/d2/dd/d40/d81/d9a/da6 0 2024-04-26T12:06:56.993 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:56.991+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:56.993 INFO:tasks.workunit.client.0.smithi052.stdout:4/495: fsync d3/d1f/f25 0 2024-04-26T12:06:56.993 INFO:tasks.workunit.client.0.smithi052.stdout:9/553: dwrite d3/db/d10/d3c/d40/d96/db5/d8f/d49/f8a [0,4194304] 0 2024-04-26T12:06:56.994 INFO:tasks.workunit.client.0.smithi052.stdout:5/529: chown db/dd/d34/d69/faa 18595 1 2024-04-26T12:06:56.994 INFO:tasks.workunit.client.0.smithi052.stdout:6/531: creat da/d22/d3c/d74/d99/fbd x:0 0 0 2024-04-26T12:06:56.994 INFO:tasks.workunit.client.0.smithi052.stdout:1/502: mknod d0/d2/d88/ca7 0 2024-04-26T12:06:56.994 INFO:tasks.workunit.client.0.smithi052.stdout:8/472: symlink d0/d4/dc/d45/d58/d8f/l97 0 2024-04-26T12:06:56.995 INFO:tasks.workunit.client.0.smithi052.stdout:3/481: dread - d2/d4/dc/d1d/d25/d36/f86 zero size 2024-04-26T12:06:56.995 INFO:tasks.workunit.client.0.smithi052.stdout:0/549: write d0/d1/d11/f61 [3912281,80417] 0 2024-04-26T12:06:56.996 INFO:tasks.workunit.client.0.smithi052.stdout:8/473: symlink d0/d4/d5/d86/l98 0 2024-04-26T12:06:56.996 INFO:tasks.workunit.client.0.smithi052.stdout:5/530: link db/dd/d18/f6c db/dd/d34/fb2 0 2024-04-26T12:06:56.996 INFO:tasks.workunit.client.0.smithi052.stdout:9/554: write d3/db/d10/d3c/d40/d96/db5/d8f/d49/f8a [4641215,14483] 0 2024-04-26T12:06:56.997 INFO:tasks.workunit.client.0.smithi052.stdout:6/532: symlink da/d22/d3c/d74/d99/d7c/d94/lbe 0 2024-04-26T12:06:56.999 INFO:tasks.workunit.client.0.smithi052.stdout:3/482: rmdir d2/d80 0 2024-04-26T12:06:56.999 INFO:tasks.workunit.client.0.smithi052.stdout:0/550: creat d0/d26/fb0 x:0 0 0 2024-04-26T12:06:56.999 INFO:tasks.workunit.client.0.smithi052.stdout:8/474: mknod d0/d16/d28/c99 0 2024-04-26T12:06:57.000 INFO:tasks.workunit.client.0.smithi052.stdout:6/533: truncate da/d22/f52 4290363 0 2024-04-26T12:06:57.000 INFO:tasks.workunit.client.0.smithi052.stdout:9/555: stat d3/db/d10/d3c/fa5 0 2024-04-26T12:06:57.001 INFO:tasks.workunit.client.0.smithi052.stdout:2/574: sync 2024-04-26T12:06:57.002 INFO:tasks.workunit.client.0.smithi052.stdout:0/551: symlink d0/d1/d1a/d3b/lb1 0 2024-04-26T12:06:57.002 INFO:tasks.workunit.client.0.smithi052.stdout:6/534: mknod da/d5d/cbf 0 2024-04-26T12:06:57.003 INFO:tasks.workunit.client.0.smithi052.stdout:3/483: chown d2/d4/dc/d1d/d25/d36/d1c/f20 3452795 1 2024-04-26T12:06:57.003 INFO:tasks.workunit.client.0.smithi052.stdout:8/475: creat d0/d4/d5/d27/d69/f9a x:0 0 0 2024-04-26T12:06:57.003 INFO:tasks.workunit.client.0.smithi052.stdout:4/496: dwrite d3/d22/d30/f5c [0,4194304] 0 2024-04-26T12:06:57.004 INFO:tasks.workunit.client.0.smithi052.stdout:9/556: symlink d3/db/d10/d3c/d40/d96/db5/d8f/lbc 0 2024-04-26T12:06:57.004 INFO:tasks.workunit.client.0.smithi052.stdout:2/575: creat d0/d3f/d56/d6d/d5a/d73/fc2 x:0 0 0 2024-04-26T12:06:57.005 INFO:tasks.workunit.client.0.smithi052.stdout:1/503: dwrite d0/d2/dd/f6e [0,4194304] 0 2024-04-26T12:06:57.005 INFO:tasks.workunit.client.0.smithi052.stdout:0/552: write d0/d1/d11/f43 [4127402,49368] 0 2024-04-26T12:06:57.005 INFO:tasks.workunit.client.0.smithi052.stdout:8/476: symlink d0/d4/d5/db/l9b 0 2024-04-26T12:06:57.005 INFO:tasks.workunit.client.0.smithi052.stdout:3/484: symlink d2/d4/d2a/d2d/d4d/l8e 0 2024-04-26T12:06:57.008 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:57.008 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:57.009 INFO:tasks.workunit.client.0.smithi052.stdout:9/557: rmdir d3/db/d10/d3c/d40/d96/db5/da3 39 2024-04-26T12:06:57.009 INFO:tasks.workunit.client.0.smithi052.stdout:0/553: getdents d0/d1/d1a/d20 0 2024-04-26T12:06:57.013 INFO:tasks.workunit.client.0.smithi052.stdout:7/548: dread d1/d1c/d21/d2f/f7d [0,4194304] 0 2024-04-26T12:06:57.014 INFO:tasks.workunit.client.0.smithi052.stdout:0/554: chown d0/d1/d11/l44 4563 1 2024-04-26T12:06:57.015 INFO:tasks.workunit.client.0.smithi052.stdout:6/535: rmdir da/d22/d3c 39 2024-04-26T12:06:57.016 INFO:tasks.workunit.client.0.smithi052.stdout:4/497: dwrite d3/d2e/f6e [0,4194304] 0 2024-04-26T12:06:57.017 INFO:tasks.workunit.client.0.smithi052.stdout:1/504: dwrite d0/d1e/f79 [0,4194304] 0 2024-04-26T12:06:57.017 INFO:tasks.workunit.client.0.smithi052.stdout:8/477: dwrite d0/d16/d28/f7d [0,4194304] 0 2024-04-26T12:06:57.018 INFO:tasks.workunit.client.0.smithi052.stdout:0/555: creat d0/d1/d54/fb2 x:0 0 0 2024-04-26T12:06:57.018 INFO:tasks.workunit.client.0.smithi052.stdout:3/485: dwrite d2/d4/d31/f7f [0,4194304] 0 2024-04-26T12:06:57.019 INFO:tasks.workunit.client.0.smithi052.stdout:4/498: stat d3/d12/d34/d45/c4a 0 2024-04-26T12:06:57.019 INFO:tasks.workunit.client.0.smithi052.stdout:6/536: creat da/d22/d3c/d74/d99/d7c/fc0 x:0 0 0 2024-04-26T12:06:57.020 INFO:tasks.workunit.client.0.smithi052.stdout:1/505: unlink d0/d2/f10 0 2024-04-26T12:06:57.020 INFO:tasks.workunit.client.0.smithi052.stdout:8/478: write d0/d4/dc/d68/f79 [2885727,7348] 0 2024-04-26T12:06:57.020 INFO:tasks.workunit.client.0.smithi052.stdout:0/556: write d0/d1/d52/f6b [289299,63961] 0 2024-04-26T12:06:57.021 INFO:tasks.workunit.client.0.smithi052.stdout:6/537: chown da/d63/f78 91028 1 2024-04-26T12:06:57.021 INFO:tasks.workunit.client.0.smithi052.stdout:4/499: creat d3/d12/d59/faa x:0 0 0 2024-04-26T12:06:57.021 INFO:tasks.workunit.client.0.smithi052.stdout:9/558: dwrite d3/db/f20 [8388608,4194304] 0 2024-04-26T12:06:57.022 INFO:tasks.workunit.client.0.smithi052.stdout:4/500: dread - d3/d12/d59/faa zero size 2024-04-26T12:06:57.026 INFO:tasks.workunit.client.0.smithi052.stdout:1/506: creat d0/da/d2e/fa8 x:0 0 0 2024-04-26T12:06:57.026 INFO:tasks.workunit.client.0.smithi052.stdout:8/479: mkdir d0/d4/d5/d86/d9c 0 2024-04-26T12:06:57.026 INFO:tasks.workunit.client.0.smithi052.stdout:6/538: chown da/d5d/d9c/cb0 1775 1 2024-04-26T12:06:57.026 INFO:tasks.workunit.client.0.smithi052.stdout:9/559: creat d3/db/d10/d3c/d40/d96/db5/d8f/fbd x:0 0 0 2024-04-26T12:06:57.027 INFO:tasks.workunit.client.0.smithi052.stdout:7/549: sync 2024-04-26T12:06:57.027 INFO:tasks.workunit.client.0.smithi052.stdout:1/507: creat d0/d2/dd/d1c/d3c/d9b/fa9 x:0 0 0 2024-04-26T12:06:57.028 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:57.028 INFO:tasks.workunit.client.0.smithi052.stdout:6/539: truncate da/f1e 2093764 0 2024-04-26T12:06:57.029 INFO:tasks.workunit.client.0.smithi052.stdout:1/508: dread - d0/d83/f5f zero size 2024-04-26T12:06:57.029 INFO:tasks.workunit.client.0.smithi052.stdout:9/560: rename d3/db/d13/f9a to d3/db/fbe 0 2024-04-26T12:06:57.029 INFO:tasks.workunit.client.0.smithi052.stdout:3/486: dwrite d2/d4/d6b/f76 [0,4194304] 0 2024-04-26T12:06:57.030 INFO:tasks.workunit.client.0.smithi052.stdout:0/557: dwrite d0/d26/d36/f92 [8388608,4194304] 0 2024-04-26T12:06:57.032 INFO:tasks.workunit.client.0.smithi052.stdout:6/540: write da/d22/d29/d31/f4d [1870103,130330] 0 2024-04-26T12:06:57.032 INFO:tasks.workunit.client.0.smithi052.stdout:1/509: unlink d0/d2/dd/d1c/d1d/d23/c85 0 2024-04-26T12:06:57.032 INFO:tasks.workunit.client.0.smithi052.stdout:3/487: chown d2/d4/dc/d1d/d25/d61/f82 157184 1 2024-04-26T12:06:57.033 INFO:tasks.workunit.client.0.smithi052.stdout:4/501: dwrite d3/d22/d30/d71/f78 [0,4194304] 0 2024-04-26T12:06:57.033 INFO:tasks.workunit.client.0.smithi052.stdout:9/561: creat d3/db/d10/d3c/d40/d96/db5/d8f/d49/fbf x:0 0 0 2024-04-26T12:06:57.034 INFO:tasks.workunit.client.0.smithi052.stdout:4/502: mkdir d3/d2b/dab 0 2024-04-26T12:06:57.035 INFO:tasks.workunit.client.0.smithi052.stdout:9/562: mknod d3/db/d13/cc0 0 2024-04-26T12:06:57.036 INFO:tasks.workunit.client.0.smithi052.stdout:3/488: getdents d2/d4/d2a 0 2024-04-26T12:06:57.040 INFO:tasks.workunit.client.0.smithi052.stdout:9/563: rename d3/db/d4a/fb9 to d3/d3b/db0/fc1 0 2024-04-26T12:06:57.040 INFO:tasks.workunit.client.0.smithi052.stdout:0/558: dwrite d0/d5b/d9d/d32/f78 [0,4194304] 0 2024-04-26T12:06:57.040 INFO:tasks.workunit.client.0.smithi052.stdout:3/489: creat d2/d4/d41/d59/f8f x:0 0 0 2024-04-26T12:06:57.042 INFO:tasks.workunit.client.0.smithi052.stdout:9/564: rmdir d3/d3b/db0 39 2024-04-26T12:06:57.042 INFO:tasks.workunit.client.0.smithi052.stdout:6/541: dwrite da/d22/d3c/f58 [0,4194304] 0 2024-04-26T12:06:57.043 INFO:tasks.workunit.client.0.smithi052.stdout:1/510: dwrite d0/da/f2f [0,4194304] 0 2024-04-26T12:06:57.044 INFO:tasks.workunit.client.0.smithi052.stdout:6/542: fsync da/d63/f78 0 2024-04-26T12:06:57.044 INFO:tasks.workunit.client.0.smithi052.stdout:3/490: creat d2/d4/d6b/d7b/f90 x:0 0 0 2024-04-26T12:06:57.044 INFO:tasks.workunit.client.0.smithi052.stdout:4/503: dread d3/d12/d34/d45/f5e [0,4194304] 0 2024-04-26T12:06:57.044 INFO:tasks.workunit.client.0.smithi052.stdout:0/559: getdents d0 0 2024-04-26T12:06:57.045 INFO:tasks.workunit.client.0.smithi052.stdout:1/511: creat d0/da/faa x:0 0 0 2024-04-26T12:06:57.047 INFO:tasks.workunit.client.0.smithi052.stdout:6/543: truncate da/d63/f78 519908 0 2024-04-26T12:06:57.047 INFO:tasks.workunit.client.0.smithi052.stdout:3/491: unlink d2/d4/dc/l69 0 2024-04-26T12:06:57.047 INFO:tasks.workunit.client.0.smithi052.stdout:9/565: symlink d3/db/d10/d2e/lc2 0 2024-04-26T12:06:57.048 INFO:tasks.workunit.client.0.smithi052.stdout:1/512: mknod d0/d2/dd/d1c/d1d/d23/cab 0 2024-04-26T12:06:57.048 INFO:tasks.workunit.client.0.smithi052.stdout:0/560: rename d0/d1/d11/c68 to d0/cb3 0 2024-04-26T12:06:57.048 INFO:tasks.workunit.client.0.smithi052.stdout:7/550: dread d1/d1c/d21/d2f/d33/f6a [0,4194304] 0 2024-04-26T12:06:57.048 INFO:tasks.workunit.client.0.smithi052.stdout:3/492: chown d2/d4/d2a/l8c 65634 1 2024-04-26T12:06:57.048 INFO:tasks.workunit.client.0.smithi052.stdout:7/551: chown d1 15404 1 2024-04-26T12:06:57.049 INFO:tasks.workunit.client.0.smithi052.stdout:9/566: getdents d3/d3b 0 2024-04-26T12:06:57.049 INFO:tasks.workunit.client.0.smithi052.stdout:3/493: truncate d2/d4/dc/d1d/d3f/f70 1071777 0 2024-04-26T12:06:57.051 INFO:tasks.workunit.client.0.smithi052.stdout:3/494: write d2/d4/d2a/d2d/f78 [247534,86535] 0 2024-04-26T12:06:57.053 INFO:tasks.workunit.client.0.smithi052.stdout:1/513: write d0/d2/dd/d1c/f82 [993652,97803] 0 2024-04-26T12:06:57.053 INFO:tasks.workunit.client.0.smithi052.stdout:8/480: dread d0/f78 [0,4194304] 0 2024-04-26T12:06:57.053 INFO:tasks.workunit.client.0.smithi052.stdout:9/567: rename d3/db/d10/d3c/d40/d96/db5/da3/ca6 to d3/d3b/cc3 0 2024-04-26T12:06:57.054 INFO:tasks.workunit.client.0.smithi052.stdout:1/514: rmdir d0 39 2024-04-26T12:06:57.055 INFO:tasks.workunit.client.0.smithi052.stdout:0/561: rename d0/d1/dd/d79 to d0/d26/d74/db4 0 2024-04-26T12:06:57.055 INFO:tasks.workunit.client.0.smithi052.stdout:7/552: dwrite d1/d1c/d23/f85 [0,4194304] 0 2024-04-26T12:06:57.058 INFO:tasks.workunit.client.0.smithi052.stdout:1/515: mkdir d0/d2/dd/d40/dac 0 2024-04-26T12:06:57.058 INFO:tasks.workunit.client.0.smithi052.stdout:7/553: readlink d1/d1c/d21/d2f/d68/l84 0 2024-04-26T12:06:57.058 INFO:tasks.workunit.client.0.smithi052.stdout:0/562: creat d0/d1/d1a/d20/fb5 x:0 0 0 2024-04-26T12:06:57.060 INFO:tasks.workunit.client.0.smithi052.stdout:7/554: mknod d1/d1c/d21/d2f/d68/cb2 0 2024-04-26T12:06:57.060 INFO:tasks.workunit.client.0.smithi052.stdout:1/516: write d0/d2/dd/f32 [57974,86984] 0 2024-04-26T12:06:57.060 INFO:tasks.workunit.client.0.smithi052.stdout:0/563: mknod d0/d26/d85/cb6 0 2024-04-26T12:06:57.061 INFO:tasks.workunit.client.0.smithi052.stdout:3/495: dwrite d2/d4/d2a/d2d/f78 [0,4194304] 0 2024-04-26T12:06:57.061 INFO:tasks.workunit.client.0.smithi052.stdout:8/481: dwrite d0/d16/f73 [0,4194304] 0 2024-04-26T12:06:57.062 INFO:tasks.workunit.client.0.smithi052.stdout:1/517: symlink d0/d2/dd/d34/d95/lad 0 2024-04-26T12:06:57.063 INFO:tasks.workunit.client.0.smithi052.stdout:8/482: write d0/d4/d1c/f2c [2979151,46098] 0 2024-04-26T12:06:57.063 INFO:tasks.workunit.client.0.smithi052.stdout:1/518: fdatasync d0/d2/d88/f9e 0 2024-04-26T12:06:57.064 INFO:tasks.workunit.client.0.smithi052.stdout:3/496: link d2/d4/c18 d2/d4/dc/d33/c91 0 2024-04-26T12:06:57.064 INFO:tasks.workunit.client.0.smithi052.stdout:8/483: creat d0/d16/d28/f9d x:0 0 0 2024-04-26T12:06:57.064 INFO:tasks.workunit.client.0.smithi052.stdout:1/519: chown d0/d2/dd/d40/l92 7526367 1 2024-04-26T12:06:57.065 INFO:tasks.workunit.client.0.smithi052.stdout:8/484: read - d0/d4/d5/d3c/f55 zero size 2024-04-26T12:06:57.067 INFO:tasks.workunit.client.0.smithi052.stdout:1/520: mknod d0/d2/dd/d1c/d1d/cae 0 2024-04-26T12:06:57.069 INFO:tasks.workunit.client.0.smithi052.stdout:7/555: dwrite d1/d1c/d21/d2f/d33/d3a/f40 [0,4194304] 0 2024-04-26T12:06:57.069 INFO:tasks.workunit.client.0.smithi052.stdout:9/568: mknod d3/d3b/db0/cc4 0 2024-04-26T12:06:57.071 INFO:tasks.workunit.client.0.smithi052.stdout:7/556: symlink d1/lb3 0 2024-04-26T12:06:57.071 INFO:tasks.workunit.client.0.smithi052.stdout:9/569: unlink d3/db/d52/f65 0 2024-04-26T12:06:57.072 INFO:tasks.workunit.client.0.smithi052.stdout:0/564: truncate d0/f7a 1340588 0 2024-04-26T12:06:57.074 INFO:tasks.workunit.client.0.smithi052.stdout:3/497: dwrite d2/d4/d6b/f76 [0,4194304] 0 2024-04-26T12:06:57.074 INFO:tasks.workunit.client.0.smithi052.stdout:9/570: fdatasync d3/db/d10/f38 0 2024-04-26T12:06:57.074 INFO:tasks.workunit.client.0.smithi052.stdout:0/565: fdatasync d0/d5a/f88 0 2024-04-26T12:06:57.075 INFO:tasks.workunit.client.0.smithi052.stdout:3/498: creat d2/d4/d41/d5c/f92 x:0 0 0 2024-04-26T12:06:57.076 INFO:tasks.workunit.client.0.smithi052.stdout:9/571: chown d3/db/d10/d3c/d40/d96/db5/d8f/f6f 33 1 2024-04-26T12:06:57.076 INFO:tasks.workunit.client.0.smithi052.stdout:1/521: dwrite d0/d83/f27 [0,4194304] 0 2024-04-26T12:06:57.077 INFO:tasks.workunit.client.0.smithi052.stdout:5/531: dread db/dc/d5f/f2f [0,4194304] 0 2024-04-26T12:06:57.077 INFO:tasks.workunit.client.0.smithi052.stdout:9/572: write d3/fb8 [668049,124318] 0 2024-04-26T12:06:57.078 INFO:tasks.workunit.client.0.smithi052.stdout:1/522: symlink d0/d2/dd/d40/d81/d9a/laf 0 2024-04-26T12:06:57.080 INFO:tasks.workunit.client.0.smithi052.stdout:1/523: write d0/d2/dd/d1c/d1d/d91/f94 [1241364,12084] 0 2024-04-26T12:06:57.081 INFO:tasks.workunit.client.0.smithi052.stdout:6/544: dread da/d22/d29/f55 [0,4194304] 0 2024-04-26T12:06:57.083 INFO:tasks.workunit.client.0.smithi052.stdout:1/524: symlink d0/da/lb0 0 2024-04-26T12:06:57.083 INFO:tasks.workunit.client.0.smithi052.stdout:6/545: rmdir da/d22/d3c/d74 39 2024-04-26T12:06:57.084 INFO:tasks.workunit.client.0.smithi052.stdout:7/557: dwrite d1/f6 [0,4194304] 0 2024-04-26T12:06:57.086 INFO:tasks.workunit.client.0.smithi052.stdout:7/558: stat d1/l1b 0 2024-04-26T12:06:57.086 INFO:tasks.workunit.client.0.smithi052.stdout:6/546: mknod da/d22/d3c/cc1 0 2024-04-26T12:06:57.086 INFO:tasks.workunit.client.0.smithi052.stdout:5/532: dwrite db/dd/d34/d69/d8a/f8b [0,4194304] 0 2024-04-26T12:06:57.087 INFO:tasks.workunit.client.0.smithi052.stdout:5/533: mkdir db/d5c/db3 0 2024-04-26T12:06:57.088 INFO:tasks.workunit.client.0.smithi052.stdout:7/559: mknod d1/d1c/d23/cb4 0 2024-04-26T12:06:57.088 INFO:tasks.workunit.client.0.smithi052.stdout:3/499: dwrite d2/d4/dc/d1d/d25/d36/d1c/f4a [0,4194304] 0 2024-04-26T12:06:57.089 INFO:tasks.workunit.client.0.smithi052.stdout:6/547: fdatasync da/d22/d29/d31/f7f 0 2024-04-26T12:06:57.090 INFO:tasks.workunit.client.0.smithi052.stdout:7/560: unlink d1/d1c/d21/d2f/d33/d92/l98 0 2024-04-26T12:06:57.090 INFO:tasks.workunit.client.0.smithi052.stdout:6/548: fsync da/d22/d29/d31/f4a 0 2024-04-26T12:06:57.090 INFO:tasks.workunit.client.0.smithi052.stdout:5/534: mknod db/dd/d18/d60/d64/d9c/da0/cb4 0 2024-04-26T12:06:57.090 INFO:tasks.workunit.client.0.smithi052.stdout:6/549: readlink l3 0 2024-04-26T12:06:57.092 INFO:tasks.workunit.client.0.smithi052.stdout:5/535: fsync f1 0 2024-04-26T12:06:57.093 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:57.092+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:57.094 INFO:tasks.workunit.client.0.smithi052.stdout:7/561: symlink d1/d1c/d23/lb5 0 2024-04-26T12:06:57.094 INFO:tasks.workunit.client.0.smithi052.stdout:1/525: dwrite d0/d2/dd/d1c/d1d/d23/fa1 [4194304,4194304] 0 2024-04-26T12:06:57.094 INFO:tasks.workunit.client.0.smithi052.stdout:5/536: fsync db/dc/d5f/d50/d46/f79 0 2024-04-26T12:06:57.094 INFO:tasks.workunit.client.0.smithi052.stdout:4/504: dread d3/d12/f19 [0,4194304] 0 2024-04-26T12:06:57.095 INFO:tasks.workunit.client.0.smithi052.stdout:2/576: dread d0/d7/d2f/d3d/f92 [0,4194304] 0 2024-04-26T12:06:57.095 INFO:tasks.workunit.client.0.smithi052.stdout:4/505: fsync d3/d2b/f7d 0 2024-04-26T12:06:57.095 INFO:tasks.workunit.client.0.smithi052.stdout:5/537: chown db/dd/d34/d69/f89 4094583 1 2024-04-26T12:06:57.096 INFO:tasks.workunit.client.0.smithi052.stdout:7/562: truncate d1/d1c/d23/d81/f99 657658 0 2024-04-26T12:06:57.096 INFO:tasks.workunit.client.0.smithi052.stdout:5/538: readlink db/l14 0 2024-04-26T12:06:57.097 INFO:tasks.workunit.client.0.smithi052.stdout:6/550: link da/d22/d3c/d74/d99/d95/dac/db9/lbc da/d22/d3c/d74/d7e/lc2 0 2024-04-26T12:06:57.097 INFO:tasks.workunit.client.0.smithi052.stdout:4/506: rename d3/d12/f8b to d3/d12/d59/d6b/fac 0 2024-04-26T12:06:57.097 INFO:tasks.workunit.client.0.smithi052.stdout:7/563: chown d1/dab/d4c/d4d/c5a 1737941 1 2024-04-26T12:06:57.097 INFO:tasks.workunit.client.0.smithi052.stdout:9/573: dread d3/db/d13/f79 [0,4194304] 0 2024-04-26T12:06:57.097 INFO:tasks.workunit.client.0.smithi052.stdout:5/539: write db/f38 [1258944,61727] 0 2024-04-26T12:06:57.098 INFO:tasks.workunit.client.0.smithi052.stdout:7/564: mkdir d1/d1c/d21/db6 0 2024-04-26T12:06:57.099 INFO:tasks.workunit.client.0.smithi052.stdout:9/574: symlink d3/db/lc5 0 2024-04-26T12:06:57.100 INFO:tasks.workunit.client.0.smithi052.stdout:4/507: creat d3/d12/d34/d45/d67/d6c/fad x:0 0 0 2024-04-26T12:06:57.100 INFO:tasks.workunit.client.0.smithi052.stdout:5/540: creat db/dd/d18/d60/d64/fb5 x:0 0 0 2024-04-26T12:06:57.100 INFO:tasks.workunit.client.0.smithi052.stdout:1/526: dwrite d0/f68 [0,4194304] 0 2024-04-26T12:06:57.100 INFO:tasks.workunit.client.0.smithi052.stdout:9/575: mkdir d3/db/d4a/dc6 0 2024-04-26T12:06:57.101 INFO:tasks.workunit.client.0.smithi052.stdout:6/551: truncate da/d22/d3c/d74/d99/f70 5102613 0 2024-04-26T12:06:57.101 INFO:tasks.workunit.client.0.smithi052.stdout:7/565: getdents d1/d1c 0 2024-04-26T12:06:57.102 INFO:tasks.workunit.client.0.smithi052.stdout:9/576: chown d3/db/d52/fb1 195883 1 2024-04-26T12:06:57.102 INFO:tasks.workunit.client.0.smithi052.stdout:1/527: creat d0/d2/dd/d1c/d1d/d91/fb1 x:0 0 0 2024-04-26T12:06:57.102 INFO:tasks.workunit.client.0.smithi052.stdout:7/566: dread - d1/d1c/d21/d2f/fb1 zero size 2024-04-26T12:06:57.103 INFO:tasks.workunit.client.0.smithi052.stdout:6/552: write da/d22/d3c/d74/d99/f8f [645383,48534] 0 2024-04-26T12:06:57.103 INFO:tasks.workunit.client.0.smithi052.stdout:5/541: read db/dc/d5f/d50/d46/f79 [3872265,56484] 0 2024-04-26T12:06:57.103 INFO:tasks.workunit.client.0.smithi052.stdout:1/528: mkdir d0/d83/d4b/db2 0 2024-04-26T12:06:57.104 INFO:tasks.workunit.client.0.smithi052.stdout:1/529: write d0/d83/d4b/f8e [585529,108274] 0 2024-04-26T12:06:57.105 INFO:tasks.workunit.client.0.smithi052.stdout:5/542: creat db/dd/d34/d69/d93/fb6 x:0 0 0 2024-04-26T12:06:57.105 INFO:tasks.workunit.client.0.smithi052.stdout:6/553: mknod da/d22/d29/d31/d6f/cc3 0 2024-04-26T12:06:57.105 INFO:tasks.workunit.client.0.smithi052.stdout:1/530: dread - d0/d83/d4b/d56/f74 zero size 2024-04-26T12:06:57.106 INFO:tasks.workunit.client.0.smithi052.stdout:6/554: symlink da/d22/d3c/d74/d99/d7c/lc4 0 2024-04-26T12:06:57.106 INFO:tasks.workunit.client.0.smithi052.stdout:5/543: symlink db/d5c/db3/lb7 0 2024-04-26T12:06:57.107 INFO:tasks.workunit.client.0.smithi052.stdout:9/577: dread d3/db/d10/d3c/d40/d96/db5/d8f/f5e [0,4194304] 0 2024-04-26T12:06:57.107 INFO:tasks.workunit.client.0.smithi052.stdout:6/555: fsync da/d22/d3c/d74/d99/f8f 0 2024-04-26T12:06:57.108 INFO:tasks.workunit.client.0.smithi052.stdout:9/578: stat d3/db/d52 0 2024-04-26T12:06:57.109 INFO:tasks.workunit.client.0.smithi052.stdout:6/556: chown da/d22/d3c/d74/d99 66102223 1 2024-04-26T12:06:57.109 INFO:tasks.workunit.client.0.smithi052.stdout:0/566: sync 2024-04-26T12:06:57.111 INFO:tasks.workunit.client.0.smithi052.stdout:0/567: fsync d0/d26/d36/f92 0 2024-04-26T12:06:57.112 INFO:tasks.workunit.client.0.smithi052.stdout:9/579: mknod d3/db/d10/d3c/d40/d96/db5/d8f/cc7 0 2024-04-26T12:06:57.112 INFO:tasks.workunit.client.0.smithi052.stdout:4/508: dread d3/d22/d30/f42 [4194304,4194304] 0 2024-04-26T12:06:57.113 INFO:tasks.workunit.client.0.smithi052.stdout:5/544: write db/dd/d18/f71 [1237455,66752] 0 2024-04-26T12:06:57.113 INFO:tasks.workunit.client.0.smithi052.stdout:6/557: link da/d5d/fa1 da/d22/d3c/d74/d7e/fc5 0 2024-04-26T12:06:57.114 INFO:tasks.workunit.client.0.smithi052.stdout:4/509: fsync d3/f1c 0 2024-04-26T12:06:57.114 INFO:tasks.workunit.client.0.smithi052.stdout:8/485: dread d0/d4/f38 [0,4194304] 0 2024-04-26T12:06:57.115 INFO:tasks.workunit.client.0.smithi052.stdout:4/510: stat d3/d2b 0 2024-04-26T12:06:57.115 INFO:tasks.workunit.client.0.smithi052.stdout:1/531: dwrite d0/d83/f27 [4194304,4194304] 0 2024-04-26T12:06:57.115 INFO:tasks.workunit.client.0.smithi052.stdout:0/568: creat d0/d1/d1a/d20/d47/fb7 x:0 0 0 2024-04-26T12:06:57.116 INFO:tasks.workunit.client.0.smithi052.stdout:9/580: write d3/db/d10/d3c/d40/d96/db5/d8f/d49/f8a [2918867,11172] 0 2024-04-26T12:06:57.116 INFO:tasks.workunit.client.0.smithi052.stdout:4/511: write d3/f57 [813887,20672] 0 2024-04-26T12:06:57.116 INFO:tasks.workunit.client.0.smithi052.stdout:5/545: mkdir db/dd/d34/d69/d8a/da9/d87/d6e/db8 0 2024-04-26T12:06:57.117 INFO:tasks.workunit.client.0.smithi052.stdout:0/569: write d0/d1/d1a/d20/fb5 [274120,37110] 0 2024-04-26T12:06:57.117 INFO:tasks.workunit.client.0.smithi052.stdout:1/532: creat d0/d2/dd/d34/d95/fb3 x:0 0 0 2024-04-26T12:06:57.117 INFO:tasks.workunit.client.0.smithi052.stdout:4/512: creat d3/d22/d30/fae x:0 0 0 2024-04-26T12:06:57.118 INFO:tasks.workunit.client.0.smithi052.stdout:8/486: rename d0/d4/dc/c8d to d0/d4/d5/db/d20/d41/c9e 0 2024-04-26T12:06:57.118 INFO:tasks.workunit.client.0.smithi052.stdout:5/546: creat db/dd/d34/d69/d8a/da9/d87/fb9 x:0 0 0 2024-04-26T12:06:57.119 INFO:tasks.workunit.client.0.smithi052.stdout:4/513: dread - d3/d44/f48 zero size 2024-04-26T12:06:57.119 INFO:tasks.workunit.client.0.smithi052.stdout:9/581: write d3/db/d10/d3c/d40/d96/db5/d8f/f6f [3519623,18376] 0 2024-04-26T12:06:57.120 INFO:tasks.workunit.client.0.smithi052.stdout:8/487: creat d0/d4/dc/d45/f9f x:0 0 0 2024-04-26T12:06:57.120 INFO:tasks.workunit.client.0.smithi052.stdout:6/558: dread da/d22/d29/d31/f49 [0,4194304] 0 2024-04-26T12:06:57.120 INFO:tasks.workunit.client.0.smithi052.stdout:4/514: creat d3/d1f/d21/faf x:0 0 0 2024-04-26T12:06:57.121 INFO:tasks.workunit.client.0.smithi052.stdout:5/547: creat db/dd/d34/d69/d8a/da9/d87/fba x:0 0 0 2024-04-26T12:06:57.121 INFO:tasks.workunit.client.0.smithi052.stdout:8/488: stat d0/d16/d28/f7d 0 2024-04-26T12:06:57.121 INFO:tasks.workunit.client.0.smithi052.stdout:3/500: dread d2/d4/dc/d1d/d25/d36/d1c/d4e/f52 [0,4194304] 0 2024-04-26T12:06:57.122 INFO:tasks.workunit.client.0.smithi052.stdout:4/515: creat d3/d12/d34/d45/d67/d6c/d86/fb0 x:0 0 0 2024-04-26T12:06:57.123 INFO:tasks.workunit.client.0.smithi052.stdout:6/559: creat da/d22/d3c/d74/d99/d7c/d94/fc6 x:0 0 0 2024-04-26T12:06:57.124 INFO:tasks.workunit.client.0.smithi052.stdout:8/489: rename d0/f29 to d0/d3e/fa0 0 2024-04-26T12:06:57.124 INFO:tasks.workunit.client.0.smithi052.stdout:0/570: dwrite d0/d26/d74/f7f [0,4194304] 0 2024-04-26T12:06:57.125 INFO:tasks.workunit.client.0.smithi052.stdout:1/533: dwrite d0/d2/dd/f14 [0,4194304] 0 2024-04-26T12:06:57.125 INFO:tasks.workunit.client.0.smithi052.stdout:4/516: symlink d3/d15/d53/lb1 0 2024-04-26T12:06:57.125 INFO:tasks.workunit.client.0.smithi052.stdout:5/548: getdents db/dc/d5f/d50/d46 0 2024-04-26T12:06:57.126 INFO:tasks.workunit.client.0.smithi052.stdout:6/560: mkdir da/d22/d29/d31/d39/dc7 0 2024-04-26T12:06:57.127 INFO:tasks.workunit.client.0.smithi052.stdout:8/490: write d0/d16/d28/f9d [1570,112632] 0 2024-04-26T12:06:57.129 INFO:tasks.workunit.client.0.smithi052.stdout:7/567: dread d1/d1c/d21/d2f/f38 [0,4194304] 0 2024-04-26T12:06:57.129 INFO:tasks.workunit.client.0.smithi052.stdout:5/549: write db/dd/d34/f57 [5151898,13190] 0 2024-04-26T12:06:57.129 INFO:tasks.workunit.client.0.smithi052.stdout:0/571: link d0/d5b/d9d/d4f/l8d d0/lb8 0 2024-04-26T12:06:57.130 INFO:tasks.workunit.client.0.smithi052.stdout:5/550: chown db 323773 1 2024-04-26T12:06:57.130 INFO:tasks.workunit.client.0.smithi052.stdout:4/517: rename d3/d22/d69/f8c to d3/d15/d76/fb2 0 2024-04-26T12:06:57.131 INFO:tasks.workunit.client.0.smithi052.stdout:7/568: mkdir d1/db7 0 2024-04-26T12:06:57.132 INFO:tasks.workunit.client.0.smithi052.stdout:8/491: truncate d0/d4/dc/d68/d84/f85 302285 0 2024-04-26T12:06:57.132 INFO:tasks.workunit.client.0.smithi052.stdout:4/518: creat d3/d12/d34/d43/fb3 x:0 0 0 2024-04-26T12:06:57.133 INFO:tasks.workunit.client.0.smithi052.stdout:3/501: dwrite d2/d4/dc/d33/d37/f88 [0,4194304] 0 2024-04-26T12:06:57.133 INFO:tasks.workunit.client.0.smithi052.stdout:4/519: dread - d3/d2b/f7d zero size 2024-04-26T12:06:57.133 INFO:tasks.workunit.client.0.smithi052.stdout:7/569: rename d1/d1c/d23/cb4 to d1/d1c/d21/d2f/d33/d3a/d64/cb8 0 2024-04-26T12:06:57.134 INFO:tasks.workunit.client.0.smithi052.stdout:8/492: symlink d0/d4/dc/d45/d58/d89/la1 0 2024-04-26T12:06:57.134 INFO:tasks.workunit.client.0.smithi052.stdout:5/551: read db/dd/d18/d60/f9a [316663,126351] 0 2024-04-26T12:06:57.134 INFO:tasks.workunit.client.0.smithi052.stdout:4/520: creat d3/d1f/fb4 x:0 0 0 2024-04-26T12:06:57.135 INFO:tasks.workunit.client.0.smithi052.stdout:0/572: dread d0/d1/d1a/d20/fb5 [0,4194304] 0 2024-04-26T12:06:57.136 INFO:tasks.workunit.client.0.smithi052.stdout:4/521: creat d3/d12/d34/d91/fb5 x:0 0 0 2024-04-26T12:06:57.137 INFO:tasks.workunit.client.0.smithi052.stdout:3/502: rename d2/d4/dc/d1d/d25/d36/d1c/d4e/f52 to d2/d4/dc/d1d/d25/d61/f93 0 2024-04-26T12:06:57.138 INFO:tasks.workunit.client.0.smithi052.stdout:0/573: creat d0/d5b/d9d/d32/fb9 x:0 0 0 2024-04-26T12:06:57.138 INFO:tasks.workunit.client.0.smithi052.stdout:4/522: truncate d3/d22/f4e 807626 0 2024-04-26T12:06:57.138 INFO:tasks.workunit.client.0.smithi052.stdout:4/523: dread - d3/d2b/f7d zero size 2024-04-26T12:06:57.139 INFO:tasks.workunit.client.0.smithi052.stdout:0/574: write d0/d26/d36/f8e [526742,57861] 0 2024-04-26T12:06:57.139 INFO:tasks.workunit.client.0.smithi052.stdout:8/493: truncate d0/d4/f30 3882600 0 2024-04-26T12:06:57.140 INFO:tasks.workunit.client.0.smithi052.stdout:4/524: mkdir d3/d2b/dab/db6 0 2024-04-26T12:06:57.141 INFO:tasks.workunit.client.0.smithi052.stdout:8/494: creat d0/d4/d5/d27/d69/fa2 x:0 0 0 2024-04-26T12:06:57.141 INFO:tasks.workunit.client.0.smithi052.stdout:0/575: mkdir d0/d1/d2c/d42/da5/dba 0 2024-04-26T12:06:57.142 INFO:tasks.workunit.client.0.smithi052.stdout:8/495: mkdir d0/d4/d5/da3 0 2024-04-26T12:06:57.142 INFO:tasks.workunit.client.0.smithi052.stdout:0/576: read d0/d26/d74/f7f [5012560,29309] 0 2024-04-26T12:06:57.142 INFO:tasks.workunit.client.0.smithi052.stdout:2/577: sync 2024-04-26T12:06:57.143 INFO:tasks.workunit.client.0.smithi052.stdout:9/582: sync 2024-04-26T12:06:57.143 INFO:tasks.workunit.client.0.smithi052.stdout:8/496: mknod d0/d4/dc/d45/d58/d89/ca4 0 2024-04-26T12:06:57.144 INFO:tasks.workunit.client.0.smithi052.stdout:9/583: creat d3/db/d10/d54/fc8 x:0 0 0 2024-04-26T12:06:57.145 INFO:tasks.workunit.client.0.smithi052.stdout:9/584: chown d3/db/d10/la8 86736 1 2024-04-26T12:06:57.146 INFO:tasks.workunit.client.0.smithi052.stdout:3/503: truncate d2/d4/dc/d1d/d25/d36/d1c/f3c 980979 0 2024-04-26T12:06:57.147 INFO:tasks.workunit.client.0.smithi052.stdout:6/561: dread da/d22/f52 [0,4194304] 0 2024-04-26T12:06:57.147 INFO:tasks.workunit.client.0.smithi052.stdout:4/525: truncate d3/d12/f1e 1955409 0 2024-04-26T12:06:57.147 INFO:tasks.workunit.client.0.smithi052.stdout:1/534: sync 2024-04-26T12:06:57.148 INFO:tasks.workunit.client.0.smithi052.stdout:4/526: chown d3/fd 3 1 2024-04-26T12:06:57.149 INFO:tasks.workunit.client.0.smithi052.stdout:5/552: dread db/dd/d34/d69/d93/f58 [0,4194304] 0 2024-04-26T12:06:57.149 INFO:tasks.workunit.client.0.smithi052.stdout:1/535: creat d0/d2/d88/fb4 x:0 0 0 2024-04-26T12:06:57.150 INFO:tasks.workunit.client.0.smithi052.stdout:2/578: dwrite d0/f21 [0,4194304] 0 2024-04-26T12:06:57.150 INFO:tasks.workunit.client.0.smithi052.stdout:8/497: truncate d0/d4/f38 4035874 0 2024-04-26T12:06:57.150 INFO:tasks.workunit.client.0.smithi052.stdout:3/504: link d2/d4/dc/d1d/d3f/f5e d2/d4/dc/d33/f94 0 2024-04-26T12:06:57.151 INFO:tasks.workunit.client.0.smithi052.stdout:2/579: symlink d0/d7/d2f/d9b/lc3 0 2024-04-26T12:06:57.152 INFO:tasks.workunit.client.0.smithi052.stdout:8/498: write d0/d4/d5/d27/d69/fa2 [264742,64730] 0 2024-04-26T12:06:57.152 INFO:tasks.workunit.client.0.smithi052.stdout:5/553: rename db/dd/d34/d69/f76 to db/dd/d34/d69/d93/fbb 0 2024-04-26T12:06:57.153 INFO:tasks.workunit.client.0.smithi052.stdout:6/562: truncate da/d22/d3c/d74/d99/d7c/d94/fa7 456161 0 2024-04-26T12:06:57.154 INFO:tasks.workunit.client.0.smithi052.stdout:6/563: chown da/d51/f5b 892 1 2024-04-26T12:06:57.157 INFO:tasks.workunit.client.0.smithi052.stdout:3/505: dread d2/d4/d2a/d2d/f78 [0,4194304] 0 2024-04-26T12:06:57.157 INFO:tasks.workunit.client.0.smithi052.stdout:9/585: dread d3/db/d10/d3c/d40/d96/db5/f8e [0,4194304] 0 2024-04-26T12:06:57.158 INFO:tasks.workunit.client.0.smithi052.stdout:1/536: dwrite d0/d2/f24 [0,4194304] 0 2024-04-26T12:06:57.159 INFO:tasks.workunit.client.0.smithi052.stdout:7/570: dread d1/dab/d4c/d4d/f79 [0,4194304] 0 2024-04-26T12:06:57.160 INFO:tasks.workunit.client.0.smithi052.stdout:3/506: mknod d2/d4/d41/c95 0 2024-04-26T12:06:57.160 INFO:tasks.workunit.client.0.smithi052.stdout:9/586: mknod d3/d23/d7f/cc9 0 2024-04-26T12:06:57.161 INFO:tasks.workunit.client.0.smithi052.stdout:1/537: fsync d0/d2/dd/d40/d81/d52/f98 0 2024-04-26T12:06:57.161 INFO:tasks.workunit.client.0.smithi052.stdout:6/564: truncate da/d22/d3c/d74/d99/d7c/fb1 288551 0 2024-04-26T12:06:57.161 INFO:tasks.workunit.client.0.smithi052.stdout:3/507: chown d2/c49 247807 1 2024-04-26T12:06:57.162 INFO:tasks.workunit.client.0.smithi052.stdout:8/499: dwrite d0/d16/d28/f6a [0,4194304] 0 2024-04-26T12:06:57.162 INFO:tasks.workunit.client.0.smithi052.stdout:9/587: mknod d3/d23/d7f/cca 0 2024-04-26T12:06:57.163 INFO:tasks.workunit.client.0.smithi052.stdout:7/571: creat d1/d1c/d21/d2f/d33/fb9 x:0 0 0 2024-04-26T12:06:57.163 INFO:tasks.workunit.client.0.smithi052.stdout:6/565: write da/d51/f69 [73367,130669] 0 2024-04-26T12:06:57.164 INFO:tasks.workunit.client.0.smithi052.stdout:3/508: readlink d2/d4/d2a/d2d/l77 0 2024-04-26T12:06:57.165 INFO:tasks.workunit.client.0.smithi052.stdout:5/554: dwrite db/dd/d34/d70/d78/f94 [0,4194304] 0 2024-04-26T12:06:57.165 INFO:tasks.workunit.client.0.smithi052.stdout:9/588: write d3/d23/f98 [692185,113876] 0 2024-04-26T12:06:57.166 INFO:tasks.workunit.client.0.smithi052.stdout:6/566: creat da/d22/d3c/d74/d99/d92/d96/fc8 x:0 0 0 2024-04-26T12:06:57.167 INFO:tasks.workunit.client.0.smithi052.stdout:0/577: dread d0/d1/f41 [4194304,4194304] 0 2024-04-26T12:06:57.167 INFO:tasks.workunit.client.0.smithi052.stdout:8/500: dread d0/d16/d28/f9d [0,4194304] 0 2024-04-26T12:06:57.168 INFO:tasks.workunit.client.0.smithi052.stdout:6/567: symlink da/d5d/d64/d68/lc9 0 2024-04-26T12:06:57.169 INFO:tasks.workunit.client.0.smithi052.stdout:6/568: readlink da/d5d/d64/d68/lc9 0 2024-04-26T12:06:57.170 INFO:tasks.workunit.client.0.smithi052.stdout:6/569: getdents da/d63 0 2024-04-26T12:06:57.171 INFO:tasks.workunit.client.0.smithi052.stdout:6/570: write da/d22/f47 [1677505,69598] 0 2024-04-26T12:06:57.173 INFO:tasks.workunit.client.0.smithi052.stdout:4/527: dread d3/fb [0,4194304] 0 2024-04-26T12:06:57.173 INFO:tasks.workunit.client.0.smithi052.stdout:8/501: dwrite d0/f7a [0,4194304] 0 2024-04-26T12:06:57.174 INFO:tasks.workunit.client.0.smithi052.stdout:4/528: rmdir d3/d22/d69 39 2024-04-26T12:06:57.175 INFO:tasks.workunit.client.0.smithi052.stdout:8/502: mknod d0/d4/d5/d27/d69/ca5 0 2024-04-26T12:06:57.175 INFO:tasks.workunit.client.0.smithi052.stdout:2/580: dread d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/fbc [0,4194304] 0 2024-04-26T12:06:57.175 INFO:tasks.workunit.client.0.smithi052.stdout:4/529: mkdir d3/d2b/dab/db6/db7 0 2024-04-26T12:06:57.176 INFO:tasks.workunit.client.0.smithi052.stdout:5/555: truncate db/dc/d5f/f2f 172535 0 2024-04-26T12:06:57.176 INFO:tasks.workunit.client.0.smithi052.stdout:3/509: write d2/d4/dc/d1d/f60 [6658660,14733] 0 2024-04-26T12:06:57.177 INFO:tasks.workunit.client.0.smithi052.stdout:0/578: truncate d0/d1/f12 516273 0 2024-04-26T12:06:57.177 INFO:tasks.workunit.client.0.smithi052.stdout:2/581: fsync d0/d36/f7e 0 2024-04-26T12:06:57.178 INFO:tasks.workunit.client.0.smithi052.stdout:8/503: write d0/d4/d5/d27/f4c [1026782,112571] 0 2024-04-26T12:06:57.179 INFO:tasks.workunit.client.0.smithi052.stdout:4/530: mkdir d3/d44/d4b/db8 0 2024-04-26T12:06:57.179 INFO:tasks.workunit.client.0.smithi052.stdout:5/556: fdatasync db/dc/d5f/d50/d46/d74/f8e 0 2024-04-26T12:06:57.179 INFO:tasks.workunit.client.0.smithi052.stdout:0/579: write d0/d3d/f3f [11083529,37452] 0 2024-04-26T12:06:57.179 INFO:tasks.workunit.client.0.smithi052.stdout:6/571: dwrite da/d63/f78 [0,4194304] 0 2024-04-26T12:06:57.180 INFO:tasks.workunit.client.0.smithi052.stdout:4/531: fsync d3/d2b/f7d 0 2024-04-26T12:06:57.182 INFO:tasks.workunit.client.0.smithi052.stdout:2/582: creat d0/d3f/d56/d8d/d99/db9/fc4 x:0 0 0 2024-04-26T12:06:57.182 INFO:tasks.workunit.client.0.smithi052.stdout:9/589: dwrite d3/db/d13/f79 [0,4194304] 0 2024-04-26T12:06:57.184 INFO:tasks.workunit.client.0.smithi052.stdout:5/557: write db/dd/d18/d60/f83 [562832,97308] 0 2024-04-26T12:06:57.184 INFO:tasks.workunit.client.0.smithi052.stdout:0/580: mkdir d0/d1/d2c/d42/da5/dba/dbb 0 2024-04-26T12:06:57.185 INFO:tasks.workunit.client.0.smithi052.stdout:4/532: symlink d3/d2b/dab/db6/db7/lb9 0 2024-04-26T12:06:57.185 INFO:tasks.workunit.client.0.smithi052.stdout:2/583: mknod d0/d3f/d56/cc5 0 2024-04-26T12:06:57.185 INFO:tasks.workunit.client.0.smithi052.stdout:4/533: chown d3/d2b/dab/db6 1484461 1 2024-04-26T12:06:57.186 INFO:tasks.workunit.client.0.smithi052.stdout:0/581: creat d0/d1/d1a/d20/d47/d84/fbc x:0 0 0 2024-04-26T12:06:57.187 INFO:tasks.workunit.client.0.smithi052.stdout:8/504: dwrite d0/f59 [0,4194304] 0 2024-04-26T12:06:57.188 INFO:tasks.workunit.client.0.smithi052.stdout:4/534: mkdir d3/d12/d34/d91/dba 0 2024-04-26T12:06:57.188 INFO:tasks.workunit.client.0.smithi052.stdout:9/590: chown d3/db/d10/d3c/d40/d96/db5/d8f/l2a 30658 1 2024-04-26T12:06:57.188 INFO:tasks.workunit.client.0.smithi052.stdout:0/582: rmdir d0/d3c 39 2024-04-26T12:06:57.189 INFO:tasks.workunit.client.0.smithi052.stdout:1/538: dread d0/d2/dd/f32 [0,4194304] 0 2024-04-26T12:06:57.190 INFO:tasks.workunit.client.0.smithi052.stdout:4/535: chown d3/d12/c7e 53669 1 2024-04-26T12:06:57.190 INFO:tasks.workunit.client.0.smithi052.stdout:9/591: fsync d3/db/d4a/f4d 0 2024-04-26T12:06:57.191 INFO:tasks.workunit.client.0.smithi052.stdout:3/510: truncate d2/d4/d2a/d2d/f2e 2828304 0 2024-04-26T12:06:57.194 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:57.192+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:57.195 INFO:tasks.workunit.client.0.smithi052.stdout:1/539: rmdir d0/d2/dd/d1c/d3c/d9b 39 2024-04-26T12:06:57.195 INFO:tasks.workunit.client.0.smithi052.stdout:7/572: dread d1/d1f/f60 [0,4194304] 0 2024-04-26T12:06:57.195 INFO:tasks.workunit.client.0.smithi052.stdout:5/558: dwrite db/dd/d34/d69/d8a/f8b [0,4194304] 0 2024-04-26T12:06:57.195 INFO:tasks.workunit.client.0.smithi052.stdout:3/511: mkdir d2/d4/d2a/d96 0 2024-04-26T12:06:57.195 INFO:tasks.workunit.client.0.smithi052.stdout:2/584: dwrite d0/d7/d16/d3a/f8a [0,4194304] 0 2024-04-26T12:06:57.196 INFO:tasks.workunit.client.0.smithi052.stdout:3/512: chown d2/d4/dc/d33/d75 6371728 1 2024-04-26T12:06:57.197 INFO:tasks.workunit.client.0.smithi052.stdout:5/559: creat db/d5c/fbc x:0 0 0 2024-04-26T12:06:57.198 INFO:tasks.workunit.client.0.smithi052.stdout:0/583: dwrite d0/d1/f41 [0,4194304] 0 2024-04-26T12:06:57.199 INFO:tasks.workunit.client.0.smithi052.stdout:2/585: symlink d0/d3f/d56/d6d/d5a/d82/d91/lc6 0 2024-04-26T12:06:57.201 INFO:tasks.workunit.client.0.smithi052.stdout:0/584: getdents d0/d3d 0 2024-04-26T12:06:57.201 INFO:tasks.workunit.client.0.smithi052.stdout:3/513: write d2/d4/dc/d1d/d25/d36/d1c/f4a [4185486,112948] 0 2024-04-26T12:06:57.201 INFO:tasks.workunit.client.0.smithi052.stdout:8/505: dwrite d0/d4/d5/d27/d57/f88 [0,4194304] 0 2024-04-26T12:06:57.203 INFO:tasks.workunit.client.0.smithi052.stdout:0/585: chown d0/d1/dd 9723561 1 2024-04-26T12:06:57.204 INFO:tasks.workunit.client.0.smithi052.stdout:3/514: symlink d2/d4/d81/l97 0 2024-04-26T12:06:57.206 INFO:tasks.workunit.client.0.smithi052.stdout:7/573: dwrite d1/dab/d4c/f4f [0,4194304] 0 2024-04-26T12:06:57.207 INFO:tasks.workunit.client.0.smithi052.stdout:3/515: chown d2/d4/dc/d33/c91 8 1 2024-04-26T12:06:57.208 INFO:tasks.workunit.client.0.smithi052.stdout:3/516: chown d2 14 1 2024-04-26T12:06:57.208 INFO:tasks.workunit.client.0.smithi052.stdout:5/560: dwrite db/dd/d34/d69/d8a/da9/d87/fa7 [0,4194304] 0 2024-04-26T12:06:57.208 INFO:tasks.workunit.client.0.smithi052.stdout:2/586: dwrite d0/fa [4194304,4194304] 0 2024-04-26T12:06:57.208 INFO:tasks.workunit.client.0.smithi052.stdout:7/574: mknod d1/dab/cba 0 2024-04-26T12:06:57.208 INFO:tasks.workunit.client.0.smithi052.stdout:7/575: chown d1/f20 2066550 1 2024-04-26T12:06:57.209 INFO:tasks.workunit.client.0.smithi052.stdout:3/517: fsync d2/d4/d6b/d7b/f7d 0 2024-04-26T12:06:57.210 INFO:tasks.workunit.client.0.smithi052.stdout:7/576: readlink d1/d1c/d21/d2f/d33/d3a/d64/la3 0 2024-04-26T12:06:57.210 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:57.210 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:57.211 INFO:tasks.workunit.client.0.smithi052.stdout:7/577: chown d1/d1c/d21/d2f/f80 102 1 2024-04-26T12:06:57.211 INFO:tasks.workunit.client.0.smithi052.stdout:7/578: symlink d1/d1c/d21/d2f/d33/lbb 0 2024-04-26T12:06:57.213 INFO:tasks.workunit.client.0.smithi052.stdout:7/579: rmdir d1/d1c/d21/d2f/d68 39 2024-04-26T12:06:57.214 INFO:tasks.workunit.client.0.smithi052.stdout:7/580: getdents d1/dab/d4c/d4d 0 2024-04-26T12:06:57.217 INFO:tasks.workunit.client.0.smithi052.stdout:3/518: truncate d2/d4/dc/d33/d37/f3a 5581382 0 2024-04-26T12:06:57.218 INFO:tasks.workunit.client.0.smithi052.stdout:7/581: dwrite d1/d1c/d21/f53 [0,4194304] 0 2024-04-26T12:06:57.222 INFO:tasks.workunit.client.0.smithi052.stdout:9/592: dread d3/d23/f88 [0,4194304] 0 2024-04-26T12:06:57.223 INFO:tasks.workunit.client.0.smithi052.stdout:9/593: symlink d3/lcb 0 2024-04-26T12:06:57.223 INFO:tasks.workunit.client.0.smithi052.stdout:7/582: dwrite d1/d1f/f22 [0,4194304] 0 2024-04-26T12:06:57.224 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:57.230 INFO:tasks.workunit.client.0.smithi052.stdout:7/583: dwrite d1/d1c/d23/f2c [0,4194304] 0 2024-04-26T12:06:57.230 INFO:tasks.workunit.client.0.smithi052.stdout:2/587: dread d0/d7/d2f/fb2 [0,4194304] 0 2024-04-26T12:06:57.232 INFO:tasks.workunit.client.0.smithi052.stdout:1/540: dread d0/d2/dd/d1c/d1d/d91/f8a [0,4194304] 0 2024-04-26T12:06:57.232 INFO:tasks.workunit.client.0.smithi052.stdout:6/572: dread da/d22/d29/d31/f7f [0,4194304] 0 2024-04-26T12:06:57.232 INFO:tasks.workunit.client.0.smithi052.stdout:5/561: dread db/f1f [4194304,4194304] 0 2024-04-26T12:06:57.232 INFO:tasks.workunit.client.0.smithi052.stdout:2/588: creat d0/d3f/d56/d6d/d5a/d73/fc7 x:0 0 0 2024-04-26T12:06:57.232 INFO:tasks.workunit.client.0.smithi052.stdout:7/584: getdents d1/d1c/d21/db6 0 2024-04-26T12:06:57.234 INFO:tasks.workunit.client.0.smithi052.stdout:5/562: creat db/dd/d34/d69/d8a/da9/d87/d6e/fbd x:0 0 0 2024-04-26T12:06:57.236 INFO:tasks.workunit.client.0.smithi052.stdout:5/563: mkdir db/dc/d5f/d50/d46/d74/dbe 0 2024-04-26T12:06:57.238 INFO:tasks.workunit.client.0.smithi052.stdout:1/541: dwrite d0/d2/f2a [0,4194304] 0 2024-04-26T12:06:57.238 INFO:tasks.workunit.client.0.smithi052.stdout:5/564: mknod db/dd/cbf 0 2024-04-26T12:06:57.238 INFO:tasks.workunit.client.0.smithi052.stdout:4/536: dread d3/d44/d4b/f75 [0,4194304] 0 2024-04-26T12:06:57.238 INFO:tasks.workunit.client.0.smithi052.stdout:1/542: chown d0/d2/dd/d40/c7d 474 1 2024-04-26T12:06:57.239 INFO:tasks.workunit.client.0.smithi052.stdout:5/565: write db/dd/d34/d69/d93/fbb [4311631,15984] 0 2024-04-26T12:06:57.240 INFO:tasks.workunit.client.0.smithi052.stdout:4/537: getdents d3/d2e 0 2024-04-26T12:06:57.240 INFO:tasks.workunit.client.0.smithi052.stdout:1/543: write d0/d83/d4b/d56/f5d [123214,27653] 0 2024-04-26T12:06:57.240 INFO:tasks.workunit.client.0.smithi052.stdout:5/566: chown db/dc/d5f/d50/c44 2039462538 1 2024-04-26T12:06:57.241 INFO:tasks.workunit.client.0.smithi052.stdout:2/589: sync 2024-04-26T12:06:57.241 INFO:tasks.workunit.client.0.smithi052.stdout:5/567: fsync db/f38 0 2024-04-26T12:06:57.243 INFO:tasks.workunit.client.0.smithi052.stdout:2/590: creat d0/d3f/d56/d8d/d99/fc8 x:0 0 0 2024-04-26T12:06:57.244 INFO:tasks.workunit.client.0.smithi052.stdout:5/568: truncate db/dd/d34/d69/d93/fb6 461705 0 2024-04-26T12:06:57.244 INFO:tasks.workunit.client.0.smithi052.stdout:2/591: creat d0/d7/d2f/d8c/fc9 x:0 0 0 2024-04-26T12:06:57.245 INFO:tasks.workunit.client.0.smithi052.stdout:5/569: unlink db/dd/d18/f71 0 2024-04-26T12:06:57.247 INFO:tasks.workunit.client.0.smithi052.stdout:5/570: unlink db/dd/d18/f6f 0 2024-04-26T12:06:57.248 INFO:tasks.workunit.client.0.smithi052.stdout:1/544: dwrite d0/d83/d4b/d56/f6d [0,4194304] 0 2024-04-26T12:06:57.249 INFO:tasks.workunit.client.0.smithi052.stdout:2/592: dread d0/f21 [0,4194304] 0 2024-04-26T12:06:57.250 INFO:tasks.workunit.client.0.smithi052.stdout:1/545: write d0/d2/dd/d40/d81/d52/f72 [1404084,6093] 0 2024-04-26T12:06:57.250 INFO:tasks.workunit.client.0.smithi052.stdout:5/571: truncate db/dd/d34/d69/d8a/da9/d87/fba 847793 0 2024-04-26T12:06:57.251 INFO:tasks.workunit.client.0.smithi052.stdout:4/538: dread d3/d22/d30/d71/f81 [0,4194304] 0 2024-04-26T12:06:57.251 INFO:tasks.workunit.client.0.smithi052.stdout:5/572: creat db/dd/d34/d70/fc0 x:0 0 0 2024-04-26T12:06:57.251 INFO:tasks.workunit.client.0.smithi052.stdout:1/546: chown d0/d83/c86 1379 1 2024-04-26T12:06:57.252 INFO:tasks.workunit.client.0.smithi052.stdout:1/547: fdatasync d0/d2/dd/f6e 0 2024-04-26T12:06:57.252 INFO:tasks.workunit.client.0.smithi052.stdout:3/519: dread d2/d4/d41/d59/f71 [0,4194304] 0 2024-04-26T12:06:57.253 INFO:tasks.workunit.client.0.smithi052.stdout:4/539: symlink d3/d12/d34/d43/da1/lbb 0 2024-04-26T12:06:57.253 INFO:tasks.workunit.client.0.smithi052.stdout:5/573: stat db/dd/d34/d69/d8a/da9/d87/d6e/db8 0 2024-04-26T12:06:57.253 INFO:tasks.workunit.client.0.smithi052.stdout:0/586: dread d0/d1/d1a/d20/f6e [0,4194304] 0 2024-04-26T12:06:57.255 INFO:tasks.workunit.client.0.smithi052.stdout:3/520: rename d2/d4/dc/d1d/d25/d61/f63 to d2/d4/d41/d59/f98 0 2024-04-26T12:06:57.255 INFO:tasks.workunit.client.0.smithi052.stdout:8/506: dread d0/d4/d5/db/f96 [0,4194304] 0 2024-04-26T12:06:57.256 INFO:tasks.workunit.client.0.smithi052.stdout:0/587: getdents d0/d5b/d9d 0 2024-04-26T12:06:57.257 INFO:tasks.workunit.client.0.smithi052.stdout:5/574: rename db/dd/d34/d70/d59/f95 to db/dc/d5f/d50/d46/d74/fc1 0 2024-04-26T12:06:57.258 INFO:tasks.workunit.client.0.smithi052.stdout:9/594: dread d3/d23/d7f/fad [0,4194304] 0 2024-04-26T12:06:57.259 INFO:tasks.workunit.client.0.smithi052.stdout:9/595: chown d3 498996056 1 2024-04-26T12:06:57.260 INFO:tasks.workunit.client.0.smithi052.stdout:6/573: dread da/d22/d3c/f66 [0,4194304] 0 2024-04-26T12:06:57.261 INFO:tasks.workunit.client.0.smithi052.stdout:3/521: rmdir d2/d4/dc/d1d/d25/d61 39 2024-04-26T12:06:57.261 INFO:tasks.workunit.client.0.smithi052.stdout:4/540: dwrite d3/d15/d76/fb2 [0,4194304] 0 2024-04-26T12:06:57.261 INFO:tasks.workunit.client.0.smithi052.stdout:4/541: sync 2024-04-26T12:06:57.261 INFO:tasks.workunit.client.0.smithi052.stdout:9/596: mknod d3/db/d10/d3c/d40/d96/ccc 0 2024-04-26T12:06:57.262 INFO:tasks.workunit.client.0.smithi052.stdout:6/574: dread - da/d22/d29/d31/fa6 zero size 2024-04-26T12:06:57.262 INFO:tasks.workunit.client.0.smithi052.stdout:4/542: readlink d3/d15/l8e 0 2024-04-26T12:06:57.263 INFO:tasks.workunit.client.0.smithi052.stdout:8/507: dread d0/f59 [0,4194304] 0 2024-04-26T12:06:57.263 INFO:tasks.workunit.client.0.smithi052.stdout:9/597: mknod d3/d23/d7f/ccd 0 2024-04-26T12:06:57.264 INFO:tasks.workunit.client.0.smithi052.stdout:8/508: chown d0/d4/dc/d68/f6e 221831794 1 2024-04-26T12:06:57.265 INFO:tasks.workunit.client.0.smithi052.stdout:6/575: chown da/d22/d3c/d74/d99/d92/d96/f9e 121967 1 2024-04-26T12:06:57.265 INFO:tasks.workunit.client.0.smithi052.stdout:9/598: creat d3/db/d2b/fce x:0 0 0 2024-04-26T12:06:57.265 INFO:tasks.workunit.client.0.smithi052.stdout:4/543: truncate d3/d22/d69/f7c 831277 0 2024-04-26T12:06:57.266 INFO:tasks.workunit.client.0.smithi052.stdout:8/509: read - d0/f66 zero size 2024-04-26T12:06:57.267 INFO:tasks.workunit.client.0.smithi052.stdout:5/575: dwrite db/dd/d34/f82 [0,4194304] 0 2024-04-26T12:06:57.267 INFO:tasks.workunit.client.0.smithi052.stdout:5/576: sync 2024-04-26T12:06:57.267 INFO:tasks.workunit.client.0.smithi052.stdout:7/585: dread d1/d1c/d21/d2f/f4e [0,4194304] 0 2024-04-26T12:06:57.267 INFO:tasks.workunit.client.0.smithi052.stdout:6/576: creat da/da2/fca x:0 0 0 2024-04-26T12:06:57.268 INFO:tasks.workunit.client.0.smithi052.stdout:9/599: chown d3/db/d10/d54/f97 159384835 1 2024-04-26T12:06:57.268 INFO:tasks.workunit.client.0.smithi052.stdout:8/510: creat d0/d4/dc/d68/fa6 x:0 0 0 2024-04-26T12:06:57.269 INFO:tasks.workunit.client.0.smithi052.stdout:6/577: chown da/f1b 0 1 2024-04-26T12:06:57.270 INFO:tasks.workunit.client.0.smithi052.stdout:6/578: mknod da/d63/ccb 0 2024-04-26T12:06:57.270 INFO:tasks.workunit.client.0.smithi052.stdout:5/577: dread - db/dd/d34/d69/d8a/da9/d87/d6e/fbd zero size 2024-04-26T12:06:57.271 INFO:tasks.workunit.client.0.smithi052.stdout:8/511: getdents d0/d4/d5/db 0 2024-04-26T12:06:57.272 INFO:tasks.workunit.client.0.smithi052.stdout:3/522: dwrite d2/d4/dc/d1d/d25/d36/d1c/f3c [0,4194304] 0 2024-04-26T12:06:57.272 INFO:tasks.workunit.client.0.smithi052.stdout:8/512: sync 2024-04-26T12:06:57.272 INFO:tasks.workunit.client.0.smithi052.stdout:6/579: mkdir da/d22/d29/d31/d6f/dcc 0 2024-04-26T12:06:57.272 INFO:tasks.workunit.client.0.smithi052.stdout:3/523: chown d2/d4/d31/d6a 15302 1 2024-04-26T12:06:57.273 INFO:tasks.workunit.client.0.smithi052.stdout:9/600: link d3/d23/d7f/c50 d3/db/d10/d3c/d40/d96/db5/d8f/d49/ccf 0 2024-04-26T12:06:57.273 INFO:tasks.workunit.client.0.smithi052.stdout:7/586: truncate d1/d1f/d55/f82 400260 0 2024-04-26T12:06:57.273 INFO:tasks.workunit.client.0.smithi052.stdout:9/601: chown d3/f7 413016062 1 2024-04-26T12:06:57.274 INFO:tasks.workunit.client.0.smithi052.stdout:6/580: symlink da/d22/d29/d31/d39/dc7/lcd 0 2024-04-26T12:06:57.274 INFO:tasks.workunit.client.0.smithi052.stdout:3/524: mkdir d2/d4/d2a/d99 0 2024-04-26T12:06:57.274 INFO:tasks.workunit.client.0.smithi052.stdout:9/602: mkdir d3/d23/dd0 0 2024-04-26T12:06:57.275 INFO:tasks.workunit.client.0.smithi052.stdout:7/587: link d1/f18 d1/d1f/d55/fbc 0 2024-04-26T12:06:57.276 INFO:tasks.workunit.client.0.smithi052.stdout:9/603: chown d3/d3b/lae 15036 1 2024-04-26T12:06:57.276 INFO:tasks.workunit.client.0.smithi052.stdout:7/588: readlink d1/d1f/d55/lad 0 2024-04-26T12:06:57.276 INFO:tasks.workunit.client.0.smithi052.stdout:0/588: dread d0/f49 [0,4194304] 0 2024-04-26T12:06:57.278 INFO:tasks.workunit.client.0.smithi052.stdout:9/604: creat d3/db/d10/d3c/d40/d96/db5/d8f/d49/da4/fd1 x:0 0 0 2024-04-26T12:06:57.278 INFO:tasks.workunit.client.0.smithi052.stdout:7/589: rename d1/dab/d4c/d4d/f7e to d1/d1c/d23/d81/d88/fbd 0 2024-04-26T12:06:57.278 INFO:tasks.workunit.client.0.smithi052.stdout:8/513: dread d0/d4/f30 [0,4194304] 0 2024-04-26T12:06:57.279 INFO:tasks.workunit.client.0.smithi052.stdout:3/525: truncate d2/d4/f3e 3087335 0 2024-04-26T12:06:57.279 INFO:tasks.workunit.client.0.smithi052.stdout:5/578: dread db/dd/d18/f6c [0,4194304] 0 2024-04-26T12:06:57.279 INFO:tasks.workunit.client.0.smithi052.stdout:1/548: dread d0/d2/dd/d1c/d1d/f50 [0,4194304] 0 2024-04-26T12:06:57.281 INFO:tasks.workunit.client.0.smithi052.stdout:7/590: symlink d1/d1c/d23/d81/d88/lbe 0 2024-04-26T12:06:57.281 INFO:tasks.workunit.client.0.smithi052.stdout:1/549: dread - d0/d83/f5f zero size 2024-04-26T12:06:57.281 INFO:tasks.workunit.client.0.smithi052.stdout:9/605: link d3/d23/f88 d3/d3b/fd2 0 2024-04-26T12:06:57.282 INFO:tasks.workunit.client.0.smithi052.stdout:5/579: write db/dc/f12 [2075600,10196] 0 2024-04-26T12:06:57.282 INFO:tasks.workunit.client.0.smithi052.stdout:3/526: creat d2/d4/dc/d1d/d25/d36/f9a x:0 0 0 2024-04-26T12:06:57.285 INFO:tasks.workunit.client.0.smithi052.stdout:1/550: read - d0/d2/dd/d34/d95/fb3 zero size 2024-04-26T12:06:57.285 INFO:tasks.workunit.client.0.smithi052.stdout:7/591: rmdir d1/d1c/d21/d2f/d68 39 2024-04-26T12:06:57.285 INFO:tasks.workunit.client.0.smithi052.stdout:8/514: link d0/d3e/l50 d0/d4/d5/db/d20/d41/la7 0 2024-04-26T12:06:57.285 INFO:tasks.workunit.client.0.smithi052.stdout:9/606: dread - d3/db/d10/d3c/d40/d96/db5/f8b zero size 2024-04-26T12:06:57.285 INFO:tasks.workunit.client.0.smithi052.stdout:0/589: dwrite d0/d1/d1a/d20/fa0 [0,4194304] 0 2024-04-26T12:06:57.285 INFO:tasks.workunit.client.0.smithi052.stdout:3/527: creat d2/d4/dc/d33/d8a/f9b x:0 0 0 2024-04-26T12:06:57.285 INFO:tasks.workunit.client.0.smithi052.stdout:1/551: mkdir d0/da/db5 0 2024-04-26T12:06:57.286 INFO:tasks.workunit.client.0.smithi052.stdout:8/515: dread - d0/d4/d5/db/d20/f7f zero size 2024-04-26T12:06:57.286 INFO:tasks.workunit.client.0.smithi052.stdout:7/592: creat d1/d1c/d65/fbf x:0 0 0 2024-04-26T12:06:57.286 INFO:tasks.workunit.client.0.smithi052.stdout:5/580: rename db/dc/d5f/d50/l5e to db/dd/d34/d70/d59/lc2 0 2024-04-26T12:06:57.286 INFO:tasks.workunit.client.0.smithi052.stdout:0/590: unlink d0/d5b/d9d/d32/fb9 0 2024-04-26T12:06:57.286 INFO:tasks.workunit.client.0.smithi052.stdout:8/516: write d0/d4/f17 [2327719,43451] 0 2024-04-26T12:06:57.287 INFO:tasks.workunit.client.0.smithi052.stdout:1/552: chown d0/da/f2f 5889 1 2024-04-26T12:06:57.287 INFO:tasks.workunit.client.0.smithi052.stdout:7/593: write d1/dab/d4c/d4d/f79 [2987138,118529] 0 2024-04-26T12:06:57.288 INFO:tasks.workunit.client.0.smithi052.stdout:5/581: chown db/dd/d34/d70/d59 6659 1 2024-04-26T12:06:57.288 INFO:tasks.workunit.client.0.smithi052.stdout:8/517: fsync d0/d3e/fa0 0 2024-04-26T12:06:57.288 INFO:tasks.workunit.client.0.smithi052.stdout:0/591: chown d0/d1/d52/f6b 1009 1 2024-04-26T12:06:57.288 INFO:tasks.workunit.client.0.smithi052.stdout:7/594: fsync d1/d1f/f22 0 2024-04-26T12:06:57.289 INFO:tasks.workunit.client.0.smithi052.stdout:1/553: write d0/d2/dd/d34/f66 [1735593,10129] 0 2024-04-26T12:06:57.290 INFO:tasks.workunit.client.0.smithi052.stdout:3/528: link d2/d4/d2a/d2d/f78 d2/d4/d41/f9c 0 2024-04-26T12:06:57.290 INFO:tasks.workunit.client.0.smithi052.stdout:0/592: fsync d0/d1/d52/fae 0 2024-04-26T12:06:57.290 INFO:tasks.workunit.client.0.smithi052.stdout:5/582: mknod db/dd/d34/d69/d93/cc3 0 2024-04-26T12:06:57.290 INFO:tasks.workunit.client.0.smithi052.stdout:1/554: mknod d0/d2/cb6 0 2024-04-26T12:06:57.291 INFO:tasks.workunit.client.0.smithi052.stdout:3/529: mknod d2/d4/dc/d68/c9d 0 2024-04-26T12:06:57.291 INFO:tasks.workunit.client.0.smithi052.stdout:5/583: unlink db/dd/d34/d70/l31 0 2024-04-26T12:06:57.292 INFO:tasks.workunit.client.0.smithi052.stdout:1/555: write d0/d2/dd/d40/d81/d52/f8d [262589,3139] 0 2024-04-26T12:06:57.293 INFO:tasks.workunit.client.0.smithi052.stdout:5/584: unlink db/dd/d34/d70/d78/f94 0 2024-04-26T12:06:57.294 INFO:tasks.workunit.client.0.smithi052.stdout:5/585: dread - db/dc/d5f/fa2 zero size 2024-04-26T12:06:57.294 INFO:tasks.workunit.client.0.smithi052.stdout:1/556: symlink d0/d1e/lb7 0 2024-04-26T12:06:57.294 INFO:tasks.workunit.client.0.smithi052.stdout:2/593: dread d0/f12 [4194304,4194304] 0 2024-04-26T12:06:57.295 INFO:tasks.workunit.client.0.smithi052.stdout:0/593: dread d0/f49 [0,4194304] 0 2024-04-26T12:06:57.295 INFO:tasks.workunit.client.0.smithi052.stdout:5/586: write db/dd/d18/d60/f83 [945718,28332] 0 2024-04-26T12:06:57.295 INFO:tasks.workunit.client.0.smithi052.stdout:1/557: creat d0/d2/dd/d40/d81/d9a/fb8 x:0 0 0 2024-04-26T12:06:57.296 INFO:tasks.workunit.client.0.smithi052.stdout:0/594: symlink d0/d5a/lbd 0 2024-04-26T12:06:57.297 INFO:tasks.workunit.client.0.smithi052.stdout:1/558: rmdir d0/d83/d4b/d56 39 2024-04-26T12:06:57.297 INFO:tasks.workunit.client.0.smithi052.stdout:4/544: dread d3/d12/f1a [0,4194304] 0 2024-04-26T12:06:57.297 INFO:tasks.workunit.client.0.smithi052.stdout:4/545: chown d3/d2b/d40 0 1 2024-04-26T12:06:57.299 INFO:tasks.workunit.client.0.smithi052.stdout:2/594: read d0/d7/d2f/d9b/f6b [3972968,69275] 0 2024-04-26T12:06:57.299 INFO:tasks.workunit.client.0.smithi052.stdout:4/546: creat d3/d2b/dab/db6/fbc x:0 0 0 2024-04-26T12:06:57.300 INFO:tasks.workunit.client.0.smithi052.stdout:5/587: dread db/dc/d5f/f8f [0,4194304] 0 2024-04-26T12:06:57.301 INFO:tasks.workunit.client.0.smithi052.stdout:6/581: dread da/f13 [0,4194304] 0 2024-04-26T12:06:57.301 INFO:tasks.workunit.client.0.smithi052.stdout:4/547: chown d3/d12/d64/f79 217768002 1 2024-04-26T12:06:57.304 INFO:tasks.workunit.client.0.smithi052.stdout:0/595: dwrite d0/d1/d54/fb2 [0,4194304] 0 2024-04-26T12:06:57.304 INFO:tasks.workunit.client.0.smithi052.stdout:4/548: creat d3/d1f/fbd x:0 0 0 2024-04-26T12:06:57.304 INFO:tasks.workunit.client.0.smithi052.stdout:5/588: creat db/dd/d18/d60/d64/d9c/da0/fc4 x:0 0 0 2024-04-26T12:06:57.304 INFO:tasks.workunit.client.0.smithi052.stdout:6/582: creat da/d22/d3c/d74/d99/d95/fce x:0 0 0 2024-04-26T12:06:57.305 INFO:tasks.workunit.client.0.smithi052.stdout:0/596: readlink d0/d5a/lbd 0 2024-04-26T12:06:57.306 INFO:tasks.workunit.client.0.smithi052.stdout:4/549: mkdir d3/d1f/d21/dbe 0 2024-04-26T12:06:57.306 INFO:tasks.workunit.client.0.smithi052.stdout:6/583: mkdir da/d22/d3c/d74/dcf 0 2024-04-26T12:06:57.306 INFO:tasks.workunit.client.0.smithi052.stdout:1/559: dwrite d0/d2/dd/d1c/d1d/d91/f94 [0,4194304] 0 2024-04-26T12:06:57.306 INFO:tasks.workunit.client.0.smithi052.stdout:5/589: mkdir db/dd/d34/d69/d8a/dc5 0 2024-04-26T12:06:57.307 INFO:tasks.workunit.client.0.smithi052.stdout:0/597: mkdir d0/d26/dbe 0 2024-04-26T12:06:57.307 INFO:tasks.workunit.client.0.smithi052.stdout:4/550: dread - d3/d22/d30/d71/f97 zero size 2024-04-26T12:06:57.307 INFO:tasks.workunit.client.0.smithi052.stdout:2/595: dwrite d0/d7/f83 [0,4194304] 0 2024-04-26T12:06:57.308 INFO:tasks.workunit.client.0.smithi052.stdout:1/560: unlink d0/d2/dd/d40/l92 0 2024-04-26T12:06:57.309 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:57.308+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:57.309 INFO:tasks.workunit.client.0.smithi052.stdout:6/584: mknod da/d22/d3c/d74/d99/d7c/d94/cd0 0 2024-04-26T12:06:57.310 INFO:tasks.workunit.client.0.smithi052.stdout:5/590: unlink db/dd/d34/l4e 0 2024-04-26T12:06:57.310 INFO:tasks.workunit.client.0.smithi052.stdout:4/551: chown d3/d12/c49 51 1 2024-04-26T12:06:57.311 INFO:tasks.workunit.client.0.smithi052.stdout:2/596: mknod d0/d3f/d56/d6d/d5a/d73/d4b/cca 0 2024-04-26T12:06:57.311 INFO:tasks.workunit.client.0.smithi052.stdout:0/598: rename d0/d1/d1a/d20/fa0 to d0/d1/d2c/d42/fbf 0 2024-04-26T12:06:57.311 INFO:tasks.workunit.client.0.smithi052.stdout:6/585: dread - da/d22/d97/fb6 zero size 2024-04-26T12:06:57.312 INFO:tasks.workunit.client.0.smithi052.stdout:5/591: chown db/dc/d5f/f36 3920087 1 2024-04-26T12:06:57.312 INFO:tasks.workunit.client.0.smithi052.stdout:1/561: creat d0/d2/dd/d40/dac/fb9 x:0 0 0 2024-04-26T12:06:57.312 INFO:tasks.workunit.client.0.smithi052.stdout:6/586: write da/f1c [6561015,124288] 0 2024-04-26T12:06:57.313 INFO:tasks.workunit.client.0.smithi052.stdout:1/562: dread - d0/d83/f5f zero size 2024-04-26T12:06:57.313 INFO:tasks.workunit.client.0.smithi052.stdout:3/530: dwrite d2/d4/dc/f6f [0,4194304] 0 2024-04-26T12:06:57.314 INFO:tasks.workunit.client.0.smithi052.stdout:2/597: truncate d0/d3f/d56/d6d/fa0 344696 0 2024-04-26T12:06:57.316 INFO:tasks.workunit.client.0.smithi052.stdout:6/587: rename da/f37 to da/d5d/fd1 0 2024-04-26T12:06:57.316 INFO:tasks.workunit.client.0.smithi052.stdout:3/531: dread - d2/d4/d6b/d7b/f90 zero size 2024-04-26T12:06:57.317 INFO:tasks.workunit.client.0.smithi052.stdout:6/588: write da/d51/f69 [607692,108324] 0 2024-04-26T12:06:57.318 INFO:tasks.workunit.client.0.smithi052.stdout:8/518: dread d0/d16/f1a [0,4194304] 0 2024-04-26T12:06:57.320 INFO:tasks.workunit.client.0.smithi052.stdout:5/592: dwrite db/dd/d34/d69/fb0 [0,4194304] 0 2024-04-26T12:06:57.320 INFO:tasks.workunit.client.0.smithi052.stdout:6/589: rename da/d22/d3c/d74/d99/d95/dac to da/d22/d3c/d74/d99/d95/dd2 0 2024-04-26T12:06:57.321 INFO:tasks.workunit.client.0.smithi052.stdout:6/590: rmdir da/d22/d29/d31 39 2024-04-26T12:06:57.322 INFO:tasks.workunit.client.0.smithi052.stdout:5/593: unlink db/dd/d34/d69/faa 0 2024-04-26T12:06:57.322 INFO:tasks.workunit.client.0.smithi052.stdout:5/594: fsync db/dc/d5f/d50/d91/fa8 0 2024-04-26T12:06:57.323 INFO:tasks.workunit.client.0.smithi052.stdout:6/591: mkdir da/d22/d3c/dd3 0 2024-04-26T12:06:57.323 INFO:tasks.workunit.client.0.smithi052.stdout:5/595: fsync db/f1f 0 2024-04-26T12:06:57.324 INFO:tasks.workunit.client.0.smithi052.stdout:8/519: dwrite d0/d16/d28/f7d [0,4194304] 0 2024-04-26T12:06:57.324 INFO:tasks.workunit.client.0.smithi052.stdout:6/592: mkdir da/d22/d29/dd4 0 2024-04-26T12:06:57.325 INFO:tasks.workunit.client.0.smithi052.stdout:6/593: readlink da/d22/d29/l2b 0 2024-04-26T12:06:57.325 INFO:tasks.workunit.client.0.smithi052.stdout:8/520: creat d0/d4/dc/d45/d75/fa8 x:0 0 0 2024-04-26T12:06:57.325 INFO:tasks.workunit.client.0.smithi052.stdout:1/563: truncate d0/d2/f6 2908958 0 2024-04-26T12:06:57.325 INFO:tasks.workunit.client.0.smithi052.stdout:2/598: truncate d0/d7/d2f/d8c/fb7 4142771 0 2024-04-26T12:06:57.326 INFO:tasks.workunit.client.0.smithi052.stdout:5/596: getdents db/dd/d18/d60/d64 0 2024-04-26T12:06:57.326 INFO:tasks.workunit.client.0.smithi052.stdout:3/532: write d2/d4/dc/d1d/d25/f2b [1584503,105768] 0 2024-04-26T12:06:57.327 INFO:tasks.workunit.client.0.smithi052.stdout:6/594: write da/d22/d3c/d74/d99/f70 [4199516,19213] 0 2024-04-26T12:06:57.327 INFO:tasks.workunit.client.0.smithi052.stdout:8/521: creat d0/d4/d1c/fa9 x:0 0 0 2024-04-26T12:06:57.327 INFO:tasks.workunit.client.0.smithi052.stdout:1/564: write d0/d2/dd/d34/f4e [3624677,3036] 0 2024-04-26T12:06:57.327 INFO:tasks.workunit.client.0.smithi052.stdout:5/597: fsync db/dd/d34/d69/fa6 0 2024-04-26T12:06:57.328 INFO:tasks.workunit.client.0.smithi052.stdout:7/595: dread d1/f15 [0,4194304] 0 2024-04-26T12:06:57.329 INFO:tasks.workunit.client.0.smithi052.stdout:8/522: symlink d0/d4/dc/d45/d75/laa 0 2024-04-26T12:06:57.330 INFO:tasks.workunit.client.0.smithi052.stdout:7/596: chown d1/d1c/c71 1129 1 2024-04-26T12:06:57.330 INFO:tasks.workunit.client.0.smithi052.stdout:1/565: mknod d0/d2/dd/d1c/cba 0 2024-04-26T12:06:57.334 INFO:tasks.workunit.client.0.smithi052.stdout:7/597: link d1/d1c/d23/d81/d88/ca6 d1/dab/d4c/d4d/cc0 0 2024-04-26T12:06:57.334 INFO:tasks.workunit.client.0.smithi052.stdout:3/533: dread d2/d4/d41/d59/f71 [0,4194304] 0 2024-04-26T12:06:57.335 INFO:tasks.workunit.client.0.smithi052.stdout:9/607: dread d3/db/d10/d3c/fa5 [0,4194304] 0 2024-04-26T12:06:57.335 INFO:tasks.workunit.client.0.smithi052.stdout:7/598: sync 2024-04-26T12:06:57.335 INFO:tasks.workunit.client.0.smithi052.stdout:5/598: dwrite db/dc/f12 [0,4194304] 0 2024-04-26T12:06:57.336 INFO:tasks.workunit.client.0.smithi052.stdout:0/599: dread d0/d1/d52/f6b [0,4194304] 0 2024-04-26T12:06:57.337 INFO:tasks.workunit.client.0.smithi052.stdout:3/534: chown d2/d4/dc/d68/c74 133182 1 2024-04-26T12:06:57.337 INFO:tasks.workunit.client.0.smithi052.stdout:7/599: symlink d1/d1c/d21/d2f/d33/lc1 0 2024-04-26T12:06:57.338 INFO:tasks.workunit.client.0.smithi052.stdout:8/523: dwrite d0/d3e/fa0 [0,4194304] 0 2024-04-26T12:06:57.338 INFO:tasks.workunit.client.0.smithi052.stdout:9/608: dread - d3/db/d10/d3c/d40/d96/db5/d8f/d49/fbf zero size 2024-04-26T12:06:57.338 INFO:tasks.workunit.client.0.smithi052.stdout:1/566: dread d0/d83/d4b/d56/f6d [0,4194304] 0 2024-04-26T12:06:57.339 INFO:tasks.workunit.client.0.smithi052.stdout:9/609: chown d3/db/fb6 44 1 2024-04-26T12:06:57.340 INFO:tasks.workunit.client.0.smithi052.stdout:5/599: symlink db/dc/d5f/d50/lc6 0 2024-04-26T12:06:57.340 INFO:tasks.workunit.client.0.smithi052.stdout:5/600: dread - db/dd/d34/d70/f6d zero size 2024-04-26T12:06:57.341 INFO:tasks.workunit.client.0.smithi052.stdout:3/535: rename d2/d4/dc/d1d/d25/f2b to d2/d4/d2a/d2d/d4d/f9e 0 2024-04-26T12:06:57.342 INFO:tasks.workunit.client.0.smithi052.stdout:1/567: creat d0/d2/dd/d1c/d1d/d91/fbb x:0 0 0 2024-04-26T12:06:57.342 INFO:tasks.workunit.client.0.smithi052.stdout:2/599: truncate d0/d7/d2f/d9b/f6b 4112180 0 2024-04-26T12:06:57.342 INFO:tasks.workunit.client.0.smithi052.stdout:9/610: symlink d3/d3b/db0/ld3 0 2024-04-26T12:06:57.343 INFO:tasks.workunit.client.0.smithi052.stdout:5/601: mknod db/dd/d34/d69/d8a/da9/d87/d6e/db8/cc7 0 2024-04-26T12:06:57.343 INFO:tasks.workunit.client.0.smithi052.stdout:3/536: mkdir d2/d4/dc/d1d/d3f/d9f 0 2024-04-26T12:06:57.343 INFO:tasks.workunit.client.0.smithi052.stdout:8/524: getdents d0/d4/dc/d45/d75 0 2024-04-26T12:06:57.343 INFO:tasks.workunit.client.0.smithi052.stdout:2/600: creat d0/d7/d2f/fcb x:0 0 0 2024-04-26T12:06:57.344 INFO:tasks.workunit.client.0.smithi052.stdout:9/611: mkdir d3/db/d2b/dd4 0 2024-04-26T12:06:57.344 INFO:tasks.workunit.client.0.smithi052.stdout:1/568: getdents d0/da/db5 0 2024-04-26T12:06:57.344 INFO:tasks.workunit.client.0.smithi052.stdout:8/525: chown d0/f59 133669669 1 2024-04-26T12:06:57.344 INFO:tasks.workunit.client.0.smithi052.stdout:5/602: creat db/dd/d34/d69/d8a/da9/fc8 x:0 0 0 2024-04-26T12:06:57.345 INFO:tasks.workunit.client.0.smithi052.stdout:9/612: write d3/db/d2b/f61 [3970868,27155] 0 2024-04-26T12:06:57.345 INFO:tasks.workunit.client.0.smithi052.stdout:1/569: mkdir d0/da/dbc 0 2024-04-26T12:06:57.345 INFO:tasks.workunit.client.0.smithi052.stdout:0/600: write d0/f7a [1549177,28053] 0 2024-04-26T12:06:57.345 INFO:tasks.workunit.client.0.smithi052.stdout:3/537: rename d2/d4/d31/f7f to d2/d4/dc/d33/fa0 0 2024-04-26T12:06:57.346 INFO:tasks.workunit.client.0.smithi052.stdout:8/526: creat d0/d4/dc/d45/fab x:0 0 0 2024-04-26T12:06:57.347 INFO:tasks.workunit.client.0.smithi052.stdout:1/570: chown d0/d2/dd/d1c/d1d/c8c 0 1 2024-04-26T12:06:57.347 INFO:tasks.workunit.client.0.smithi052.stdout:9/613: fdatasync d3/db/d10/d3c/d40/d96/db5/d8f/f6f 0 2024-04-26T12:06:57.348 INFO:tasks.workunit.client.0.smithi052.stdout:8/527: write d0/d3e/f42 [1449816,100178] 0 2024-04-26T12:06:57.348 INFO:tasks.workunit.client.0.smithi052.stdout:3/538: write d2/d4/dc/d1d/d25/f3b [3750519,73315] 0 2024-04-26T12:06:57.349 INFO:tasks.workunit.client.0.smithi052.stdout:7/600: dread d1/d1c/d21/d2f/f7d [0,4194304] 0 2024-04-26T12:06:57.349 INFO:tasks.workunit.client.0.smithi052.stdout:0/601: read d0/d1/f12 [470153,291] 0 2024-04-26T12:06:57.349 INFO:tasks.workunit.client.0.smithi052.stdout:2/601: write d0/d7/fe [320577,121836] 0 2024-04-26T12:06:57.350 INFO:tasks.workunit.client.0.smithi052.stdout:4/552: dread d3/d15/f17 [0,4194304] 0 2024-04-26T12:06:57.350 INFO:tasks.workunit.client.0.smithi052.stdout:7/601: fdatasync d1/d1c/d23/f25 0 2024-04-26T12:06:57.350 INFO:tasks.workunit.client.0.smithi052.stdout:3/539: dread - d2/d4/dc/f7a zero size 2024-04-26T12:06:57.350 INFO:tasks.workunit.client.0.smithi052.stdout:0/602: mknod d0/cc0 0 2024-04-26T12:06:57.351 INFO:tasks.workunit.client.0.smithi052.stdout:9/614: mknod d3/db/d10/d3c/d40/d96/db5/cd5 0 2024-04-26T12:06:57.351 INFO:tasks.workunit.client.0.smithi052.stdout:8/528: write d0/d4/d5/d27/f8e [862952,93276] 0 2024-04-26T12:06:57.351 INFO:tasks.workunit.client.0.smithi052.stdout:2/602: creat d0/d7/d16/fcc x:0 0 0 2024-04-26T12:06:57.352 INFO:tasks.workunit.client.0.smithi052.stdout:7/602: mknod d1/d1c/d23/d81/d88/cc2 0 2024-04-26T12:06:57.353 INFO:tasks.workunit.client.0.smithi052.stdout:9/615: symlink d3/d23/dd0/ld6 0 2024-04-26T12:06:57.354 INFO:tasks.workunit.client.0.smithi052.stdout:0/603: write d0/d26/d74/f7f [4519450,16628] 0 2024-04-26T12:06:57.354 INFO:tasks.workunit.client.0.smithi052.stdout:4/553: creat d3/d12/d34/d45/d67/d6c/fbf x:0 0 0 2024-04-26T12:06:57.354 INFO:tasks.workunit.client.0.smithi052.stdout:3/540: rename d2/d4/dc/d33/d37/f88 to d2/d4/d2a/d99/fa1 0 2024-04-26T12:06:57.354 INFO:tasks.workunit.client.0.smithi052.stdout:2/603: dread d0/d7/d16/f75 [0,4194304] 0 2024-04-26T12:06:57.354 INFO:tasks.workunit.client.0.smithi052.stdout:8/529: link d0/d16/f73 d0/d4/dc/d45/fac 0 2024-04-26T12:06:57.355 INFO:tasks.workunit.client.0.smithi052.stdout:0/604: write d0/d26/fb0 [148116,103505] 0 2024-04-26T12:06:57.355 INFO:tasks.workunit.client.0.smithi052.stdout:7/603: read d1/d1c/d23/d81/d88/fbd [3134976,93332] 0 2024-04-26T12:06:57.356 INFO:tasks.workunit.client.0.smithi052.stdout:4/554: rename d3/d22/d30/d71 to d3/d12/d59/d96/dc0 0 2024-04-26T12:06:57.356 INFO:tasks.workunit.client.0.smithi052.stdout:9/616: chown d3/db/d10/d3c/d40/d96/db5/d8f/cab 25838949 1 2024-04-26T12:06:57.356 INFO:tasks.workunit.client.0.smithi052.stdout:7/604: rmdir d1/dab 39 2024-04-26T12:06:57.357 INFO:tasks.workunit.client.0.smithi052.stdout:0/605: creat d0/d5b/d9d/fc1 x:0 0 0 2024-04-26T12:06:57.357 INFO:tasks.workunit.client.0.smithi052.stdout:1/571: truncate d0/d83/d4b/f8e 33474 0 2024-04-26T12:06:57.359 INFO:tasks.workunit.client.0.smithi052.stdout:7/605: unlink d1/d1c/d65/cb0 0 2024-04-26T12:06:57.360 INFO:tasks.workunit.client.0.smithi052.stdout:6/595: dread da/d5d/d64/d68/f86 [0,4194304] 0 2024-04-26T12:06:57.360 INFO:tasks.workunit.client.0.smithi052.stdout:4/555: rmdir d3/d12/d34/d91/dba 0 2024-04-26T12:06:57.362 INFO:tasks.workunit.client.0.smithi052.stdout:1/572: rename d0/da/dbc to d0/d2/d88/dbd 0 2024-04-26T12:06:57.362 INFO:tasks.workunit.client.0.smithi052.stdout:6/596: symlink da/d63/ld5 0 2024-04-26T12:06:57.363 INFO:tasks.workunit.client.0.smithi052.stdout:7/606: dread - d1/d1c/d23/d81/f8e zero size 2024-04-26T12:06:57.364 INFO:tasks.workunit.client.0.smithi052.stdout:8/530: dwrite d0/d4/dc/f72 [0,4194304] 0 2024-04-26T12:06:57.365 INFO:tasks.workunit.client.0.smithi052.stdout:1/573: readlink d0/d2/l84 0 2024-04-26T12:06:57.365 INFO:tasks.workunit.client.0.smithi052.stdout:3/541: dwrite d2/f29 [0,4194304] 0 2024-04-26T12:06:57.366 INFO:tasks.workunit.client.0.smithi052.stdout:5/603: dread db/dc/d5f/d50/d46/f4b [0,4194304] 0 2024-04-26T12:06:57.367 INFO:tasks.workunit.client.0.smithi052.stdout:9/617: rename d3/caf to d3/db/d10/d3c/d40/d96/db5/d8f/d49/da4/cd7 0 2024-04-26T12:06:57.367 INFO:tasks.workunit.client.0.smithi052.stdout:3/542: chown d2/d4/dc 13722379 1 2024-04-26T12:06:57.368 INFO:tasks.workunit.client.0.smithi052.stdout:3/543: stat d2/d4/f3e 0 2024-04-26T12:06:57.368 INFO:tasks.workunit.client.0.smithi052.stdout:7/607: truncate d1/f14 1734273 0 2024-04-26T12:06:57.370 INFO:tasks.workunit.client.0.smithi052.stdout:0/606: dwrite d0/d26/d36/f92 [12582912,4194304] 0 2024-04-26T12:06:57.370 INFO:tasks.workunit.client.0.smithi052.stdout:5/604: rmdir db/dc/d5f/d50/d46/d74 39 2024-04-26T12:06:57.370 INFO:tasks.workunit.client.0.smithi052.stdout:9/618: rmdir d3/db/d10/d3c/d40/d96/db5/d8f 39 2024-04-26T12:06:57.370 INFO:tasks.workunit.client.0.smithi052.stdout:1/574: mknod d0/d2/dd/d1c/d1d/cbe 0 2024-04-26T12:06:57.371 INFO:tasks.workunit.client.0.smithi052.stdout:3/544: rmdir d2/d4/dc/d33/d8a 39 2024-04-26T12:06:57.371 INFO:tasks.workunit.client.0.smithi052.stdout:7/608: stat d1/d1c/d21/d2f/d33/d3a/d64/cb8 0 2024-04-26T12:06:57.372 INFO:tasks.workunit.client.0.smithi052.stdout:0/607: write d0/d1/d52/fae [824558,13188] 0 2024-04-26T12:06:57.372 INFO:tasks.workunit.client.0.smithi052.stdout:3/545: mkdir d2/d4/dc/d1d/d3f/da2 0 2024-04-26T12:06:57.373 INFO:tasks.workunit.client.0.smithi052.stdout:6/597: dwrite da/f20 [0,4194304] 0 2024-04-26T12:06:57.373 INFO:tasks.workunit.client.0.smithi052.stdout:5/605: fdatasync db/dd/d34/d69/d8a/da9/d87/d6e/fbd 0 2024-04-26T12:06:57.374 INFO:tasks.workunit.client.0.smithi052.stdout:9/619: rename d3/d23/c75 to d3/db/d10/d54/cd8 0 2024-04-26T12:06:57.375 INFO:tasks.workunit.client.0.smithi052.stdout:3/546: write d2/f3d [1388588,130474] 0 2024-04-26T12:06:57.375 INFO:tasks.workunit.client.0.smithi052.stdout:0/608: symlink d0/d1/d2c/d42/da5/dba/lc2 0 2024-04-26T12:06:57.375 INFO:tasks.workunit.client.0.smithi052.stdout:6/598: rmdir da/dba 0 2024-04-26T12:06:57.376 INFO:tasks.workunit.client.0.smithi052.stdout:5/606: mknod db/dd/d34/d69/d8a/da9/d87/cc9 0 2024-04-26T12:06:57.377 INFO:tasks.workunit.client.0.smithi052.stdout:8/531: dwrite d0/d16/f23 [0,4194304] 0 2024-04-26T12:06:57.377 INFO:tasks.workunit.client.0.smithi052.stdout:9/620: stat d3/db/d10/d3c/d40/ca2 0 2024-04-26T12:06:57.377 INFO:tasks.workunit.client.0.smithi052.stdout:3/547: symlink d2/d4/dc/d1d/d3f/la3 0 2024-04-26T12:06:57.379 INFO:tasks.workunit.client.0.smithi052.stdout:9/621: link d3/f87 d3/db/d13/fd9 0 2024-04-26T12:06:57.379 INFO:tasks.workunit.client.0.smithi052.stdout:6/599: getdents da/d22/d3c/d74/d99/d7c 0 2024-04-26T12:06:57.379 INFO:tasks.workunit.client.0.smithi052.stdout:3/548: creat d2/d4/dc/d1d/d25/d36/d1c/fa4 x:0 0 0 2024-04-26T12:06:57.382 INFO:tasks.workunit.client.0.smithi052.stdout:1/575: truncate d0/d2/dd/d40/d81/d52/f72 1402825 0 2024-04-26T12:06:57.383 INFO:tasks.workunit.client.0.smithi052.stdout:6/600: fdatasync da/d5d/fd1 0 2024-04-26T12:06:57.384 INFO:tasks.workunit.client.0.smithi052.stdout:3/549: write d2/f2f [7146593,84260] 0 2024-04-26T12:06:57.384 INFO:tasks.workunit.client.0.smithi052.stdout:9/622: write d3/db/fbe [310815,85840] 0 2024-04-26T12:06:57.384 INFO:tasks.workunit.client.0.smithi052.stdout:0/609: dwrite d0/d3c/f9a [0,4194304] 0 2024-04-26T12:06:57.385 INFO:tasks.workunit.client.0.smithi052.stdout:2/604: dread d0/d3f/d56/f64 [0,4194304] 0 2024-04-26T12:06:57.385 INFO:tasks.workunit.client.0.smithi052.stdout:9/623: stat d3/db/f5b 0 2024-04-26T12:06:57.385 INFO:tasks.workunit.client.0.smithi052.stdout:8/532: dwrite d0/d4/d5/fe [0,4194304] 0 2024-04-26T12:06:57.385 INFO:tasks.workunit.client.0.smithi052.stdout:6/601: fsync da/d22/d3c/f85 0 2024-04-26T12:06:57.386 INFO:tasks.workunit.client.0.smithi052.stdout:5/607: dwrite db/dd/d34/d69/d8a/da9/d87/fba [0,4194304] 0 2024-04-26T12:06:57.387 INFO:tasks.workunit.client.0.smithi052.stdout:0/610: symlink d0/d1/d1a/d20/lc3 0 2024-04-26T12:06:57.387 INFO:tasks.workunit.client.0.smithi052.stdout:3/550: link d2/d4/c17 d2/d4/dc/d68/ca5 0 2024-04-26T12:06:57.388 INFO:tasks.workunit.client.0.smithi052.stdout:9/624: dread d3/db/d10/f38 [0,4194304] 0 2024-04-26T12:06:57.389 INFO:tasks.workunit.client.0.smithi052.stdout:0/611: unlink d0/d1/d2c/l4d 0 2024-04-26T12:06:57.389 INFO:tasks.workunit.client.0.smithi052.stdout:8/533: rename d0/d4/d5/d3c/f5d to d0/d4/d5/db/d20/d41/fad 0 2024-04-26T12:06:57.389 INFO:tasks.workunit.client.0.smithi052.stdout:3/551: fdatasync d2/d4/d2a/d2d/d4d/f9e 0 2024-04-26T12:06:57.389 INFO:tasks.workunit.client.0.smithi052.stdout:8/534: readlink d0/d4/d5/db/l6b 0 2024-04-26T12:06:57.390 INFO:tasks.workunit.client.0.smithi052.stdout:6/602: dread da/d22/d3c/f66 [0,4194304] 0 2024-04-26T12:06:57.391 INFO:tasks.workunit.client.0.smithi052.stdout:3/552: chown d2/d4/d2a/d2d/d4d/f9e 2210 1 2024-04-26T12:06:57.391 INFO:tasks.workunit.client.0.smithi052.stdout:8/535: unlink d0/d4/c10 0 2024-04-26T12:06:57.391 INFO:tasks.workunit.client.0.smithi052.stdout:9/625: rename d3/db/d10/d3c/d40/d96/ccc to d3/db/d10/d2e/d5c/cda 0 2024-04-26T12:06:57.391 INFO:tasks.workunit.client.0.smithi052.stdout:6/603: symlink da/d63/ld6 0 2024-04-26T12:06:57.391 INFO:tasks.workunit.client.0.smithi052.stdout:2/605: truncate d0/f12 1966974 0 2024-04-26T12:06:57.392 INFO:tasks.workunit.client.0.smithi052.stdout:3/553: symlink d2/d4/d41/d59/la6 0 2024-04-26T12:06:57.392 INFO:tasks.workunit.client.0.smithi052.stdout:8/536: chown d0/d16/d28/l49 20 1 2024-04-26T12:06:57.392 INFO:tasks.workunit.client.0.smithi052.stdout:6/604: write da/d5d/f90 [632127,40969] 0 2024-04-26T12:06:57.393 INFO:tasks.workunit.client.0.smithi052.stdout:2/606: creat d0/d3f/d56/d6d/d5a/d73/fcd x:0 0 0 2024-04-26T12:06:57.393 INFO:tasks.workunit.client.0.smithi052.stdout:9/626: read d3/db/d10/d2e/f71 [4091240,117334] 0 2024-04-26T12:06:57.393 INFO:tasks.workunit.client.0.smithi052.stdout:3/554: getdents d2/d4/d6b 0 2024-04-26T12:06:57.395 INFO:tasks.workunit.client.0.smithi052.stdout:9/627: fsync d3/db/d10/d3c/d40/d96/db5/d8f/fbd 0 2024-04-26T12:06:57.396 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:57.394+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:57.396 INFO:tasks.workunit.client.0.smithi052.stdout:6/605: link da/d22/d3c/f58 da/d22/d3c/d74/d99/d7c/d94/fd7 0 2024-04-26T12:06:57.398 INFO:tasks.workunit.client.0.smithi052.stdout:9/628: readlink d3/db/d10/d2e/lc2 0 2024-04-26T12:06:57.399 INFO:tasks.workunit.client.0.smithi052.stdout:5/608: dwrite db/dd/d34/fb2 [0,4194304] 0 2024-04-26T12:06:57.400 INFO:tasks.workunit.client.0.smithi052.stdout:8/537: dwrite d0/d4/d5/d86/f93 [0,4194304] 0 2024-04-26T12:06:57.400 INFO:tasks.workunit.client.0.smithi052.stdout:6/606: chown da/d22/d29/d31/f3a 5 1 2024-04-26T12:06:57.400 INFO:tasks.workunit.client.0.smithi052.stdout:9/629: creat d3/db/d2b/fdb x:0 0 0 2024-04-26T12:06:57.402 INFO:tasks.workunit.client.0.smithi052.stdout:4/556: sync 2024-04-26T12:06:57.402 INFO:tasks.workunit.client.0.smithi052.stdout:5/609: write db/f38 [2974144,126298] 0 2024-04-26T12:06:57.402 INFO:tasks.workunit.client.0.smithi052.stdout:0/612: dwrite d0/d1/d1a/d20/d47/d84/fa3 [0,4194304] 0 2024-04-26T12:06:57.403 INFO:tasks.workunit.client.0.smithi052.stdout:8/538: fsync d0/d4/d5/f8 0 2024-04-26T12:06:57.403 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:57.403 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:57.404 INFO:tasks.workunit.client.0.smithi052.stdout:4/557: stat d3/d22/d30/f5c 0 2024-04-26T12:06:57.404 INFO:tasks.workunit.client.0.smithi052.stdout:9/630: dread - d3/db/d10/d3c/d40/d96/db5/d8f/fbd zero size 2024-04-26T12:06:57.404 INFO:tasks.workunit.client.0.smithi052.stdout:5/610: unlink db/dd/d18/f6c 0 2024-04-26T12:06:57.404 INFO:tasks.workunit.client.0.smithi052.stdout:0/613: chown d0/d26/l76 5072 1 2024-04-26T12:06:57.404 INFO:tasks.workunit.client.0.smithi052.stdout:6/607: link da/d22/d3c/d74/d99/lae da/d51/ld8 0 2024-04-26T12:06:57.405 INFO:tasks.workunit.client.0.smithi052.stdout:4/558: write d3/d12/d59/d6b/fac [731989,125399] 0 2024-04-26T12:06:57.405 INFO:tasks.workunit.client.0.smithi052.stdout:4/559: write d3/d44/f48 [819314,59792] 0 2024-04-26T12:06:57.406 INFO:tasks.workunit.client.0.smithi052.stdout:6/608: creat da/d22/d3c/d74/d99/d7c/d94/fd9 x:0 0 0 2024-04-26T12:06:57.406 INFO:tasks.workunit.client.0.smithi052.stdout:4/560: rmdir d3/d44 39 2024-04-26T12:06:57.414 INFO:tasks.workunit.client.0.smithi052.stdout:4/561: dwrite d3/d12/f19 [0,4194304] 0 2024-04-26T12:06:57.415 INFO:tasks.workunit.client.0.smithi052.stdout:4/562: fdatasync d3/d12/d59/d96/dc0/f74 0 2024-04-26T12:06:57.416 INFO:tasks.workunit.client.0.smithi052.stdout:4/563: creat d3/d1f/d21/fc1 x:0 0 0 2024-04-26T12:06:57.417 INFO:tasks.workunit.client.0.smithi052.stdout:4/564: write d3/d1f/d21/f32 [5081777,46454] 0 2024-04-26T12:06:57.417 INFO:tasks.workunit.client.0.smithi052.stdout:4/565: write d3/d1f/fbd [650112,576] 0 2024-04-26T12:06:57.418 INFO:tasks.workunit.client.0.smithi052.stdout:6/609: dread da/f1e [0,4194304] 0 2024-04-26T12:06:57.419 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:57.419 INFO:tasks.workunit.client.0.smithi052.stdout:6/610: stat da/d63/ccb 0 2024-04-26T12:06:57.419 INFO:tasks.workunit.client.0.smithi052.stdout:3/555: dread d2/f3d [0,4194304] 0 2024-04-26T12:06:57.419 INFO:tasks.workunit.client.0.smithi052.stdout:6/611: write da/d5d/d64/fad [1083660,33922] 0 2024-04-26T12:06:57.420 INFO:tasks.workunit.client.0.smithi052.stdout:6/612: unlink da/d5d/fa1 0 2024-04-26T12:06:57.420 INFO:tasks.workunit.client.0.smithi052.stdout:4/566: read d3/d12/f18 [8214982,36433] 0 2024-04-26T12:06:57.421 INFO:tasks.workunit.client.0.smithi052.stdout:2/607: dread d0/d7/d16/f24 [0,4194304] 0 2024-04-26T12:06:57.422 INFO:tasks.workunit.client.0.smithi052.stdout:6/613: rename da/d22/l41 to da/d22/d3c/d74/d7e/d8b/lda 0 2024-04-26T12:06:57.422 INFO:tasks.workunit.client.0.smithi052.stdout:4/567: creat d3/d22/fc2 x:0 0 0 2024-04-26T12:06:57.422 INFO:tasks.workunit.client.0.smithi052.stdout:6/614: dread - da/d22/d29/d31/fa6 zero size 2024-04-26T12:06:57.423 INFO:tasks.workunit.client.0.smithi052.stdout:4/568: creat d3/d12/d34/d45/d67/fc3 x:0 0 0 2024-04-26T12:06:57.423 INFO:tasks.workunit.client.0.smithi052.stdout:2/608: link d0/d3f/cba d0/d7/d16/d4d/d8b/cce 0 2024-04-26T12:06:57.424 INFO:tasks.workunit.client.0.smithi052.stdout:6/615: fsync da/d5d/d64/d68/f86 0 2024-04-26T12:06:57.424 INFO:tasks.workunit.client.0.smithi052.stdout:3/556: dwrite d2/d4/d2a/d2d/d4d/f9e [0,4194304] 0 2024-04-26T12:06:57.425 INFO:tasks.workunit.client.0.smithi052.stdout:4/569: getdents d3/d2e 0 2024-04-26T12:06:57.425 INFO:tasks.workunit.client.0.smithi052.stdout:6/616: chown da/d22/d3c/d74/d99/d92/d96 47 1 2024-04-26T12:06:57.426 INFO:tasks.workunit.client.0.smithi052.stdout:4/570: dread - d3/d12/d59/faa zero size 2024-04-26T12:06:57.426 INFO:tasks.workunit.client.0.smithi052.stdout:4/571: readlink l0 0 2024-04-26T12:06:57.426 INFO:tasks.workunit.client.0.smithi052.stdout:6/617: unlink da/f83 0 2024-04-26T12:06:57.426 INFO:tasks.workunit.client.0.smithi052.stdout:6/618: mknod da/d51/cdb 0 2024-04-26T12:06:57.427 INFO:tasks.workunit.client.0.smithi052.stdout:6/619: chown da/d22/l33 16552039 1 2024-04-26T12:06:57.428 INFO:tasks.workunit.client.0.smithi052.stdout:6/620: creat da/d22/d3c/d74/d87/fdc x:0 0 0 2024-04-26T12:06:57.429 INFO:tasks.workunit.client.0.smithi052.stdout:2/609: getdents d0/d7/d16/d4d/d8b 0 2024-04-26T12:06:57.430 INFO:tasks.workunit.client.0.smithi052.stdout:3/557: write d2/d4/d41/f66 [936974,24377] 0 2024-04-26T12:06:57.430 INFO:tasks.workunit.client.0.smithi052.stdout:6/621: mknod da/d22/d29/d31/d39/cdd 0 2024-04-26T12:06:57.430 INFO:tasks.workunit.client.0.smithi052.stdout:5/611: dread db/dd/d34/d69/d8a/da9/d87/fa7 [0,4194304] 0 2024-04-26T12:06:57.435 INFO:tasks.workunit.client.0.smithi052.stdout:2/610: chown d0/d7/d16/c27 55467 1 2024-04-26T12:06:57.435 INFO:tasks.workunit.client.0.smithi052.stdout:5/612: fsync db/dc/f12 0 2024-04-26T12:06:57.435 INFO:tasks.workunit.client.0.smithi052.stdout:4/572: dwrite d3/d22/d69/f7c [0,4194304] 0 2024-04-26T12:06:57.436 INFO:tasks.workunit.client.0.smithi052.stdout:6/622: symlink da/d22/d29/dd4/lde 0 2024-04-26T12:06:57.436 INFO:tasks.workunit.client.0.smithi052.stdout:3/558: symlink d2/d4/dc/d1d/d25/d36/d1c/la7 0 2024-04-26T12:06:57.436 INFO:tasks.workunit.client.0.smithi052.stdout:2/611: truncate d0/d3f/d56/d6d/d5a/d73/f85 639185 0 2024-04-26T12:06:57.436 INFO:tasks.workunit.client.0.smithi052.stdout:3/559: creat d2/d4/dc/d1d/d25/d61/fa8 x:0 0 0 2024-04-26T12:06:57.436 INFO:tasks.workunit.client.0.smithi052.stdout:5/613: getdents db/dd/d18/d60/d64/d9c 0 2024-04-26T12:06:57.436 INFO:tasks.workunit.client.0.smithi052.stdout:7/609: sync 2024-04-26T12:06:57.436 INFO:tasks.workunit.client.0.smithi052.stdout:1/576: sync 2024-04-26T12:06:57.436 INFO:tasks.workunit.client.0.smithi052.stdout:0/614: sync 2024-04-26T12:06:57.436 INFO:tasks.workunit.client.0.smithi052.stdout:5/614: readlink db/dd/l96 0 2024-04-26T12:06:57.436 INFO:tasks.workunit.client.0.smithi052.stdout:5/615: chown db/dc/d5f 22 1 2024-04-26T12:06:57.437 INFO:tasks.workunit.client.0.smithi052.stdout:0/615: fsync d0/d1/d1a/d20/d47/fb7 0 2024-04-26T12:06:57.437 INFO:tasks.workunit.client.0.smithi052.stdout:1/577: read - d0/d83/d4b/d56/f9d zero size 2024-04-26T12:06:57.437 INFO:tasks.workunit.client.0.smithi052.stdout:7/610: write d1/d1f/f22 [5869496,89109] 0 2024-04-26T12:06:57.437 INFO:tasks.workunit.client.0.smithi052.stdout:0/616: write d0/d3c/f9a [4484104,84206] 0 2024-04-26T12:06:57.438 INFO:tasks.workunit.client.0.smithi052.stdout:6/623: dwrite da/d22/f24 [0,4194304] 0 2024-04-26T12:06:57.438 INFO:tasks.workunit.client.0.smithi052.stdout:1/578: mknod d0/d2/dd/d1c/d1d/d91/cbf 0 2024-04-26T12:06:57.439 INFO:tasks.workunit.client.0.smithi052.stdout:5/616: truncate db/dc/d5f/d50/d46/d74/fc1 247858 0 2024-04-26T12:06:57.439 INFO:tasks.workunit.client.0.smithi052.stdout:0/617: symlink d0/lc4 0 2024-04-26T12:06:57.439 INFO:tasks.workunit.client.0.smithi052.stdout:1/579: rmdir d0/da 39 2024-04-26T12:06:57.439 INFO:tasks.workunit.client.0.smithi052.stdout:7/611: getdents d1/d1c/d21 0 2024-04-26T12:06:57.440 INFO:tasks.workunit.client.0.smithi052.stdout:0/618: creat d0/d3d/fc5 x:0 0 0 2024-04-26T12:06:57.441 INFO:tasks.workunit.client.0.smithi052.stdout:1/580: link d0/d1e/lb7 d0/da/lc0 0 2024-04-26T12:06:57.442 INFO:tasks.workunit.client.0.smithi052.stdout:5/617: link db/dd/d34/d70/f80 db/dd/d34/d70/fca 0 2024-04-26T12:06:57.442 INFO:tasks.workunit.client.0.smithi052.stdout:1/581: unlink d0/da/f2f 0 2024-04-26T12:06:57.443 INFO:tasks.workunit.client.0.smithi052.stdout:5/618: symlink db/dd/d34/d70/d78/lcb 0 2024-04-26T12:06:57.443 INFO:tasks.workunit.client.0.smithi052.stdout:7/612: write d1/f47 [79909,22112] 0 2024-04-26T12:06:57.443 INFO:tasks.workunit.client.0.smithi052.stdout:5/619: mkdir db/dd/d34/d69/dcc 0 2024-04-26T12:06:57.445 INFO:tasks.workunit.client.0.smithi052.stdout:7/613: dread d1/d1c/d23/f78 [0,4194304] 0 2024-04-26T12:06:57.445 INFO:tasks.workunit.client.0.smithi052.stdout:4/573: dread d3/d22/f52 [0,4194304] 0 2024-04-26T12:06:57.445 INFO:tasks.workunit.client.0.smithi052.stdout:5/620: rename db/dd/d18/d60/l88 to db/dc/d5f/d50/d46/d74/lcd 0 2024-04-26T12:06:57.446 INFO:tasks.workunit.client.0.smithi052.stdout:7/614: rmdir d1/d1c/d21/db6 0 2024-04-26T12:06:57.446 INFO:tasks.workunit.client.0.smithi052.stdout:8/539: sync 2024-04-26T12:06:57.446 INFO:tasks.workunit.client.0.smithi052.stdout:9/631: sync 2024-04-26T12:06:57.446 INFO:tasks.workunit.client.0.smithi052.stdout:3/560: sync 2024-04-26T12:06:57.447 INFO:tasks.workunit.client.0.smithi052.stdout:4/574: unlink d3/d12/c49 0 2024-04-26T12:06:57.447 INFO:tasks.workunit.client.0.smithi052.stdout:5/621: write db/dc/d5f/fa2 [168219,49381] 0 2024-04-26T12:06:57.447 INFO:tasks.workunit.client.0.smithi052.stdout:9/632: readlink d3/d3b/l60 0 2024-04-26T12:06:57.448 INFO:tasks.workunit.client.0.smithi052.stdout:8/540: write d0/f59 [4884767,35165] 0 2024-04-26T12:06:57.448 INFO:tasks.workunit.client.0.smithi052.stdout:7/615: dread - d1/dab/d4c/d4d/f70 zero size 2024-04-26T12:06:57.448 INFO:tasks.workunit.client.0.smithi052.stdout:3/561: write d2/d4/dc/d33/d75/f84 [82150,3536] 0 2024-04-26T12:06:57.449 INFO:tasks.workunit.client.0.smithi052.stdout:4/575: write d3/d12/fa2 [719934,36879] 0 2024-04-26T12:06:57.449 INFO:tasks.workunit.client.0.smithi052.stdout:8/541: mkdir d0/d4/dc/d45/d58/dae 0 2024-04-26T12:06:57.450 INFO:tasks.workunit.client.0.smithi052.stdout:9/633: mkdir d3/db/d10/d3c/d40/d96/db5/d8f/ddc 0 2024-04-26T12:06:57.450 INFO:tasks.workunit.client.0.smithi052.stdout:5/622: mkdir db/dd/d34/d69/d8a/da9/d87/d6e/db8/dce 0 2024-04-26T12:06:57.451 INFO:tasks.workunit.client.0.smithi052.stdout:4/576: rmdir d3/d12/d34/d45/d67/d6c/d86 39 2024-04-26T12:06:57.452 INFO:tasks.workunit.client.0.smithi052.stdout:0/619: dread d0/d1/d11/f4a [0,4194304] 0 2024-04-26T12:06:57.454 INFO:tasks.workunit.client.0.smithi052.stdout:9/634: dread d3/db/d10/f38 [0,4194304] 0 2024-04-26T12:06:57.454 INFO:tasks.workunit.client.0.smithi052.stdout:6/624: dread da/d22/f52 [0,4194304] 0 2024-04-26T12:06:57.454 INFO:tasks.workunit.client.0.smithi052.stdout:4/577: symlink d3/d12/d34/d43/da1/lc4 0 2024-04-26T12:06:57.456 INFO:tasks.workunit.client.0.smithi052.stdout:4/578: dread - d3/d2b/f7d zero size 2024-04-26T12:06:57.456 INFO:tasks.workunit.client.0.smithi052.stdout:7/616: mknod d1/d1c/d21/d2f/d68/cc3 0 2024-04-26T12:06:57.457 INFO:tasks.workunit.client.0.smithi052.stdout:3/562: dread d2/d4/dc/f6f [0,4194304] 0 2024-04-26T12:06:57.457 INFO:tasks.workunit.client.0.smithi052.stdout:6/625: read - da/d22/d3c/d74/d99/fbd zero size 2024-04-26T12:06:57.458 INFO:tasks.workunit.client.0.smithi052.stdout:9/635: dread d3/d23/f88 [0,4194304] 0 2024-04-26T12:06:57.458 INFO:tasks.workunit.client.0.smithi052.stdout:4/579: fsync d3/d1f/d21/fc1 0 2024-04-26T12:06:57.458 INFO:tasks.workunit.client.0.smithi052.stdout:2/612: dread d0/f33 [0,4194304] 0 2024-04-26T12:06:57.459 INFO:tasks.workunit.client.0.smithi052.stdout:6/626: chown da/d5d/c65 393247 1 2024-04-26T12:06:57.460 INFO:tasks.workunit.client.0.smithi052.stdout:0/620: truncate d0/d1/dd/fab 1917519 0 2024-04-26T12:06:57.460 INFO:tasks.workunit.client.0.smithi052.stdout:3/563: mkdir d2/d4/dc/d1d/d3f/da9 0 2024-04-26T12:06:57.460 INFO:tasks.workunit.client.0.smithi052.stdout:8/542: dwrite d0/d4/d5/d27/d57/f88 [4194304,4194304] 0 2024-04-26T12:06:57.461 INFO:tasks.workunit.client.0.smithi052.stdout:4/580: write d3/d2e/f95 [858355,85140] 0 2024-04-26T12:06:57.462 INFO:tasks.workunit.client.0.smithi052.stdout:2/613: stat d0/d7/d22/fb8 0 2024-04-26T12:06:57.463 INFO:tasks.workunit.client.0.smithi052.stdout:5/623: dwrite db/dc/d5f/f3a [4194304,4194304] 0 2024-04-26T12:06:57.463 INFO:tasks.workunit.client.0.smithi052.stdout:3/564: chown d2/d4/d2a/d2d/d4d 131 1 2024-04-26T12:06:57.464 INFO:tasks.workunit.client.0.smithi052.stdout:0/621: creat d0/d26/fc6 x:0 0 0 2024-04-26T12:06:57.464 INFO:tasks.workunit.client.0.smithi052.stdout:1/582: dread d0/d2/dd/f32 [0,4194304] 0 2024-04-26T12:06:57.464 INFO:tasks.workunit.client.0.smithi052.stdout:2/614: dread - d0/d36/f96 zero size 2024-04-26T12:06:57.465 INFO:tasks.workunit.client.0.smithi052.stdout:4/581: creat d3/d12/d34/d45/fc5 x:0 0 0 2024-04-26T12:06:57.465 INFO:tasks.workunit.client.0.smithi052.stdout:3/565: symlink d2/d4/d31/d6a/laa 0 2024-04-26T12:06:57.466 INFO:tasks.workunit.client.0.smithi052.stdout:0/622: chown d0/la 11008036 1 2024-04-26T12:06:57.467 INFO:tasks.workunit.client.0.smithi052.stdout:8/543: truncate d0/d4/d5/f8 10022560 0 2024-04-26T12:06:57.467 INFO:tasks.workunit.client.0.smithi052.stdout:4/582: mkdir d3/d12/d34/d43/dc6 0 2024-04-26T12:06:57.468 INFO:tasks.workunit.client.0.smithi052.stdout:7/617: dwrite d1/f9f [4194304,4194304] 0 2024-04-26T12:06:57.469 INFO:tasks.workunit.client.0.smithi052.stdout:1/583: write d0/d2/dd/d1c/d3c/d9b/fa9 [1035700,100451] 0 2024-04-26T12:06:57.469 INFO:tasks.workunit.client.0.smithi052.stdout:6/627: dwrite da/d22/f52 [0,4194304] 0 2024-04-26T12:06:57.470 INFO:tasks.workunit.client.0.smithi052.stdout:4/583: unlink d3/d12/f1a 0 2024-04-26T12:06:57.470 INFO:tasks.workunit.client.0.smithi052.stdout:2/615: getdents d0/d7/d16/d3a 0 2024-04-26T12:06:57.470 INFO:tasks.workunit.client.0.smithi052.stdout:0/623: rename d0/d1/dd/d72 to d0/d26/dc7 0 2024-04-26T12:06:57.470 INFO:tasks.workunit.client.0.smithi052.stdout:8/544: write d0/d4/d5/d27/d69/f76 [12531,51685] 0 2024-04-26T12:06:57.471 INFO:tasks.workunit.client.0.smithi052.stdout:7/618: symlink d1/dab/lc4 0 2024-04-26T12:06:57.471 INFO:tasks.workunit.client.0.smithi052.stdout:3/566: link d2/d4/f3e d2/d4/dc/d1d/d3f/da9/fab 0 2024-04-26T12:06:57.471 INFO:tasks.workunit.client.0.smithi052.stdout:6/628: dread - da/da2/fca zero size 2024-04-26T12:06:57.471 INFO:tasks.workunit.client.0.smithi052.stdout:0/624: mknod d0/d26/dc7/cc8 0 2024-04-26T12:06:57.472 INFO:tasks.workunit.client.0.smithi052.stdout:2/616: symlink d0/d7/d2f/d8c/lcf 0 2024-04-26T12:06:57.472 INFO:tasks.workunit.client.0.smithi052.stdout:1/584: rename d0/d2/dd/d1c to d0/d2/dd/d40/dc1 0 2024-04-26T12:06:57.473 INFO:tasks.workunit.client.0.smithi052.stdout:0/625: chown d0/d1/d2c/c62 50935989 1 2024-04-26T12:06:57.474 INFO:tasks.workunit.client.0.smithi052.stdout:0/626: chown d0/d1/d52 1206326386 1 2024-04-26T12:06:57.474 INFO:tasks.workunit.client.0.smithi052.stdout:8/545: write d0/d4/d1c/f2c [4166371,119027] 0 2024-04-26T12:06:57.474 INFO:tasks.workunit.client.0.smithi052.stdout:7/619: getdents d1/d1c/d23/d81/d88 0 2024-04-26T12:06:57.475 INFO:tasks.workunit.client.0.smithi052.stdout:0/627: mknod d0/d1/d54/cc9 0 2024-04-26T12:06:57.476 INFO:tasks.workunit.client.0.smithi052.stdout:8/546: read d0/d4/d5/d86/f93 [1933970,33973] 0 2024-04-26T12:06:57.479 INFO:tasks.workunit.client.0.smithi052.stdout:8/547: chown d0/d4/d5/d27/f4c 13 1 2024-04-26T12:06:57.480 INFO:tasks.workunit.client.0.smithi052.stdout:6/629: truncate da/f1c 3913415 0 2024-04-26T12:06:57.480 INFO:tasks.workunit.client.0.smithi052.stdout:4/584: dwrite d3/d12/d59/d96/dc0/f81 [0,4194304] 0 2024-04-26T12:06:57.480 INFO:tasks.workunit.client.0.smithi052.stdout:0/628: write d0/d1/dd/fab [37092,23655] 0 2024-04-26T12:06:57.481 INFO:tasks.workunit.client.0.smithi052.stdout:1/585: dwrite d0/f4a [0,4194304] 0 2024-04-26T12:06:57.481 INFO:tasks.workunit.client.0.smithi052.stdout:8/548: readlink d0/l7e 0 2024-04-26T12:06:57.482 INFO:tasks.workunit.client.0.smithi052.stdout:2/617: dwrite d0/fb0 [0,4194304] 0 2024-04-26T12:06:57.482 INFO:tasks.workunit.client.0.smithi052.stdout:0/629: stat d0/d1/d54/fb2 0 2024-04-26T12:06:57.483 INFO:tasks.workunit.client.0.smithi052.stdout:4/585: unlink d3/d22/d69/f7c 0 2024-04-26T12:06:57.483 INFO:tasks.workunit.client.0.smithi052.stdout:2/618: unlink d0/d7/d16/c20 0 2024-04-26T12:06:57.483 INFO:tasks.workunit.client.0.smithi052.stdout:8/549: mkdir d0/d4/d5/daf 0 2024-04-26T12:06:57.484 INFO:tasks.workunit.client.0.smithi052.stdout:1/586: getdents d0/d2/dd/d40/dc1 0 2024-04-26T12:06:57.484 INFO:tasks.workunit.client.0.smithi052.stdout:4/586: fdatasync d3/d22/f52 0 2024-04-26T12:06:57.484 INFO:tasks.workunit.client.0.smithi052.stdout:2/619: write d0/d3f/d56/d6d/fa0 [402642,51207] 0 2024-04-26T12:06:57.486 INFO:tasks.workunit.client.0.smithi052.stdout:1/587: mknod d0/d83/d4b/cc2 0 2024-04-26T12:06:57.486 INFO:tasks.workunit.client.0.smithi052.stdout:2/620: symlink d0/d7/d2f/d9b/ld0 0 2024-04-26T12:06:57.487 INFO:tasks.workunit.client.0.smithi052.stdout:4/587: link d3/d12/d34/d45/d67/fc3 d3/d12/d59/d6b/fc7 0 2024-04-26T12:06:57.488 INFO:tasks.workunit.client.0.smithi052.stdout:2/621: creat d0/d7/d2f/fd1 x:0 0 0 2024-04-26T12:06:57.488 INFO:tasks.workunit.client.0.smithi052.stdout:4/588: chown d3/d22/fc2 31418 1 2024-04-26T12:06:57.489 INFO:tasks.workunit.client.0.smithi052.stdout:4/589: write d3/d2b/d40/f5b [1022721,108357] 0 2024-04-26T12:06:57.489 INFO:tasks.workunit.client.0.smithi052.stdout:1/588: truncate d0/d2/dd/d40/d81/d52/f72 436261 0 2024-04-26T12:06:57.490 INFO:tasks.workunit.client.0.smithi052.stdout:2/622: write d0/d3f/d56/d6d/d5a/d73/fc2 [263484,21496] 0 2024-04-26T12:06:57.490 INFO:tasks.workunit.client.0.smithi052.stdout:8/550: dwrite d0/d4/d5/db/f96 [0,4194304] 0 2024-04-26T12:06:57.490 INFO:tasks.workunit.client.0.smithi052.stdout:1/589: chown d0/d83/d4b/l6a 3 1 2024-04-26T12:06:57.492 INFO:tasks.workunit.client.0.smithi052.stdout:2/623: chown d0/d3f/d56/d6d/d5a/d73/d4b/c98 1622 1 2024-04-26T12:06:57.492 INFO:tasks.workunit.client.0.smithi052.stdout:1/590: creat d0/d2/dd/d40/dc1/d1d/d91/fc3 x:0 0 0 2024-04-26T12:06:57.493 INFO:tasks.workunit.client.0.smithi052.stdout:0/630: truncate d0/d26/d36/f9e 250111 0 2024-04-26T12:06:57.494 INFO:tasks.workunit.client.0.smithi052.stdout:2/624: truncate d0/d3f/d56/d6d/f7b 322399 0 2024-04-26T12:06:57.494 INFO:tasks.workunit.client.0.smithi052.stdout:1/591: mkdir d0/d2/dd/d40/d81/d9a/da6/dc4 0 2024-04-26T12:06:57.495 INFO:tasks.workunit.client.0.smithi052.stdout:0/631: symlink d0/d1/d1a/d20/d47/d84/lca 0 2024-04-26T12:06:57.496 INFO:tasks.workunit.client.0.smithi052.stdout:8/551: dread d0/d4/d5/db/f5e [0,4194304] 0 2024-04-26T12:06:57.496 INFO:tasks.workunit.client.0.smithi052.stdout:9/636: dread d3/f7 [0,4194304] 0 2024-04-26T12:06:57.496 INFO:tasks.workunit.client.0.smithi052.stdout:2/625: write d0/d7/d2f/d3d/fb5 [645302,73520] 0 2024-04-26T12:06:57.496 INFO:tasks.workunit.client.0.smithi052.stdout:1/592: fsync d0/d83/d4b/f8f 0 2024-04-26T12:06:57.496 INFO:tasks.workunit.client.0.smithi052.stdout:6/630: read da/d22/d3c/d74/d99/d7c/d94/fd7 [3099645,48904] 0 2024-04-26T12:06:57.496 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:57.494+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:57.497 INFO:tasks.workunit.client.0.smithi052.stdout:6/631: fdatasync da/d22/f25 0 2024-04-26T12:06:57.498 INFO:tasks.workunit.client.0.smithi052.stdout:2/626: truncate d0/d7/d2f/d4c/fa9 679997 0 2024-04-26T12:06:57.500 INFO:tasks.workunit.client.0.smithi052.stdout:1/593: dread d0/d2/dd/f32 [0,4194304] 0 2024-04-26T12:06:57.501 INFO:tasks.workunit.client.0.smithi052.stdout:0/632: dwrite d0/d1/d1a/d20/d47/d84/fa3 [0,4194304] 0 2024-04-26T12:06:57.502 INFO:tasks.workunit.client.0.smithi052.stdout:9/637: dwrite d3/db/d10/d3c/d40/d96/db5/d8f/d49/fbf [0,4194304] 0 2024-04-26T12:06:57.503 INFO:tasks.workunit.client.0.smithi052.stdout:1/594: creat d0/d2/dd/d40/d81/d9a/da6/fc5 x:0 0 0 2024-04-26T12:06:57.504 INFO:tasks.workunit.client.0.smithi052.stdout:4/590: dread d3/d12/d59/f82 [0,4194304] 0 2024-04-26T12:06:57.504 INFO:tasks.workunit.client.0.smithi052.stdout:2/627: fsync d0/d7/d2f/fd1 0 2024-04-26T12:06:57.504 INFO:tasks.workunit.client.0.smithi052.stdout:0/633: link d0/d1/d1a/d20/f3a d0/d1/d1a/fcb 0 2024-04-26T12:06:57.505 INFO:tasks.workunit.client.0.smithi052.stdout:9/638: rename d3/db/d13/fd9 to d3/db/d10/d54/fdd 0 2024-04-26T12:06:57.506 INFO:tasks.workunit.client.0.smithi052.stdout:0/634: readlink d0/d1/d11/l44 0 2024-04-26T12:06:57.506 INFO:tasks.workunit.client.0.smithi052.stdout:2/628: symlink d0/d3f/d56/d6d/d5a/d73/d4b/d9c/ld2 0 2024-04-26T12:06:57.507 INFO:tasks.workunit.client.0.smithi052.stdout:9/639: write d3/db/fbe [1410988,38570] 0 2024-04-26T12:06:57.507 INFO:tasks.workunit.client.0.smithi052.stdout:3/567: dread d2/d4/dc/d1d/d25/d61/f93 [0,4194304] 0 2024-04-26T12:06:57.507 INFO:tasks.workunit.client.0.smithi052.stdout:0/635: readlink d0/d1/d1a/d20/l7d 0 2024-04-26T12:06:57.508 INFO:tasks.workunit.client.0.smithi052.stdout:0/636: chown d0/d26/d74/db4 16409364 1 2024-04-26T12:06:57.508 INFO:tasks.workunit.client.0.smithi052.stdout:9/640: mkdir d3/db/d2b/dd4/dde 0 2024-04-26T12:06:57.508 INFO:tasks.workunit.client.0.smithi052.stdout:7/620: dread d1/d1c/d21/d2f/f38 [0,4194304] 0 2024-04-26T12:06:57.508 INFO:tasks.workunit.client.0.smithi052.stdout:2/629: mkdir d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/dd3 0 2024-04-26T12:06:57.509 INFO:tasks.workunit.client.0.smithi052.stdout:7/621: chown d1/c3b 0 1 2024-04-26T12:06:57.509 INFO:tasks.workunit.client.0.smithi052.stdout:3/568: write d2/d4/dc/d1d/d25/d36/d1c/f3c [4219094,4199] 0 2024-04-26T12:06:57.510 INFO:tasks.workunit.client.0.smithi052.stdout:8/552: truncate d0/d4/f38 1656078 0 2024-04-26T12:06:57.510 INFO:tasks.workunit.client.0.smithi052.stdout:2/630: fsync d0/d7/d16/fcc 0 2024-04-26T12:06:57.510 INFO:tasks.workunit.client.0.smithi052.stdout:9/641: chown d3/db/fb6 133828953 1 2024-04-26T12:06:57.510 INFO:tasks.workunit.client.0.smithi052.stdout:0/637: symlink d0/d26/d74/db4/lcc 0 2024-04-26T12:06:57.511 INFO:tasks.workunit.client.0.smithi052.stdout:6/632: read da/d22/d29/d31/f3a [2959626,129045] 0 2024-04-26T12:06:57.511 INFO:tasks.workunit.client.0.smithi052.stdout:5/624: dread db/dd/d34/d69/d93/fbb [0,4194304] 0 2024-04-26T12:06:57.511 INFO:tasks.workunit.client.0.smithi052.stdout:0/638: fdatasync d0/f66 0 2024-04-26T12:06:57.511 INFO:tasks.workunit.client.0.smithi052.stdout:3/569: creat d2/d4/d81/fac x:0 0 0 2024-04-26T12:06:57.512 INFO:tasks.workunit.client.0.smithi052.stdout:6/633: write da/d51/f62 [317259,115197] 0 2024-04-26T12:06:57.512 INFO:tasks.workunit.client.0.smithi052.stdout:5/625: write db/dd/f73 [1453438,17425] 0 2024-04-26T12:06:57.513 INFO:tasks.workunit.client.0.smithi052.stdout:0/639: creat d0/d1/d11/fcd x:0 0 0 2024-04-26T12:06:57.513 INFO:tasks.workunit.client.0.smithi052.stdout:9/642: truncate d3/db/d10/f38 246974 0 2024-04-26T12:06:57.513 INFO:tasks.workunit.client.0.smithi052.stdout:6/634: write f2 [874524,68815] 0 2024-04-26T12:06:57.513 INFO:tasks.workunit.client.0.smithi052.stdout:4/591: truncate d3/d12/d59/d96/dc0/f81 2697967 0 2024-04-26T12:06:57.514 INFO:tasks.workunit.client.0.smithi052.stdout:0/640: rmdir d0/d3d 39 2024-04-26T12:06:57.515 INFO:tasks.workunit.client.0.smithi052.stdout:5/626: chown db/dd/d18/d60/d64/f24 5450 1 2024-04-26T12:06:57.515 INFO:tasks.workunit.client.0.smithi052.stdout:8/553: dread d0/d3e/f4a [0,4194304] 0 2024-04-26T12:06:57.515 INFO:tasks.workunit.client.0.smithi052.stdout:0/641: fsync d0/d1/d52/fae 0 2024-04-26T12:06:57.517 INFO:tasks.workunit.client.0.smithi052.stdout:0/642: read - d0/d1/d1a/d20/d47/fb7 zero size 2024-04-26T12:06:57.518 INFO:tasks.workunit.client.0.smithi052.stdout:1/595: truncate d0/d2/dd/d40/d81/d52/f72 769369 0 2024-04-26T12:06:57.518 INFO:tasks.workunit.client.0.smithi052.stdout:8/554: symlink d0/d16/d63/d8b/lb0 0 2024-04-26T12:06:57.518 INFO:tasks.workunit.client.0.smithi052.stdout:3/570: dread d2/d4/dc/d1d/d25/d61/f93 [0,4194304] 0 2024-04-26T12:06:57.519 INFO:tasks.workunit.client.0.smithi052.stdout:5/627: getdents db/d5c/db3 0 2024-04-26T12:06:57.521 INFO:tasks.workunit.client.0.smithi052.stdout:1/596: read d0/d2/f2a [9801628,111673] 0 2024-04-26T12:06:57.521 INFO:tasks.workunit.client.0.smithi052.stdout:6/635: dread da/d22/d29/d31/f49 [0,4194304] 0 2024-04-26T12:06:57.521 INFO:tasks.workunit.client.0.smithi052.stdout:5/628: dread - db/dd/d34/d70/f80 zero size 2024-04-26T12:06:57.522 INFO:tasks.workunit.client.0.smithi052.stdout:8/555: creat d0/d4/d5/d27/d69/fb1 x:0 0 0 2024-04-26T12:06:57.523 INFO:tasks.workunit.client.0.smithi052.stdout:1/597: mknod d0/d2/dd/cc6 0 2024-04-26T12:06:57.525 INFO:tasks.workunit.client.0.smithi052.stdout:6/636: fdatasync da/d22/d3c/d74/d99/d92/fab 0 2024-04-26T12:06:57.525 INFO:tasks.workunit.client.0.smithi052.stdout:3/571: link d2/d4/d6b/d7b/f7d d2/d4/dc/d33/d37/fad 0 2024-04-26T12:06:57.526 INFO:tasks.workunit.client.0.smithi052.stdout:8/556: stat d0/d4/dc/d45/d58/d8f 0 2024-04-26T12:06:57.526 INFO:tasks.workunit.client.0.smithi052.stdout:9/643: dwrite d3/d3b/fd2 [0,4194304] 0 2024-04-26T12:06:57.528 INFO:tasks.workunit.client.0.smithi052.stdout:5/629: mknod db/dd/d34/d69/d8a/dc5/ccf 0 2024-04-26T12:06:57.528 INFO:tasks.workunit.client.0.smithi052.stdout:0/643: dwrite d0/d26/d74/f7f [0,4194304] 0 2024-04-26T12:06:57.530 INFO:tasks.workunit.client.0.smithi052.stdout:3/572: fdatasync d2/d4/dc/d1d/d25/d61/fa8 0 2024-04-26T12:06:57.530 INFO:tasks.workunit.client.0.smithi052.stdout:7/622: dread d1/d1f/f60 [0,4194304] 0 2024-04-26T12:06:57.532 INFO:tasks.workunit.client.0.smithi052.stdout:9/644: rename d3/db/d10/d3c/c5a to d3/db/d10/d3c/d40/cdf 0 2024-04-26T12:06:57.532 INFO:tasks.workunit.client.0.smithi052.stdout:3/573: fdatasync d2/d4/d41/d59/f71 0 2024-04-26T12:06:57.532 INFO:tasks.workunit.client.0.smithi052.stdout:5/630: creat db/dd/d34/d69/d8a/da9/d87/d6e/fd0 x:0 0 0 2024-04-26T12:06:57.533 INFO:tasks.workunit.client.0.smithi052.stdout:2/631: dread d0/d7/d22/f84 [0,4194304] 0 2024-04-26T12:06:57.535 INFO:tasks.workunit.client.0.smithi052.stdout:7/623: getdents d1/d1c/d21/d2f 0 2024-04-26T12:06:57.535 INFO:tasks.workunit.client.0.smithi052.stdout:5/631: chown db/dd/c7f 860 1 2024-04-26T12:06:57.537 INFO:tasks.workunit.client.0.smithi052.stdout:5/632: rmdir db/dc 39 2024-04-26T12:06:57.537 INFO:tasks.workunit.client.0.smithi052.stdout:6/637: dread da/d22/d29/d31/f4f [0,4194304] 0 2024-04-26T12:06:57.537 INFO:tasks.workunit.client.0.smithi052.stdout:4/592: dread d3/d12/d34/d45/f61 [0,4194304] 0 2024-04-26T12:06:57.538 INFO:tasks.workunit.client.0.smithi052.stdout:8/557: dwrite d0/d16/d28/f7d [0,4194304] 0 2024-04-26T12:06:57.538 INFO:tasks.workunit.client.0.smithi052.stdout:1/598: dwrite d0/d2/dd/d40/dc1/f57 [0,4194304] 0 2024-04-26T12:06:57.538 INFO:tasks.workunit.client.0.smithi052.stdout:3/574: truncate d2/d4/d2a/d2d/f78 490651 0 2024-04-26T12:06:57.538 INFO:tasks.workunit.client.0.smithi052.stdout:7/624: dread - d1/d1c/d21/d2f/d33/f95 zero size 2024-04-26T12:06:57.539 INFO:tasks.workunit.client.0.smithi052.stdout:4/593: creat d3/d22/d30/fc8 x:0 0 0 2024-04-26T12:06:57.543 INFO:tasks.workunit.client.0.smithi052.stdout:8/558: creat d0/d16/fb2 x:0 0 0 2024-04-26T12:06:57.544 INFO:tasks.workunit.client.0.smithi052.stdout:6/638: write da/d22/d3c/d74/d99/d92/fab [900849,53166] 0 2024-04-26T12:06:57.545 INFO:tasks.workunit.client.0.smithi052.stdout:1/599: dread d0/f4a [0,4194304] 0 2024-04-26T12:06:57.546 INFO:tasks.workunit.client.0.smithi052.stdout:9/645: write d3/db/d52/fb1 [224494,116876] 0 2024-04-26T12:06:57.546 INFO:tasks.workunit.client.0.smithi052.stdout:9/646: write d3/db/d10/d54/fdd [1060524,279] 0 2024-04-26T12:06:57.547 INFO:tasks.workunit.client.0.smithi052.stdout:9/647: chown d3/db/d10/d3c/c92 0 1 2024-04-26T12:06:57.550 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:57.550 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:57.556 INFO:tasks.workunit.client.0.smithi052.stdout:6/639: rename da/d22/d3c/d74/d99 to da/d22/d29/dd4/ddf 0 2024-04-26T12:06:57.556 INFO:tasks.workunit.client.0.smithi052.stdout:2/632: dread d0/d7/f10 [0,4194304] 0 2024-04-26T12:06:57.556 INFO:tasks.workunit.client.0.smithi052.stdout:8/559: mknod d0/d4/dc/d80/cb3 0 2024-04-26T12:06:57.556 INFO:tasks.workunit.client.0.smithi052.stdout:7/625: link d1/d1c/d21/d2f/d68/f91 d1/d1c/fc5 0 2024-04-26T12:06:57.558 INFO:tasks.workunit.client.0.smithi052.stdout:7/626: truncate d1/d1c/d23/d81/fa5 961813 0 2024-04-26T12:06:57.560 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:57.561 INFO:tasks.workunit.client.0.smithi052.stdout:1/600: creat d0/d2/dd/d34/fc7 x:0 0 0 2024-04-26T12:06:57.561 INFO:tasks.workunit.client.0.smithi052.stdout:8/560: fsync d0/d4/d5/db/d20/f24 0 2024-04-26T12:06:57.561 INFO:tasks.workunit.client.0.smithi052.stdout:2/633: creat d0/d3f/d56/d6d/d5a/d73/d4b/fd4 x:0 0 0 2024-04-26T12:06:57.562 INFO:tasks.workunit.client.0.smithi052.stdout:7/627: unlink d1/d1c/d21/d2f/d33/fb9 0 2024-04-26T12:06:57.562 INFO:tasks.workunit.client.0.smithi052.stdout:2/634: fsync d0/d3f/d56/d8d/d99/fc8 0 2024-04-26T12:06:57.564 INFO:tasks.workunit.client.0.smithi052.stdout:7/628: truncate d1/d1c/d21/d2f/fa7 951861 0 2024-04-26T12:06:57.565 INFO:tasks.workunit.client.0.smithi052.stdout:6/640: mkdir da/d22/d3c/d74/dcf/de0 0 2024-04-26T12:06:57.565 INFO:tasks.workunit.client.0.smithi052.stdout:4/594: getdents d3/d12/d59/d96/dc0 0 2024-04-26T12:06:57.567 INFO:tasks.workunit.client.0.smithi052.stdout:6/641: write f2 [424107,34671] 0 2024-04-26T12:06:57.568 INFO:tasks.workunit.client.0.smithi052.stdout:5/633: truncate db/dc/d5f/f3a 3097468 0 2024-04-26T12:06:57.569 INFO:tasks.workunit.client.0.smithi052.stdout:8/561: rename d0/d4/dc/d45 to d0/d4/d5/d86/d9c/db4 0 2024-04-26T12:06:57.569 INFO:tasks.workunit.client.0.smithi052.stdout:6/642: write da/d22/d29/f5a [1222357,71035] 0 2024-04-26T12:06:57.570 INFO:tasks.workunit.client.0.smithi052.stdout:2/635: rename d0/d7/d16 to d0/d3f/d56/d6d/d5a/dd5 0 2024-04-26T12:06:57.571 INFO:tasks.workunit.client.0.smithi052.stdout:4/595: mknod d3/d22/cc9 0 2024-04-26T12:06:57.571 INFO:tasks.workunit.client.0.smithi052.stdout:5/634: write db/dd/d18/d60/f83 [1634791,4704] 0 2024-04-26T12:06:57.572 INFO:tasks.workunit.client.0.smithi052.stdout:6/643: write da/d22/d3c/f85 [405688,94050] 0 2024-04-26T12:06:57.573 INFO:tasks.workunit.client.0.smithi052.stdout:8/562: write d0/d4/d5/d86/d9c/db4/d75/f94 [557680,83821] 0 2024-04-26T12:06:57.573 INFO:tasks.workunit.client.0.smithi052.stdout:2/636: mknod d0/d7/d2f/d9b/cd6 0 2024-04-26T12:06:57.573 INFO:tasks.workunit.client.0.smithi052.stdout:4/596: mkdir d3/d12/d59/d6b/dca 0 2024-04-26T12:06:57.574 INFO:tasks.workunit.client.0.smithi052.stdout:8/563: chown d0/l5c 66566 1 2024-04-26T12:06:57.574 INFO:tasks.workunit.client.0.smithi052.stdout:7/629: dwrite d1/d1c/d21/d2f/d33/d3a/f40 [4194304,4194304] 0 2024-04-26T12:06:57.575 INFO:tasks.workunit.client.0.smithi052.stdout:2/637: creat d0/d3f/fd7 x:0 0 0 2024-04-26T12:06:57.576 INFO:tasks.workunit.client.0.smithi052.stdout:3/575: dwrite d2/d4/dc/d1d/d3f/f5e [0,4194304] 0 2024-04-26T12:06:57.576 INFO:tasks.workunit.client.0.smithi052.stdout:7/630: write d1/fa [3586259,26037] 0 2024-04-26T12:06:57.577 INFO:tasks.workunit.client.0.smithi052.stdout:5/635: rename db/dc/d5f/d50/d46/d74/l7c to db/dd/d34/d69/d8a/dc5/ld1 0 2024-04-26T12:06:57.577 INFO:tasks.workunit.client.0.smithi052.stdout:1/601: dwrite d0/d2/f6 [0,4194304] 0 2024-04-26T12:06:57.578 INFO:tasks.workunit.client.0.smithi052.stdout:2/638: symlink d0/d7/d2f/d9b/ld8 0 2024-04-26T12:06:57.578 INFO:tasks.workunit.client.0.smithi052.stdout:8/564: chown d0/d4/d5/d86/d9c/db4/d75/f94 427061 1 2024-04-26T12:06:57.578 INFO:tasks.workunit.client.0.smithi052.stdout:6/644: truncate da/d22/d29/dd4/ddf/d92/d96/fc8 90605 0 2024-04-26T12:06:57.578 INFO:tasks.workunit.client.0.smithi052.stdout:4/597: rename d3/d2e/f6e to d3/d12/d34/d91/fcb 0 2024-04-26T12:06:57.579 INFO:tasks.workunit.client.0.smithi052.stdout:8/565: chown d0/d4/d5/d27/d69/f9a 47928 1 2024-04-26T12:06:57.580 INFO:tasks.workunit.client.0.smithi052.stdout:5/636: mkdir db/dc/d5f/d50/d91/dd2 0 2024-04-26T12:06:57.581 INFO:tasks.workunit.client.0.smithi052.stdout:4/598: symlink d3/d12/lcc 0 2024-04-26T12:06:57.581 INFO:tasks.workunit.client.0.smithi052.stdout:6/645: rename da/d22/d29/d31/f54 to da/fe1 0 2024-04-26T12:06:57.582 INFO:tasks.workunit.client.0.smithi052.stdout:7/631: rename d1/d1c/d21/d2f/d68/l84 to d1/d1c/d23/d81/d88/lc6 0 2024-04-26T12:06:57.583 INFO:tasks.workunit.client.0.smithi052.stdout:4/599: mknod d3/d15/d76/ccd 0 2024-04-26T12:06:57.583 INFO:tasks.workunit.client.0.smithi052.stdout:8/566: mknod d0/d4/d5/daf/cb5 0 2024-04-26T12:06:57.583 INFO:tasks.workunit.client.0.smithi052.stdout:6/646: stat da/d22/d29/dd4/ddf/lae 0 2024-04-26T12:06:57.583 INFO:tasks.workunit.client.0.smithi052.stdout:5/637: symlink db/dd/ld3 0 2024-04-26T12:06:57.583 INFO:tasks.workunit.client.0.smithi052.stdout:3/576: rename d2/d4/d2a/d2d/d4d/f9e to d2/d4/d41/d5c/fae 0 2024-04-26T12:06:57.583 INFO:tasks.workunit.client.0.smithi052.stdout:4/600: write d3/d12/fa2 [1612798,53408] 0 2024-04-26T12:06:57.584 INFO:tasks.workunit.client.0.smithi052.stdout:8/567: creat d0/d4/d1c/d83/fb6 x:0 0 0 2024-04-26T12:06:57.584 INFO:tasks.workunit.client.0.smithi052.stdout:6/647: creat da/d22/d29/dd4/ddf/d7c/fe2 x:0 0 0 2024-04-26T12:06:57.584 INFO:tasks.workunit.client.0.smithi052.stdout:3/577: readlink d2/d4/d41/d59/la6 0 2024-04-26T12:06:57.585 INFO:tasks.workunit.client.0.smithi052.stdout:5/638: write db/dd/d34/d70/d59/f8c [250029,27388] 0 2024-04-26T12:06:57.585 INFO:tasks.workunit.client.0.smithi052.stdout:8/568: fsync d0/d4/d5/db/d20/d7b/f92 0 2024-04-26T12:06:57.585 INFO:tasks.workunit.client.0.smithi052.stdout:4/601: creat d3/d12/fce x:0 0 0 2024-04-26T12:06:57.585 INFO:tasks.workunit.client.0.smithi052.stdout:3/578: creat d2/d4/dc/d1d/d3f/da9/faf x:0 0 0 2024-04-26T12:06:57.586 INFO:tasks.workunit.client.0.smithi052.stdout:4/602: fdatasync d3/d2b/f7d 0 2024-04-26T12:06:57.586 INFO:tasks.workunit.client.0.smithi052.stdout:3/579: chown d2/c49 58 1 2024-04-26T12:06:57.587 INFO:tasks.workunit.client.0.smithi052.stdout:4/603: creat d3/d12/d34/d43/fcf x:0 0 0 2024-04-26T12:06:57.587 INFO:tasks.workunit.client.0.smithi052.stdout:6/648: truncate da/d22/d3c/d74/d7e/fc5 2456002 0 2024-04-26T12:06:57.588 INFO:tasks.workunit.client.0.smithi052.stdout:6/649: stat da/d63/ld6 0 2024-04-26T12:06:57.588 INFO:tasks.workunit.client.0.smithi052.stdout:3/580: rename d2/d4/d31 to d2/d4/dc/d1d/d3f/da9/db0 0 2024-04-26T12:06:57.590 INFO:tasks.workunit.client.0.smithi052.stdout:6/650: rename da/d22/d29/d31/f4a to da/d22/d29/dd4/fe3 0 2024-04-26T12:06:57.590 INFO:tasks.workunit.client.0.smithi052.stdout:3/581: write d2/d4/dc/d1d/d3f/da9/faf [510437,70024] 0 2024-04-26T12:06:57.591 INFO:tasks.workunit.client.0.smithi052.stdout:5/639: dwrite db/dc/d5f/d50/d46/d74/fa3 [4194304,4194304] 0 2024-04-26T12:06:57.591 INFO:tasks.workunit.client.0.smithi052.stdout:3/582: chown d2/d4 71512 1 2024-04-26T12:06:57.591 INFO:tasks.workunit.client.0.smithi052.stdout:3/583: stat d2/d4/c18 0 2024-04-26T12:06:57.591 INFO:tasks.workunit.client.0.smithi052.stdout:5/640: readlink db/l14 0 2024-04-26T12:06:57.591 INFO:tasks.workunit.client.0.smithi052.stdout:2/639: dread d0/d7/f3c [0,4194304] 0 2024-04-26T12:06:57.592 INFO:tasks.workunit.client.0.smithi052.stdout:6/651: rename da/d22/d3c/dd3 to da/d22/d29/dd4/ddf/d95/dd2/de4 0 2024-04-26T12:06:57.592 INFO:tasks.workunit.client.0.smithi052.stdout:3/584: chown d2/d4/dc/d1d/d25/d36/d1c/d4e 8276 1 2024-04-26T12:06:57.592 INFO:tasks.workunit.client.0.smithi052.stdout:5/641: rmdir db/dd/d34/d70/d78 39 2024-04-26T12:06:57.593 INFO:tasks.workunit.client.0.smithi052.stdout:2/640: rename d0/f21 to d0/d3f/d56/fd9 0 2024-04-26T12:06:57.593 INFO:tasks.workunit.client.0.smithi052.stdout:3/585: creat d2/d4/d41/d59/fb1 x:0 0 0 2024-04-26T12:06:57.594 INFO:tasks.workunit.client.0.smithi052.stdout:0/644: sync 2024-04-26T12:06:57.594 INFO:tasks.workunit.client.0.smithi052.stdout:5/642: write db/dd/d34/d69/f89 [1030554,45600] 0 2024-04-26T12:06:57.594 INFO:tasks.workunit.client.0.smithi052.stdout:6/652: unlink da/d5d/d64/fad 0 2024-04-26T12:06:57.594 INFO:tasks.workunit.client.0.smithi052.stdout:2/641: write d0/d3f/d56/d8d/fae [473561,92043] 0 2024-04-26T12:06:57.595 INFO:tasks.workunit.client.0.smithi052.stdout:6/653: write da/f43 [1786224,66276] 0 2024-04-26T12:06:57.596 INFO:tasks.workunit.client.0.smithi052.stdout:2/642: rename d0/d7/d22/f28 to d0/d36/dc1/fda 0 2024-04-26T12:06:57.596 INFO:tasks.workunit.client.0.smithi052.stdout:5/643: creat db/dd/d34/d69/d8a/da9/d87/d6e/db8/dce/fd4 x:0 0 0 2024-04-26T12:06:57.597 INFO:tasks.workunit.client.0.smithi052.stdout:6/654: truncate da/d22/d3c/d74/d7e/f98 387544 0 2024-04-26T12:06:57.597 INFO:tasks.workunit.client.0.smithi052.stdout:2/643: unlink d0/d3f/d56/d6d/d5a/dd5/f38 0 2024-04-26T12:06:57.599 INFO:tasks.workunit.client.0.smithi052.stdout:8/569: write d0/d4/f38 [187918,122409] 0 2024-04-26T12:06:57.599 INFO:tasks.workunit.client.0.smithi052.stdout:2/644: read d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/fbc [3727249,128879] 0 2024-04-26T12:06:57.601 INFO:tasks.workunit.client.0.smithi052.stdout:2/645: chown d0/d3f/d56/d6d/d5a/dd5/f24 979 1 2024-04-26T12:06:57.602 INFO:tasks.workunit.client.0.smithi052.stdout:7/632: dwrite d1/d1c/d21/d2f/d68/f91 [0,4194304] 0 2024-04-26T12:06:57.603 INFO:tasks.workunit.client.0.smithi052.stdout:7/633: readlink d1/d1c/d23/l6d 0 2024-04-26T12:06:57.603 INFO:tasks.workunit.client.0.smithi052.stdout:2/646: write d0/d3f/d56/d6d/d5a/d73/fcd [278711,32407] 0 2024-04-26T12:06:57.604 INFO:tasks.workunit.client.0.smithi052.stdout:8/570: write d0/d4/f4d [464104,41801] 0 2024-04-26T12:06:57.604 INFO:tasks.workunit.client.0.smithi052.stdout:7/634: write d1/d1c/d21/d2f/f48 [300484,77278] 0 2024-04-26T12:06:57.605 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:57.604+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:57.606 INFO:tasks.workunit.client.0.smithi052.stdout:2/647: truncate d0/d7/d2f/d9b/f7a 1161938 0 2024-04-26T12:06:57.609 INFO:tasks.workunit.client.0.smithi052.stdout:2/648: truncate d0/d3f/d56/d6d/d5a/dd5/f1c 3419464 0 2024-04-26T12:06:57.610 INFO:tasks.workunit.client.0.smithi052.stdout:7/635: dwrite d1/d1c/d21/f73 [4194304,4194304] 0 2024-04-26T12:06:57.610 INFO:tasks.workunit.client.0.smithi052.stdout:2/649: chown d0/d3f/d56/d6d/d5a/dd5/d3a/c67 120582046 1 2024-04-26T12:06:57.611 INFO:tasks.workunit.client.0.smithi052.stdout:7/636: dread - d1/d1c/d23/d81/d88/fac zero size 2024-04-26T12:06:57.612 INFO:tasks.workunit.client.0.smithi052.stdout:2/650: chown d0/d3f/d56/d6d/d5a/d82/f93 0 1 2024-04-26T12:06:57.612 INFO:tasks.workunit.client.0.smithi052.stdout:7/637: mkdir d1/d1c/d21/d2f/d33/dc7 0 2024-04-26T12:06:57.613 INFO:tasks.workunit.client.0.smithi052.stdout:3/586: dread d2/d4/d41/d59/f98 [0,4194304] 0 2024-04-26T12:06:57.613 INFO:tasks.workunit.client.0.smithi052.stdout:7/638: rmdir d1/d1c/d23/d81/d88 39 2024-04-26T12:06:57.614 INFO:tasks.workunit.client.0.smithi052.stdout:3/587: creat d2/d4/d41/fb2 x:0 0 0 2024-04-26T12:06:57.615 INFO:tasks.workunit.client.0.smithi052.stdout:4/604: dread d3/d12/d59/d96/dc0/f78 [0,4194304] 0 2024-04-26T12:06:57.616 INFO:tasks.workunit.client.0.smithi052.stdout:3/588: write d2/d4/dc/d33/d8a/f9b [751867,33374] 0 2024-04-26T12:06:57.617 INFO:tasks.workunit.client.0.smithi052.stdout:0/645: dread d0/d5b/d9d/d32/f78 [0,4194304] 0 2024-04-26T12:06:57.617 INFO:tasks.workunit.client.0.smithi052.stdout:4/605: write d3/d12/d34/d43/fb3 [269725,28361] 0 2024-04-26T12:06:57.617 INFO:tasks.workunit.client.0.smithi052.stdout:3/589: chown d2/d4/dc/d1d/f60 58361 1 2024-04-26T12:06:57.619 INFO:tasks.workunit.client.0.smithi052.stdout:2/651: dread d0/d3f/d56/d6d/fa0 [0,4194304] 0 2024-04-26T12:06:57.619 INFO:tasks.workunit.client.0.smithi052.stdout:4/606: link d3/d12/d34/d45/f47 d3/d2b/dab/db6/db7/fd0 0 2024-04-26T12:06:57.619 INFO:tasks.workunit.client.0.smithi052.stdout:8/571: dread d0/d4/f4d [0,4194304] 0 2024-04-26T12:06:57.619 INFO:tasks.workunit.client.0.smithi052.stdout:1/602: sync 2024-04-26T12:06:57.619 INFO:tasks.workunit.client.0.smithi052.stdout:9/648: sync 2024-04-26T12:06:57.620 INFO:tasks.workunit.client.0.smithi052.stdout:5/644: sync 2024-04-26T12:06:57.620 INFO:tasks.workunit.client.0.smithi052.stdout:4/607: creat d3/d12/d34/d45/d67/fd1 x:0 0 0 2024-04-26T12:06:57.620 INFO:tasks.workunit.client.0.smithi052.stdout:2/652: write d0/d3f/d56/d8d/d99/db9/fc4 [817525,128872] 0 2024-04-26T12:06:57.621 INFO:tasks.workunit.client.0.smithi052.stdout:1/603: stat d0/d2/dd/d40/d81/d52/f72 0 2024-04-26T12:06:57.621 INFO:tasks.workunit.client.0.smithi052.stdout:9/649: symlink d3/d3b/le0 0 2024-04-26T12:06:57.621 INFO:tasks.workunit.client.0.smithi052.stdout:8/572: link d0/d4/d5/d27/d69/f9a d0/d4/d1c/fb7 0 2024-04-26T12:06:57.623 INFO:tasks.workunit.client.0.smithi052.stdout:2/653: link d0/d3f/d56/d6d/d5a/dd5/d4d/f94 d0/d3f/d56/d6d/fdb 0 2024-04-26T12:06:57.625 INFO:tasks.workunit.client.0.smithi052.stdout:8/573: rename d0/d4/dc/l60 to d0/d4/d5/d86/d9c/db4/d58/d89/lb8 0 2024-04-26T12:06:57.625 INFO:tasks.workunit.client.0.smithi052.stdout:2/654: fsync d0/d3f/d56/d6d/d5a/dd5/f1a 0 2024-04-26T12:06:57.627 INFO:tasks.workunit.client.0.smithi052.stdout:5/645: dwrite db/dd/d34/f57 [0,4194304] 0 2024-04-26T12:06:57.627 INFO:tasks.workunit.client.0.smithi052.stdout:4/608: dwrite d3/d2e/f4d [0,4194304] 0 2024-04-26T12:06:57.627 INFO:tasks.workunit.client.0.smithi052.stdout:8/574: fsync d0/d16/d28/f6a 0 2024-04-26T12:06:57.627 INFO:tasks.workunit.client.0.smithi052.stdout:1/604: truncate d0/d2/f2a 9312915 0 2024-04-26T12:06:57.629 INFO:tasks.workunit.client.0.smithi052.stdout:4/609: mkdir d3/d1f/d21/dd2 0 2024-04-26T12:06:57.629 INFO:tasks.workunit.client.0.smithi052.stdout:1/605: fdatasync d0/da/d2e/fa8 0 2024-04-26T12:06:57.629 INFO:tasks.workunit.client.0.smithi052.stdout:2/655: creat d0/d7/fdc x:0 0 0 2024-04-26T12:06:57.629 INFO:tasks.workunit.client.0.smithi052.stdout:5/646: mknod db/dc/d5f/d50/d91/cd5 0 2024-04-26T12:06:57.630 INFO:tasks.workunit.client.0.smithi052.stdout:4/610: mkdir d3/d15/dd3 0 2024-04-26T12:06:57.631 INFO:tasks.workunit.client.0.smithi052.stdout:1/606: symlink d0/d1e/lc8 0 2024-04-26T12:06:57.631 INFO:tasks.workunit.client.0.smithi052.stdout:9/650: dwrite d3/db/d10/d3c/d40/d96/db5/d8f/f5e [0,4194304] 0 2024-04-26T12:06:57.631 INFO:tasks.workunit.client.0.smithi052.stdout:8/575: getdents d0/d4/d5/d86/d9c/db4 0 2024-04-26T12:06:57.631 INFO:tasks.workunit.client.0.smithi052.stdout:2/656: unlink d0/d3f/d56/d6d/d5a/dd5/d3a/f8a 0 2024-04-26T12:06:57.632 INFO:tasks.workunit.client.0.smithi052.stdout:5/647: mkdir db/dd/d34/d69/d8a/da9/dd6 0 2024-04-26T12:06:57.633 INFO:tasks.workunit.client.0.smithi052.stdout:7/639: sync 2024-04-26T12:06:57.633 INFO:tasks.workunit.client.0.smithi052.stdout:6/655: sync 2024-04-26T12:06:57.633 INFO:tasks.workunit.client.0.smithi052.stdout:4/611: sync 2024-04-26T12:06:57.634 INFO:tasks.workunit.client.0.smithi052.stdout:2/657: creat d0/d3f/d56/d6d/d5a/dd5/d4d/d8b/fdd x:0 0 0 2024-04-26T12:06:57.634 INFO:tasks.workunit.client.0.smithi052.stdout:9/651: rename d3/d3b/cc3 to d3/db/d10/d2e/ce1 0 2024-04-26T12:06:57.634 INFO:tasks.workunit.client.0.smithi052.stdout:3/590: dread d2/d1f/f2c [0,4194304] 0 2024-04-26T12:06:57.635 INFO:tasks.workunit.client.0.smithi052.stdout:9/652: creat d3/db/d2b/fe2 x:0 0 0 2024-04-26T12:06:57.636 INFO:tasks.workunit.client.0.smithi052.stdout:4/612: chown d3/d44/d4b/c63 995230 1 2024-04-26T12:06:57.636 INFO:tasks.workunit.client.0.smithi052.stdout:7/640: write d1/d1c/d21/f7f [747930,15527] 0 2024-04-26T12:06:57.638 INFO:tasks.workunit.client.0.smithi052.stdout:0/646: dread d0/d26/dc7/d97/fac [0,4194304] 0 2024-04-26T12:06:57.638 INFO:tasks.workunit.client.0.smithi052.stdout:8/576: rename d0/d4/d5/db/d20/d41/fad to d0/d4/d5/d27/fb9 0 2024-04-26T12:06:57.638 INFO:tasks.workunit.client.0.smithi052.stdout:5/648: dread db/dd/d34/f57 [0,4194304] 0 2024-04-26T12:06:57.638 INFO:tasks.workunit.client.0.smithi052.stdout:4/613: symlink d3/d22/d69/ld4 0 2024-04-26T12:06:57.639 INFO:tasks.workunit.client.0.smithi052.stdout:9/653: chown d3/db/d10/d2e/d5c/l86 3423002 1 2024-04-26T12:06:57.639 INFO:tasks.workunit.client.0.smithi052.stdout:6/656: link da/d22/d3c/d74/fa0 da/d22/d29/dd4/ddf/d7c/d94/fe5 0 2024-04-26T12:06:57.639 INFO:tasks.workunit.client.0.smithi052.stdout:0/647: mkdir d0/d1/d1a/dce 0 2024-04-26T12:06:57.639 INFO:tasks.workunit.client.0.smithi052.stdout:3/591: truncate d2/d4/d41/d59/f98 4995008 0 2024-04-26T12:06:57.639 INFO:tasks.workunit.client.0.smithi052.stdout:8/577: fsync d0/d16/f73 0 2024-04-26T12:06:57.639 INFO:tasks.workunit.client.0.smithi052.stdout:4/614: readlink d3/d44/l85 0 2024-04-26T12:06:57.643 INFO:tasks.workunit.client.0.smithi052.stdout:5/649: fdatasync db/dd/d34/d70/fc0 0 2024-04-26T12:06:57.643 INFO:tasks.workunit.client.0.smithi052.stdout:7/641: rename d1/d1c/d23/l6d to d1/d1c/d21/d2f/d33/dc7/lc8 0 2024-04-26T12:06:57.643 INFO:tasks.workunit.client.0.smithi052.stdout:7/642: sync 2024-04-26T12:06:57.643 INFO:tasks.workunit.client.0.smithi052.stdout:6/657: readlink da/d22/d29/dd4/ddf/d92/d96/lb5 0 2024-04-26T12:06:57.643 INFO:tasks.workunit.client.0.smithi052.stdout:8/578: truncate d0/f59 5519631 0 2024-04-26T12:06:57.643 INFO:tasks.workunit.client.0.smithi052.stdout:4/615: stat d3/d12/d34/d45/d67/d6c/l8d 0 2024-04-26T12:06:57.643 INFO:tasks.workunit.client.0.smithi052.stdout:0/648: stat d0/d1/d1a/d3b/c46 0 2024-04-26T12:06:57.644 INFO:tasks.workunit.client.0.smithi052.stdout:9/654: mknod d3/db/d10/d3c/d40/d96/db5/d8f/d49/ce3 0 2024-04-26T12:06:57.644 INFO:tasks.workunit.client.0.smithi052.stdout:3/592: creat d2/d4/dc/d1d/d25/d61/fb3 x:0 0 0 2024-04-26T12:06:57.644 INFO:tasks.workunit.client.0.smithi052.stdout:8/579: creat d0/d4/fba x:0 0 0 2024-04-26T12:06:57.644 INFO:tasks.workunit.client.0.smithi052.stdout:5/650: creat db/dc/d5f/d50/fd7 x:0 0 0 2024-04-26T12:06:57.644 INFO:tasks.workunit.client.0.smithi052.stdout:4/616: stat d3/d22/d30/fae 0 2024-04-26T12:06:57.644 INFO:tasks.workunit.client.0.smithi052.stdout:9/655: fdatasync d3/db/d4a/f4d 0 2024-04-26T12:06:57.644 INFO:tasks.workunit.client.0.smithi052.stdout:3/593: unlink d2/f3d 0 2024-04-26T12:06:57.644 INFO:tasks.workunit.client.0.smithi052.stdout:2/658: dwrite d0/d3f/d56/f64 [4194304,4194304] 0 2024-04-26T12:06:57.646 INFO:tasks.workunit.client.0.smithi052.stdout:4/617: mknod d3/d1f/d21/dd2/cd5 0 2024-04-26T12:06:57.646 INFO:tasks.workunit.client.0.smithi052.stdout:1/607: dread d0/d2/dd/d40/d81/d52/f72 [0,4194304] 0 2024-04-26T12:06:57.646 INFO:tasks.workunit.client.0.smithi052.stdout:8/580: rename d0/d16/d28/c54 to d0/d3e/cbb 0 2024-04-26T12:06:57.646 INFO:tasks.workunit.client.0.smithi052.stdout:3/594: unlink d2/d4/d6b/d7b/l8d 0 2024-04-26T12:06:57.646 INFO:tasks.workunit.client.0.smithi052.stdout:9/656: rename d3/d23/l25 to d3/db/d4a/dc6/le4 0 2024-04-26T12:06:57.646 INFO:tasks.workunit.client.0.smithi052.stdout:3/595: unlink d2/d4/dc/d68/c9d 0 2024-04-26T12:06:57.647 INFO:tasks.workunit.client.0.smithi052.stdout:7/643: truncate d1/fb 3852540 0 2024-04-26T12:06:57.647 INFO:tasks.workunit.client.0.smithi052.stdout:1/608: mknod d0/d2/dd/d40/dc1/d3c/d9b/cc9 0 2024-04-26T12:06:57.648 INFO:tasks.workunit.client.0.smithi052.stdout:9/657: symlink d3/d23/le5 0 2024-04-26T12:06:57.648 INFO:tasks.workunit.client.0.smithi052.stdout:3/596: mknod d2/d4/d2a/d2d/d4d/cb4 0 2024-04-26T12:06:57.649 INFO:tasks.workunit.client.0.smithi052.stdout:8/581: link d0/l90 d0/d4/d5/db/d20/d41/lbc 0 2024-04-26T12:06:57.649 INFO:tasks.workunit.client.0.smithi052.stdout:9/658: readlink d3/d3b/lae 0 2024-04-26T12:06:57.650 INFO:tasks.workunit.client.0.smithi052.stdout:3/597: dread - d2/d4/dc/d1d/d25/d61/fb3 zero size 2024-04-26T12:06:57.650 INFO:tasks.workunit.client.0.smithi052.stdout:2/659: dwrite d0/d7/fe [0,4194304] 0 2024-04-26T12:06:57.652 INFO:tasks.workunit.client.0.smithi052.stdout:8/582: read d0/d4/d5/d86/f93 [3145476,13125] 0 2024-04-26T12:06:57.652 INFO:tasks.workunit.client.0.smithi052.stdout:4/618: dread d3/d12/d34/d45/d67/d6c/d86/f93 [0,4194304] 0 2024-04-26T12:06:57.653 INFO:tasks.workunit.client.0.smithi052.stdout:3/598: mkdir d2/d4/d41/db5 0 2024-04-26T12:06:57.654 INFO:tasks.workunit.client.0.smithi052.stdout:9/659: creat d3/db/d10/d2e/fe6 x:0 0 0 2024-04-26T12:06:57.654 INFO:tasks.workunit.client.0.smithi052.stdout:1/609: truncate d0/d2/dd/d40/dc1/d1d/d91/fb1 394694 0 2024-04-26T12:06:57.654 INFO:tasks.workunit.client.0.smithi052.stdout:6/658: dwrite da/d22/d3c/d74/d7e/fc5 [0,4194304] 0 2024-04-26T12:06:57.655 INFO:tasks.workunit.client.0.smithi052.stdout:2/660: symlink d0/d3f/d56/d8d/lde 0 2024-04-26T12:06:57.655 INFO:tasks.workunit.client.0.smithi052.stdout:8/583: fsync d0/d4/d1c/fb7 0 2024-04-26T12:06:57.656 INFO:tasks.workunit.client.0.smithi052.stdout:3/599: mkdir d2/d4/d81/db6 0 2024-04-26T12:06:57.656 INFO:tasks.workunit.client.0.smithi052.stdout:2/661: read d0/d7/d2f/d9b/f6b [2427292,78325] 0 2024-04-26T12:06:57.657 INFO:tasks.workunit.client.0.smithi052.stdout:4/619: rename d3/d12/d59/d96/dc0/f97 to d3/d12/d34/d9b/fd6 0 2024-04-26T12:06:57.657 INFO:tasks.workunit.client.0.smithi052.stdout:3/600: read d2/d4/dc/f6f [1521420,98176] 0 2024-04-26T12:06:57.658 INFO:tasks.workunit.client.0.smithi052.stdout:1/610: write d0/d83/d4b/d56/f9d [440821,7373] 0 2024-04-26T12:06:57.658 INFO:tasks.workunit.client.0.smithi052.stdout:8/584: creat d0/d4/d5/d86/d9c/db4/d75/fbd x:0 0 0 2024-04-26T12:06:57.659 INFO:tasks.workunit.client.0.smithi052.stdout:7/644: dwrite d1/f18 [0,4194304] 0 2024-04-26T12:06:57.660 INFO:tasks.workunit.client.0.smithi052.stdout:1/611: chown d0/d83/d4b/l6a 1135483 1 2024-04-26T12:06:57.660 INFO:tasks.workunit.client.0.smithi052.stdout:3/601: mkdir d2/d4/d2a/d99/db7 0 2024-04-26T12:06:57.662 INFO:tasks.workunit.client.0.smithi052.stdout:8/585: getdents d0/d4/d5 0 2024-04-26T12:06:57.663 INFO:tasks.workunit.client.0.smithi052.stdout:8/586: fdatasync d0/f64 0 2024-04-26T12:06:57.665 INFO:tasks.workunit.client.0.smithi052.stdout:3/602: truncate d2/d4/dc/f6f 4312711 0 2024-04-26T12:06:57.666 INFO:tasks.workunit.client.0.smithi052.stdout:6/659: dwrite da/d22/d29/dd4/ddf/d7c/fc0 [0,4194304] 0 2024-04-26T12:06:57.667 INFO:tasks.workunit.client.0.smithi052.stdout:4/620: dwrite d3/d15/d76/fb2 [0,4194304] 0 2024-04-26T12:06:57.667 INFO:tasks.workunit.client.0.smithi052.stdout:8/587: write d0/d4/d5/d27/d57/f88 [8679671,60517] 0 2024-04-26T12:06:57.667 INFO:tasks.workunit.client.0.smithi052.stdout:2/662: dwrite d0/d7/f95 [0,4194304] 0 2024-04-26T12:06:57.670 INFO:tasks.workunit.client.0.smithi052.stdout:6/660: mkdir da/d5d/d64/de6 0 2024-04-26T12:06:57.671 INFO:tasks.workunit.client.0.smithi052.stdout:4/621: mknod d3/d22/d30/cd7 0 2024-04-26T12:06:57.671 INFO:tasks.workunit.client.0.smithi052.stdout:2/663: write d0/d3f/d56/d8d/f9d [539240,52248] 0 2024-04-26T12:06:57.671 INFO:tasks.workunit.client.0.smithi052.stdout:8/588: chown d0/d4/dc/d68/f6e 13886 1 2024-04-26T12:06:57.671 INFO:tasks.workunit.client.0.smithi052.stdout:4/622: read - d3/d12/d34/d45/d67/fd1 zero size 2024-04-26T12:06:57.672 INFO:tasks.workunit.client.0.smithi052.stdout:2/664: symlink d0/d3f/d56/d8d/d99/ldf 0 2024-04-26T12:06:57.672 INFO:tasks.workunit.client.0.smithi052.stdout:0/649: dread d0/d1/dd/f19 [0,4194304] 0 2024-04-26T12:06:57.672 INFO:tasks.workunit.client.0.smithi052.stdout:6/661: rmdir da/d22/d29/dd4/ddf/d95/dd2/de4 0 2024-04-26T12:06:57.673 INFO:tasks.workunit.client.0.smithi052.stdout:7/645: dwrite d1/fb [0,4194304] 0 2024-04-26T12:06:57.674 INFO:tasks.workunit.client.0.smithi052.stdout:0/650: creat d0/d26/d85/fcf x:0 0 0 2024-04-26T12:06:57.675 INFO:tasks.workunit.client.0.smithi052.stdout:2/665: creat d0/d3f/d56/d6d/d5a/fe0 x:0 0 0 2024-04-26T12:06:57.675 INFO:tasks.workunit.client.0.smithi052.stdout:6/662: chown da/d22/d29/d31/d6f/c75 24801 1 2024-04-26T12:06:57.676 INFO:tasks.workunit.client.0.smithi052.stdout:0/651: fsync d0/fe 0 2024-04-26T12:06:57.676 INFO:tasks.workunit.client.0.smithi052.stdout:7/646: rename d1/d1c/d23/f25 to d1/d1c/d65/fc9 0 2024-04-26T12:06:57.677 INFO:tasks.workunit.client.0.smithi052.stdout:2/666: write d0/d7/fe [705839,1102] 0 2024-04-26T12:06:57.677 INFO:tasks.workunit.client.0.smithi052.stdout:7/647: fdatasync d1/f6 0 2024-04-26T12:06:57.677 INFO:tasks.workunit.client.0.smithi052.stdout:5/651: dread db/dd/d34/d69/d8a/f8b [0,4194304] 0 2024-04-26T12:06:57.678 INFO:tasks.workunit.client.0.smithi052.stdout:6/663: write da/d22/d29/dd4/ddf/f70 [314200,30431] 0 2024-04-26T12:06:57.678 INFO:tasks.workunit.client.0.smithi052.stdout:8/589: dwrite d0/d16/d28/f7d [0,4194304] 0 2024-04-26T12:06:57.679 INFO:tasks.workunit.client.0.smithi052.stdout:0/652: rename d0/d1/d1a/d20/fb5 to d0/d5b/fd0 0 2024-04-26T12:06:57.680 INFO:tasks.workunit.client.0.smithi052.stdout:7/648: unlink d1/d1c/d21/d2f/d33/f95 0 2024-04-26T12:06:57.681 INFO:tasks.workunit.client.0.smithi052.stdout:8/590: link d0/f59 d0/d4/d5/d86/d9c/db4/d58/fbe 0 2024-04-26T12:06:57.681 INFO:tasks.workunit.client.0.smithi052.stdout:7/649: chown d1/d1c/d23/d81/caa 1396640 1 2024-04-26T12:06:57.682 INFO:tasks.workunit.client.0.smithi052.stdout:6/664: dread da/d22/d29/d31/f4f [0,4194304] 0 2024-04-26T12:06:57.682 INFO:tasks.workunit.client.0.smithi052.stdout:8/591: write d0/f71 [682041,79381] 0 2024-04-26T12:06:57.683 INFO:tasks.workunit.client.0.smithi052.stdout:7/650: getdents d1/db7 0 2024-04-26T12:06:57.683 INFO:tasks.workunit.client.0.smithi052.stdout:8/592: mkdir d0/d4/d5/dbf 0 2024-04-26T12:06:57.684 INFO:tasks.workunit.client.0.smithi052.stdout:0/653: truncate d0/d1/dd/fab 1823756 0 2024-04-26T12:06:57.685 INFO:tasks.workunit.client.0.smithi052.stdout:6/665: creat da/d22/d29/dd4/ddf/d92/d96/fe7 x:0 0 0 2024-04-26T12:06:57.685 INFO:tasks.workunit.client.0.smithi052.stdout:5/652: read db/dd/d34/d69/fa6 [1621972,102378] 0 2024-04-26T12:06:57.685 INFO:tasks.workunit.client.0.smithi052.stdout:6/666: truncate da/f53 1629789 0 2024-04-26T12:06:57.686 INFO:tasks.workunit.client.0.smithi052.stdout:0/654: unlink d0/d1/d11/l96 0 2024-04-26T12:06:57.686 INFO:tasks.workunit.client.0.smithi052.stdout:6/667: chown da/d51 0 1 2024-04-26T12:06:57.687 INFO:tasks.workunit.client.0.smithi052.stdout:4/623: fsync d3/d15/d76/fb2 0 2024-04-26T12:06:57.687 INFO:tasks.workunit.client.0.smithi052.stdout:6/668: dread - da/d22/d3c/d74/d87/fdc zero size 2024-04-26T12:06:57.687 INFO:tasks.workunit.client.0.smithi052.stdout:0/655: link d0/d1/d52/c53 d0/d1/d1a/cd1 0 2024-04-26T12:06:57.690 INFO:tasks.workunit.client.0.smithi052.stdout:5/653: dwrite db/dd/d34/d69/d93/f58 [4194304,4194304] 0 2024-04-26T12:06:57.691 INFO:tasks.workunit.client.0.smithi052.stdout:5/654: creat db/dd/d34/d69/dcc/fd8 x:0 0 0 2024-04-26T12:06:57.692 INFO:tasks.workunit.client.0.smithi052.stdout:8/593: creat d0/d4/d5/db/d20/d41/fc0 x:0 0 0 2024-04-26T12:06:57.692 INFO:tasks.workunit.client.0.smithi052.stdout:8/594: fdatasync d0/f59 0 2024-04-26T12:06:57.693 INFO:tasks.workunit.client.0.smithi052.stdout:2/667: dread d0/d3f/d56/d6d/fdb [0,4194304] 0 2024-04-26T12:06:57.694 INFO:tasks.workunit.client.0.smithi052.stdout:5/655: mknod db/dd/d34/d69/d8a/dc5/cd9 0 2024-04-26T12:06:57.694 INFO:tasks.workunit.client.0.smithi052.stdout:2/668: chown d0/d3f/d56/d6d/fa0 20 1 2024-04-26T12:06:57.694 INFO:tasks.workunit.client.0.smithi052.stdout:9/660: dread d3/db/d13/f51 [8388608,4194304] 0 2024-04-26T12:06:57.695 INFO:tasks.workunit.client.0.smithi052.stdout:1/612: dread d0/d2/dd/f6e [0,4194304] 0 2024-04-26T12:06:57.695 INFO:tasks.workunit.client.0.smithi052.stdout:5/656: chown db/dc/d5f/d50/l85 641 1 2024-04-26T12:06:57.697 INFO:tasks.workunit.client.0.smithi052.stdout:8/595: sync 2024-04-26T12:06:57.697 INFO:tasks.workunit.client.0.smithi052.stdout:9/661: mknod d3/db/d10/daa/ce7 0 2024-04-26T12:06:57.697 INFO:tasks.workunit.client.0.smithi052.stdout:2/669: fsync d0/d3f/d56/d6d/d5a/d73/d4b/d8f/fa1 0 2024-04-26T12:06:57.698 INFO:tasks.workunit.client.0.smithi052.stdout:1/613: write d0/f55 [2092502,126930] 0 2024-04-26T12:06:57.698 INFO:tasks.workunit.client.0.smithi052.stdout:5/657: mkdir db/dd/d18/dda 0 2024-04-26T12:06:57.698 INFO:tasks.workunit.client.0.smithi052.stdout:2/670: fdatasync d0/d3f/d56/d6d/f7b 0 2024-04-26T12:06:57.698 INFO:tasks.workunit.client.0.smithi052.stdout:9/662: fsync d3/db/d10/f85 0 2024-04-26T12:06:57.698 INFO:tasks.workunit.client.0.smithi052.stdout:8/596: creat d0/d4/d5/d27/d57/fc1 x:0 0 0 2024-04-26T12:06:57.699 INFO:tasks.workunit.client.0.smithi052.stdout:2/671: truncate d0/d7/d22/f23 902659 0 2024-04-26T12:06:57.699 INFO:tasks.workunit.client.0.smithi052.stdout:8/597: mknod d0/d4/dc/d80/cc2 0 2024-04-26T12:06:57.700 INFO:tasks.workunit.client.0.smithi052.stdout:9/663: rename d3/db/d10/d3c/d40/d96/l9b to d3/db/d10/d3c/d40/d96/da7/le8 0 2024-04-26T12:06:57.700 INFO:tasks.workunit.client.0.smithi052.stdout:2/672: getdents d0/d3f/d56/d6d/d5a/dd5/d4d/d8b 0 2024-04-26T12:06:57.701 INFO:tasks.workunit.client.0.smithi052.stdout:1/614: dwrite d0/d83/f27 [0,4194304] 0 2024-04-26T12:06:57.702 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:57.699+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:57.703 INFO:tasks.workunit.client.0.smithi052.stdout:1/615: fdatasync d0/d2/dd/d40/dc1/d1d/f50 0 2024-04-26T12:06:57.703 INFO:tasks.workunit.client.0.smithi052.stdout:2/673: write d0/d3f/d56/d6d/d5a/dd5/f1a [1546697,53390] 0 2024-04-26T12:06:57.703 INFO:tasks.workunit.client.0.smithi052.stdout:3/603: dread d2/d4/dc/d33/d37/f51 [4194304,4194304] 0 2024-04-26T12:06:57.703 INFO:tasks.workunit.client.0.smithi052.stdout:1/616: creat d0/d2/dd/fca x:0 0 0 2024-04-26T12:06:57.703 INFO:tasks.workunit.client.0.smithi052.stdout:2/674: getdents d0/d3f/d56/d8d 0 2024-04-26T12:06:57.705 INFO:tasks.workunit.client.0.smithi052.stdout:8/598: dread d0/d4/d5/d86/d9c/db4/d75/f94 [0,4194304] 0 2024-04-26T12:06:57.705 INFO:tasks.workunit.client.0.smithi052.stdout:3/604: symlink d2/d4/d2a/d96/lb8 0 2024-04-26T12:06:57.705 INFO:tasks.workunit.client.0.smithi052.stdout:7/651: truncate d1/dab/d4c/f4f 3380609 0 2024-04-26T12:06:57.705 INFO:tasks.workunit.client.0.smithi052.stdout:4/624: truncate d3/d22/d30/f42 480937 0 2024-04-26T12:06:57.705 INFO:tasks.workunit.client.0.smithi052.stdout:6/669: write da/f1c [1663271,81732] 0 2024-04-26T12:06:57.705 INFO:tasks.workunit.client.0.smithi052.stdout:2/675: mknod d0/d3f/d56/d6d/d5a/dd5/ce1 0 2024-04-26T12:06:57.705 INFO:tasks.workunit.client.0.smithi052.stdout:0/656: truncate d0/d3c/f80 1784468 0 2024-04-26T12:06:57.706 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:57.706 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:57.707 INFO:tasks.workunit.client.0.smithi052.stdout:4/625: mknod d3/d2b/dab/cd8 0 2024-04-26T12:06:57.707 INFO:tasks.workunit.client.0.smithi052.stdout:3/605: fdatasync d2/d4/d2a/d2d/f78 0 2024-04-26T12:06:57.707 INFO:tasks.workunit.client.0.smithi052.stdout:5/658: write db/dd/d34/d70/fca [977562,20825] 0 2024-04-26T12:06:57.707 INFO:tasks.workunit.client.0.smithi052.stdout:0/657: fsync d0/d5a/f88 0 2024-04-26T12:06:57.707 INFO:tasks.workunit.client.0.smithi052.stdout:2/676: mkdir d0/d3f/d56/d6d/d5a/d82/de2 0 2024-04-26T12:06:57.707 INFO:tasks.workunit.client.0.smithi052.stdout:8/599: rmdir d0/d4/dc 39 2024-04-26T12:06:57.707 INFO:tasks.workunit.client.0.smithi052.stdout:9/664: truncate d3/db/d10/d54/f93 382144 0 2024-04-26T12:06:57.708 INFO:tasks.workunit.client.0.smithi052.stdout:1/617: truncate d0/f4a 2480670 0 2024-04-26T12:06:57.708 INFO:tasks.workunit.client.0.smithi052.stdout:3/606: write d2/d4/d41/d59/fb1 [926127,48328] 0 2024-04-26T12:06:57.708 INFO:tasks.workunit.client.0.smithi052.stdout:0/658: mkdir d0/d3d/dd2 0 2024-04-26T12:06:57.709 INFO:tasks.workunit.client.0.smithi052.stdout:8/600: symlink d0/d4/d5/db/lc3 0 2024-04-26T12:06:57.709 INFO:tasks.workunit.client.0.smithi052.stdout:7/652: dread d1/d1c/d23/d81/d88/f8a [0,4194304] 0 2024-04-26T12:06:57.710 INFO:tasks.workunit.client.0.smithi052.stdout:6/670: link da/d22/d29/l7b da/d22/d29/dd4/ddf/d92/d96/le8 0 2024-04-26T12:06:57.711 INFO:tasks.workunit.client.0.smithi052.stdout:2/677: rename d0/d3f/d56/d8d/lde to d0/d3f/d56/d8d/d99/db9/le3 0 2024-04-26T12:06:57.711 INFO:tasks.workunit.client.0.smithi052.stdout:1/618: write d0/d2/d88/fb4 [795165,20902] 0 2024-04-26T12:06:57.712 INFO:tasks.workunit.client.0.smithi052.stdout:5/659: link db/dd/d34/d69/fa6 db/dc/d5f/d50/d46/d74/dbe/fdb 0 2024-04-26T12:06:57.712 INFO:tasks.workunit.client.0.smithi052.stdout:8/601: stat d0/d16/f23 0 2024-04-26T12:06:57.712 INFO:tasks.workunit.client.0.smithi052.stdout:0/659: creat d0/d5b/d9d/d4f/da4/da9/fd3 x:0 0 0 2024-04-26T12:06:57.713 INFO:tasks.workunit.client.0.smithi052.stdout:4/626: dwrite d3/d12/fce [0,4194304] 0 2024-04-26T12:06:57.714 INFO:tasks.workunit.client.0.smithi052.stdout:3/607: link d2/d4/dc/d1d/d25/d36/d1c/f20 d2/d4/d2a/fb9 0 2024-04-26T12:06:57.714 INFO:tasks.workunit.client.0.smithi052.stdout:7/653: write d1/dab/d4c/fae [262805,127772] 0 2024-04-26T12:06:57.714 INFO:tasks.workunit.client.0.smithi052.stdout:5/660: write db/f35 [4916330,126707] 0 2024-04-26T12:06:57.715 INFO:tasks.workunit.client.0.smithi052.stdout:8/602: dread - d0/d16/d63/f95 zero size 2024-04-26T12:06:57.715 INFO:tasks.workunit.client.0.smithi052.stdout:1/619: chown d0/d2/dd/d34/d95 61 1 2024-04-26T12:06:57.716 INFO:tasks.workunit.client.0.smithi052.stdout:0/660: creat d0/d26/dbe/fd4 x:0 0 0 2024-04-26T12:06:57.716 INFO:tasks.workunit.client.0.smithi052.stdout:8/603: stat d0/l62 0 2024-04-26T12:06:57.717 INFO:tasks.workunit.client.0.smithi052.stdout:7/654: creat d1/d1f/d55/fca x:0 0 0 2024-04-26T12:06:57.718 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:57.719 INFO:tasks.workunit.client.0.smithi052.stdout:3/608: write d2/d4/dc/d33/fa0 [1481683,6816] 0 2024-04-26T12:06:57.719 INFO:tasks.workunit.client.0.smithi052.stdout:4/627: creat d3/d12/d34/d43/dc6/fd9 x:0 0 0 2024-04-26T12:06:57.720 INFO:tasks.workunit.client.0.smithi052.stdout:6/671: dwrite da/f1b [0,4194304] 0 2024-04-26T12:06:57.720 INFO:tasks.workunit.client.0.smithi052.stdout:1/620: mkdir d0/da/db5/dcb 0 2024-04-26T12:06:57.720 INFO:tasks.workunit.client.0.smithi052.stdout:9/665: dwrite d3/db/d10/d2e/fe6 [0,4194304] 0 2024-04-26T12:06:57.720 INFO:tasks.workunit.client.0.smithi052.stdout:5/661: mknod db/dd/d34/d69/d8a/dc5/cdc 0 2024-04-26T12:06:57.720 INFO:tasks.workunit.client.0.smithi052.stdout:0/661: symlink d0/d1/d2c/ld5 0 2024-04-26T12:06:57.721 INFO:tasks.workunit.client.0.smithi052.stdout:9/666: dread - d3/db/d2b/fce zero size 2024-04-26T12:06:57.722 INFO:tasks.workunit.client.0.smithi052.stdout:8/604: link d0/d4/d5/f8c d0/d16/d63/d8b/fc4 0 2024-04-26T12:06:57.722 INFO:tasks.workunit.client.0.smithi052.stdout:0/662: readlink d0/d26/d74/db4/lcc 0 2024-04-26T12:06:57.723 INFO:tasks.workunit.client.0.smithi052.stdout:2/678: dwrite d0/d3f/d56/d6d/d5a/dd5/f1a [0,4194304] 0 2024-04-26T12:06:57.724 INFO:tasks.workunit.client.0.smithi052.stdout:8/605: rmdir d0/d4/dc 39 2024-04-26T12:06:57.724 INFO:tasks.workunit.client.0.smithi052.stdout:7/655: truncate d1/d1f/d55/fbc 1598361 0 2024-04-26T12:06:57.725 INFO:tasks.workunit.client.0.smithi052.stdout:5/662: truncate db/dd/f73 1702 0 2024-04-26T12:06:57.725 INFO:tasks.workunit.client.0.smithi052.stdout:2/679: truncate d0/d36/f96 159001 0 2024-04-26T12:06:57.726 INFO:tasks.workunit.client.0.smithi052.stdout:8/606: write d0/d4/d5/db/d20/f7f [896698,76897] 0 2024-04-26T12:06:57.726 INFO:tasks.workunit.client.0.smithi052.stdout:7/656: stat d1/d1c/d23/d81/d88/f8a 0 2024-04-26T12:06:57.726 INFO:tasks.workunit.client.0.smithi052.stdout:2/680: mkdir d0/d3f/d56/d6d/d5a/de4 0 2024-04-26T12:06:57.727 INFO:tasks.workunit.client.0.smithi052.stdout:4/628: dwrite d3/d15/f2a [0,4194304] 0 2024-04-26T12:06:57.727 INFO:tasks.workunit.client.0.smithi052.stdout:5/663: creat db/dd/d34/d69/d8a/da9/dd6/fdd x:0 0 0 2024-04-26T12:06:57.729 INFO:tasks.workunit.client.0.smithi052.stdout:5/664: stat db/dd/d18/c72 0 2024-04-26T12:06:57.729 INFO:tasks.workunit.client.0.smithi052.stdout:8/607: link d0/d16/d63/d8b/fc4 d0/d4/d1c/fc5 0 2024-04-26T12:06:57.729 INFO:tasks.workunit.client.0.smithi052.stdout:5/665: fsync db/dd/d34/d70/fc0 0 2024-04-26T12:06:57.729 INFO:tasks.workunit.client.0.smithi052.stdout:4/629: rename d3/d44/d4b/c63 to d3/d44/d4b/cda 0 2024-04-26T12:06:57.730 INFO:tasks.workunit.client.0.smithi052.stdout:2/681: getdents d0/d7/d2f 0 2024-04-26T12:06:57.730 INFO:tasks.workunit.client.0.smithi052.stdout:8/608: chown d0/d4/dc/d68/d84 3658991 1 2024-04-26T12:06:57.730 INFO:tasks.workunit.client.0.smithi052.stdout:7/657: dread d1/f18 [0,4194304] 0 2024-04-26T12:06:57.731 INFO:tasks.workunit.client.0.smithi052.stdout:5/666: write db/dd/d18/d60/d64/d9c/fac [117243,29322] 0 2024-04-26T12:06:57.731 INFO:tasks.workunit.client.0.smithi052.stdout:8/609: fsync d0/d4/d5/db/f5e 0 2024-04-26T12:06:57.732 INFO:tasks.workunit.client.0.smithi052.stdout:5/667: chown db/dd/d34/d70/d59/c86 45075769 1 2024-04-26T12:06:57.733 INFO:tasks.workunit.client.0.smithi052.stdout:5/668: creat db/dd/d34/d69/d8a/da9/dd6/fde x:0 0 0 2024-04-26T12:06:57.733 INFO:tasks.workunit.client.0.smithi052.stdout:0/663: read d0/d3c/f80 [1158019,115038] 0 2024-04-26T12:06:57.734 INFO:tasks.workunit.client.0.smithi052.stdout:0/664: unlink d0/cb3 0 2024-04-26T12:06:57.735 INFO:tasks.workunit.client.0.smithi052.stdout:7/658: write d1/ff [1001678,63718] 0 2024-04-26T12:06:57.736 INFO:tasks.workunit.client.0.smithi052.stdout:7/659: mkdir d1/d1f/d55/dcb 0 2024-04-26T12:06:57.736 INFO:tasks.workunit.client.0.smithi052.stdout:4/630: dwrite d3/d12/f18 [0,4194304] 0 2024-04-26T12:06:57.736 INFO:tasks.workunit.client.0.smithi052.stdout:5/669: dread db/dc/d5f/f2f [0,4194304] 0 2024-04-26T12:06:57.737 INFO:tasks.workunit.client.0.smithi052.stdout:7/660: write d1/d1f/d55/fbc [398445,119216] 0 2024-04-26T12:06:57.737 INFO:tasks.workunit.client.0.smithi052.stdout:4/631: stat d3/d1f/d21/faf 0 2024-04-26T12:06:57.738 INFO:tasks.workunit.client.0.smithi052.stdout:4/632: creat d3/d44/d4b/db8/fdb x:0 0 0 2024-04-26T12:06:57.739 INFO:tasks.workunit.client.0.smithi052.stdout:4/633: rmdir d3/d12/d34/d91 39 2024-04-26T12:06:57.739 INFO:tasks.workunit.client.0.smithi052.stdout:3/609: read d2/d4/d2a/fb9 [1540016,18608] 0 2024-04-26T12:06:57.741 INFO:tasks.workunit.client.0.smithi052.stdout:4/634: symlink d3/d1f/ldc 0 2024-04-26T12:06:57.741 INFO:tasks.workunit.client.0.smithi052.stdout:3/610: stat d2/d4/dc/d33/c91 0 2024-04-26T12:06:57.742 INFO:tasks.workunit.client.0.smithi052.stdout:5/670: read db/dc/f54 [718083,86015] 0 2024-04-26T12:06:57.742 INFO:tasks.workunit.client.0.smithi052.stdout:8/610: dwrite d0/d4/d1c/fb7 [0,4194304] 0 2024-04-26T12:06:57.743 INFO:tasks.workunit.client.0.smithi052.stdout:3/611: chown d2/d4/dc/c45 921 1 2024-04-26T12:06:57.745 INFO:tasks.workunit.client.0.smithi052.stdout:7/661: dwrite d1/d1c/d65/fc9 [0,4194304] 0 2024-04-26T12:06:57.746 INFO:tasks.workunit.client.0.smithi052.stdout:8/611: truncate d0/d4/f4d 1686801 0 2024-04-26T12:06:57.746 INFO:tasks.workunit.client.0.smithi052.stdout:5/671: link db/dc/f12 db/dd/fdf 0 2024-04-26T12:06:57.746 INFO:tasks.workunit.client.0.smithi052.stdout:3/612: symlink d2/d4/dc/lba 0 2024-04-26T12:06:57.746 INFO:tasks.workunit.client.0.smithi052.stdout:8/612: readlink d0/d3e/l50 0 2024-04-26T12:06:57.747 INFO:tasks.workunit.client.0.smithi052.stdout:2/682: dread d0/d3f/d56/d6d/d5a/d82/f93 [0,4194304] 0 2024-04-26T12:06:57.747 INFO:tasks.workunit.client.0.smithi052.stdout:7/662: mknod d1/d1c/d21/d2f/d33/ccc 0 2024-04-26T12:06:57.748 INFO:tasks.workunit.client.0.smithi052.stdout:8/613: symlink d0/d3e/lc6 0 2024-04-26T12:06:57.749 INFO:tasks.workunit.client.0.smithi052.stdout:2/683: truncate d0/f4 4366471 0 2024-04-26T12:06:57.750 INFO:tasks.workunit.client.0.smithi052.stdout:8/614: fdatasync d0/d4/d5/d27/d57/fc1 0 2024-04-26T12:06:57.750 INFO:tasks.workunit.client.0.smithi052.stdout:7/663: write d1/d1f/d55/fca [247289,49024] 0 2024-04-26T12:06:57.751 INFO:tasks.workunit.client.0.smithi052.stdout:4/635: dwrite d3/d12/d34/d43/f7b [0,4194304] 0 2024-04-26T12:06:57.753 INFO:tasks.workunit.client.0.smithi052.stdout:2/684: truncate d0/d7/d2f/f78 904894 0 2024-04-26T12:06:57.753 INFO:tasks.workunit.client.0.smithi052.stdout:4/636: write d3/d12/d34/d43/fb3 [472441,123262] 0 2024-04-26T12:06:57.753 INFO:tasks.workunit.client.0.smithi052.stdout:1/621: dread d0/f64 [0,4194304] 0 2024-04-26T12:06:57.754 INFO:tasks.workunit.client.0.smithi052.stdout:6/672: dread da/d22/d3c/f58 [0,4194304] 0 2024-04-26T12:06:57.755 INFO:tasks.workunit.client.0.smithi052.stdout:7/664: mknod d1/d1c/d21/d2f/d33/d92/ccd 0 2024-04-26T12:06:57.755 INFO:tasks.workunit.client.0.smithi052.stdout:1/622: rmdir d0/d1e 39 2024-04-26T12:06:57.755 INFO:tasks.workunit.client.0.smithi052.stdout:2/685: write d0/d3f/d56/d6d/d5a/d73/d4b/fd4 [922766,121957] 0 2024-04-26T12:06:57.756 INFO:tasks.workunit.client.0.smithi052.stdout:5/672: dwrite db/dc/d5f/d50/d46/f4b [0,4194304] 0 2024-04-26T12:06:57.756 INFO:tasks.workunit.client.0.smithi052.stdout:4/637: rename d3/d12/d59/d6b to d3/d12/d59/d96/dc0/ddd 0 2024-04-26T12:06:57.756 INFO:tasks.workunit.client.0.smithi052.stdout:7/665: chown d1/d1c/d23/d81/fa5 255277 1 2024-04-26T12:06:57.757 INFO:tasks.workunit.client.0.smithi052.stdout:9/667: dread d3/db/f5b [0,4194304] 0 2024-04-26T12:06:57.758 INFO:tasks.workunit.client.0.smithi052.stdout:5/673: unlink db/dd/d18/c30 0 2024-04-26T12:06:57.759 INFO:tasks.workunit.client.0.smithi052.stdout:9/668: dread - d3/db/d10/d3c/d40/fbb zero size 2024-04-26T12:06:57.759 INFO:tasks.workunit.client.0.smithi052.stdout:4/638: mkdir d3/d44/d4b/db8/dde 0 2024-04-26T12:06:57.760 INFO:tasks.workunit.client.0.smithi052.stdout:6/673: rename da/d22/d3c/d74/d87/fb8 to da/d5d/fe9 0 2024-04-26T12:06:57.760 INFO:tasks.workunit.client.0.smithi052.stdout:0/665: sync 2024-04-26T12:06:57.760 INFO:tasks.workunit.client.0.smithi052.stdout:3/613: sync 2024-04-26T12:06:57.761 INFO:tasks.workunit.client.0.smithi052.stdout:6/674: dread - da/d5d/fe9 zero size 2024-04-26T12:06:57.761 INFO:tasks.workunit.client.0.smithi052.stdout:0/666: readlink d0/d26/dc7/l9f 0 2024-04-26T12:06:57.762 INFO:tasks.workunit.client.0.smithi052.stdout:4/639: unlink d3/d2b/dab/cd8 0 2024-04-26T12:06:57.762 INFO:tasks.workunit.client.0.smithi052.stdout:8/615: dwrite d0/f59 [4194304,4194304] 0 2024-04-26T12:06:57.762 INFO:tasks.workunit.client.0.smithi052.stdout:7/666: truncate d1/d1f/f22 2746151 0 2024-04-26T12:06:57.764 INFO:tasks.workunit.client.0.smithi052.stdout:0/667: rmdir d0/d5b 39 2024-04-26T12:06:57.765 INFO:tasks.workunit.client.0.smithi052.stdout:5/674: truncate db/dd/d34/d69/d8a/da9/d87/fb9 995953 0 2024-04-26T12:06:57.765 INFO:tasks.workunit.client.0.smithi052.stdout:4/640: unlink d3/d1f/f25 0 2024-04-26T12:06:57.766 INFO:tasks.workunit.client.0.smithi052.stdout:6/675: dread - da/d22/d29/dd4/ddf/d92/d96/fe7 zero size 2024-04-26T12:06:57.766 INFO:tasks.workunit.client.0.smithi052.stdout:0/668: fdatasync d0/d1/f41 0 2024-04-26T12:06:57.766 INFO:tasks.workunit.client.0.smithi052.stdout:7/667: write d1/ff [720369,10339] 0 2024-04-26T12:06:57.767 INFO:tasks.workunit.client.0.smithi052.stdout:2/686: dwrite d0/d7/f3c [4194304,4194304] 0 2024-04-26T12:06:57.767 INFO:tasks.workunit.client.0.smithi052.stdout:8/616: symlink d0/d4/lc7 0 2024-04-26T12:06:57.768 INFO:tasks.workunit.client.0.smithi052.stdout:1/623: dwrite d0/d2/dd/d40/dc1/d1d/d91/fb1 [0,4194304] 0 2024-04-26T12:06:57.770 INFO:tasks.workunit.client.0.smithi052.stdout:4/641: creat d3/d12/d34/d43/da1/fdf x:0 0 0 2024-04-26T12:06:57.770 INFO:tasks.workunit.client.0.smithi052.stdout:2/687: write d0/d7/d2f/fd1 [151915,4460] 0 2024-04-26T12:06:57.770 INFO:tasks.workunit.client.0.smithi052.stdout:0/669: creat d0/d1/d2c/d42/d70/fd6 x:0 0 0 2024-04-26T12:06:57.771 INFO:tasks.workunit.client.0.smithi052.stdout:1/624: dread - d0/d2/dd/d40/dac/fb9 zero size 2024-04-26T12:06:57.771 INFO:tasks.workunit.client.0.smithi052.stdout:3/614: dread d2/d4/d41/d59/f98 [0,4194304] 0 2024-04-26T12:06:57.771 INFO:tasks.workunit.client.0.smithi052.stdout:6/676: mknod da/d22/d3c/d74/d7e/cea 0 2024-04-26T12:06:57.771 INFO:tasks.workunit.client.0.smithi052.stdout:9/669: dwrite d3/db/d10/d3c/fa5 [0,4194304] 0 2024-04-26T12:06:57.771 INFO:tasks.workunit.client.0.smithi052.stdout:7/668: rename d1/dab/d4c/c8d to d1/d1c/d65/cce 0 2024-04-26T12:06:57.773 INFO:tasks.workunit.client.0.smithi052.stdout:1/625: mknod d0/da/ccc 0 2024-04-26T12:06:57.773 INFO:tasks.workunit.client.0.smithi052.stdout:8/617: getdents d0/d4/d5/d27 0 2024-04-26T12:06:57.774 INFO:tasks.workunit.client.0.smithi052.stdout:6/677: link da/d5d/d9c/la3 da/d22/d29/dd4/ddf/d95/leb 0 2024-04-26T12:06:57.776 INFO:tasks.workunit.client.0.smithi052.stdout:6/678: rmdir da/d5d/d64 39 2024-04-26T12:06:57.777 INFO:tasks.workunit.client.0.smithi052.stdout:8/618: dread - d0/d4/d5/d86/d9c/db4/fab zero size 2024-04-26T12:06:57.777 INFO:tasks.workunit.client.0.smithi052.stdout:1/626: creat d0/d83/fcd x:0 0 0 2024-04-26T12:06:57.777 INFO:tasks.workunit.client.0.smithi052.stdout:7/669: truncate d1/d1f/d55/fbc 534909 0 2024-04-26T12:06:57.778 INFO:tasks.workunit.client.0.smithi052.stdout:9/670: write d3/db/d10/f85 [2159604,2379] 0 2024-04-26T12:06:57.779 INFO:tasks.workunit.client.0.smithi052.stdout:2/688: sync 2024-04-26T12:06:57.781 INFO:tasks.workunit.client.0.smithi052.stdout:0/670: dwrite d0/d26/d36/f92 [4194304,4194304] 0 2024-04-26T12:06:57.781 INFO:tasks.workunit.client.0.smithi052.stdout:4/642: dwrite d3/d12/d34/d43/dc6/fd9 [0,4194304] 0 2024-04-26T12:06:57.781 INFO:tasks.workunit.client.0.smithi052.stdout:6/679: mknod da/d22/d29/d31/d39/dc7/cec 0 2024-04-26T12:06:57.781 INFO:tasks.workunit.client.0.smithi052.stdout:8/619: write d0/d4/d5/db/f5e [4850651,115528] 0 2024-04-26T12:06:57.782 INFO:tasks.workunit.client.0.smithi052.stdout:8/620: sync 2024-04-26T12:06:57.783 INFO:tasks.workunit.client.0.smithi052.stdout:9/671: dread - d3/db/d10/d3c/d40/d96/db5/d8f/d49/da4/fd1 zero size 2024-04-26T12:06:57.783 INFO:tasks.workunit.client.0.smithi052.stdout:4/643: readlink d3/d2b/d40/l4c 0 2024-04-26T12:06:57.783 INFO:tasks.workunit.client.0.smithi052.stdout:3/615: dwrite d2/d4/dc/d33/d37/f3a [0,4194304] 0 2024-04-26T12:06:57.783 INFO:tasks.workunit.client.0.smithi052.stdout:7/670: link d1/dab/d4c/fae d1/d1c/d21/d2f/fcf 0 2024-04-26T12:06:57.784 INFO:tasks.workunit.client.0.smithi052.stdout:2/689: creat d0/d7/d2f/d3d/fe5 x:0 0 0 2024-04-26T12:06:57.785 INFO:tasks.workunit.client.0.smithi052.stdout:5/675: dread db/dc/d5f/d50/f48 [0,4194304] 0 2024-04-26T12:06:57.785 INFO:tasks.workunit.client.0.smithi052.stdout:0/671: creat d0/d26/dc7/fd7 x:0 0 0 2024-04-26T12:06:57.786 INFO:tasks.workunit.client.0.smithi052.stdout:7/671: write d1/d1f/f8c [499856,46223] 0 2024-04-26T12:06:57.786 INFO:tasks.workunit.client.0.smithi052.stdout:6/680: creat da/d22/d3c/d74/d7e/d8b/fed x:0 0 0 2024-04-26T12:06:57.786 INFO:tasks.workunit.client.0.smithi052.stdout:9/672: mkdir d3/db/d10/d2e/de9 0 2024-04-26T12:06:57.786 INFO:tasks.workunit.client.0.smithi052.stdout:3/616: symlink d2/d4/dc/d33/d75/lbb 0 2024-04-26T12:06:57.786 INFO:tasks.workunit.client.0.smithi052.stdout:8/621: unlink d0/d4/d5/db/d20/d41/lbc 0 2024-04-26T12:06:57.787 INFO:tasks.workunit.client.0.smithi052.stdout:4/644: creat d3/d44/d4b/db8/dde/fe0 x:0 0 0 2024-04-26T12:06:57.787 INFO:tasks.workunit.client.0.smithi052.stdout:9/673: mkdir d3/d3b/dea 0 2024-04-26T12:06:57.787 INFO:tasks.workunit.client.0.smithi052.stdout:0/672: truncate d0/d1/d11/f16 8473196 0 2024-04-26T12:06:57.787 INFO:tasks.workunit.client.0.smithi052.stdout:9/674: sync 2024-04-26T12:06:57.788 INFO:tasks.workunit.client.0.smithi052.stdout:2/690: write d0/d3f/d56/d6d/d5a/d73/d4b/d8f/fa1 [324852,66021] 0 2024-04-26T12:06:57.788 INFO:tasks.workunit.client.0.smithi052.stdout:7/672: unlink d1/d1c/d23/d81/d88/fac 0 2024-04-26T12:06:57.788 INFO:tasks.workunit.client.0.smithi052.stdout:4/645: stat d3/d2e/c38 0 2024-04-26T12:06:57.789 INFO:tasks.workunit.client.0.smithi052.stdout:8/622: creat d0/d4/dc/d80/fc8 x:0 0 0 2024-04-26T12:06:57.789 INFO:tasks.workunit.client.0.smithi052.stdout:8/623: fsync d0/d4/d5/d27/d69/fb1 0 2024-04-26T12:06:57.789 INFO:tasks.workunit.client.0.smithi052.stdout:7/673: readlink d1/dab/d4c/l52 0 2024-04-26T12:06:57.790 INFO:tasks.workunit.client.0.smithi052.stdout:6/681: rename da/d63/ccb to da/d22/d29/d31/cee 0 2024-04-26T12:06:57.791 INFO:tasks.workunit.client.0.smithi052.stdout:3/617: link d2/d4/dc/d1d/d25/d61/f82 d2/d4/dc/d33/fbc 0 2024-04-26T12:06:57.791 INFO:tasks.workunit.client.0.smithi052.stdout:0/673: creat d0/d1/d1a/d20/fd8 x:0 0 0 2024-04-26T12:06:57.791 INFO:tasks.workunit.client.0.smithi052.stdout:8/624: rmdir d0/d4/d5/d86/d9c/db4/d58/d89 39 2024-04-26T12:06:57.792 INFO:tasks.workunit.client.0.smithi052.stdout:2/691: dread d0/d36/f96 [0,4194304] 0 2024-04-26T12:06:57.794 INFO:tasks.workunit.client.0.smithi052.stdout:6/682: rename da/d22/d29/dd4/ddf/d95/dd2/db9/lbc to da/da2/lef 0 2024-04-26T12:06:57.796 INFO:tasks.workunit.client.0.smithi052.stdout:7/674: mknod d1/d1c/d21/d2f/d33/d92/cd0 0 2024-04-26T12:06:57.798 INFO:tasks.workunit.client.0.smithi052.stdout:6/683: chown da/d22/d29/dd4/ddf/d95/dd2 60 1 2024-04-26T12:06:57.798 INFO:tasks.workunit.client.0.smithi052.stdout:0/674: link d0/d26/dc7/l81 d0/d1/d2c/d42/ld9 0 2024-04-26T12:06:57.799 INFO:tasks.workunit.client.0.smithi052.stdout:4/646: dwrite d3/d44/d4b/db8/dde/fe0 [0,4194304] 0 2024-04-26T12:06:57.800 INFO:tasks.workunit.client.0.smithi052.stdout:5/676: dread db/f1f [4194304,4194304] 0 2024-04-26T12:06:57.800 INFO:tasks.workunit.client.0.smithi052.stdout:9/675: truncate d3/db/d10/d3c/d40/d96/db5/d8f/f5e 155867 0 2024-04-26T12:06:57.801 INFO:tasks.workunit.client.0.smithi052.stdout:3/618: dwrite d2/d4/d2a/f58 [0,4194304] 0 2024-04-26T12:06:57.802 INFO:tasks.workunit.client.0.smithi052.stdout:1/627: dread d0/d2/dd/d40/dc1/d1d/f37 [0,4194304] 0 2024-04-26T12:06:57.802 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:57.801+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:57.804 INFO:tasks.workunit.client.0.smithi052.stdout:6/684: mknod da/d22/d3c/d74/dcf/cf0 0 2024-04-26T12:06:57.804 INFO:tasks.workunit.client.0.smithi052.stdout:2/692: dwrite d0/d3f/d56/d6d/fa0 [0,4194304] 0 2024-04-26T12:06:57.805 INFO:tasks.workunit.client.0.smithi052.stdout:8/625: dwrite d0/d4/d5/d86/d9c/db4/d75/fbd [0,4194304] 0 2024-04-26T12:06:57.805 INFO:tasks.workunit.client.0.smithi052.stdout:0/675: mknod d0/d5b/d9d/d32/cda 0 2024-04-26T12:06:57.807 INFO:tasks.workunit.client.0.smithi052.stdout:9/676: write d3/db/d10/d3c/d40/d96/db5/f8e [1306755,87151] 0 2024-04-26T12:06:57.808 INFO:tasks.workunit.client.0.smithi052.stdout:3/619: write d2/d4/dc/d33/d37/f51 [3382179,125151] 0 2024-04-26T12:06:57.809 INFO:tasks.workunit.client.0.smithi052.stdout:1/628: write d0/d83/d4b/f8f [2855196,45210] 0 2024-04-26T12:06:57.811 INFO:tasks.workunit.client.0.smithi052.stdout:2/693: symlink d0/d3f/d56/d6d/d5a/d73/d4b/d8f/le6 0 2024-04-26T12:06:57.811 INFO:tasks.workunit.client.0.smithi052.stdout:8/626: creat d0/d4/d5/d86/d9c/db4/d58/fc9 x:0 0 0 2024-04-26T12:06:57.812 INFO:tasks.workunit.client.0.smithi052.stdout:3/620: write d2/d4/d6b/d7b/f7d [1316770,67472] 0 2024-04-26T12:06:57.813 INFO:tasks.workunit.client.0.smithi052.stdout:7/675: dwrite d1/ff [0,4194304] 0 2024-04-26T12:06:57.813 INFO:tasks.workunit.client.0.smithi052.stdout:6/685: link da/d22/d29/dd4/ddf/fbd da/d5d/d64/d68/ff1 0 2024-04-26T12:06:57.814 INFO:tasks.workunit.client.0.smithi052.stdout:9/677: creat d3/db/d10/d3c/d40/d96/da7/feb x:0 0 0 2024-04-26T12:06:57.814 INFO:tasks.workunit.client.0.smithi052.stdout:4/647: dwrite d3/d12/d34/d45/f61 [0,4194304] 0 2024-04-26T12:06:57.814 INFO:tasks.workunit.client.0.smithi052.stdout:7/676: stat d1/d1c/d65/fc9 0 2024-04-26T12:06:57.814 INFO:tasks.workunit.client.0.smithi052.stdout:1/629: mkdir d0/d2/dd/d40/d81/d9a/dce 0 2024-04-26T12:06:57.815 INFO:tasks.workunit.client.0.smithi052.stdout:5/677: dwrite db/dd/d34/d69/d8a/da9/d87/fa7 [0,4194304] 0 2024-04-26T12:06:57.815 INFO:tasks.workunit.client.0.smithi052.stdout:2/694: symlink d0/d7/d22/le7 0 2024-04-26T12:06:57.815 INFO:tasks.workunit.client.0.smithi052.stdout:9/678: fsync d3/db/d4a/f4d 0 2024-04-26T12:06:57.816 INFO:tasks.workunit.client.0.smithi052.stdout:9/679: fdatasync d3/fb8 0 2024-04-26T12:06:57.816 INFO:tasks.workunit.client.0.smithi052.stdout:4/648: fdatasync d3/d12/d34/d45/d67/d6c/f8f 0 2024-04-26T12:06:57.817 INFO:tasks.workunit.client.0.smithi052.stdout:3/621: fsync d2/d4/d41/d59/fb1 0 2024-04-26T12:06:57.817 INFO:tasks.workunit.client.0.smithi052.stdout:6/686: mknod da/d22/d29/dd4/ddf/d95/cf2 0 2024-04-26T12:06:57.817 INFO:tasks.workunit.client.0.smithi052.stdout:1/630: rmdir d0/d2/dd/d40/dc1/d3c 39 2024-04-26T12:06:57.818 INFO:tasks.workunit.client.0.smithi052.stdout:8/627: link d0/d4/d5/db/d20/d7b/f92 d0/d4/d5/d86/d9c/db4/d58/dae/fca 0 2024-04-26T12:06:57.819 INFO:tasks.workunit.client.0.smithi052.stdout:2/695: creat d0/d3f/d56/d6d/d5a/d82/fe8 x:0 0 0 2024-04-26T12:06:57.820 INFO:tasks.workunit.client.0.smithi052.stdout:7/677: rename d1/d1c/d23/d81/f8e to d1/d1c/d23/fd1 0 2024-04-26T12:06:57.821 INFO:tasks.workunit.client.0.smithi052.stdout:8/628: write d0/d16/d63/f95 [815991,40245] 0 2024-04-26T12:06:57.822 INFO:tasks.workunit.client.0.smithi052.stdout:8/629: stat d0/d4/fba 0 2024-04-26T12:06:57.822 INFO:tasks.workunit.client.0.smithi052.stdout:9/680: rename d3/db/d10/d54/f93 to d3/d23/fec 0 2024-04-26T12:06:57.822 INFO:tasks.workunit.client.0.smithi052.stdout:6/687: mknod da/d22/d29/dd4/ddf/d7c/cf3 0 2024-04-26T12:06:57.823 INFO:tasks.workunit.client.0.smithi052.stdout:2/696: unlink d0/d3f/d56/d6d/d5a/fe0 0 2024-04-26T12:06:57.823 INFO:tasks.workunit.client.0.smithi052.stdout:1/631: mkdir d0/d2/dd/d40/d81/d9a/dce/dcf 0 2024-04-26T12:06:57.823 INFO:tasks.workunit.client.0.smithi052.stdout:0/676: dwrite d0/d1/d1a/d20/f3a [0,4194304] 0 2024-04-26T12:06:57.823 INFO:tasks.workunit.client.0.smithi052.stdout:2/697: sync 2024-04-26T12:06:57.823 INFO:tasks.workunit.client.0.smithi052.stdout:8/630: mknod d0/d4/dc/ccb 0 2024-04-26T12:06:57.824 INFO:tasks.workunit.client.0.smithi052.stdout:2/698: readlink d0/d3f/d56/d8d/d99/ldf 0 2024-04-26T12:06:57.825 INFO:tasks.workunit.client.0.smithi052.stdout:1/632: write d0/d83/d4b/d56/f9d [615632,48042] 0 2024-04-26T12:06:57.826 INFO:tasks.workunit.client.0.smithi052.stdout:8/631: creat d0/d4/d1c/fcc x:0 0 0 2024-04-26T12:06:57.827 INFO:tasks.workunit.client.0.smithi052.stdout:6/688: getdents da/d5d/d64/d68 0 2024-04-26T12:06:57.827 INFO:tasks.workunit.client.0.smithi052.stdout:5/678: dwrite db/dc/d5f/d50/d46/f4c [0,4194304] 0 2024-04-26T12:06:57.828 INFO:tasks.workunit.client.0.smithi052.stdout:8/632: mknod d0/ccd 0 2024-04-26T12:06:57.829 INFO:tasks.workunit.client.0.smithi052.stdout:2/699: getdents d0/d7/d22 0 2024-04-26T12:06:57.829 INFO:tasks.workunit.client.0.smithi052.stdout:1/633: link d0/d2/dd/f14 d0/d2/dd/d34/fd0 0 2024-04-26T12:06:57.831 INFO:tasks.workunit.client.0.smithi052.stdout:0/677: truncate d0/f7a 54242 0 2024-04-26T12:06:57.833 INFO:tasks.workunit.client.0.smithi052.stdout:8/633: mknod d0/d4/d1c/d83/cce 0 2024-04-26T12:06:57.833 INFO:tasks.workunit.client.0.smithi052.stdout:3/622: dread d2/d4/dc/d33/d8a/f9b [0,4194304] 0 2024-04-26T12:06:57.833 INFO:tasks.workunit.client.0.smithi052.stdout:4/649: dread d3/d1f/fbd [0,4194304] 0 2024-04-26T12:06:57.833 INFO:tasks.workunit.client.0.smithi052.stdout:9/681: dwrite d3/db/d10/d3c/d40/d96/f6e [0,4194304] 0 2024-04-26T12:06:57.833 INFO:tasks.workunit.client.0.smithi052.stdout:2/700: creat d0/d3f/d56/d6d/d5a/d73/d4b/d9c/fe9 x:0 0 0 2024-04-26T12:06:57.834 INFO:tasks.workunit.client.0.smithi052.stdout:0/678: chown d0/d1/d54/la1 681586 1 2024-04-26T12:06:57.835 INFO:tasks.workunit.client.0.smithi052.stdout:6/689: link da/d22/d3c/d74/d87/c93 da/d22/d29/dd4/ddf/d7c/d94/cf4 0 2024-04-26T12:06:57.836 INFO:tasks.workunit.client.0.smithi052.stdout:9/682: mkdir d3/db/d2b/ded 0 2024-04-26T12:06:57.836 INFO:tasks.workunit.client.0.smithi052.stdout:0/679: readlink d0/d1/d1a/d3b/lb1 0 2024-04-26T12:06:57.836 INFO:tasks.workunit.client.0.smithi052.stdout:7/678: dwrite d1/d1c/d21/d2f/d68/fa0 [0,4194304] 0 2024-04-26T12:06:57.836 INFO:tasks.workunit.client.0.smithi052.stdout:2/701: truncate d0/f15 1681646 0 2024-04-26T12:06:57.837 INFO:tasks.workunit.client.0.smithi052.stdout:6/690: chown da/f3f 2 1 2024-04-26T12:06:57.837 INFO:tasks.workunit.client.0.smithi052.stdout:8/634: symlink d0/d4/d5/d86/d9c/db4/d58/d89/lcf 0 2024-04-26T12:06:57.838 INFO:tasks.workunit.client.0.smithi052.stdout:7/679: write d1/d1c/d21/f7f [808947,6516] 0 2024-04-26T12:06:57.838 INFO:tasks.workunit.client.0.smithi052.stdout:9/683: symlink d3/db/d10/d54/lee 0 2024-04-26T12:06:57.842 INFO:tasks.workunit.client.0.smithi052.stdout:2/702: write d0/d3f/d56/d6d/d5a/d73/fc7 [541663,39176] 0 2024-04-26T12:06:57.842 INFO:tasks.workunit.client.0.smithi052.stdout:5/679: dwrite db/f35 [0,4194304] 0 2024-04-26T12:06:57.843 INFO:tasks.workunit.client.0.smithi052.stdout:0/680: link d0/d1/f13 d0/d3d/dd2/fdb 0 2024-04-26T12:06:57.843 INFO:tasks.workunit.client.0.smithi052.stdout:1/634: truncate d0/d2/dd/d40/dc1/f57 2282251 0 2024-04-26T12:06:57.843 INFO:tasks.workunit.client.0.smithi052.stdout:1/635: sync 2024-04-26T12:06:57.843 INFO:tasks.workunit.client.0.smithi052.stdout:3/623: read d2/d4/d2a/fb9 [214504,22754] 0 2024-04-26T12:06:57.843 INFO:tasks.workunit.client.0.smithi052.stdout:1/636: rename d0/d2/dd/fca to d0/d2/dd/d40/dac/fd1 0 2024-04-26T12:06:57.845 INFO:tasks.workunit.client.0.smithi052.stdout:3/624: creat d2/d4/d2a/d2d/fbd x:0 0 0 2024-04-26T12:06:57.845 INFO:tasks.workunit.client.0.smithi052.stdout:5/680: write f1 [4024950,111424] 0 2024-04-26T12:06:57.845 INFO:tasks.workunit.client.0.smithi052.stdout:3/625: chown d2/f2f 0 1 2024-04-26T12:06:57.847 INFO:tasks.workunit.client.0.smithi052.stdout:7/680: write d1/d1c/d21/d2f/f80 [1773743,48885] 0 2024-04-26T12:06:57.847 INFO:tasks.workunit.client.0.smithi052.stdout:3/626: mknod d2/d4/d41/d59/cbe 0 2024-04-26T12:06:57.848 INFO:tasks.workunit.client.0.smithi052.stdout:4/650: dread d3/d2b/d40/f5b [0,4194304] 0 2024-04-26T12:06:57.848 INFO:tasks.workunit.client.0.smithi052.stdout:2/703: truncate d0/fb0 3028858 0 2024-04-26T12:06:57.848 INFO:tasks.workunit.client.0.smithi052.stdout:1/637: read d0/d2/dd/d40/dc1/d1d/f50 [458455,40645] 0 2024-04-26T12:06:57.848 INFO:tasks.workunit.client.0.smithi052.stdout:0/681: dwrite d0/d5b/d9d/d32/f78 [0,4194304] 0 2024-04-26T12:06:57.850 INFO:tasks.workunit.client.0.smithi052.stdout:7/681: chown d1/c5d 15816007 1 2024-04-26T12:06:57.850 INFO:tasks.workunit.client.0.smithi052.stdout:0/682: chown d0/f7a 6701072 1 2024-04-26T12:06:57.851 INFO:tasks.workunit.client.0.smithi052.stdout:2/704: creat d0/d3f/d56/d8d/d99/fea x:0 0 0 2024-04-26T12:06:57.852 INFO:tasks.workunit.client.0.smithi052.stdout:3/627: rename d2/d4/dc/d1d/d3f/da9 to d2/d4/d2a/dbf 0 2024-04-26T12:06:57.852 INFO:tasks.workunit.client.0.smithi052.stdout:4/651: truncate d3/d44/d4b/db8/fdb 24296 0 2024-04-26T12:06:57.852 INFO:tasks.workunit.client.0.smithi052.stdout:9/684: dwrite d3/db/d10/d3c/d40/d96/f57 [0,4194304] 0 2024-04-26T12:06:57.853 INFO:tasks.workunit.client.0.smithi052.stdout:7/682: stat d1/dab/d4c/d4d/cc0 0 2024-04-26T12:06:57.853 INFO:tasks.workunit.client.0.smithi052.stdout:2/705: readlink d0/d3f/d56/d6d/l89 0 2024-04-26T12:06:57.854 INFO:tasks.workunit.client.0.smithi052.stdout:5/681: dwrite db/dc/d5f/d50/d91/fa8 [0,4194304] 0 2024-04-26T12:06:57.854 INFO:tasks.workunit.client.0.smithi052.stdout:0/683: getdents d0/d26/dbe 0 2024-04-26T12:06:57.855 INFO:tasks.workunit.client.0.smithi052.stdout:2/706: creat d0/d7/d22/feb x:0 0 0 2024-04-26T12:06:57.855 INFO:tasks.workunit.client.0.smithi052.stdout:7/683: write d1/d1c/d21/f53 [4079326,84673] 0 2024-04-26T12:06:57.856 INFO:tasks.workunit.client.0.smithi052.stdout:7/684: readlink d1/l1b 0 2024-04-26T12:06:57.856 INFO:tasks.workunit.client.0.smithi052.stdout:5/682: rmdir db/dc/d5f/d50/d91 39 2024-04-26T12:06:57.858 INFO:tasks.workunit.client.0.smithi052.stdout:0/684: symlink d0/d3d/dd2/ldc 0 2024-04-26T12:06:57.859 INFO:tasks.workunit.client.0.smithi052.stdout:7/685: chown d1/d1c/d23/d81/d88/lc6 2782644 1 2024-04-26T12:06:57.859 INFO:tasks.workunit.client.0.smithi052.stdout:5/683: creat db/dd/d34/d70/d78/fe0 x:0 0 0 2024-04-26T12:06:57.859 INFO:tasks.workunit.client.0.smithi052.stdout:0/685: unlink d0/d1/d1a/fcb 0 2024-04-26T12:06:57.860 INFO:tasks.workunit.client.0.smithi052.stdout:7/686: chown d1/f16 5267 1 2024-04-26T12:06:57.861 INFO:tasks.workunit.client.0.smithi052.stdout:5/684: dread - db/dd/d18/d60/d64/fb5 zero size 2024-04-26T12:06:57.861 INFO:tasks.workunit.client.0.smithi052.stdout:9/685: dwrite d3/db/d13/fb3 [0,4194304] 0 2024-04-26T12:06:57.861 INFO:tasks.workunit.client.0.smithi052.stdout:0/686: write d0/d1/d11/f43 [2877791,86412] 0 2024-04-26T12:06:57.862 INFO:tasks.workunit.client.0.smithi052.stdout:7/687: write d1/d1c/d23/f50 [1337281,7414] 0 2024-04-26T12:06:57.862 INFO:tasks.workunit.client.0.smithi052.stdout:5/685: stat db/dd/d34/d70/d78/lcb 0 2024-04-26T12:06:57.863 INFO:tasks.workunit.client.0.smithi052.stdout:7/688: symlink d1/dab/ld2 0 2024-04-26T12:06:57.863 INFO:tasks.workunit.client.0.smithi052.stdout:9/686: creat d3/d3b/fef x:0 0 0 2024-04-26T12:06:57.864 INFO:tasks.workunit.client.0.smithi052.stdout:2/707: getdents d0/d7/d22 0 2024-04-26T12:06:57.864 INFO:tasks.workunit.client.0.smithi052.stdout:4/652: truncate d3/f57 695628 0 2024-04-26T12:06:57.864 INFO:tasks.workunit.client.0.smithi052.stdout:3/628: truncate d2/d4/d41/d5c/f83 1628164 0 2024-04-26T12:06:57.864 INFO:tasks.workunit.client.0.smithi052.stdout:9/687: mkdir d3/d23/df0 0 2024-04-26T12:06:57.864 INFO:tasks.workunit.client.0.smithi052.stdout:5/686: write db/dc/d5f/f8f [951528,101078] 0 2024-04-26T12:06:57.864 INFO:tasks.workunit.client.0.smithi052.stdout:7/689: mkdir d1/d1c/dd3 0 2024-04-26T12:06:57.865 INFO:tasks.workunit.client.0.smithi052.stdout:4/653: symlink d3/d2b/dab/db6/db7/le1 0 2024-04-26T12:06:57.865 INFO:tasks.workunit.client.0.smithi052.stdout:7/690: write d1/d1f/d55/fbc [1681423,39285] 0 2024-04-26T12:06:57.866 INFO:tasks.workunit.client.0.smithi052.stdout:3/629: write d2/d4/dc/d33/d8a/f9b [534088,79855] 0 2024-04-26T12:06:57.866 INFO:tasks.workunit.client.0.smithi052.stdout:5/687: creat db/dc/d5f/d50/fe1 x:0 0 0 2024-04-26T12:06:57.866 INFO:tasks.workunit.client.0.smithi052.stdout:2/708: truncate d0/d3f/d56/d8d/d99/fea 357838 0 2024-04-26T12:06:57.867 INFO:tasks.workunit.client.0.smithi052.stdout:4/654: mknod d3/d12/d34/d91/ce2 0 2024-04-26T12:06:57.868 INFO:tasks.workunit.client.0.smithi052.stdout:9/688: creat d3/db/d10/d3c/d40/d96/db5/d8f/ddc/ff1 x:0 0 0 2024-04-26T12:06:57.868 INFO:tasks.workunit.client.0.smithi052.stdout:7/691: truncate d1/f14 38221 0 2024-04-26T12:06:57.868 INFO:tasks.workunit.client.0.smithi052.stdout:3/630: write d2/d4/dc/d33/d37/fad [5987178,23291] 0 2024-04-26T12:06:57.868 INFO:tasks.workunit.client.0.smithi052.stdout:7/692: sync 2024-04-26T12:06:57.868 INFO:tasks.workunit.client.0.smithi052.stdout:3/631: sync 2024-04-26T12:06:57.868 INFO:tasks.workunit.client.0.smithi052.stdout:5/688: mknod db/dc/d5f/d50/d91/dd2/ce2 0 2024-04-26T12:06:57.868 INFO:tasks.workunit.client.0.smithi052.stdout:4/655: mknod d3/d1f/d21/dbe/ce3 0 2024-04-26T12:06:57.869 INFO:tasks.workunit.client.0.smithi052.stdout:0/687: truncate d0/d26/d36/f8e 357278 0 2024-04-26T12:06:57.870 INFO:tasks.workunit.client.0.smithi052.stdout:3/632: unlink d2/d4/d41/d5c/f83 0 2024-04-26T12:06:57.870 INFO:tasks.workunit.client.0.smithi052.stdout:4/656: write d3/f2f [522943,81891] 0 2024-04-26T12:06:57.871 INFO:tasks.workunit.client.0.smithi052.stdout:8/635: dread d0/d16/f73 [0,4194304] 0 2024-04-26T12:06:57.873 INFO:tasks.workunit.client.0.smithi052.stdout:2/709: read d0/d7/d2f/d4c/f60 [159564,38216] 0 2024-04-26T12:06:57.873 INFO:tasks.workunit.client.0.smithi052.stdout:0/688: creat d0/d26/d74/da6/fdd x:0 0 0 2024-04-26T12:06:57.873 INFO:tasks.workunit.client.0.smithi052.stdout:3/633: creat d2/d4/d41/db5/fc0 x:0 0 0 2024-04-26T12:06:57.875 INFO:tasks.workunit.client.0.smithi052.stdout:8/636: write d0/d4/d5/d27/d57/f88 [6712015,11512] 0 2024-04-26T12:06:57.875 INFO:tasks.workunit.client.0.smithi052.stdout:9/689: dread d3/d23/fec [0,4194304] 0 2024-04-26T12:06:57.877 INFO:tasks.workunit.client.0.smithi052.stdout:5/689: dwrite db/dc/f1d [0,4194304] 0 2024-04-26T12:06:57.877 INFO:tasks.workunit.client.0.smithi052.stdout:7/693: dwrite d1/d1c/d23/d81/fa5 [0,4194304] 0 2024-04-26T12:06:57.878 INFO:tasks.workunit.client.0.smithi052.stdout:2/710: creat d0/d3f/d56/d6d/d5a/d73/d4b/d8f/fec x:0 0 0 2024-04-26T12:06:57.878 INFO:tasks.workunit.client.0.smithi052.stdout:0/689: mknod d0/d1/d2c/d42/cde 0 2024-04-26T12:06:57.878 INFO:tasks.workunit.client.0.smithi052.stdout:6/691: dread da/d22/f24 [0,4194304] 0 2024-04-26T12:06:57.880 INFO:tasks.workunit.client.0.smithi052.stdout:9/690: mknod d3/db/d4a/dc6/cf2 0 2024-04-26T12:06:57.880 INFO:tasks.workunit.client.0.smithi052.stdout:3/634: truncate d2/d4/dc/d33/d75/f84 538881 0 2024-04-26T12:06:57.881 INFO:tasks.workunit.client.0.smithi052.stdout:0/690: fdatasync d0/f7a 0 2024-04-26T12:06:57.881 INFO:tasks.workunit.client.0.smithi052.stdout:6/692: fdatasync da/d22/d3c/f85 0 2024-04-26T12:06:57.881 INFO:tasks.workunit.client.0.smithi052.stdout:2/711: mkdir d0/d3f/d56/d6d/d5a/ded 0 2024-04-26T12:06:57.882 INFO:tasks.workunit.client.0.smithi052.stdout:4/657: dwrite d3/d1f/d21/f32 [0,4194304] 0 2024-04-26T12:06:57.882 INFO:tasks.workunit.client.0.smithi052.stdout:7/694: creat d1/d1c/d21/d2f/d33/d3a/fd4 x:0 0 0 2024-04-26T12:06:57.882 INFO:tasks.workunit.client.0.smithi052.stdout:3/635: write d2/d4/dc/d33/d8a/f9b [1029574,43829] 0 2024-04-26T12:06:57.882 INFO:tasks.workunit.client.0.smithi052.stdout:9/691: write d3/db/d10/d3c/d40/d96/da7/feb [150661,34842] 0 2024-04-26T12:06:57.883 INFO:tasks.workunit.client.0.smithi052.stdout:9/692: sync 2024-04-26T12:06:57.883 INFO:tasks.workunit.client.0.smithi052.stdout:7/695: unlink d1/l5 0 2024-04-26T12:06:57.883 INFO:tasks.workunit.client.0.smithi052.stdout:4/658: readlink d3/d12/d34/d43/da1/lbb 0 2024-04-26T12:06:57.883 INFO:tasks.workunit.client.0.smithi052.stdout:3/636: fsync d2/d4/d6b/f76 0 2024-04-26T12:06:57.884 INFO:tasks.workunit.client.0.smithi052.stdout:2/712: chown d0/d3f/d56/d6d/l4f 189 1 2024-04-26T12:06:57.884 INFO:tasks.workunit.client.0.smithi052.stdout:8/637: link d0/d4/d5/d86/d9c/db4/d58/dae/fca d0/d4/d5/daf/fd0 0 2024-04-26T12:06:57.884 INFO:tasks.workunit.client.0.smithi052.stdout:9/693: write d3/db/d10/d2e/f77 [426030,14931] 0 2024-04-26T12:06:57.885 INFO:tasks.workunit.client.0.smithi052.stdout:5/690: getdents db/dc/d5f/d50/d91/dd2 0 2024-04-26T12:06:57.885 INFO:tasks.workunit.client.0.smithi052.stdout:7/696: rmdir d1/d1c/d23/d81 39 2024-04-26T12:06:57.885 INFO:tasks.workunit.client.0.smithi052.stdout:4/659: creat d3/d1f/d21/dd2/fe4 x:0 0 0 2024-04-26T12:06:57.886 INFO:tasks.workunit.client.0.smithi052.stdout:2/713: mkdir d0/d7/d2f/dee 0 2024-04-26T12:06:57.886 INFO:tasks.workunit.client.0.smithi052.stdout:4/660: readlink d3/d2b/d40/l4c 0 2024-04-26T12:06:57.887 INFO:tasks.workunit.client.0.smithi052.stdout:4/661: sync 2024-04-26T12:06:57.887 INFO:tasks.workunit.client.0.smithi052.stdout:7/697: mknod d1/db7/cd5 0 2024-04-26T12:06:57.887 INFO:tasks.workunit.client.0.smithi052.stdout:9/694: symlink d3/d23/d7f/lf3 0 2024-04-26T12:06:57.887 INFO:tasks.workunit.client.0.smithi052.stdout:6/693: dread da/d22/d29/dd4/ddf/d7c/d94/fd7 [0,4194304] 0 2024-04-26T12:06:57.888 INFO:tasks.workunit.client.0.smithi052.stdout:8/638: fsync d0/d4/d5/d86/d9c/db4/d58/f5b 0 2024-04-26T12:06:57.888 INFO:tasks.workunit.client.0.smithi052.stdout:5/691: read db/dd/d34/f82 [3884025,100359] 0 2024-04-26T12:06:57.889 INFO:tasks.workunit.client.0.smithi052.stdout:9/695: creat d3/db/d10/d2e/d5c/ff4 x:0 0 0 2024-04-26T12:06:57.890 INFO:tasks.workunit.client.0.smithi052.stdout:5/692: symlink db/d5c/le3 0 2024-04-26T12:06:57.891 INFO:tasks.workunit.client.0.smithi052.stdout:0/691: dwrite d0/d1/f24 [0,4194304] 0 2024-04-26T12:06:57.891 INFO:tasks.workunit.client.0.smithi052.stdout:6/694: creat da/d22/d3c/ff5 x:0 0 0 2024-04-26T12:06:57.891 INFO:tasks.workunit.client.0.smithi052.stdout:9/696: creat d3/d23/df0/ff5 x:0 0 0 2024-04-26T12:06:57.892 INFO:tasks.workunit.client.0.smithi052.stdout:1/638: dread d0/d2/dd/f32 [0,4194304] 0 2024-04-26T12:06:57.892 INFO:tasks.workunit.client.0.smithi052.stdout:3/637: fsync d2/d4/dc/d1d/d3f/f70 0 2024-04-26T12:06:57.893 INFO:tasks.workunit.client.0.smithi052.stdout:6/695: rmdir da/d5d/d64/de6 0 2024-04-26T12:06:57.893 INFO:tasks.workunit.client.0.smithi052.stdout:3/638: sync 2024-04-26T12:06:57.893 INFO:tasks.workunit.client.0.smithi052.stdout:9/697: mkdir d3/db/d10/d3c/d40/df6 0 2024-04-26T12:06:57.893 INFO:tasks.workunit.client.0.smithi052.stdout:0/692: rename d0/d1/d1a/f64 to d0/d26/dbe/fdf 0 2024-04-26T12:06:57.894 INFO:tasks.workunit.client.0.smithi052.stdout:1/639: truncate d0/d2/f18 4849001 0 2024-04-26T12:06:57.894 INFO:tasks.workunit.client.0.smithi052.stdout:4/662: write d3/d22/d30/f5c [4145880,91373] 0 2024-04-26T12:06:57.894 INFO:tasks.workunit.client.0.smithi052.stdout:3/639: readlink d2/d4/d2a/l8c 0 2024-04-26T12:06:57.894 INFO:tasks.workunit.client.0.smithi052.stdout:0/693: unlink d0/d3d/dd2/ldc 0 2024-04-26T12:06:57.895 INFO:tasks.workunit.client.0.smithi052.stdout:3/640: creat d2/d4/d6b/fc1 x:0 0 0 2024-04-26T12:06:57.896 INFO:tasks.workunit.client.0.smithi052.stdout:0/694: truncate d0/d26/fb0 455243 0 2024-04-26T12:06:57.896 INFO:tasks.workunit.client.0.smithi052.stdout:8/639: write d0/d4/f38 [463251,6629] 0 2024-04-26T12:06:57.896 INFO:tasks.workunit.client.0.smithi052.stdout:6/696: write da/fe1 [2146363,804] 0 2024-04-26T12:06:57.897 INFO:tasks.workunit.client.0.smithi052.stdout:4/663: truncate d3/d12/d34/d43/fcf 43773 0 2024-04-26T12:06:57.897 INFO:tasks.workunit.client.0.smithi052.stdout:1/640: mknod d0/d2/dd/d40/d81/d9a/dce/dcf/cd2 0 2024-04-26T12:06:57.897 INFO:tasks.workunit.client.0.smithi052.stdout:3/641: write d2/d4/d41/f66 [790078,93523] 0 2024-04-26T12:06:57.897 INFO:tasks.workunit.client.0.smithi052.stdout:6/697: fsync da/d63/f78 0 2024-04-26T12:06:57.897 INFO:tasks.workunit.client.0.smithi052.stdout:9/698: truncate d3/db/d10/d3c/d40/d96/db5/d8f/fbd 524335 0 2024-04-26T12:06:57.900 INFO:tasks.workunit.client.0.smithi052.stdout:1/641: write d0/d2/f6 [4788552,16158] 0 2024-04-26T12:06:57.900 INFO:tasks.workunit.client.0.smithi052.stdout:2/714: dwrite d0/d7/d2f/d8c/fb7 [0,4194304] 0 2024-04-26T12:06:57.900 INFO:tasks.workunit.client.0.smithi052.stdout:5/693: dread db/dd/d34/d70/d59/f8c [0,4194304] 0 2024-04-26T12:06:57.901 INFO:tasks.workunit.client.0.smithi052.stdout:4/664: mknod d3/d12/d59/d96/dc0/ddd/ce5 0 2024-04-26T12:06:57.901 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:57.900+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:57.902 INFO:tasks.workunit.client.0.smithi052.stdout:6/698: mkdir da/d22/d29/d31/d6f/dcc/df6 0 2024-04-26T12:06:57.902 INFO:tasks.workunit.client.0.smithi052.stdout:9/699: symlink d3/db/d2b/dd4/dde/lf7 0 2024-04-26T12:06:57.902 INFO:tasks.workunit.client.0.smithi052.stdout:4/665: fdatasync d3/d22/f4e 0 2024-04-26T12:06:57.902 INFO:tasks.workunit.client.0.smithi052.stdout:1/642: fsync d0/d2/dd/d40/dac/fd1 0 2024-04-26T12:06:57.902 INFO:tasks.workunit.client.0.smithi052.stdout:2/715: write d0/d3f/d56/d8d/f9d [250999,81968] 0 2024-04-26T12:06:57.903 INFO:tasks.workunit.client.0.smithi052.stdout:5/694: mknod db/dc/d5f/d50/ce4 0 2024-04-26T12:06:57.903 INFO:tasks.workunit.client.0.smithi052.stdout:6/699: readlink da/d22/l33 0 2024-04-26T12:06:57.904 INFO:tasks.workunit.client.0.smithi052.stdout:6/700: readlink da/d22/d3c/lb4 0 2024-04-26T12:06:57.905 INFO:tasks.workunit.client.0.smithi052.stdout:5/695: fdatasync db/dc/d5f/d50/d46/d74/f8e 0 2024-04-26T12:06:57.905 INFO:tasks.workunit.client.0.smithi052.stdout:1/643: chown d0/d83/d4b/f8e 22631 1 2024-04-26T12:06:57.906 INFO:tasks.workunit.client.0.smithi052.stdout:4/666: truncate d3/fd 4666481 0 2024-04-26T12:06:57.906 INFO:tasks.workunit.client.0.smithi052.stdout:9/700: link d3/db/d10/d2e/f77 d3/db/ff8 0 2024-04-26T12:06:57.907 INFO:tasks.workunit.client.0.smithi052.stdout:2/716: mknod d0/d3f/d56/d6d/d5a/d73/d4b/d9c/cef 0 2024-04-26T12:06:57.907 INFO:tasks.workunit.client.0.smithi052.stdout:3/642: dwrite d2/d4/d41/d59/fb1 [0,4194304] 0 2024-04-26T12:06:57.907 INFO:tasks.workunit.client.0.smithi052.stdout:6/701: stat da/d22/d29/d31/d6f/dcc/df6 0 2024-04-26T12:06:57.908 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:57.908 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:57.908 INFO:tasks.workunit.client.0.smithi052.stdout:1/644: dread - d0/d2/dd/d40/dc1/d1d/d91/fbb zero size 2024-04-26T12:06:57.908 INFO:tasks.workunit.client.0.smithi052.stdout:2/717: chown d0/c2b 0 1 2024-04-26T12:06:57.908 INFO:tasks.workunit.client.0.smithi052.stdout:3/643: fsync d2/d4/d41/fb2 0 2024-04-26T12:06:57.908 INFO:tasks.workunit.client.0.smithi052.stdout:5/696: truncate db/dd/d34/d70/d78/fe0 389620 0 2024-04-26T12:06:57.909 INFO:tasks.workunit.client.0.smithi052.stdout:6/702: readlink da/d22/d29/dd4/ddf/d7c/lc4 0 2024-04-26T12:06:57.910 INFO:tasks.workunit.client.0.smithi052.stdout:0/695: dread d0/d26/dc7/d97/fac [0,4194304] 0 2024-04-26T12:06:57.910 INFO:tasks.workunit.client.0.smithi052.stdout:9/701: creat d3/db/d2b/dd4/dde/ff9 x:0 0 0 2024-04-26T12:06:57.910 INFO:tasks.workunit.client.0.smithi052.stdout:6/703: fdatasync da/d22/d3c/f66 0 2024-04-26T12:06:57.911 INFO:tasks.workunit.client.0.smithi052.stdout:5/697: mknod db/dd/d18/d60/d64/d9c/da0/ce5 0 2024-04-26T12:06:57.911 INFO:tasks.workunit.client.0.smithi052.stdout:1/645: unlink d0/d2/dd/d40/dc1/d1d/d91/la5 0 2024-04-26T12:06:57.912 INFO:tasks.workunit.client.0.smithi052.stdout:2/718: creat d0/d3f/d56/d6d/d5a/dd5/ff0 x:0 0 0 2024-04-26T12:06:57.912 INFO:tasks.workunit.client.0.smithi052.stdout:4/667: getdents d3/d22 0 2024-04-26T12:06:57.912 INFO:tasks.workunit.client.0.smithi052.stdout:9/702: mkdir d3/db/d52/dfa 0 2024-04-26T12:06:57.913 INFO:tasks.workunit.client.0.smithi052.stdout:0/696: mknod d0/d1/d2c/d42/da5/ce0 0 2024-04-26T12:06:57.913 INFO:tasks.workunit.client.0.smithi052.stdout:4/668: rmdir d3/d44 39 2024-04-26T12:06:57.914 INFO:tasks.workunit.client.0.smithi052.stdout:5/698: creat db/dc/d5f/d50/d91/fe6 x:0 0 0 2024-04-26T12:06:57.914 INFO:tasks.workunit.client.0.smithi052.stdout:7/698: dread d1/d1c/d21/f53 [0,4194304] 0 2024-04-26T12:06:57.915 INFO:tasks.workunit.client.0.smithi052.stdout:9/703: chown d3/db/d10/d54/c6d 13939919 1 2024-04-26T12:06:57.916 INFO:tasks.workunit.client.0.smithi052.stdout:0/697: write d0/d1/d11/f16 [4882505,104709] 0 2024-04-26T12:06:57.917 INFO:tasks.workunit.client.0.smithi052.stdout:3/644: dwrite d2/d4/dc/d1d/d25/d36/f86 [0,4194304] 0 2024-04-26T12:06:57.918 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:57.918 INFO:tasks.workunit.client.0.smithi052.stdout:3/645: chown d2/d4 99643 1 2024-04-26T12:06:57.919 INFO:tasks.workunit.client.0.smithi052.stdout:9/704: creat d3/db/d10/d54/ffb x:0 0 0 2024-04-26T12:06:57.919 INFO:tasks.workunit.client.0.smithi052.stdout:2/719: truncate d0/d3f/d56/d6d/d5a/dd5/f30 1110287 0 2024-04-26T12:06:57.920 INFO:tasks.workunit.client.0.smithi052.stdout:4/669: link d3/d12/d34/d43/f7b d3/d2b/d40/fe6 0 2024-04-26T12:06:57.921 INFO:tasks.workunit.client.0.smithi052.stdout:8/640: dread d0/d4/f17 [4194304,4194304] 0 2024-04-26T12:06:57.921 INFO:tasks.workunit.client.0.smithi052.stdout:6/704: dwrite da/d63/f78 [0,4194304] 0 2024-04-26T12:06:57.921 INFO:tasks.workunit.client.0.smithi052.stdout:0/698: readlink d0/d1/d1a/d20/d47/d84/lca 0 2024-04-26T12:06:57.922 INFO:tasks.workunit.client.0.smithi052.stdout:3/646: fdatasync d2/d4/dc/d33/f94 0 2024-04-26T12:06:57.922 INFO:tasks.workunit.client.0.smithi052.stdout:0/699: sync 2024-04-26T12:06:57.922 INFO:tasks.workunit.client.0.smithi052.stdout:1/646: dwrite d0/d2/dd/d40/d81/d52/f8d [0,4194304] 0 2024-04-26T12:06:57.923 INFO:tasks.workunit.client.0.smithi052.stdout:4/670: creat d3/d15/d53/fe7 x:0 0 0 2024-04-26T12:06:57.923 INFO:tasks.workunit.client.0.smithi052.stdout:2/720: chown d0/d7/d22/le7 2 1 2024-04-26T12:06:57.924 INFO:tasks.workunit.client.0.smithi052.stdout:0/700: write d0/d1/f24 [8364361,14523] 0 2024-04-26T12:06:57.925 INFO:tasks.workunit.client.0.smithi052.stdout:6/705: write da/d22/d29/d31/f6b [8024345,34968] 0 2024-04-26T12:06:57.926 INFO:tasks.workunit.client.0.smithi052.stdout:7/699: truncate d1/d1c/d21/d2f/d68/fa0 1329453 0 2024-04-26T12:06:57.926 INFO:tasks.workunit.client.0.smithi052.stdout:9/705: write d3/db/d10/d3c/d40/d96/db5/d8f/ddc/ff1 [4441,130258] 0 2024-04-26T12:06:57.927 INFO:tasks.workunit.client.0.smithi052.stdout:0/701: stat d0/d26/d74/c87 0 2024-04-26T12:06:57.927 INFO:tasks.workunit.client.0.smithi052.stdout:1/647: creat d0/d83/d4b/fd3 x:0 0 0 2024-04-26T12:06:57.927 INFO:tasks.workunit.client.0.smithi052.stdout:5/699: dwrite db/dc/d5f/d50/d46/d74/fc1 [0,4194304] 0 2024-04-26T12:06:57.927 INFO:tasks.workunit.client.0.smithi052.stdout:6/706: write da/d51/f62 [347427,92411] 0 2024-04-26T12:06:57.929 INFO:tasks.workunit.client.0.smithi052.stdout:0/702: mkdir d0/d26/d74/db4/de1 0 2024-04-26T12:06:57.929 INFO:tasks.workunit.client.0.smithi052.stdout:1/648: read d0/d2/dd/f32 [1252469,14401] 0 2024-04-26T12:06:57.931 INFO:tasks.workunit.client.0.smithi052.stdout:4/671: truncate d3/d12/d59/d96/dc0/f81 641188 0 2024-04-26T12:06:57.931 INFO:tasks.workunit.client.0.smithi052.stdout:5/700: symlink db/dd/d34/d69/le7 0 2024-04-26T12:06:57.931 INFO:tasks.workunit.client.0.smithi052.stdout:7/700: chown d1/d1c/d21/d2f/d33/d3a/l86 1499809 1 2024-04-26T12:06:57.932 INFO:tasks.workunit.client.0.smithi052.stdout:0/703: readlink d0/d1/d1a/d20/lc3 0 2024-04-26T12:06:57.932 INFO:tasks.workunit.client.0.smithi052.stdout:8/641: dwrite d0/f7a [4194304,4194304] 0 2024-04-26T12:06:57.933 INFO:tasks.workunit.client.0.smithi052.stdout:4/672: dread - d3/d1f/d21/fc1 zero size 2024-04-26T12:06:57.933 INFO:tasks.workunit.client.0.smithi052.stdout:6/707: rename da/d22/d3c/d74 to da/d22/d29/dd4/df7 0 2024-04-26T12:06:57.934 INFO:tasks.workunit.client.0.smithi052.stdout:5/701: chown db/dc/d5f/f2f 44 1 2024-04-26T12:06:57.935 INFO:tasks.workunit.client.0.smithi052.stdout:7/701: mkdir d1/dab/d4c/dd6 0 2024-04-26T12:06:57.935 INFO:tasks.workunit.client.0.smithi052.stdout:3/647: dwrite d2/d4/dc/d1d/d25/d61/fa8 [0,4194304] 0 2024-04-26T12:06:57.935 INFO:tasks.workunit.client.0.smithi052.stdout:1/649: symlink d0/d2/dd/d40/dc1/d1d/d23/ld4 0 2024-04-26T12:06:57.938 INFO:tasks.workunit.client.0.smithi052.stdout:9/706: dwrite d3/db/d2b/fe2 [0,4194304] 0 2024-04-26T12:06:57.939 INFO:tasks.workunit.client.0.smithi052.stdout:2/721: dwrite d0/d3f/d56/d6d/d5a/dd5/d3a/f59 [0,4194304] 0 2024-04-26T12:06:57.940 INFO:tasks.workunit.client.0.smithi052.stdout:0/704: rename d0/d5b/d9d/d4f/l8d to d0/d1/d2c/d42/le2 0 2024-04-26T12:06:57.941 INFO:tasks.workunit.client.0.smithi052.stdout:8/642: truncate d0/d4/d5/d86/d9c/db4/fab 39609 0 2024-04-26T12:06:57.941 INFO:tasks.workunit.client.0.smithi052.stdout:1/650: write d0/d2/dd/d40/dc1/d1d/d91/fb1 [2285050,22400] 0 2024-04-26T12:06:57.941 INFO:tasks.workunit.client.0.smithi052.stdout:6/708: rename da/d5d/d64 to da/d22/d29/dd4/ddf/d95/df8 0 2024-04-26T12:06:57.942 INFO:tasks.workunit.client.0.smithi052.stdout:8/643: read - d0/f66 zero size 2024-04-26T12:06:57.943 INFO:tasks.workunit.client.0.smithi052.stdout:2/722: readlink d0/d7/d22/le7 0 2024-04-26T12:06:57.945 INFO:tasks.workunit.client.0.smithi052.stdout:5/702: rename db/dc/d5f/d50/d91/cd5 to db/dd/d34/d69/ce8 0 2024-04-26T12:06:57.947 INFO:tasks.workunit.client.0.smithi052.stdout:4/673: dwrite d3/d22/d30/fc8 [0,4194304] 0 2024-04-26T12:06:57.948 INFO:tasks.workunit.client.0.smithi052.stdout:8/644: fsync d0/d4/d5/db/d20/f24 0 2024-04-26T12:06:57.948 INFO:tasks.workunit.client.0.smithi052.stdout:1/651: chown d0/d2/dd/d40/d81/d52/f98 219 1 2024-04-26T12:06:57.949 INFO:tasks.workunit.client.0.smithi052.stdout:7/702: dwrite d1/d1f/f60 [4194304,4194304] 0 2024-04-26T12:06:57.951 INFO:tasks.workunit.client.0.smithi052.stdout:2/723: mknod d0/d3f/d56/d6d/d5a/dd5/d4d/d8b/cf1 0 2024-04-26T12:06:57.954 INFO:tasks.workunit.client.0.smithi052.stdout:5/703: getdents db/dd/d18/d60 0 2024-04-26T12:06:57.954 INFO:tasks.workunit.client.0.smithi052.stdout:8/645: mknod d0/d4/d5/db/d20/cd1 0 2024-04-26T12:06:57.954 INFO:tasks.workunit.client.0.smithi052.stdout:6/709: dwrite f2 [0,4194304] 0 2024-04-26T12:06:57.955 INFO:tasks.workunit.client.0.smithi052.stdout:0/705: dwrite d0/f3 [8388608,4194304] 0 2024-04-26T12:06:57.955 INFO:tasks.workunit.client.0.smithi052.stdout:9/707: dwrite d3/db/d10/f85 [0,4194304] 0 2024-04-26T12:06:57.955 INFO:tasks.workunit.client.0.smithi052.stdout:3/648: dwrite d2/d4/dc/d33/d75/f84 [0,4194304] 0 2024-04-26T12:06:57.955 INFO:tasks.workunit.client.0.smithi052.stdout:1/652: creat d0/d2/dd/d40/dc1/d1d/d91/fd5 x:0 0 0 2024-04-26T12:06:57.955 INFO:tasks.workunit.client.0.smithi052.stdout:7/703: unlink d1/d1c/d21/d2f/d33/lbb 0 2024-04-26T12:06:57.956 INFO:tasks.workunit.client.0.smithi052.stdout:2/724: write d0/d3f/d56/d6d/d5a/dd5/f30 [87660,87265] 0 2024-04-26T12:06:57.956 INFO:tasks.workunit.client.0.smithi052.stdout:1/653: write d0/d2/f6 [4346785,46785] 0 2024-04-26T12:06:57.956 INFO:tasks.workunit.client.0.smithi052.stdout:0/706: symlink d0/d3d/le3 0 2024-04-26T12:06:57.957 INFO:tasks.workunit.client.0.smithi052.stdout:7/704: write d1/d1c/d21/d2f/fa7 [665033,32342] 0 2024-04-26T12:06:57.958 INFO:tasks.workunit.client.0.smithi052.stdout:5/704: creat db/dd/d18/d60/d64/d9c/fe9 x:0 0 0 2024-04-26T12:06:57.959 INFO:tasks.workunit.client.0.smithi052.stdout:6/710: rename da/d22/d29/d31/f4d to da/d22/ff9 0 2024-04-26T12:06:57.959 INFO:tasks.workunit.client.0.smithi052.stdout:1/654: creat d0/d2/dd/d40/d81/fd6 x:0 0 0 2024-04-26T12:06:57.959 INFO:tasks.workunit.client.0.smithi052.stdout:7/705: truncate d1/d1c/d21/f53 4632874 0 2024-04-26T12:06:57.959 INFO:tasks.workunit.client.0.smithi052.stdout:5/705: write db/dc/d5f/f8f [716852,58016] 0 2024-04-26T12:06:57.959 INFO:tasks.workunit.client.0.smithi052.stdout:3/649: rename d2/d4/d6b/d7b/d7c to d2/d4/dc/d33/d75/dc2 0 2024-04-26T12:06:57.960 INFO:tasks.workunit.client.0.smithi052.stdout:2/725: getdents d0/d3f/d56/d6d/d5a/d82 0 2024-04-26T12:06:57.960 INFO:tasks.workunit.client.0.smithi052.stdout:6/711: symlink da/d22/d29/dd4/df7/d87/lfa 0 2024-04-26T12:06:57.961 INFO:tasks.workunit.client.0.smithi052.stdout:5/706: truncate db/f1f 5988575 0 2024-04-26T12:06:57.961 INFO:tasks.workunit.client.0.smithi052.stdout:6/712: mkdir da/d22/d29/dd4/df7/d87/dfb 0 2024-04-26T12:06:57.962 INFO:tasks.workunit.client.0.smithi052.stdout:2/726: getdents d0/d7/d22 0 2024-04-26T12:06:57.963 INFO:tasks.workunit.client.0.smithi052.stdout:0/707: dwrite d0/d26/d74/f7f [0,4194304] 0 2024-04-26T12:06:57.963 INFO:tasks.workunit.client.0.smithi052.stdout:6/713: fsync da/d22/d29/dd4/df7/fa0 0 2024-04-26T12:06:57.964 INFO:tasks.workunit.client.0.smithi052.stdout:2/727: write d0/d7/d2f/d3d/f92 [4873856,86913] 0 2024-04-26T12:06:57.964 INFO:tasks.workunit.client.0.smithi052.stdout:3/650: rmdir d2 39 2024-04-26T12:06:57.964 INFO:tasks.workunit.client.0.smithi052.stdout:0/708: unlink d0/d3d/fc5 0 2024-04-26T12:06:57.964 INFO:tasks.workunit.client.0.smithi052.stdout:5/707: truncate db/dd/d34/d69/d8a/da9/d87/d6e/db8/dce/fd4 740089 0 2024-04-26T12:06:57.966 INFO:tasks.workunit.client.0.smithi052.stdout:6/714: link da/d22/d29/dd4/ddf/d92/fb3 da/d22/ffc 0 2024-04-26T12:06:57.967 INFO:tasks.workunit.client.0.smithi052.stdout:9/708: dwrite d3/db/ff8 [0,4194304] 0 2024-04-26T12:06:57.971 INFO:tasks.workunit.client.0.smithi052.stdout:5/708: read db/dd/d34/d69/d93/f58 [28767,12957] 0 2024-04-26T12:06:57.974 INFO:tasks.workunit.client.0.smithi052.stdout:6/715: write da/d5d/fd1 [4753631,27101] 0 2024-04-26T12:06:57.975 INFO:tasks.workunit.client.0.smithi052.stdout:6/716: fsync da/d22/d29/d31/f6b 0 2024-04-26T12:06:57.975 INFO:tasks.workunit.client.0.smithi052.stdout:6/717: mknod da/da2/cfd 0 2024-04-26T12:06:57.975 INFO:tasks.workunit.client.0.smithi052.stdout:6/718: symlink da/d63/lfe 0 2024-04-26T12:06:57.976 INFO:tasks.workunit.client.0.smithi052.stdout:6/719: dread - da/d22/d3c/ff5 zero size 2024-04-26T12:06:57.976 INFO:tasks.workunit.client.0.smithi052.stdout:5/709: dwrite db/dc/f12 [0,4194304] 0 2024-04-26T12:06:57.977 INFO:tasks.workunit.client.0.smithi052.stdout:6/720: mknod da/d22/d29/dd4/ddf/d92/d96/cff 0 2024-04-26T12:06:57.977 INFO:tasks.workunit.client.0.smithi052.stdout:5/710: truncate db/dc/f54 1510800 0 2024-04-26T12:06:57.977 INFO:tasks.workunit.client.0.smithi052.stdout:5/711: stat db/dc/d5f/f3a 0 2024-04-26T12:06:57.978 INFO:tasks.workunit.client.0.smithi052.stdout:5/712: fdatasync db/dc/d5f/d50/f48 0 2024-04-26T12:06:57.979 INFO:tasks.workunit.client.0.smithi052.stdout:5/713: creat db/dd/d34/d69/d8a/dc5/fea x:0 0 0 2024-04-26T12:06:57.981 INFO:tasks.workunit.client.0.smithi052.stdout:6/721: rename da/d22/d29/dd4/df7/d7e/fbb to da/d22/d29/dd4/ddf/d7c/d94/f100 0 2024-04-26T12:06:57.985 INFO:tasks.workunit.client.0.smithi052.stdout:6/722: write da/d22/d29/dd4/ddf/d7c/fb1 [113062,109880] 0 2024-04-26T12:06:57.986 INFO:tasks.workunit.client.0.smithi052.stdout:6/723: mknod da/d22/d29/dd4/ddf/c101 0 2024-04-26T12:06:57.986 INFO:tasks.workunit.client.0.smithi052.stdout:4/674: sync 2024-04-26T12:06:57.987 INFO:tasks.workunit.client.0.smithi052.stdout:7/706: read d1/d1c/d21/f7f [189948,94691] 0 2024-04-26T12:06:57.987 INFO:tasks.workunit.client.0.smithi052.stdout:4/675: getdents d3/d12/d34/d45/d67/d6c 0 2024-04-26T12:06:57.987 INFO:tasks.workunit.client.0.smithi052.stdout:4/676: chown d3/d12/d34/d91/ce2 30499963 1 2024-04-26T12:06:57.988 INFO:tasks.workunit.client.0.smithi052.stdout:4/677: getdents d3/d22/d30 0 2024-04-26T12:06:57.988 INFO:tasks.workunit.client.0.smithi052.stdout:4/678: chown d3/d2b/dab/db6 60598 1 2024-04-26T12:06:57.989 INFO:tasks.workunit.client.0.smithi052.stdout:7/707: dwrite d1/fa [0,4194304] 0 2024-04-26T12:06:57.990 INFO:tasks.workunit.client.0.smithi052.stdout:4/679: truncate d3/d22/d30/f70 3730952 0 2024-04-26T12:06:57.990 INFO:tasks.workunit.client.0.smithi052.stdout:5/714: truncate db/dd/d34/f57 4556129 0 2024-04-26T12:06:57.991 INFO:tasks.workunit.client.0.smithi052.stdout:4/680: mknod d3/d22/d30/ce8 0 2024-04-26T12:06:57.991 INFO:tasks.workunit.client.0.smithi052.stdout:5/715: creat db/d5c/feb x:0 0 0 2024-04-26T12:06:57.994 INFO:tasks.workunit.client.0.smithi052.stdout:5/716: truncate db/dd/d34/d69/d8a/da9/d87/d6e/fd0 583749 0 2024-04-26T12:06:57.994 INFO:tasks.workunit.client.0.smithi052.stdout:5/717: readlink db/d5c/db3/lb7 0 2024-04-26T12:06:57.996 INFO:tasks.workunit.client.0.smithi052.stdout:5/718: stat db/dd/d34/d69/d8a/dc5/cdc 0 2024-04-26T12:06:57.996 INFO:tasks.workunit.client.0.smithi052.stdout:4/681: dwrite d3/d12/d34/d43/fcf [0,4194304] 0 2024-04-26T12:06:57.997 INFO:tasks.workunit.client.0.smithi052.stdout:6/724: dwrite da/d22/d29/dd4/ddf/d92/fb3 [0,4194304] 0 2024-04-26T12:06:57.999 INFO:tasks.workunit.client.0.smithi052.stdout:5/719: getdents db/dd/d34/d69/d8a/da9 0 2024-04-26T12:06:58.001 INFO:tasks.workunit.client.0.smithi052.stdout:4/682: truncate d3/d12/d59/d96/dc0/ddd/fac 653664 0 2024-04-26T12:06:58.001 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:58.000+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:58.002 INFO:tasks.workunit.client.0.smithi052.stdout:0/709: sync 2024-04-26T12:06:58.002 INFO:tasks.workunit.client.0.smithi052.stdout:8/646: sync 2024-04-26T12:06:58.002 INFO:tasks.workunit.client.0.smithi052.stdout:3/651: sync 2024-04-26T12:06:58.004 INFO:tasks.workunit.client.0.smithi052.stdout:6/725: read da/d22/d29/d31/f49 [481081,41369] 0 2024-04-26T12:06:58.006 INFO:tasks.workunit.client.0.smithi052.stdout:1/655: dread d0/d2/d88/fb4 [0,4194304] 0 2024-04-26T12:06:58.006 INFO:tasks.workunit.client.0.smithi052.stdout:3/652: readlink d2/d4/dc/d33/d75/lbb 0 2024-04-26T12:06:58.007 INFO:tasks.workunit.client.0.smithi052.stdout:2/728: dread d0/d3f/d56/d6d/d5a/d82/f93 [0,4194304] 0 2024-04-26T12:06:58.009 INFO:tasks.workunit.client.0.smithi052.stdout:4/683: dwrite d3/d44/d4b/db8/fdb [0,4194304] 0 2024-04-26T12:06:58.012 INFO:tasks.workunit.client.0.smithi052.stdout:2/729: chown d0/d7/d2f/d9b/f7a 0 1 2024-04-26T12:06:58.012 INFO:tasks.workunit.client.0.smithi052.stdout:6/726: rename da/d22/d29/d31/f3a to da/d22/d29/dd4/ddf/d95/df8/f102 0 2024-04-26T12:06:58.012 INFO:tasks.workunit.client.0.smithi052.stdout:8/647: dwrite d0/d4/d5/d27/d69/fb1 [0,4194304] 0 2024-04-26T12:06:58.012 INFO:tasks.workunit.client.0.smithi052.stdout:3/653: write d2/d4/d2a/d2d/f2e [2048116,11767] 0 2024-04-26T12:06:58.013 INFO:tasks.workunit.client.0.smithi052.stdout:0/710: dwrite d0/d26/d36/f63 [0,4194304] 0 2024-04-26T12:06:58.013 INFO:tasks.workunit.client.0.smithi052.stdout:4/684: truncate d3/d2e/f95 1705221 0 2024-04-26T12:06:58.014 INFO:tasks.workunit.client.0.smithi052.stdout:6/727: chown da/d22/d29/d31/f49 235062 1 2024-04-26T12:06:58.014 INFO:tasks.workunit.client.0.smithi052.stdout:8/648: rmdir d0/d4/d5/d27 39 2024-04-26T12:06:58.015 INFO:tasks.workunit.client.0.smithi052.stdout:3/654: dread - d2/d4/dc/d1d/d3f/f7e zero size 2024-04-26T12:06:58.015 INFO:tasks.workunit.client.0.smithi052.stdout:0/711: creat d0/d1/d52/fe4 x:0 0 0 2024-04-26T12:06:58.017 INFO:tasks.workunit.client.0.smithi052.stdout:4/685: rename d3/d12/d34/d45/fc5 to d3/d2b/dab/fe9 0 2024-04-26T12:06:58.018 INFO:tasks.workunit.client.0.smithi052.stdout:3/655: mkdir d2/d4/d2a/d99/dc3 0 2024-04-26T12:06:58.018 INFO:tasks.workunit.client.0.smithi052.stdout:0/712: readlink d0/d26/d74/db4/lcc 0 2024-04-26T12:06:58.019 INFO:tasks.workunit.client.0.smithi052.stdout:2/730: rename d0/d3f/d56/d6d/d5a/dd5/d4d/d8b/fdd to d0/d3f/d56/d6d/d5a/de4/ff2 0 2024-04-26T12:06:58.019 INFO:tasks.workunit.client.0.smithi052.stdout:8/649: chown d0/d4/d5/d86/d9c/db4/d75/laa 444943039 1 2024-04-26T12:06:58.020 INFO:tasks.workunit.client.0.smithi052.stdout:6/728: symlink da/d22/d29/dd4/ddf/d95/df8/d68/l103 0 2024-04-26T12:06:58.020 INFO:tasks.workunit.client.0.smithi052.stdout:1/656: dwrite d0/d2/dd/d40/dc1/d1d/d91/fc3 [0,4194304] 0 2024-04-26T12:06:58.021 INFO:tasks.workunit.client.0.smithi052.stdout:8/650: stat d0/d4/dc/d68/f79 0 2024-04-26T12:06:58.022 INFO:tasks.workunit.client.0.smithi052.stdout:4/686: rename d3/d12/d34/d91/fcb to d3/d12/d59/d96/dc0/ddd/dca/fea 0 2024-04-26T12:06:58.023 INFO:tasks.workunit.client.0.smithi052.stdout:7/708: dread d1/f9f [0,4194304] 0 2024-04-26T12:06:58.024 INFO:tasks.workunit.client.0.smithi052.stdout:1/657: fdatasync d0/d2/dd/d40/dc1/f82 0 2024-04-26T12:06:58.025 INFO:tasks.workunit.client.0.smithi052.stdout:3/656: read d2/d4/d2a/dbf/db0/d6a/f5f [6595721,18548] 0 2024-04-26T12:06:58.025 INFO:tasks.workunit.client.0.smithi052.stdout:8/651: creat d0/d3e/d87/fd2 x:0 0 0 2024-04-26T12:06:58.025 INFO:tasks.workunit.client.0.smithi052.stdout:4/687: creat d3/d12/d59/feb x:0 0 0 2024-04-26T12:06:58.025 INFO:tasks.workunit.client.0.smithi052.stdout:7/709: write d1/ff [1155092,553] 0 2024-04-26T12:06:58.027 INFO:tasks.workunit.client.0.smithi052.stdout:8/652: rmdir d0/d4/d1c 39 2024-04-26T12:06:58.027 INFO:tasks.workunit.client.0.smithi052.stdout:9/709: dread d3/db/d10/f38 [0,4194304] 0 2024-04-26T12:06:58.028 INFO:tasks.workunit.client.0.smithi052.stdout:1/658: chown d0/d2/dd/d40/dc1/d1d/d91 242 1 2024-04-26T12:06:58.029 INFO:tasks.workunit.client.0.smithi052.stdout:0/713: dwrite d0/d1/d52/fae [0,4194304] 0 2024-04-26T12:06:58.031 INFO:tasks.workunit.client.0.smithi052.stdout:8/653: unlink d0/d4/d5/d86/l98 0 2024-04-26T12:06:58.031 INFO:tasks.workunit.client.0.smithi052.stdout:6/729: dwrite da/d5d/fe9 [0,4194304] 0 2024-04-26T12:06:58.031 INFO:tasks.workunit.client.0.smithi052.stdout:7/710: read d1/f15 [845317,102286] 0 2024-04-26T12:06:58.033 INFO:tasks.workunit.client.0.smithi052.stdout:9/710: write d3/db/d10/d2e/d5c/f8d [8028744,939] 0 2024-04-26T12:06:58.033 INFO:tasks.workunit.client.0.smithi052.stdout:2/731: dwrite d0/d3f/f80 [0,4194304] 0 2024-04-26T12:06:58.033 INFO:tasks.workunit.client.0.smithi052.stdout:1/659: mknod d0/d2/dd/d40/d81/d9a/cd7 0 2024-04-26T12:06:58.034 INFO:tasks.workunit.client.0.smithi052.stdout:7/711: write d1/d1c/d21/d2f/fa7 [1270482,119378] 0 2024-04-26T12:06:58.035 INFO:tasks.workunit.client.0.smithi052.stdout:5/720: dread db/dd/d34/f82 [0,4194304] 0 2024-04-26T12:06:58.036 INFO:tasks.workunit.client.0.smithi052.stdout:0/714: link d0/f7a d0/d1/d1a/fe5 0 2024-04-26T12:06:58.037 INFO:tasks.workunit.client.0.smithi052.stdout:8/654: rmdir d0/d4/d5/d86/d9c/db4/d58 39 2024-04-26T12:06:58.038 INFO:tasks.workunit.client.0.smithi052.stdout:7/712: symlink d1/d1c/d21/d2f/d68/ld7 0 2024-04-26T12:06:58.039 INFO:tasks.workunit.client.0.smithi052.stdout:2/732: creat d0/d3f/d56/d6d/d5a/ff3 x:0 0 0 2024-04-26T12:06:58.040 INFO:tasks.workunit.client.0.smithi052.stdout:0/715: link d0/d26/d36/f98 d0/fe6 0 2024-04-26T12:06:58.040 INFO:tasks.workunit.client.0.smithi052.stdout:8/655: mknod d0/d16/d63/cd3 0 2024-04-26T12:06:58.041 INFO:tasks.workunit.client.0.smithi052.stdout:7/713: mkdir d1/d1c/d23/dd8 0 2024-04-26T12:06:58.041 INFO:tasks.workunit.client.0.smithi052.stdout:0/716: stat d0/d1/f5c 0 2024-04-26T12:06:58.041 INFO:tasks.workunit.client.0.smithi052.stdout:4/688: dwrite d3/d2b/dab/db6/db7/fd0 [0,4194304] 0 2024-04-26T12:06:58.042 INFO:tasks.workunit.client.0.smithi052.stdout:5/721: read db/dd/d34/d69/d8a/da9/d87/fa7 [3861571,59000] 0 2024-04-26T12:06:58.043 INFO:tasks.workunit.client.0.smithi052.stdout:6/730: dwrite da/fe1 [0,4194304] 0 2024-04-26T12:06:58.044 INFO:tasks.workunit.client.0.smithi052.stdout:1/660: dwrite d0/d2/dd/d40/dc1/d1d/d91/f94 [0,4194304] 0 2024-04-26T12:06:58.044 INFO:tasks.workunit.client.0.smithi052.stdout:5/722: unlink c6 0 2024-04-26T12:06:58.044 INFO:tasks.workunit.client.0.smithi052.stdout:8/656: mknod d0/d4/d5/d86/cd4 0 2024-04-26T12:06:58.044 INFO:tasks.workunit.client.0.smithi052.stdout:0/717: mkdir d0/d5b/d9d/d4f/de7 0 2024-04-26T12:06:58.045 INFO:tasks.workunit.client.0.smithi052.stdout:4/689: mkdir d3/d2b/dab/dec 0 2024-04-26T12:06:58.046 INFO:tasks.workunit.client.0.smithi052.stdout:7/714: rename d1/d1c/d21/d2f/d33/d3a/d64/la3 to d1/d1c/ld9 0 2024-04-26T12:06:58.050 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:58.050 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:58.051 INFO:tasks.workunit.client.0.smithi052.stdout:2/733: link d0/d7/d22/l9e d0/d3f/d56/d6d/d5a/de4/lf4 0 2024-04-26T12:06:58.051 INFO:tasks.workunit.client.0.smithi052.stdout:8/657: readlink d0/d4/d5/db/d20/d41/l5f 0 2024-04-26T12:06:58.051 INFO:tasks.workunit.client.0.smithi052.stdout:5/723: unlink db/dd/d34/d69/d8a/da9/dd6/fdd 0 2024-04-26T12:06:58.051 INFO:tasks.workunit.client.0.smithi052.stdout:6/731: getdents da/d22/d29/dd4/df7/d7e/d8b 0 2024-04-26T12:06:58.051 INFO:tasks.workunit.client.0.smithi052.stdout:9/711: dwrite d3/db/d2b/f2f [0,4194304] 0 2024-04-26T12:06:58.054 INFO:tasks.workunit.client.0.smithi052.stdout:0/718: getdents d0/d26/d74 0 2024-04-26T12:06:58.054 INFO:tasks.workunit.client.0.smithi052.stdout:1/661: link d0/d2/f18 d0/d2/dd/d40/dc1/d3c/d9b/fd8 0 2024-04-26T12:06:58.054 INFO:tasks.workunit.client.0.smithi052.stdout:6/732: mkdir da/d22/d29/dd4/df7/d104 0 2024-04-26T12:06:58.054 INFO:tasks.workunit.client.0.smithi052.stdout:5/724: creat db/dd/d34/d69/d8a/da9/d87/d6e/fec x:0 0 0 2024-04-26T12:06:58.054 INFO:tasks.workunit.client.0.smithi052.stdout:4/690: link d3/d1f/d21/c8a d3/d12/d34/d45/d67/ced 0 2024-04-26T12:06:58.054 INFO:tasks.workunit.client.0.smithi052.stdout:2/734: rename d0/d3f/d56/d6d/d5a/dd5/f75 to d0/d3f/d56/d6d/d5a/dd5/d3a/ff5 0 2024-04-26T12:06:58.054 INFO:tasks.workunit.client.0.smithi052.stdout:9/712: creat d3/db/d13/ffc x:0 0 0 2024-04-26T12:06:58.054 INFO:tasks.workunit.client.0.smithi052.stdout:6/733: fdatasync da/d22/d29/f4c 0 2024-04-26T12:06:58.055 INFO:tasks.workunit.client.0.smithi052.stdout:4/691: chown d3/d1f/d21/dd2 594274907 1 2024-04-26T12:06:58.057 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:58.058 INFO:tasks.workunit.client.0.smithi052.stdout:5/725: chown db/dd/d34/d69/d8a/da9/d87 20350 1 2024-04-26T12:06:58.058 INFO:tasks.workunit.client.0.smithi052.stdout:9/713: write d3/d23/d7f/fa1 [1030326,105598] 0 2024-04-26T12:06:58.058 INFO:tasks.workunit.client.0.smithi052.stdout:2/735: truncate d0/d7/f10 4975845 0 2024-04-26T12:06:58.059 INFO:tasks.workunit.client.0.smithi052.stdout:7/715: dwrite d1/d1c/d21/f7f [0,4194304] 0 2024-04-26T12:06:58.060 INFO:tasks.workunit.client.0.smithi052.stdout:0/719: write d0/d1/d1a/fe5 [423903,128726] 0 2024-04-26T12:06:58.061 INFO:tasks.workunit.client.0.smithi052.stdout:3/657: dread d2/d4/dc/d1d/d25/d36/d1c/f4a [0,4194304] 0 2024-04-26T12:06:58.061 INFO:tasks.workunit.client.0.smithi052.stdout:4/692: rename d3/d44/c87 to d3/d2b/dab/db6/db7/cee 0 2024-04-26T12:06:58.061 INFO:tasks.workunit.client.0.smithi052.stdout:8/658: dwrite d0/d4/f17 [8388608,4194304] 0 2024-04-26T12:06:58.063 INFO:tasks.workunit.client.0.smithi052.stdout:4/693: mkdir d3/d44/d4b/db8/def 0 2024-04-26T12:06:58.064 INFO:tasks.workunit.client.0.smithi052.stdout:7/716: creat d1/d1c/d23/d81/fda x:0 0 0 2024-04-26T12:06:58.064 INFO:tasks.workunit.client.0.smithi052.stdout:5/726: truncate db/dc/d5f/f36 1283588 0 2024-04-26T12:06:58.065 INFO:tasks.workunit.client.0.smithi052.stdout:8/659: write d0/d4/d5/f8c [258708,130775] 0 2024-04-26T12:06:58.066 INFO:tasks.workunit.client.0.smithi052.stdout:6/734: dwrite da/d5d/f9b [0,4194304] 0 2024-04-26T12:06:58.067 INFO:tasks.workunit.client.0.smithi052.stdout:3/658: getdents d2/d4/dc/d1d/d3f/d9f 0 2024-04-26T12:06:58.067 INFO:tasks.workunit.client.0.smithi052.stdout:0/720: link d0/fe6 d0/d26/d74/db4/fe8 0 2024-04-26T12:06:58.067 INFO:tasks.workunit.client.0.smithi052.stdout:7/717: mknod d1/dab/d4c/d4d/cdb 0 2024-04-26T12:06:58.067 INFO:tasks.workunit.client.0.smithi052.stdout:8/660: chown d0/d16 1410 1 2024-04-26T12:06:58.067 INFO:tasks.workunit.client.0.smithi052.stdout:6/735: mknod da/d22/d97/c105 0 2024-04-26T12:06:58.068 INFO:tasks.workunit.client.0.smithi052.stdout:3/659: stat d2/d4/d41/c95 0 2024-04-26T12:06:58.068 INFO:tasks.workunit.client.0.smithi052.stdout:4/694: symlink d3/d12/d34/d45/d67/d6c/d86/lf0 0 2024-04-26T12:06:58.069 INFO:tasks.workunit.client.0.smithi052.stdout:6/736: write da/d22/ffc [3292185,40948] 0 2024-04-26T12:06:58.069 INFO:tasks.workunit.client.0.smithi052.stdout:7/718: symlink d1/d1c/d21/d2f/d33/dc7/ldc 0 2024-04-26T12:06:58.069 INFO:tasks.workunit.client.0.smithi052.stdout:3/660: write d2/d4/dc/d33/d37/f3a [3252878,41790] 0 2024-04-26T12:06:58.069 INFO:tasks.workunit.client.0.smithi052.stdout:0/721: creat d0/d1/d2c/d42/da5/dba/dbb/fe9 x:0 0 0 2024-04-26T12:06:58.070 INFO:tasks.workunit.client.0.smithi052.stdout:8/661: write d0/d4/d5/d27/d57/f88 [2004872,110918] 0 2024-04-26T12:06:58.070 INFO:tasks.workunit.client.0.smithi052.stdout:2/736: dwrite d0/d7/d22/fb8 [0,4194304] 0 2024-04-26T12:06:58.070 INFO:tasks.workunit.client.0.smithi052.stdout:7/719: chown d1/d1c/d65/fc9 18352973 1 2024-04-26T12:06:58.071 INFO:tasks.workunit.client.0.smithi052.stdout:3/661: mknod d2/d4/d81/cc4 0 2024-04-26T12:06:58.071 INFO:tasks.workunit.client.0.smithi052.stdout:0/722: write d0/d1/d11/f61 [2419395,120044] 0 2024-04-26T12:06:58.071 INFO:tasks.workunit.client.0.smithi052.stdout:6/737: mknod da/d22/d29/dd4/df7/dcf/de0/c106 0 2024-04-26T12:06:58.072 INFO:tasks.workunit.client.0.smithi052.stdout:2/737: chown d0/d3f/d56/d6d/d5a/dd5/d3a/f5e 10388089 1 2024-04-26T12:06:58.072 INFO:tasks.workunit.client.0.smithi052.stdout:7/720: write d1/d1c/d65/fbf [521554,43697] 0 2024-04-26T12:06:58.073 INFO:tasks.workunit.client.0.smithi052.stdout:8/662: truncate d0/d4/d5/d27/f81 221323 0 2024-04-26T12:06:58.073 INFO:tasks.workunit.client.0.smithi052.stdout:6/738: unlink da/d22/d29/d31/d39/cdd 0 2024-04-26T12:06:58.073 INFO:tasks.workunit.client.0.smithi052.stdout:0/723: truncate d0/d26/dbe/fd4 205299 0 2024-04-26T12:06:58.073 INFO:tasks.workunit.client.0.smithi052.stdout:2/738: creat d0/d7/d2f/dee/ff6 x:0 0 0 2024-04-26T12:06:58.074 INFO:tasks.workunit.client.0.smithi052.stdout:6/739: stat da/f1e 0 2024-04-26T12:06:58.074 INFO:tasks.workunit.client.0.smithi052.stdout:7/721: mkdir d1/d1f/d55/ddd 0 2024-04-26T12:06:58.074 INFO:tasks.workunit.client.0.smithi052.stdout:6/740: mknod da/d22/d97/c107 0 2024-04-26T12:06:58.075 INFO:tasks.workunit.client.0.smithi052.stdout:0/724: rename d0/d1/d52/fae to d0/d1/d52/fea 0 2024-04-26T12:06:58.077 INFO:tasks.workunit.client.0.smithi052.stdout:0/725: creat d0/d1/d1a/d20/d47/d84/feb x:0 0 0 2024-04-26T12:06:58.078 INFO:tasks.workunit.client.0.smithi052.stdout:8/663: dwrite d0/d4/d5/db/f5e [0,4194304] 0 2024-04-26T12:06:58.080 INFO:tasks.workunit.client.0.smithi052.stdout:7/722: dwrite d1/d1c/d21/d2f/f38 [0,4194304] 0 2024-04-26T12:06:58.081 INFO:tasks.workunit.client.0.smithi052.stdout:4/695: truncate d3/d12/f18 6888443 0 2024-04-26T12:06:58.082 INFO:tasks.workunit.client.0.smithi052.stdout:3/662: write d2/d4/dc/d1d/d25/d61/f82 [182370,81470] 0 2024-04-26T12:06:58.082 INFO:tasks.workunit.client.0.smithi052.stdout:2/739: write d0/d36/f96 [450924,64547] 0 2024-04-26T12:06:58.082 INFO:tasks.workunit.client.0.smithi052.stdout:4/696: fdatasync d3/d12/fa2 0 2024-04-26T12:06:58.084 INFO:tasks.workunit.client.0.smithi052.stdout:7/723: creat d1/d1c/d23/fde x:0 0 0 2024-04-26T12:06:58.084 INFO:tasks.workunit.client.0.smithi052.stdout:8/664: link d0/d16/d28/c99 d0/d4/d5/d27/d57/d8a/cd5 0 2024-04-26T12:06:58.085 INFO:tasks.workunit.client.0.smithi052.stdout:0/726: dwrite d0/d1/d2c/d42/fbf [0,4194304] 0 2024-04-26T12:06:58.085 INFO:tasks.workunit.client.0.smithi052.stdout:4/697: dread - d3/d12/d34/d45/d67/d6c/fad zero size 2024-04-26T12:06:58.086 INFO:tasks.workunit.client.0.smithi052.stdout:0/727: rmdir d0/d26 39 2024-04-26T12:06:58.086 INFO:tasks.workunit.client.0.smithi052.stdout:4/698: symlink d3/d15/d76/lf1 0 2024-04-26T12:06:58.089 INFO:tasks.workunit.client.0.smithi052.stdout:4/699: write d3/d15/f17 [5959549,123635] 0 2024-04-26T12:06:58.089 INFO:tasks.workunit.client.0.smithi052.stdout:0/728: symlink d0/d1/d2c/d42/da5/lec 0 2024-04-26T12:06:58.090 INFO:tasks.workunit.client.0.smithi052.stdout:3/663: dwrite d2/d4/dc/f7a [0,4194304] 0 2024-04-26T12:06:58.090 INFO:tasks.workunit.client.0.smithi052.stdout:2/740: dwrite d0/d3f/d56/f64 [0,4194304] 0 2024-04-26T12:06:58.090 INFO:tasks.workunit.client.0.smithi052.stdout:7/724: rename d1/d1c/d21/d2f/d68/cc3 to d1/d1c/d21/d2f/d33/d3a/d64/cdf 0 2024-04-26T12:06:58.091 INFO:tasks.workunit.client.0.smithi052.stdout:0/729: dread - d0/d5a/f88 zero size 2024-04-26T12:06:58.091 INFO:tasks.workunit.client.0.smithi052.stdout:1/662: dread d0/f20 [0,4194304] 0 2024-04-26T12:06:58.092 INFO:tasks.workunit.client.0.smithi052.stdout:3/664: unlink d2/d4/c17 0 2024-04-26T12:06:58.092 INFO:tasks.workunit.client.0.smithi052.stdout:4/700: creat d3/d12/d59/d96/dc0/ddd/dca/ff2 x:0 0 0 2024-04-26T12:06:58.092 INFO:tasks.workunit.client.0.smithi052.stdout:2/741: creat d0/d7/d2f/d3d/ff7 x:0 0 0 2024-04-26T12:06:58.092 INFO:tasks.workunit.client.0.smithi052.stdout:0/730: mknod d0/d26/d85/ced 0 2024-04-26T12:06:58.093 INFO:tasks.workunit.client.0.smithi052.stdout:1/663: chown d0/da/f4f 0 1 2024-04-26T12:06:58.093 INFO:tasks.workunit.client.0.smithi052.stdout:2/742: creat d0/d7/d22/ff8 x:0 0 0 2024-04-26T12:06:58.094 INFO:tasks.workunit.client.0.smithi052.stdout:3/665: symlink d2/d4/dc/d1d/d25/lc5 0 2024-04-26T12:06:58.094 INFO:tasks.workunit.client.0.smithi052.stdout:0/731: write d0/d3d/f3f [5934959,36110] 0 2024-04-26T12:06:58.094 INFO:tasks.workunit.client.0.smithi052.stdout:4/701: read d3/d22/d30/f5c [741329,19272] 0 2024-04-26T12:06:58.094 INFO:tasks.workunit.client.0.smithi052.stdout:1/664: rmdir d0/da/d2e 39 2024-04-26T12:06:58.095 INFO:tasks.workunit.client.0.smithi052.stdout:8/665: truncate d0/d4/dc/d68/f79 671480 0 2024-04-26T12:06:58.096 INFO:tasks.workunit.client.0.smithi052.stdout:2/743: write d0/d7/d2f/d3d/fe5 [183825,53732] 0 2024-04-26T12:06:58.096 INFO:tasks.workunit.client.0.smithi052.stdout:3/666: write d2/d4/d41/f66 [1146917,74117] 0 2024-04-26T12:06:58.096 INFO:tasks.workunit.client.0.smithi052.stdout:0/732: stat d0/d1/d2c/d42/d70/l75 0 2024-04-26T12:06:58.097 INFO:tasks.workunit.client.0.smithi052.stdout:4/702: creat d3/d12/d34/d43/ff3 x:0 0 0 2024-04-26T12:06:58.097 INFO:tasks.workunit.client.0.smithi052.stdout:8/666: creat d0/d3e/d87/fd6 x:0 0 0 2024-04-26T12:06:58.097 INFO:tasks.workunit.client.0.smithi052.stdout:1/665: symlink d0/d2/dd/d40/dc1/d1d/ld9 0 2024-04-26T12:06:58.097 INFO:tasks.workunit.client.0.smithi052.stdout:2/744: dread - d0/d3f/fd7 zero size 2024-04-26T12:06:58.098 INFO:tasks.workunit.client.0.smithi052.stdout:1/666: chown d0/da 45184278 1 2024-04-26T12:06:58.099 INFO:tasks.workunit.client.0.smithi052.stdout:4/703: creat d3/d15/d76/ff4 x:0 0 0 2024-04-26T12:06:58.099 INFO:tasks.workunit.client.0.smithi052.stdout:2/745: stat d0/d7/c65 0 2024-04-26T12:06:58.099 INFO:tasks.workunit.client.0.smithi052.stdout:7/725: dwrite d1/d1c/d21/d2f/fcf [0,4194304] 0 2024-04-26T12:06:58.099 INFO:tasks.workunit.client.0.smithi052.stdout:3/667: rename d2/d4/d41/d59/l89 to d2/d4/d41/d5c/lc6 0 2024-04-26T12:06:58.099 INFO:tasks.workunit.client.0.smithi052.stdout:1/667: mknod d0/d2/d88/dbd/cda 0 2024-04-26T12:06:58.100 INFO:tasks.workunit.client.0.smithi052.stdout:7/726: mknod d1/d1c/d65/ce0 0 2024-04-26T12:06:58.100 INFO:tasks.workunit.client.0.smithi052.stdout:2/746: unlink d0/d7/c5b 0 2024-04-26T12:06:58.100 INFO:tasks.workunit.client.0.smithi052.stdout:4/704: truncate d3/d1f/d21/faf 216931 0 2024-04-26T12:06:58.101 INFO:tasks.workunit.client.0.smithi052.stdout:1/668: fsync d0/d2/d88/fb4 0 2024-04-26T12:06:58.102 INFO:tasks.workunit.client.0.smithi052.stdout:3/668: link d2/d4/f64 d2/d4/d2a/d96/fc7 0 2024-04-26T12:06:58.102 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:58.101+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:58.102 INFO:tasks.workunit.client.0.smithi052.stdout:4/705: getdents d3/d44 0 2024-04-26T12:06:58.103 INFO:tasks.workunit.client.0.smithi052.stdout:2/747: getdents d0/d3f/d56/d6d/d5a/d73 0 2024-04-26T12:06:58.103 INFO:tasks.workunit.client.0.smithi052.stdout:3/669: fsync d2/d4/dc/d1d/d25/f3b 0 2024-04-26T12:06:58.103 INFO:tasks.workunit.client.0.smithi052.stdout:0/733: read d0/d1/d11/f61 [1915675,43523] 0 2024-04-26T12:06:58.104 INFO:tasks.workunit.client.0.smithi052.stdout:6/741: dread da/d22/d29/dd4/fe3 [0,4194304] 0 2024-04-26T12:06:58.104 INFO:tasks.workunit.client.0.smithi052.stdout:4/706: rmdir d3/d12/d34 39 2024-04-26T12:06:58.105 INFO:tasks.workunit.client.0.smithi052.stdout:0/734: write d0/d1/d11/fcd [487732,118488] 0 2024-04-26T12:06:58.106 INFO:tasks.workunit.client.0.smithi052.stdout:6/742: mkdir da/d22/d29/d31/d108 0 2024-04-26T12:06:58.106 INFO:tasks.workunit.client.0.smithi052.stdout:4/707: stat d3/d12/d34/d45/c4a 0 2024-04-26T12:06:58.106 INFO:tasks.workunit.client.0.smithi052.stdout:5/727: dread db/dd/d34/d69/d8a/f8b [0,4194304] 0 2024-04-26T12:06:58.109 INFO:tasks.workunit.client.0.smithi052.stdout:5/728: chown db/dd/d34/d69/d8a/da9 540 1 2024-04-26T12:06:58.109 INFO:tasks.workunit.client.0.smithi052.stdout:1/669: dwrite d0/d2/dd/d40/d81/d9a/fb8 [0,4194304] 0 2024-04-26T12:06:58.109 INFO:tasks.workunit.client.0.smithi052.stdout:4/708: write d3/d22/d30/fae [490520,60777] 0 2024-04-26T12:06:58.109 INFO:tasks.workunit.client.0.smithi052.stdout:0/735: mknod d0/d1/d1a/d20/d47/d84/cee 0 2024-04-26T12:06:58.111 INFO:tasks.workunit.client.0.smithi052.stdout:1/670: chown d0/da/db5 371938 1 2024-04-26T12:06:58.111 INFO:tasks.workunit.client.0.smithi052.stdout:9/714: dread d3/db/d10/d3c/d40/d96/f6e [0,4194304] 0 2024-04-26T12:06:58.112 INFO:tasks.workunit.client.0.smithi052.stdout:6/743: link da/d22/d3c/f66 da/d22/d29/dd4/ddf/d92/f109 0 2024-04-26T12:06:58.112 INFO:tasks.workunit.client.0.smithi052.stdout:7/727: dread d1/d1c/f9a [0,4194304] 0 2024-04-26T12:06:58.112 INFO:tasks.workunit.client.0.smithi052.stdout:4/709: write d3/f10 [5100495,112502] 0 2024-04-26T12:06:58.113 INFO:tasks.workunit.client.0.smithi052.stdout:3/670: dwrite d2/d4/dc/d1d/d25/d36/f9a [0,4194304] 0 2024-04-26T12:06:58.114 INFO:tasks.workunit.client.0.smithi052.stdout:5/729: chown db/dd/d34/d69/d8a/da9/dd6 46743 1 2024-04-26T12:06:58.115 INFO:tasks.workunit.client.0.smithi052.stdout:7/728: write d1/f16 [1523038,41403] 0 2024-04-26T12:06:58.115 INFO:tasks.workunit.client.0.smithi052.stdout:8/667: dread d0/d16/f23 [0,4194304] 0 2024-04-26T12:06:58.115 INFO:tasks.workunit.client.0.smithi052.stdout:1/671: mkdir d0/d2/dd/d40/d81/d9a/ddb 0 2024-04-26T12:06:58.116 INFO:tasks.workunit.client.0.smithi052.stdout:9/715: mkdir d3/d3b/dfd 0 2024-04-26T12:06:58.116 INFO:tasks.workunit.client.0.smithi052.stdout:3/671: readlink d2/d4/d2a/d2d/d4d/l8e 0 2024-04-26T12:06:58.116 INFO:tasks.workunit.client.0.smithi052.stdout:6/744: creat da/d22/d29/dd4/ddf/d7c/f10a x:0 0 0 2024-04-26T12:06:58.117 INFO:tasks.workunit.client.0.smithi052.stdout:2/748: dwrite d0/d3f/d56/d6d/d5a/dd5/d3a/ff5 [0,4194304] 0 2024-04-26T12:06:58.119 INFO:tasks.workunit.client.0.smithi052.stdout:9/716: mkdir d3/d3b/dea/dfe 0 2024-04-26T12:06:58.120 INFO:tasks.workunit.client.0.smithi052.stdout:8/668: write d0/d4/d5/d27/d57/f88 [5698037,10020] 0 2024-04-26T12:06:58.120 INFO:tasks.workunit.client.0.smithi052.stdout:1/672: dread d0/f67 [0,4194304] 0 2024-04-26T12:06:58.121 INFO:tasks.workunit.client.0.smithi052.stdout:6/745: rmdir da/d22/d29/dd4/ddf/d7c/d94 39 2024-04-26T12:06:58.121 INFO:tasks.workunit.client.0.smithi052.stdout:2/749: fsync d0/d3f/d56/d6d/d5a/d82/f93 0 2024-04-26T12:06:58.123 INFO:tasks.workunit.client.0.smithi052.stdout:0/736: dwrite d0/d1/d52/fe4 [0,4194304] 0 2024-04-26T12:06:58.125 INFO:tasks.workunit.client.0.smithi052.stdout:1/673: fdatasync d0/d2/dd/d40/dac/fb9 0 2024-04-26T12:06:58.125 INFO:tasks.workunit.client.0.smithi052.stdout:2/750: fdatasync d0/d7/d2f/f78 0 2024-04-26T12:06:58.125 INFO:tasks.workunit.client.0.smithi052.stdout:9/717: link d3/d3b/le0 d3/db/d10/d2e/d5c/lff 0 2024-04-26T12:06:58.126 INFO:tasks.workunit.client.0.smithi052.stdout:8/669: rmdir d0/d4/d5/d86/d9c/db4/d75 39 2024-04-26T12:06:58.126 INFO:tasks.workunit.client.0.smithi052.stdout:0/737: rename d0/d3c/c77 to d0/d1/d11/cef 0 2024-04-26T12:06:58.127 INFO:tasks.workunit.client.0.smithi052.stdout:7/729: dwrite d1/d1f/f60 [4194304,4194304] 0 2024-04-26T12:06:58.127 INFO:tasks.workunit.client.0.smithi052.stdout:6/746: truncate da/d22/d29/d31/d39/f48 371623 0 2024-04-26T12:06:58.128 INFO:tasks.workunit.client.0.smithi052.stdout:8/670: rmdir d0/d4/dc/d68/d84 39 2024-04-26T12:06:58.128 INFO:tasks.workunit.client.0.smithi052.stdout:1/674: mknod d0/d2/dd/d40/d81/d9a/dce/dcf/cdc 0 2024-04-26T12:06:58.129 INFO:tasks.workunit.client.0.smithi052.stdout:0/738: write d0/d1/d1a/d20/d47/d84/fbc [45269,52059] 0 2024-04-26T12:06:58.129 INFO:tasks.workunit.client.0.smithi052.stdout:2/751: chown d0/d3f/d56/d6d/d5a/d73/d4b/c7f 60523250 1 2024-04-26T12:06:58.129 INFO:tasks.workunit.client.0.smithi052.stdout:5/730: dwrite db/dc/d5f/d50/d91/fe6 [0,4194304] 0 2024-04-26T12:06:58.130 INFO:tasks.workunit.client.0.smithi052.stdout:9/718: read d3/d3b/f3e [2692652,73159] 0 2024-04-26T12:06:58.130 INFO:tasks.workunit.client.0.smithi052.stdout:8/671: creat d0/d4/d5/db/d20/d7b/fd7 x:0 0 0 2024-04-26T12:06:58.131 INFO:tasks.workunit.client.0.smithi052.stdout:6/747: unlink da/d22/d29/d31/d6f/l8c 0 2024-04-26T12:06:58.132 INFO:tasks.workunit.client.0.smithi052.stdout:7/730: getdents d1/d1c/d21/d2f/d33/d92 0 2024-04-26T12:06:58.132 INFO:tasks.workunit.client.0.smithi052.stdout:9/719: write d3/d3b/fd2 [2486229,126352] 0 2024-04-26T12:06:58.132 INFO:tasks.workunit.client.0.smithi052.stdout:5/731: fsync db/dd/d34/d69/d8a/f8b 0 2024-04-26T12:06:58.133 INFO:tasks.workunit.client.0.smithi052.stdout:2/752: rename d0/d7/d2f/d4c to d0/d3f/d56/d6d/d5a/de4/df9 0 2024-04-26T12:06:58.133 INFO:tasks.workunit.client.0.smithi052.stdout:1/675: truncate d0/d2/dd/d40/dc1/d1d/d91/fbb 344535 0 2024-04-26T12:06:58.133 INFO:tasks.workunit.client.0.smithi052.stdout:6/748: creat da/d5d/d9c/f10b x:0 0 0 2024-04-26T12:06:58.134 INFO:tasks.workunit.client.0.smithi052.stdout:0/739: getdents d0/d1/d2c/d42/da5/dba/dbb 0 2024-04-26T12:06:58.134 INFO:tasks.workunit.client.0.smithi052.stdout:9/720: creat d3/db/d10/d3c/d40/d96/f100 x:0 0 0 2024-04-26T12:06:58.135 INFO:tasks.workunit.client.0.smithi052.stdout:7/731: creat d1/dab/d4c/dd6/fe1 x:0 0 0 2024-04-26T12:06:58.135 INFO:tasks.workunit.client.0.smithi052.stdout:5/732: unlink db/dc/d5f/d50/f48 0 2024-04-26T12:06:58.136 INFO:tasks.workunit.client.0.smithi052.stdout:1/676: creat d0/d2/dd/d40/d81/d9a/fdd x:0 0 0 2024-04-26T12:06:58.136 INFO:tasks.workunit.client.0.smithi052.stdout:2/753: stat d0/d3f/d56/d8d/d99/db9/le3 0 2024-04-26T12:06:58.136 INFO:tasks.workunit.client.0.smithi052.stdout:9/721: creat d3/db/d52/f101 x:0 0 0 2024-04-26T12:06:58.138 INFO:tasks.workunit.client.0.smithi052.stdout:5/733: unlink db/dd/d18/d60/d64/f24 0 2024-04-26T12:06:58.139 INFO:tasks.workunit.client.0.smithi052.stdout:7/732: mknod d1/d1c/d21/d2f/d33/d3a/d64/ce2 0 2024-04-26T12:06:58.139 INFO:tasks.workunit.client.0.smithi052.stdout:9/722: mkdir d3/d3b/d102 0 2024-04-26T12:06:58.139 INFO:tasks.workunit.client.0.smithi052.stdout:3/672: dread d2/d4/d41/f66 [0,4194304] 0 2024-04-26T12:06:58.140 INFO:tasks.workunit.client.0.smithi052.stdout:8/672: dwrite d0/d4/d5/d86/d9c/db4/d58/d8f/f91 [0,4194304] 0 2024-04-26T12:06:58.140 INFO:tasks.workunit.client.0.smithi052.stdout:1/677: rename d0/d1e to d0/d2/dd/d40/dac/dde 0 2024-04-26T12:06:58.141 INFO:tasks.workunit.client.0.smithi052.stdout:9/723: chown d3/db/d10/d3c/fa5 265923116 1 2024-04-26T12:06:58.143 INFO:tasks.workunit.client.0.smithi052.stdout:7/733: creat d1/fe3 x:0 0 0 2024-04-26T12:06:58.143 INFO:tasks.workunit.client.0.smithi052.stdout:1/678: symlink d0/d83/d4b/d56/ldf 0 2024-04-26T12:06:58.144 INFO:tasks.workunit.client.0.smithi052.stdout:9/724: chown d3/db/d10/d2e/de9 290851 1 2024-04-26T12:06:58.145 INFO:tasks.workunit.client.0.smithi052.stdout:6/749: dwrite da/d51/f5b [0,4194304] 0 2024-04-26T12:06:58.145 INFO:tasks.workunit.client.0.smithi052.stdout:2/754: dread d0/f33 [0,4194304] 0 2024-04-26T12:06:58.146 INFO:tasks.workunit.client.0.smithi052.stdout:3/673: truncate d2/d4/d2a/dbf/faf 1250467 0 2024-04-26T12:06:58.146 INFO:tasks.workunit.client.0.smithi052.stdout:8/673: mkdir d0/d4/d5/d86/d9c/db4/dd8 0 2024-04-26T12:06:58.147 INFO:tasks.workunit.client.0.smithi052.stdout:4/710: dread d3/d22/d30/f70 [0,4194304] 0 2024-04-26T12:06:58.148 INFO:tasks.workunit.client.0.smithi052.stdout:9/725: mkdir d3/db/d10/d2e/d5c/d103 0 2024-04-26T12:06:58.150 INFO:tasks.workunit.client.0.smithi052.stdout:6/750: fdatasync da/d22/d29/dd4/ddf/d92/d96/f9e 0 2024-04-26T12:06:58.150 INFO:tasks.workunit.client.0.smithi052.stdout:0/740: dwrite d0/d26/d36/f9e [0,4194304] 0 2024-04-26T12:06:58.150 INFO:tasks.workunit.client.0.smithi052.stdout:9/726: creat d3/d23/f104 x:0 0 0 2024-04-26T12:06:58.150 INFO:tasks.workunit.client.0.smithi052.stdout:8/674: creat d0/d4/d5/d86/d9c/fd9 x:0 0 0 2024-04-26T12:06:58.151 INFO:tasks.workunit.client.0.smithi052.stdout:4/711: unlink d3/d12/d34/d45/c4a 0 2024-04-26T12:06:58.151 INFO:tasks.workunit.client.0.smithi052.stdout:2/755: creat d0/d3f/d56/d6d/d5a/de4/df9/ffa x:0 0 0 2024-04-26T12:06:58.151 INFO:tasks.workunit.client.0.smithi052.stdout:5/734: dwrite db/dd/d34/d69/d8a/f8b [0,4194304] 0 2024-04-26T12:06:58.152 INFO:tasks.workunit.client.0.smithi052.stdout:3/674: write d2/d4/f3e [2749528,116257] 0 2024-04-26T12:06:58.153 INFO:tasks.workunit.client.0.smithi052.stdout:1/679: dread d0/f20 [0,4194304] 0 2024-04-26T12:06:58.153 INFO:tasks.workunit.client.0.smithi052.stdout:9/727: unlink d3/db/d10/f85 0 2024-04-26T12:06:58.153 INFO:tasks.workunit.client.0.smithi052.stdout:2/756: creat d0/d7/d2f/ffb x:0 0 0 2024-04-26T12:06:58.154 INFO:tasks.workunit.client.0.smithi052.stdout:2/757: creat d0/d7/d2f/ffc x:0 0 0 2024-04-26T12:06:58.155 INFO:tasks.workunit.client.0.smithi052.stdout:0/741: truncate d0/d3d/dd2/fdb 4065404 0 2024-04-26T12:06:58.155 INFO:tasks.workunit.client.0.smithi052.stdout:5/735: creat db/dd/d34/fed x:0 0 0 2024-04-26T12:06:58.155 INFO:tasks.workunit.client.0.smithi052.stdout:7/734: dwrite d1/d1c/d21/d2f/f4e [0,4194304] 0 2024-04-26T12:06:58.156 INFO:tasks.workunit.client.0.smithi052.stdout:3/675: truncate d2/d4/d2a/d96/fc7 843423 0 2024-04-26T12:06:58.157 INFO:tasks.workunit.client.0.smithi052.stdout:1/680: write d0/d2/dd/d40/dc1/d3c/d9b/fa9 [1036976,6930] 0 2024-04-26T12:06:58.158 INFO:tasks.workunit.client.0.smithi052.stdout:9/728: link d3/db/d10/d54/l59 d3/db/d52/dfa/l105 0 2024-04-26T12:06:58.159 INFO:tasks.workunit.client.0.smithi052.stdout:7/735: getdents d1/d1f/d55/ddd 0 2024-04-26T12:06:58.160 INFO:tasks.workunit.client.0.smithi052.stdout:2/758: rename d0/d7/d2f/d8c/fb7 to d0/d3f/d56/d6d/d5a/ffd 0 2024-04-26T12:06:58.160 INFO:tasks.workunit.client.0.smithi052.stdout:7/736: chown d1/dab 197 1 2024-04-26T12:06:58.160 INFO:tasks.workunit.client.0.smithi052.stdout:6/751: dwrite da/d22/d29/dd4/ddf/d92/d96/fe7 [0,4194304] 0 2024-04-26T12:06:58.160 INFO:tasks.workunit.client.0.smithi052.stdout:9/729: symlink d3/db/d2b/l106 0 2024-04-26T12:06:58.160 INFO:tasks.workunit.client.0.smithi052.stdout:3/676: mknod d2/d4/dc/d1d/d3f/da2/cc8 0 2024-04-26T12:06:58.161 INFO:tasks.workunit.client.0.smithi052.stdout:1/681: creat d0/d2/dd/d40/dc1/d1d/fe0 x:0 0 0 2024-04-26T12:06:58.161 INFO:tasks.workunit.client.0.smithi052.stdout:2/759: creat d0/d3f/d56/d8d/d99/ffe x:0 0 0 2024-04-26T12:06:58.162 INFO:tasks.workunit.client.0.smithi052.stdout:9/730: fsync d3/db/d10/d3c/d40/d96/db5/d8f/ddc/ff1 0 2024-04-26T12:06:58.162 INFO:tasks.workunit.client.0.smithi052.stdout:6/752: creat da/d22/d29/dd4/df7/d7e/d8b/f10c x:0 0 0 2024-04-26T12:06:58.162 INFO:tasks.workunit.client.0.smithi052.stdout:7/737: rename d1/db7/cd5 to d1/d1c/d21/d2f/d33/d92/ce4 0 2024-04-26T12:06:58.163 INFO:tasks.workunit.client.0.smithi052.stdout:3/677: write d2/d4/dc/d1d/d25/d36/d1c/f4a [5160301,122949] 0 2024-04-26T12:06:58.163 INFO:tasks.workunit.client.0.smithi052.stdout:9/731: creat d3/db/d52/f107 x:0 0 0 2024-04-26T12:06:58.164 INFO:tasks.workunit.client.0.smithi052.stdout:2/760: creat d0/d3f/d56/d6d/d5a/dd5/d4d/fff x:0 0 0 2024-04-26T12:06:58.164 INFO:tasks.workunit.client.0.smithi052.stdout:3/678: creat d2/d4/d41/d5c/fc9 x:0 0 0 2024-04-26T12:06:58.164 INFO:tasks.workunit.client.0.smithi052.stdout:8/675: rmdir d0/d4/d5/d86 39 2024-04-26T12:06:58.164 INFO:tasks.workunit.client.0.smithi052.stdout:6/753: symlink da/d22/d29/dd4/df7/d7e/l10d 0 2024-04-26T12:06:58.165 INFO:tasks.workunit.client.0.smithi052.stdout:7/738: truncate d1/d1c/d21/d2f/d33/f49 1157844 0 2024-04-26T12:06:58.165 INFO:tasks.workunit.client.0.smithi052.stdout:2/761: mknod d0/d3f/d56/d6d/c100 0 2024-04-26T12:06:58.166 INFO:tasks.workunit.client.0.smithi052.stdout:8/676: chown d0/d4/d5/d27/d69/fa2 0 1 2024-04-26T12:06:58.166 INFO:tasks.workunit.client.0.smithi052.stdout:7/739: stat d1/d1c/d21/d2f/d33/d3a/d64/cb8 0 2024-04-26T12:06:58.167 INFO:tasks.workunit.client.0.smithi052.stdout:2/762: rmdir d0/d3f/d56/d6d/d5a/d73/d4b 39 2024-04-26T12:06:58.167 INFO:tasks.workunit.client.0.smithi052.stdout:8/677: mkdir d0/d4/d5/d27/d57/dda 0 2024-04-26T12:06:58.168 INFO:tasks.workunit.client.0.smithi052.stdout:7/740: symlink d1/d1c/d21/d2f/d33/d3a/d64/le5 0 2024-04-26T12:06:58.168 INFO:tasks.workunit.client.0.smithi052.stdout:2/763: creat d0/d7/d22/f101 x:0 0 0 2024-04-26T12:06:58.170 INFO:tasks.workunit.client.0.smithi052.stdout:1/682: truncate d0/d83/d4b/d56/f6d 733313 0 2024-04-26T12:06:58.170 INFO:tasks.workunit.client.0.smithi052.stdout:7/741: write d1/d1c/d21/f7f [1709187,27024] 0 2024-04-26T12:06:58.170 INFO:tasks.workunit.client.0.smithi052.stdout:3/679: dread d2/d4/dc/d1d/d25/d36/f9a [0,4194304] 0 2024-04-26T12:06:58.170 INFO:tasks.workunit.client.0.smithi052.stdout:8/678: creat d0/d4/d5/d86/d9c/db4/dd8/fdb x:0 0 0 2024-04-26T12:06:58.171 INFO:tasks.workunit.client.0.smithi052.stdout:7/742: truncate d1/d1f/f72 954676 0 2024-04-26T12:06:58.171 INFO:tasks.workunit.client.0.smithi052.stdout:4/712: dread d3/d12/d34/d45/f61 [0,4194304] 0 2024-04-26T12:06:58.172 INFO:tasks.workunit.client.0.smithi052.stdout:4/713: creat d3/d44/d4b/ff5 x:0 0 0 2024-04-26T12:06:58.172 INFO:tasks.workunit.client.0.smithi052.stdout:3/680: rename d2/d4/d41/l5b to d2/d4/dc/d1d/d25/d36/d1c/lca 0 2024-04-26T12:06:58.172 INFO:tasks.workunit.client.0.smithi052.stdout:7/743: symlink d1/d1c/d21/d2f/d33/le6 0 2024-04-26T12:06:58.172 INFO:tasks.workunit.client.0.smithi052.stdout:8/679: dread d0/d4/dc/d68/f79 [0,4194304] 0 2024-04-26T12:06:58.174 INFO:tasks.workunit.client.0.smithi052.stdout:4/714: unlink d3/d12/c26 0 2024-04-26T12:06:58.174 INFO:tasks.workunit.client.0.smithi052.stdout:8/680: fsync d0/d16/d28/f9d 0 2024-04-26T12:06:58.175 INFO:tasks.workunit.client.0.smithi052.stdout:1/683: dread d0/d2/dd/d40/dc1/d1d/d91/f94 [0,4194304] 0 2024-04-26T12:06:58.176 INFO:tasks.workunit.client.0.smithi052.stdout:4/715: link d3/d12/fa2 d3/d2b/dab/db6/ff6 0 2024-04-26T12:06:58.177 INFO:tasks.workunit.client.0.smithi052.stdout:2/764: dwrite d0/fb0 [0,4194304] 0 2024-04-26T12:06:58.178 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:58.178 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:58.178 INFO:tasks.workunit.client.0.smithi052.stdout:1/684: write d0/d2/dd/d40/dc1/d1d/fe0 [870022,51837] 0 2024-04-26T12:06:58.179 INFO:tasks.workunit.client.0.smithi052.stdout:2/765: fsync d0/d3f/d56/d6d/d5a/d73/d4b/fd4 0 2024-04-26T12:06:58.180 INFO:tasks.workunit.client.0.smithi052.stdout:2/766: chown d0/d3f 5060 1 2024-04-26T12:06:58.181 INFO:tasks.workunit.client.0.smithi052.stdout:8/681: dwrite d0/d3e/d87/fd2 [0,4194304] 0 2024-04-26T12:06:58.182 INFO:tasks.workunit.client.0.smithi052.stdout:1/685: rename d0/d83/d4b/d56/f5d to d0/d2/dd/d40/dc1/d3c/d9b/fe1 0 2024-04-26T12:06:58.182 INFO:tasks.workunit.client.0.smithi052.stdout:2/767: chown d0/d3f/d56/d6d/d5a/d73/d4b/c7f 33 1 2024-04-26T12:06:58.182 INFO:tasks.workunit.client.0.smithi052.stdout:2/768: chown d0/d3f/d56/d8d/c76 4 1 2024-04-26T12:06:58.183 INFO:tasks.workunit.client.0.smithi052.stdout:8/682: link d0/d3e/d87/fd6 d0/d4/d5/d86/d9c/db4/fdc 0 2024-04-26T12:06:58.184 INFO:tasks.workunit.client.0.smithi052.stdout:3/681: dread d2/d1f/f2c [0,4194304] 0 2024-04-26T12:06:58.184 INFO:tasks.workunit.client.0.smithi052.stdout:2/769: symlink d0/d3f/d56/d6d/d5a/de4/df9/l102 0 2024-04-26T12:06:58.185 INFO:tasks.workunit.client.0.smithi052.stdout:3/682: unlink d2/d4/dc/d1d/f60 0 2024-04-26T12:06:58.186 INFO:tasks.workunit.client.0.smithi052.stdout:2/770: write d0/d36/dc1/fda [4309770,75757] 0 2024-04-26T12:06:58.187 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:58.188 INFO:tasks.workunit.client.0.smithi052.stdout:5/736: dread db/dc/d5f/d50/d46/f79 [0,4194304] 0 2024-04-26T12:06:58.189 INFO:tasks.workunit.client.0.smithi052.stdout:1/686: truncate d0/d2/dd/d40/dc1/d1d/d91/fbb 108851 0 2024-04-26T12:06:58.190 INFO:tasks.workunit.client.0.smithi052.stdout:5/737: creat db/dd/d34/d70/d59/fee x:0 0 0 2024-04-26T12:06:58.191 INFO:tasks.workunit.client.0.smithi052.stdout:1/687: truncate d0/d2/dd/d40/d81/d52/f72 1379158 0 2024-04-26T12:06:58.191 INFO:tasks.workunit.client.0.smithi052.stdout:5/738: mkdir db/dd/d18/d60/d64/d9c/da0/def 0 2024-04-26T12:06:58.192 INFO:tasks.workunit.client.0.smithi052.stdout:1/688: chown d0/d2/dd/d34/c93 6966 1 2024-04-26T12:06:58.192 INFO:tasks.workunit.client.0.smithi052.stdout:5/739: write db/dd/fdf [2436871,10919] 0 2024-04-26T12:06:58.193 INFO:tasks.workunit.client.0.smithi052.stdout:5/740: fsync db/dc/d5f/d50/d46/d74/fc1 0 2024-04-26T12:06:58.193 INFO:tasks.workunit.client.0.smithi052.stdout:1/689: fsync d0/d2/dd/d40/d81/d9a/da6/fc5 0 2024-04-26T12:06:58.193 INFO:tasks.workunit.client.0.smithi052.stdout:0/742: dread d0/d5b/d9d/d32/f78 [0,4194304] 0 2024-04-26T12:06:58.194 INFO:tasks.workunit.client.0.smithi052.stdout:4/716: dread d3/d2b/d40/f5b [0,4194304] 0 2024-04-26T12:06:58.195 INFO:tasks.workunit.client.0.smithi052.stdout:0/743: readlink d0/d1/d2c/d42/d70/l75 0 2024-04-26T12:06:58.195 INFO:tasks.workunit.client.0.smithi052.stdout:5/741: getdents db/dd/d18 0 2024-04-26T12:06:58.195 INFO:tasks.workunit.client.0.smithi052.stdout:0/744: fdatasync d0/f49 0 2024-04-26T12:06:58.196 INFO:tasks.workunit.client.0.smithi052.stdout:4/717: write d3/d1f/d21/faf [690443,26306] 0 2024-04-26T12:06:58.196 INFO:tasks.workunit.client.0.smithi052.stdout:5/742: rename db/dd/la5 to db/d5c/lf0 0 2024-04-26T12:06:58.197 INFO:tasks.workunit.client.0.smithi052.stdout:9/732: dread d3/f87 [0,4194304] 0 2024-04-26T12:06:58.197 INFO:tasks.workunit.client.0.smithi052.stdout:5/743: dread - db/dd/d18/d60/d64/fb5 zero size 2024-04-26T12:06:58.197 INFO:tasks.workunit.client.0.smithi052.stdout:4/718: mkdir d3/d12/d59/d96/df7 0 2024-04-26T12:06:58.197 INFO:tasks.workunit.client.0.smithi052.stdout:8/683: dread d0/d4/f51 [0,4194304] 0 2024-04-26T12:06:58.198 INFO:tasks.workunit.client.0.smithi052.stdout:5/744: mkdir db/dd/d18/d60/d64/d9c/da0/df1 0 2024-04-26T12:06:58.199 INFO:tasks.workunit.client.0.smithi052.stdout:9/733: creat d3/db/d10/d3c/d40/d96/db5/d8f/f108 x:0 0 0 2024-04-26T12:06:58.199 INFO:tasks.workunit.client.0.smithi052.stdout:4/719: read d3/d22/d30/f5c [557995,73938] 0 2024-04-26T12:06:58.199 INFO:tasks.workunit.client.0.smithi052.stdout:8/684: getdents d0/d4/dc/d68/d84 0 2024-04-26T12:06:58.199 INFO:tasks.workunit.client.0.smithi052.stdout:5/745: write db/dc/d5f/d50/fd7 [18001,34137] 0 2024-04-26T12:06:58.200 INFO:tasks.workunit.client.0.smithi052.stdout:9/734: write d3/db/d10/d3c/d40/d96/db5/d8f/fbd [1417027,76286] 0 2024-04-26T12:06:58.200 INFO:tasks.workunit.client.0.smithi052.stdout:4/720: mkdir d3/d2b/dab/dec/df8 0 2024-04-26T12:06:58.200 INFO:tasks.workunit.client.0.smithi052.stdout:5/746: chown db/dd/d18/d60/f83 2 1 2024-04-26T12:06:58.201 INFO:tasks.workunit.client.0.smithi052.stdout:9/735: truncate d3/f99 677533 0 2024-04-26T12:06:58.201 INFO:tasks.workunit.client.0.smithi052.stdout:9/736: rmdir d3/db 39 2024-04-26T12:06:58.201 INFO:tasks.workunit.client.0.smithi052.stdout:4/721: fsync d3/d12/d59/d96/dc0/ddd/dca/fea 0 2024-04-26T12:06:58.203 INFO:tasks.workunit.client.0.smithi052.stdout:5/747: read db/dd/d34/f57 [82261,52140] 0 2024-04-26T12:06:58.204 INFO:tasks.workunit.client.0.smithi052.stdout:1/690: truncate d0/d2/dd/d40/dc1/d1d/fe0 93782 0 2024-04-26T12:06:58.205 INFO:tasks.workunit.client.0.smithi052.stdout:8/685: dwrite d0/d4/d5/d27/d69/f9a [0,4194304] 0 2024-04-26T12:06:58.212 INFO:tasks.workunit.client.0.smithi052.stdout:1/691: mkdir d0/d2/dd/d40/d81/d9a/dce/de2 0 2024-04-26T12:06:58.212 INFO:tasks.workunit.client.0.smithi052.stdout:5/748: mkdir db/dd/d18/d60/d64/d9c/da0/df1/df2 0 2024-04-26T12:06:58.212 INFO:tasks.workunit.client.0.smithi052.stdout:0/745: truncate d0/d26/d36/f63 1207718 0 2024-04-26T12:06:58.212 INFO:tasks.workunit.client.0.smithi052.stdout:5/749: fsync db/dc/d5f/f3a 0 2024-04-26T12:06:58.212 INFO:tasks.workunit.client.0.smithi052.stdout:4/722: dwrite d3/d1f/d21/dd2/fe4 [0,4194304] 0 2024-04-26T12:06:58.212 INFO:tasks.workunit.client.0.smithi052.stdout:1/692: rename d0/da/faa to d0/d2/dd/d40/d81/d9a/da6/dc4/fe3 0 2024-04-26T12:06:58.213 INFO:tasks.workunit.client.0.smithi052.stdout:3/683: dread d2/d4/dc/d33/f94 [0,4194304] 0 2024-04-26T12:06:58.213 INFO:tasks.workunit.client.0.smithi052.stdout:4/723: symlink d3/d12/d59/d96/dc0/d92/lf9 0 2024-04-26T12:06:58.214 INFO:tasks.workunit.client.0.smithi052.stdout:8/686: dwrite d0/d4/f26 [0,4194304] 0 2024-04-26T12:06:58.215 INFO:tasks.workunit.client.0.smithi052.stdout:4/724: chown d3/d12/d34/d45/d67 1243 1 2024-04-26T12:06:58.215 INFO:tasks.workunit.client.0.smithi052.stdout:3/684: chown d2/d4/d2a/l8c 110758 1 2024-04-26T12:06:58.217 INFO:tasks.workunit.client.0.smithi052.stdout:0/746: dwrite d0/f3 [0,4194304] 0 2024-04-26T12:06:58.218 INFO:tasks.workunit.client.0.smithi052.stdout:9/737: dread d3/db/d13/f29 [0,4194304] 0 2024-04-26T12:06:58.218 INFO:tasks.workunit.client.0.smithi052.stdout:5/750: dwrite db/dc/d5f/d50/d46/f79 [0,4194304] 0 2024-04-26T12:06:58.218 INFO:tasks.workunit.client.0.smithi052.stdout:3/685: getdents d2/d4/dc/d1d/d3f/d9f 0 2024-04-26T12:06:58.219 INFO:tasks.workunit.client.0.smithi052.stdout:0/747: symlink d0/d1/lf0 0 2024-04-26T12:06:58.219 INFO:tasks.workunit.client.0.smithi052.stdout:9/738: fsync d3/db/fb6 0 2024-04-26T12:06:58.220 INFO:tasks.workunit.client.0.smithi052.stdout:0/748: readlink d0/d1/d1a/d20/d47/l48 0 2024-04-26T12:06:58.220 INFO:tasks.workunit.client.0.smithi052.stdout:9/739: fdatasync d3/db/d10/f38 0 2024-04-26T12:06:58.222 INFO:tasks.workunit.client.0.smithi052.stdout:0/749: truncate d0/fe6 1023292 0 2024-04-26T12:06:58.222 INFO:tasks.workunit.client.0.smithi052.stdout:3/686: link d2/d4/dc/d1d/d3f/l6c d2/d4/d41/lcb 0 2024-04-26T12:06:58.223 INFO:tasks.workunit.client.0.smithi052.stdout:8/687: dwrite d0/d4/d5/db/f5e [0,4194304] 0 2024-04-26T12:06:58.223 INFO:tasks.workunit.client.0.smithi052.stdout:0/750: stat d0/d26/d74/caa 0 2024-04-26T12:06:58.224 INFO:tasks.workunit.client.0.smithi052.stdout:0/751: fdatasync d0/d1/d1a/f4b 0 2024-04-26T12:06:58.225 INFO:tasks.workunit.client.0.smithi052.stdout:8/688: mknod d0/d4/d1c/d83/cdd 0 2024-04-26T12:06:58.226 INFO:tasks.workunit.client.0.smithi052.stdout:1/693: dwrite d0/d2/dd/d40/dc1/f57 [0,4194304] 0 2024-04-26T12:06:58.227 INFO:tasks.workunit.client.0.smithi052.stdout:6/754: sync 2024-04-26T12:06:58.227 INFO:tasks.workunit.client.0.smithi052.stdout:2/771: sync 2024-04-26T12:06:58.227 INFO:tasks.workunit.client.0.smithi052.stdout:7/744: sync 2024-04-26T12:06:58.228 INFO:tasks.workunit.client.0.smithi052.stdout:0/752: rename d0/d1/d1a/d20/l27 to d0/d26/d85/lf1 0 2024-04-26T12:06:58.228 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:58.227+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:58.229 INFO:tasks.workunit.client.0.smithi052.stdout:1/694: mknod d0/d2/dd/d40/dc1/d3c/ce4 0 2024-04-26T12:06:58.229 INFO:tasks.workunit.client.0.smithi052.stdout:8/689: rename d0/d4/d5/d86/d9c/db4/d58/d89/la1 to d0/d4/d1c/lde 0 2024-04-26T12:06:58.230 INFO:tasks.workunit.client.0.smithi052.stdout:2/772: mknod d0/d3f/d56/d6d/c103 0 2024-04-26T12:06:58.231 INFO:tasks.workunit.client.0.smithi052.stdout:8/690: chown d0/d3e/c6c 31992 1 2024-04-26T12:06:58.232 INFO:tasks.workunit.client.0.smithi052.stdout:7/745: write d1/d1c/d21/d2f/f9b [272922,100949] 0 2024-04-26T12:06:58.233 INFO:tasks.workunit.client.0.smithi052.stdout:6/755: creat da/d22/d29/dd4/df7/d7e/d8b/f10e x:0 0 0 2024-04-26T12:06:58.233 INFO:tasks.workunit.client.0.smithi052.stdout:4/725: dread d3/d12/d59/d96/dc0/f78 [0,4194304] 0 2024-04-26T12:06:58.233 INFO:tasks.workunit.client.0.smithi052.stdout:3/687: dwrite d2/d4/d41/d59/f98 [0,4194304] 0 2024-04-26T12:06:58.234 INFO:tasks.workunit.client.0.smithi052.stdout:1/695: write d0/d2/dd/d40/dc1/d1d/d91/f8a [4898350,933] 0 2024-04-26T12:06:58.236 INFO:tasks.workunit.client.0.smithi052.stdout:0/753: rmdir d0/d1/d1a/d20 39 2024-04-26T12:06:58.236 INFO:tasks.workunit.client.0.smithi052.stdout:8/691: creat d0/d4/d5/d86/d9c/fdf x:0 0 0 2024-04-26T12:06:58.237 INFO:tasks.workunit.client.0.smithi052.stdout:6/756: symlink da/d5d/l10f 0 2024-04-26T12:06:58.237 INFO:tasks.workunit.client.0.smithi052.stdout:7/746: rename d1/f14 to d1/d1f/d55/dcb/fe7 0 2024-04-26T12:06:58.237 INFO:tasks.workunit.client.0.smithi052.stdout:3/688: mkdir d2/d4/d2a/d99/db7/dcc 0 2024-04-26T12:06:58.237 INFO:tasks.workunit.client.0.smithi052.stdout:0/754: chown d0/d1/d2c/d42/da5 13 1 2024-04-26T12:06:58.237 INFO:tasks.workunit.client.0.smithi052.stdout:4/726: rename d3/d22/f52 to d3/d2e/ffa 0 2024-04-26T12:06:58.237 INFO:tasks.workunit.client.0.smithi052.stdout:9/740: dread d3/db/f20 [8388608,4194304] 0 2024-04-26T12:06:58.238 INFO:tasks.workunit.client.0.smithi052.stdout:3/689: rmdir d2/d4/dc/d1d/d25 39 2024-04-26T12:06:58.238 INFO:tasks.workunit.client.0.smithi052.stdout:7/747: mkdir d1/d1c/d21/d2f/d33/d3a/de8 0 2024-04-26T12:06:58.239 INFO:tasks.workunit.client.0.smithi052.stdout:6/757: rename da/d51/f69 to da/d22/d29/dd4/df7/d7e/d8b/f110 0 2024-04-26T12:06:58.239 INFO:tasks.workunit.client.0.smithi052.stdout:8/692: symlink d0/d4/d5/d86/d9c/db4/le0 0 2024-04-26T12:06:58.239 INFO:tasks.workunit.client.0.smithi052.stdout:4/727: creat d3/d44/ffb x:0 0 0 2024-04-26T12:06:58.240 INFO:tasks.workunit.client.0.smithi052.stdout:3/690: write d2/d4/d6b/f76 [1744842,31254] 0 2024-04-26T12:06:58.240 INFO:tasks.workunit.client.0.smithi052.stdout:0/755: rename d0/la to d0/d1/d1a/d20/lf2 0 2024-04-26T12:06:58.241 INFO:tasks.workunit.client.0.smithi052.stdout:6/758: mknod da/d22/d29/d31/d6f/c111 0 2024-04-26T12:06:58.242 INFO:tasks.workunit.client.0.smithi052.stdout:8/693: write d0/d4/d5/d27/d69/fb1 [715885,76949] 0 2024-04-26T12:06:58.243 INFO:tasks.workunit.client.0.smithi052.stdout:2/773: dwrite d0/f12 [0,4194304] 0 2024-04-26T12:06:58.243 INFO:tasks.workunit.client.0.smithi052.stdout:6/759: chown da/d22/d29/d31/d39/dc7/lcd 61 1 2024-04-26T12:06:58.245 INFO:tasks.workunit.client.0.smithi052.stdout:6/760: creat da/d51/f112 x:0 0 0 2024-04-26T12:06:58.245 INFO:tasks.workunit.client.0.smithi052.stdout:8/694: truncate d0/d4/d5/db/d20/d41/fc0 552654 0 2024-04-26T12:06:58.246 INFO:tasks.workunit.client.0.smithi052.stdout:6/761: creat da/d22/d29/d31/d6f/f113 x:0 0 0 2024-04-26T12:06:58.247 INFO:tasks.workunit.client.0.smithi052.stdout:0/756: write d0/d1/dd/fab [2028950,51253] 0 2024-04-26T12:06:58.247 INFO:tasks.workunit.client.0.smithi052.stdout:8/695: creat d0/d4/d5/d27/d57/dda/fe1 x:0 0 0 2024-04-26T12:06:58.247 INFO:tasks.workunit.client.0.smithi052.stdout:4/728: creat d3/d44/d4b/db8/dde/ffc x:0 0 0 2024-04-26T12:06:58.248 INFO:tasks.workunit.client.0.smithi052.stdout:3/691: dwrite d2/d4/dc/d33/d37/f3a [0,4194304] 0 2024-04-26T12:06:58.248 INFO:tasks.workunit.client.0.smithi052.stdout:8/696: write d0/d4/d1c/fa9 [402164,94479] 0 2024-04-26T12:06:58.248 INFO:tasks.workunit.client.0.smithi052.stdout:3/692: chown d2/d4/dc/c26 25859 1 2024-04-26T12:06:58.249 INFO:tasks.workunit.client.0.smithi052.stdout:6/762: rmdir da/d22/d29 39 2024-04-26T12:06:58.249 INFO:tasks.workunit.client.0.smithi052.stdout:4/729: rename d3/d12/d59/d96/dc0/d92/l9c to d3/d12/d34/d9b/lfd 0 2024-04-26T12:06:58.250 INFO:tasks.workunit.client.0.smithi052.stdout:3/693: dread - d2/d4/d41/fb2 zero size 2024-04-26T12:06:58.250 INFO:tasks.workunit.client.0.smithi052.stdout:8/697: creat d0/d4/d5/d86/d9c/db4/fe2 x:0 0 0 2024-04-26T12:06:58.252 INFO:tasks.workunit.client.0.smithi052.stdout:5/751: sync 2024-04-26T12:06:58.252 INFO:tasks.workunit.client.0.smithi052.stdout:8/698: unlink d0/d4/d5/d86/d9c/db4/le0 0 2024-04-26T12:06:58.252 INFO:tasks.workunit.client.0.smithi052.stdout:3/694: creat d2/d4/dc/d1d/d25/fcd x:0 0 0 2024-04-26T12:06:58.252 INFO:tasks.workunit.client.0.smithi052.stdout:6/763: getdents da/d22/d29/dd4/df7/d7e/d8b 0 2024-04-26T12:06:58.253 INFO:tasks.workunit.client.0.smithi052.stdout:3/695: unlink d2/d4/d41/l4b 0 2024-04-26T12:06:58.253 INFO:tasks.workunit.client.0.smithi052.stdout:5/752: creat db/dd/d34/d69/d8a/dc5/ff3 x:0 0 0 2024-04-26T12:06:58.253 INFO:tasks.workunit.client.0.smithi052.stdout:8/699: write d0/d4/d5/db/f96 [2321648,124194] 0 2024-04-26T12:06:58.254 INFO:tasks.workunit.client.0.smithi052.stdout:6/764: mkdir da/d22/d29/d31/d39/dc7/d114 0 2024-04-26T12:06:58.254 INFO:tasks.workunit.client.0.smithi052.stdout:3/696: unlink d2/d4/d41/d59/f71 0 2024-04-26T12:06:58.255 INFO:tasks.workunit.client.0.smithi052.stdout:6/765: mkdir da/d22/d97/d115 0 2024-04-26T12:06:58.256 INFO:tasks.workunit.client.0.smithi052.stdout:6/766: dread - da/d5d/d9c/f10b zero size 2024-04-26T12:06:58.256 INFO:tasks.workunit.client.0.smithi052.stdout:8/700: getdents d0/d4/d5 0 2024-04-26T12:06:58.256 INFO:tasks.workunit.client.0.smithi052.stdout:6/767: stat da/d22/d29/l2b 0 2024-04-26T12:06:58.258 INFO:tasks.workunit.client.0.smithi052.stdout:1/696: dread d0/d83/f27 [4194304,4194304] 0 2024-04-26T12:06:58.259 INFO:tasks.workunit.client.0.smithi052.stdout:1/697: chown d0/d83/d4b/l6a 1 1 2024-04-26T12:06:58.262 INFO:tasks.workunit.client.0.smithi052.stdout:0/757: dread d0/d26/dbe/fdf [0,4194304] 0 2024-04-26T12:06:58.263 INFO:tasks.workunit.client.0.smithi052.stdout:1/698: creat d0/d2/dd/d40/dc1/d3c/d9b/fe5 x:0 0 0 2024-04-26T12:06:58.264 INFO:tasks.workunit.client.0.smithi052.stdout:0/758: mknod d0/d3c/cf3 0 2024-04-26T12:06:58.264 INFO:tasks.workunit.client.0.smithi052.stdout:1/699: symlink d0/d2/d88/le6 0 2024-04-26T12:06:58.264 INFO:tasks.workunit.client.0.smithi052.stdout:3/697: dwrite d2/d4/f64 [0,4194304] 0 2024-04-26T12:06:58.264 INFO:tasks.workunit.client.0.smithi052.stdout:6/768: dwrite da/d22/d29/f55 [0,4194304] 0 2024-04-26T12:06:58.266 INFO:tasks.workunit.client.0.smithi052.stdout:1/700: write d0/d83/f5f [407000,109371] 0 2024-04-26T12:06:58.266 INFO:tasks.workunit.client.0.smithi052.stdout:6/769: rmdir da/d22 39 2024-04-26T12:06:58.267 INFO:tasks.workunit.client.0.smithi052.stdout:2/774: dread d0/d7/d2f/f78 [0,4194304] 0 2024-04-26T12:06:58.267 INFO:tasks.workunit.client.0.smithi052.stdout:0/759: creat d0/d5b/d9d/ff4 x:0 0 0 2024-04-26T12:06:58.267 INFO:tasks.workunit.client.0.smithi052.stdout:5/753: dread db/dd/d34/d70/fca [0,4194304] 0 2024-04-26T12:06:58.268 INFO:tasks.workunit.client.0.smithi052.stdout:9/741: dread d3/db/d10/d2e/f71 [0,4194304] 0 2024-04-26T12:06:58.268 INFO:tasks.workunit.client.0.smithi052.stdout:0/760: symlink d0/d26/dbe/lf5 0 2024-04-26T12:06:58.268 INFO:tasks.workunit.client.0.smithi052.stdout:1/701: creat d0/d2/dd/d40/d81/d9a/dce/fe7 x:0 0 0 2024-04-26T12:06:58.270 INFO:tasks.workunit.client.0.smithi052.stdout:9/742: read - d3/db/d10/d3c/d40/d96/f100 zero size 2024-04-26T12:06:58.270 INFO:tasks.workunit.client.0.smithi052.stdout:1/702: stat d0/d2/dd/d40/dc1/d1d 0 2024-04-26T12:06:58.270 INFO:tasks.workunit.client.0.smithi052.stdout:0/761: creat d0/d26/ff6 x:0 0 0 2024-04-26T12:06:58.271 INFO:tasks.workunit.client.0.smithi052.stdout:5/754: write db/dd/d34/d69/d8a/da9/d87/fba [1338215,90556] 0 2024-04-26T12:06:58.271 INFO:tasks.workunit.client.0.smithi052.stdout:7/748: dread d1/f6 [0,4194304] 0 2024-04-26T12:06:58.272 INFO:tasks.workunit.client.0.smithi052.stdout:1/703: symlink d0/d2/dd/d34/le8 0 2024-04-26T12:06:58.272 INFO:tasks.workunit.client.0.smithi052.stdout:0/762: mknod d0/d1/d1a/dce/cf7 0 2024-04-26T12:06:58.273 INFO:tasks.workunit.client.0.smithi052.stdout:9/743: mknod d3/db/d10/d3c/d40/d96/db5/d8f/c109 0 2024-04-26T12:06:58.274 INFO:tasks.workunit.client.0.smithi052.stdout:4/730: dread d3/d12/d59/d96/dc0/ddd/dca/fea [0,4194304] 0 2024-04-26T12:06:58.275 INFO:tasks.workunit.client.0.smithi052.stdout:7/749: rename d1/dab/d4c/d4d/c7b to d1/dab/ce9 0 2024-04-26T12:06:58.275 INFO:tasks.workunit.client.0.smithi052.stdout:0/763: mknod d0/d5b/d9d/d32/cf8 0 2024-04-26T12:06:58.275 INFO:tasks.workunit.client.0.smithi052.stdout:9/744: dread - d3/db/d10/d3c/d40/d96/da7/fb4 zero size 2024-04-26T12:06:58.276 INFO:tasks.workunit.client.0.smithi052.stdout:6/770: dwrite da/d22/ff9 [0,4194304] 0 2024-04-26T12:06:58.276 INFO:tasks.workunit.client.0.smithi052.stdout:4/731: read - d3/d15/f99 zero size 2024-04-26T12:06:58.277 INFO:tasks.workunit.client.0.smithi052.stdout:0/764: symlink d0/d26/dbe/lf9 0 2024-04-26T12:06:58.277 INFO:tasks.workunit.client.0.smithi052.stdout:9/745: write d3/f99 [1638309,27252] 0 2024-04-26T12:06:58.280 INFO:tasks.workunit.client.0.smithi052.stdout:7/750: rename d1/d1f/d55/la8 to d1/d1f/d55/dcb/lea 0 2024-04-26T12:06:58.280 INFO:tasks.workunit.client.0.smithi052.stdout:6/771: write da/d22/d29/f4c [4943736,38515] 0 2024-04-26T12:06:58.280 INFO:tasks.workunit.client.0.smithi052.stdout:4/732: write d3/d2b/dab/db6/fbc [611100,76273] 0 2024-04-26T12:06:58.281 INFO:tasks.workunit.client.0.smithi052.stdout:9/746: fsync d3/db/d10/d3c/d40/fbb 0 2024-04-26T12:06:58.282 INFO:tasks.workunit.client.0.smithi052.stdout:0/765: chown d0/d1/d1a/d20/d47/d84/feb 0 1 2024-04-26T12:06:58.283 INFO:tasks.workunit.client.0.smithi052.stdout:6/772: chown da/d22/d29/d31/f49 7 1 2024-04-26T12:06:58.283 INFO:tasks.workunit.client.0.smithi052.stdout:4/733: chown d3/d22/fc2 321861323 1 2024-04-26T12:06:58.283 INFO:tasks.workunit.client.0.smithi052.stdout:5/755: dwrite db/dc/f54 [0,4194304] 0 2024-04-26T12:06:58.285 INFO:tasks.workunit.client.0.smithi052.stdout:8/701: dread d0/d4/d5/d27/d69/f76 [0,4194304] 0 2024-04-26T12:06:58.285 INFO:tasks.workunit.client.0.smithi052.stdout:1/704: dwrite d0/d2/dd/f14 [0,4194304] 0 2024-04-26T12:06:58.285 INFO:tasks.workunit.client.0.smithi052.stdout:0/766: readlink d0/d1/d2c/d42/d70/l75 0 2024-04-26T12:06:58.286 INFO:tasks.workunit.client.0.smithi052.stdout:5/756: symlink db/d5c/db3/lf4 0 2024-04-26T12:06:58.286 INFO:tasks.workunit.client.0.smithi052.stdout:9/747: write d3/db/d10/d3c/d40/d96/db5/d8f/f108 [378954,69663] 0 2024-04-26T12:06:58.287 INFO:tasks.workunit.client.0.smithi052.stdout:6/773: mkdir da/d22/d29/dd4/ddf/d95/dd2/db9/d116 0 2024-04-26T12:06:58.287 INFO:tasks.workunit.client.0.smithi052.stdout:1/705: readlink d0/d2/dd/d34/l89 0 2024-04-26T12:06:58.288 INFO:tasks.workunit.client.0.smithi052.stdout:8/702: unlink d0/d4/d5/d86/d9c/db4/d58/d89/ca4 0 2024-04-26T12:06:58.289 INFO:tasks.workunit.client.0.smithi052.stdout:6/774: fsync da/d22/d29/d31/fa6 0 2024-04-26T12:06:58.289 INFO:tasks.workunit.client.0.smithi052.stdout:8/703: write d0/d4/f30 [781870,45124] 0 2024-04-26T12:06:58.290 INFO:tasks.workunit.client.0.smithi052.stdout:0/767: link d0/d26/c38 d0/d5a/cfa 0 2024-04-26T12:06:58.291 INFO:tasks.workunit.client.0.smithi052.stdout:8/704: unlink d0/d4/d5/d27/d69/f76 0 2024-04-26T12:06:58.292 INFO:tasks.workunit.client.0.smithi052.stdout:3/698: dread d2/d4/dc/d33/d75/f84 [0,4194304] 0 2024-04-26T12:06:58.293 INFO:tasks.workunit.client.0.smithi052.stdout:0/768: readlink d0/d1/d2c/d42/ld9 0 2024-04-26T12:06:58.294 INFO:tasks.workunit.client.0.smithi052.stdout:5/757: dwrite db/dc/d5f/d50/fd7 [0,4194304] 0 2024-04-26T12:06:58.295 INFO:tasks.workunit.client.0.smithi052.stdout:9/748: dread d3/db/d10/d3c/d40/d96/f6e [0,4194304] 0 2024-04-26T12:06:58.295 INFO:tasks.workunit.client.0.smithi052.stdout:2/775: dread d0/d7/f95 [4194304,4194304] 0 2024-04-26T12:06:58.295 INFO:tasks.workunit.client.0.smithi052.stdout:3/699: mknod d2/d4/d2a/d99/dc3/cce 0 2024-04-26T12:06:58.296 INFO:tasks.workunit.client.0.smithi052.stdout:0/769: chown d0/d3c/f80 418 1 2024-04-26T12:06:58.296 INFO:tasks.workunit.client.0.smithi052.stdout:5/758: getdents db/d5c 0 2024-04-26T12:06:58.297 INFO:tasks.workunit.client.0.smithi052.stdout:0/770: fdatasync d0/d1/d1a/d20/d47/fb7 0 2024-04-26T12:06:58.298 INFO:tasks.workunit.client.0.smithi052.stdout:1/706: dwrite d0/da/d2e/fa8 [0,4194304] 0 2024-04-26T12:06:58.298 INFO:tasks.workunit.client.0.smithi052.stdout:2/776: mknod d0/d3f/d56/d6d/d5a/dd5/d4d/d8b/c104 0 2024-04-26T12:06:58.298 INFO:tasks.workunit.client.0.smithi052.stdout:3/700: truncate d2/d4/d2a/d2d/fbd 819244 0 2024-04-26T12:06:58.299 INFO:tasks.workunit.client.0.smithi052.stdout:2/777: sync 2024-04-26T12:06:58.299 INFO:tasks.workunit.client.0.smithi052.stdout:0/771: chown d0/d1/d1a/d20/c29 137634 1 2024-04-26T12:06:58.300 INFO:tasks.workunit.client.0.smithi052.stdout:3/701: mkdir d2/d4/d6b/dcf 0 2024-04-26T12:06:58.300 INFO:tasks.workunit.client.0.smithi052.stdout:2/778: creat d0/d7/d2f/dee/f105 x:0 0 0 2024-04-26T12:06:58.300 INFO:tasks.workunit.client.0.smithi052.stdout:1/707: rename d0/d2/dd/d40/dc1/d3c to d0/d2/dd/d40/d81/d9a/dce/de9 0 2024-04-26T12:06:58.302 INFO:tasks.workunit.client.0.smithi052.stdout:3/702: chown d2/d4/d2a/dbf/fab 8156 1 2024-04-26T12:06:58.302 INFO:tasks.workunit.client.0.smithi052.stdout:2/779: symlink d0/d7/d2f/l106 0 2024-04-26T12:06:58.302 INFO:tasks.workunit.client.0.smithi052.stdout:5/759: write db/dc/d5f/d50/d46/d74/dbe/fdb [583576,30977] 0 2024-04-26T12:06:58.304 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:58.303+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:58.305 INFO:tasks.workunit.client.0.smithi052.stdout:5/760: symlink db/dc/d5f/d50/lf5 0 2024-04-26T12:06:58.305 INFO:tasks.workunit.client.0.smithi052.stdout:5/761: rmdir db/dc/d5f 39 2024-04-26T12:06:58.307 INFO:tasks.workunit.client.0.smithi052.stdout:3/703: dwrite d2/d4/d2a/dbf/faf [0,4194304] 0 2024-04-26T12:06:58.307 INFO:tasks.workunit.client.0.smithi052.stdout:2/780: truncate d0/d3f/d56/d8d/d99/db9/fc4 702689 0 2024-04-26T12:06:58.310 INFO:tasks.workunit.client.0.smithi052.stdout:3/704: chown d2/d4/dc/d1d/d25/d36/f9a 21245334 1 2024-04-26T12:06:58.311 INFO:tasks.workunit.client.0.smithi052.stdout:2/781: mknod d0/d3f/d56/d6d/d5a/d73/d4b/d9c/c107 0 2024-04-26T12:06:58.311 INFO:tasks.workunit.client.0.smithi052.stdout:5/762: dread db/dc/d5f/d50/d46/f79 [0,4194304] 0 2024-04-26T12:06:58.311 INFO:tasks.workunit.client.0.smithi052.stdout:5/763: chown db/dc/f1d 26 1 2024-04-26T12:06:58.311 INFO:tasks.workunit.client.0.smithi052.stdout:3/705: getdents d2/d1f 0 2024-04-26T12:06:58.312 INFO:tasks.workunit.client.0.smithi052.stdout:3/706: fdatasync d2/d4/d6b/fc1 0 2024-04-26T12:06:58.312 INFO:tasks.workunit.client.0.smithi052.stdout:2/782: link d0/d7/d2f/fb3 d0/d3f/d56/d6d/d5a/d82/d91/f108 0 2024-04-26T12:06:58.312 INFO:tasks.workunit.client.0.smithi052.stdout:5/764: rename db/dc/d5f/fa2 to db/dd/d34/d70/d78/d92/ff6 0 2024-04-26T12:06:58.313 INFO:tasks.workunit.client.0.smithi052.stdout:7/751: dread d1/dab/d4c/d4d/fa1 [0,4194304] 0 2024-04-26T12:06:58.313 INFO:tasks.workunit.client.0.smithi052.stdout:3/707: readlink d2/d4/d2a/d96/lb8 0 2024-04-26T12:06:58.314 INFO:tasks.workunit.client.0.smithi052.stdout:6/775: dread da/d22/d29/dd4/ddf/d92/f109 [0,4194304] 0 2024-04-26T12:06:58.314 INFO:tasks.workunit.client.0.smithi052.stdout:8/705: dread d0/d4/d1c/f36 [0,4194304] 0 2024-04-26T12:06:58.314 INFO:tasks.workunit.client.0.smithi052.stdout:3/708: write d2/d4/d41/d59/f8f [239179,127394] 0 2024-04-26T12:06:58.315 INFO:tasks.workunit.client.0.smithi052.stdout:6/776: read - da/d22/d29/d31/d6f/f113 zero size 2024-04-26T12:06:58.315 INFO:tasks.workunit.client.0.smithi052.stdout:3/709: fdatasync d2/d4/dc/d33/d37/f3a 0 2024-04-26T12:06:58.315 INFO:tasks.workunit.client.0.smithi052.stdout:8/706: mknod d0/d4/d5/db/d20/ce3 0 2024-04-26T12:06:58.316 INFO:tasks.workunit.client.0.smithi052.stdout:5/765: read db/dc/d5f/f3a [2725720,122170] 0 2024-04-26T12:06:58.316 INFO:tasks.workunit.client.0.smithi052.stdout:0/772: dread d0/fe6 [0,4194304] 0 2024-04-26T12:06:58.318 INFO:tasks.workunit.client.0.smithi052.stdout:3/710: symlink d2/d4/dc/d33/ld0 0 2024-04-26T12:06:58.318 INFO:tasks.workunit.client.0.smithi052.stdout:6/777: link da/d22/d29/d31/cee da/c117 0 2024-04-26T12:06:58.319 INFO:tasks.workunit.client.0.smithi052.stdout:4/734: dread d3/d12/d34/d45/f5e [0,4194304] 0 2024-04-26T12:06:58.319 INFO:tasks.workunit.client.0.smithi052.stdout:0/773: creat d0/d26/d74/da6/ffb x:0 0 0 2024-04-26T12:06:58.319 INFO:tasks.workunit.client.0.smithi052.stdout:5/766: fdatasync db/dd/d18/d60/f9a 0 2024-04-26T12:06:58.319 INFO:tasks.workunit.client.0.smithi052.stdout:8/707: creat d0/d4/d5/d27/d57/d8a/fe4 x:0 0 0 2024-04-26T12:06:58.321 INFO:tasks.workunit.client.0.smithi052.stdout:4/735: dread - d3/d1f/fb4 zero size 2024-04-26T12:06:58.321 INFO:tasks.workunit.client.0.smithi052.stdout:3/711: write d2/d4/d41/f66 [1514070,47983] 0 2024-04-26T12:06:58.321 INFO:tasks.workunit.client.0.smithi052.stdout:5/767: fsync db/dd/d34/d69/fb0 0 2024-04-26T12:06:58.321 INFO:tasks.workunit.client.0.smithi052.stdout:0/774: mknod d0/d1/d2c/d42/cfc 0 2024-04-26T12:06:58.321 INFO:tasks.workunit.client.0.smithi052.stdout:4/736: creat d3/d2b/ffe x:0 0 0 2024-04-26T12:06:58.321 INFO:tasks.workunit.client.0.smithi052.stdout:0/775: sync 2024-04-26T12:06:58.321 INFO:tasks.workunit.client.0.smithi052.stdout:3/712: dread - d2/d4/dc/d1d/d25/d61/fb3 zero size 2024-04-26T12:06:58.322 INFO:tasks.workunit.client.0.smithi052.stdout:5/768: mknod db/dc/d5f/d50/d91/cf7 0 2024-04-26T12:06:58.322 INFO:tasks.workunit.client.0.smithi052.stdout:8/708: write d0/d4/d5/d86/d9c/db4/d58/d8f/f91 [3065048,106842] 0 2024-04-26T12:06:58.322 INFO:tasks.workunit.client.0.smithi052.stdout:3/713: mknod d2/d4/d41/cd1 0 2024-04-26T12:06:58.323 INFO:tasks.workunit.client.0.smithi052.stdout:4/737: fdatasync d3/d22/d30/f42 0 2024-04-26T12:06:58.323 INFO:tasks.workunit.client.0.smithi052.stdout:0/776: truncate d0/fe 2391479 0 2024-04-26T12:06:58.324 INFO:tasks.workunit.client.0.smithi052.stdout:6/778: write da/d22/d29/f2e [71625,28052] 0 2024-04-26T12:06:58.324 INFO:tasks.workunit.client.0.smithi052.stdout:4/738: fdatasync d3/d15/d53/fe7 0 2024-04-26T12:06:58.325 INFO:tasks.workunit.client.0.smithi052.stdout:0/777: mknod d0/d5b/cfd 0 2024-04-26T12:06:58.326 INFO:tasks.workunit.client.0.smithi052.stdout:5/769: symlink db/dd/d34/d69/d8a/da9/d87/d6e/db8/lf8 0 2024-04-26T12:06:58.326 INFO:tasks.workunit.client.0.smithi052.stdout:3/714: rename d2/d4/dc/d1d/d25/lc5 to d2/d4/d2a/d2d/d4d/ld2 0 2024-04-26T12:06:58.326 INFO:tasks.workunit.client.0.smithi052.stdout:6/779: readlink da/d22/d29/dd4/df7/d87/lfa 0 2024-04-26T12:06:58.328 INFO:tasks.workunit.client.0.smithi052.stdout:9/749: dread d3/db/d2b/f2f [0,4194304] 0 2024-04-26T12:06:58.328 INFO:tasks.workunit.client.0.smithi052.stdout:1/708: dread d0/d2/dd/d34/f4e [0,4194304] 0 2024-04-26T12:06:58.328 INFO:tasks.workunit.client.0.smithi052.stdout:4/739: write d3/d15/d76/fb2 [1779804,126132] 0 2024-04-26T12:06:58.328 INFO:tasks.workunit.client.0.smithi052.stdout:0/778: write d0/d26/d74/da6/ffb [518345,106173] 0 2024-04-26T12:06:58.328 INFO:tasks.workunit.client.0.smithi052.stdout:5/770: mkdir db/dd/d18/d60/d64/df9 0 2024-04-26T12:06:58.329 INFO:tasks.workunit.client.0.smithi052.stdout:3/715: symlink d2/d4/dc/d33/d75/ld3 0 2024-04-26T12:06:58.329 INFO:tasks.workunit.client.0.smithi052.stdout:0/779: write d0/d26/fb0 [274871,44912] 0 2024-04-26T12:06:58.329 INFO:tasks.workunit.client.0.smithi052.stdout:0/780: fdatasync d0/d1/d52/fe4 0 2024-04-26T12:06:58.330 INFO:tasks.workunit.client.0.smithi052.stdout:5/771: rmdir db/dc/d5f/d50/d46 39 2024-04-26T12:06:58.331 INFO:tasks.workunit.client.0.smithi052.stdout:8/709: dread d0/d4/d5/d27/d69/fa2 [0,4194304] 0 2024-04-26T12:06:58.332 INFO:tasks.workunit.client.0.smithi052.stdout:3/716: write d2/f73 [3131206,57627] 0 2024-04-26T12:06:58.332 INFO:tasks.workunit.client.0.smithi052.stdout:0/781: symlink d0/d1/d2c/d42/da5/lfe 0 2024-04-26T12:06:58.333 INFO:tasks.workunit.client.0.smithi052.stdout:7/752: dread d1/ff [0,4194304] 0 2024-04-26T12:06:58.334 INFO:tasks.workunit.client.0.smithi052.stdout:8/710: stat d0/d4/d5/d86/d9c/db4/d58/fbe 0 2024-04-26T12:06:58.335 INFO:tasks.workunit.client.0.smithi052.stdout:3/717: mkdir d2/d4/dc/d33/d37/dd4 0 2024-04-26T12:06:58.336 INFO:tasks.workunit.client.0.smithi052.stdout:5/772: mkdir db/dd/d18/d60/d64/d9c/da0/df1/dfa 0 2024-04-26T12:06:58.336 INFO:tasks.workunit.client.0.smithi052.stdout:2/783: dread d0/d7/d2f/d3d/f92 [0,4194304] 0 2024-04-26T12:06:58.336 INFO:tasks.workunit.client.0.smithi052.stdout:7/753: write d1/d1c/d23/f85 [3960834,16000] 0 2024-04-26T12:06:58.336 INFO:tasks.workunit.client.0.smithi052.stdout:0/782: rename d0/d5a/f88 to d0/d26/d36/fff 0 2024-04-26T12:06:58.337 INFO:tasks.workunit.client.0.smithi052.stdout:9/750: dwrite d3/d3b/fac [0,4194304] 0 2024-04-26T12:06:58.338 INFO:tasks.workunit.client.0.smithi052.stdout:4/740: dwrite d3/d12/d59/d96/dc0/ddd/dca/ff2 [0,4194304] 0 2024-04-26T12:06:58.338 INFO:tasks.workunit.client.0.smithi052.stdout:5/773: write db/dd/d34/d70/d78/fe0 [943345,77096] 0 2024-04-26T12:06:58.338 INFO:tasks.workunit.client.0.smithi052.stdout:8/711: creat d0/d16/d63/d8b/fe5 x:0 0 0 2024-04-26T12:06:58.338 INFO:tasks.workunit.client.0.smithi052.stdout:9/751: readlink d3/l6 0 2024-04-26T12:06:58.339 INFO:tasks.workunit.client.0.smithi052.stdout:2/784: write d0/d3f/d56/d6d/d5a/dd5/fcc [622547,21502] 0 2024-04-26T12:06:58.340 INFO:tasks.workunit.client.0.smithi052.stdout:8/712: stat d0/d4/d5/d86/d9c/db4/fac 0 2024-04-26T12:06:58.340 INFO:tasks.workunit.client.0.smithi052.stdout:4/741: write d3/d12/d34/d45/f5e [2201408,102175] 0 2024-04-26T12:06:58.341 INFO:tasks.workunit.client.0.smithi052.stdout:1/709: truncate d0/d2/dd/d40/dc1/d1d/d91/f8a 3543380 0 2024-04-26T12:06:58.341 INFO:tasks.workunit.client.0.smithi052.stdout:5/774: dread - db/dd/d34/d69/d8a/dc5/ff3 zero size 2024-04-26T12:06:58.341 INFO:tasks.workunit.client.0.smithi052.stdout:7/754: getdents d1/d1c/d21/d2f 0 2024-04-26T12:06:58.342 INFO:tasks.workunit.client.0.smithi052.stdout:2/785: symlink d0/d7/d2f/l109 0 2024-04-26T12:06:58.342 INFO:tasks.workunit.client.0.smithi052.stdout:0/783: link d0/d1/dd/c10 d0/d1/d2c/d42/da5/c100 0 2024-04-26T12:06:58.342 INFO:tasks.workunit.client.0.smithi052.stdout:0/784: chown d0/d5a 1737 1 2024-04-26T12:06:58.343 INFO:tasks.workunit.client.0.smithi052.stdout:4/742: mkdir d3/d22/d69/dff 0 2024-04-26T12:06:58.343 INFO:tasks.workunit.client.0.smithi052.stdout:9/752: link d3/d23/d7f/c50 d3/db/d2b/dd4/dde/c10a 0 2024-04-26T12:06:58.344 INFO:tasks.workunit.client.0.smithi052.stdout:1/710: symlink d0/d2/d88/lea 0 2024-04-26T12:06:58.344 INFO:tasks.workunit.client.0.smithi052.stdout:8/713: creat d0/d4/d5/d86/d9c/db4/fe6 x:0 0 0 2024-04-26T12:06:58.345 INFO:tasks.workunit.client.0.smithi052.stdout:1/711: rmdir d0/da/db5 39 2024-04-26T12:06:58.345 INFO:tasks.workunit.client.0.smithi052.stdout:7/755: link d1/d1c/d65/fbf d1/d1f/d55/feb 0 2024-04-26T12:06:58.345 INFO:tasks.workunit.client.0.smithi052.stdout:0/785: dread - d0/d1/d1a/d20/fd8 zero size 2024-04-26T12:06:58.346 INFO:tasks.workunit.client.0.smithi052.stdout:7/756: fdatasync d1/d1f/f26 0 2024-04-26T12:06:58.346 INFO:tasks.workunit.client.0.smithi052.stdout:5/775: creat db/dd/d34/d70/d59/ffb x:0 0 0 2024-04-26T12:06:58.347 INFO:tasks.workunit.client.0.smithi052.stdout:8/714: fdatasync d0/d4/d1c/fb7 0 2024-04-26T12:06:58.347 INFO:tasks.workunit.client.0.smithi052.stdout:9/753: rmdir d3/db/d10/d2e/de9 0 2024-04-26T12:06:58.347 INFO:tasks.workunit.client.0.smithi052.stdout:3/718: dwrite d2/d4/d2a/fb9 [0,4194304] 0 2024-04-26T12:06:58.347 INFO:tasks.workunit.client.0.smithi052.stdout:6/780: dread da/d51/f5b [0,4194304] 0 2024-04-26T12:06:58.349 INFO:tasks.workunit.client.0.smithi052.stdout:1/712: mknod d0/d83/d4b/ceb 0 2024-04-26T12:06:58.350 INFO:tasks.workunit.client.0.smithi052.stdout:8/715: fdatasync d0/d4/d1c/fb7 0 2024-04-26T12:06:58.350 INFO:tasks.workunit.client.0.smithi052.stdout:9/754: symlink d3/db/d10/d54/l10b 0 2024-04-26T12:06:58.352 INFO:tasks.workunit.client.0.smithi052.stdout:6/781: dread - da/d22/d29/dd4/ddf/d95/fce zero size 2024-04-26T12:06:58.352 INFO:tasks.workunit.client.0.smithi052.stdout:3/719: creat d2/d4/d41/d59/fd5 x:0 0 0 2024-04-26T12:06:58.353 INFO:tasks.workunit.client.0.smithi052.stdout:9/755: rmdir d3/db/d2b/dd4/dde 39 2024-04-26T12:06:58.353 INFO:tasks.workunit.client.0.smithi052.stdout:4/743: dwrite d3/d12/f20 [0,4194304] 0 2024-04-26T12:06:58.354 INFO:tasks.workunit.client.0.smithi052.stdout:1/713: unlink d0/d2/dd/d40/dc1/d1d/ld9 0 2024-04-26T12:06:58.354 INFO:tasks.workunit.client.0.smithi052.stdout:5/776: truncate db/dc/f12 2267808 0 2024-04-26T12:06:58.355 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:58.355 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:58.355 INFO:tasks.workunit.client.0.smithi052.stdout:4/744: stat d3/d12/d59/feb 0 2024-04-26T12:06:58.355 INFO:tasks.workunit.client.0.smithi052.stdout:6/782: fdatasync da/d22/d29/dd4/ddf/d95/fce 0 2024-04-26T12:06:58.355 INFO:tasks.workunit.client.0.smithi052.stdout:0/786: dwrite d0/f3 [4194304,4194304] 0 2024-04-26T12:06:58.357 INFO:tasks.workunit.client.0.smithi052.stdout:9/756: mknod d3/db/d10/d3c/d40/d96/db5/d8f/ddc/c10c 0 2024-04-26T12:06:58.357 INFO:tasks.workunit.client.0.smithi052.stdout:4/745: read - d3/d15/f99 zero size 2024-04-26T12:06:58.357 INFO:tasks.workunit.client.0.smithi052.stdout:0/787: fsync d0/d3c/f9a 0 2024-04-26T12:06:58.358 INFO:tasks.workunit.client.0.smithi052.stdout:2/786: dwrite d0/d3f/d56/d6d/d5a/dd5/f40 [0,4194304] 0 2024-04-26T12:06:58.358 INFO:tasks.workunit.client.0.smithi052.stdout:1/714: mkdir d0/d2/dd/d40/d81/d9a/da6/dc4/dec 0 2024-04-26T12:06:58.358 INFO:tasks.workunit.client.0.smithi052.stdout:0/788: chown d0/d1/d11 16563 1 2024-04-26T12:06:58.358 INFO:tasks.workunit.client.0.smithi052.stdout:2/787: fsync d0/f12 0 2024-04-26T12:06:58.359 INFO:tasks.workunit.client.0.smithi052.stdout:4/746: readlink d3/d1f/ldc 0 2024-04-26T12:06:58.359 INFO:tasks.workunit.client.0.smithi052.stdout:6/783: mkdir da/d22/d29/d31/d108/d118 0 2024-04-26T12:06:58.360 INFO:tasks.workunit.client.0.smithi052.stdout:0/789: fsync d0/d5b/fd0 0 2024-04-26T12:06:58.360 INFO:tasks.workunit.client.0.smithi052.stdout:1/715: creat d0/da/d2e/fed x:0 0 0 2024-04-26T12:06:58.360 INFO:tasks.workunit.client.0.smithi052.stdout:9/757: getdents d3/d23/df0 0 2024-04-26T12:06:58.361 INFO:tasks.workunit.client.0.smithi052.stdout:4/747: write d3/d15/d76/fb2 [2744017,107669] 0 2024-04-26T12:06:58.361 INFO:tasks.workunit.client.0.smithi052.stdout:6/784: symlink da/l119 0 2024-04-26T12:06:58.361 INFO:tasks.workunit.client.0.smithi052.stdout:3/720: dread d2/d4/dc/d1d/d25/d36/d1c/f20 [0,4194304] 0 2024-04-26T12:06:58.362 INFO:tasks.workunit.client.0.smithi052.stdout:0/790: creat d0/d26/d74/db4/f101 x:0 0 0 2024-04-26T12:06:58.363 INFO:tasks.workunit.client.0.smithi052.stdout:6/785: stat da/d5d/d9c/cb0 0 2024-04-26T12:06:58.363 INFO:tasks.workunit.client.0.smithi052.stdout:1/716: creat d0/d2/dd/d40/d81/d52/fee x:0 0 0 2024-04-26T12:06:58.363 INFO:tasks.workunit.client.0.smithi052.stdout:4/748: symlink d3/d15/d76/l100 0 2024-04-26T12:06:58.363 INFO:tasks.workunit.client.0.smithi052.stdout:9/758: write d3/db/d2b/f2f [4463510,19683] 0 2024-04-26T12:06:58.363 INFO:tasks.workunit.client.0.smithi052.stdout:2/788: getdents d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4 0 2024-04-26T12:06:58.364 INFO:tasks.workunit.client.0.smithi052.stdout:0/791: read - d0/d26/d85/fcf zero size 2024-04-26T12:06:58.364 INFO:tasks.workunit.client.0.smithi052.stdout:6/786: fsync da/d22/d29/d31/d6f/f113 0 2024-04-26T12:06:58.364 INFO:tasks.workunit.client.0.smithi052.stdout:3/721: symlink d2/d4/dc/d1d/ld6 0 2024-04-26T12:06:58.364 INFO:tasks.workunit.client.0.smithi052.stdout:6/787: stat da/d22/d3c/c82 0 2024-04-26T12:06:58.364 INFO:tasks.workunit.client.0.smithi052.stdout:9/759: chown d3/db/d10/d3c/d40/d96/db5/da3 1767 1 2024-04-26T12:06:58.365 INFO:tasks.workunit.client.0.smithi052.stdout:0/792: mknod d0/d1/dd/c102 0 2024-04-26T12:06:58.365 INFO:tasks.workunit.client.0.smithi052.stdout:3/722: write d2/d4/dc/f6f [3531266,4452] 0 2024-04-26T12:06:58.365 INFO:tasks.workunit.client.0.smithi052.stdout:2/789: dread d0/d3f/d56/d6d/d5a/d73/f85 [0,4194304] 0 2024-04-26T12:06:58.365 INFO:tasks.workunit.client.0.smithi052.stdout:0/793: mkdir d0/d5b/d103 0 2024-04-26T12:06:58.366 INFO:tasks.workunit.client.0.smithi052.stdout:1/717: write d0/d2/f2a [2150302,54903] 0 2024-04-26T12:06:58.367 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:58.368 INFO:tasks.workunit.client.0.smithi052.stdout:0/794: chown d0/d1/d2c 22 1 2024-04-26T12:06:58.368 INFO:tasks.workunit.client.0.smithi052.stdout:9/760: getdents d3/db/d4a 0 2024-04-26T12:06:58.368 INFO:tasks.workunit.client.0.smithi052.stdout:6/788: getdents da/d22/d29/dd4/ddf/d95/df8 0 2024-04-26T12:06:58.368 INFO:tasks.workunit.client.0.smithi052.stdout:0/795: stat d0/d3c 0 2024-04-26T12:06:58.368 INFO:tasks.workunit.client.0.smithi052.stdout:6/789: write da/d22/f3b [1325655,13073] 0 2024-04-26T12:06:58.369 INFO:tasks.workunit.client.0.smithi052.stdout:9/761: symlink d3/d23/df0/l10d 0 2024-04-26T12:06:58.369 INFO:tasks.workunit.client.0.smithi052.stdout:2/790: rename d0/d3f/d56/d6d/fdb to d0/d3f/d56/d8d/d99/f10a 0 2024-04-26T12:06:58.369 INFO:tasks.workunit.client.0.smithi052.stdout:6/790: chown da/d51/ld8 611 1 2024-04-26T12:06:58.369 INFO:tasks.workunit.client.0.smithi052.stdout:9/762: symlink d3/db/d52/dfa/l10e 0 2024-04-26T12:06:58.369 INFO:tasks.workunit.client.0.smithi052.stdout:6/791: symlink da/d22/d29/dd4/ddf/l11a 0 2024-04-26T12:06:58.370 INFO:tasks.workunit.client.0.smithi052.stdout:9/763: write d3/db/d10/d3c/d40/d96/db5/d8f/d49/fbf [3098638,104548] 0 2024-04-26T12:06:58.371 INFO:tasks.workunit.client.0.smithi052.stdout:6/792: creat da/d22/d29/dd4/ddf/d95/df8/d68/f11b x:0 0 0 2024-04-26T12:06:58.371 INFO:tasks.workunit.client.0.smithi052.stdout:9/764: fdatasync d3/db/d4a/f4d 0 2024-04-26T12:06:58.374 INFO:tasks.workunit.client.0.smithi052.stdout:2/791: dwrite d0/d7/d2f/f78 [0,4194304] 0 2024-04-26T12:06:58.375 INFO:tasks.workunit.client.0.smithi052.stdout:7/757: dread d1/d1c/d23/f85 [0,4194304] 0 2024-04-26T12:06:58.378 INFO:tasks.workunit.client.0.smithi052.stdout:7/758: rename d1/dab/ce9 to d1/d1c/dd3/cec 0 2024-04-26T12:06:58.378 INFO:tasks.workunit.client.0.smithi052.stdout:9/765: dwrite d3/db/ff8 [0,4194304] 0 2024-04-26T12:06:58.379 INFO:tasks.workunit.client.0.smithi052.stdout:7/759: read - d1/d1c/d21/d2f/f46 zero size 2024-04-26T12:06:58.380 INFO:tasks.workunit.client.0.smithi052.stdout:7/760: chown d1/d1f/f22 1949 1 2024-04-26T12:06:58.380 INFO:tasks.workunit.client.0.smithi052.stdout:2/792: dwrite d0/d3f/d56/f64 [4194304,4194304] 0 2024-04-26T12:06:58.381 INFO:tasks.workunit.client.0.smithi052.stdout:7/761: chown d1/dab/l62 694 1 2024-04-26T12:06:58.381 INFO:tasks.workunit.client.0.smithi052.stdout:9/766: link d3/db/d10/d3c/d40/d96/db5/d8f/cab d3/db/d10/d3c/c10f 0 2024-04-26T12:06:58.381 INFO:tasks.workunit.client.0.smithi052.stdout:2/793: write d0/d7/d2f/dee/ff6 [1020988,54522] 0 2024-04-26T12:06:58.382 INFO:tasks.workunit.client.0.smithi052.stdout:7/762: write d1/d1c/d21/d2f/f7d [178744,64940] 0 2024-04-26T12:06:58.382 INFO:tasks.workunit.client.0.smithi052.stdout:9/767: creat d3/db/d4a/dc6/f110 x:0 0 0 2024-04-26T12:06:58.383 INFO:tasks.workunit.client.0.smithi052.stdout:2/794: mknod d0/d3f/d56/d6d/d5a/d73/d4b/d8f/c10b 0 2024-04-26T12:06:58.384 INFO:tasks.workunit.client.0.smithi052.stdout:9/768: rename d3/db/fbe to d3/d3b/dea/dfe/f111 0 2024-04-26T12:06:58.385 INFO:tasks.workunit.client.0.smithi052.stdout:7/763: rename d1/d1c/d21/d2f/fcf to d1/d1c/d21/d2f/d33/d3a/d64/fed 0 2024-04-26T12:06:58.385 INFO:tasks.workunit.client.0.smithi052.stdout:6/793: dwrite da/d22/d29/dd4/ddf/fbd [0,4194304] 0 2024-04-26T12:06:58.386 INFO:tasks.workunit.client.0.smithi052.stdout:9/769: chown d3/db/d2b/ded 1 1 2024-04-26T12:06:58.389 INFO:tasks.workunit.client.0.smithi052.stdout:6/794: truncate da/d22/d29/dd4/ddf/d7c/d94/fd7 4991872 0 2024-04-26T12:06:58.390 INFO:tasks.workunit.client.0.smithi052.stdout:6/795: chown da/d22/d29/dd4/ddf/d7c/d94/lbe 889094 1 2024-04-26T12:06:58.390 INFO:tasks.workunit.client.0.smithi052.stdout:2/795: dwrite d0/d3f/d56/d6d/d5a/f69 [0,4194304] 0 2024-04-26T12:06:58.392 INFO:tasks.workunit.client.0.smithi052.stdout:1/718: dread d0/d83/d4b/f8f [0,4194304] 0 2024-04-26T12:06:58.392 INFO:tasks.workunit.client.0.smithi052.stdout:2/796: truncate d0/d7/fdc 376160 0 2024-04-26T12:06:58.392 INFO:tasks.workunit.client.0.smithi052.stdout:6/796: write da/d22/d29/dd4/ddf/d7c/f7d [1545847,43725] 0 2024-04-26T12:06:58.393 INFO:tasks.workunit.client.0.smithi052.stdout:1/719: mknod d0/d2/dd/d40/d81/cef 0 2024-04-26T12:06:58.394 INFO:tasks.workunit.client.0.smithi052.stdout:8/716: sync 2024-04-26T12:06:58.394 INFO:tasks.workunit.client.0.smithi052.stdout:3/723: dread d2/d4/dc/d1d/d25/d36/f9a [0,4194304] 0 2024-04-26T12:06:58.396 INFO:tasks.workunit.client.0.smithi052.stdout:3/724: chown d2/d4/d2a/f58 455 1 2024-04-26T12:06:58.397 INFO:tasks.workunit.client.0.smithi052.stdout:5/777: dread db/f1f [0,4194304] 0 2024-04-26T12:06:58.397 INFO:tasks.workunit.client.0.smithi052.stdout:2/797: dwrite d0/d7/d22/f23 [0,4194304] 0 2024-04-26T12:06:58.399 INFO:tasks.workunit.client.0.smithi052.stdout:1/720: dwrite d0/d2/d88/fb4 [0,4194304] 0 2024-04-26T12:06:58.401 INFO:tasks.workunit.client.0.smithi052.stdout:1/721: dread - d0/d2/dd/d34/fc7 zero size 2024-04-26T12:06:58.401 INFO:tasks.workunit.client.0.smithi052.stdout:7/764: creat d1/d1c/d21/d2f/d33/d3a/fee x:0 0 0 2024-04-26T12:06:58.402 INFO:tasks.workunit.client.0.smithi052.stdout:8/717: dwrite d0/d4/d5/d86/d9c/db4/d58/f5b [0,4194304] 0 2024-04-26T12:06:58.404 INFO:tasks.workunit.client.0.smithi052.stdout:1/722: creat d0/d2/dd/d40/d81/d52/ff0 x:0 0 0 2024-04-26T12:06:58.404 INFO:tasks.workunit.client.0.smithi052.stdout:8/718: write d0/f66 [995970,129528] 0 2024-04-26T12:06:58.405 INFO:tasks.workunit.client.0.smithi052.stdout:7/765: rename d1/d1c/d23/d81/fa5 to d1/d1c/d21/d2f/d33/d92/fef 0 2024-04-26T12:06:58.405 INFO:tasks.workunit.client.0.smithi052.stdout:3/725: dwrite d2/d4/dc/d33/d37/f51 [4194304,4194304] 0 2024-04-26T12:06:58.405 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:58.404+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:58.406 INFO:tasks.workunit.client.0.smithi052.stdout:8/719: creat d0/d4/dc/d80/fe7 x:0 0 0 2024-04-26T12:06:58.406 INFO:tasks.workunit.client.0.smithi052.stdout:1/723: read - d0/d2/dd/d40/d81/d9a/dce/de9/d9b/fe5 zero size 2024-04-26T12:06:58.407 INFO:tasks.workunit.client.0.smithi052.stdout:3/726: creat d2/d4/d2a/d96/fd7 x:0 0 0 2024-04-26T12:06:58.407 INFO:tasks.workunit.client.0.smithi052.stdout:2/798: dwrite d0/d3f/d56/d6d/d5a/dd5/f1c [0,4194304] 0 2024-04-26T12:06:58.407 INFO:tasks.workunit.client.0.smithi052.stdout:7/766: mknod d1/d1c/d21/d2f/d33/dc7/cf0 0 2024-04-26T12:06:58.409 INFO:tasks.workunit.client.0.smithi052.stdout:7/767: symlink d1/d1c/d21/d2f/lf1 0 2024-04-26T12:06:58.409 INFO:tasks.workunit.client.0.smithi052.stdout:2/799: creat d0/d3f/d56/d8d/d99/db9/f10c x:0 0 0 2024-04-26T12:06:58.409 INFO:tasks.workunit.client.0.smithi052.stdout:1/724: rename d0/d2/dd/d40/d81/d9a/cd7 to d0/d2/dd/d40/dac/cf1 0 2024-04-26T12:06:58.409 INFO:tasks.workunit.client.0.smithi052.stdout:3/727: symlink d2/d4/d2a/d99/db7/ld8 0 2024-04-26T12:06:58.411 INFO:tasks.workunit.client.0.smithi052.stdout:2/800: chown d0/d7/d2f/d9b/ld8 1245859957 1 2024-04-26T12:06:58.411 INFO:tasks.workunit.client.0.smithi052.stdout:1/725: chown d0/d2/d88/lea 511 1 2024-04-26T12:06:58.412 INFO:tasks.workunit.client.0.smithi052.stdout:2/801: chown d0/d7/d2f/d8c/fc9 1915 1 2024-04-26T12:06:58.413 INFO:tasks.workunit.client.0.smithi052.stdout:8/720: dwrite d0/d4/d1c/fb7 [4194304,4194304] 0 2024-04-26T12:06:58.413 INFO:tasks.workunit.client.0.smithi052.stdout:2/802: unlink d0/d3f/d56/d6d/d5a/d82/f93 0 2024-04-26T12:06:58.414 INFO:tasks.workunit.client.0.smithi052.stdout:8/721: write d0/d4/d5/db/d20/f7f [148341,36306] 0 2024-04-26T12:06:58.415 INFO:tasks.workunit.client.0.smithi052.stdout:2/803: rename d0/d3f/d56/d8d/c76 to d0/d3f/d56/d6d/d5a/d82/c10d 0 2024-04-26T12:06:58.416 INFO:tasks.workunit.client.0.smithi052.stdout:8/722: symlink d0/d4/d5/d86/d9c/db4/dd8/le8 0 2024-04-26T12:06:58.416 INFO:tasks.workunit.client.0.smithi052.stdout:3/728: read d2/d4/d2a/d2d/fbd [454743,53197] 0 2024-04-26T12:06:58.417 INFO:tasks.workunit.client.0.smithi052.stdout:2/804: fdatasync d0/d3f/d56/d6d/d5a/de4/ff2 0 2024-04-26T12:06:58.417 INFO:tasks.workunit.client.0.smithi052.stdout:3/729: fsync d2/f73 0 2024-04-26T12:06:58.417 INFO:tasks.workunit.client.0.smithi052.stdout:1/726: dwrite d0/d2/dd/d40/dc1/d1d/d91/fd5 [0,4194304] 0 2024-04-26T12:06:58.419 INFO:tasks.workunit.client.0.smithi052.stdout:1/727: mkdir d0/d2/dd/d40/d81/d9a/da6/dc4/df2 0 2024-04-26T12:06:58.419 INFO:tasks.workunit.client.0.smithi052.stdout:3/730: getdents d2/d4/d81/db6 0 2024-04-26T12:06:58.420 INFO:tasks.workunit.client.0.smithi052.stdout:2/805: link d0/d7/d2f/d9b/ld0 d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/dd3/l10e 0 2024-04-26T12:06:58.420 INFO:tasks.workunit.client.0.smithi052.stdout:3/731: truncate d2/d4/dc/d1d/d3f/f70 2001894 0 2024-04-26T12:06:58.423 INFO:tasks.workunit.client.0.smithi052.stdout:1/728: dwrite d0/d2/dd/d34/fd0 [0,4194304] 0 2024-04-26T12:06:58.425 INFO:tasks.workunit.client.0.smithi052.stdout:1/729: write d0/d2/dd/d40/dc1/d1d/f50 [1058560,51979] 0 2024-04-26T12:06:58.427 INFO:tasks.workunit.client.0.smithi052.stdout:2/806: read d0/d3f/d56/d6d/d5a/ffd [4137169,86466] 0 2024-04-26T12:06:58.428 INFO:tasks.workunit.client.0.smithi052.stdout:3/732: dwrite d2/d4/d41/fb2 [0,4194304] 0 2024-04-26T12:06:58.428 INFO:tasks.workunit.client.0.smithi052.stdout:1/730: dread - d0/d2/dd/d40/d81/fd6 zero size 2024-04-26T12:06:58.429 INFO:tasks.workunit.client.0.smithi052.stdout:3/733: chown d2/d4/d41/d59/fd5 1 1 2024-04-26T12:06:58.430 INFO:tasks.workunit.client.0.smithi052.stdout:4/749: sync 2024-04-26T12:06:58.430 INFO:tasks.workunit.client.0.smithi052.stdout:0/796: sync 2024-04-26T12:06:58.431 INFO:tasks.workunit.client.0.smithi052.stdout:0/797: chown d0/d26/d74/db4/de1 191242318 1 2024-04-26T12:06:58.431 INFO:tasks.workunit.client.0.smithi052.stdout:1/731: symlink d0/d2/dd/d34/d95/lf3 0 2024-04-26T12:06:58.431 INFO:tasks.workunit.client.0.smithi052.stdout:2/807: unlink d0/d3f/d56/d6d/d5a/d73/d4b/d8f/fa1 0 2024-04-26T12:06:58.431 INFO:tasks.workunit.client.0.smithi052.stdout:3/734: dread d2/d4/d2a/d2d/fbd [0,4194304] 0 2024-04-26T12:06:58.431 INFO:tasks.workunit.client.0.smithi052.stdout:0/798: symlink d0/d1/d1a/d20/l104 0 2024-04-26T12:06:58.431 INFO:tasks.workunit.client.0.smithi052.stdout:1/732: creat d0/d2/dd/d40/dac/dde/ff4 x:0 0 0 2024-04-26T12:06:58.431 INFO:tasks.workunit.client.0.smithi052.stdout:0/799: write d0/d1/d11/f43 [4561187,34259] 0 2024-04-26T12:06:58.432 INFO:tasks.workunit.client.0.smithi052.stdout:4/750: unlink d3/d12/d34/d45/d67/d6c/d86/lf0 0 2024-04-26T12:06:58.432 INFO:tasks.workunit.client.0.smithi052.stdout:2/808: chown d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/dd3/l10e 2609336 1 2024-04-26T12:06:58.432 INFO:tasks.workunit.client.0.smithi052.stdout:3/735: rename d2/d4/d2a/l8c to d2/d4/dc/d1d/d25/d36/d1c/d4e/ld9 0 2024-04-26T12:06:58.432 INFO:tasks.workunit.client.0.smithi052.stdout:0/800: unlink d0/cc0 0 2024-04-26T12:06:58.433 INFO:tasks.workunit.client.0.smithi052.stdout:4/751: write d3/d12/d34/d45/d67/d6c/f8f [848562,88865] 0 2024-04-26T12:06:58.433 INFO:tasks.workunit.client.0.smithi052.stdout:0/801: write d0/d26/d36/f9e [4541608,51077] 0 2024-04-26T12:06:58.434 INFO:tasks.workunit.client.0.smithi052.stdout:3/736: truncate d2/d4/d41/f9c 1075376 0 2024-04-26T12:06:58.435 INFO:tasks.workunit.client.0.smithi052.stdout:8/723: dread d0/d16/f2a [0,4194304] 0 2024-04-26T12:06:58.435 INFO:tasks.workunit.client.0.smithi052.stdout:0/802: dread - d0/d5b/d9d/ff4 zero size 2024-04-26T12:06:58.435 INFO:tasks.workunit.client.0.smithi052.stdout:3/737: mkdir d2/dda 0 2024-04-26T12:06:58.435 INFO:tasks.workunit.client.0.smithi052.stdout:2/809: link d0/d3f/d56/d8d/d99/fea d0/d3f/d56/d6d/d5a/dd5/d4d/f10f 0 2024-04-26T12:06:58.436 INFO:tasks.workunit.client.0.smithi052.stdout:8/724: chown d0/d4/d1c/d83 743 1 2024-04-26T12:06:58.436 INFO:tasks.workunit.client.0.smithi052.stdout:0/803: symlink d0/d26/dbe/l105 0 2024-04-26T12:06:58.437 INFO:tasks.workunit.client.0.smithi052.stdout:2/810: creat d0/d3f/d56/d8d/f110 x:0 0 0 2024-04-26T12:06:58.437 INFO:tasks.workunit.client.0.smithi052.stdout:1/733: dwrite d0/d2/dd/d40/dc1/d1d/d23/fa1 [8388608,4194304] 0 2024-04-26T12:06:58.437 INFO:tasks.workunit.client.0.smithi052.stdout:0/804: symlink d0/d3d/dd2/l106 0 2024-04-26T12:06:58.438 INFO:tasks.workunit.client.0.smithi052.stdout:2/811: fdatasync d0/d3f/d56/d6d/d5a/d73/fcd 0 2024-04-26T12:06:58.439 INFO:tasks.workunit.client.0.smithi052.stdout:2/812: mknod d0/c111 0 2024-04-26T12:06:58.439 INFO:tasks.workunit.client.0.smithi052.stdout:1/734: chown d0/d2/dd/d40/dc1/d1d/d91/fb1 5407891 1 2024-04-26T12:06:58.439 INFO:tasks.workunit.client.0.smithi052.stdout:2/813: dread - d0/d3f/d56/d8d/f110 zero size 2024-04-26T12:06:58.440 INFO:tasks.workunit.client.0.smithi052.stdout:1/735: chown d0/d2/dd/d40/dc1/d1d/d91/fbb 0 1 2024-04-26T12:06:58.440 INFO:tasks.workunit.client.0.smithi052.stdout:2/814: write d0/d3f/d56/fd9 [283716,46523] 0 2024-04-26T12:06:58.442 INFO:tasks.workunit.client.0.smithi052.stdout:1/736: rename d0/d2/dd/d40/d81/d9a/dce/de9/c8b to d0/d2/dd/d40/dc1/d1d/d23/cf5 0 2024-04-26T12:06:58.443 INFO:tasks.workunit.client.0.smithi052.stdout:1/737: fdatasync d0/d2/dd/d40/d81/d9a/dce/de9/d9b/fa9 0 2024-04-26T12:06:58.445 INFO:tasks.workunit.client.0.smithi052.stdout:4/752: dread d3/d2b/dab/db6/fbc [0,4194304] 0 2024-04-26T12:06:58.445 INFO:tasks.workunit.client.0.smithi052.stdout:1/738: write d0/da/f4f [5079558,129424] 0 2024-04-26T12:06:58.446 INFO:tasks.workunit.client.0.smithi052.stdout:2/815: dwrite d0/d3f/d56/d6d/f70 [0,4194304] 0 2024-04-26T12:06:58.446 INFO:tasks.workunit.client.0.smithi052.stdout:8/725: write d0/d4/d5/daf/fd0 [837441,83849] 0 2024-04-26T12:06:58.447 INFO:tasks.workunit.client.0.smithi052.stdout:4/753: fdatasync d3/d44/f9d 0 2024-04-26T12:06:58.448 INFO:tasks.workunit.client.0.smithi052.stdout:1/739: write d0/d2/dd/d40/dc1/d1d/d91/f94 [3886408,97115] 0 2024-04-26T12:06:58.448 INFO:tasks.workunit.client.0.smithi052.stdout:8/726: dread - d0/d4/d5/d86/d9c/db4/dd8/fdb zero size 2024-04-26T12:06:58.448 INFO:tasks.workunit.client.0.smithi052.stdout:4/754: write d3/d1f/d21/f66 [113583,75279] 0 2024-04-26T12:06:58.449 INFO:tasks.workunit.client.0.smithi052.stdout:3/738: dwrite d2/d4/d2a/dbf/faf [4194304,4194304] 0 2024-04-26T12:06:58.449 INFO:tasks.workunit.client.0.smithi052.stdout:8/727: readlink d0/d4/lc7 0 2024-04-26T12:06:58.450 INFO:tasks.workunit.client.0.smithi052.stdout:8/728: stat d0/d4/dc/d80 0 2024-04-26T12:06:58.451 INFO:tasks.workunit.client.0.smithi052.stdout:8/729: fsync d0/d4/d5/d86/d9c/db4/fe6 0 2024-04-26T12:06:58.451 INFO:tasks.workunit.client.0.smithi052.stdout:3/739: mkdir d2/d4/dc/d68/ddb 0 2024-04-26T12:06:58.452 INFO:tasks.workunit.client.0.smithi052.stdout:5/778: sync 2024-04-26T12:06:58.452 INFO:tasks.workunit.client.0.smithi052.stdout:6/797: sync 2024-04-26T12:06:58.452 INFO:tasks.workunit.client.0.smithi052.stdout:9/770: sync 2024-04-26T12:06:58.452 INFO:tasks.workunit.client.0.smithi052.stdout:8/730: rmdir d0/d4/d5/d86/d9c/db4/d58/d89 39 2024-04-26T12:06:58.453 INFO:tasks.workunit.client.0.smithi052.stdout:3/740: truncate d2/d4/d81/fac 683354 0 2024-04-26T12:06:58.453 INFO:tasks.workunit.client.0.smithi052.stdout:6/798: creat da/d22/d97/f11c x:0 0 0 2024-04-26T12:06:58.453 INFO:tasks.workunit.client.0.smithi052.stdout:9/771: rmdir d3/db/d10/d3c/d40/d96/db5/d8f/d49 39 2024-04-26T12:06:58.454 INFO:tasks.workunit.client.0.smithi052.stdout:5/779: mknod db/dd/d18/d60/d64/df9/cfc 0 2024-04-26T12:06:58.454 INFO:tasks.workunit.client.0.smithi052.stdout:8/731: write d0/d4/d5/d86/d9c/db4/fe2 [36143,51658] 0 2024-04-26T12:06:58.454 INFO:tasks.workunit.client.0.smithi052.stdout:9/772: truncate d3/db/f5b 4949914 0 2024-04-26T12:06:58.455 INFO:tasks.workunit.client.0.smithi052.stdout:3/741: getdents d2/d4/d2a/d2d 0 2024-04-26T12:06:58.455 INFO:tasks.workunit.client.0.smithi052.stdout:8/732: write d0/d4/f51 [1762493,35430] 0 2024-04-26T12:06:58.455 INFO:tasks.workunit.client.0.smithi052.stdout:5/780: symlink db/dc/d5f/d50/d46/d74/lfd 0 2024-04-26T12:06:58.455 INFO:tasks.workunit.client.0.smithi052.stdout:9/773: mkdir d3/db/d4a/d112 0 2024-04-26T12:06:58.456 INFO:tasks.workunit.client.0.smithi052.stdout:6/799: rename da/da2/la8 to da/d22/d29/d31/d39/dc7/d114/l11d 0 2024-04-26T12:06:58.456 INFO:tasks.workunit.client.0.smithi052.stdout:3/742: mknod d2/d4/dc/d1d/d25/d61/cdc 0 2024-04-26T12:06:58.456 INFO:tasks.workunit.client.0.smithi052.stdout:8/733: unlink d0/d16/d28/f6a 0 2024-04-26T12:06:58.457 INFO:tasks.workunit.client.0.smithi052.stdout:2/816: dread d0/d3f/d56/d8d/d99/f10a [0,4194304] 0 2024-04-26T12:06:58.457 INFO:tasks.workunit.client.0.smithi052.stdout:5/781: chown db/dd/d18/d60/d64/d9c/da0/df1 17 1 2024-04-26T12:06:58.457 INFO:tasks.workunit.client.0.smithi052.stdout:9/774: fsync d3/d23/d7f/f2c 0 2024-04-26T12:06:58.458 INFO:tasks.workunit.client.0.smithi052.stdout:4/755: write d3/d12/d59/d96/dc0/ddd/fac [1446045,38579] 0 2024-04-26T12:06:58.458 INFO:tasks.workunit.client.0.smithi052.stdout:7/768: dread d1/f7 [0,4194304] 0 2024-04-26T12:06:58.459 INFO:tasks.workunit.client.0.smithi052.stdout:5/782: mkdir db/d5c/dfe 0 2024-04-26T12:06:58.463 INFO:tasks.workunit.client.0.smithi052.stdout:9/775: mknod d3/d23/c113 0 2024-04-26T12:06:58.463 INFO:tasks.workunit.client.0.smithi052.stdout:4/756: creat d3/d15/d76/f101 x:0 0 0 2024-04-26T12:06:58.463 INFO:tasks.workunit.client.0.smithi052.stdout:6/800: read da/d22/d29/dd4/ddf/d7c/fb1 [78803,128952] 0 2024-04-26T12:06:58.463 INFO:tasks.workunit.client.0.smithi052.stdout:7/769: chown d1/d1c/d21/d2f/fb1 9362636 1 2024-04-26T12:06:58.463 INFO:tasks.workunit.client.0.smithi052.stdout:2/817: link d0/d7/fe d0/d3f/d56/d6d/d5a/d82/f112 0 2024-04-26T12:06:58.463 INFO:tasks.workunit.client.0.smithi052.stdout:5/783: unlink db/dc/d5f/d50/d46/d74/fa3 0 2024-04-26T12:06:58.463 INFO:tasks.workunit.client.0.smithi052.stdout:6/801: mkdir da/d51/d11e 0 2024-04-26T12:06:58.464 INFO:tasks.workunit.client.0.smithi052.stdout:7/770: read - d1/d1c/d23/d81/fda zero size 2024-04-26T12:06:58.464 INFO:tasks.workunit.client.0.smithi052.stdout:5/784: creat db/dc/d5f/d50/d46/d74/fff x:0 0 0 2024-04-26T12:06:58.464 INFO:tasks.workunit.client.0.smithi052.stdout:4/757: truncate d3/d1f/d21/f66 409280 0 2024-04-26T12:06:58.465 INFO:tasks.workunit.client.0.smithi052.stdout:7/771: chown d1/fe3 4775826 1 2024-04-26T12:06:58.465 INFO:tasks.workunit.client.0.smithi052.stdout:3/743: dwrite d2/d4/f3e [0,4194304] 0 2024-04-26T12:06:58.466 INFO:tasks.workunit.client.0.smithi052.stdout:6/802: mkdir da/d22/d29/dd4/ddf/d92/d96/d11f 0 2024-04-26T12:06:58.468 INFO:tasks.workunit.client.0.smithi052.stdout:8/734: dwrite d0/d4/d5/d86/d9c/db4/d58/f5b [0,4194304] 0 2024-04-26T12:06:58.468 INFO:tasks.workunit.client.0.smithi052.stdout:0/805: dread d0/d1/dd/f19 [0,4194304] 0 2024-04-26T12:06:58.468 INFO:tasks.workunit.client.0.smithi052.stdout:9/776: dread d3/db/d10/d3c/d40/d96/db5/d8f/f108 [0,4194304] 0 2024-04-26T12:06:58.469 INFO:tasks.workunit.client.0.smithi052.stdout:7/772: creat d1/d1c/d21/d2f/d68/ff2 x:0 0 0 2024-04-26T12:06:58.469 INFO:tasks.workunit.client.0.smithi052.stdout:4/758: write d3/d22/d30/fc8 [1190603,52585] 0 2024-04-26T12:06:58.469 INFO:tasks.workunit.client.0.smithi052.stdout:6/803: getdents da/d22/d97/d115 0 2024-04-26T12:06:58.470 INFO:tasks.workunit.client.0.smithi052.stdout:5/785: rename db/dd/d18 to db/dd/d18/d60/d64/d9c/d100 22 2024-04-26T12:06:58.470 INFO:tasks.workunit.client.0.smithi052.stdout:3/744: truncate d2/d4/d2a/d2d/f78 612448 0 2024-04-26T12:06:58.470 INFO:tasks.workunit.client.0.smithi052.stdout:8/735: symlink d0/d4/dc/d68/le9 0 2024-04-26T12:06:58.470 INFO:tasks.workunit.client.0.smithi052.stdout:9/777: readlink d3/db/d52/l6b 0 2024-04-26T12:06:58.472 INFO:tasks.workunit.client.0.smithi052.stdout:5/786: mkdir db/dd/d34/d69/d93/d101 0 2024-04-26T12:06:58.472 INFO:tasks.workunit.client.0.smithi052.stdout:8/736: chown d0/d4/f17 168 1 2024-04-26T12:06:58.472 INFO:tasks.workunit.client.0.smithi052.stdout:9/778: creat d3/db/d2b/ded/f114 x:0 0 0 2024-04-26T12:06:58.473 INFO:tasks.workunit.client.0.smithi052.stdout:7/773: write d1/d1c/d21/d2f/f9b [780195,117203] 0 2024-04-26T12:06:58.473 INFO:tasks.workunit.client.0.smithi052.stdout:5/787: creat db/dd/d18/f102 x:0 0 0 2024-04-26T12:06:58.474 INFO:tasks.workunit.client.0.smithi052.stdout:8/737: creat d0/d4/d5/d27/fea x:0 0 0 2024-04-26T12:06:58.475 INFO:tasks.workunit.client.0.smithi052.stdout:2/818: dwrite d0/d3f/d56/d6d/d5a/d73/d4b/d8f/fec [0,4194304] 0 2024-04-26T12:06:58.475 INFO:tasks.workunit.client.0.smithi052.stdout:4/759: read d3/d2b/dab/db6/ff6 [2406581,36437] 0 2024-04-26T12:06:58.476 INFO:tasks.workunit.client.0.smithi052.stdout:7/774: creat d1/d1c/d21/d2f/d68/ff3 x:0 0 0 2024-04-26T12:06:58.476 INFO:tasks.workunit.client.0.smithi052.stdout:5/788: chown db/dd/d34/c65 5685915 1 2024-04-26T12:06:58.477 INFO:tasks.workunit.client.0.smithi052.stdout:6/804: dread da/d22/d29/dd4/ddf/fbd [0,4194304] 0 2024-04-26T12:06:58.478 INFO:tasks.workunit.client.0.smithi052.stdout:9/779: creat d3/db/d10/d3c/d40/d96/db5/d8f/d49/da4/f115 x:0 0 0 2024-04-26T12:06:58.480 INFO:tasks.workunit.client.0.smithi052.stdout:7/775: readlink d1/d1c/d21/d2f/l34 0 2024-04-26T12:06:58.480 INFO:tasks.workunit.client.0.smithi052.stdout:5/789: read db/dc/f54 [1258882,70220] 0 2024-04-26T12:06:58.480 INFO:tasks.workunit.client.0.smithi052.stdout:2/819: rmdir d0/d3f/d56/d6d/d5a/de4 39 2024-04-26T12:06:58.480 INFO:tasks.workunit.client.0.smithi052.stdout:9/780: write d3/db/ff8 [1766741,119712] 0 2024-04-26T12:06:58.480 INFO:tasks.workunit.client.0.smithi052.stdout:5/790: rmdir db/dd 39 2024-04-26T12:06:58.481 INFO:tasks.workunit.client.0.smithi052.stdout:3/745: dwrite d2/d4/dc/d33/d37/f3a [0,4194304] 0 2024-04-26T12:06:58.482 INFO:tasks.workunit.client.0.smithi052.stdout:9/781: stat d3/d23/le5 0 2024-04-26T12:06:58.483 INFO:tasks.workunit.client.0.smithi052.stdout:6/805: creat da/d22/f120 x:0 0 0 2024-04-26T12:06:58.483 INFO:tasks.workunit.client.0.smithi052.stdout:7/776: read d1/d1c/d21/d2f/d33/d3a/f40 [5955662,13901] 0 2024-04-26T12:06:58.483 INFO:tasks.workunit.client.0.smithi052.stdout:1/740: dread d0/d2/dd/d40/dc1/d1d/f37 [0,4194304] 0 2024-04-26T12:06:58.484 INFO:tasks.workunit.client.0.smithi052.stdout:3/746: fsync d2/d4/d41/f66 0 2024-04-26T12:06:58.485 INFO:tasks.workunit.client.0.smithi052.stdout:5/791: unlink db/dd/d34/f82 0 2024-04-26T12:06:58.485 INFO:tasks.workunit.client.0.smithi052.stdout:7/777: fdatasync d1/ff 0 2024-04-26T12:06:58.485 INFO:tasks.workunit.client.0.smithi052.stdout:2/820: creat d0/d3f/d56/d6d/d5a/de4/f113 x:0 0 0 2024-04-26T12:06:58.486 INFO:tasks.workunit.client.0.smithi052.stdout:7/778: sync 2024-04-26T12:06:58.487 INFO:tasks.workunit.client.0.smithi052.stdout:6/806: rename da/da2/fca to da/d22/d29/dd4/ddf/d95/dd2/db9/f121 0 2024-04-26T12:06:58.487 INFO:tasks.workunit.client.0.smithi052.stdout:7/779: readlink d1/d1c/d21/d2f/d33/d3a/d64/le5 0 2024-04-26T12:06:58.487 INFO:tasks.workunit.client.0.smithi052.stdout:2/821: unlink d0/d3f/d56/d6d/f7b 0 2024-04-26T12:06:58.488 INFO:tasks.workunit.client.0.smithi052.stdout:5/792: link db/dd/d34/d70/f80 db/dc/d5f/d50/d46/d74/f103 0 2024-04-26T12:06:58.489 INFO:tasks.workunit.client.0.smithi052.stdout:4/760: dwrite d3/d12/d59/f82 [0,4194304] 0 2024-04-26T12:06:58.489 INFO:tasks.workunit.client.0.smithi052.stdout:6/807: chown da/d22/f120 13 1 2024-04-26T12:06:58.491 INFO:tasks.workunit.client.0.smithi052.stdout:5/793: fdatasync db/dd/d34/fed 0 2024-04-26T12:06:58.492 INFO:tasks.workunit.client.0.smithi052.stdout:7/780: getdents d1/db7 0 2024-04-26T12:06:58.492 INFO:tasks.workunit.client.0.smithi052.stdout:4/761: readlink d3/d12/d34/d43/da1/lc4 0 2024-04-26T12:06:58.493 INFO:tasks.workunit.client.0.smithi052.stdout:3/747: dwrite d2/d4/f3e [0,4194304] 0 2024-04-26T12:06:58.494 INFO:tasks.workunit.client.0.smithi052.stdout:6/808: fsync da/d22/d29/dd4/ddf/d7c/d94/fc6 0 2024-04-26T12:06:58.494 INFO:tasks.workunit.client.0.smithi052.stdout:2/822: link d0/c2b d0/d7/d2f/d9b/c114 0 2024-04-26T12:06:58.494 INFO:tasks.workunit.client.0.smithi052.stdout:1/741: dwrite d0/d83/d4b/d56/f74 [0,4194304] 0 2024-04-26T12:06:58.495 INFO:tasks.workunit.client.0.smithi052.stdout:0/806: dread d0/d1/d1a/f4b [0,4194304] 0 2024-04-26T12:06:58.495 INFO:tasks.workunit.client.0.smithi052.stdout:4/762: symlink d3/d15/l102 0 2024-04-26T12:06:58.495 INFO:tasks.workunit.client.0.smithi052.stdout:7/781: symlink d1/d1c/d21/lf4 0 2024-04-26T12:06:58.496 INFO:tasks.workunit.client.0.smithi052.stdout:5/794: write db/dd/d34/d70/d59/f8c [303494,128919] 0 2024-04-26T12:06:58.496 INFO:tasks.workunit.client.0.smithi052.stdout:0/807: chown d0/d26/fc6 193359493 1 2024-04-26T12:06:58.498 INFO:tasks.workunit.client.0.smithi052.stdout:7/782: symlink d1/dab/lf5 0 2024-04-26T12:06:58.500 INFO:tasks.workunit.client.0.smithi052.stdout:8/738: dread d0/d4/d5/d27/d57/f88 [0,4194304] 0 2024-04-26T12:06:58.500 INFO:tasks.workunit.client.0.smithi052.stdout:4/763: rename d3/d12/d34/d45/f47 to d3/d2b/dab/db6/db7/f103 0 2024-04-26T12:06:58.501 INFO:tasks.workunit.client.0.smithi052.stdout:0/808: chown d0/d1/d2c/d42/da5/c100 1812589 1 2024-04-26T12:06:58.501 INFO:tasks.workunit.client.0.smithi052.stdout:5/795: getdents db/dc 0 2024-04-26T12:06:58.502 INFO:tasks.workunit.client.0.smithi052.stdout:0/809: fsync d0/d26/fc6 0 2024-04-26T12:06:58.503 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:58.503 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:58.503 INFO:tasks.workunit.client.0.smithi052.stdout:8/739: mknod d0/d4/dc/d80/ceb 0 2024-04-26T12:06:58.504 INFO:tasks.workunit.client.0.smithi052.stdout:7/783: write d1/d1c/d21/d2f/d68/f91 [2857828,61394] 0 2024-04-26T12:06:58.505 INFO:tasks.workunit.client.0.smithi052.stdout:6/809: dwrite da/d22/d29/d31/f6b [0,4194304] 0 2024-04-26T12:06:58.506 INFO:tasks.workunit.client.0.smithi052.stdout:5/796: dread - db/dd/d34/d70/fc0 zero size 2024-04-26T12:06:58.506 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:58.505+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:58.506 INFO:tasks.workunit.client.0.smithi052.stdout:1/742: truncate d0/d2/dd/d40/dac/dde/f79 2346180 0 2024-04-26T12:06:58.507 INFO:tasks.workunit.client.0.smithi052.stdout:7/784: symlink d1/d1f/d55/ddd/lf6 0 2024-04-26T12:06:58.508 INFO:tasks.workunit.client.0.smithi052.stdout:2/823: dwrite d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/fbc [0,4194304] 0 2024-04-26T12:06:58.508 INFO:tasks.workunit.client.0.smithi052.stdout:8/740: mkdir d0/d4/d5/db/d20/dec 0 2024-04-26T12:06:58.508 INFO:tasks.workunit.client.0.smithi052.stdout:3/748: dwrite d2/d4/dc/d1d/d3f/f5e [0,4194304] 0 2024-04-26T12:06:58.509 INFO:tasks.workunit.client.0.smithi052.stdout:6/810: truncate da/f12 5026163 0 2024-04-26T12:06:58.509 INFO:tasks.workunit.client.0.smithi052.stdout:0/810: truncate d0/d1/dd/fa2 826874 0 2024-04-26T12:06:58.509 INFO:tasks.workunit.client.0.smithi052.stdout:8/741: readlink d0/d3e/l50 0 2024-04-26T12:06:58.510 INFO:tasks.workunit.client.0.smithi052.stdout:5/797: readlink db/dd/d34/d70/l2c 0 2024-04-26T12:06:58.510 INFO:tasks.workunit.client.0.smithi052.stdout:1/743: mknod d0/d2/dd/d40/cf6 0 2024-04-26T12:06:58.511 INFO:tasks.workunit.client.0.smithi052.stdout:7/785: read - d1/dab/d4c/dd6/fe1 zero size 2024-04-26T12:06:58.511 INFO:tasks.workunit.client.0.smithi052.stdout:0/811: mkdir d0/d5a/d107 0 2024-04-26T12:06:58.511 INFO:tasks.workunit.client.0.smithi052.stdout:3/749: dread - d2/d4/dc/d1d/d25/fcd zero size 2024-04-26T12:06:58.511 INFO:tasks.workunit.client.0.smithi052.stdout:1/744: chown d0/d2/dd/d40/d81/d9a/dce 72 1 2024-04-26T12:06:58.512 INFO:tasks.workunit.client.0.smithi052.stdout:7/786: fsync d1/f12 0 2024-04-26T12:06:58.513 INFO:tasks.workunit.client.0.smithi052.stdout:2/824: fdatasync d0/d3f/d56/d6d/d5a/dd5/d4d/f94 0 2024-04-26T12:06:58.514 INFO:tasks.workunit.client.0.smithi052.stdout:3/750: write d2/d4/dc/d33/fa0 [3671276,126719] 0 2024-04-26T12:06:58.515 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:58.516 INFO:tasks.workunit.client.0.smithi052.stdout:4/764: dwrite d3/d12/f20 [0,4194304] 0 2024-04-26T12:06:58.516 INFO:tasks.workunit.client.0.smithi052.stdout:0/812: symlink d0/d1/d1a/d20/l108 0 2024-04-26T12:06:58.516 INFO:tasks.workunit.client.0.smithi052.stdout:7/787: readlink d1/d1c/d23/d81/d88/l9c 0 2024-04-26T12:06:58.516 INFO:tasks.workunit.client.0.smithi052.stdout:9/782: dread d3/db/d10/f38 [0,4194304] 0 2024-04-26T12:06:58.517 INFO:tasks.workunit.client.0.smithi052.stdout:3/751: mknod d2/d4/d2a/d99/dc3/cdd 0 2024-04-26T12:06:58.518 INFO:tasks.workunit.client.0.smithi052.stdout:8/742: truncate d0/f66 189503 0 2024-04-26T12:06:58.518 INFO:tasks.workunit.client.0.smithi052.stdout:7/788: mknod d1/d1c/d23/d81/cf7 0 2024-04-26T12:06:58.519 INFO:tasks.workunit.client.0.smithi052.stdout:9/783: mkdir d3/db/d10/d3c/d40/d96/da7/d116 0 2024-04-26T12:06:58.520 INFO:tasks.workunit.client.0.smithi052.stdout:7/789: fsync d1/d1c/d21/f67 0 2024-04-26T12:06:58.520 INFO:tasks.workunit.client.0.smithi052.stdout:3/752: write d2/d4/dc/d1d/d25/d61/fb3 [380820,30451] 0 2024-04-26T12:06:58.520 INFO:tasks.workunit.client.0.smithi052.stdout:6/811: dwrite da/d22/ffc [0,4194304] 0 2024-04-26T12:06:58.521 INFO:tasks.workunit.client.0.smithi052.stdout:5/798: read db/dd/d34/d69/d8a/da9/d87/fba [1697687,118013] 0 2024-04-26T12:06:58.522 INFO:tasks.workunit.client.0.smithi052.stdout:8/743: chown d0/d4/d5/db/d20/d41/c9e 66 1 2024-04-26T12:06:58.522 INFO:tasks.workunit.client.0.smithi052.stdout:9/784: creat d3/db/d10/d3c/d40/d96/db5/da3/f117 x:0 0 0 2024-04-26T12:06:58.523 INFO:tasks.workunit.client.0.smithi052.stdout:1/745: dwrite d0/d83/d4b/d56/fa2 [0,4194304] 0 2024-04-26T12:06:58.523 INFO:tasks.workunit.client.0.smithi052.stdout:8/744: write d0/d16/d63/f95 [1761180,10582] 0 2024-04-26T12:06:58.524 INFO:tasks.workunit.client.0.smithi052.stdout:1/746: stat d0/d2/dd/d40/c7d 0 2024-04-26T12:06:58.524 INFO:tasks.workunit.client.0.smithi052.stdout:5/799: write db/dd/d34/d69/dcc/fd8 [760182,93446] 0 2024-04-26T12:06:58.525 INFO:tasks.workunit.client.0.smithi052.stdout:8/745: unlink d0/d4/d5/d27/d69/fa2 0 2024-04-26T12:06:58.530 INFO:tasks.workunit.client.0.smithi052.stdout:2/825: read d0/d3f/d56/d8d/d99/db9/fc4 [645303,59645] 0 2024-04-26T12:06:58.530 INFO:tasks.workunit.client.0.smithi052.stdout:7/790: dwrite d1/d1c/fc5 [0,4194304] 0 2024-04-26T12:06:58.530 INFO:tasks.workunit.client.0.smithi052.stdout:7/791: fsync d1/d1c/d21/d2f/d33/d3a/fee 0 2024-04-26T12:06:58.530 INFO:tasks.workunit.client.0.smithi052.stdout:5/800: mknod db/dd/d18/d60/d64/c104 0 2024-04-26T12:06:58.531 INFO:tasks.workunit.client.0.smithi052.stdout:8/746: creat d0/d4/d5/d27/d57/fed x:0 0 0 2024-04-26T12:06:58.531 INFO:tasks.workunit.client.0.smithi052.stdout:2/826: read d0/d3f/d56/d6d/d5a/f69 [893589,99419] 0 2024-04-26T12:06:58.532 INFO:tasks.workunit.client.0.smithi052.stdout:4/765: dread d3/d1f/d21/f66 [0,4194304] 0 2024-04-26T12:06:58.532 INFO:tasks.workunit.client.0.smithi052.stdout:9/785: rename d3/db/d10/d3c/d40/d96/db5/d8f/d49/l7c to d3/l118 0 2024-04-26T12:06:58.533 INFO:tasks.workunit.client.0.smithi052.stdout:2/827: chown d0/d7/d2f/l106 5 1 2024-04-26T12:06:58.533 INFO:tasks.workunit.client.0.smithi052.stdout:5/801: symlink db/dd/d34/d70/d59/l105 0 2024-04-26T12:06:58.533 INFO:tasks.workunit.client.0.smithi052.stdout:3/753: dwrite d2/d4/d2a/d2d/f78 [0,4194304] 0 2024-04-26T12:06:58.534 INFO:tasks.workunit.client.0.smithi052.stdout:4/766: creat d3/d1f/f104 x:0 0 0 2024-04-26T12:06:58.534 INFO:tasks.workunit.client.0.smithi052.stdout:1/747: dwrite d0/d83/d4b/fd3 [0,4194304] 0 2024-04-26T12:06:58.534 INFO:tasks.workunit.client.0.smithi052.stdout:3/754: chown d2/d4/d6b 692 1 2024-04-26T12:06:58.535 INFO:tasks.workunit.client.0.smithi052.stdout:0/813: sync 2024-04-26T12:06:58.536 INFO:tasks.workunit.client.0.smithi052.stdout:5/802: write db/dd/d34/d69/d93/fbb [693720,95605] 0 2024-04-26T12:06:58.536 INFO:tasks.workunit.client.0.smithi052.stdout:4/767: rename d3/d1f/d21/c3b to d3/d12/d34/d43/c105 0 2024-04-26T12:06:58.536 INFO:tasks.workunit.client.0.smithi052.stdout:3/755: symlink d2/dda/lde 0 2024-04-26T12:06:58.536 INFO:tasks.workunit.client.0.smithi052.stdout:1/748: readlink d0/d83/l6c 0 2024-04-26T12:06:58.536 INFO:tasks.workunit.client.0.smithi052.stdout:2/828: creat d0/d3f/d56/d6d/d5a/f115 x:0 0 0 2024-04-26T12:06:58.537 INFO:tasks.workunit.client.0.smithi052.stdout:0/814: mknod d0/d1/dd/c109 0 2024-04-26T12:06:58.537 INFO:tasks.workunit.client.0.smithi052.stdout:4/768: fdatasync d3/d12/d64/f79 0 2024-04-26T12:06:58.537 INFO:tasks.workunit.client.0.smithi052.stdout:3/756: creat d2/d4/d41/fdf x:0 0 0 2024-04-26T12:06:58.537 INFO:tasks.workunit.client.0.smithi052.stdout:0/815: mknod d0/d26/d85/c10a 0 2024-04-26T12:06:58.539 INFO:tasks.workunit.client.0.smithi052.stdout:5/803: chown db/dc/d5f/d50/d46/d74/dbe/fdb 1638923206 1 2024-04-26T12:06:58.539 INFO:tasks.workunit.client.0.smithi052.stdout:3/757: creat d2/d4/dc/fe0 x:0 0 0 2024-04-26T12:06:58.539 INFO:tasks.workunit.client.0.smithi052.stdout:4/769: write d3/d44/d4b/db8/dde/fe0 [991989,17695] 0 2024-04-26T12:06:58.539 INFO:tasks.workunit.client.0.smithi052.stdout:0/816: unlink d0/d5b/d9d/d32/cda 0 2024-04-26T12:06:58.540 INFO:tasks.workunit.client.0.smithi052.stdout:3/758: rename d2/dda/lde to d2/d4/d2a/d99/le1 0 2024-04-26T12:06:58.540 INFO:tasks.workunit.client.0.smithi052.stdout:5/804: truncate db/dd/d18/d60/d64/d9c/fe9 710050 0 2024-04-26T12:06:58.541 INFO:tasks.workunit.client.0.smithi052.stdout:7/792: write d1/dab/d4c/d4d/f79 [76243,32358] 0 2024-04-26T12:06:58.541 INFO:tasks.workunit.client.0.smithi052.stdout:3/759: mknod d2/d4/dc/d1d/d25/d36/ce2 0 2024-04-26T12:06:58.546 INFO:tasks.workunit.client.0.smithi052.stdout:3/760: creat d2/d4/dc/d1d/d25/d36/d1c/fe3 x:0 0 0 2024-04-26T12:06:58.547 INFO:tasks.workunit.client.0.smithi052.stdout:4/770: dwrite d3/d12/d59/feb [0,4194304] 0 2024-04-26T12:06:58.547 INFO:tasks.workunit.client.0.smithi052.stdout:5/805: truncate db/dd/d34/d69/d8a/da9/fc8 36454 0 2024-04-26T12:06:58.547 INFO:tasks.workunit.client.0.smithi052.stdout:0/817: dwrite d0/d1/dd/fa2 [0,4194304] 0 2024-04-26T12:06:58.550 INFO:tasks.workunit.client.0.smithi052.stdout:3/761: rename d2/d4/d2a/d99 to d2/d4/d6b/dcf/de4 0 2024-04-26T12:06:58.550 INFO:tasks.workunit.client.0.smithi052.stdout:1/749: dwrite d0/d2/f18 [0,4194304] 0 2024-04-26T12:06:58.550 INFO:tasks.workunit.client.0.smithi052.stdout:5/806: chown db/dd/d34/d70/d59/lc2 161277 1 2024-04-26T12:06:58.551 INFO:tasks.workunit.client.0.smithi052.stdout:0/818: mkdir d0/d1/d2c/d42/d10b 0 2024-04-26T12:06:58.552 INFO:tasks.workunit.client.0.smithi052.stdout:7/793: dwrite d1/d1c/d21/f2e [0,4194304] 0 2024-04-26T12:06:58.552 INFO:tasks.workunit.client.0.smithi052.stdout:3/762: read d2/d4/d2a/d2d/fbd [734170,42672] 0 2024-04-26T12:06:58.552 INFO:tasks.workunit.client.0.smithi052.stdout:4/771: link d3/d12/d59/d96/dc0/ddd/fac d3/d12/d59/d96/f106 0 2024-04-26T12:06:58.552 INFO:tasks.workunit.client.0.smithi052.stdout:0/819: getdents d0/d3d 0 2024-04-26T12:06:58.553 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:06:58.553 INFO:tasks.workunit.client.0.smithi052.stdout:0/820: stat d0/f7a 0 2024-04-26T12:06:58.554 INFO:tasks.workunit.client.0.smithi052.stdout:7/794: fsync d1/d1c/d21/d2f/fb1 0 2024-04-26T12:06:58.554 INFO:tasks.workunit.client.0.smithi052.stdout:0/821: mkdir d0/d5b/d9d/d10c 0 2024-04-26T12:06:58.559 INFO:tasks.workunit.client.0.smithi052.stdout:6/812: dread da/f1b [0,4194304] 0 2024-04-26T12:06:58.559 INFO:tasks.workunit.client.0.smithi052.stdout:0/822: rename d0/d1/d54/fb2 to d0/d5b/d103/f10d 0 2024-04-26T12:06:58.560 INFO:tasks.workunit.client.0.smithi052.stdout:3/763: dwrite d2/d4/d41/d59/fb1 [0,4194304] 0 2024-04-26T12:06:58.561 INFO:tasks.workunit.client.0.smithi052.stdout:4/772: dwrite d3/d15/f17 [0,4194304] 0 2024-04-26T12:06:58.563 INFO:tasks.workunit.client.0.smithi052.stdout:3/764: write d2/d4/d41/d5c/f92 [451902,106691] 0 2024-04-26T12:06:58.564 INFO:tasks.workunit.client.0.smithi052.stdout:4/773: chown d3/d12/d34/d43/c105 253721 1 2024-04-26T12:06:58.564 INFO:tasks.workunit.client.0.smithi052.stdout:3/765: chown d2/d4/d6b/d7b/l8b 936766139 1 2024-04-26T12:06:58.564 INFO:tasks.workunit.client.0.smithi052.stdout:4/774: fdatasync d3/d12/d59/d96/dc0/f77 0 2024-04-26T12:06:58.569 INFO:tasks.workunit.client.0.smithi052.stdout:6/813: dwrite da/d22/d29/dd4/ddf/d95/dd2/db9/f121 [0,4194304] 0 2024-04-26T12:06:58.570 INFO:tasks.workunit.client.0.smithi052.stdout:3/766: dwrite d2/d4/dc/d1d/d25/d61/fa8 [0,4194304] 0 2024-04-26T12:06:58.571 INFO:tasks.workunit.client.0.smithi052.stdout:6/814: creat da/d22/d29/d31/d39/dc7/d114/f122 x:0 0 0 2024-04-26T12:06:58.571 INFO:tasks.workunit.client.0.smithi052.stdout:4/775: dwrite d3/d12/d59/d96/dc0/f78 [0,4194304] 0 2024-04-26T12:06:58.572 INFO:tasks.workunit.client.0.smithi052.stdout:6/815: mkdir da/d5d/d9c/d123 0 2024-04-26T12:06:58.572 INFO:tasks.workunit.client.0.smithi052.stdout:4/776: creat d3/d12/d34/d43/dc6/f107 x:0 0 0 2024-04-26T12:06:58.575 INFO:tasks.workunit.client.0.smithi052.stdout:5/807: dread f1 [4194304,4194304] 0 2024-04-26T12:06:58.576 INFO:tasks.workunit.client.0.smithi052.stdout:4/777: rename d3/f4f to d3/d2b/dab/dec/f108 0 2024-04-26T12:06:58.577 INFO:tasks.workunit.client.0.smithi052.stdout:5/808: mknod db/dd/d18/d60/d64/d9c/da0/c106 0 2024-04-26T12:06:58.577 INFO:tasks.workunit.client.0.smithi052.stdout:3/767: dwrite d2/d4/dc/f6f [4194304,4194304] 0 2024-04-26T12:06:58.578 INFO:tasks.workunit.client.0.smithi052.stdout:5/809: creat db/dd/d18/d60/d64/d9c/da0/df1/f107 x:0 0 0 2024-04-26T12:06:58.578 INFO:tasks.workunit.client.0.smithi052.stdout:5/810: chown db/dc/d5f/f2f 92157 1 2024-04-26T12:06:58.578 INFO:tasks.workunit.client.0.smithi052.stdout:3/768: symlink d2/d4/d2a/dbf/le5 0 2024-04-26T12:06:58.579 INFO:tasks.workunit.client.0.smithi052.stdout:8/747: sync 2024-04-26T12:06:58.579 INFO:tasks.workunit.client.0.smithi052.stdout:9/786: sync 2024-04-26T12:06:58.579 INFO:tasks.workunit.client.0.smithi052.stdout:2/829: sync 2024-04-26T12:06:58.579 INFO:tasks.workunit.client.0.smithi052.stdout:5/811: truncate db/dc/d5f/d50/fe1 40032 0 2024-04-26T12:06:58.580 INFO:tasks.workunit.client.0.smithi052.stdout:9/787: symlink d3/d23/l119 0 2024-04-26T12:06:58.581 INFO:tasks.workunit.client.0.smithi052.stdout:2/830: write d0/d7/fdc [973866,116361] 0 2024-04-26T12:06:58.581 INFO:tasks.workunit.client.0.smithi052.stdout:8/748: mknod d0/d4/dc/d68/cee 0 2024-04-26T12:06:58.582 INFO:tasks.workunit.client.0.smithi052.stdout:9/788: rename d3/d3b/l60 to d3/d3b/d102/l11a 0 2024-04-26T12:06:58.587 INFO:tasks.workunit.client.0.smithi052.stdout:8/749: truncate d0/d3e/f4a 3532420 0 2024-04-26T12:06:58.587 INFO:tasks.workunit.client.0.smithi052.stdout:3/769: dwrite d2/d4/d41/d59/f98 [0,4194304] 0 2024-04-26T12:06:58.587 INFO:tasks.workunit.client.0.smithi052.stdout:5/812: dread db/dd/d18/d60/d64/d9c/fe9 [0,4194304] 0 2024-04-26T12:06:58.587 INFO:tasks.workunit.client.0.smithi052.stdout:3/770: mkdir d2/d4/d41/d59/de6 0 2024-04-26T12:06:58.588 INFO:tasks.workunit.client.0.smithi052.stdout:8/750: symlink d0/d4/d5/d27/d57/d8a/lef 0 2024-04-26T12:06:58.588 INFO:tasks.workunit.client.0.smithi052.stdout:5/813: mkdir db/dd/d34/d69/d108 0 2024-04-26T12:06:58.589 INFO:tasks.workunit.client.0.smithi052.stdout:8/751: readlink d0/l5c 0 2024-04-26T12:06:58.590 INFO:tasks.workunit.client.0.smithi052.stdout:2/831: dwrite d0/d3f/d56/d8d/f9d [0,4194304] 0 2024-04-26T12:06:58.591 INFO:tasks.workunit.client.0.smithi052.stdout:3/771: symlink d2/d4/d41/d5c/le7 0 2024-04-26T12:06:58.591 INFO:tasks.workunit.client.0.smithi052.stdout:5/814: creat db/dd/d34/d69/dcc/f109 x:0 0 0 2024-04-26T12:06:58.592 INFO:tasks.workunit.client.0.smithi052.stdout:8/752: write d0/d4/d5/d86/f93 [2992449,87823] 0 2024-04-26T12:06:58.593 INFO:tasks.workunit.client.0.smithi052.stdout:9/789: truncate d3/db/d10/d54/f56 1585250 0 2024-04-26T12:06:58.593 INFO:tasks.workunit.client.0.smithi052.stdout:3/772: mknod d2/d4/dc/d33/d75/dc2/ce8 0 2024-04-26T12:06:58.593 INFO:tasks.workunit.client.0.smithi052.stdout:8/753: creat d0/d4/d5/db/ff0 x:0 0 0 2024-04-26T12:06:58.594 INFO:tasks.workunit.client.0.smithi052.stdout:5/815: creat db/dd/d18/d60/d64/d9c/da0/def/f10a x:0 0 0 2024-04-26T12:06:58.594 INFO:tasks.workunit.client.0.smithi052.stdout:9/790: chown d3/db/ff8 16760277 1 2024-04-26T12:06:58.595 INFO:tasks.workunit.client.0.smithi052.stdout:8/754: creat d0/d4/d5/d3c/ff1 x:0 0 0 2024-04-26T12:06:58.596 INFO:tasks.workunit.client.0.smithi052.stdout:1/750: sync 2024-04-26T12:06:58.597 INFO:tasks.workunit.client.0.smithi052.stdout:8/755: chown d0/d4/d5/db/f5e 3959 1 2024-04-26T12:06:58.597 INFO:tasks.workunit.client.0.smithi052.stdout:5/816: mknod db/dd/d34/d69/d8a/da9/d87/d6e/c10b 0 2024-04-26T12:06:58.598 INFO:tasks.workunit.client.0.smithi052.stdout:2/832: dwrite d0/d3f/d56/d6d/d5a/d73/fcd [0,4194304] 0 2024-04-26T12:06:58.600 INFO:tasks.workunit.client.0.smithi052.stdout:3/773: truncate d2/d4/d6b/dcf/de4/fa1 3057158 0 2024-04-26T12:06:58.600 INFO:tasks.workunit.client.0.smithi052.stdout:7/795: dread d1/d1c/d23/d81/d88/fbd [0,4194304] 0 2024-04-26T12:06:58.601 INFO:tasks.workunit.client.0.smithi052.stdout:5/817: rename db/dc/d5f/d50/d46/d74/dbe to db/dc/d5f/d10c 0 2024-04-26T12:06:58.602 INFO:tasks.workunit.client.0.smithi052.stdout:0/823: sync 2024-04-26T12:06:58.604 INFO:tasks.workunit.client.0.smithi052.stdout:6/816: dread da/d22/d29/dd4/ddf/d7c/d94/f100 [0,4194304] 0 2024-04-26T12:06:58.605 INFO:tasks.workunit.client.0.smithi052.stdout:0/824: chown d0/d3d/dd2/l106 227956622 1 2024-04-26T12:06:58.605 INFO:tasks.workunit.client.0.smithi052.stdout:9/791: dwrite d3/db/d10/d3c/d40/d96/da7/feb [0,4194304] 0 2024-04-26T12:06:58.606 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:58.605+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:58.607 INFO:tasks.workunit.client.0.smithi052.stdout:4/778: dread d3/d12/d59/d96/dc0/ddd/dca/ff2 [0,4194304] 0 2024-04-26T12:06:58.607 INFO:tasks.workunit.client.0.smithi052.stdout:3/774: rename d2/d4/dc/d1d/d3f/la3 to d2/d4/dc/d68/ddb/le9 0 2024-04-26T12:06:58.607 INFO:tasks.workunit.client.0.smithi052.stdout:2/833: dwrite d0/d7/d2f/dee/ff6 [0,4194304] 0 2024-04-26T12:06:58.608 INFO:tasks.workunit.client.0.smithi052.stdout:3/775: stat d2/d4/d41/cd1 0 2024-04-26T12:06:58.609 INFO:tasks.workunit.client.0.smithi052.stdout:4/779: fdatasync d3/d12/d34/d45/d67/d6c/fad 0 2024-04-26T12:06:58.609 INFO:tasks.workunit.client.0.smithi052.stdout:0/825: symlink d0/d3d/dd2/l10e 0 2024-04-26T12:06:58.609 INFO:tasks.workunit.client.0.smithi052.stdout:5/818: rename db/dc/d5f/d50/lf5 to db/dd/d34/d69/d108/l10d 0 2024-04-26T12:06:58.610 INFO:tasks.workunit.client.0.smithi052.stdout:9/792: symlink d3/db/d10/d3c/d40/d96/db5/da3/l11b 0 2024-04-26T12:06:58.612 INFO:tasks.workunit.client.0.smithi052.stdout:3/776: creat d2/d4/d41/d59/fea x:0 0 0 2024-04-26T12:06:58.613 INFO:tasks.workunit.client.0.smithi052.stdout:0/826: chown d0/d3d/dd2/l106 1387 1 2024-04-26T12:06:58.613 INFO:tasks.workunit.client.0.smithi052.stdout:9/793: write d3/f99 [677472,98888] 0 2024-04-26T12:06:58.615 INFO:tasks.workunit.client.0.smithi052.stdout:0/827: truncate d0/d26/fc6 648754 0 2024-04-26T12:06:58.615 INFO:tasks.workunit.client.0.smithi052.stdout:1/751: dread d0/d2/dd/f32 [0,4194304] 0 2024-04-26T12:06:58.615 INFO:tasks.workunit.client.0.smithi052.stdout:9/794: chown d3/db/d52/dfa/l10e 224 1 2024-04-26T12:06:58.617 INFO:tasks.workunit.client.0.smithi052.stdout:5/819: dread db/dc/f54 [0,4194304] 0 2024-04-26T12:06:58.618 INFO:tasks.workunit.client.0.smithi052.stdout:4/780: dwrite d3/d44/d4b/ff5 [0,4194304] 0 2024-04-26T12:06:58.619 INFO:tasks.workunit.client.0.smithi052.stdout:2/834: dwrite d0/d3f/d56/d6d/d5a/d73/fc2 [0,4194304] 0 2024-04-26T12:06:58.620 INFO:tasks.workunit.client.0.smithi052.stdout:5/820: rmdir db/dc/d5f/d50/d46 39 2024-04-26T12:06:58.620 INFO:tasks.workunit.client.0.smithi052.stdout:4/781: chown d3/d1f/c3d 1584 1 2024-04-26T12:06:58.621 INFO:tasks.workunit.client.0.smithi052.stdout:2/835: mkdir d0/d7/d2f/d8c/d116 0 2024-04-26T12:06:58.623 INFO:tasks.workunit.client.0.smithi052.stdout:5/821: write db/dd/d18/d60/d64/d9c/da0/df1/f107 [757142,64619] 0 2024-04-26T12:06:58.623 INFO:tasks.workunit.client.0.smithi052.stdout:0/828: truncate d0/d26/d36/f9e 1321573 0 2024-04-26T12:06:58.624 INFO:tasks.workunit.client.0.smithi052.stdout:2/836: getdents d0/d3f/d56/d6d/d5a/ded 0 2024-04-26T12:06:58.624 INFO:tasks.workunit.client.0.smithi052.stdout:1/752: dread d0/d2/dd/f32 [0,4194304] 0 2024-04-26T12:06:58.625 INFO:tasks.workunit.client.0.smithi052.stdout:6/817: dread da/d22/d29/dd4/ddf/f70 [0,4194304] 0 2024-04-26T12:06:58.627 INFO:tasks.workunit.client.0.smithi052.stdout:6/818: creat da/d22/d29/dd4/df7/d7e/d8b/f124 x:0 0 0 2024-04-26T12:06:58.627 INFO:tasks.workunit.client.0.smithi052.stdout:8/756: sync 2024-04-26T12:06:58.628 INFO:tasks.workunit.client.0.smithi052.stdout:9/795: sync 2024-04-26T12:06:58.629 INFO:tasks.workunit.client.0.smithi052.stdout:6/819: write da/d63/f72 [386248,40232] 0 2024-04-26T12:06:58.630 INFO:tasks.workunit.client.0.smithi052.stdout:0/829: dwrite d0/d3d/f3f [12582912,4194304] 0 2024-04-26T12:06:58.631 INFO:tasks.workunit.client.0.smithi052.stdout:5/822: read db/dd/d34/d69/d8a/da9/d87/d6e/fd0 [527013,32127] 0 2024-04-26T12:06:58.632 INFO:tasks.workunit.client.0.smithi052.stdout:2/837: dwrite d0/d7/f31 [8388608,4194304] 0 2024-04-26T12:06:58.632 INFO:tasks.workunit.client.0.smithi052.stdout:8/757: rmdir d0/d4/d5/d86/d9c/db4/d58/d89 39 2024-04-26T12:06:58.635 INFO:tasks.workunit.client.0.smithi052.stdout:9/796: truncate d3/db/d10/d2e/f71 4876699 0 2024-04-26T12:06:58.635 INFO:tasks.workunit.client.0.smithi052.stdout:6/820: creat da/d5d/d9c/f125 x:0 0 0 2024-04-26T12:06:58.636 INFO:tasks.workunit.client.0.smithi052.stdout:5/823: sync 2024-04-26T12:06:58.636 INFO:tasks.workunit.client.0.smithi052.stdout:9/797: stat d3/fb8 0 2024-04-26T12:06:58.636 INFO:tasks.workunit.client.0.smithi052.stdout:7/796: dread d1/d1f/d55/fbc [0,4194304] 0 2024-04-26T12:06:58.636 INFO:tasks.workunit.client.0.smithi052.stdout:5/824: mknod db/dd/d18/d60/d64/d9c/c10e 0 2024-04-26T12:06:58.637 INFO:tasks.workunit.client.0.smithi052.stdout:0/830: truncate d0/d1/d11/f16 5324614 0 2024-04-26T12:06:58.637 INFO:tasks.workunit.client.0.smithi052.stdout:9/798: rename d3/db/d4a/d112 to d3/d23/dd0/d11c 0 2024-04-26T12:06:58.637 INFO:tasks.workunit.client.0.smithi052.stdout:6/821: write da/f1e [2064977,21068] 0 2024-04-26T12:06:58.638 INFO:tasks.workunit.client.0.smithi052.stdout:2/838: creat d0/d3f/d56/d6d/d5a/f117 x:0 0 0 2024-04-26T12:06:58.639 INFO:tasks.workunit.client.0.smithi052.stdout:0/831: mkdir d0/d1/d1a/d3b/d10f 0 2024-04-26T12:06:58.639 INFO:tasks.workunit.client.0.smithi052.stdout:8/758: chown d0/d4/d5/d86/d9c/db4/d75/fbd 67970961 1 2024-04-26T12:06:58.640 INFO:tasks.workunit.client.0.smithi052.stdout:6/822: getdents da/d22/d29/d31/d6f 0 2024-04-26T12:06:58.640 INFO:tasks.workunit.client.0.smithi052.stdout:0/832: chown d0/d1/d2c/d42/cde 1 1 2024-04-26T12:06:58.641 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:58.641 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:58.642 INFO:tasks.workunit.client.0.smithi052.stdout:7/797: dwrite d1/d1c/d65/fc9 [0,4194304] 0 2024-04-26T12:06:58.642 INFO:tasks.workunit.client.0.smithi052.stdout:5/825: link db/dc/d5f/d50/d91/dd2/ce2 db/dd/d18/d60/d64/d9c/da0/df1/dfa/c10f 0 2024-04-26T12:06:58.643 INFO:tasks.workunit.client.0.smithi052.stdout:3/777: dread d2/d4/d6b/f76 [0,4194304] 0 2024-04-26T12:06:58.645 INFO:tasks.workunit.client.0.smithi052.stdout:9/799: truncate d3/db/d10/d3c/d40/d96/da7/feb 4892290 0 2024-04-26T12:06:58.645 INFO:tasks.workunit.client.0.smithi052.stdout:3/778: mknod d2/d4/ceb 0 2024-04-26T12:06:58.647 INFO:tasks.workunit.client.0.smithi052.stdout:5/826: chown db/dc/d5f/d50/ce4 210 1 2024-04-26T12:06:58.647 INFO:tasks.workunit.client.0.smithi052.stdout:8/759: link d0/d4/d5/d86/d9c/db4/fe6 d0/d4/d5/d27/d57/d8a/ff2 0 2024-04-26T12:06:58.649 INFO:tasks.workunit.client.0.smithi052.stdout:7/798: getdents d1/dab/d4c 0 2024-04-26T12:06:58.649 INFO:tasks.workunit.client.0.smithi052.stdout:4/782: dread d3/d12/fce [0,4194304] 0 2024-04-26T12:06:58.651 INFO:tasks.workunit.client.0.smithi052.stdout:2/839: dwrite d0/d3f/d56/d8d/d99/fbf [0,4194304] 0 2024-04-26T12:06:58.652 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:58.652 INFO:tasks.workunit.client.0.smithi052.stdout:7/799: truncate d1/f20 5805181 0 2024-04-26T12:06:58.653 INFO:tasks.workunit.client.0.smithi052.stdout:8/760: symlink d0/d16/d63/lf3 0 2024-04-26T12:06:58.653 INFO:tasks.workunit.client.0.smithi052.stdout:0/833: dwrite d0/d5b/d9d/ff4 [0,4194304] 0 2024-04-26T12:06:58.654 INFO:tasks.workunit.client.0.smithi052.stdout:9/800: creat d3/db/d10/d2e/f11d x:0 0 0 2024-04-26T12:06:58.654 INFO:tasks.workunit.client.0.smithi052.stdout:5/827: symlink db/dd/d34/d69/d8a/da9/l110 0 2024-04-26T12:06:58.654 INFO:tasks.workunit.client.0.smithi052.stdout:4/783: mknod d3/d1f/d21/c109 0 2024-04-26T12:06:58.655 INFO:tasks.workunit.client.0.smithi052.stdout:1/753: dread d0/d2/dd/d40/dc1/d1d/d91/fd5 [0,4194304] 0 2024-04-26T12:06:58.655 INFO:tasks.workunit.client.0.smithi052.stdout:8/761: symlink d0/d4/d5/d3c/lf4 0 2024-04-26T12:06:58.656 INFO:tasks.workunit.client.0.smithi052.stdout:6/823: dwrite da/d22/f3b [0,4194304] 0 2024-04-26T12:06:58.659 INFO:tasks.workunit.client.0.smithi052.stdout:0/834: write d0/d1/dd/f19 [4806465,97147] 0 2024-04-26T12:06:58.659 INFO:tasks.workunit.client.0.smithi052.stdout:4/784: write d3/d2b/dab/fe9 [1027175,29986] 0 2024-04-26T12:06:58.660 INFO:tasks.workunit.client.0.smithi052.stdout:8/762: creat d0/d4/d5/d27/d57/d8a/ff5 x:0 0 0 2024-04-26T12:06:58.661 INFO:tasks.workunit.client.0.smithi052.stdout:0/835: fdatasync d0/d1/d11/f43 0 2024-04-26T12:06:58.662 INFO:tasks.workunit.client.0.smithi052.stdout:9/801: getdents d3/db/d10/d3c/d40/d96/db5/d8f/d49 0 2024-04-26T12:06:58.662 INFO:tasks.workunit.client.0.smithi052.stdout:5/828: rename db/dc/d5f/d50/l85 to db/dc/d5f/d50/d91/l111 0 2024-04-26T12:06:58.662 INFO:tasks.workunit.client.0.smithi052.stdout:4/785: chown d3/d1f/d21/l27 328 1 2024-04-26T12:06:58.662 INFO:tasks.workunit.client.0.smithi052.stdout:8/763: chown d0/d4/d5/fe 522 1 2024-04-26T12:06:58.667 INFO:tasks.workunit.client.0.smithi052.stdout:0/836: rename d0/d5b/d9d/d32/l33 to d0/d3d/l110 0 2024-04-26T12:06:58.667 INFO:tasks.workunit.client.0.smithi052.stdout:2/840: dwrite d0/f4 [4194304,4194304] 0 2024-04-26T12:06:58.667 INFO:tasks.workunit.client.0.smithi052.stdout:8/764: write d0/d16/d28/f7d [1230411,58943] 0 2024-04-26T12:06:58.667 INFO:tasks.workunit.client.0.smithi052.stdout:4/786: dread - d3/d12/d59/d96/dc0/d92/fa8 zero size 2024-04-26T12:06:58.667 INFO:tasks.workunit.client.0.smithi052.stdout:1/754: dread d0/d83/d4b/f8f [4194304,4194304] 0 2024-04-26T12:06:58.667 INFO:tasks.workunit.client.0.smithi052.stdout:5/829: readlink db/dd/d34/d69/d8a/da9/d87/d6e/db8/lf8 0 2024-04-26T12:06:58.667 INFO:tasks.workunit.client.0.smithi052.stdout:9/802: write d3/db/d13/ffc [705035,25910] 0 2024-04-26T12:06:58.667 INFO:tasks.workunit.client.0.smithi052.stdout:7/800: read d1/d1c/d21/d2f/f38 [3182219,42084] 0 2024-04-26T12:06:58.667 INFO:tasks.workunit.client.0.smithi052.stdout:1/755: chown d0/d83/f27 0 1 2024-04-26T12:06:58.667 INFO:tasks.workunit.client.0.smithi052.stdout:0/837: getdents d0/d26/dc7/d97 0 2024-04-26T12:06:58.668 INFO:tasks.workunit.client.0.smithi052.stdout:5/830: chown db/dd/d34/d69/d93/cc3 0 1 2024-04-26T12:06:58.668 INFO:tasks.workunit.client.0.smithi052.stdout:4/787: rename d3/d44/d4b/c6a to d3/d1f/d21/dbe/c10a 0 2024-04-26T12:06:58.668 INFO:tasks.workunit.client.0.smithi052.stdout:7/801: rmdir d1/d1c/d21/d2f/d33/dc7 39 2024-04-26T12:06:58.668 INFO:tasks.workunit.client.0.smithi052.stdout:0/838: chown d0/d26/dbe/lf9 293742360 1 2024-04-26T12:06:58.669 INFO:tasks.workunit.client.0.smithi052.stdout:7/802: readlink d1/l1b 0 2024-04-26T12:06:58.669 INFO:tasks.workunit.client.0.smithi052.stdout:7/803: sync 2024-04-26T12:06:58.670 INFO:tasks.workunit.client.0.smithi052.stdout:8/765: rename d0/d4/f17 to d0/d4/d5/d86/d9c/db4/d58/dae/ff6 0 2024-04-26T12:06:58.670 INFO:tasks.workunit.client.0.smithi052.stdout:1/756: creat d0/da/db5/dcb/ff7 x:0 0 0 2024-04-26T12:06:58.671 INFO:tasks.workunit.client.0.smithi052.stdout:2/841: write d0/d3f/d56/d6d/d5a/dd5/d4d/f94 [953464,34346] 0 2024-04-26T12:06:58.672 INFO:tasks.workunit.client.0.smithi052.stdout:7/804: symlink d1/d1c/d23/d81/lf8 0 2024-04-26T12:06:58.674 INFO:tasks.workunit.client.0.smithi052.stdout:9/803: dwrite d3/db/d10/d3c/fa5 [0,4194304] 0 2024-04-26T12:06:58.676 INFO:tasks.workunit.client.0.smithi052.stdout:4/788: dread d3/d12/f19 [0,4194304] 0 2024-04-26T12:06:58.676 INFO:tasks.workunit.client.0.smithi052.stdout:8/766: getdents d0/d4/d5/d86/d9c/db4/dd8 0 2024-04-26T12:06:58.676 INFO:tasks.workunit.client.0.smithi052.stdout:8/767: sync 2024-04-26T12:06:58.677 INFO:tasks.workunit.client.0.smithi052.stdout:7/805: creat d1/d1c/d21/d2f/d33/d3a/d64/ff9 x:0 0 0 2024-04-26T12:06:58.679 INFO:tasks.workunit.client.0.smithi052.stdout:9/804: mknod d3/db/d10/d3c/d40/d96/db5/d8f/d49/c11e 0 2024-04-26T12:06:58.679 INFO:tasks.workunit.client.0.smithi052.stdout:0/839: dwrite d0/d3c/f9a [0,4194304] 0 2024-04-26T12:06:58.680 INFO:tasks.workunit.client.0.smithi052.stdout:8/768: rename d0/d4/lc7 to d0/d4/d1c/lf7 0 2024-04-26T12:06:58.681 INFO:tasks.workunit.client.0.smithi052.stdout:4/789: creat d3/d12/d34/d43/dc6/f10b x:0 0 0 2024-04-26T12:06:58.682 INFO:tasks.workunit.client.0.smithi052.stdout:7/806: creat d1/d1c/d21/d2f/ffa x:0 0 0 2024-04-26T12:06:58.682 INFO:tasks.workunit.client.0.smithi052.stdout:3/779: dread d2/d4/dc/d1d/f32 [4194304,4194304] 0 2024-04-26T12:06:58.682 INFO:tasks.workunit.client.0.smithi052.stdout:8/769: write d0/d4/d5/f61 [54232,26616] 0 2024-04-26T12:06:58.683 INFO:tasks.workunit.client.0.smithi052.stdout:4/790: chown d3/d1f/d21/dd2 163390529 1 2024-04-26T12:06:58.684 INFO:tasks.workunit.client.0.smithi052.stdout:2/842: dwrite d0/d7/d2f/fb2 [4194304,4194304] 0 2024-04-26T12:06:58.685 INFO:tasks.workunit.client.0.smithi052.stdout:7/807: symlink d1/d1c/d21/d2f/d33/d3a/lfb 0 2024-04-26T12:06:58.685 INFO:tasks.workunit.client.0.smithi052.stdout:1/757: dwrite d0/d2/dd/d40/dc1/d1d/d91/fbb [0,4194304] 0 2024-04-26T12:06:58.686 INFO:tasks.workunit.client.0.smithi052.stdout:8/770: stat d0/d4/d5/db/d20/d7b/f92 0 2024-04-26T12:06:58.687 INFO:tasks.workunit.client.0.smithi052.stdout:6/824: dread da/f1d [0,4194304] 0 2024-04-26T12:06:58.687 INFO:tasks.workunit.client.0.smithi052.stdout:9/805: read d3/db/d10/d3c/d40/d96/f6e [1082350,93825] 0 2024-04-26T12:06:58.687 INFO:tasks.workunit.client.0.smithi052.stdout:2/843: chown d0/d3f/d56/d6d/d5a/d73/d4b 667665 1 2024-04-26T12:06:58.688 INFO:tasks.workunit.client.0.smithi052.stdout:1/758: mkdir d0/d2/dd/d40/df8 0 2024-04-26T12:06:58.688 INFO:tasks.workunit.client.0.smithi052.stdout:7/808: write d1/d1f/f8c [1102827,15747] 0 2024-04-26T12:06:58.689 INFO:tasks.workunit.client.0.smithi052.stdout:3/780: link d2/d4/d6b/dcf/de4/dc3/cdd d2/d4/d41/cec 0 2024-04-26T12:06:58.689 INFO:tasks.workunit.client.0.smithi052.stdout:9/806: fsync d3/d3b/fb7 0 2024-04-26T12:06:58.690 INFO:tasks.workunit.client.0.smithi052.stdout:6/825: write da/d51/f62 [1962855,82133] 0 2024-04-26T12:06:58.691 INFO:tasks.workunit.client.0.smithi052.stdout:3/781: write d2/d4/d2a/d2d/f2e [648573,69136] 0 2024-04-26T12:06:58.692 INFO:tasks.workunit.client.0.smithi052.stdout:0/840: dwrite d0/d26/ff6 [0,4194304] 0 2024-04-26T12:06:58.692 INFO:tasks.workunit.client.0.smithi052.stdout:1/759: creat d0/d2/dd/d40/d81/d9a/dce/ff9 x:0 0 0 2024-04-26T12:06:58.693 INFO:tasks.workunit.client.0.smithi052.stdout:8/771: getdents d0/d4/d5/db/d20/d7b 0 2024-04-26T12:06:58.694 INFO:tasks.workunit.client.0.smithi052.stdout:9/807: creat d3/f11f x:0 0 0 2024-04-26T12:06:58.696 INFO:tasks.workunit.client.0.smithi052.stdout:5/831: dread db/dc/d5f/d50/d46/f4c [0,4194304] 0 2024-04-26T12:06:58.696 INFO:tasks.workunit.client.0.smithi052.stdout:3/782: creat d2/d4/dc/d1d/d25/d36/d1c/d4e/fed x:0 0 0 2024-04-26T12:06:58.696 INFO:tasks.workunit.client.0.smithi052.stdout:7/809: getdents d1/d1c/d21/d2f/d33 0 2024-04-26T12:06:58.697 INFO:tasks.workunit.client.0.smithi052.stdout:9/808: rmdir d3/db/d10/d2e 39 2024-04-26T12:06:58.697 INFO:tasks.workunit.client.0.smithi052.stdout:5/832: symlink db/dd/d34/d69/l112 0 2024-04-26T12:06:58.698 INFO:tasks.workunit.client.0.smithi052.stdout:8/772: chown d0/d4/dc/d68/d84/f85 6887801 1 2024-04-26T12:06:58.698 INFO:tasks.workunit.client.0.smithi052.stdout:3/783: chown d2/d4/d41/d59/fd5 48212 1 2024-04-26T12:06:58.699 INFO:tasks.workunit.client.0.smithi052.stdout:2/844: truncate d0/d7/d2f/d3d/fb5 318551 0 2024-04-26T12:06:58.699 INFO:tasks.workunit.client.0.smithi052.stdout:7/810: fdatasync d1/d1c/d23/fd1 0 2024-04-26T12:06:58.699 INFO:tasks.workunit.client.0.smithi052.stdout:1/760: write d0/d83/d4b/d56/f6d [323155,107167] 0 2024-04-26T12:06:58.701 INFO:tasks.workunit.client.0.smithi052.stdout:7/811: unlink d1/l1d 0 2024-04-26T12:06:58.701 INFO:tasks.workunit.client.0.smithi052.stdout:3/784: mknod d2/d4/d41/d5c/cee 0 2024-04-26T12:06:58.702 INFO:tasks.workunit.client.0.smithi052.stdout:8/773: getdents d0/d4/d5/da3 0 2024-04-26T12:06:58.702 INFO:tasks.workunit.client.0.smithi052.stdout:5/833: mknod db/dd/d34/d69/d93/d101/c113 0 2024-04-26T12:06:58.702 INFO:tasks.workunit.client.0.smithi052.stdout:6/826: dwrite da/d63/f72 [0,4194304] 0 2024-04-26T12:06:58.703 INFO:tasks.workunit.client.0.smithi052.stdout:2/845: link d0/d3f/d56/d6d/d5a/dd5/d3a/f59 d0/d3f/d56/d8d/f118 0 2024-04-26T12:06:58.705 INFO:tasks.workunit.client.0.smithi052.stdout:4/791: dread d3/d22/d30/f5c [0,4194304] 0 2024-04-26T12:06:58.706 INFO:tasks.workunit.client.0.smithi052.stdout:5/834: chown db/dd/d18/d60/d64/l4a 24560 1 2024-04-26T12:06:58.706 INFO:tasks.workunit.client.0.smithi052.stdout:1/761: read d0/da/f19 [1571872,75958] 0 2024-04-26T12:06:58.706 INFO:tasks.workunit.client.0.smithi052.stdout:6/827: unlink da/d22/d3c/cc1 0 2024-04-26T12:06:58.707 INFO:tasks.workunit.client.0.smithi052.stdout:8/774: dread - d0/d4/d5/d27/d57/fed zero size 2024-04-26T12:06:58.707 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:58.705+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:58.707 INFO:tasks.workunit.client.0.smithi052.stdout:4/792: read - d3/d15/f99 zero size 2024-04-26T12:06:58.708 INFO:tasks.workunit.client.0.smithi052.stdout:5/835: fdatasync db/dd/d34/d69/fa6 0 2024-04-26T12:06:58.708 INFO:tasks.workunit.client.0.smithi052.stdout:9/809: dwrite d3/db/d10/d3c/d40/d96/db5/d8f/d49/da4/f115 [0,4194304] 0 2024-04-26T12:06:58.709 INFO:tasks.workunit.client.0.smithi052.stdout:6/828: creat da/d22/d97/f126 x:0 0 0 2024-04-26T12:06:58.709 INFO:tasks.workunit.client.0.smithi052.stdout:0/841: dread d0/d1/d1a/f4b [4194304,4194304] 0 2024-04-26T12:06:58.710 INFO:tasks.workunit.client.0.smithi052.stdout:0/842: sync 2024-04-26T12:06:58.711 INFO:tasks.workunit.client.0.smithi052.stdout:2/846: truncate d0/d3f/d56/d6d/d5a/dd5/ff0 913524 0 2024-04-26T12:06:58.711 INFO:tasks.workunit.client.0.smithi052.stdout:4/793: symlink d3/d12/d34/l10c 0 2024-04-26T12:06:58.711 INFO:tasks.workunit.client.0.smithi052.stdout:3/785: getdents d2/d4/d6b/dcf/de4/dc3 0 2024-04-26T12:06:58.712 INFO:tasks.workunit.client.0.smithi052.stdout:1/762: creat d0/d2/dd/d40/d81/d9a/dce/de2/ffa x:0 0 0 2024-04-26T12:06:58.712 INFO:tasks.workunit.client.0.smithi052.stdout:7/812: dwrite d1/d1c/d21/d2f/d33/d3a/f8f [0,4194304] 0 2024-04-26T12:06:58.712 INFO:tasks.workunit.client.0.smithi052.stdout:8/775: write d0/d4/d5/d27/d69/fb1 [624629,81350] 0 2024-04-26T12:06:58.713 INFO:tasks.workunit.client.0.smithi052.stdout:3/786: chown d2/d4/d41/d59/la6 4 1 2024-04-26T12:06:58.713 INFO:tasks.workunit.client.0.smithi052.stdout:0/843: read d0/f49 [2237863,103628] 0 2024-04-26T12:06:58.713 INFO:tasks.workunit.client.0.smithi052.stdout:6/829: creat da/d22/d29/d31/d6f/dcc/f127 x:0 0 0 2024-04-26T12:06:58.715 INFO:tasks.workunit.client.0.smithi052.stdout:4/794: creat d3/d12/d34/d91/f10d x:0 0 0 2024-04-26T12:06:58.715 INFO:tasks.workunit.client.0.smithi052.stdout:2/847: rmdir d0/d3f/d56/d6d/d5a/d73/d4b/d9c 39 2024-04-26T12:06:58.715 INFO:tasks.workunit.client.0.smithi052.stdout:0/844: mkdir d0/d5b/d9d/d4f/d111 0 2024-04-26T12:06:58.715 INFO:tasks.workunit.client.0.smithi052.stdout:1/763: write d0/d2/dd/d40/dc1/d1d/d91/f94 [4561136,33720] 0 2024-04-26T12:06:58.716 INFO:tasks.workunit.client.0.smithi052.stdout:3/787: chown d2/d4/d2a/dbf/le5 63145111 1 2024-04-26T12:06:58.716 INFO:tasks.workunit.client.0.smithi052.stdout:4/795: rmdir d3/d44/d4b 39 2024-04-26T12:06:58.716 INFO:tasks.workunit.client.0.smithi052.stdout:2/848: chown d0/d36/dc1/fda 8549 1 2024-04-26T12:06:58.716 INFO:tasks.workunit.client.0.smithi052.stdout:6/830: creat da/d22/d29/dd4/ddf/d95/df8/f128 x:0 0 0 2024-04-26T12:06:58.717 INFO:tasks.workunit.client.0.smithi052.stdout:0/845: mknod d0/d5b/d9d/d4f/da4/c112 0 2024-04-26T12:06:58.718 INFO:tasks.workunit.client.0.smithi052.stdout:5/836: dwrite db/dd/d34/fed [0,4194304] 0 2024-04-26T12:06:58.718 INFO:tasks.workunit.client.0.smithi052.stdout:4/796: chown d3/d12/d34/d45/d67/d6c/fad 304975 1 2024-04-26T12:06:58.718 INFO:tasks.workunit.client.0.smithi052.stdout:1/764: rmdir d0/d2/dd/d40/d81/d9a/ddb 0 2024-04-26T12:06:58.718 INFO:tasks.workunit.client.0.smithi052.stdout:2/849: unlink d0/d3f/d56/d8d/f110 0 2024-04-26T12:06:58.719 INFO:tasks.workunit.client.0.smithi052.stdout:9/810: read d3/db/d13/f51 [10315142,37041] 0 2024-04-26T12:06:58.719 INFO:tasks.workunit.client.0.smithi052.stdout:8/776: link d0/d4/dc/d80/fc8 d0/d4/d5/da3/ff8 0 2024-04-26T12:06:58.720 INFO:tasks.workunit.client.0.smithi052.stdout:5/837: unlink db/dd/d34/d69/l112 0 2024-04-26T12:06:58.720 INFO:tasks.workunit.client.0.smithi052.stdout:7/813: truncate d1/f20 2241028 0 2024-04-26T12:06:58.721 INFO:tasks.workunit.client.0.smithi052.stdout:6/831: rename da/d22/d29/d31/d6f/c111 to da/d22/d97/d115/c129 0 2024-04-26T12:06:58.721 INFO:tasks.workunit.client.0.smithi052.stdout:1/765: mknod d0/d2/dd/d40/d81/d9a/cfb 0 2024-04-26T12:06:58.721 INFO:tasks.workunit.client.0.smithi052.stdout:3/788: getdents d2/d4/dc/d1d/d25 0 2024-04-26T12:06:58.722 INFO:tasks.workunit.client.0.smithi052.stdout:9/811: mkdir d3/db/d10/d3c/d40/d96/d120 0 2024-04-26T12:06:58.722 INFO:tasks.workunit.client.0.smithi052.stdout:4/797: rename d3/d15/d76/fb2 to d3/d1f/d21/dbe/f10e 0 2024-04-26T12:06:58.722 INFO:tasks.workunit.client.0.smithi052.stdout:2/850: chown d0/d3f/d56/d6d/d5a/de4/df9/cb1 1042 1 2024-04-26T12:06:58.723 INFO:tasks.workunit.client.0.smithi052.stdout:1/766: symlink d0/da/db5/lfc 0 2024-04-26T12:06:58.724 INFO:tasks.workunit.client.0.smithi052.stdout:7/814: write d1/d1c/d23/f78 [797497,41081] 0 2024-04-26T12:06:58.724 INFO:tasks.workunit.client.0.smithi052.stdout:8/777: creat d0/d4/d5/d86/d9c/db4/d58/ff9 x:0 0 0 2024-04-26T12:06:58.725 INFO:tasks.workunit.client.0.smithi052.stdout:3/789: chown d2/d4/d6b/dcf/de4/dc3/cdd 33071619 1 2024-04-26T12:06:58.725 INFO:tasks.workunit.client.0.smithi052.stdout:4/798: chown d3/d12/d59/d96/dc0/ddd 3 1 2024-04-26T12:06:58.725 INFO:tasks.workunit.client.0.smithi052.stdout:2/851: creat d0/d7/d2f/dee/f119 x:0 0 0 2024-04-26T12:06:58.725 INFO:tasks.workunit.client.0.smithi052.stdout:4/799: sync 2024-04-26T12:06:58.725 INFO:tasks.workunit.client.0.smithi052.stdout:6/832: rename da/d22/d97/c107 to da/d22/d29/dd4/df7/dcf/de0/c12a 0 2024-04-26T12:06:58.725 INFO:tasks.workunit.client.0.smithi052.stdout:7/815: creat d1/d1c/d65/ffc x:0 0 0 2024-04-26T12:06:58.726 INFO:tasks.workunit.client.0.smithi052.stdout:2/852: fdatasync d0/d7/fe 0 2024-04-26T12:06:58.727 INFO:tasks.workunit.client.0.smithi052.stdout:9/812: link d3/db/d10/d3c/c92 d3/db/d10/daa/c121 0 2024-04-26T12:06:58.727 INFO:tasks.workunit.client.0.smithi052.stdout:3/790: readlink d2/d4/dc/d1d/d3f/l6c 0 2024-04-26T12:06:58.728 INFO:tasks.workunit.client.0.smithi052.stdout:4/800: unlink d3/d12/d34/d45/f61 0 2024-04-26T12:06:58.728 INFO:tasks.workunit.client.0.smithi052.stdout:6/833: dread - da/d22/d29/dd4/df7/d87/fdc zero size 2024-04-26T12:06:58.728 INFO:tasks.workunit.client.0.smithi052.stdout:9/813: chown d3/d3b/fb7 432765498 1 2024-04-26T12:06:58.728 INFO:tasks.workunit.client.0.smithi052.stdout:1/767: creat d0/d2/dd/d40/d81/d9a/dce/de9/ffd x:0 0 0 2024-04-26T12:06:58.729 INFO:tasks.workunit.client.0.smithi052.stdout:0/846: dwrite d0/d26/d74/da6/fdd [0,4194304] 0 2024-04-26T12:06:58.729 INFO:tasks.workunit.client.0.smithi052.stdout:8/778: getdents d0/d4/d5/db 0 2024-04-26T12:06:58.730 INFO:tasks.workunit.client.0.smithi052.stdout:6/834: chown da/d22/d29/d31/d39 136007 1 2024-04-26T12:06:58.730 INFO:tasks.workunit.client.0.smithi052.stdout:0/847: mkdir d0/d1/d54/d113 0 2024-04-26T12:06:58.731 INFO:tasks.workunit.client.0.smithi052.stdout:9/814: mkdir d3/d3b/d102/d122 0 2024-04-26T12:06:58.732 INFO:tasks.workunit.client.0.smithi052.stdout:5/838: truncate db/dc/d5f/d50/d91/fa8 2859136 0 2024-04-26T12:06:58.733 INFO:tasks.workunit.client.0.smithi052.stdout:1/768: creat d0/da/ffe x:0 0 0 2024-04-26T12:06:58.733 INFO:tasks.workunit.client.0.smithi052.stdout:8/779: fsync d0/d4/d5/d27/d57/d8a/ff2 0 2024-04-26T12:06:58.733 INFO:tasks.workunit.client.0.smithi052.stdout:6/835: rmdir da/d22/d29/dd4/df7/dcf/de0 39 2024-04-26T12:06:58.735 INFO:tasks.workunit.client.0.smithi052.stdout:0/848: dread - d0/d1/d2c/d42/d70/fd6 zero size 2024-04-26T12:06:58.736 INFO:tasks.workunit.client.0.smithi052.stdout:8/780: creat d0/d4/d5/db/ffa x:0 0 0 2024-04-26T12:06:58.736 INFO:tasks.workunit.client.0.smithi052.stdout:4/801: truncate d3/d12/d34/d45/d67/d6c/d86/fb0 204603 0 2024-04-26T12:06:58.736 INFO:tasks.workunit.client.0.smithi052.stdout:7/816: dwrite d1/d1c/d21/f67 [0,4194304] 0 2024-04-26T12:06:58.737 INFO:tasks.workunit.client.0.smithi052.stdout:2/853: dwrite d0/d7/d22/f101 [0,4194304] 0 2024-04-26T12:06:58.739 INFO:tasks.workunit.client.0.smithi052.stdout:4/802: dread - d3/d44/d4b/db8/dde/ffc zero size 2024-04-26T12:06:58.740 INFO:tasks.workunit.client.0.smithi052.stdout:7/817: creat d1/d1f/ffd x:0 0 0 2024-04-26T12:06:58.740 INFO:tasks.workunit.client.0.smithi052.stdout:6/836: link da/c77 da/d22/d29/d31/d39/c12b 0 2024-04-26T12:06:58.740 INFO:tasks.workunit.client.0.smithi052.stdout:8/781: mkdir d0/d4/d5/d27/d57/dda/dfb 0 2024-04-26T12:06:58.740 INFO:tasks.workunit.client.0.smithi052.stdout:0/849: rename d0/d1/d1a/d3b to d0/d1/d114 0 2024-04-26T12:06:58.741 INFO:tasks.workunit.client.0.smithi052.stdout:4/803: mkdir d3/d2b/d40/d10f 0 2024-04-26T12:06:58.741 INFO:tasks.workunit.client.0.smithi052.stdout:8/782: readlink d0/d16/d28/l67 0 2024-04-26T12:06:58.742 INFO:tasks.workunit.client.0.smithi052.stdout:2/854: symlink d0/d3f/d56/d6d/d5a/de4/l11a 0 2024-04-26T12:06:58.742 INFO:tasks.workunit.client.0.smithi052.stdout:9/815: truncate d3/db/d2b/f61 1337751 0 2024-04-26T12:06:58.743 INFO:tasks.workunit.client.0.smithi052.stdout:8/783: symlink d0/d4/d5/lfc 0 2024-04-26T12:06:58.743 INFO:tasks.workunit.client.0.smithi052.stdout:7/818: mkdir d1/d1c/d23/dd8/dfe 0 2024-04-26T12:06:58.743 INFO:tasks.workunit.client.0.smithi052.stdout:0/850: mkdir d0/d26/d74/db4/de1/d115 0 2024-04-26T12:06:58.746 INFO:tasks.workunit.client.0.smithi052.stdout:5/839: dread db/dd/d34/d70/d78/d92/ff6 [0,4194304] 0 2024-04-26T12:06:58.747 INFO:tasks.workunit.client.0.smithi052.stdout:3/791: dread d2/d4/dc/f7a [0,4194304] 0 2024-04-26T12:06:58.748 INFO:tasks.workunit.client.0.smithi052.stdout:2/855: dread - d0/d3f/d56/d6d/d5a/d73/d4b/d9c/fe9 zero size 2024-04-26T12:06:58.748 INFO:tasks.workunit.client.0.smithi052.stdout:7/819: mknod d1/dab/d4c/cff 0 2024-04-26T12:06:58.748 INFO:tasks.workunit.client.0.smithi052.stdout:8/784: truncate d0/d4/d5/d86/d9c/db4/fac 662091 0 2024-04-26T12:06:58.749 INFO:tasks.workunit.client.0.smithi052.stdout:6/837: dwrite da/f43 [0,4194304] 0 2024-04-26T12:06:58.749 INFO:tasks.workunit.client.0.smithi052.stdout:0/851: read d0/d26/d74/da6/ffb [574855,114076] 0 2024-04-26T12:06:58.751 INFO:tasks.workunit.client.0.smithi052.stdout:3/792: mknod d2/d4/dc/d33/d75/dc2/cef 0 2024-04-26T12:06:58.751 INFO:tasks.workunit.client.0.smithi052.stdout:1/769: dread d0/d2/f6 [0,4194304] 0 2024-04-26T12:06:58.751 INFO:tasks.workunit.client.0.smithi052.stdout:3/793: fsync d2/d4/dc/d1d/d3f/f7e 0 2024-04-26T12:06:58.752 INFO:tasks.workunit.client.0.smithi052.stdout:2/856: link d0/fb0 d0/d3f/d56/d6d/d5a/d82/de2/f11b 0 2024-04-26T12:06:58.753 INFO:tasks.workunit.client.0.smithi052.stdout:7/820: rmdir d1/d1c/d23 39 2024-04-26T12:06:58.753 INFO:tasks.workunit.client.0.smithi052.stdout:4/804: write d3/d12/d59/d96/dc0/ddd/fac [960372,44059] 0 2024-04-26T12:06:58.754 INFO:tasks.workunit.client.0.smithi052.stdout:5/840: getdents db/dd/d18/d60/d64/d9c/da0/df1 0 2024-04-26T12:06:58.754 INFO:tasks.workunit.client.0.smithi052.stdout:8/785: symlink d0/d4/d5/d86/d9c/db4/lfd 0 2024-04-26T12:06:58.754 INFO:tasks.workunit.client.0.smithi052.stdout:0/852: rename d0/d1/d11/f61 to d0/d5a/f116 0 2024-04-26T12:06:58.754 INFO:tasks.workunit.client.0.smithi052.stdout:2/857: unlink d0/d7/d22/c25 0 2024-04-26T12:06:58.755 INFO:tasks.workunit.client.0.smithi052.stdout:1/770: chown d0/d2/dd/d40/d81/d9a/dce/de9/d9b/la4 829575 1 2024-04-26T12:06:58.758 INFO:tasks.workunit.client.0.smithi052.stdout:5/841: write db/dd/d34/d69/d8a/da9/d87/d6e/fec [395150,26827] 0 2024-04-26T12:06:58.759 INFO:tasks.workunit.client.0.smithi052.stdout:8/786: write d0/d16/d28/f7d [2791037,37880] 0 2024-04-26T12:06:58.759 INFO:tasks.workunit.client.0.smithi052.stdout:0/853: write d0/d5b/d9d/ff4 [4049451,1782] 0 2024-04-26T12:06:58.760 INFO:tasks.workunit.client.0.smithi052.stdout:6/838: dwrite da/d22/d3c/f58 [0,4194304] 0 2024-04-26T12:06:58.764 INFO:tasks.workunit.client.0.smithi052.stdout:9/816: dwrite d3/d3b/dea/dfe/f111 [0,4194304] 0 2024-04-26T12:06:58.766 INFO:tasks.workunit.client.0.smithi052.stdout:3/794: dwrite d2/d4/dc/d33/fa0 [4194304,4194304] 0 2024-04-26T12:06:58.768 INFO:tasks.workunit.client.0.smithi052.stdout:6/839: mknod da/d22/d29/d31/d6f/dcc/df6/c12c 0 2024-04-26T12:06:58.769 INFO:tasks.workunit.client.0.smithi052.stdout:4/805: dwrite d3/f2f [0,4194304] 0 2024-04-26T12:06:58.769 INFO:tasks.workunit.client.0.smithi052.stdout:8/787: mknod d0/d4/d5/d86/d9c/db4/d58/d8f/cfe 0 2024-04-26T12:06:58.770 INFO:tasks.workunit.client.0.smithi052.stdout:0/854: link d0/d26/dbe/lf9 d0/d5b/d103/l117 0 2024-04-26T12:06:58.771 INFO:tasks.workunit.client.0.smithi052.stdout:8/788: mknod d0/d3e/d87/cff 0 2024-04-26T12:06:58.771 INFO:tasks.workunit.client.0.smithi052.stdout:2/858: dwrite d0/d3f/d56/d8d/fae [0,4194304] 0 2024-04-26T12:06:58.772 INFO:tasks.workunit.client.0.smithi052.stdout:3/795: chown d2/d4/dc/d1d/d25/d61/cdc 49058 1 2024-04-26T12:06:58.772 INFO:tasks.workunit.client.0.smithi052.stdout:4/806: readlink d3/d2b/dab/db6/db7/le1 0 2024-04-26T12:06:58.772 INFO:tasks.workunit.client.0.smithi052.stdout:0/855: creat d0/d26/d74/db4/f118 x:0 0 0 2024-04-26T12:06:58.773 INFO:tasks.workunit.client.0.smithi052.stdout:1/771: dwrite d0/d2/dd/d40/d81/d9a/dce/de9/d9b/fd8 [0,4194304] 0 2024-04-26T12:06:58.773 INFO:tasks.workunit.client.0.smithi052.stdout:6/840: getdents da/d22/d29/d31/d108/d118 0 2024-04-26T12:06:58.773 INFO:tasks.workunit.client.0.smithi052.stdout:8/789: unlink d0/d4/d5/d86/d9c/db4/d58/f5b 0 2024-04-26T12:06:58.774 INFO:tasks.workunit.client.0.smithi052.stdout:4/807: symlink d3/d12/d59/d96/df7/l110 0 2024-04-26T12:06:58.774 INFO:tasks.workunit.client.0.smithi052.stdout:6/841: unlink da/d22/d29/d31/f7f 0 2024-04-26T12:06:58.775 INFO:tasks.workunit.client.0.smithi052.stdout:2/859: creat d0/d3f/d56/d6d/d5a/d73/d4b/f11c x:0 0 0 2024-04-26T12:06:58.775 INFO:tasks.workunit.client.0.smithi052.stdout:4/808: mkdir d3/d1f/d21/dbe/d111 0 2024-04-26T12:06:58.776 INFO:tasks.workunit.client.0.smithi052.stdout:6/842: creat da/d22/d29/d31/d108/d118/f12d x:0 0 0 2024-04-26T12:06:58.777 INFO:tasks.workunit.client.0.smithi052.stdout:4/809: mknod d3/d12/d34/d45/d67/d6c/c112 0 2024-04-26T12:06:58.779 INFO:tasks.workunit.client.0.smithi052.stdout:2/860: link d0/d7/d2f/d9b/l6f d0/d3f/d56/d8d/d99/l11d 0 2024-04-26T12:06:58.780 INFO:tasks.workunit.client.0.smithi052.stdout:2/861: dread - d0/d7/d2f/fcb zero size 2024-04-26T12:06:58.781 INFO:tasks.workunit.client.0.smithi052.stdout:3/796: truncate d2/d4/dc/d33/d75/f84 3062797 0 2024-04-26T12:06:58.782 INFO:tasks.workunit.client.0.smithi052.stdout:3/797: chown d2/d4/dc/d1d/d25/d36/d1c/l30 7684479 1 2024-04-26T12:06:58.783 INFO:tasks.workunit.client.0.smithi052.stdout:6/843: dwrite da/d22/d29/dd4/ddf/d7c/d94/fd7 [0,4194304] 0 2024-04-26T12:06:58.783 INFO:tasks.workunit.client.0.smithi052.stdout:3/798: write d2/d4/f64 [2933720,75341] 0 2024-04-26T12:06:58.784 INFO:tasks.workunit.client.0.smithi052.stdout:0/856: dwrite d0/d1/d1a/d20/f3a [4194304,4194304] 0 2024-04-26T12:06:58.785 INFO:tasks.workunit.client.0.smithi052.stdout:6/844: symlink da/d22/d29/dd4/df7/d7e/d8b/l12e 0 2024-04-26T12:06:58.786 INFO:tasks.workunit.client.0.smithi052.stdout:3/799: mkdir d2/d4/dc/d1d/d25/d36/d1c/d4e/df0 0 2024-04-26T12:06:58.786 INFO:tasks.workunit.client.0.smithi052.stdout:0/857: mkdir d0/d26/dbe/d119 0 2024-04-26T12:06:58.787 INFO:tasks.workunit.client.0.smithi052.stdout:0/858: chown d0/d1/d1a 3945992 1 2024-04-26T12:06:58.788 INFO:tasks.workunit.client.0.smithi052.stdout:2/862: dwrite d0/d3f/d56/d6d/d5a/f117 [0,4194304] 0 2024-04-26T12:06:58.789 INFO:tasks.workunit.client.0.smithi052.stdout:3/800: mknod d2/d4/dc/d33/d37/dd4/cf1 0 2024-04-26T12:06:58.790 INFO:tasks.workunit.client.0.smithi052.stdout:0/859: rmdir d0/d26/dbe/d119 0 2024-04-26T12:06:58.790 INFO:tasks.workunit.client.0.smithi052.stdout:3/801: write d2/d4/d2a/d2d/f2e [1576713,72174] 0 2024-04-26T12:06:58.790 INFO:tasks.workunit.client.0.smithi052.stdout:0/860: readlink d0/d1/d1a/d20/l7d 0 2024-04-26T12:06:58.792 INFO:tasks.workunit.client.0.smithi052.stdout:7/821: dread d1/f7 [0,4194304] 0 2024-04-26T12:06:58.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~41s 2024-04-26T12:06:58.793 INFO:tasks.workunit.client.0.smithi052.stdout:0/861: mknod d0/d1/d2c/d42/c11a 0 2024-04-26T12:06:58.793 INFO:tasks.workunit.client.0.smithi052.stdout:0/862: write d0/d1/f41 [2232536,12438] 0 2024-04-26T12:06:58.795 INFO:tasks.workunit.client.0.smithi052.stdout:0/863: chown d0/d1/f41 1047232 1 2024-04-26T12:06:58.795 INFO:tasks.workunit.client.0.smithi052.stdout:2/863: dwrite d0/d3f/d56/d6d/d5a/d82/fe8 [0,4194304] 0 2024-04-26T12:06:58.797 INFO:tasks.workunit.client.0.smithi052.stdout:0/864: mkdir d0/d5b/d9d/d4f/da4/d11b 0 2024-04-26T12:06:58.798 INFO:tasks.workunit.client.0.smithi052.stdout:0/865: chown d0/d1/d52/fe4 1944514 1 2024-04-26T12:06:58.800 INFO:tasks.workunit.client.0.smithi052.stdout:7/822: dwrite d1/d1c/d23/f31 [0,4194304] 0 2024-04-26T12:06:58.800 INFO:tasks.workunit.client.0.smithi052.stdout:0/866: rename d0/d1/c14 to d0/d26/d36/c11c 0 2024-04-26T12:06:58.802 INFO:tasks.workunit.client.0.smithi052.stdout:7/823: chown d1/d1c/d21/d2f/f38 4956852 1 2024-04-26T12:06:58.802 INFO:tasks.workunit.client.0.smithi052.stdout:2/864: dwrite d0/d7/d2f/ffb [0,4194304] 0 2024-04-26T12:06:58.802 INFO:tasks.workunit.client.0.smithi052.stdout:3/802: dread d2/d4/dc/d1d/d3f/f70 [0,4194304] 0 2024-04-26T12:06:58.803 INFO:tasks.workunit.client.0.smithi052.stdout:5/842: sync 2024-04-26T12:06:58.804 INFO:tasks.workunit.client.0.smithi052.stdout:1/772: sync 2024-04-26T12:06:58.804 INFO:tasks.workunit.client.0.smithi052.stdout:3/803: chown d2/d4/dc/d1d/d25/d36/f86 3 1 2024-04-26T12:06:58.804 INFO:tasks.workunit.client.0.smithi052.stdout:5/843: mknod db/dd/d34/c114 0 2024-04-26T12:06:58.805 INFO:tasks.workunit.client.0.smithi052.stdout:3/804: dread - d2/d4/dc/d1d/d25/fcd zero size 2024-04-26T12:06:58.805 INFO:tasks.workunit.client.0.smithi052.stdout:1/773: creat d0/d2/dd/d40/df8/fff x:0 0 0 2024-04-26T12:06:58.806 INFO:tasks.workunit.client.0.smithi052.stdout:0/867: dread d0/d1/d11/f4a [0,4194304] 0 2024-04-26T12:06:58.807 INFO:tasks.workunit.client.0.smithi052.stdout:7/824: truncate d1/d1c/d21/d2f/f54 75816 0 2024-04-26T12:06:58.807 INFO:tasks.workunit.client.0.smithi052.stdout:3/805: mknod d2/d4/dc/d1d/d3f/da2/cf2 0 2024-04-26T12:06:58.808 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:58.806+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:58.808 INFO:tasks.workunit.client.0.smithi052.stdout:0/868: rmdir d0/d1/d54/d113 0 2024-04-26T12:06:58.809 INFO:tasks.workunit.client.0.smithi052.stdout:3/806: creat d2/d4/d2a/dbf/db0/ff3 x:0 0 0 2024-04-26T12:06:58.809 INFO:tasks.workunit.client.0.smithi052.stdout:7/825: getdents d1/d1f/d55 0 2024-04-26T12:06:58.809 INFO:tasks.workunit.client.0.smithi052.stdout:7/826: fsync d1/d1f/f72 0 2024-04-26T12:06:58.810 INFO:tasks.workunit.client.0.smithi052.stdout:0/869: creat d0/d26/f11d x:0 0 0 2024-04-26T12:06:58.810 INFO:tasks.workunit.client.0.smithi052.stdout:7/827: stat d1/d1c/c71 0 2024-04-26T12:06:58.811 INFO:tasks.workunit.client.0.smithi052.stdout:5/844: dwrite db/dd/d18/f102 [0,4194304] 0 2024-04-26T12:06:58.812 INFO:tasks.workunit.client.0.smithi052.stdout:7/828: stat d1/d1c/d21/d2f/d68/cb2 0 2024-04-26T12:06:58.813 INFO:tasks.workunit.client.0.smithi052.stdout:0/870: read d0/d1/f13 [2444034,70620] 0 2024-04-26T12:06:58.813 INFO:tasks.workunit.client.0.smithi052.stdout:5/845: mknod db/dd/d18/d60/c115 0 2024-04-26T12:06:58.813 INFO:tasks.workunit.client.0.smithi052.stdout:7/829: write d1/f9f [2754426,129080] 0 2024-04-26T12:06:58.817 INFO:tasks.workunit.client.0.smithi052.stdout:1/774: dread d0/d2/dd/d40/d81/d9a/dce/de9/d9b/fa9 [0,4194304] 0 2024-04-26T12:06:58.818 INFO:tasks.workunit.client.0.smithi052.stdout:0/871: dwrite d0/d5b/d9d/d4f/f7c [0,4194304] 0 2024-04-26T12:06:58.818 INFO:tasks.workunit.client.0.smithi052.stdout:7/830: read d1/d1f/f26 [1680103,71225] 0 2024-04-26T12:06:58.819 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:58.819 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:58.820 INFO:tasks.workunit.client.0.smithi052.stdout:6/845: dread da/d22/d29/dd4/ddf/d95/df8/d68/f86 [0,4194304] 0 2024-04-26T12:06:58.820 INFO:tasks.workunit.client.0.smithi052.stdout:6/846: stat da/d22/l33 0 2024-04-26T12:06:58.821 INFO:tasks.workunit.client.0.smithi052.stdout:7/831: mkdir d1/d1c/d21/d2f/d33/d3a/d100 0 2024-04-26T12:06:58.821 INFO:tasks.workunit.client.0.smithi052.stdout:0/872: creat d0/d1/d2c/d42/da5/dba/dbb/f11e x:0 0 0 2024-04-26T12:06:58.822 INFO:tasks.workunit.client.0.smithi052.stdout:4/810: dread d3/d2e/f4d [0,4194304] 0 2024-04-26T12:06:58.822 INFO:tasks.workunit.client.0.smithi052.stdout:0/873: write d0/d5b/d103/f10d [2788475,96699] 0 2024-04-26T12:06:58.823 INFO:tasks.workunit.client.0.smithi052.stdout:0/874: creat d0/d3c/f11f x:0 0 0 2024-04-26T12:06:58.823 INFO:tasks.workunit.client.0.smithi052.stdout:4/811: truncate d3/d2b/f7d 733885 0 2024-04-26T12:06:58.825 INFO:tasks.workunit.client.0.smithi052.stdout:6/847: truncate da/d22/d3c/f4b 80474 0 2024-04-26T12:06:58.825 INFO:tasks.workunit.client.0.smithi052.stdout:4/812: creat d3/d2b/dab/dec/df8/f113 x:0 0 0 2024-04-26T12:06:58.825 INFO:tasks.workunit.client.0.smithi052.stdout:7/832: dread d1/d1c/d21/d2f/d33/d3a/f8f [0,4194304] 0 2024-04-26T12:06:58.827 INFO:tasks.workunit.client.0.smithi052.stdout:7/833: creat d1/db7/f101 x:0 0 0 2024-04-26T12:06:58.827 INFO:tasks.workunit.client.0.smithi052.stdout:7/834: stat d1/d1c/fc5 0 2024-04-26T12:06:58.827 INFO:tasks.workunit.client.0.smithi052.stdout:6/848: truncate da/d22/d29/d31/d39/f48 1126737 0 2024-04-26T12:06:58.829 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:58.829 INFO:tasks.workunit.client.0.smithi052.stdout:0/875: dwrite d0/d1/d11/f43 [0,4194304] 0 2024-04-26T12:06:58.830 INFO:tasks.workunit.client.0.smithi052.stdout:7/835: mkdir d1/dab/d4c/dd6/d102 0 2024-04-26T12:06:58.830 INFO:tasks.workunit.client.0.smithi052.stdout:6/849: mkdir da/d22/d29/dd4/ddf/d92/d96/d12f 0 2024-04-26T12:06:58.832 INFO:tasks.workunit.client.0.smithi052.stdout:6/850: chown da/d63/f78 76158349 1 2024-04-26T12:06:58.832 INFO:tasks.workunit.client.0.smithi052.stdout:4/813: dwrite d3/d22/fc2 [0,4194304] 0 2024-04-26T12:06:58.834 INFO:tasks.workunit.client.0.smithi052.stdout:7/836: rename d1/d1c/d21/d2f/d33/d92/ccd to d1/d1f/d55/c103 0 2024-04-26T12:06:58.834 INFO:tasks.workunit.client.0.smithi052.stdout:2/865: sync 2024-04-26T12:06:58.834 INFO:tasks.workunit.client.0.smithi052.stdout:9/817: sync 2024-04-26T12:06:58.835 INFO:tasks.workunit.client.0.smithi052.stdout:8/790: sync 2024-04-26T12:06:58.835 INFO:tasks.workunit.client.0.smithi052.stdout:3/807: sync 2024-04-26T12:06:58.835 INFO:tasks.workunit.client.0.smithi052.stdout:4/814: creat d3/d15/d76/f114 x:0 0 0 2024-04-26T12:06:58.835 INFO:tasks.workunit.client.0.smithi052.stdout:6/851: rename da/d22/d29/d31/c9d to da/d22/d29/dd4/ddf/d95/dd2/c130 0 2024-04-26T12:06:58.837 INFO:tasks.workunit.client.0.smithi052.stdout:4/815: creat d3/d15/f115 x:0 0 0 2024-04-26T12:06:58.837 INFO:tasks.workunit.client.0.smithi052.stdout:1/775: dread d0/da/d2e/fa8 [0,4194304] 0 2024-04-26T12:06:58.837 INFO:tasks.workunit.client.0.smithi052.stdout:4/816: stat d3 0 2024-04-26T12:06:58.838 INFO:tasks.workunit.client.0.smithi052.stdout:8/791: creat d0/d4/d5/d27/f100 x:0 0 0 2024-04-26T12:06:58.838 INFO:tasks.workunit.client.0.smithi052.stdout:5/846: dread db/dd/d18/d60/f9a [0,4194304] 0 2024-04-26T12:06:58.838 INFO:tasks.workunit.client.0.smithi052.stdout:0/876: dwrite d0/d1/d2c/d42/da5/dba/dbb/f11e [0,4194304] 0 2024-04-26T12:06:58.839 INFO:tasks.workunit.client.0.smithi052.stdout:7/837: write d1/d1c/d21/f7f [4282789,44389] 0 2024-04-26T12:06:58.839 INFO:tasks.workunit.client.0.smithi052.stdout:3/808: unlink d2/d4/dc/d1d/d25/fcd 0 2024-04-26T12:06:58.839 INFO:tasks.workunit.client.0.smithi052.stdout:1/776: stat d0/d2/dd/d40/df8 0 2024-04-26T12:06:58.840 INFO:tasks.workunit.client.0.smithi052.stdout:6/852: mkdir da/d22/d29/dd4/ddf/d92/d96/d131 0 2024-04-26T12:06:58.842 INFO:tasks.workunit.client.0.smithi052.stdout:2/866: rename d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/fbc to d0/d7/d2f/dee/f11e 0 2024-04-26T12:06:58.843 INFO:tasks.workunit.client.0.smithi052.stdout:7/838: chown d1/d1c/d21/d2f/d33/d3a/d64/fed 476 1 2024-04-26T12:06:58.847 INFO:tasks.workunit.client.0.smithi052.stdout:9/818: dwrite d3/db/d13/f51 [4194304,4194304] 0 2024-04-26T12:06:58.848 INFO:tasks.workunit.client.0.smithi052.stdout:8/792: dread d0/d3e/f42 [0,4194304] 0 2024-04-26T12:06:58.849 INFO:tasks.workunit.client.0.smithi052.stdout:1/777: rename d0/d2/dd/d40/dc1/d1d/d23/ld4 to d0/d2/dd/d40/df8/l100 0 2024-04-26T12:06:58.851 INFO:tasks.workunit.client.0.smithi052.stdout:0/877: dwrite d0/d1/f41 [4194304,4194304] 0 2024-04-26T12:06:58.852 INFO:tasks.workunit.client.0.smithi052.stdout:1/778: symlink d0/d2/dd/d40/l101 0 2024-04-26T12:06:58.853 INFO:tasks.workunit.client.0.smithi052.stdout:9/819: getdents d3/db 0 2024-04-26T12:06:58.853 INFO:tasks.workunit.client.0.smithi052.stdout:8/793: rename d0/d16/d63/f95 to d0/d16/f101 0 2024-04-26T12:06:58.853 INFO:tasks.workunit.client.0.smithi052.stdout:2/867: dread d0/d7/d2f/fb2 [4194304,4194304] 0 2024-04-26T12:06:58.853 INFO:tasks.workunit.client.0.smithi052.stdout:0/878: fsync d0/d1/d2c/d42/fbf 0 2024-04-26T12:06:58.854 INFO:tasks.workunit.client.0.smithi052.stdout:8/794: rmdir d0/d4/d1c 39 2024-04-26T12:06:58.854 INFO:tasks.workunit.client.0.smithi052.stdout:5/847: dwrite db/dc/d5f/d50/d46/d74/f103 [0,4194304] 0 2024-04-26T12:06:58.854 INFO:tasks.workunit.client.0.smithi052.stdout:2/868: chown d0/d7/d2f/d3d/ff7 871604 1 2024-04-26T12:06:58.856 INFO:tasks.workunit.client.0.smithi052.stdout:8/795: symlink d0/d4/dc/d68/l102 0 2024-04-26T12:06:58.856 INFO:tasks.workunit.client.0.smithi052.stdout:5/848: symlink db/dd/d34/l116 0 2024-04-26T12:06:58.856 INFO:tasks.workunit.client.0.smithi052.stdout:0/879: mknod d0/d26/d74/db4/de1/d115/c120 0 2024-04-26T12:06:58.856 INFO:tasks.workunit.client.0.smithi052.stdout:2/869: stat d0/d7/d2f/d9b/l6f 0 2024-04-26T12:06:58.857 INFO:tasks.workunit.client.0.smithi052.stdout:3/809: dread d2/d4/dc/d33/d8a/f9b [0,4194304] 0 2024-04-26T12:06:58.858 INFO:tasks.workunit.client.0.smithi052.stdout:5/849: dread - db/dc/d5f/d50/d46/d74/f8e zero size 2024-04-26T12:06:58.861 INFO:tasks.workunit.client.0.smithi052.stdout:5/850: stat db/dd/d34/d69/d93/d101/c113 0 2024-04-26T12:06:58.861 INFO:tasks.workunit.client.0.smithi052.stdout:9/820: dwrite d3/db/d13/f51 [8388608,4194304] 0 2024-04-26T12:06:58.865 INFO:tasks.workunit.client.0.smithi052.stdout:2/870: dwrite d0/f4 [0,4194304] 0 2024-04-26T12:06:58.866 INFO:tasks.workunit.client.0.smithi052.stdout:9/821: creat d3/d23/dd0/d11c/f123 x:0 0 0 2024-04-26T12:06:58.870 INFO:tasks.workunit.client.0.smithi052.stdout:9/822: creat d3/d3b/f124 x:0 0 0 2024-04-26T12:06:58.870 INFO:tasks.workunit.client.0.smithi052.stdout:3/810: dwrite d2/d4/d41/d59/f98 [0,4194304] 0 2024-04-26T12:06:58.870 INFO:tasks.workunit.client.0.smithi052.stdout:2/871: chown d0/d36/c7c 2015504 1 2024-04-26T12:06:58.871 INFO:tasks.workunit.client.0.smithi052.stdout:2/872: creat d0/d7/d2f/d8c/f11f x:0 0 0 2024-04-26T12:06:58.871 INFO:tasks.workunit.client.0.smithi052.stdout:5/851: dwrite db/dd/d34/d70/fca [0,4194304] 0 2024-04-26T12:06:58.871 INFO:tasks.workunit.client.0.smithi052.stdout:6/853: dread da/d22/d29/dd4/ddf/d92/fab [0,4194304] 0 2024-04-26T12:06:58.871 INFO:tasks.workunit.client.0.smithi052.stdout:0/880: dread d0/d26/d36/f98 [0,4194304] 0 2024-04-26T12:06:58.874 INFO:tasks.workunit.client.0.smithi052.stdout:2/873: unlink d0/d3f/d56/d6d/d5a/d73/fc7 0 2024-04-26T12:06:58.875 INFO:tasks.workunit.client.0.smithi052.stdout:0/881: mkdir d0/d26/d74/db4/d121 0 2024-04-26T12:06:58.878 INFO:tasks.workunit.client.0.smithi052.stdout:1/779: sync 2024-04-26T12:06:58.878 INFO:tasks.workunit.client.0.smithi052.stdout:2/874: creat d0/d3f/d56/d6d/f120 x:0 0 0 2024-04-26T12:06:58.878 INFO:tasks.workunit.client.0.smithi052.stdout:0/882: symlink d0/d3d/l122 0 2024-04-26T12:06:58.879 INFO:tasks.workunit.client.0.smithi052.stdout:3/811: dwrite d2/d4/d41/d5c/f92 [0,4194304] 0 2024-04-26T12:06:58.879 INFO:tasks.workunit.client.0.smithi052.stdout:6/854: dread da/d22/d29/dd4/ddf/d92/d96/fc8 [0,4194304] 0 2024-04-26T12:06:58.880 INFO:tasks.workunit.client.0.smithi052.stdout:4/817: dread d3/d15/f17 [0,4194304] 0 2024-04-26T12:06:58.880 INFO:tasks.workunit.client.0.smithi052.stdout:9/823: dwrite d3/d23/fec [0,4194304] 0 2024-04-26T12:06:58.882 INFO:tasks.workunit.client.0.smithi052.stdout:3/812: mknod d2/d4/d2a/dbf/cf4 0 2024-04-26T12:06:58.883 INFO:tasks.workunit.client.0.smithi052.stdout:5/852: dwrite db/dd/d34/d70/d78/fe0 [0,4194304] 0 2024-04-26T12:06:58.884 INFO:tasks.workunit.client.0.smithi052.stdout:6/855: rename da/l119 to da/d22/d29/d31/d39/dc7/d114/l132 0 2024-04-26T12:06:58.884 INFO:tasks.workunit.client.0.smithi052.stdout:0/883: read d0/d1/d1a/fe5 [74751,53400] 0 2024-04-26T12:06:58.885 INFO:tasks.workunit.client.0.smithi052.stdout:9/824: creat d3/db/d10/d2e/d5c/f125 x:0 0 0 2024-04-26T12:06:58.885 INFO:tasks.workunit.client.0.smithi052.stdout:3/813: chown d2/d4/d41/fdf 16980885 1 2024-04-26T12:06:58.886 INFO:tasks.workunit.client.0.smithi052.stdout:4/818: unlink d3/d12/d59/d96/dc0/ddd/dca/fea 0 2024-04-26T12:06:58.886 INFO:tasks.workunit.client.0.smithi052.stdout:3/814: chown d2/d4/dc 6 1 2024-04-26T12:06:58.887 INFO:tasks.workunit.client.0.smithi052.stdout:5/853: dread - db/dd/d34/d70/d59/ffb zero size 2024-04-26T12:06:58.887 INFO:tasks.workunit.client.0.smithi052.stdout:7/839: dread d1/d1c/f42 [0,4194304] 0 2024-04-26T12:06:58.887 INFO:tasks.workunit.client.0.smithi052.stdout:6/856: unlink da/d63/ld6 0 2024-04-26T12:06:58.887 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:06:58.888 INFO:tasks.workunit.client.0.smithi052.stdout:2/875: rename d0/d3f/d56/d6d/d5a/dd5 to d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/dd3/d121 0 2024-04-26T12:06:58.888 INFO:tasks.workunit.client.0.smithi052.stdout:8/796: dread d0/d4/d1c/f2c [0,4194304] 0 2024-04-26T12:06:58.891 INFO:tasks.workunit.client.0.smithi052.stdout:1/780: dread d0/d2/dd/d40/dc1/d1d/d91/fbb [0,4194304] 0 2024-04-26T12:06:58.891 INFO:tasks.workunit.client.0.smithi052.stdout:4/819: mknod d3/d12/d64/c116 0 2024-04-26T12:06:58.891 INFO:tasks.workunit.client.0.smithi052.stdout:0/884: rename d0/d26/d85 to d0/d1/d2c/d42/da5/dba/d123 0 2024-04-26T12:06:58.891 INFO:tasks.workunit.client.0.smithi052.stdout:5/854: write db/dd/d34/d70/f80 [2779262,67153] 0 2024-04-26T12:06:58.892 INFO:tasks.workunit.client.0.smithi052.stdout:0/885: unlink d0/d1/d52/f6b 0 2024-04-26T12:06:58.892 INFO:tasks.workunit.client.0.smithi052.stdout:8/797: truncate d0/f70 363937 0 2024-04-26T12:06:58.893 INFO:tasks.workunit.client.0.smithi052.stdout:4/820: chown d3/d12/d34/d45/f5e 15406021 1 2024-04-26T12:06:58.895 INFO:tasks.workunit.client.0.smithi052.stdout:9/825: read d3/db/f5b [4871722,46807] 0 2024-04-26T12:06:58.901 INFO:tasks.workunit.client.0.smithi052.stdout:7/840: dwrite d1/d1c/d21/f2e [0,4194304] 0 2024-04-26T12:06:58.902 INFO:tasks.workunit.client.0.smithi052.stdout:4/821: unlink d3/d12/d34/d45/f5e 0 2024-04-26T12:06:58.902 INFO:tasks.workunit.client.0.smithi052.stdout:9/826: unlink d3/db/d13/cc0 0 2024-04-26T12:06:58.903 INFO:tasks.workunit.client.0.smithi052.stdout:2/876: symlink d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/dd3/d121/d3a/l122 0 2024-04-26T12:06:58.903 INFO:tasks.workunit.client.0.smithi052.stdout:8/798: link d0/d16/d28/f9d d0/d4/d5/d86/d9c/db4/d75/f103 0 2024-04-26T12:06:58.906 INFO:tasks.workunit.client.0.smithi052.stdout:3/815: dwrite d2/d4/dc/d1d/d25/d61/fb3 [0,4194304] 0 2024-04-26T12:06:58.907 INFO:tasks.workunit.client.0.smithi052.stdout:5/855: dwrite db/dd/d18/d60/d64/d9c/da0/df1/f107 [0,4194304] 0 2024-04-26T12:06:58.907 INFO:tasks.workunit.client.0.smithi052.stdout:9/827: creat d3/db/d2b/ded/f126 x:0 0 0 2024-04-26T12:06:58.908 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:58.907+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:58.909 INFO:tasks.workunit.client.0.smithi052.stdout:8/799: chown d0/d4/d5/d27/d57/f88 0 1 2024-04-26T12:06:58.909 INFO:tasks.workunit.client.0.smithi052.stdout:0/886: dwrite d0/d5b/d9d/ff4 [0,4194304] 0 2024-04-26T12:06:58.911 INFO:tasks.workunit.client.0.smithi052.stdout:4/822: creat d3/d12/d34/d43/da1/f117 x:0 0 0 2024-04-26T12:06:58.913 INFO:tasks.workunit.client.0.smithi052.stdout:6/857: dread da/f12 [0,4194304] 0 2024-04-26T12:06:58.914 INFO:tasks.workunit.client.0.smithi052.stdout:9/828: mknod d3/d3b/d102/c127 0 2024-04-26T12:06:58.914 INFO:tasks.workunit.client.0.smithi052.stdout:4/823: chown d3/d2e/c38 26155 1 2024-04-26T12:06:58.915 INFO:tasks.workunit.client.0.smithi052.stdout:4/824: rmdir d3 39 2024-04-26T12:06:58.917 INFO:tasks.workunit.client.0.smithi052.stdout:5/856: chown db/dd/d18/d60/d64/d9c/da0/fc4 23178609 1 2024-04-26T12:06:58.917 INFO:tasks.workunit.client.0.smithi052.stdout:8/800: link d0/d3e/lc6 d0/d4/d5/daf/l104 0 2024-04-26T12:06:58.918 INFO:tasks.workunit.client.0.smithi052.stdout:7/841: dwrite d1/dab/d4c/f89 [0,4194304] 0 2024-04-26T12:06:58.918 INFO:tasks.workunit.client.0.smithi052.stdout:3/816: truncate d2/f29 1678679 0 2024-04-26T12:06:58.918 INFO:tasks.workunit.client.0.smithi052.stdout:9/829: symlink d3/d23/dd0/d11c/l128 0 2024-04-26T12:06:58.918 INFO:tasks.workunit.client.0.smithi052.stdout:4/825: rmdir d3/d12/d34/d43 39 2024-04-26T12:06:58.918 INFO:tasks.workunit.client.0.smithi052.stdout:2/877: dwrite d0/d7/d22/feb [0,4194304] 0 2024-04-26T12:06:58.919 INFO:tasks.workunit.client.0.smithi052.stdout:6/858: write da/d22/d29/dd4/df7/d87/fdc [184035,51570] 0 2024-04-26T12:06:58.922 INFO:tasks.workunit.client.0.smithi052.stdout:6/859: chown da/d22/d29/dd4/df7/d7e/fc5 15 1 2024-04-26T12:06:58.922 INFO:tasks.workunit.client.0.smithi052.stdout:4/826: mkdir d3/d44/d4b/db8/dde/d118 0 2024-04-26T12:06:58.924 INFO:tasks.workunit.client.0.smithi052.stdout:9/830: mknod d3/db/d52/dfa/c129 0 2024-04-26T12:06:58.925 INFO:tasks.workunit.client.0.smithi052.stdout:0/887: dread d0/d1/dd/fab [0,4194304] 0 2024-04-26T12:06:58.925 INFO:tasks.workunit.client.0.smithi052.stdout:4/827: creat d3/d1f/d21/f119 x:0 0 0 2024-04-26T12:06:58.925 INFO:tasks.workunit.client.0.smithi052.stdout:2/878: mkdir d0/d3f/d56/d6d/d5a/de4/d123 0 2024-04-26T12:06:58.928 INFO:tasks.workunit.client.0.smithi052.stdout:9/831: creat d3/db/d10/d3c/d40/df6/f12a x:0 0 0 2024-04-26T12:06:58.928 INFO:tasks.workunit.client.0.smithi052.stdout:6/860: rename da/d22/d29/dd4/ddf/lae to da/d22/d29/dd4/df7/d87/dfb/l133 0 2024-04-26T12:06:58.929 INFO:tasks.workunit.client.0.smithi052.stdout:1/781: dread d0/d2/dd/d40/dc1/d1d/d23/fa1 [4194304,4194304] 0 2024-04-26T12:06:58.929 INFO:tasks.workunit.client.0.smithi052.stdout:0/888: mknod d0/d26/dbe/c124 0 2024-04-26T12:06:58.929 INFO:tasks.workunit.client.0.smithi052.stdout:5/857: dwrite db/dd/d18/f102 [4194304,4194304] 0 2024-04-26T12:06:58.929 INFO:tasks.workunit.client.0.smithi052.stdout:2/879: fsync d0/d3f/d56/d6d/d5a/d73/d4b/f11c 0 2024-04-26T12:06:58.931 INFO:tasks.workunit.client.0.smithi052.stdout:9/832: symlink d3/db/d10/d3c/l12b 0 2024-04-26T12:06:58.932 INFO:tasks.workunit.client.0.smithi052.stdout:5/858: symlink db/dc/d5f/l117 0 2024-04-26T12:06:58.932 INFO:tasks.workunit.client.0.smithi052.stdout:1/782: dread - d0/d2/dd/d40/dc1/d1d/d23/f61 zero size 2024-04-26T12:06:58.932 INFO:tasks.workunit.client.0.smithi052.stdout:0/889: mknod d0/d5b/d9d/d32/c125 0 2024-04-26T12:06:58.933 INFO:tasks.workunit.client.0.smithi052.stdout:0/890: read - d0/d1/d1a/d20/d47/fb7 zero size 2024-04-26T12:06:58.934 INFO:tasks.workunit.client.0.smithi052.stdout:9/833: chown d3/db/d10/d3c/d40/d96/db5/d8f 1964 1 2024-04-26T12:06:58.934 INFO:tasks.workunit.client.0.smithi052.stdout:5/859: read db/dd/d18/d60/d64/d9c/da0/df1/f107 [3812777,52208] 0 2024-04-26T12:06:58.935 INFO:tasks.workunit.client.0.smithi052.stdout:2/880: link d0/d3f/d56/d6d/l4f d0/d3f/d56/d6d/d5a/ded/l124 0 2024-04-26T12:06:58.935 INFO:tasks.workunit.client.0.smithi052.stdout:3/817: truncate d2/d4/dc/d1d/d25/d61/fa8 1869110 0 2024-04-26T12:06:58.936 INFO:tasks.workunit.client.0.smithi052.stdout:5/860: creat db/d5c/f118 x:0 0 0 2024-04-26T12:06:58.936 INFO:tasks.workunit.client.0.smithi052.stdout:3/818: creat d2/d4/d2a/dbf/ff5 x:0 0 0 2024-04-26T12:06:58.937 INFO:tasks.workunit.client.0.smithi052.stdout:2/881: mkdir d0/d3f/d56/d6d/d5a/ded/d125 0 2024-04-26T12:06:58.938 INFO:tasks.workunit.client.0.smithi052.stdout:3/819: unlink d2/f2f 0 2024-04-26T12:06:58.938 INFO:tasks.workunit.client.0.smithi052.stdout:9/834: creat d3/db/d10/d3c/d40/d96/db5/d8f/ddc/f12c x:0 0 0 2024-04-26T12:06:58.939 INFO:tasks.workunit.client.0.smithi052.stdout:5/861: write db/dd/d34/d69/d8a/f8b [4235995,70003] 0 2024-04-26T12:06:58.940 INFO:tasks.workunit.client.0.smithi052.stdout:2/882: dread - d0/d3f/d56/d8d/d99/db9/f10c zero size 2024-04-26T12:06:58.941 INFO:tasks.workunit.client.0.smithi052.stdout:9/835: chown d3/db/d52/dfa/l105 0 1 2024-04-26T12:06:58.941 INFO:tasks.workunit.client.0.smithi052.stdout:0/891: dwrite d0/d1/dd/fa2 [0,4194304] 0 2024-04-26T12:06:58.943 INFO:tasks.workunit.client.0.smithi052.stdout:9/836: fdatasync d3/db/d4a/f78 0 2024-04-26T12:06:58.944 INFO:tasks.workunit.client.0.smithi052.stdout:3/820: rmdir d2/d4/dc/d1d/d25/d36/d1c/d4e/df0 0 2024-04-26T12:06:58.944 INFO:tasks.workunit.client.0.smithi052.stdout:5/862: creat db/dd/d34/d69/d8a/da9/f119 x:0 0 0 2024-04-26T12:06:58.945 INFO:tasks.workunit.client.0.smithi052.stdout:2/883: dread - d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/dd3/d121/d3a/f5e zero size 2024-04-26T12:06:58.946 INFO:tasks.workunit.client.0.smithi052.stdout:5/863: write f1 [4083463,116097] 0 2024-04-26T12:06:58.946 INFO:tasks.workunit.client.0.smithi052.stdout:8/801: dread d0/d4/f82 [0,4194304] 0 2024-04-26T12:06:58.946 INFO:tasks.workunit.client.0.smithi052.stdout:2/884: unlink d0/f33 0 2024-04-26T12:06:58.947 INFO:tasks.workunit.client.0.smithi052.stdout:8/802: chown d0/d4/d1c/fa9 3598601 1 2024-04-26T12:06:58.947 INFO:tasks.workunit.client.0.smithi052.stdout:3/821: write d2/d4/d41/d59/fb1 [4978126,85131] 0 2024-04-26T12:06:58.948 INFO:tasks.workunit.client.0.smithi052.stdout:5/864: fsync db/dd/d34/d69/d8a/da9/d87/fba 0 2024-04-26T12:06:58.948 INFO:tasks.workunit.client.0.smithi052.stdout:2/885: write d0/d7/d22/f84 [2725051,99307] 0 2024-04-26T12:06:58.951 INFO:tasks.workunit.client.0.smithi052.stdout:8/803: truncate d0/d4/d5/d3c/ff1 109575 0 2024-04-26T12:06:58.951 INFO:tasks.workunit.client.0.smithi052.stdout:1/783: dread d0/f20 [0,4194304] 0 2024-04-26T12:06:58.953 INFO:tasks.workunit.client.0.smithi052.stdout:8/804: write d0/f64 [521651,70859] 0 2024-04-26T12:06:58.953 INFO:tasks.workunit.client.0.smithi052.stdout:7/842: sync 2024-04-26T12:06:58.953 INFO:tasks.workunit.client.0.smithi052.stdout:9/837: dwrite d3/db/d13/f79 [0,4194304] 0 2024-04-26T12:06:58.957 INFO:tasks.workunit.client.0.smithi052.stdout:2/886: rename d0/d3f/d56/d6d/d5a/d82/d91/lc6 to d0/d3f/d56/d6d/d5a/d82/d91/l126 0 2024-04-26T12:06:58.957 INFO:tasks.workunit.client.0.smithi052.stdout:3/822: dwrite d2/d4/dc/d33/d37/fad [0,4194304] 0 2024-04-26T12:06:58.959 INFO:tasks.workunit.client.0.smithi052.stdout:9/838: rename d3/db/d52/dfa/c129 to d3/db/d10/d3c/d40/df6/c12d 0 2024-04-26T12:06:58.960 INFO:tasks.workunit.client.0.smithi052.stdout:5/865: dread db/dc/d5f/d50/d46/d74/f103 [0,4194304] 0 2024-04-26T12:06:58.960 INFO:tasks.workunit.client.0.smithi052.stdout:8/805: rename d0/d4/d5/d86/f93 to d0/d4/d5/db/f105 0 2024-04-26T12:06:58.961 INFO:tasks.workunit.client.0.smithi052.stdout:3/823: write d2/d4/d2a/f58 [4923291,36983] 0 2024-04-26T12:06:58.961 INFO:tasks.workunit.client.0.smithi052.stdout:2/887: fsync d0/d7/d2f/dee/ff6 0 2024-04-26T12:06:58.962 INFO:tasks.workunit.client.0.smithi052.stdout:9/839: write d3/d23/d7f/f2c [1933273,57892] 0 2024-04-26T12:06:58.963 INFO:tasks.workunit.client.0.smithi052.stdout:5/866: write db/dd/d18/d60/f83 [1810108,104563] 0 2024-04-26T12:06:58.963 INFO:tasks.workunit.client.0.smithi052.stdout:7/843: dread d1/d1f/d55/feb [0,4194304] 0 2024-04-26T12:06:58.964 INFO:tasks.workunit.client.0.smithi052.stdout:3/824: creat d2/d4/dc/d68/ff6 x:0 0 0 2024-04-26T12:06:58.965 INFO:tasks.workunit.client.0.smithi052.stdout:1/784: dwrite d0/d2/dd/d40/d81/d9a/da6/fc5 [0,4194304] 0 2024-04-26T12:06:58.965 INFO:tasks.workunit.client.0.smithi052.stdout:8/806: truncate d0/d4/d1c/d83/fb6 210755 0 2024-04-26T12:06:58.966 INFO:tasks.workunit.client.0.smithi052.stdout:9/840: mkdir d3/db/d10/d2e/d5c/d12e 0 2024-04-26T12:06:58.966 INFO:tasks.workunit.client.0.smithi052.stdout:3/825: chown d2/d4/d41/fb2 3974 1 2024-04-26T12:06:58.968 INFO:tasks.workunit.client.0.smithi052.stdout:7/844: write d1/d1c/d21/d2f/fa7 [2306063,71836] 0 2024-04-26T12:06:58.968 INFO:tasks.workunit.client.0.smithi052.stdout:8/807: unlink d0/d4/d1c/d83/cce 0 2024-04-26T12:06:58.969 INFO:tasks.workunit.client.0.smithi052.stdout:3/826: unlink d2/d4/d6b/dcf/de4/dc3/cce 0 2024-04-26T12:06:58.970 INFO:tasks.workunit.client.0.smithi052.stdout:4/828: sync 2024-04-26T12:06:58.970 INFO:tasks.workunit.client.0.smithi052.stdout:6/861: sync 2024-04-26T12:06:58.971 INFO:tasks.workunit.client.0.smithi052.stdout:3/827: fdatasync d2/d4/f64 0 2024-04-26T12:06:58.971 INFO:tasks.workunit.client.0.smithi052.stdout:7/845: mkdir d1/dab/d4c/d4d/d104 0 2024-04-26T12:06:58.972 INFO:tasks.workunit.client.0.smithi052.stdout:8/808: chown d0/d4/d5/d27/d57/d8a 3897 1 2024-04-26T12:06:58.972 INFO:tasks.workunit.client.0.smithi052.stdout:2/888: rename d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/dd3/d121/d4d/fff to d0/d7/f127 0 2024-04-26T12:06:58.972 INFO:tasks.workunit.client.0.smithi052.stdout:4/829: chown d3/d12/d59/d96/dc0/f74 64293887 1 2024-04-26T12:06:58.972 INFO:tasks.workunit.client.0.smithi052.stdout:5/867: dwrite db/d5c/fbc [0,4194304] 0 2024-04-26T12:06:58.975 INFO:tasks.workunit.client.0.smithi052.stdout:0/892: dread d0/d3d/f3f [4194304,4194304] 0 2024-04-26T12:06:58.975 INFO:tasks.workunit.client.0.smithi052.stdout:7/846: dread - d1/d1c/d21/d2f/ffa zero size 2024-04-26T12:06:58.975 INFO:tasks.workunit.client.0.smithi052.stdout:9/841: rename d3/db/d10/d2e/d5c/f8d to d3/d3b/dea/dfe/f12f 0 2024-04-26T12:06:58.975 INFO:tasks.workunit.client.0.smithi052.stdout:8/809: mknod d0/d4/d5/d86/c106 0 2024-04-26T12:06:58.976 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:58.976 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:58.978 INFO:tasks.workunit.client.0.smithi052.stdout:4/830: rmdir d3/d15/d53 39 2024-04-26T12:06:58.978 INFO:tasks.workunit.client.0.smithi052.stdout:2/889: creat d0/d3f/d56/d6d/d5a/de4/d123/f128 x:0 0 0 2024-04-26T12:06:58.978 INFO:tasks.workunit.client.0.smithi052.stdout:3/828: truncate d2/d4/dc/d1d/d25/d61/f93 3580024 0 2024-04-26T12:06:58.979 INFO:tasks.workunit.client.0.smithi052.stdout:9/842: mknod d3/d23/c130 0 2024-04-26T12:06:58.981 INFO:tasks.workunit.client.0.smithi052.stdout:8/810: creat d0/d4/d5/da3/f107 x:0 0 0 2024-04-26T12:06:58.982 INFO:tasks.workunit.client.0.smithi052.stdout:5/868: dread db/d5c/fbc [0,4194304] 0 2024-04-26T12:06:58.983 INFO:tasks.workunit.client.0.smithi052.stdout:2/890: chown d0/d7/c29 4874904 1 2024-04-26T12:06:58.984 INFO:tasks.workunit.client.0.smithi052.stdout:3/829: stat d2/d4/dc/d1d/d25/d36/d1c 0 2024-04-26T12:06:58.985 INFO:tasks.workunit.client.0.smithi052.stdout:6/862: dwrite da/d22/d29/f2e [0,4194304] 0 2024-04-26T12:06:58.986 INFO:tasks.workunit.client.0.smithi052.stdout:3/830: stat d2/d4/dc/d33/d37/f51 0 2024-04-26T12:06:58.988 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:06:58.988 INFO:tasks.workunit.client.0.smithi052.stdout:5/869: creat db/dd/d34/d69/d8a/f11a x:0 0 0 2024-04-26T12:06:58.988 INFO:tasks.workunit.client.0.smithi052.stdout:0/893: dwrite d0/f7a [0,4194304] 0 2024-04-26T12:06:58.989 INFO:tasks.workunit.client.0.smithi052.stdout:9/843: write d3/db/d10/d3c/d40/d96/db5/f8e [1122952,25904] 0 2024-04-26T12:06:58.989 INFO:tasks.workunit.client.0.smithi052.stdout:4/831: mknod d3/d12/d34/d45/d67/d6c/d86/c11a 0 2024-04-26T12:06:58.990 INFO:tasks.workunit.client.0.smithi052.stdout:8/811: rename d0/d16/l1d to d0/d4/d5/d86/d9c/db4/dd8/l108 0 2024-04-26T12:06:58.990 INFO:tasks.workunit.client.0.smithi052.stdout:7/847: dwrite d1/d1c/d21/d2f/d33/d3a/fee [0,4194304] 0 2024-04-26T12:06:58.990 INFO:tasks.workunit.client.0.smithi052.stdout:0/894: chown d0 1823484 1 2024-04-26T12:06:58.991 INFO:tasks.workunit.client.0.smithi052.stdout:5/870: creat db/dd/d18/d60/d64/d9c/da0/def/f11b x:0 0 0 2024-04-26T12:06:58.993 INFO:tasks.workunit.client.0.smithi052.stdout:4/832: dread - d3/d12/d34/d43/dc6/f107 zero size 2024-04-26T12:06:58.993 INFO:tasks.workunit.client.0.smithi052.stdout:3/831: rename d2/d4/d6b/dcf/de4/db7 to d2/d4/d6b/dcf/de4/db7/df7 22 2024-04-26T12:06:58.994 INFO:tasks.workunit.client.0.smithi052.stdout:1/785: dread d0/d2/dd/d40/dc1/f57 [0,4194304] 0 2024-04-26T12:06:58.994 INFO:tasks.workunit.client.0.smithi052.stdout:7/848: mkdir d1/d1c/d65/d105 0 2024-04-26T12:06:58.995 INFO:tasks.workunit.client.0.smithi052.stdout:9/844: truncate d3/db/d10/d54/f97 413302 0 2024-04-26T12:06:58.997 INFO:tasks.workunit.client.0.smithi052.stdout:6/863: link da/d22/d29/dd4/ddf/d92/d96/lb5 da/d22/d29/dd4/ddf/d95/l134 0 2024-04-26T12:06:58.997 INFO:tasks.workunit.client.0.smithi052.stdout:3/832: rmdir d2/d4/dc/d1d/d25/d61 39 2024-04-26T12:06:58.998 INFO:tasks.workunit.client.0.smithi052.stdout:1/786: mknod d0/d2/dd/d40/dc1/d1d/d23/c102 0 2024-04-26T12:06:58.998 INFO:tasks.workunit.client.0.smithi052.stdout:8/812: creat d0/d4/d5/d27/d57/dda/dfb/f109 x:0 0 0 2024-04-26T12:06:58.999 INFO:tasks.workunit.client.0.smithi052.stdout:7/849: write d1/d1c/fc5 [4741059,64451] 0 2024-04-26T12:06:58.999 INFO:tasks.workunit.client.0.smithi052.stdout:5/871: read db/dd/d34/d69/f89 [49819,63902] 0 2024-04-26T12:06:59.001 INFO:tasks.workunit.client.0.smithi052.stdout:6/864: write da/d22/d29/dd4/ddf/d95/fce [888596,97820] 0 2024-04-26T12:06:59.002 INFO:tasks.workunit.client.0.smithi052.stdout:8/813: symlink d0/l10a 0 2024-04-26T12:06:59.003 INFO:tasks.workunit.client.0.smithi052.stdout:2/891: dwrite d0/d7/d2f/fb3 [0,4194304] 0 2024-04-26T12:06:59.004 INFO:tasks.workunit.client.0.smithi052.stdout:7/850: write d1/d1c/d21/d2f/d33/d3a/d64/ff9 [633768,28775] 0 2024-04-26T12:06:59.005 INFO:tasks.workunit.client.0.smithi052.stdout:3/833: write d2/d4/dc/d1d/d25/f3b [1086998,34928] 0 2024-04-26T12:06:59.005 INFO:tasks.workunit.client.0.smithi052.stdout:0/895: dwrite d0/d26/d74/db4/fe8 [0,4194304] 0 2024-04-26T12:06:59.006 INFO:tasks.workunit.client.0.smithi052.stdout:8/814: mknod d0/d4/d5/d86/c10b 0 2024-04-26T12:06:59.006 INFO:tasks.workunit.client.0.smithi052.stdout:3/834: chown d2/dda 51583206 1 2024-04-26T12:06:59.007 INFO:tasks.workunit.client.0.smithi052.stdout:5/872: link db/dd/d34/d70/f80 db/d5c/dfe/f11c 0 2024-04-26T12:06:59.009 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:59.007+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:59.009 INFO:tasks.workunit.client.0.smithi052.stdout:6/865: truncate da/f1b 1380307 0 2024-04-26T12:06:59.009 INFO:tasks.workunit.client.0.smithi052.stdout:9/845: dwrite d3/db/d10/d3c/d40/d96/db5/f8b [0,4194304] 0 2024-04-26T12:06:59.009 INFO:tasks.workunit.client.0.smithi052.stdout:2/892: symlink d0/d3f/d56/d6d/d5a/d82/d91/l129 0 2024-04-26T12:06:59.010 INFO:tasks.workunit.client.0.smithi052.stdout:8/815: mknod d0/d4/d5/d27/d69/c10c 0 2024-04-26T12:06:59.010 INFO:tasks.workunit.client.0.smithi052.stdout:7/851: rmdir d1/d1c/d21/d2f/d33/d3a/d64 39 2024-04-26T12:06:59.010 INFO:tasks.workunit.client.0.smithi052.stdout:5/873: write db/dd/d34/fed [1832999,26667] 0 2024-04-26T12:06:59.010 INFO:tasks.workunit.client.0.smithi052.stdout:3/835: chown d2/d4/d81/cc4 404234 1 2024-04-26T12:06:59.011 INFO:tasks.workunit.client.0.smithi052.stdout:2/893: stat d0/d3f/d56/d6d/c103 0 2024-04-26T12:06:59.014 INFO:tasks.workunit.client.0.smithi052.stdout:9/846: link d3/d3b/fac d3/db/d10/d3c/f131 0 2024-04-26T12:06:59.014 INFO:tasks.workunit.client.0.smithi052.stdout:5/874: write db/dd/d18/d60/d64/d9c/fac [355644,15532] 0 2024-04-26T12:06:59.014 INFO:tasks.workunit.client.0.smithi052.stdout:8/816: stat d0/d4/d5/d86/d9c/db4/fac 0 2024-04-26T12:06:59.015 INFO:tasks.workunit.client.0.smithi052.stdout:2/894: chown d0/d3f/d56/d6d/d5a/d82/d91/l129 1130 1 2024-04-26T12:06:59.016 INFO:tasks.workunit.client.0.smithi052.stdout:0/896: dwrite d0/d1/f24 [0,4194304] 0 2024-04-26T12:06:59.016 INFO:tasks.workunit.client.0.smithi052.stdout:7/852: getdents d1/d1c/d21/d2f/d68 0 2024-04-26T12:06:59.016 INFO:tasks.workunit.client.0.smithi052.stdout:9/847: chown d3/d23/df0/l10d 5926556 1 2024-04-26T12:06:59.016 INFO:tasks.workunit.client.0.smithi052.stdout:8/817: creat d0/d4/d5/d27/f10d x:0 0 0 2024-04-26T12:06:59.017 INFO:tasks.workunit.client.0.smithi052.stdout:5/875: fdatasync db/dd/d18/d60/d64/d9c/fe9 0 2024-04-26T12:06:59.017 INFO:tasks.workunit.client.0.smithi052.stdout:0/897: creat d0/d5b/d9d/d4f/f126 x:0 0 0 2024-04-26T12:06:59.018 INFO:tasks.workunit.client.0.smithi052.stdout:7/853: write d1/d1f/ffd [950060,17531] 0 2024-04-26T12:06:59.018 INFO:tasks.workunit.client.0.smithi052.stdout:9/848: chown d3/d23/c113 11 1 2024-04-26T12:06:59.018 INFO:tasks.workunit.client.0.smithi052.stdout:0/898: readlink d0/d3d/le3 0 2024-04-26T12:06:59.018 INFO:tasks.workunit.client.0.smithi052.stdout:7/854: chown d1/dab/d4c/f57 60 1 2024-04-26T12:06:59.019 INFO:tasks.workunit.client.0.smithi052.stdout:0/899: symlink d0/d1/dd/l127 0 2024-04-26T12:06:59.019 INFO:tasks.workunit.client.0.smithi052.stdout:8/818: mknod d0/d4/d5/d27/d57/dda/dfb/c10e 0 2024-04-26T12:06:59.021 INFO:tasks.workunit.client.0.smithi052.stdout:7/855: chown d1/d1c/d23/d81/lf8 27 1 2024-04-26T12:06:59.021 INFO:tasks.workunit.client.0.smithi052.stdout:9/849: write d3/db/d10/d54/ffb [813680,86418] 0 2024-04-26T12:06:59.021 INFO:tasks.workunit.client.0.smithi052.stdout:0/900: write d0/d1/d1a/fe5 [4118559,104487] 0 2024-04-26T12:06:59.023 INFO:tasks.workunit.client.0.smithi052.stdout:9/850: dread - d3/db/d2b/dd4/dde/ff9 zero size 2024-04-26T12:06:59.025 INFO:tasks.workunit.client.0.smithi052.stdout:8/819: link d0/d4/d5/db/d20/c31 d0/d4/d5/dbf/c10f 0 2024-04-26T12:06:59.025 INFO:tasks.workunit.client.0.smithi052.stdout:0/901: truncate d0/d5b/d9d/d4f/f126 582257 0 2024-04-26T12:06:59.027 INFO:tasks.workunit.client.0.smithi052.stdout:9/851: fdatasync d3/db/d10/d3c/d40/d96/db5/d8f/ddc/ff1 0 2024-04-26T12:06:59.027 INFO:tasks.workunit.client.0.smithi052.stdout:5/876: dwrite db/dc/d5f/d50/d91/fa8 [0,4194304] 0 2024-04-26T12:06:59.029 INFO:tasks.workunit.client.0.smithi052.stdout:9/852: chown d3/db/d10/d2e/fe6 31 1 2024-04-26T12:06:59.032 INFO:tasks.workunit.client.0.smithi052.stdout:1/787: dread d0/d2/dd/d40/d81/d9a/dce/de9/d9b/fe1 [0,4194304] 0 2024-04-26T12:06:59.032 INFO:tasks.workunit.client.0.smithi052.stdout:7/856: dwrite d1/fa [0,4194304] 0 2024-04-26T12:06:59.033 INFO:tasks.workunit.client.0.smithi052.stdout:1/788: mknod d0/d2/dd/d40/dc1/c103 0 2024-04-26T12:06:59.033 INFO:tasks.workunit.client.0.smithi052.stdout:9/853: write d3/db/d10/d3c/d40/d96/da7/feb [5444443,11600] 0 2024-04-26T12:06:59.034 INFO:tasks.workunit.client.0.smithi052.stdout:1/789: mknod d0/d2/dd/d40/dc1/d1d/d91/c104 0 2024-04-26T12:06:59.037 INFO:tasks.workunit.client.0.smithi052.stdout:4/833: sync 2024-04-26T12:06:59.037 INFO:tasks.workunit.client.0.smithi052.stdout:2/895: sync 2024-04-26T12:06:59.037 INFO:tasks.workunit.client.0.smithi052.stdout:0/902: dwrite d0/d26/d36/f9e [0,4194304] 0 2024-04-26T12:06:59.037 INFO:tasks.workunit.client.0.smithi052.stdout:6/866: dread da/d22/d29/dd4/ddf/d7c/f7d [0,4194304] 0 2024-04-26T12:06:59.040 INFO:tasks.workunit.client.0.smithi052.stdout:8/820: dwrite d0/d4/d5/d27/d69/f9a [4194304,4194304] 0 2024-04-26T12:06:59.044 INFO:tasks.workunit.client.0.smithi052.stdout:8/821: creat d0/d4/d5/d27/f110 x:0 0 0 2024-04-26T12:06:59.044 INFO:tasks.workunit.client.0.smithi052.stdout:7/857: dwrite d1/d1c/d23/d81/f99 [0,4194304] 0 2024-04-26T12:06:59.044 INFO:tasks.workunit.client.0.smithi052.stdout:5/877: dwrite db/dd/d18/d60/d64/d9c/da0/fc4 [0,4194304] 0 2024-04-26T12:06:59.046 INFO:tasks.workunit.client.0.smithi052.stdout:6/867: dread da/d22/d29/dd4/ddf/d7c/d94/fa7 [0,4194304] 0 2024-04-26T12:06:59.046 INFO:tasks.workunit.client.0.smithi052.stdout:2/896: rename d0/d3f/d56/d6d/d5a/de4/d123 to d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/dd3/d121/d4d/d12a 0 2024-04-26T12:06:59.046 INFO:tasks.workunit.client.0.smithi052.stdout:7/858: fdatasync d1/d1f/d55/fbc 0 2024-04-26T12:06:59.046 INFO:tasks.workunit.client.0.smithi052.stdout:8/822: fsync d0/d4/d5/d27/fb9 0 2024-04-26T12:06:59.047 INFO:tasks.workunit.client.0.smithi052.stdout:4/834: truncate d3/d12/d34/d43/f5d 765791 0 2024-04-26T12:06:59.047 INFO:tasks.workunit.client.0.smithi052.stdout:1/790: dwrite d0/d2/dd/d40/d81/fd6 [0,4194304] 0 2024-04-26T12:06:59.049 INFO:tasks.workunit.client.0.smithi052.stdout:3/836: sync 2024-04-26T12:06:59.049 INFO:tasks.workunit.client.0.smithi052.stdout:6/868: stat da/d22/d29/dd4/df7/dcf/cf0 0 2024-04-26T12:06:59.049 INFO:tasks.workunit.client.0.smithi052.stdout:0/903: sync 2024-04-26T12:06:59.049 INFO:tasks.workunit.client.0.smithi052.stdout:7/859: symlink d1/d1c/d65/l106 0 2024-04-26T12:06:59.050 INFO:tasks.workunit.client.0.smithi052.stdout:7/860: fsync d1/f10 0 2024-04-26T12:06:59.050 INFO:tasks.workunit.client.0.smithi052.stdout:0/904: stat d0/d1/dd/c9b 0 2024-04-26T12:06:59.050 INFO:tasks.workunit.client.0.smithi052.stdout:5/878: creat db/dd/d18/dda/f11d x:0 0 0 2024-04-26T12:06:59.051 INFO:tasks.workunit.client.0.smithi052.stdout:8/823: symlink d0/d4/d5/d86/d9c/l111 0 2024-04-26T12:06:59.051 INFO:tasks.workunit.client.0.smithi052.stdout:2/897: creat d0/d3f/d56/d6d/d5a/d73/d4b/d9c/f12b x:0 0 0 2024-04-26T12:06:59.052 INFO:tasks.workunit.client.0.smithi052.stdout:6/869: chown da/d22/d29/dd4/ddf/d95/df8/d68/lc9 3593678 1 2024-04-26T12:06:59.056 INFO:tasks.workunit.client.0.smithi052.stdout:7/861: rename d1/f16 to d1/d1c/dd3/f107 0 2024-04-26T12:06:59.056 INFO:tasks.workunit.client.0.smithi052.stdout:1/791: getdents d0/da 0 2024-04-26T12:06:59.062 INFO:tasks.workunit.client.0.smithi052.stdout:6/870: creat da/d22/d29/dd4/ddf/d92/d96/f135 x:0 0 0 2024-04-26T12:06:59.062 INFO:tasks.workunit.client.0.smithi052.stdout:2/898: write d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/dd3/d121/f30 [1118916,130767] 0 2024-04-26T12:06:59.062 INFO:tasks.workunit.client.0.smithi052.stdout:5/879: rename db/dd/d34/d69/d8a/dc5 to db/dd/d34/d69/d8a/da9/d87/d6e/db8/d11e 0 2024-04-26T12:06:59.062 INFO:tasks.workunit.client.0.smithi052.stdout:4/835: dwrite d3/d12/d59/f82 [0,4194304] 0 2024-04-26T12:06:59.062 INFO:tasks.workunit.client.0.smithi052.stdout:7/862: mkdir d1/d1c/d23/d81/d88/d108 0 2024-04-26T12:06:59.063 INFO:tasks.workunit.client.0.smithi052.stdout:9/854: dread d3/db/d13/ffc [0,4194304] 0 2024-04-26T12:06:59.064 INFO:tasks.workunit.client.0.smithi052.stdout:3/837: dwrite d2/d4/d2a/dbf/db0/d6a/f5f [0,4194304] 0 2024-04-26T12:06:59.066 INFO:tasks.workunit.client.0.smithi052.stdout:8/824: dwrite d0/d4/fba [0,4194304] 0 2024-04-26T12:06:59.066 INFO:tasks.workunit.client.0.smithi052.stdout:4/836: mknod d3/c11b 0 2024-04-26T12:06:59.067 INFO:tasks.workunit.client.0.smithi052.stdout:5/880: chown db/dd/d34/d69/d8a/da9/l110 4973 1 2024-04-26T12:06:59.067 INFO:tasks.workunit.client.0.smithi052.stdout:0/905: dwrite d0/d1/d11/f69 [0,4194304] 0 2024-04-26T12:06:59.067 INFO:tasks.workunit.client.0.smithi052.stdout:1/792: mkdir d0/d83/d4b/db2/d105 0 2024-04-26T12:06:59.067 INFO:tasks.workunit.client.0.smithi052.stdout:7/863: write d1/d1c/d21/f73 [1853911,16602] 0 2024-04-26T12:06:59.068 INFO:tasks.workunit.client.0.smithi052.stdout:2/899: fdatasync d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/dd3/d121/f40 0 2024-04-26T12:06:59.068 INFO:tasks.workunit.client.0.smithi052.stdout:9/855: chown d3/d23/d7f/fa1 14688 1 2024-04-26T12:06:59.069 INFO:tasks.workunit.client.0.smithi052.stdout:7/864: rmdir d1/dab/d4c 39 2024-04-26T12:06:59.070 INFO:tasks.workunit.client.0.smithi052.stdout:0/906: chown d0/d5b/d9d/ff4 6141246 1 2024-04-26T12:06:59.075 INFO:tasks.workunit.client.0.smithi052.stdout:3/838: rename d2/d4/d2a/d96/fd7 to d2/d4/d6b/ff8 0 2024-04-26T12:06:59.075 INFO:tasks.workunit.client.0.smithi052.stdout:1/793: creat d0/d2/dd/d40/dc1/d1d/d91/f106 x:0 0 0 2024-04-26T12:06:59.075 INFO:tasks.workunit.client.0.smithi052.stdout:0/907: chown d0/d1/d2c/d42/da5/dba 26 1 2024-04-26T12:06:59.075 INFO:tasks.workunit.client.0.smithi052.stdout:3/839: write d2/d4/d41/db5/fc0 [543717,78787] 0 2024-04-26T12:06:59.075 INFO:tasks.workunit.client.0.smithi052.stdout:2/900: rename d0/d7/d22/f23 to d0/d3f/d56/d6d/d5a/f12c 0 2024-04-26T12:06:59.076 INFO:tasks.workunit.client.0.smithi052.stdout:7/865: rename d1/d1c/d21/d2f/c63 to d1/d1c/d21/d2f/d33/dc7/c109 0 2024-04-26T12:06:59.078 INFO:tasks.workunit.client.0.smithi052.stdout:1/794: rename d0/d2/cb6 to d0/d2/dd/d40/d81/d9a/da6/dc4/dec/c107 0 2024-04-26T12:06:59.079 INFO:tasks.workunit.client.0.smithi052.stdout:5/881: dwrite db/dc/d5f/d50/d91/fe6 [0,4194304] 0 2024-04-26T12:06:59.081 INFO:tasks.workunit.client.0.smithi052.stdout:2/901: write d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/dd3/d121/f1e [3650202,4657] 0 2024-04-26T12:06:59.083 INFO:tasks.workunit.client.0.smithi052.stdout:9/856: dwrite d3/db/d10/d3c/d40/d96/db5/f8b [4194304,4194304] 0 2024-04-26T12:06:59.083 INFO:tasks.workunit.client.0.smithi052.stdout:7/866: rename d1/d1c/d65/d105 to d1/d1c/d21/d2f/d68/d10a 0 2024-04-26T12:06:59.084 INFO:tasks.workunit.client.0.smithi052.stdout:9/857: stat d3/d3b/dfd 0 2024-04-26T12:06:59.085 INFO:tasks.workunit.client.0.smithi052.stdout:7/867: write d1/f9f [7051079,75993] 0 2024-04-26T12:06:59.085 INFO:tasks.workunit.client.0.smithi052.stdout:0/908: dwrite d0/d5b/d9d/fc1 [0,4194304] 0 2024-04-26T12:06:59.085 INFO:tasks.workunit.client.0.smithi052.stdout:5/882: rename db/dd/d18/d60/d64/c39 to db/dd/d18/d60/d64/d9c/da0/c11f 0 2024-04-26T12:06:59.086 INFO:tasks.workunit.client.0.smithi052.stdout:7/868: symlink d1/dab/l10b 0 2024-04-26T12:06:59.086 INFO:tasks.workunit.client.0.smithi052.stdout:5/883: fdatasync db/dd/d18/dda/f11d 0 2024-04-26T12:06:59.086 INFO:tasks.workunit.client.0.smithi052.stdout:0/909: mkdir d0/d1/d2c/d42/d128 0 2024-04-26T12:06:59.087 INFO:tasks.workunit.client.0.smithi052.stdout:9/858: rename d3/db/d10/d54/f97 to d3/db/d10/d2e/f132 0 2024-04-26T12:06:59.087 INFO:tasks.workunit.client.0.smithi052.stdout:7/869: mkdir d1/d1c/d10c 0 2024-04-26T12:06:59.088 INFO:tasks.workunit.client.0.smithi052.stdout:0/910: mkdir d0/d5b/d9d/d4f/de7/d129 0 2024-04-26T12:06:59.088 INFO:tasks.workunit.client.0.smithi052.stdout:7/870: chown d1/db7 26029738 1 2024-04-26T12:06:59.089 INFO:tasks.workunit.client.0.smithi052.stdout:0/911: readlink d0/d5a/lbd 0 2024-04-26T12:06:59.089 INFO:tasks.workunit.client.0.smithi052.stdout:5/884: symlink db/dd/d34/d69/d8a/da9/d87/l120 0 2024-04-26T12:06:59.089 INFO:tasks.workunit.client.0.smithi052.stdout:9/859: mkdir d3/db/d10/d3c/d40/d96/db5/da3/d133 0 2024-04-26T12:06:59.091 INFO:tasks.workunit.client.0.smithi052.stdout:9/860: read - d3/d3b/fef zero size 2024-04-26T12:06:59.092 INFO:tasks.workunit.client.0.smithi052.stdout:7/871: link d1/dab/d4c/dd6/fe1 d1/db7/f10d 0 2024-04-26T12:06:59.092 INFO:tasks.workunit.client.0.smithi052.stdout:6/871: dread da/d22/d29/dd4/ddf/d95/df8/d68/f86 [0,4194304] 0 2024-04-26T12:06:59.093 INFO:tasks.workunit.client.0.smithi052.stdout:9/861: write d3/db/d10/d2e/f71 [3075732,128634] 0 2024-04-26T12:06:59.093 INFO:tasks.workunit.client.0.smithi052.stdout:5/885: dread - db/dd/d34/d69/d8a/da9/d87/d6e/db8/d11e/ff3 zero size 2024-04-26T12:06:59.093 INFO:tasks.workunit.client.0.smithi052.stdout:0/912: truncate d0/d1/d1a/d20/d47/d84/fbc 732035 0 2024-04-26T12:06:59.093 INFO:tasks.workunit.client.0.smithi052.stdout:6/872: unlink da/d22/d97/c105 0 2024-04-26T12:06:59.094 INFO:tasks.workunit.client.0.smithi052.stdout:7/872: symlink d1/d1c/d21/d2f/d33/d3a/d64/l10e 0 2024-04-26T12:06:59.094 INFO:tasks.workunit.client.0.smithi052.stdout:0/913: unlink d0/d1/d1a/d20/d47/d84/fbc 0 2024-04-26T12:06:59.096 INFO:tasks.workunit.client.0.smithi052.stdout:7/873: link d1/c3b d1/d1c/d10c/c10f 0 2024-04-26T12:06:59.096 INFO:tasks.workunit.client.0.smithi052.stdout:0/914: creat d0/d5b/d9d/d4f/da4/da9/f12a x:0 0 0 2024-04-26T12:06:59.098 INFO:tasks.workunit.client.0.smithi052.stdout:7/874: creat d1/d1f/d55/dcb/f110 x:0 0 0 2024-04-26T12:06:59.099 INFO:tasks.workunit.client.0.smithi052.stdout:5/886: dread db/dd/d34/d69/d93/f5d [0,4194304] 0 2024-04-26T12:06:59.099 INFO:tasks.workunit.client.0.smithi052.stdout:9/862: truncate d3/f99 1407051 0 2024-04-26T12:06:59.101 INFO:tasks.workunit.client.0.smithi052.stdout:5/887: mkdir db/dd/d121 0 2024-04-26T12:06:59.102 INFO:tasks.workunit.client.0.smithi052.stdout:9/863: write d3/db/d2b/ded/f114 [973953,105929] 0 2024-04-26T12:06:59.102 INFO:tasks.workunit.client.0.smithi052.stdout:0/915: dread d0/fe6 [0,4194304] 0 2024-04-26T12:06:59.102 INFO:tasks.workunit.client.0.smithi052.stdout:5/888: truncate db/d5c/f118 810335 0 2024-04-26T12:06:59.102 INFO:tasks.workunit.client.0.smithi052.stdout:9/864: unlink d3/db/d10/d54/l59 0 2024-04-26T12:06:59.103 INFO:tasks.workunit.client.0.smithi052.stdout:0/916: fdatasync d0/d1/d11/fcd 0 2024-04-26T12:06:59.103 INFO:tasks.workunit.client.0.smithi052.stdout:7/875: truncate d1/d1c/d21/f53 2253212 0 2024-04-26T12:06:59.104 INFO:tasks.workunit.client.0.smithi052.stdout:5/889: unlink db/dd/d34/d70/d59/lc2 0 2024-04-26T12:06:59.104 INFO:tasks.workunit.client.0.smithi052.stdout:0/917: write d0/d1/d52/fea [1087794,86496] 0 2024-04-26T12:06:59.104 INFO:tasks.workunit.client.0.smithi052.stdout:9/865: mkdir d3/db/d10/d2e/d134 0 2024-04-26T12:06:59.105 INFO:tasks.workunit.client.0.smithi052.stdout:5/890: fsync db/dd/d34/d69/fa6 0 2024-04-26T12:06:59.105 INFO:tasks.workunit.client.0.smithi052.stdout:7/876: read d1/f12 [451841,116921] 0 2024-04-26T12:06:59.106 INFO:tasks.workunit.client.0.smithi052.stdout:0/918: read d0/d26/d36/f8e [180307,49759] 0 2024-04-26T12:06:59.107 INFO:tasks.workunit.client.0.smithi052.stdout:7/877: chown d1/d1c/d23/dd8/dfe 92 1 2024-04-26T12:06:59.107 INFO:tasks.workunit.client.0.smithi052.stdout:3/840: dread d2/d4/f3e [0,4194304] 0 2024-04-26T12:06:59.108 INFO:tasks.workunit.client.0.smithi052.stdout:7/878: chown d1/d1f/ffd 7527403 1 2024-04-26T12:06:59.108 INFO:tasks.workunit.client.0.smithi052.stdout:0/919: creat d0/f12b x:0 0 0 2024-04-26T12:06:59.109 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:59.107+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:59.109 INFO:tasks.workunit.client.0.smithi052.stdout:1/795: dread d0/d2/d88/fb4 [0,4194304] 0 2024-04-26T12:06:59.109 INFO:tasks.workunit.client.0.smithi052.stdout:9/866: truncate d3/db/d10/d3c/fa5 600673 0 2024-04-26T12:06:59.109 INFO:tasks.workunit.client.0.smithi052.stdout:5/891: link db/dc/d5f/d50/c4d db/dd/d18/dda/c122 0 2024-04-26T12:06:59.109 INFO:tasks.workunit.client.0.smithi052.stdout:3/841: readlink d2/d4/d2a/dbf/le5 0 2024-04-26T12:06:59.110 INFO:tasks.workunit.client.0.smithi052.stdout:7/879: creat d1/d1c/d23/d81/f111 x:0 0 0 2024-04-26T12:06:59.110 INFO:tasks.workunit.client.0.smithi052.stdout:1/796: dread - d0/d2/dd/d40/dc1/d1d/d91/f106 zero size 2024-04-26T12:06:59.112 INFO:tasks.workunit.client.0.smithi052.stdout:3/842: write d2/d4/dc/d1d/d25/d61/fb3 [4615470,3568] 0 2024-04-26T12:06:59.113 INFO:tasks.workunit.client.0.smithi052.stdout:1/797: unlink d0/d2/dd/cc6 0 2024-04-26T12:06:59.114 INFO:tasks.workunit.client.0.smithi052.stdout:3/843: mkdir d2/d4/d2a/d2d/df9 0 2024-04-26T12:06:59.115 INFO:tasks.workunit.client.0.smithi052.stdout:1/798: symlink d0/d2/dd/d40/dc1/d1d/d91/l108 0 2024-04-26T12:06:59.115 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:06:59.115 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:06:59.116 INFO:tasks.workunit.client.0.smithi052.stdout:3/844: mkdir d2/d4/dc/d33/d75/dfa 0 2024-04-26T12:06:59.116 INFO:tasks.workunit.client.0.smithi052.stdout:0/920: dwrite d0/d3d/f3f [0,4194304] 0 2024-04-26T12:06:59.117 INFO:tasks.workunit.client.0.smithi052.stdout:1/799: chown d0/d2/dd/d40/d81/d9a/dce/de9/d9b 0 1 2024-04-26T12:06:59.117 INFO:tasks.workunit.client.0.smithi052.stdout:9/867: dwrite d3/d3b/dea/dfe/f111 [0,4194304] 0 2024-04-26T12:06:59.117 INFO:tasks.workunit.client.0.smithi052.stdout:0/921: chown d0/d1/dd/l127 0 1 2024-04-26T12:06:59.119 INFO:tasks.workunit.client.0.smithi052.stdout:0/922: symlink d0/d1/d2c/l12c 0 2024-04-26T12:06:59.119 INFO:tasks.workunit.client.0.smithi052.stdout:9/868: link d3/db/d13/f79 d3/d3b/d102/f135 0 2024-04-26T12:06:59.119 INFO:tasks.workunit.client.0.smithi052.stdout:1/800: creat d0/d2/dd/d40/d81/d9a/da6/dc4/dec/f109 x:0 0 0 2024-04-26T12:06:59.119 INFO:tasks.workunit.client.0.smithi052.stdout:9/869: stat d3/db/d2b/ded/f114 0 2024-04-26T12:06:59.120 INFO:tasks.workunit.client.0.smithi052.stdout:0/923: rmdir d0/d5b/d9d/d4f/da4 39 2024-04-26T12:06:59.120 INFO:tasks.workunit.client.0.smithi052.stdout:4/837: sync 2024-04-26T12:06:59.120 INFO:tasks.workunit.client.0.smithi052.stdout:8/825: sync 2024-04-26T12:06:59.121 INFO:tasks.workunit.client.0.smithi052.stdout:1/801: fsync d0/d2/dd/d40/dc1/f82 0 2024-04-26T12:06:59.121 INFO:tasks.workunit.client.0.smithi052.stdout:0/924: rmdir d0/d5b/d9d 39 2024-04-26T12:06:59.121 INFO:tasks.workunit.client.0.smithi052.stdout:9/870: mkdir d3/d3b/d102/d122/d136 0 2024-04-26T12:06:59.121 INFO:tasks.workunit.client.0.smithi052.stdout:8/826: mknod d0/d4/d5/db/d20/d41/c112 0 2024-04-26T12:06:59.122 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:06:59.123 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:06:59.123 INFO:tasks.workunit.client.0.smithi052.stdout:0/925: unlink d0/d3d/dd2/l10e 0 2024-04-26T12:06:59.123 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:06:59.124 INFO:tasks.workunit.client.0.smithi052.stdout:0/926: write d0/d5b/fd0 [1067051,10266] 0 2024-04-26T12:06:59.124 INFO:tasks.workunit.client.0.smithi052.stdout:8/827: truncate d0/d4/d5/db/f96 4269341 0 2024-04-26T12:06:59.125 INFO:tasks.workunit.client.0.smithi052.stdout:9/871: link d3/db/d10/d3c/d40/d96/db5/d8f/c109 d3/d3b/dea/c137 0 2024-04-26T12:06:59.127 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:06:59.128 INFO:tasks.workunit.client.0.smithi052.stdout:0/927: rename d0/d5b/d103 to d0/d1/dd/d12d 0 2024-04-26T12:06:59.128 INFO:tasks.workunit.client.0.smithi052.stdout:4/838: dwrite d3/d12/d59/faa [0,4194304] 0 2024-04-26T12:06:59.128 INFO:tasks.workunit.client.0.smithi052.stdout:8/828: dread - d0/d4/d5/d86/d9c/db4/fe6 zero size 2024-04-26T12:06:59.128 INFO:tasks.workunit.client.0.smithi052.stdout:7/880: dread d1/fb [0,4194304] 0 2024-04-26T12:06:59.128 INFO:tasks.workunit.client.0.smithi052.stdout:9/872: rename d3/f7 to d3/d23/dd0/f138 0 2024-04-26T12:06:59.129 INFO:tasks.workunit.client.0.smithi052.stdout:3/845: read d2/d4/dc/d1d/d25/d61/fb3 [4597538,43454] 0 2024-04-26T12:06:59.129 INFO:tasks.workunit.client.0.smithi052.stdout:0/928: chown d0/d1/d2c/d42/da5/ce0 969772 1 2024-04-26T12:06:59.129 INFO:tasks.workunit.client.0.smithi052.stdout:7/881: chown d1/c7a 2636614 1 2024-04-26T12:06:59.129 INFO:tasks.workunit.client.0.smithi052.stdout:9/873: mknod d3/c139 0 2024-04-26T12:06:59.130 INFO:tasks.workunit.client.0.smithi052.stdout:4/839: creat d3/d12/d34/d45/f11c x:0 0 0 2024-04-26T12:06:59.130 INFO:tasks.workunit.client.0.smithi052.stdout:9/874: chown d3/d23/d7f/ccd 207705 1 2024-04-26T12:06:59.131 INFO:tasks.workunit.client.0.smithi052.stdout:9/875: dread - d3/d3b/fb7 zero size 2024-04-26T12:06:59.131 INFO:tasks.workunit.client.0.smithi052.stdout:7/882: mkdir d1/d1c/d23/d81/d88/d108/d112 0 2024-04-26T12:06:59.131 INFO:tasks.workunit.client.0.smithi052.stdout:8/829: rename d0/d4/d5/d27/d69/fb1 to d0/d4/d5/d86/d9c/db4/d58/d89/f113 0 2024-04-26T12:06:59.131 INFO:tasks.workunit.client.0.smithi052.stdout:0/929: mkdir d0/d5b/d9d/d4f/da4/da9/d12e 0 2024-04-26T12:06:59.131 INFO:tasks.workunit.client.0.smithi052.stdout:4/840: creat d3/d44/d4b/db8/f11d x:0 0 0 2024-04-26T12:06:59.132 INFO:tasks.workunit.client.0.smithi052.stdout:9/876: symlink d3/db/d2b/dd4/l13a 0 2024-04-26T12:06:59.132 INFO:tasks.workunit.client.0.smithi052.stdout:0/930: fdatasync d0/d3d/dd2/fdb 0 2024-04-26T12:06:59.133 INFO:tasks.workunit.client.0.smithi052.stdout:8/830: mknod d0/d4/d5/c114 0 2024-04-26T12:06:59.133 INFO:tasks.workunit.client.0.smithi052.stdout:1/802: dread d0/d83/d4b/d56/f9d [0,4194304] 0 2024-04-26T12:06:59.134 INFO:tasks.workunit.client.0.smithi052.stdout:0/931: chown d0/d3c/c65 0 1 2024-04-26T12:06:59.134 INFO:tasks.workunit.client.0.smithi052.stdout:8/831: dread - d0/d4/d5/d27/fea zero size 2024-04-26T12:06:59.134 INFO:tasks.workunit.client.0.smithi052.stdout:1/803: chown d0/d2/c21 115325995 1 2024-04-26T12:06:59.135 INFO:tasks.workunit.client.0.smithi052.stdout:4/841: write d3/d2b/d40/fe6 [3445892,124502] 0 2024-04-26T12:06:59.135 INFO:tasks.workunit.client.0.smithi052.stdout:3/846: dwrite d2/d4/dc/d1d/d25/d36/f86 [0,4194304] 0 2024-04-26T12:06:59.137 INFO:tasks.workunit.client.0.smithi052.stdout:0/932: symlink d0/d1/d2c/d42/da5/dba/d123/l12f 0 2024-04-26T12:06:59.137 INFO:tasks.workunit.client.0.smithi052.stdout:7/883: write d1/d1c/d21/d2f/d68/fa0 [1308642,40811] 0 2024-04-26T12:06:59.139 INFO:tasks.workunit.client.0.smithi052.stdout:9/877: getdents d3/db/d10/d3c/d40/d96/db5/da3 0 2024-04-26T12:06:59.140 INFO:tasks.workunit.client.0.smithi052.stdout:8/832: symlink d0/d4/d5/d86/d9c/db4/d58/d8f/l115 0 2024-04-26T12:06:59.140 INFO:tasks.workunit.client.0.smithi052.stdout:1/804: creat d0/d2/dd/d40/d81/d9a/dce/de9/f10a x:0 0 0 2024-04-26T12:06:59.140 INFO:tasks.workunit.client.0.smithi052.stdout:0/933: write d0/d1/d2c/d42/fbf [3268755,74075] 0 2024-04-26T12:06:59.140 INFO:tasks.workunit.client.0.smithi052.stdout:5/892: dread db/dc/d5f/d50/d46/f79 [0,4194304] 0 2024-04-26T12:06:59.140 INFO:tasks.workunit.client.0.smithi052.stdout:7/884: stat d1/dab/d4c/f4f 0 2024-04-26T12:06:59.142 INFO:tasks.workunit.client.0.smithi052.stdout:4/842: dread d3/d22/d30/f42 [0,4194304] 0 2024-04-26T12:06:59.142 INFO:tasks.workunit.client.0.smithi052.stdout:8/833: stat d0/d4/d5/d86/d9c/db4/d75/f103 0 2024-04-26T12:06:59.143 INFO:tasks.workunit.client.0.smithi052.stdout:0/934: readlink d0/d1/d1a/d20/lf2 0 2024-04-26T12:06:59.143 INFO:tasks.workunit.client.0.smithi052.stdout:7/885: creat d1/d1c/dd3/f113 x:0 0 0 2024-04-26T12:06:59.143 INFO:tasks.workunit.client.0.smithi052.stdout:1/805: write d0/d2/dd/d40/dc1/d1d/f50 [1852177,130281] 0 2024-04-26T12:06:59.144 INFO:tasks.workunit.client.0.smithi052.stdout:3/847: dwrite d2/d4/f64 [0,4194304] 0 2024-04-26T12:06:59.145 INFO:tasks.workunit.client.0.smithi052.stdout:4/843: creat d3/d12/d59/d96/dc0/ddd/f11e x:0 0 0 2024-04-26T12:06:59.146 INFO:tasks.workunit.client.0.smithi052.stdout:3/848: chown d2/d4/dc/d33/d8a/f9b 13077156 1 2024-04-26T12:06:59.146 INFO:tasks.workunit.client.0.smithi052.stdout:7/886: read d1/d1c/d21/f67 [2715440,116735] 0 2024-04-26T12:06:59.147 INFO:tasks.workunit.client.0.smithi052.stdout:0/935: rename d0/d26/d36/f92 to d0/d1/d114/f130 0 2024-04-26T12:06:59.147 INFO:tasks.workunit.client.0.smithi052.stdout:4/844: write d3/d15/d76/f114 [1043623,51990] 0 2024-04-26T12:06:59.148 INFO:tasks.workunit.client.0.smithi052.stdout:1/806: rename d0/d2/dd/d40/dac to d0/d2/dd/d34/d95/d10b 0 2024-04-26T12:06:59.148 INFO:tasks.workunit.client.0.smithi052.stdout:3/849: creat d2/d4/d2a/d96/ffb x:0 0 0 2024-04-26T12:06:59.148 INFO:tasks.workunit.client.0.smithi052.stdout:4/845: mkdir d3/d15/d11f 0 2024-04-26T12:06:59.149 INFO:tasks.workunit.client.0.smithi052.stdout:1/807: unlink d0/da/f19 0 2024-04-26T12:06:59.150 INFO:tasks.workunit.client.0.smithi052.stdout:8/834: read d0/d4/d5/d86/d9c/db4/d58/d8f/f91 [2122908,58434] 0 2024-04-26T12:06:59.152 INFO:tasks.workunit.client.0.smithi052.stdout:1/808: symlink d0/d83/d4b/db2/l10c 0 2024-04-26T12:06:59.153 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:06:59.153 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:06:59.153 INFO:tasks.workunit.client.0.smithi052.stdout:2/902: sync 2024-04-26T12:06:59.154 INFO:tasks.workunit.client.0.smithi052.stdout:6/873: sync 2024-04-26T12:06:59.154 INFO:tasks.workunit.client.0.smithi052.stdout:5/893: dwrite db/dd/d34/d69/d8a/da9/d87/d6e/fbd [0,4194304] 0 2024-04-26T12:06:59.154 INFO:tasks.workunit.client.0.smithi052.stdout:4/846: getdents d3/d44/d4b/db8/dde/d118 0 2024-04-26T12:06:59.154 INFO:tasks.workunit.client.0.smithi052.stdout:8/835: mknod d0/d4/d5/d86/d9c/db4/dd8/c116 0 2024-04-26T12:06:59.155 INFO:tasks.workunit.client.0.smithi052.stdout:8/836: fdatasync d0/f70 0 2024-04-26T12:06:59.156 INFO:tasks.workunit.client.0.smithi052.stdout:4/847: readlink d3/d12/l2c 0 2024-04-26T12:06:59.156 INFO:tasks.workunit.client.0.smithi052.stdout:6/874: symlink da/d22/d29/d31/d39/l136 0 2024-04-26T12:06:59.156 INFO:tasks.workunit.client.0.smithi052.stdout:0/936: dwrite d0/d1/d1a/d20/fd8 [0,4194304] 0 2024-04-26T12:06:59.157 INFO:tasks.workunit.client.0.smithi052.stdout:1/809: write d0/d2/dd/d40/dc1/d1d/f37 [316361,36778] 0 2024-04-26T12:06:59.157 INFO:tasks.workunit.client.0.smithi052.stdout:2/903: creat d0/d3f/d56/d8d/f12d x:0 0 0 2024-04-26T12:06:59.158 INFO:tasks.workunit.client.0.smithi052.stdout:8/837: fsync d0/d4/d1c/f36 0 2024-04-26T12:06:59.158 INFO:tasks.workunit.client.0.smithi052.stdout:9/878: dread d3/db/d10/f38 [0,4194304] 0 2024-04-26T12:06:59.158 INFO:tasks.workunit.client.0.smithi052.stdout:0/937: chown d0/d3d/le3 456858868 1 2024-04-26T12:06:59.158 INFO:tasks.workunit.client.0.smithi052.stdout:4/848: dread - d3/d12/d59/d96/dc0/ddd/f11e zero size 2024-04-26T12:06:59.159 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:06:59.159 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:06:59.160 INFO:tasks.workunit.client.0.smithi052.stdout:2/904: mkdir d0/d3f/d12e 0 2024-04-26T12:06:59.160 INFO:tasks.workunit.client.0.smithi052.stdout:5/894: rename db/dd/d34/d69/d93/d101 to db/dc/d5f/d123 0 2024-04-26T12:06:59.160 INFO:tasks.workunit.client.0.smithi052.stdout:6/875: write da/d22/d29/d31/d39/f48 [1745816,26857] 0 2024-04-26T12:06:59.160 INFO:tasks.workunit.client.0.smithi052.stdout:4/849: mknod d3/d22/d69/c120 0 2024-04-26T12:06:59.161 INFO:tasks.workunit.client.0.smithi052.stdout:1/810: mknod d0/d2/dd/d40/d81/d9a/dce/de9/c10d 0 2024-04-26T12:06:59.161 INFO:tasks.workunit.client.0.smithi052.stdout:9/879: creat d3/d23/f13b x:0 0 0 2024-04-26T12:06:59.161 INFO:tasks.workunit.client.0.smithi052.stdout:2/905: creat d0/d3f/f12f x:0 0 0 2024-04-26T12:06:59.161 INFO:tasks.workunit.client.0.smithi052.stdout:5/895: write db/dd/d18/d60/f9a [4927341,97792] 0 2024-04-26T12:06:59.161 INFO:tasks.workunit.client.0.smithi052.stdout:6/876: mkdir da/d22/d29/d31/d39/d137 0 2024-04-26T12:06:59.162 INFO:tasks.workunit.client.0.smithi052.stdout:8/838: getdents d0/d4/d5/d27/d69 0 2024-04-26T12:06:59.162 INFO:tasks.workunit.client.0.smithi052.stdout:0/938: rmdir d0/d26/d74/db4/d121 0 2024-04-26T12:06:59.163 INFO:tasks.workunit.client.0.smithi052.stdout:5/896: write db/dd/d34/d69/fa6 [4292500,108039] 0 2024-04-26T12:06:59.163 INFO:tasks.workunit.client.0.smithi052.stdout:9/880: readlink d3/db/d10/d2e/d5c/lba 0 2024-04-26T12:06:59.163 INFO:tasks.workunit.client.0.smithi052.stdout:1/811: fdatasync d0/d2/dd/d40/dc1/d1d/d91/fbb 0 2024-04-26T12:06:59.163 INFO:tasks.workunit.client.0.smithi052.stdout:0/939: fsync d0/d26/d36/f98 0 2024-04-26T12:06:59.163 INFO:tasks.workunit.client.0.smithi052.stdout:4/850: truncate d3/d12/d34/d45/d67/fa5 498050 0 2024-04-26T12:06:59.164 INFO:tasks.workunit.client.0.smithi052.stdout:5/897: unlink db/f1f 0 2024-04-26T12:06:59.165 INFO:tasks.workunit.client.0.smithi052.stdout:9/881: creat d3/db/d10/d2e/d5c/f13c x:0 0 0 2024-04-26T12:06:59.165 INFO:tasks.workunit.client.0.smithi052.stdout:2/906: getdents d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/dd3/d121 0 2024-04-26T12:06:59.166 INFO:tasks.workunit.client.0.smithi052.stdout:1/812: creat d0/d2/dd/d40/d81/d9a/f10e x:0 0 0 2024-04-26T12:06:59.168 INFO:tasks.workunit.client.0.smithi052.stdout:5/898: fdatasync db/dd/d34/d69/d8a/da9/d87/d6e/db8/dce/fd4 0 2024-04-26T12:06:59.171 INFO:tasks.workunit.client.0.smithi052.stdout:3/850: dread d2/d4/d41/d5c/fae [0,4194304] 0 2024-04-26T12:06:59.172 INFO:tasks.workunit.client.0.smithi052.stdout:8/839: dwrite d0/d4/d1c/fb7 [0,4194304] 0 2024-04-26T12:06:59.173 INFO:tasks.workunit.client.0.smithi052.stdout:5/899: write db/dd/d34/d69/d93/f58 [6918497,40025] 0 2024-04-26T12:06:59.173 INFO:tasks.workunit.client.0.smithi052.stdout:6/877: truncate da/d22/d29/dd4/ddf/d95/df8/d68/ff1 1320741 0 2024-04-26T12:06:59.174 INFO:tasks.workunit.client.0.smithi052.stdout:9/882: truncate d3/d23/dd0/f138 1943899 0 2024-04-26T12:06:59.174 INFO:tasks.workunit.client.0.smithi052.stdout:4/851: dwrite d3/d1f/d21/f32 [0,4194304] 0 2024-04-26T12:06:59.174 INFO:tasks.workunit.client.0.smithi052.stdout:2/907: link d0/d3f/d56/d8d/d99/db9/le3 d0/d7/d2f/d9b/l130 0 2024-04-26T12:06:59.174 INFO:tasks.workunit.client.0.smithi052.stdout:0/940: dwrite d0/d26/ff6 [0,4194304] 0 2024-04-26T12:06:59.175 INFO:tasks.workunit.client.0.smithi052.stdout:3/851: mkdir d2/d4/d2a/d96/dfc 0 2024-04-26T12:06:59.176 INFO:tasks.workunit.client.0.smithi052.stdout:8/840: creat d0/d4/d5/d27/d57/d8a/f117 x:0 0 0 2024-04-26T12:06:59.177 INFO:tasks.workunit.client.0.smithi052.stdout:9/883: dread - d3/db/d10/d54/f89 zero size 2024-04-26T12:06:59.177 INFO:tasks.workunit.client.0.smithi052.stdout:0/941: rmdir d0/d1 39 2024-04-26T12:06:59.177 INFO:tasks.workunit.client.0.smithi052.stdout:8/841: chown d0/d4/d5/da3 4 1 2024-04-26T12:06:59.177 INFO:tasks.workunit.client.0.smithi052.stdout:4/852: rename d3/d12/d34/d9b to d3/d22/d69/d121 0 2024-04-26T12:06:59.178 INFO:tasks.workunit.client.0.smithi052.stdout:7/887: dread d1/d1c/d23/f2c [0,4194304] 0 2024-04-26T12:06:59.178 INFO:tasks.workunit.client.0.smithi052.stdout:6/878: getdents da/d22/d29/dd4/df7/d7e 0 2024-04-26T12:06:59.178 INFO:tasks.workunit.client.0.smithi052.stdout:9/884: fsync d3/f99 0 2024-04-26T12:06:59.178 INFO:tasks.workunit.client.0.smithi052.stdout:3/852: write d2/d4/dc/d1d/d25/f3b [7255101,36744] 0 2024-04-26T12:06:59.180 INFO:tasks.workunit.client.0.smithi052.stdout:0/942: getdents d0/d1/d2c 0 2024-04-26T12:06:59.180 INFO:tasks.workunit.client.0.smithi052.stdout:3/853: mknod d2/d4/d2a/cfd 0 2024-04-26T12:06:59.180 INFO:tasks.workunit.client.0.smithi052.stdout:5/900: link db/dd/d34/d69/d8a/da9/d87/d6e/fec db/dd/d34/d69/d8a/da9/dd6/f124 0 2024-04-26T12:06:59.180 INFO:tasks.workunit.client.0.smithi052.stdout:8/842: getdents d0/d4/d5/dbf 0 2024-04-26T12:06:59.180 INFO:tasks.workunit.client.0.smithi052.stdout:7/888: rename d1/d1c/f42 to d1/d1c/d23/d81/d88/d108/f114 0 2024-04-26T12:06:59.181 INFO:tasks.workunit.client.0.smithi052.stdout:6/879: creat da/d22/d29/dd4/ddf/d7c/f138 x:0 0 0 2024-04-26T12:06:59.181 INFO:tasks.workunit.client.0.smithi052.stdout:0/943: readlink d0/d26/d74/la8 0 2024-04-26T12:06:59.182 INFO:tasks.workunit.client.0.smithi052.stdout:7/889: creat d1/d1c/d23/dd8/f115 x:0 0 0 2024-04-26T12:06:59.182 INFO:tasks.workunit.client.0.smithi052.stdout:3/854: symlink d2/d4/dc/d33/d75/lfe 0 2024-04-26T12:06:59.183 INFO:tasks.workunit.client.0.smithi052.stdout:5/901: symlink db/dc/d5f/d10c/l125 0 2024-04-26T12:06:59.183 INFO:tasks.workunit.client.0.smithi052.stdout:7/890: stat d1/d1f/d55/c96 0 2024-04-26T12:06:59.184 INFO:tasks.workunit.client.0.smithi052.stdout:0/944: dread - d0/d1/d2c/d42/da5/dba/d123/fcf zero size 2024-04-26T12:06:59.186 INFO:tasks.workunit.client.0.smithi052.stdout:7/891: creat d1/dab/f116 x:0 0 0 2024-04-26T12:06:59.186 INFO:tasks.workunit.client.0.smithi052.stdout:3/855: creat d2/d4/d41/db5/fff x:0 0 0 2024-04-26T12:06:59.186 INFO:tasks.workunit.client.0.smithi052.stdout:5/902: unlink db/dd/d34/d69/ce8 0 2024-04-26T12:06:59.186 INFO:tasks.workunit.client.0.smithi052.stdout:9/885: dwrite d3/f87 [0,4194304] 0 2024-04-26T12:06:59.187 INFO:tasks.workunit.client.0.smithi052.stdout:6/880: truncate da/d22/d29/dd4/ddf/d95/df8/f128 92964 0 2024-04-26T12:06:59.188 INFO:tasks.workunit.client.0.smithi052.stdout:0/945: rename d0/d1/d11/f4a to d0/d26/d74/db4/f131 0 2024-04-26T12:06:59.189 INFO:tasks.workunit.client.0.smithi052.stdout:3/856: creat d2/d4/dc/d33/f100 x:0 0 0 2024-04-26T12:06:59.189 INFO:tasks.workunit.client.0.smithi052.stdout:5/903: creat db/dc/d5f/d50/d46/d74/f126 x:0 0 0 2024-04-26T12:06:59.190 INFO:tasks.workunit.client.0.smithi052.stdout:8/843: dwrite d0/d3e/d87/fd6 [0,4194304] 0 2024-04-26T12:06:59.190 INFO:tasks.workunit.client.0.smithi052.stdout:0/946: stat d0/d1/d1a/d20/f83 0 2024-04-26T12:06:59.190 INFO:tasks.workunit.client.0.smithi052.stdout:6/881: symlink da/d22/d29/d31/d108/d118/l139 0 2024-04-26T12:06:59.191 INFO:tasks.workunit.client.0.smithi052.stdout:5/904: chown db/dc/c13 4144 1 2024-04-26T12:06:59.191 INFO:tasks.workunit.client.0.smithi052.stdout:4/853: dread d3/d12/f18 [4194304,4194304] 0 2024-04-26T12:06:59.192 INFO:tasks.workunit.client.0.smithi052.stdout:3/857: creat d2/d4/dc/d1d/f101 x:0 0 0 2024-04-26T12:06:59.193 INFO:tasks.workunit.client.0.smithi052.stdout:6/882: mknod da/d22/d29/d31/c13a 0 2024-04-26T12:06:59.193 INFO:tasks.workunit.client.0.smithi052.stdout:5/905: truncate db/dd/fdf 702781 0 2024-04-26T12:06:59.194 INFO:tasks.workunit.client.0.smithi052.stdout:4/854: dread - d3/d12/d59/d96/dc0/ddd/fc7 zero size 2024-04-26T12:06:59.194 INFO:tasks.workunit.client.0.smithi052.stdout:3/858: symlink d2/d4/dc/d33/d75/l102 0 2024-04-26T12:06:59.194 INFO:tasks.workunit.client.0.smithi052.stdout:8/844: dread d0/f66 [0,4194304] 0 2024-04-26T12:06:59.195 INFO:tasks.workunit.client.0.smithi052.stdout:1/813: dread d0/d2/dd/f32 [0,4194304] 0 2024-04-26T12:06:59.195 INFO:tasks.workunit.client.0.smithi052.stdout:3/859: creat d2/d4/d41/f103 x:0 0 0 2024-04-26T12:06:59.195 INFO:tasks.workunit.client.0.smithi052.stdout:8/845: write d0/d4/f4d [725686,19863] 0 2024-04-26T12:06:59.196 INFO:tasks.workunit.client.0.smithi052.stdout:1/814: readlink d0/d2/dd/d40/l87 0 2024-04-26T12:06:59.196 INFO:tasks.workunit.client.0.smithi052.stdout:0/947: write d0/d1/f12 [1547066,48054] 0 2024-04-26T12:06:59.196 INFO:tasks.workunit.client.0.smithi052.stdout:5/906: dread db/dd/d34/d69/d93/fb6 [0,4194304] 0 2024-04-26T12:06:59.197 INFO:tasks.workunit.client.0.smithi052.stdout:3/860: mknod d2/d4/d2a/d2d/df9/c104 0 2024-04-26T12:06:59.197 INFO:tasks.workunit.client.0.smithi052.stdout:8/846: creat d0/d4/dc/d68/d84/f118 x:0 0 0 2024-04-26T12:06:59.197 INFO:tasks.workunit.client.0.smithi052.stdout:3/861: chown d2/d4/dc/d33/d75/dc2/ce8 2618513 1 2024-04-26T12:06:59.198 INFO:tasks.workunit.client.0.smithi052.stdout:5/907: creat db/dd/d34/d69/d8a/da9/dd6/f127 x:0 0 0 2024-04-26T12:06:59.198 INFO:tasks.workunit.client.0.smithi052.stdout:1/815: link d0/da/lb0 d0/d2/dd/d40/dc1/d1d/l10f 0 2024-04-26T12:06:59.199 INFO:tasks.workunit.client.0.smithi052.stdout:8/847: rename d0/d4/d5/d86/d9c/db4/d75/fbd to d0/d16/d63/d8b/f119 0 2024-04-26T12:06:59.199 INFO:tasks.workunit.client.0.smithi052.stdout:9/886: truncate d3/db/d10/d3c/d40/d96/db5/f8b 2911110 0 2024-04-26T12:06:59.200 INFO:tasks.workunit.client.0.smithi052.stdout:7/892: truncate d1/d1c/d21/d2f/d33/d3a/d64/fed 7178845 0 2024-04-26T12:06:59.200 INFO:tasks.workunit.client.0.smithi052.stdout:6/883: truncate da/f1e 1089438 0 2024-04-26T12:06:59.200 INFO:tasks.workunit.client.0.smithi052.stdout:3/862: dread d2/d4/d81/fac [0,4194304] 0 2024-04-26T12:06:59.201 INFO:tasks.workunit.client.0.smithi052.stdout:5/908: creat db/dd/d34/d69/d8a/da9/dd6/f128 x:0 0 0 2024-04-26T12:06:59.201 INFO:tasks.workunit.client.0.smithi052.stdout:1/816: rename d0/d83/d4b/d56/fa2 to d0/d83/f110 0 2024-04-26T12:06:59.202 INFO:tasks.workunit.client.0.smithi052.stdout:9/887: truncate d3/db/d2b/fce 1032605 0 2024-04-26T12:06:59.202 INFO:tasks.workunit.client.0.smithi052.stdout:5/909: mknod db/dd/d18/dda/c129 0 2024-04-26T12:06:59.202 INFO:tasks.workunit.client.0.smithi052.stdout:8/848: rename d0/d4/d5/d86/d9c/db4/d75/fa8 to d0/d4/d5/f11a 0 2024-04-26T12:06:59.204 INFO:tasks.workunit.client.0.smithi052.stdout:1/817: write d0/d2/dd/d40/d81/d9a/dce/de9/f10a [469936,75095] 0 2024-04-26T12:06:59.204 INFO:tasks.workunit.client.0.smithi052.stdout:3/863: rename d2/d4/dc/d1d/d25/d36/d1c/f4a to d2/d4/d41/d5c/f105 0 2024-04-26T12:06:59.205 INFO:tasks.workunit.client.0.smithi052.stdout:6/884: read da/d22/d29/dd4/ddf/d92/d96/fc8 [80483,95654] 0 2024-04-26T12:06:59.205 INFO:tasks.workunit.client.0.smithi052.stdout:5/910: symlink db/dd/d34/d70/d59/l12a 0 2024-04-26T12:06:59.207 INFO:tasks.workunit.client.0.smithi052.stdout:1/818: mkdir d0/d2/dd/d40/d111 0 2024-04-26T12:06:59.207 INFO:tasks.workunit.client.0.smithi052.stdout:5/911: creat db/dc/f12b x:0 0 0 2024-04-26T12:06:59.207 INFO:tasks.workunit.client.0.smithi052.stdout:3/864: symlink d2/d4/d6b/dcf/de4/l106 0 2024-04-26T12:06:59.208 INFO:tasks.workunit.client.0.smithi052.stdout:7/893: dwrite d1/d1c/d23/f50 [0,4194304] 0 2024-04-26T12:06:59.208 INFO:tasks.workunit.client.0.smithi052.stdout:6/885: mknod da/d22/d29/d31/d39/dc7/d114/c13b 0 2024-04-26T12:06:59.208 INFO:tasks.workunit.client.0.smithi052.stdout:8/849: link d0/d4/d5/db/d20/d41/c112 d0/d4/d5/d86/d9c/db4/d58/dae/c11b 0 2024-04-26T12:06:59.208 INFO:tasks.workunit.client.0.smithi052.stdout:4/855: dread d3/d12/d59/d96/dc0/ddd/dca/ff2 [0,4194304] 0 2024-04-26T12:06:59.209 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:59.207+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:59.210 INFO:tasks.workunit.client.0.smithi052.stdout:6/886: fdatasync da/d5d/fd1 0 2024-04-26T12:06:59.210 INFO:tasks.workunit.client.0.smithi052.stdout:1/819: mknod d0/d2/dd/d34/d95/d10b/c112 0 2024-04-26T12:06:59.210 INFO:tasks.workunit.client.0.smithi052.stdout:3/865: dread - d2/d4/d2a/dbf/db0/ff3 zero size 2024-04-26T12:06:59.210 INFO:tasks.workunit.client.0.smithi052.stdout:7/894: write d1/d1f/f60 [9090263,32314] 0 2024-04-26T12:06:59.210 INFO:tasks.workunit.client.0.smithi052.stdout:5/912: creat db/dd/d34/d70/f12c x:0 0 0 2024-04-26T12:06:59.210 INFO:tasks.workunit.client.0.smithi052.stdout:4/856: mkdir d3/d12/d59/d96/dc0/d122 0 2024-04-26T12:06:59.211 INFO:tasks.workunit.client.0.smithi052.stdout:1/820: chown d0/d2/dd/d40/d81/d52/ff0 2 1 2024-04-26T12:06:59.211 INFO:tasks.workunit.client.0.smithi052.stdout:4/857: mkdir d3/d15/d76/d123 0 2024-04-26T12:06:59.211 INFO:tasks.workunit.client.0.smithi052.stdout:8/850: write d0/d4/d5/d86/d9c/db4/d58/d89/f113 [533475,87913] 0 2024-04-26T12:06:59.213 INFO:tasks.workunit.client.0.smithi052.stdout:4/858: readlink d3/d12/d34/d45/d67/d6c/l8d 0 2024-04-26T12:06:59.213 INFO:tasks.workunit.client.0.smithi052.stdout:2/908: dread d0/d7/d22/fb8 [0,4194304] 0 2024-04-26T12:06:59.213 INFO:tasks.workunit.client.0.smithi052.stdout:8/851: readlink d0/d4/d5/d86/d9c/db4/dd8/l108 0 2024-04-26T12:06:59.214 INFO:tasks.workunit.client.0.smithi052.stdout:4/859: mkdir d3/d1f/d21/dbe/d111/d124 0 2024-04-26T12:06:59.214 INFO:tasks.workunit.client.0.smithi052.stdout:3/866: write d2/f73 [3953469,23622] 0 2024-04-26T12:06:59.216 INFO:tasks.workunit.client.0.smithi052.stdout:7/895: dwrite d1/dab/f116 [0,4194304] 0 2024-04-26T12:06:59.218 INFO:tasks.workunit.client.0.smithi052.stdout:1/821: dwrite d0/d2/dd/d40/dc1/d1d/f9f [0,4194304] 0 2024-04-26T12:06:59.220 INFO:tasks.workunit.client.0.smithi052.stdout:6/887: truncate da/fe1 3687156 0 2024-04-26T12:06:59.221 INFO:tasks.workunit.client.0.smithi052.stdout:4/860: truncate d3/fb 2121020 0 2024-04-26T12:06:59.221 INFO:tasks.workunit.client.0.smithi052.stdout:8/852: dwrite d0/d4/d5/d86/d9c/db4/fab [0,4194304] 0 2024-04-26T12:06:59.221 INFO:tasks.workunit.client.0.smithi052.stdout:6/888: chown da/d22/l33 1371514168 1 2024-04-26T12:06:59.223 INFO:tasks.workunit.client.0.smithi052.stdout:7/896: truncate d1/dab/d4c/f4f 1831559 0 2024-04-26T12:06:59.223 INFO:tasks.workunit.client.0.smithi052.stdout:4/861: mkdir d3/d12/d59/d96/df7/d125 0 2024-04-26T12:06:59.223 INFO:tasks.workunit.client.0.smithi052.stdout:8/853: mkdir d0/d3e/d87/d11c 0 2024-04-26T12:06:59.223 INFO:tasks.workunit.client.0.smithi052.stdout:7/897: unlink d1/l1b 0 2024-04-26T12:06:59.224 INFO:tasks.workunit.client.0.smithi052.stdout:3/867: dwrite d2/d4/d6b/d7b/f90 [0,4194304] 0 2024-04-26T12:06:59.225 INFO:tasks.workunit.client.0.smithi052.stdout:8/854: creat d0/d4/d5/d27/d69/f11d x:0 0 0 2024-04-26T12:06:59.226 INFO:tasks.workunit.client.0.smithi052.stdout:4/862: link d3/d12/d34/d91/fb5 d3/d12/d64/f126 0 2024-04-26T12:06:59.226 INFO:tasks.workunit.client.0.smithi052.stdout:1/822: dwrite d0/d2/dd/d40/d81/d9a/f10e [0,4194304] 0 2024-04-26T12:06:59.228 INFO:tasks.workunit.client.0.smithi052.stdout:4/863: write d3/d22/fc2 [5046059,20545] 0 2024-04-26T12:06:59.228 INFO:tasks.workunit.client.0.smithi052.stdout:7/898: rename d1/dab/c7c to d1/d1c/d23/d81/d88/d108/d112/c117 0 2024-04-26T12:06:59.228 INFO:tasks.workunit.client.0.smithi052.stdout:8/855: creat d0/d4/d5/db/d20/d7b/f11e x:0 0 0 2024-04-26T12:06:59.229 INFO:tasks.workunit.client.0.smithi052.stdout:0/948: sync 2024-04-26T12:06:59.229 INFO:tasks.workunit.client.0.smithi052.stdout:9/888: sync 2024-04-26T12:06:59.229 INFO:tasks.workunit.client.0.smithi052.stdout:6/889: dwrite da/d22/d29/dd4/fe3 [0,4194304] 0 2024-04-26T12:06:59.230 INFO:tasks.workunit.client.0.smithi052.stdout:9/889: stat d3/db/d10/d2e/f77 0 2024-04-26T12:06:59.230 INFO:tasks.workunit.client.0.smithi052.stdout:4/864: creat d3/d15/f127 x:0 0 0 2024-04-26T12:06:59.230 INFO:tasks.workunit.client.0.smithi052.stdout:1/823: link d0/d2/dd/d40/d81/d9a/f10e d0/d2/dd/d40/d81/d9a/dce/dcf/f113 0 2024-04-26T12:06:59.231 INFO:tasks.workunit.client.0.smithi052.stdout:6/890: dread - da/d22/d29/dd4/ddf/d95/df8/d68/f11b zero size 2024-04-26T12:06:59.232 INFO:tasks.workunit.client.0.smithi052.stdout:3/868: truncate d2/d4/dc/f7a 4081562 0 2024-04-26T12:06:59.233 INFO:tasks.workunit.client.0.smithi052.stdout:4/865: symlink d3/d2b/dab/dec/l128 0 2024-04-26T12:06:59.233 INFO:tasks.workunit.client.0.smithi052.stdout:6/891: chown da/d63/lfe 7635044 1 2024-04-26T12:06:59.234 INFO:tasks.workunit.client.0.smithi052.stdout:1/824: mkdir d0/d2/dd/d40/d81/d9a/dce/de9/d9b/d114 0 2024-04-26T12:06:59.235 INFO:tasks.workunit.client.0.smithi052.stdout:3/869: chown d2/d4/dc/d33/d75/dc2 44 1 2024-04-26T12:06:59.235 INFO:tasks.workunit.client.0.smithi052.stdout:9/890: link d3/db/d10/d54/f56 d3/db/d10/d3c/d40/d96/da7/f13d 0 2024-04-26T12:06:59.237 INFO:tasks.workunit.client.0.smithi052.stdout:4/866: rename d3/d12/d59/d96/df7/l110 to d3/d12/d34/d43/dc6/l129 0 2024-04-26T12:06:59.237 INFO:tasks.workunit.client.0.smithi052.stdout:0/949: dwrite d0/d26/f11d [0,4194304] 0 2024-04-26T12:06:59.237 INFO:tasks.workunit.client.0.smithi052.stdout:8/856: dwrite d0/d4/d5/db/ffa [0,4194304] 0 2024-04-26T12:06:59.237 INFO:tasks.workunit.client.0.smithi052.stdout:1/825: fsync d0/d2/dd/d40/dc1/f82 0 2024-04-26T12:06:59.238 INFO:tasks.workunit.client.0.smithi052.stdout:6/892: rename da/d5d to da/d22/d29/d31/d6f/d13c 0 2024-04-26T12:06:59.238 INFO:tasks.workunit.client.0.smithi052.stdout:3/870: creat d2/d4/d2a/d96/dfc/f107 x:0 0 0 2024-04-26T12:06:59.239 INFO:tasks.workunit.client.0.smithi052.stdout:9/891: rmdir d3/db/d10/d2e/d5c/d12e 0 2024-04-26T12:06:59.239 INFO:tasks.workunit.client.0.smithi052.stdout:4/867: symlink d3/d2b/d40/d10f/l12a 0 2024-04-26T12:06:59.239 INFO:tasks.workunit.client.0.smithi052.stdout:8/857: fdatasync d0/d4/d5/d86/d9c/db4/d58/fbe 0 2024-04-26T12:06:59.240 INFO:tasks.workunit.client.0.smithi052.stdout:0/950: rename d0/d5b/d9d/d4f/f126 to d0/d1/d1a/f132 0 2024-04-26T12:06:59.240 INFO:tasks.workunit.client.0.smithi052.stdout:3/871: write d2/d4/d41/fdf [948149,52372] 0 2024-04-26T12:06:59.241 INFO:tasks.workunit.client.0.smithi052.stdout:4/868: write d3/d22/d30/fae [1285613,16104] 0 2024-04-26T12:06:59.243 INFO:tasks.workunit.client.0.smithi052.stdout:1/826: link d0/d2/dd/d40/d81/d9a/da6/dc4/dec/c107 d0/d2/d88/c115 0 2024-04-26T12:06:59.243 INFO:tasks.workunit.client.0.smithi052.stdout:4/869: fdatasync d3/d1f/d21/f119 0 2024-04-26T12:06:59.244 INFO:tasks.workunit.client.0.smithi052.stdout:3/872: mkdir d2/d4/d81/db6/d108 0 2024-04-26T12:06:59.245 INFO:tasks.workunit.client.0.smithi052.stdout:7/899: read d1/f35 [1037553,9542] 0 2024-04-26T12:06:59.245 INFO:tasks.workunit.client.0.smithi052.stdout:1/827: chown d0/d2/dd/d40/d81/d9a/da6/dc4 91186661 1 2024-04-26T12:06:59.246 INFO:tasks.workunit.client.0.smithi052.stdout:3/873: chown d2/d4/dc/d1d/d25/d61/cdc 5404 1 2024-04-26T12:06:59.246 INFO:tasks.workunit.client.0.smithi052.stdout:9/892: dwrite d3/db/d10/d2e/f77 [0,4194304] 0 2024-04-26T12:06:59.246 INFO:tasks.workunit.client.0.smithi052.stdout:3/874: readlink d2/d4/d41/d59/la6 0 2024-04-26T12:06:59.247 INFO:tasks.workunit.client.0.smithi052.stdout:1/828: rmdir d0/d2/dd/d40/d81/d9a/dce/dcf 39 2024-04-26T12:06:59.248 INFO:tasks.workunit.client.0.smithi052.stdout:7/900: read - d1/d1c/d21/d2f/d68/ff3 zero size 2024-04-26T12:06:59.248 INFO:tasks.workunit.client.0.smithi052.stdout:3/875: creat d2/d4/dc/d33/d37/f109 x:0 0 0 2024-04-26T12:06:59.251 INFO:tasks.workunit.client.0.smithi052.stdout:7/901: creat d1/dab/d4c/dd6/d102/f118 x:0 0 0 2024-04-26T12:06:59.251 INFO:tasks.workunit.client.0.smithi052.stdout:3/876: chown d2/d4/d41/f66 1975124 1 2024-04-26T12:06:59.251 INFO:tasks.workunit.client.0.smithi052.stdout:2/909: sync 2024-04-26T12:06:59.251 INFO:tasks.workunit.client.0.smithi052.stdout:5/913: sync 2024-04-26T12:06:59.252 INFO:tasks.workunit.client.0.smithi052.stdout:5/914: readlink db/dd/d34/l116 0 2024-04-26T12:06:59.252 INFO:tasks.workunit.client.0.smithi052.stdout:8/858: dwrite d0/d4/d5/d86/d9c/db4/d75/f103 [0,4194304] 0 2024-04-26T12:06:59.252 INFO:tasks.workunit.client.0.smithi052.stdout:4/870: truncate d3/d12/d34/d43/dc6/fd9 929704 0 2024-04-26T12:06:59.253 INFO:tasks.workunit.client.0.smithi052.stdout:7/902: rename d1/d1c/d21/d2f/d33/d3a/c5c to d1/d1f/c119 0 2024-04-26T12:06:59.254 INFO:tasks.workunit.client.0.smithi052.stdout:3/877: fdatasync d2/d4/dc/d1d/d25/d36/d1c/fe3 0 2024-04-26T12:06:59.254 INFO:tasks.workunit.client.0.smithi052.stdout:4/871: creat d3/d15/f12b x:0 0 0 2024-04-26T12:06:59.255 INFO:tasks.workunit.client.0.smithi052.stdout:5/915: write db/dd/d34/d69/d8a/da9/d87/d6e/db8/d11e/ff3 [281342,58151] 0 2024-04-26T12:06:59.255 INFO:tasks.workunit.client.0.smithi052.stdout:0/951: read d0/d26/dc7/d97/fac [1679405,97862] 0 2024-04-26T12:06:59.256 INFO:tasks.workunit.client.0.smithi052.stdout:0/952: sync 2024-04-26T12:06:59.256 INFO:tasks.workunit.client.0.smithi052.stdout:8/859: write d0/d4/d1c/fb7 [5927461,97352] 0 2024-04-26T12:06:59.257 INFO:tasks.workunit.client.0.smithi052.stdout:4/872: chown d3/d12/d59/d96/dc0/ddd/dca 0 1 2024-04-26T12:06:59.258 INFO:tasks.workunit.client.0.smithi052.stdout:3/878: unlink d2/d4/dc/d1d/d3f/da2/cc8 0 2024-04-26T12:06:59.258 INFO:tasks.workunit.client.0.smithi052.stdout:7/903: rename d1/d1c/d23/f31 to d1/d1c/d21/d2f/f11a 0 2024-04-26T12:06:59.259 INFO:tasks.workunit.client.0.smithi052.stdout:1/829: dwrite d0/d2/dd/d34/d95/d10b/fd1 [0,4194304] 0 2024-04-26T12:06:59.259 INFO:tasks.workunit.client.0.smithi052.stdout:8/860: dread - d0/d4/d5/d27/f100 zero size 2024-04-26T12:06:59.260 INFO:tasks.workunit.client.0.smithi052.stdout:2/910: dwrite d0/d7/f127 [0,4194304] 0 2024-04-26T12:06:59.260 INFO:tasks.workunit.client.0.smithi052.stdout:0/953: mkdir d0/d26/d74/db4/de1/d115/d133 0 2024-04-26T12:06:59.260 INFO:tasks.workunit.client.0.smithi052.stdout:4/873: read - d3/d12/d34/d91/f10d zero size 2024-04-26T12:06:59.260 INFO:tasks.workunit.client.0.smithi052.stdout:9/893: dwrite d3/d23/dd0/f138 [0,4194304] 0 2024-04-26T12:06:59.262 INFO:tasks.workunit.client.0.smithi052.stdout:3/879: creat d2/d4/dc/d1d/d25/d36/d1c/d4e/f10a x:0 0 0 2024-04-26T12:06:59.262 INFO:tasks.workunit.client.0.smithi052.stdout:8/861: rename d0/f64 to d0/d4/dc/f11f 0 2024-04-26T12:06:59.264 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:06:59.264 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:06:59.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:06:59.264 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:06:59.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.264 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:10941 4.c 4:31ba13fb:::100000031a6.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:59.264 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:54.655373+0000", 2024-04-26T12:06:59.264 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.605566262, 2024-04-26T12:06:59.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.024374114999999998, 2024-04-26T12:06:59.265 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:59.265 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.265 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:59.265 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:59.265 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:59.265 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 10941 2024-04-26T12:06:59.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.265 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:59.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:59.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.655373+0000", 2024-04-26T12:06:59.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:59.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.655373+0000", 2024-04-26T12:06:59.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:59.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.655373+0000", 2024-04-26T12:06:59.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:59.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.662000+0000", 2024-04-26T12:06:59.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066275600000000002 2024-04-26T12:06:59.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.267 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:59.267 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.662014+0000", 2024-04-26T12:06:59.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3713999999999999e-05 2024-04-26T12:06:59.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.267 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.267 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.662022+0000", 2024-04-26T12:06:59.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4619999999999996e-06 2024-04-26T12:06:59.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.267 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:59.267 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.662087+0000", 2024-04-26T12:06:59.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5053000000000002e-05 2024-04-26T12:06:59.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:59.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.662260+0000", 2024-04-26T12:06:59.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000172249 2024-04-26T12:06:59.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:59.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.662422+0000", 2024-04-26T12:06:59.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016228600000000001 2024-04-26T12:06:59.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:59.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.669518+0000", 2024-04-26T12:06:59.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070963559999999998 2024-04-26T12:06:59.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:59.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.679691+0000", 2024-04-26T12:06:59.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010172924 2024-04-26T12:06:59.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:59.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.679723+0000", 2024-04-26T12:06:59.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1711999999999997e-05 2024-04-26T12:06:59.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:59.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:54.679747+0000", 2024-04-26T12:06:59.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4324e-05 2024-04-26T12:06:59.269 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.270 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:59.270 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.270 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11245 4.35 4:ae938551:::100000031b5.00000000:head [write 0~4194304 [2@388629]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:59.270 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:55.045091+0000", 2024-04-26T12:06:59.270 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.2158484969999996, 2024-04-26T12:06:59.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028137703, 2024-04-26T12:06:59.270 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:59.270 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.270 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:59.270 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:59.270 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:59.270 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11245 2024-04-26T12:06:59.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.271 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:59.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:59.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.045091+0000", 2024-04-26T12:06:59.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:59.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.045091+0000", 2024-04-26T12:06:59.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:59.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.045090+0000", 2024-04-26T12:06:59.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:59.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:59.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.052909+0000", 2024-04-26T12:06:59.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078183969999999995 2024-04-26T12:06:59.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:59.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.052927+0000", 2024-04-26T12:06:59.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8887999999999999e-05 2024-04-26T12:06:59.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.273 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.273 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.052934+0000", 2024-04-26T12:06:59.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3969999999999999e-06 2024-04-26T12:06:59.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.273 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:59.273 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.052974+0000", 2024-04-26T12:06:59.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9681999999999997e-05 2024-04-26T12:06:59.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.273 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:59.273 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.053038+0000", 2024-04-26T12:06:59.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4919000000000006e-05 2024-04-26T12:06:59.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.274 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:59.274 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.053137+0000", 2024-04-26T12:06:59.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8257999999999993e-05 2024-04-26T12:06:59.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.274 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:59.274 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.056689+0000", 2024-04-26T12:06:59.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035521960000000001 2024-04-26T12:06:59.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.274 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:59.274 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.073132+0000", 2024-04-26T12:06:59.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016443600999999999 2024-04-26T12:06:59.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:59.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.073194+0000", 2024-04-26T12:06:59.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1927999999999994e-05 2024-04-26T12:06:59.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:59.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.073229+0000", 2024-04-26T12:06:59.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4190000000000003e-05 2024-04-26T12:06:59.275 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.275 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:59.275 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.276 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11251 4.18 4:184fae4a:::1000000316d.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:59.276 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:55.059341+0000", 2024-04-26T12:06:59.276 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.2015986219999997, 2024-04-26T12:06:59.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.027390274999999999, 2024-04-26T12:06:59.276 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:59.276 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.276 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:59.276 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:59.276 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:59.276 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11251 2024-04-26T12:06:59.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.276 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:59.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:59.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.059341+0000", 2024-04-26T12:06:59.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:59.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.059341+0000", 2024-04-26T12:06:59.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:59.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.059339+0000", 2024-04-26T12:06:59.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:59.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:59.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.066860+0000", 2024-04-26T12:06:59.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075208380000000002 2024-04-26T12:06:59.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:59.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.066878+0000", 2024-04-26T12:06:59.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7414e-05 2024-04-26T12:06:59.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.066887+0000", 2024-04-26T12:06:59.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.8969999999999997e-06 2024-04-26T12:06:59.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:59.279 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.066995+0000", 2024-04-26T12:06:59.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010816599999999999 2024-04-26T12:06:59.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.279 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:59.279 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.067098+0000", 2024-04-26T12:06:59.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000103354 2024-04-26T12:06:59.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.279 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:59.279 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.067263+0000", 2024-04-26T12:06:59.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000165021 2024-04-26T12:06:59.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.279 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:59.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.078893+0000", 2024-04-26T12:06:59.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.011629509999999999 2024-04-26T12:06:59.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:59.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.086675+0000", 2024-04-26T12:06:59.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0077823700000000003 2024-04-26T12:06:59.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:59.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.086707+0000", 2024-04-26T12:06:59.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2113999999999998e-05 2024-04-26T12:06:59.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:59.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.086731+0000", 2024-04-26T12:06:59.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3875000000000001e-05 2024-04-26T12:06:59.281 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.281 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:59.281 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.281 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11391 4.2b 4:d5e3748c:::10000003177.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:59.281 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:55.239584+0000", 2024-04-26T12:06:59.281 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.0213558569999996, 2024-04-26T12:06:59.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.025307432000000001, 2024-04-26T12:06:59.281 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:59.281 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.281 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:59.281 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:59.281 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:59.282 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11391 2024-04-26T12:06:59.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.282 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:59.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:59.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.239584+0000", 2024-04-26T12:06:59.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:59.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.239584+0000", 2024-04-26T12:06:59.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:59.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.239583+0000", 2024-04-26T12:06:59.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:59.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:59.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.249188+0000", 2024-04-26T12:06:59.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096058910000000001 2024-04-26T12:06:59.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:59.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.249201+0000", 2024-04-26T12:06:59.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2194e-05 2024-04-26T12:06:59.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.249208+0000", 2024-04-26T12:06:59.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1269999999999997e-06 2024-04-26T12:06:59.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:59.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.249250+0000", 2024-04-26T12:06:59.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1863999999999998e-05 2024-04-26T12:06:59.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:59.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.249395+0000", 2024-04-26T12:06:59.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014560800000000001 2024-04-26T12:06:59.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:59.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.249572+0000", 2024-04-26T12:06:59.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000177162 2024-04-26T12:06:59.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:59.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.254630+0000", 2024-04-26T12:06:59.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050573650000000003 2024-04-26T12:06:59.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:59.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.264808+0000", 2024-04-26T12:06:59.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010178008000000001 2024-04-26T12:06:59.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:59.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.264851+0000", 2024-04-26T12:06:59.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2840999999999999e-05 2024-04-26T12:06:59.286 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:59.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.264891+0000", 2024-04-26T12:06:59.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0379000000000001e-05 2024-04-26T12:06:59.286 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.286 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:59.286 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.286 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.287 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11718 4.1a 4:5a6e15a2:::1000000318e.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:59.287 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:55.650439+0000", 2024-04-26T12:06:59.287 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 3.6105001859999999, 2024-04-26T12:06:59.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.024223921999999998, 2024-04-26T12:06:59.287 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:59.287 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.287 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:59.287 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:59.287 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:59.287 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11718 2024-04-26T12:06:59.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.287 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:59.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:59.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.650439+0000", 2024-04-26T12:06:59.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:59.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.650439+0000", 2024-04-26T12:06:59.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:59.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.650439+0000", 2024-04-26T12:06:59.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:59.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.656857+0000", 2024-04-26T12:06:59.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064187699999999999 2024-04-26T12:06:59.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:59.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.656873+0000", 2024-04-26T12:06:59.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5562000000000001e-05 2024-04-26T12:06:59.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.656882+0000", 2024-04-26T12:06:59.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7390000000000005e-06 2024-04-26T12:06:59.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:59.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.656953+0000", 2024-04-26T12:06:59.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0987000000000003e-05 2024-04-26T12:06:59.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.290 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:59.290 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.657041+0000", 2024-04-26T12:06:59.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.8362999999999994e-05 2024-04-26T12:06:59.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.290 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:59.290 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.657169+0000", 2024-04-26T12:06:59.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012784800000000001 2024-04-26T12:06:59.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.290 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:59.290 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.664934+0000", 2024-04-26T12:06:59.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0077649299999999997 2024-04-26T12:06:59.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:59.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.674572+0000", 2024-04-26T12:06:59.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096380460000000008 2024-04-26T12:06:59.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:59.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.674620+0000", 2024-04-26T12:06:59.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7939999999999998e-05 2024-04-26T12:06:59.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:59.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.674663+0000", 2024-04-26T12:06:59.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3368000000000002e-05 2024-04-26T12:06:59.292 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.292 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:59.292 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.292 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:11876 4.a 4:53b9bbce:::10000003342.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:59.292 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:55.810594+0000", 2024-04-26T12:06:59.292 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 3.4503456689999998, 2024-04-26T12:06:59.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.025845051000000001, 2024-04-26T12:06:59.292 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:59.292 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.292 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:59.292 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:59.292 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:59.292 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 11876 2024-04-26T12:06:59.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.293 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:59.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:59.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.810594+0000", 2024-04-26T12:06:59.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:59.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.810594+0000", 2024-04-26T12:06:59.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:59.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.810593+0000", 2024-04-26T12:06:59.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:59.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:59.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.816125+0000", 2024-04-26T12:06:59.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055319929999999998 2024-04-26T12:06:59.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:59.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.816135+0000", 2024-04-26T12:06:59.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.9550000000000004e-06 2024-04-26T12:06:59.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.816139+0000", 2024-04-26T12:06:59.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1579999999999998e-06 2024-04-26T12:06:59.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:59.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.816180+0000", 2024-04-26T12:06:59.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0892000000000001e-05 2024-04-26T12:06:59.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:59.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.816340+0000", 2024-04-26T12:06:59.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015960700000000001 2024-04-26T12:06:59.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:59.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.816434+0000", 2024-04-26T12:06:59.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4729999999999996e-05 2024-04-26T12:06:59.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:59.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.823977+0000", 2024-04-26T12:06:59.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075424480000000002 2024-04-26T12:06:59.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:59.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.836338+0000", 2024-04-26T12:06:59.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.01236081 2024-04-26T12:06:59.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:59.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.836394+0000", 2024-04-26T12:06:59.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6613000000000002e-05 2024-04-26T12:06:59.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:59.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:55.836439+0000", 2024-04-26T12:06:59.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4577999999999999e-05 2024-04-26T12:06:59.297 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.297 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:59.297 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.297 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:12122 4.30 4:0f4ea324:::1000000326b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:59.297 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:56.136691+0000", 2024-04-26T12:06:59.297 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 3.1242486280000001, 2024-04-26T12:06:59.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.022791947999999999, 2024-04-26T12:06:59.298 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:59.298 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.298 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:59.298 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:59.298 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:59.298 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 12122 2024-04-26T12:06:59.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.298 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:59.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:59.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.136691+0000", 2024-04-26T12:06:59.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:59.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.136691+0000", 2024-04-26T12:06:59.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:59.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.136690+0000", 2024-04-26T12:06:59.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:59.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:59.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.143067+0000", 2024-04-26T12:06:59.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0063767199999999998 2024-04-26T12:06:59.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:59.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.143079+0000", 2024-04-26T12:06:59.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1926999999999999e-05 2024-04-26T12:06:59.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.143091+0000", 2024-04-26T12:06:59.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1861e-05 2024-04-26T12:06:59.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:59.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.143125+0000", 2024-04-26T12:06:59.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4604000000000003e-05 2024-04-26T12:06:59.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:59.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.143239+0000", 2024-04-26T12:06:59.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011333899999999999 2024-04-26T12:06:59.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:59.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.143355+0000", 2024-04-26T12:06:59.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000116352 2024-04-26T12:06:59.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:59.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.149176+0000", 2024-04-26T12:06:59.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.005821367 2024-04-26T12:06:59.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:59.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.159393+0000", 2024-04-26T12:06:59.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010216832 2024-04-26T12:06:59.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:59.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.159442+0000", 2024-04-26T12:06:59.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9225999999999999e-05 2024-04-26T12:06:59.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:59.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.159483+0000", 2024-04-26T12:06:59.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0435999999999997e-05 2024-04-26T12:06:59.302 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.302 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:59.302 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.303 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:12219 4.c 4:31838bd1:::10000003123.00000001:head [write 0~4194304 [5@0]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:59.303 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:56.254111+0000", 2024-04-26T12:06:59.303 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 3.0068281830000001, 2024-04-26T12:06:59.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031087433000000001, 2024-04-26T12:06:59.303 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:59.303 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.303 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:59.303 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:59.303 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:59.303 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 12219 2024-04-26T12:06:59.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.303 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:59.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:59.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.254111+0000", 2024-04-26T12:06:59.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:59.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.254111+0000", 2024-04-26T12:06:59.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:59.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.254111+0000", 2024-04-26T12:06:59.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:59.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.258439+0000", 2024-04-26T12:06:59.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043286349999999999 2024-04-26T12:06:59.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:59.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.258450+0000", 2024-04-26T12:06:59.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0494e-05 2024-04-26T12:06:59.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.258456+0000", 2024-04-26T12:06:59.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7620000000000001e-06 2024-04-26T12:06:59.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:59.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.258508+0000", 2024-04-26T12:06:59.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2096999999999999e-05 2024-04-26T12:06:59.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:59.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.258603+0000", 2024-04-26T12:06:59.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5340999999999994e-05 2024-04-26T12:06:59.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:59.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.258690+0000", 2024-04-26T12:06:59.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7009999999999995e-05 2024-04-26T12:06:59.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:59.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.263729+0000", 2024-04-26T12:06:59.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050387519999999996 2024-04-26T12:06:59.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:59.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.285112+0000", 2024-04-26T12:06:59.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.021382958000000001 2024-04-26T12:06:59.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:59.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.285161+0000", 2024-04-26T12:06:59.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.888e-05 2024-04-26T12:06:59.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:59.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.285199+0000", 2024-04-26T12:06:59.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8102000000000002e-05 2024-04-26T12:06:59.308 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.308 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:59.308 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.308 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:12251 4.30 4:0ce628d2:::10000003300.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:59.308 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:56.294492+0000", 2024-04-26T12:06:59.308 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 2.9664473149999999, 2024-04-26T12:06:59.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028588951000000001, 2024-04-26T12:06:59.309 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:59.309 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.309 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:59.309 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:59.309 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:59.309 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 12251 2024-04-26T12:06:59.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.309 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:59.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:59.309 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.294492+0000", 2024-04-26T12:06:59.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:59.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.294492+0000", 2024-04-26T12:06:59.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:59.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.294491+0000", 2024-04-26T12:06:59.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:06:59.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:59.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.300321+0000", 2024-04-26T12:06:59.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0058304380000000003 2024-04-26T12:06:59.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.311 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:59.311 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.300332+0000", 2024-04-26T12:06:59.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.058e-05 2024-04-26T12:06:59.311 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.311 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.311 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.300337+0000", 2024-04-26T12:06:59.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3140000000000003e-06 2024-04-26T12:06:59.311 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.311 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:59.311 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.300375+0000", 2024-04-26T12:06:59.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7474000000000001e-05 2024-04-26T12:06:59.311 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:59.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.300480+0000", 2024-04-26T12:06:59.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010580400000000001 2024-04-26T12:06:59.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:59.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.300553+0000", 2024-04-26T12:06:59.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2927000000000002e-05 2024-04-26T12:06:59.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:59.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.305801+0000", 2024-04-26T12:06:59.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052473700000000003 2024-04-26T12:06:59.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.313 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:59.313 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.322987+0000", 2024-04-26T12:06:59.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017186357999999999 2024-04-26T12:06:59.313 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.313 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:59.313 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.323039+0000", 2024-04-26T12:06:59.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2216000000000003e-05 2024-04-26T12:06:59.313 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.313 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:59.313 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.323081+0000", 2024-04-26T12:06:59.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1754e-05 2024-04-26T12:06:59.313 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.313 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:59.314 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.314 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:12254 4.30 4:0ce628d2:::10000003300.00000000:head [write 2679935~108229] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:59.314 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:56.300364+0000", 2024-04-26T12:06:59.314 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 2.9605749380000002, 2024-04-26T12:06:59.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.022990109000000002, 2024-04-26T12:06:59.314 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:59.314 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.314 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:59.314 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:59.314 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:59.314 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 12254 2024-04-26T12:06:59.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.315 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:59.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:59.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.300364+0000", 2024-04-26T12:06:59.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:59.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.300364+0000", 2024-04-26T12:06:59.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:59.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.300364+0000", 2024-04-26T12:06:59.316 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.316 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.316 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.316 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:59.316 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.300415+0000", 2024-04-26T12:06:59.316 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1150000000000003e-05 2024-04-26T12:06:59.316 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.316 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.316 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:59.316 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.300422+0000", 2024-04-26T12:06:59.316 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.6390000000000003e-06 2024-04-26T12:06:59.316 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.316 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.316 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.300426+0000", 2024-04-26T12:06:59.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7160000000000001e-06 2024-04-26T12:06:59.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:59.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.304888+0000", 2024-04-26T12:06:59.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044625460000000004 2024-04-26T12:06:59.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:59.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.304975+0000", 2024-04-26T12:06:59.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6811999999999995e-05 2024-04-26T12:06:59.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:59.318 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.305071+0000", 2024-04-26T12:06:59.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5964000000000005e-05 2024-04-26T12:06:59.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.318 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:59.318 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.306133+0000", 2024-04-26T12:06:59.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0010616270000000001 2024-04-26T12:06:59.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.318 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:59.318 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.323155+0000", 2024-04-26T12:06:59.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017022112999999998 2024-04-26T12:06:59.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:59.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.323256+0000", 2024-04-26T12:06:59.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010105799999999999 2024-04-26T12:06:59.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.319 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:59.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.323355+0000", 2024-04-26T12:06:59.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8754999999999999e-05 2024-04-26T12:06:59.319 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.319 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:59.319 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.319 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.319 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:12331 4.38 4:1eb721de:::10000003485.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:59.319 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:56.378701+0000", 2024-04-26T12:06:59.320 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 2.882237977, 2024-04-26T12:06:59.320 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.032046887000000003, 2024-04-26T12:06:59.320 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:59.320 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.320 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:59.320 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:59.320 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:59.320 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 12331 2024-04-26T12:06:59.320 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.320 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:59.320 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.320 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:59.320 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.378701+0000", 2024-04-26T12:06:59.320 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.320 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.321 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.321 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:59.321 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.378701+0000", 2024-04-26T12:06:59.321 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.321 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.321 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.321 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:59.321 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.378701+0000", 2024-04-26T12:06:59.321 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.321 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.321 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.321 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:59.321 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.384744+0000", 2024-04-26T12:06:59.321 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060428679999999999 2024-04-26T12:06:59.321 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.322 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:59.322 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.384757+0000", 2024-04-26T12:06:59.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.291e-05 2024-04-26T12:06:59.322 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.322 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.322 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.384765+0000", 2024-04-26T12:06:59.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2889999999999998e-06 2024-04-26T12:06:59.322 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.322 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:59.322 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.384807+0000", 2024-04-26T12:06:59.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2293999999999999e-05 2024-04-26T12:06:59.322 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:59.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.384921+0000", 2024-04-26T12:06:59.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011373400000000001 2024-04-26T12:06:59.323 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:59.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.385007+0000", 2024-04-26T12:06:59.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5490999999999999e-05 2024-04-26T12:06:59.323 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:59.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.410537+0000", 2024-04-26T12:06:59.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.025530750000000001 2024-04-26T12:06:59.323 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:59.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.410638+0000", 2024-04-26T12:06:59.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010066299999999999 2024-04-26T12:06:59.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:59.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.410698+0000", 2024-04-26T12:06:59.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9449e-05 2024-04-26T12:06:59.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:59.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.410748+0000", 2024-04-26T12:06:59.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0742999999999999e-05 2024-04-26T12:06:59.324 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.325 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:59.325 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.325 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4564.0:12328 4.b e53/16 4:d3ea317a:::10000003266.00000000:head v 53'184, mlcod=53'182)", 2024-04-26T12:06:59.325 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:56.383532+0000", 2024-04-26T12:06:59.325 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 2.8774070790000001, 2024-04-26T12:06:59.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.027372265999999999, 2024-04-26T12:06:59.325 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:59.325 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.325 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:59.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:59.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.383532+0000", 2024-04-26T12:06:59.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:59.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.383532+0000", 2024-04-26T12:06:59.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:59.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.383532+0000", 2024-04-26T12:06:59.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:59.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:59.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.392951+0000", 2024-04-26T12:06:59.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094198479999999998 2024-04-26T12:06:59.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:59.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.392988+0000", 2024-04-26T12:06:59.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6344999999999998e-05 2024-04-26T12:06:59.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.392999+0000", 2024-04-26T12:06:59.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1184e-05 2024-04-26T12:06:59.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:59.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.393037+0000", 2024-04-26T12:06:59.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7848000000000001e-05 2024-04-26T12:06:59.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.328 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:59.328 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.393060+0000", 2024-04-26T12:06:59.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2767000000000001e-05 2024-04-26T12:06:59.328 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.328 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:59.328 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.410871+0000", 2024-04-26T12:06:59.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017811019000000001 2024-04-26T12:06:59.328 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.328 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:59.328 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.410905+0000", 2024-04-26T12:06:59.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4017000000000003e-05 2024-04-26T12:06:59.328 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.328 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:59.329 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.329 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:12334 4.38 4:1f034004:::1000000336a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:59.329 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:56.384802+0000", 2024-04-26T12:06:59.329 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 2.8761373180000001, 2024-04-26T12:06:59.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.026100352, 2024-04-26T12:06:59.329 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:59.329 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.329 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:59.329 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:59.329 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:59.329 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 12334 2024-04-26T12:06:59.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.329 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:59.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:59.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.384802+0000", 2024-04-26T12:06:59.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:59.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.384802+0000", 2024-04-26T12:06:59.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:59.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.384802+0000", 2024-04-26T12:06:59.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:59.331 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.390840+0000", 2024-04-26T12:06:59.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00603799 2024-04-26T12:06:59.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:59.331 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.390850+0000", 2024-04-26T12:06:59.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0096e-05 2024-04-26T12:06:59.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.331 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.390870+0000", 2024-04-26T12:06:59.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0618000000000001e-05 2024-04-26T12:06:59.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.332 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:59.332 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.390927+0000", 2024-04-26T12:06:59.332 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6504e-05 2024-04-26T12:06:59.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.332 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:59.332 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.391042+0000", 2024-04-26T12:06:59.332 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115479 2024-04-26T12:06:59.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.332 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:59.332 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.391157+0000", 2024-04-26T12:06:59.332 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000114259 2024-04-26T12:06:59.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:59.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.410621+0000", 2024-04-26T12:06:59.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.019464286000000001 2024-04-26T12:06:59.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:59.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.410838+0000", 2024-04-26T12:06:59.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00021745600000000001 2024-04-26T12:06:59.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:59.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.410871+0000", 2024-04-26T12:06:59.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2715000000000001e-05 2024-04-26T12:06:59.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.334 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.334 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:59.334 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.410902+0000", 2024-04-26T12:06:59.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1430999999999998e-05 2024-04-26T12:06:59.334 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.334 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:59.334 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.334 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.334 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.334 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:12340 4.38 4:1c8d9fef:::100000033ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:59.334 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:56.391260+0000", 2024-04-26T12:06:59.334 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 2.8696796999999998, 2024-04-26T12:06:59.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.027962183000000002, 2024-04-26T12:06:59.334 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:59.334 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.335 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:59.335 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:59.335 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:59.335 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 12340 2024-04-26T12:06:59.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.335 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:59.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:59.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.391260+0000", 2024-04-26T12:06:59.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:59.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.391260+0000", 2024-04-26T12:06:59.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:59.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.391259+0000", 2024-04-26T12:06:59.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:59.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.396432+0000", 2024-04-26T12:06:59.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051724570000000001 2024-04-26T12:06:59.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:59.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.396444+0000", 2024-04-26T12:06:59.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2397e-05 2024-04-26T12:06:59.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.337 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.396451+0000", 2024-04-26T12:06:59.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.489e-06 2024-04-26T12:06:59.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:59.337 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.402575+0000", 2024-04-26T12:06:59.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0061249729999999997 2024-04-26T12:06:59.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:59.337 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.402807+0000", 2024-04-26T12:06:59.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00023123499999999999 2024-04-26T12:06:59.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:59.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.402991+0000", 2024-04-26T12:06:59.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018452599999999999 2024-04-26T12:06:59.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:59.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.412192+0000", 2024-04-26T12:06:59.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092010389999999994 2024-04-26T12:06:59.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:59.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.419105+0000", 2024-04-26T12:06:59.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069129270000000001 2024-04-26T12:06:59.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:59.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.419158+0000", 2024-04-26T12:06:59.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3291000000000002e-05 2024-04-26T12:06:59.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:59.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.419222+0000", 2024-04-26T12:06:59.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3390000000000001e-05 2024-04-26T12:06:59.339 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.339 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:59.339 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.339 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:12351 4.a 4:51730b5b:::100000030d3.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:59.340 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:56.401301+0000", 2024-04-26T12:06:59.340 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 2.8596383369999998, 2024-04-26T12:06:59.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.026778936, 2024-04-26T12:06:59.340 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:59.340 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.340 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:59.340 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:59.340 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:59.340 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 12351 2024-04-26T12:06:59.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.340 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:59.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.340 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:59.340 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.401301+0000", 2024-04-26T12:06:59.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:59.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.401301+0000", 2024-04-26T12:06:59.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:59.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.401301+0000", 2024-04-26T12:06:59.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:59.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.409385+0000", 2024-04-26T12:06:59.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0080843679999999998 2024-04-26T12:06:59.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:59.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.409404+0000", 2024-04-26T12:06:59.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9001999999999999e-05 2024-04-26T12:06:59.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.409421+0000", 2024-04-26T12:06:59.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7085999999999999e-05 2024-04-26T12:06:59.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:59.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.409472+0000", 2024-04-26T12:06:59.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0784e-05 2024-04-26T12:06:59.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:59.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.409569+0000", 2024-04-26T12:06:59.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7071000000000006e-05 2024-04-26T12:06:59.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:59.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.409706+0000", 2024-04-26T12:06:59.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000136456 2024-04-26T12:06:59.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:59.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.423256+0000", 2024-04-26T12:06:59.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013550588000000001 2024-04-26T12:06:59.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:59.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.428024+0000", 2024-04-26T12:06:59.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047681970000000001 2024-04-26T12:06:59.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:59.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.428053+0000", 2024-04-26T12:06:59.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8736999999999999e-05 2024-04-26T12:06:59.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:59.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.428080+0000", 2024-04-26T12:06:59.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6940999999999998e-05 2024-04-26T12:06:59.344 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.345 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:59.345 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.345 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:12352 4.2b 4:d5e3748c:::10000003177.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:59.345 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:56.409432+0000", 2024-04-26T12:06:59.345 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 2.851507083, 2024-04-26T12:06:59.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028583662999999999, 2024-04-26T12:06:59.345 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:59.345 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.345 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:59.345 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:59.345 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:59.345 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 12352 2024-04-26T12:06:59.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.346 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:59.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.346 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:59.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.409432+0000", 2024-04-26T12:06:59.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.346 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.346 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:59.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.409432+0000", 2024-04-26T12:06:59.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.346 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.346 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:59.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.409431+0000", 2024-04-26T12:06:59.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:59.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:59.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.414482+0000", 2024-04-26T12:06:59.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050511189999999997 2024-04-26T12:06:59.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:59.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.414494+0000", 2024-04-26T12:06:59.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1895e-05 2024-04-26T12:06:59.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.414500+0000", 2024-04-26T12:06:59.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0750000000000003e-06 2024-04-26T12:06:59.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.348 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:59.348 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.419645+0000", 2024-04-26T12:06:59.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051450259999999996 2024-04-26T12:06:59.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.348 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:59.348 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.419858+0000", 2024-04-26T12:06:59.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000212649 2024-04-26T12:06:59.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:59.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.419996+0000", 2024-04-26T12:06:59.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000137556 2024-04-26T12:06:59.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:59.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.427839+0000", 2024-04-26T12:06:59.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078433800000000005 2024-04-26T12:06:59.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:59.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.437944+0000", 2024-04-26T12:06:59.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010104597 2024-04-26T12:06:59.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:59.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.437984+0000", 2024-04-26T12:06:59.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0818999999999997e-05 2024-04-26T12:06:59.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:59.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.438016+0000", 2024-04-26T12:06:59.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1572999999999997e-05 2024-04-26T12:06:59.350 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.350 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:59.350 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.351 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:12365 4.3c 4:3c1589f2:::100000032ca.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:59.351 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:56.429476+0000", 2024-04-26T12:06:59.351 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 2.831462986, 2024-04-26T12:06:59.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.027110891000000002, 2024-04-26T12:06:59.351 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:59.351 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.351 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:59.351 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:59.351 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:59.351 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 12365 2024-04-26T12:06:59.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.351 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:59.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:59.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.429476+0000", 2024-04-26T12:06:59.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:59.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.429476+0000", 2024-04-26T12:06:59.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:59.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.429475+0000", 2024-04-26T12:06:59.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:06:59.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:59.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.435078+0000", 2024-04-26T12:06:59.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0056025720000000001 2024-04-26T12:06:59.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.353 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:59.353 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.435089+0000", 2024-04-26T12:06:59.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0759e-05 2024-04-26T12:06:59.353 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.353 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.353 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.435094+0000", 2024-04-26T12:06:59.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9130000000000002e-06 2024-04-26T12:06:59.353 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.353 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:59.353 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.435175+0000", 2024-04-26T12:06:59.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1165e-05 2024-04-26T12:06:59.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:59.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.435233+0000", 2024-04-26T12:06:59.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8593e-05 2024-04-26T12:06:59.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:59.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.435313+0000", 2024-04-26T12:06:59.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9618999999999998e-05 2024-04-26T12:06:59.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:59.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.440714+0000", 2024-04-26T12:06:59.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.005401337 2024-04-26T12:06:59.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:59.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.456512+0000", 2024-04-26T12:06:59.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015797584 2024-04-26T12:06:59.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:59.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.456552+0000", 2024-04-26T12:06:59.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0268999999999997e-05 2024-04-26T12:06:59.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:59.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.456587+0000", 2024-04-26T12:06:59.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5015000000000003e-05 2024-04-26T12:06:59.356 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.356 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:59.356 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.356 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:12396 4.c 4:31838bd1:::10000003123.00000001:head [write 0~4194304 [5@0]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:59.356 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:56.479091+0000", 2024-04-26T12:06:59.356 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 2.7818481779999997, 2024-04-26T12:06:59.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.025539116000000001, 2024-04-26T12:06:59.356 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:59.356 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.356 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:59.356 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:59.357 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:59.357 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 12396 2024-04-26T12:06:59.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.357 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:59.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.357 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:59.357 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.479091+0000", 2024-04-26T12:06:59.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.357 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:59.357 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.479091+0000", 2024-04-26T12:06:59.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:59.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.479084+0000", 2024-04-26T12:06:59.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999928 2024-04-26T12:06:59.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:59.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.484377+0000", 2024-04-26T12:06:59.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052927720000000003 2024-04-26T12:06:59.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:59.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.484388+0000", 2024-04-26T12:06:59.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1396999999999999e-05 2024-04-26T12:06:59.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.484396+0000", 2024-04-26T12:06:59.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0460000000000006e-06 2024-04-26T12:06:59.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:59.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.484448+0000", 2024-04-26T12:06:59.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1972000000000003e-05 2024-04-26T12:06:59.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:59.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.484547+0000", 2024-04-26T12:06:59.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8499999999999995e-05 2024-04-26T12:06:59.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:59.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.484683+0000", 2024-04-26T12:06:59.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013679299999999999 2024-04-26T12:06:59.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:59.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.490669+0000", 2024-04-26T12:06:59.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0059857829999999997 2024-04-26T12:06:59.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:59.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.504531+0000", 2024-04-26T12:06:59.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013861534999999999 2024-04-26T12:06:59.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:59.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.504592+0000", 2024-04-26T12:06:59.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1494000000000004e-05 2024-04-26T12:06:59.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:59.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.504630+0000", 2024-04-26T12:06:59.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8064e-05 2024-04-26T12:06:59.361 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.361 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:59.361 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.361 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:12404 4.1a 4:5913b086:::1000000336d.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:06:59.362 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:56.494816+0000", 2024-04-26T12:06:59.362 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 2.766123506, 2024-04-26T12:06:59.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023982555999999999, 2024-04-26T12:06:59.362 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:59.362 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.362 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:59.362 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:59.362 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:59.362 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 12404 2024-04-26T12:06:59.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.362 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:59.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.362 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:59.362 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.494816+0000", 2024-04-26T12:06:59.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:59.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.494816+0000", 2024-04-26T12:06:59.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:59.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.494815+0000", 2024-04-26T12:06:59.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:59.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.501631+0000", 2024-04-26T12:06:59.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0068157180000000001 2024-04-26T12:06:59.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:59.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.501643+0000", 2024-04-26T12:06:59.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1708999999999999e-05 2024-04-26T12:06:59.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.501651+0000", 2024-04-26T12:06:59.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5669999999999995e-06 2024-04-26T12:06:59.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:59.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.501724+0000", 2024-04-26T12:06:59.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2119999999999994e-05 2024-04-26T12:06:59.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:59.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.501841+0000", 2024-04-26T12:06:59.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011768 2024-04-26T12:06:59.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:59.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.501950+0000", 2024-04-26T12:06:59.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000108898 2024-04-26T12:06:59.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:59.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.514357+0000", 2024-04-26T12:06:59.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012407034000000001 2024-04-26T12:06:59.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:59.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.518713+0000", 2024-04-26T12:06:59.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043554470000000001 2024-04-26T12:06:59.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:59.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.518758+0000", 2024-04-26T12:06:59.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5649999999999998e-05 2024-04-26T12:06:59.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:59.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.518798+0000", 2024-04-26T12:06:59.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0204000000000003e-05 2024-04-26T12:06:59.367 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.367 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:59.367 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.367 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4564.0:12538 4.18 4:1b27ead4:::10000003266.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:06:59.367 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:56.647855+0000", 2024-04-26T12:06:59.367 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 2.6130845090000001, 2024-04-26T12:06:59.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023551620999999998, 2024-04-26T12:06:59.367 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:06:59.367 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.367 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T12:06:59.367 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4564", 2024-04-26T12:06:59.367 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "192.168.0.1:0/1869161429", 2024-04-26T12:06:59.367 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 12538 2024-04-26T12:06:59.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.368 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:06:59.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:06:59.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.647855+0000", 2024-04-26T12:06:59.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:06:59.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.647855+0000", 2024-04-26T12:06:59.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:06:59.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:06:59.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.647854+0000", 2024-04-26T12:06:59.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:06:59.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.653659+0000", 2024-04-26T12:06:59.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0058042399999999996 2024-04-26T12:06:59.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:06:59.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.653671+0000", 2024-04-26T12:06:59.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2295e-05 2024-04-26T12:06:59.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.370 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.653676+0000", 2024-04-26T12:06:59.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:06:59.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:06:59.370 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.653728+0000", 2024-04-26T12:06:59.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1434999999999998e-05 2024-04-26T12:06:59.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:06:59.370 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.653844+0000", 2024-04-26T12:06:59.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000116545 2024-04-26T12:06:59.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T12:06:59.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.653976+0000", 2024-04-26T12:06:59.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013146699999999999 2024-04-26T12:06:59.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:06:59.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.664626+0000", 2024-04-26T12:06:59.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010650619 2024-04-26T12:06:59.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:06:59.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.671315+0000", 2024-04-26T12:06:59.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066888670000000002 2024-04-26T12:06:59.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:06:59.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.671369+0000", 2024-04-26T12:06:59.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3489999999999998e-05 2024-04-26T12:06:59.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:06:59.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:06:59.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:06:59.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:56.671407+0000", 2024-04-26T12:06:59.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7716000000000003e-05 2024-04-26T12:06:59.372 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.372 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:59.372 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.372 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:06:59.372 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:06:59.372 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:06:59.374 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:59.372+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:59.375 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:06:59.399 INFO:tasks.workunit.client.0.smithi052.stdout:2/911: creat d0/d7/d2f/d3d/f131 x:0 0 0 2024-04-26T12:06:59.400 INFO:tasks.workunit.client.0.smithi052.stdout:7/904: write d1/d1c/d23/d81/d88/d108/f114 [1830024,24454] 0 2024-04-26T12:06:59.400 INFO:tasks.workunit.client.0.smithi052.stdout:9/894: creat d3/d3b/d102/d122/f13e x:0 0 0 2024-04-26T12:06:59.400 INFO:tasks.workunit.client.0.smithi052.stdout:1/830: creat d0/d2/dd/d40/dc1/f116 x:0 0 0 2024-04-26T12:06:59.400 INFO:tasks.workunit.client.0.smithi052.stdout:2/912: mkdir d0/d3f/d56/d6d/d5a/de4/df9/d132 0 2024-04-26T12:06:59.400 INFO:tasks.workunit.client.0.smithi052.stdout:2/913: sync 2024-04-26T12:06:59.400 INFO:tasks.workunit.client.0.smithi052.stdout:9/895: mknod d3/db/c13f 0 2024-04-26T12:06:59.400 INFO:tasks.workunit.client.0.smithi052.stdout:7/905: mknod d1/d1f/d55/c11b 0 2024-04-26T12:06:59.400 INFO:tasks.workunit.client.0.smithi052.stdout:5/916: truncate db/dd/d34/d69/d8a/da9/d87/fb9 337680 0 2024-04-26T12:06:59.400 INFO:tasks.workunit.client.0.smithi052.stdout:3/880: creat d2/d4/dc/d1d/d25/d61/f10b x:0 0 0 2024-04-26T12:06:59.400 INFO:tasks.workunit.client.0.smithi052.stdout:1/831: mknod d0/da/d2e/c117 0 2024-04-26T12:06:59.400 INFO:tasks.workunit.client.0.smithi052.stdout:8/862: getdents d0/d4/d5/d86/d9c/db4/d58/dae 0 2024-04-26T12:06:59.400 INFO:tasks.workunit.client.0.smithi052.stdout:4/874: dwrite d3/d44/d4b/db8/dde/fe0 [0,4194304] 0 2024-04-26T12:06:59.400 INFO:tasks.workunit.client.0.smithi052.stdout:0/954: dwrite d0/d1/dd/f19 [0,4194304] 0 2024-04-26T12:06:59.400 INFO:tasks.workunit.client.0.smithi052.stdout:5/917: mknod db/dd/d18/d60/d64/d9c/c12d 0 2024-04-26T12:06:59.401 INFO:tasks.workunit.client.0.smithi052.stdout:5/918: sync 2024-04-26T12:06:59.401 INFO:tasks.workunit.client.0.smithi052.stdout:1/832: symlink d0/d83/d4b/l118 0 2024-04-26T12:06:59.401 INFO:tasks.workunit.client.0.smithi052.stdout:8/863: write d0/d4/d5/daf/fd0 [331412,48726] 0 2024-04-26T12:06:59.401 INFO:tasks.workunit.client.0.smithi052.stdout:7/906: read d1/d1c/d21/f7f [3998856,46910] 0 2024-04-26T12:06:59.401 INFO:tasks.workunit.client.0.smithi052.stdout:2/914: write d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/dd3/d121/d3a/ff5 [1302793,295] 0 2024-04-26T12:06:59.401 INFO:tasks.workunit.client.0.smithi052.stdout:8/864: dread - d0/d4/d5/d86/d9c/db4/d58/ff9 zero size 2024-04-26T12:06:59.401 INFO:tasks.workunit.client.0.smithi052.stdout:3/881: rename d2/d4/dc/d1d/d25/d36/l5a to d2/d4/dc/d33/d75/dfa/l10c 0 2024-04-26T12:06:59.401 INFO:tasks.workunit.client.0.smithi052.stdout:7/907: creat d1/d1c/d65/f11c x:0 0 0 2024-04-26T12:06:59.401 INFO:tasks.workunit.client.0.smithi052.stdout:5/919: mknod db/dc/d5f/d50/c12e 0 2024-04-26T12:06:59.401 INFO:tasks.workunit.client.0.smithi052.stdout:0/955: rename d0/d26/dbe/fd4 to d0/d5a/f134 0 2024-04-26T12:06:59.401 INFO:tasks.workunit.client.0.smithi052.stdout:8/865: creat d0/d4/d5/d86/f120 x:0 0 0 2024-04-26T12:06:59.401 INFO:tasks.workunit.client.0.smithi052.stdout:9/896: dwrite d3/db/d52/f107 [0,4194304] 0 2024-04-26T12:06:59.401 INFO:tasks.workunit.client.0.smithi052.stdout:2/915: dread - d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/dd3/d121/d3a/f5e zero size 2024-04-26T12:06:59.401 INFO:tasks.workunit.client.0.smithi052.stdout:3/882: stat d2/d4/dc/d68/ca5 0 2024-04-26T12:06:59.402 INFO:tasks.workunit.client.0.smithi052.stdout:0/956: stat d0/d26/d74/db4/de1 0 2024-04-26T12:06:59.402 INFO:tasks.workunit.client.0.smithi052.stdout:4/875: truncate d3/d12/d59/d96/dc0/ddd/dca/ff2 4642702 0 2024-04-26T12:06:59.402 INFO:tasks.workunit.client.0.smithi052.stdout:3/883: write d2/d4/f64 [4585602,87959] 0 2024-04-26T12:06:59.402 INFO:tasks.workunit.client.0.smithi052.stdout:0/957: write d0/f12b [305688,94606] 0 2024-04-26T12:06:59.402 INFO:tasks.workunit.client.0.smithi052.stdout:8/866: chown d0/d4/d5/d27/d57/fed 116 1 2024-04-26T12:06:59.402 INFO:tasks.workunit.client.0.smithi052.stdout:4/876: write d3/d1f/d21/fc1 [1001277,26470] 0 2024-04-26T12:06:59.402 INFO:tasks.workunit.client.0.smithi052.stdout:1/833: dwrite d0/d2/dd/d40/dc1/d1d/d91/f106 [0,4194304] 0 2024-04-26T12:06:59.402 INFO:tasks.workunit.client.0.smithi052.stdout:1/834: chown d0/d2/dd/f6e 705 1 2024-04-26T12:06:59.402 INFO:tasks.workunit.client.0.smithi052.stdout:9/897: mkdir d3/db/d10/d3c/d40/d96/d140 0 2024-04-26T12:06:59.402 INFO:tasks.workunit.client.0.smithi052.stdout:2/916: rename d0/d7/f83 to d0/d7/d2f/d8c/d116/f133 0 2024-04-26T12:06:59.402 INFO:tasks.workunit.client.0.smithi052.stdout:5/920: dwrite db/dc/d5f/d50/fd7 [0,4194304] 0 2024-04-26T12:06:59.402 INFO:tasks.workunit.client.0.smithi052.stdout:8/867: unlink d0/d4/d5/d86/d9c/db4/d58/d8f/cfe 0 2024-04-26T12:06:59.402 INFO:tasks.workunit.client.0.smithi052.stdout:0/958: mknod d0/d1/d1a/d20/c135 0 2024-04-26T12:06:59.402 INFO:tasks.workunit.client.0.smithi052.stdout:7/908: getdents d1/d1c/d23/d81/d88/d108/d112 0 2024-04-26T12:06:59.403 INFO:tasks.workunit.client.0.smithi052.stdout:7/909: symlink d1/d1c/dd3/l11d 0 2024-04-26T12:06:59.403 INFO:tasks.workunit.client.0.smithi052.stdout:2/917: creat d0/d7/d2f/d8c/d116/f134 x:0 0 0 2024-04-26T12:06:59.403 INFO:tasks.workunit.client.0.smithi052.stdout:8/868: rmdir d0/d4/d1c/d83 39 2024-04-26T12:06:59.403 INFO:tasks.workunit.client.0.smithi052.stdout:1/835: link d0/d2/d88/lea d0/da/d2e/l119 0 2024-04-26T12:06:59.403 INFO:tasks.workunit.client.0.smithi052.stdout:9/898: mkdir d3/db/d10/d3c/d40/d96/db5/da3/d133/d141 0 2024-04-26T12:06:59.403 INFO:tasks.workunit.client.0.smithi052.stdout:0/959: rename d0/d26/d36/f63 to d0/d1/f136 0 2024-04-26T12:06:59.403 INFO:tasks.workunit.client.0.smithi052.stdout:7/910: rename d1 to d1/dab/d4c/dd6/d11e 22 2024-04-26T12:06:59.403 INFO:tasks.workunit.client.0.smithi052.stdout:1/836: symlink d0/d2/dd/d34/d95/d10b/l11a 0 2024-04-26T12:06:59.403 INFO:tasks.workunit.client.0.smithi052.stdout:5/921: truncate db/dc/f54 3795242 0 2024-04-26T12:06:59.403 INFO:tasks.workunit.client.0.smithi052.stdout:9/899: creat d3/db/d10/d3c/d40/d96/db5/f142 x:0 0 0 2024-04-26T12:06:59.403 INFO:tasks.workunit.client.0.smithi052.stdout:8/869: rename d0/d4/d5/d86/d9c/db4/d58/dae/c11b to d0/d4/d5/da3/c121 0 2024-04-26T12:06:59.403 INFO:tasks.workunit.client.0.smithi052.stdout:7/911: truncate d1/d1f/f26 2002716 0 2024-04-26T12:06:59.403 INFO:tasks.workunit.client.0.smithi052.stdout:1/837: write d0/d2/dd/d40/d81/d9a/da6/dc4/dec/f109 [374326,60493] 0 2024-04-26T12:06:59.403 INFO:tasks.workunit.client.0.smithi052.stdout:8/870: unlink d0/d4/d5/d86/cd4 0 2024-04-26T12:06:59.403 INFO:tasks.workunit.client.0.smithi052.stdout:9/900: creat d3/db/d10/d3c/d40/df6/f143 x:0 0 0 2024-04-26T12:06:59.404 INFO:tasks.workunit.client.0.smithi052.stdout:5/922: rename db/dc/d5f/d50/c4d to db/dd/d34/d69/d8a/da9/c12f 0 2024-04-26T12:06:59.404 INFO:tasks.workunit.client.0.smithi052.stdout:0/960: read d0/d1/d2c/d42/da5/dba/dbb/f11e [2330134,23168] 0 2024-04-26T12:06:59.404 INFO:tasks.workunit.client.0.smithi052.stdout:7/912: mknod d1/d1c/d21/d2f/d33/d3a/d100/c11f 0 2024-04-26T12:06:59.404 INFO:tasks.workunit.client.0.smithi052.stdout:8/871: chown d0/f70 784140 1 2024-04-26T12:06:59.404 INFO:tasks.workunit.client.0.smithi052.stdout:2/918: dwrite d0/d3f/f12f [0,4194304] 0 2024-04-26T12:06:59.404 INFO:tasks.workunit.client.0.smithi052.stdout:8/872: readlink d0/l7e 0 2024-04-26T12:06:59.404 INFO:tasks.workunit.client.0.smithi052.stdout:7/913: write d1/d1c/d23/f85 [2406061,110436] 0 2024-04-26T12:06:59.404 INFO:tasks.workunit.client.0.smithi052.stdout:2/919: truncate d0/d7/d2f/dee/f119 334259 0 2024-04-26T12:06:59.404 INFO:tasks.workunit.client.0.smithi052.stdout:8/873: rename d0/d4/d5/d86/d9c/db4/fab to d0/d4/d5/d86/d9c/db4/d58/d8f/f122 0 2024-04-26T12:06:59.404 INFO:tasks.workunit.client.0.smithi052.stdout:2/920: truncate d0/f9a 524905 0 2024-04-26T12:06:59.404 INFO:tasks.workunit.client.0.smithi052.stdout:7/914: mknod d1/d1c/d21/d2f/d33/d3a/c120 0 2024-04-26T12:06:59.404 INFO:tasks.workunit.client.0.smithi052.stdout:4/877: dread d3/d44/f48 [0,4194304] 0 2024-04-26T12:06:59.404 INFO:tasks.workunit.client.0.smithi052.stdout:1/838: dread d0/d2/dd/d40/dc1/d1d/d91/f106 [0,4194304] 0 2024-04-26T12:06:59.404 INFO:tasks.workunit.client.0.smithi052.stdout:6/893: dread da/d22/f3b [0,4194304] 0 2024-04-26T12:06:59.404 INFO:tasks.workunit.client.0.smithi052.stdout:4/878: creat d3/f12c x:0 0 0 2024-04-26T12:06:59.405 INFO:tasks.workunit.client.0.smithi052.stdout:7/915: unlink d1/d1c/d23/d81/d88/ca6 0 2024-04-26T12:06:59.405 INFO:tasks.workunit.client.0.smithi052.stdout:1/839: chown d0/d2/dd/d34/d95/lad 70 1 2024-04-26T12:06:59.405 INFO:tasks.workunit.client.0.smithi052.stdout:2/921: getdents d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/dd3 0 2024-04-26T12:06:59.405 INFO:tasks.workunit.client.0.smithi052.stdout:7/916: dread - d1/d1c/d21/d2f/d68/ff3 zero size 2024-04-26T12:06:59.405 INFO:tasks.workunit.client.0.smithi052.stdout:6/894: write da/d22/d29/d31/d6f/d13c/f9b [797284,17946] 0 2024-04-26T12:06:59.405 INFO:tasks.workunit.client.0.smithi052.stdout:4/879: rename d3/d12/d34/l10c to d3/d12/d64/l12d 0 2024-04-26T12:06:59.405 INFO:tasks.workunit.client.0.smithi052.stdout:1/840: mknod d0/d2/dd/d40/d81/d9a/dce/de9/d9b/c11b 0 2024-04-26T12:06:59.405 INFO:tasks.workunit.client.0.smithi052.stdout:7/917: chown d1/d1f/d55/c87 84 1 2024-04-26T12:06:59.405 INFO:tasks.workunit.client.0.smithi052.stdout:4/880: creat d3/d15/d53/f12e x:0 0 0 2024-04-26T12:06:59.405 INFO:tasks.workunit.client.0.smithi052.stdout:8/874: dwrite d0/d4/d5/d27/fb9 [0,4194304] 0 2024-04-26T12:06:59.405 INFO:tasks.workunit.client.0.smithi052.stdout:0/961: dread d0/d5b/fd0 [0,4194304] 0 2024-04-26T12:06:59.405 INFO:tasks.workunit.client.0.smithi052.stdout:4/881: mkdir d3/d15/d12f 0 2024-04-26T12:06:59.405 INFO:tasks.workunit.client.0.smithi052.stdout:0/962: creat d0/d1/d54/f137 x:0 0 0 2024-04-26T12:06:59.405 INFO:tasks.workunit.client.0.smithi052.stdout:8/875: chown d0/d4/d1c/f2c 999314 1 2024-04-26T12:06:59.405 INFO:tasks.workunit.client.0.smithi052.stdout:7/918: creat d1/d1c/d21/d2f/d68/d10a/f121 x:0 0 0 2024-04-26T12:06:59.406 INFO:tasks.workunit.client.0.smithi052.stdout:0/963: dread - d0/d1/d1a/d20/d47/fb7 zero size 2024-04-26T12:06:59.406 INFO:tasks.workunit.client.0.smithi052.stdout:7/919: mknod d1/d1f/d55/dcb/c122 0 2024-04-26T12:06:59.406 INFO:tasks.workunit.client.0.smithi052.stdout:8/876: chown d0/d4/d5/d27/d57/fed 66116970 1 2024-04-26T12:06:59.406 INFO:tasks.workunit.client.0.smithi052.stdout:2/922: dwrite d0/d3f/d56/d8d/d99/fc8 [0,4194304] 0 2024-04-26T12:06:59.406 INFO:tasks.workunit.client.0.smithi052.stdout:4/882: symlink d3/d12/d59/d96/df7/d125/l130 0 2024-04-26T12:06:59.406 INFO:tasks.workunit.client.0.smithi052.stdout:7/920: readlink d1/d1c/d23/lb5 0 2024-04-26T12:06:59.406 INFO:tasks.workunit.client.0.smithi052.stdout:4/883: creat d3/d12/d59/d96/df7/d125/f131 x:0 0 0 2024-04-26T12:06:59.406 INFO:tasks.workunit.client.0.smithi052.stdout:0/964: link d0/d1/d1a/d20/d47/d84/feb d0/d5b/d9d/d10c/f138 0 2024-04-26T12:06:59.406 INFO:tasks.workunit.client.0.smithi052.stdout:2/923: rename d0/d36/f90 to d0/d3f/d56/d6d/f135 0 2024-04-26T12:06:59.406 INFO:tasks.workunit.client.0.smithi052.stdout:1/841: truncate d0/d2/f2a 12258418 0 2024-04-26T12:06:59.406 INFO:tasks.workunit.client.0.smithi052.stdout:4/884: chown d3/d1f/c3d 6426 1 2024-04-26T12:06:59.406 INFO:tasks.workunit.client.0.smithi052.stdout:1/842: chown d0/d83/fcd 6575688 1 2024-04-26T12:06:59.406 INFO:tasks.workunit.client.0.smithi052.stdout:4/885: symlink d3/d2b/dab/db6/l132 0 2024-04-26T12:06:59.406 INFO:tasks.workunit.client.0.smithi052.stdout:2/924: stat d0/d3f/d56/d6d/d5a/de4/df9/fa9 0 2024-04-26T12:06:59.407 INFO:tasks.workunit.client.0.smithi052.stdout:4/886: fsync d3/d22/f4e 0 2024-04-26T12:06:59.407 INFO:tasks.workunit.client.0.smithi052.stdout:1/843: unlink d0/d2/dd/d40/dc1/d1d/l10f 0 2024-04-26T12:06:59.407 INFO:tasks.workunit.client.0.smithi052.stdout:1/844: unlink d0/d2/dd/d40/dc1/d1d/d91/l7c 0 2024-04-26T12:06:59.407 INFO:tasks.workunit.client.0.smithi052.stdout:8/877: dwrite d0/d4/d1c/f2b [0,4194304] 0 2024-04-26T12:06:59.407 INFO:tasks.workunit.client.0.smithi052.stdout:2/925: truncate d0/d3f/d56/d6d/d5a/d73/d4b/d9c/f12b 196401 0 2024-04-26T12:06:59.407 INFO:tasks.workunit.client.0.smithi052.stdout:0/965: dread d0/d1/d54/f95 [0,4194304] 0 2024-04-26T12:06:59.407 INFO:tasks.workunit.client.0.smithi052.stdout:1/845: write d0/d2/dd/d34/f4e [4414952,1286] 0 2024-04-26T12:06:59.407 INFO:tasks.workunit.client.0.smithi052.stdout:2/926: mkdir d0/d7/d2f/dee/d136 0 2024-04-26T12:06:59.407 INFO:tasks.workunit.client.0.smithi052.stdout:0/966: unlink d0/l7 0 2024-04-26T12:06:59.407 INFO:tasks.workunit.client.0.smithi052.stdout:8/878: write d0/d4/d5/d27/d57/dda/fe1 [38728,30056] 0 2024-04-26T12:06:59.407 INFO:tasks.workunit.client.0.smithi052.stdout:2/927: stat d0/c111 0 2024-04-26T12:06:59.407 INFO:tasks.workunit.client.0.smithi052.stdout:1/846: link d0/f68 d0/d2/d88/dbd/f11c 0 2024-04-26T12:06:59.407 INFO:tasks.workunit.client.0.smithi052.stdout:0/967: write d0/d5b/d9d/ff4 [3460875,82394] 0 2024-04-26T12:06:59.407 INFO:tasks.workunit.client.0.smithi052.stdout:4/887: dwrite d3/d44/d4b/ff5 [0,4194304] 0 2024-04-26T12:06:59.407 INFO:tasks.workunit.client.0.smithi052.stdout:4/888: dread - d3/d12/d34/d45/d67/fc3 zero size 2024-04-26T12:06:59.408 INFO:tasks.workunit.client.0.smithi052.stdout:3/884: dread d2/d4/d6b/f76 [0,4194304] 0 2024-04-26T12:06:59.408 INFO:tasks.workunit.client.0.smithi052.stdout:1/847: fdatasync d0/d2/dd/d40/d81/d9a/dce/de9/d9b/fe5 0 2024-04-26T12:06:59.408 INFO:tasks.workunit.client.0.smithi052.stdout:2/928: rename d0/d7/d2f/c3b to d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/dd3/d121/d4d/c137 0 2024-04-26T12:06:59.408 INFO:tasks.workunit.client.0.smithi052.stdout:0/968: link d0/d1/d2c/d42/da5/dba/dbb/fe9 d0/d1/dd/d12d/f139 0 2024-04-26T12:06:59.408 INFO:tasks.workunit.client.0.smithi052.stdout:9/901: dread d3/db/d10/d3c/d40/d96/da7/feb [0,4194304] 0 2024-04-26T12:06:59.408 INFO:tasks.workunit.client.0.smithi052.stdout:0/969: creat d0/d1/d114/d10f/f13a x:0 0 0 2024-04-26T12:06:59.408 INFO:tasks.workunit.client.0.smithi052.stdout:2/929: mkdir d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/dd3/d121/d4d/d8b/d138 0 2024-04-26T12:06:59.408 INFO:tasks.workunit.client.0.smithi052.stdout:9/902: mkdir d3/d23/dd0/d144 0 2024-04-26T12:06:59.408 INFO:tasks.workunit.client.0.smithi052.stdout:0/970: rmdir d0/d1/d1a 39 2024-04-26T12:06:59.408 INFO:tasks.workunit.client.0.smithi052.stdout:2/930: write d0/f15 [265633,35053] 0 2024-04-26T12:06:59.408 INFO:tasks.workunit.client.0.smithi052.stdout:8/879: read d0/d4/d5/d3c/ff1 [8736,25265] 0 2024-04-26T12:06:59.408 INFO:tasks.workunit.client.0.smithi052.stdout:6/895: dread da/d22/d29/dd4/ddf/d95/fce [0,4194304] 0 2024-04-26T12:06:59.408 INFO:tasks.workunit.client.0.smithi052.stdout:5/923: dread db/dd/d34/fb2 [0,4194304] 0 2024-04-26T12:06:59.408 INFO:tasks.workunit.client.0.smithi052.stdout:9/903: link d3/d23/d7f/cc9 d3/d3b/db0/c145 0 2024-04-26T12:06:59.408 INFO:tasks.workunit.client.0.smithi052.stdout:6/896: sync 2024-04-26T12:06:59.409 INFO:tasks.workunit.client.0.smithi052.stdout:2/931: creat d0/d7/d2f/dee/f139 x:0 0 0 2024-04-26T12:06:59.409 INFO:tasks.workunit.client.0.smithi052.stdout:8/880: mkdir d0/d4/d1c/d83/d123 0 2024-04-26T12:06:59.409 INFO:tasks.workunit.client.0.smithi052.stdout:1/848: dwrite d0/d2/dd/d40/dc1/d1d/d23/f61 [0,4194304] 0 2024-04-26T12:06:59.409 INFO:tasks.workunit.client.0.smithi052.stdout:5/924: read db/dd/d34/fb2 [3043308,93287] 0 2024-04-26T12:06:59.409 INFO:tasks.workunit.client.0.smithi052.stdout:3/885: dwrite d2/d4/d6b/dcf/de4/fa1 [0,4194304] 0 2024-04-26T12:06:59.409 INFO:tasks.workunit.client.0.smithi052.stdout:6/897: fsync da/d22/d29/dd4/ddf/f8f 0 2024-04-26T12:06:59.409 INFO:tasks.workunit.client.0.smithi052.stdout:8/881: fdatasync d0/d4/d5/db/d20/d7b/fd7 0 2024-04-26T12:06:59.409 INFO:tasks.workunit.client.0.smithi052.stdout:2/932: chown d0/d7/d2f/dee/f105 8018059 1 2024-04-26T12:06:59.409 INFO:tasks.workunit.client.0.smithi052.stdout:9/904: dread - d3/db/d10/d3c/d40/d96/da7/fb4 zero size 2024-04-26T12:06:59.409 INFO:tasks.workunit.client.0.smithi052.stdout:5/925: stat db/dc/d5f/d50/ce4 0 2024-04-26T12:06:59.409 INFO:tasks.workunit.client.0.smithi052.stdout:6/898: fsync da/f13 0 2024-04-26T12:06:59.409 INFO:tasks.workunit.client.0.smithi052.stdout:7/921: dread d1/d1c/d21/d2f/d33/f49 [0,4194304] 0 2024-04-26T12:06:59.409 INFO:tasks.workunit.client.0.smithi052.stdout:1/849: readlink d0/d2/dd/d34/d95/l9c 0 2024-04-26T12:06:59.409 INFO:tasks.workunit.client.0.smithi052.stdout:9/905: creat d3/db/d4a/f146 x:0 0 0 2024-04-26T12:06:59.409 INFO:tasks.workunit.client.0.smithi052.stdout:9/906: chown d3/lcb 1110393 1 2024-04-26T12:06:59.410 INFO:tasks.workunit.client.0.smithi052.stdout:3/886: creat d2/d4/dc/d33/d75/dfa/f10d x:0 0 0 2024-04-26T12:06:59.410 INFO:tasks.workunit.client.0.smithi052.stdout:2/933: unlink d0/d3f/d56/d8d/fae 0 2024-04-26T12:06:59.410 INFO:tasks.workunit.client.0.smithi052.stdout:3/887: readlink d2/d4/d2a/d96/lb8 0 2024-04-26T12:06:59.410 INFO:tasks.workunit.client.0.smithi052.stdout:1/850: write d0/d2/dd/d40/dc1/d1d/d91/fbb [297129,83594] 0 2024-04-26T12:06:59.410 INFO:tasks.workunit.client.0.smithi052.stdout:6/899: creat da/d22/d29/d31/f13d x:0 0 0 2024-04-26T12:06:59.410 INFO:tasks.workunit.client.0.smithi052.stdout:9/907: mkdir d3/db/d10/d3c/d40/d96/d147 0 2024-04-26T12:06:59.410 INFO:tasks.workunit.client.0.smithi052.stdout:2/934: mknod d0/d7/d2f/dee/d136/c13a 0 2024-04-26T12:06:59.410 INFO:tasks.workunit.client.0.smithi052.stdout:8/882: rename d0/d4/d5/db/d20/d7b/f92 to d0/d4/dc/d68/f124 0 2024-04-26T12:06:59.410 INFO:tasks.workunit.client.0.smithi052.stdout:3/888: chown d2/d4/dc/d33/d37/f51 344326449 1 2024-04-26T12:06:59.410 INFO:tasks.workunit.client.0.smithi052.stdout:9/908: fsync d3/db/d10/d2e/f11d 0 2024-04-26T12:06:59.410 INFO:tasks.workunit.client.0.smithi052.stdout:2/935: creat d0/f13b x:0 0 0 2024-04-26T12:06:59.410 INFO:tasks.workunit.client.0.smithi052.stdout:5/926: dwrite db/f35 [0,4194304] 0 2024-04-26T12:06:59.410 INFO:tasks.workunit.client.0.smithi052.stdout:1/851: symlink d0/d2/dd/d40/d81/d9a/dce/de9/d9b/d114/l11d 0 2024-04-26T12:06:59.410 INFO:tasks.workunit.client.0.smithi052.stdout:6/900: symlink da/d22/d29/d31/d6f/dcc/l13e 0 2024-04-26T12:06:59.410 INFO:tasks.workunit.client.0.smithi052.stdout:5/927: write db/f35 [1852175,64416] 0 2024-04-26T12:06:59.411 INFO:tasks.workunit.client.0.smithi052.stdout:9/909: mkdir d3/db/d10/d3c/d40/d96/da7/d116/d148 0 2024-04-26T12:06:59.411 INFO:tasks.workunit.client.0.smithi052.stdout:1/852: mkdir d0/d2/dd/d40/dc1/d11e 0 2024-04-26T12:06:59.411 INFO:tasks.workunit.client.0.smithi052.stdout:5/928: dread - db/dd/d34/d69/d8a/f11a zero size 2024-04-26T12:06:59.411 INFO:tasks.workunit.client.0.smithi052.stdout:6/901: mkdir da/d22/d29/dd4/df7/d7e/d13f 0 2024-04-26T12:06:59.411 INFO:tasks.workunit.client.0.smithi052.stdout:2/936: getdents d0/d3f/d56/d6d/d5a/d73/d4b/d9c 0 2024-04-26T12:06:59.411 INFO:tasks.workunit.client.0.smithi052.stdout:8/883: dread d0/d4/d5/d86/d9c/db4/fdc [0,4194304] 0 2024-04-26T12:06:59.411 INFO:tasks.workunit.client.0.smithi052.stdout:3/889: dwrite d2/d4/d6b/fc1 [0,4194304] 0 2024-04-26T12:06:59.411 INFO:tasks.workunit.client.0.smithi052.stdout:4/889: dread d3/d12/d34/d43/f7b [0,4194304] 0 2024-04-26T12:06:59.411 INFO:tasks.workunit.client.0.smithi052.stdout:1/853: read d0/d83/d4b/fd3 [3345794,38135] 0 2024-04-26T12:06:59.411 INFO:tasks.workunit.client.0.smithi052.stdout:0/971: dread d0/d5b/d9d/ff4 [0,4194304] 0 2024-04-26T12:06:59.411 INFO:tasks.workunit.client.0.smithi052.stdout:5/929: symlink db/dd/d34/d69/l130 0 2024-04-26T12:06:59.411 INFO:tasks.workunit.client.0.smithi052.stdout:6/902: truncate da/d51/f5b 5001331 0 2024-04-26T12:06:59.411 INFO:tasks.workunit.client.0.smithi052.stdout:3/890: fsync d2/d4/d2a/f58 0 2024-04-26T12:06:59.411 INFO:tasks.workunit.client.0.smithi052.stdout:8/884: symlink d0/d4/d5/d3c/l125 0 2024-04-26T12:06:59.411 INFO:tasks.workunit.client.0.smithi052.stdout:2/937: rename d0/f12 to d0/d3f/d56/d6d/d5a/d73/f13c 0 2024-04-26T12:06:59.412 INFO:tasks.workunit.client.0.smithi052.stdout:0/972: mknod d0/d1/dd/d12d/c13b 0 2024-04-26T12:06:59.412 INFO:tasks.workunit.client.0.smithi052.stdout:6/903: unlink da/d22/d3c/l57 0 2024-04-26T12:06:59.412 INFO:tasks.workunit.client.0.smithi052.stdout:5/930: mkdir db/dd/d34/d131 0 2024-04-26T12:06:59.412 INFO:tasks.workunit.client.0.smithi052.stdout:3/891: write d2/d4/dc/d33/fbc [856159,119321] 0 2024-04-26T12:06:59.412 INFO:tasks.workunit.client.0.smithi052.stdout:4/890: getdents d3/d1f/d21/dbe/d111 0 2024-04-26T12:06:59.412 INFO:tasks.workunit.client.0.smithi052.stdout:8/885: write d0/d4/d5/d86/d9c/db4/dd8/fdb [674018,84413] 0 2024-04-26T12:06:59.412 INFO:tasks.workunit.client.0.smithi052.stdout:0/973: creat d0/d5b/d9d/d4f/da4/da9/d12e/f13c x:0 0 0 2024-04-26T12:06:59.412 INFO:tasks.workunit.client.0.smithi052.stdout:2/938: unlink d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/dd3/d121/c27 0 2024-04-26T12:06:59.412 INFO:tasks.workunit.client.0.smithi052.stdout:5/931: dread - db/dd/d18/d60/d64/d9c/da0/def/f10a zero size 2024-04-26T12:06:59.412 INFO:tasks.workunit.client.0.smithi052.stdout:4/891: creat d3/d12/d59/f133 x:0 0 0 2024-04-26T12:06:59.412 INFO:tasks.workunit.client.0.smithi052.stdout:0/974: fsync d0/d26/d74/da6/fdd 0 2024-04-26T12:06:59.412 INFO:tasks.workunit.client.0.smithi052.stdout:8/886: rename d0/d4/d1c/d83/d123 to d0/d4/d5/daf/d126 0 2024-04-26T12:06:59.412 INFO:tasks.workunit.client.0.smithi052.stdout:2/939: mkdir d0/d3f/d56/d6d/d5a/ded/d13d 0 2024-04-26T12:06:59.412 INFO:tasks.workunit.client.0.smithi052.stdout:5/932: getdents db/dd 0 2024-04-26T12:06:59.413 INFO:tasks.workunit.client.0.smithi052.stdout:9/910: write d3/db/d10/d3c/f131 [4011530,123641] 0 2024-04-26T12:06:59.413 INFO:tasks.workunit.client.0.smithi052.stdout:8/887: write d0/d4/dc/d68/f79 [2749084,28193] 0 2024-04-26T12:06:59.413 INFO:tasks.workunit.client.0.smithi052.stdout:5/933: chown db/dd/d34/d69/d93/fbb 843804 1 2024-04-26T12:06:59.413 INFO:tasks.workunit.client.0.smithi052.stdout:2/940: creat d0/d3f/d56/d6d/d5a/ded/d125/f13e x:0 0 0 2024-04-26T12:06:59.413 INFO:tasks.workunit.client.0.smithi052.stdout:6/904: dwrite da/d22/d29/dd4/ddf/d7c/fb1 [0,4194304] 0 2024-04-26T12:06:59.413 INFO:tasks.workunit.client.0.smithi052.stdout:8/888: write d0/d4/d5/d27/f10d [173523,103519] 0 2024-04-26T12:06:59.413 INFO:tasks.workunit.client.0.smithi052.stdout:3/892: truncate d2/d4/dc/d1d/d25/d61/fb3 4587620 0 2024-04-26T12:06:59.413 INFO:tasks.workunit.client.0.smithi052.stdout:2/941: dread - d0/d3f/d56/d8d/f12d zero size 2024-04-26T12:06:59.413 INFO:tasks.workunit.client.0.smithi052.stdout:6/905: dread - da/d22/d29/d31/d6f/f113 zero size 2024-04-26T12:06:59.413 INFO:tasks.workunit.client.0.smithi052.stdout:0/975: dwrite d0/d1/f5c [0,4194304] 0 2024-04-26T12:06:59.413 INFO:tasks.workunit.client.0.smithi052.stdout:8/889: truncate d0/d16/d63/d8b/fe5 730266 0 2024-04-26T12:06:59.413 INFO:tasks.workunit.client.0.smithi052.stdout:6/906: creat da/d22/d29/d31/d6f/d13c/d9c/f140 x:0 0 0 2024-04-26T12:06:59.413 INFO:tasks.workunit.client.0.smithi052.stdout:7/922: dread d1/d1c/f1e [0,4194304] 0 2024-04-26T12:06:59.413 INFO:tasks.workunit.client.0.smithi052.stdout:8/890: mkdir d0/d4/d127 0 2024-04-26T12:06:59.413 INFO:tasks.workunit.client.0.smithi052.stdout:1/854: dwrite d0/f68 [0,4194304] 0 2024-04-26T12:06:59.414 INFO:tasks.workunit.client.0.smithi052.stdout:1/855: creat d0/d83/d4b/db2/f11f x:0 0 0 2024-04-26T12:06:59.414 INFO:tasks.workunit.client.0.smithi052.stdout:6/907: dread - da/d22/d29/dd4/df7/d7e/d8b/f10c zero size 2024-04-26T12:06:59.414 INFO:tasks.workunit.client.0.smithi052.stdout:7/923: chown d1/d1c/d21/d2f/d33/d3a/d64/le5 0 1 2024-04-26T12:06:59.414 INFO:tasks.workunit.client.0.smithi052.stdout:1/856: fdatasync d0/f20 0 2024-04-26T12:06:59.414 INFO:tasks.workunit.client.0.smithi052.stdout:2/942: truncate d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/dd3/d121/d4d/f10f 1291831 0 2024-04-26T12:06:59.414 INFO:tasks.workunit.client.0.smithi052.stdout:8/891: truncate d0/d4/d5/d27/d57/d8a/f117 9619 0 2024-04-26T12:06:59.414 INFO:tasks.workunit.client.0.smithi052.stdout:3/893: dwrite d2/d4/dc/d1d/d25/d36/d1c/f20 [4194304,4194304] 0 2024-04-26T12:06:59.414 INFO:tasks.workunit.client.0.smithi052.stdout:1/857: rmdir d0/d2/dd/d40/d81/d9a/dce/de9 39 2024-04-26T12:06:59.414 INFO:tasks.workunit.client.0.smithi052.stdout:2/943: creat d0/d3f/f13f x:0 0 0 2024-04-26T12:06:59.414 INFO:tasks.workunit.client.0.smithi052.stdout:8/892: fsync d0/d4/d5/d27/d57/dda/dfb/f109 0 2024-04-26T12:06:59.414 INFO:tasks.workunit.client.0.smithi052.stdout:6/908: mkdir da/d22/d29/dd4/ddf/d95/d141 0 2024-04-26T12:06:59.414 INFO:tasks.workunit.client.0.smithi052.stdout:0/976: dread d0/f3 [12582912,4194304] 0 2024-04-26T12:06:59.414 INFO:tasks.workunit.client.0.smithi052.stdout:7/924: getdents d1/d1c/d21/d2f/d68 0 2024-04-26T12:06:59.414 INFO:tasks.workunit.client.0.smithi052.stdout:2/944: stat d0/d7/f39 0 2024-04-26T12:06:59.415 INFO:tasks.workunit.client.0.smithi052.stdout:0/977: readlink d0/d1/dd/l127 0 2024-04-26T12:06:59.415 INFO:tasks.workunit.client.0.smithi052.stdout:2/945: readlink d0/d3f/d56/d6d/l89 0 2024-04-26T12:06:59.415 INFO:tasks.workunit.client.0.smithi052.stdout:8/893: dread - d0/d4/dc/d68/fa6 zero size 2024-04-26T12:06:59.415 INFO:tasks.workunit.client.0.smithi052.stdout:1/858: rename d0/d2/dd/d40/l87 to d0/d2/dd/d40/dc1/d1d/l120 0 2024-04-26T12:06:59.415 INFO:tasks.workunit.client.0.smithi052.stdout:7/925: read d1/f7 [2357072,74905] 0 2024-04-26T12:06:59.415 INFO:tasks.workunit.client.0.smithi052.stdout:0/978: chown d0/d1/dd/c109 5 1 2024-04-26T12:06:59.415 INFO:tasks.workunit.client.0.smithi052.stdout:6/909: truncate da/d22/d29/dd4/df7/d87/fdc 1176927 0 2024-04-26T12:06:59.415 INFO:tasks.workunit.client.0.smithi052.stdout:7/926: mkdir d1/d1c/d65/d123 0 2024-04-26T12:06:59.415 INFO:tasks.workunit.client.0.smithi052.stdout:8/894: fsync d0/d16/d63/d8b/f119 0 2024-04-26T12:06:59.415 INFO:tasks.workunit.client.0.smithi052.stdout:2/946: truncate d0/d3f/d56/d6d/f120 828752 0 2024-04-26T12:06:59.415 INFO:tasks.workunit.client.0.smithi052.stdout:0/979: write d0/d1/d1a/fe5 [4238104,62809] 0 2024-04-26T12:06:59.415 INFO:tasks.workunit.client.0.smithi052.stdout:6/910: chown da/d22/d29/dd4/df7/d87/dfb/l133 9387 1 2024-04-26T12:06:59.415 INFO:tasks.workunit.client.0.smithi052.stdout:3/894: dwrite d2/d4/d41/f66 [0,4194304] 0 2024-04-26T12:06:59.415 INFO:tasks.workunit.client.0.smithi052.stdout:2/947: chown d0/d7/d22/ff8 3 1 2024-04-26T12:06:59.415 INFO:tasks.workunit.client.0.smithi052.stdout:0/980: symlink d0/d5b/d9d/d4f/da4/l13d 0 2024-04-26T12:06:59.416 INFO:tasks.workunit.client.0.smithi052.stdout:8/895: truncate d0/d4/d5/d86/d9c/fd9 369549 0 2024-04-26T12:06:59.416 INFO:tasks.workunit.client.0.smithi052.stdout:6/911: write da/d22/d29/d31/fa6 [178596,111235] 0 2024-04-26T12:06:59.416 INFO:tasks.workunit.client.0.smithi052.stdout:1/859: write d0/d2/dd/d34/d95/d10b/dde/f79 [1546874,36096] 0 2024-04-26T12:06:59.416 INFO:tasks.workunit.client.0.smithi052.stdout:2/948: write d0/d7/d2f/ffc [354206,61277] 0 2024-04-26T12:06:59.416 INFO:tasks.workunit.client.0.smithi052.stdout:0/981: rename d0/d5b/c50 to d0/d1/d114/d10f/c13e 0 2024-04-26T12:06:59.416 INFO:tasks.workunit.client.0.smithi052.stdout:1/860: rename d0/d83/c86 to d0/d83/d4b/c121 0 2024-04-26T12:06:59.416 INFO:tasks.workunit.client.0.smithi052.stdout:0/982: getdents d0/d3d 0 2024-04-26T12:06:59.416 INFO:tasks.workunit.client.0.smithi052.stdout:6/912: truncate da/d51/f62 477050 0 2024-04-26T12:06:59.416 INFO:tasks.workunit.client.0.smithi052.stdout:0/983: write d0/d1/d1a/f132 [689917,83549] 0 2024-04-26T12:06:59.416 INFO:tasks.workunit.client.0.smithi052.stdout:1/861: truncate d0/d83/d4b/db2/f11f 946569 0 2024-04-26T12:06:59.416 INFO:tasks.workunit.client.0.smithi052.stdout:0/984: dread - d0/d26/d36/fff zero size 2024-04-26T12:06:59.416 INFO:tasks.workunit.client.0.smithi052.stdout:6/913: symlink da/d22/d29/d31/d39/dc7/l142 0 2024-04-26T12:06:59.416 INFO:tasks.workunit.client.0.smithi052.stdout:0/985: mknod d0/d26/d74/db4/de1/d115/c13f 0 2024-04-26T12:06:59.416 INFO:tasks.workunit.client.0.smithi052.stdout:1/862: read d0/f64 [533208,27948] 0 2024-04-26T12:06:59.416 INFO:tasks.workunit.client.0.smithi052.stdout:2/949: read d0/fb0 [3458764,38355] 0 2024-04-26T12:06:59.417 INFO:tasks.workunit.client.0.smithi052.stdout:0/986: creat d0/d1/d2c/f140 x:0 0 0 2024-04-26T12:06:59.417 INFO:tasks.workunit.client.0.smithi052.stdout:1/863: fdatasync d0/d83/fcd 0 2024-04-26T12:06:59.417 INFO:tasks.workunit.client.0.smithi052.stdout:2/950: creat d0/d3f/d56/d6d/d5a/ded/d125/f140 x:0 0 0 2024-04-26T12:06:59.417 INFO:tasks.workunit.client.0.smithi052.stdout:2/951: fsync d0/d3f/f12f 0 2024-04-26T12:06:59.417 INFO:tasks.workunit.client.0.smithi052.stdout:0/987: link d0/d5b/d9d/d32/cf8 d0/d1/dd/c141 0 2024-04-26T12:06:59.417 INFO:tasks.workunit.client.0.smithi052.stdout:8/896: dread d0/d4/f38 [0,4194304] 0 2024-04-26T12:06:59.417 INFO:tasks.workunit.client.0.smithi052.stdout:0/988: mkdir d0/d1/dd/d142 0 2024-04-26T12:06:59.417 INFO:tasks.workunit.client.0.smithi052.stdout:1/864: truncate d0/f68 2057991 0 2024-04-26T12:06:59.417 INFO:tasks.workunit.client.0.smithi052.stdout:6/914: dread da/d22/d29/d31/f4f [0,4194304] 0 2024-04-26T12:06:59.417 INFO:tasks.workunit.client.0.smithi052.stdout:4/892: sync 2024-04-26T12:06:59.417 INFO:tasks.workunit.client.0.smithi052.stdout:9/911: sync 2024-04-26T12:06:59.417 INFO:tasks.workunit.client.0.smithi052.stdout:0/989: creat d0/d1/d1a/dce/f143 x:0 0 0 2024-04-26T12:06:59.417 INFO:tasks.workunit.client.0.smithi052.stdout:8/897: fdatasync d0/d4/d5/d86/d9c/db4/d58/d89/f113 0 2024-04-26T12:06:59.417 INFO:tasks.workunit.client.0.smithi052.stdout:1/865: mknod d0/d2/dd/d40/dc1/d1d/d23/c122 0 2024-04-26T12:06:59.417 INFO:tasks.workunit.client.0.smithi052.stdout:4/893: creat d3/d15/d11f/f134 x:0 0 0 2024-04-26T12:06:59.418 INFO:tasks.workunit.client.0.smithi052.stdout:4/894: chown d3/d12/f9a 1 1 2024-04-26T12:06:59.418 INFO:tasks.workunit.client.0.smithi052.stdout:8/898: rmdir d0/d4/d5/d27/d57/dda 39 2024-04-26T12:06:59.418 INFO:tasks.workunit.client.0.smithi052.stdout:6/915: mknod da/d22/d29/dd4/ddf/d92/d96/d131/c143 0 2024-04-26T12:06:59.418 INFO:tasks.workunit.client.0.smithi052.stdout:2/952: dwrite d0/d3f/d56/d6d/d5a/d82/d91/f108 [0,4194304] 0 2024-04-26T12:06:59.418 INFO:tasks.workunit.client.0.smithi052.stdout:1/866: rename d0/d2/dd/d40/d81/d9a/cfb to d0/d2/dd/d34/d95/d10b/dde/c123 0 2024-04-26T12:06:59.418 INFO:tasks.workunit.client.0.smithi052.stdout:6/916: creat da/d22/d29/dd4/ddf/d7c/d94/f144 x:0 0 0 2024-04-26T12:06:59.418 INFO:tasks.workunit.client.0.smithi052.stdout:4/895: creat d3/d12/d59/d96/dc0/d92/f135 x:0 0 0 2024-04-26T12:06:59.418 INFO:tasks.workunit.client.0.smithi052.stdout:1/867: chown d0/da/d2e/fed 20410754 1 2024-04-26T12:06:59.418 INFO:tasks.workunit.client.0.smithi052.stdout:2/953: creat d0/d7/d22/f141 x:0 0 0 2024-04-26T12:06:59.418 INFO:tasks.workunit.client.0.smithi052.stdout:9/912: dread d3/db/d10/d3c/d40/d96/db5/d8f/f108 [0,4194304] 0 2024-04-26T12:06:59.418 INFO:tasks.workunit.client.0.smithi052.stdout:1/868: chown d0/d2/dd/d34/d95/d10b 4 1 2024-04-26T12:06:59.418 INFO:tasks.workunit.client.0.smithi052.stdout:9/913: fsync d3/d3b/f3e 0 2024-04-26T12:06:59.421 INFO:tasks.workunit.client.0.smithi052.stdout:1/869: mkdir d0/d83/d124 0 2024-04-26T12:06:59.421 INFO:tasks.workunit.client.0.smithi052.stdout:2/954: creat d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/dd3/d121/f142 x:0 0 0 2024-04-26T12:06:59.421 INFO:tasks.workunit.client.0.smithi052.stdout:4/896: getdents d3/d12/d34/d45/d67/d6c/d86 0 2024-04-26T12:06:59.421 INFO:tasks.workunit.client.0.smithi052.stdout:9/914: write d3/d23/d7f/fa1 [918927,112122] 0 2024-04-26T12:06:59.421 INFO:tasks.workunit.client.0.smithi052.stdout:7/927: dread d1/d1f/f22 [0,4194304] 0 2024-04-26T12:06:59.421 INFO:tasks.workunit.client.0.smithi052.stdout:1/870: creat d0/d2/dd/d40/d81/d52/f125 x:0 0 0 2024-04-26T12:06:59.421 INFO:tasks.workunit.client.0.smithi052.stdout:2/955: mknod d0/d3f/d56/d6d/d5a/d73/d4b/d9c/c143 0 2024-04-26T12:06:59.421 INFO:tasks.workunit.client.0.smithi052.stdout:9/915: write d3/db/d10/d2e/f132 [391354,125087] 0 2024-04-26T12:06:59.422 INFO:tasks.workunit.client.0.smithi052.stdout:9/916: stat d3/d23/c130 0 2024-04-26T12:06:59.422 INFO:tasks.workunit.client.0.smithi052.stdout:2/956: rename d0/d3f/d56/d6d/d5a/d73/d4b/d9c/c107 to d0/d3f/d56/d6d/d5a/d73/c144 0 2024-04-26T12:06:59.422 INFO:tasks.workunit.client.0.smithi052.stdout:7/928: truncate d1/d1c/d21/d2f/d33/d3a/f40 7106281 0 2024-04-26T12:06:59.422 INFO:tasks.workunit.client.0.smithi052.stdout:7/929: rename d1/d1c/f9a to d1/d1c/d21/d2f/d33/d3a/d64/f124 0 2024-04-26T12:06:59.422 INFO:tasks.workunit.client.0.smithi052.stdout:1/871: dwrite d0/da/d2e/fa8 [0,4194304] 0 2024-04-26T12:06:59.422 INFO:tasks.workunit.client.0.smithi052.stdout:9/917: dwrite d3/d3b/dea/dfe/f12f [0,4194304] 0 2024-04-26T12:06:59.422 INFO:tasks.workunit.client.0.smithi052.stdout:0/990: dread d0/d1/d11/f17 [0,4194304] 0 2024-04-26T12:06:59.422 INFO:tasks.workunit.client.0.smithi052.stdout:1/872: truncate d0/da/db5/dcb/ff7 279595 0 2024-04-26T12:06:59.422 INFO:tasks.workunit.client.0.smithi052.stdout:9/918: symlink d3/db/d10/d3c/d40/d96/db5/da3/d133/d141/l149 0 2024-04-26T12:06:59.422 INFO:tasks.workunit.client.0.smithi052.stdout:9/919: symlink d3/db/d10/d3c/d40/d96/db5/d8f/l14a 0 2024-04-26T12:06:59.422 INFO:tasks.workunit.client.0.smithi052.stdout:0/991: mkdir d0/d1/d2c/d42/da5/dba/dbb/d144 0 2024-04-26T12:06:59.422 INFO:tasks.workunit.client.0.smithi052.stdout:9/920: rmdir d3/db/d2b/dd4 39 2024-04-26T12:06:59.422 INFO:tasks.workunit.client.0.smithi052.stdout:0/992: mknod d0/d26/d74/c145 0 2024-04-26T12:06:59.422 INFO:tasks.workunit.client.0.smithi052.stdout:9/921: creat d3/db/d10/d3c/d40/d96/da7/f14b x:0 0 0 2024-04-26T12:06:59.422 INFO:tasks.workunit.client.0.smithi052.stdout:0/993: creat d0/d1/dd/d12d/f146 x:0 0 0 2024-04-26T12:06:59.423 INFO:tasks.workunit.client.0.smithi052.stdout:9/922: chown d3/c95 5964247 1 2024-04-26T12:06:59.423 INFO:tasks.workunit.client.0.smithi052.stdout:9/923: getdents d3/db/d13 0 2024-04-26T12:06:59.423 INFO:tasks.workunit.client.0.smithi052.stdout:9/924: symlink d3/d3b/db0/l14c 0 2024-04-26T12:06:59.423 INFO:tasks.workunit.client.0.smithi052.stdout:9/925: rename d3/db/d10/d3c/d40/d96/db5/da3/d133 to d3/db/d10/d3c/d40/d96/d120/d14d 0 2024-04-26T12:06:59.423 INFO:tasks.workunit.client.0.smithi052.stdout:0/994: dwrite d0/d1/d1a/d20/d47/d84/feb [0,4194304] 0 2024-04-26T12:06:59.423 INFO:tasks.workunit.client.0.smithi052.stdout:4/897: dread d3/d12/d59/d96/dc0/f74 [0,4194304] 0 2024-04-26T12:06:59.424 INFO:tasks.workunit.client.0.smithi052.stdout:0/995: truncate d0/d26/d74/f7f 945520 0 2024-04-26T12:06:59.424 INFO:tasks.workunit.client.0.smithi052.stdout:9/926: truncate d3/db/d10/d3c/d40/d96/da7/feb 1688229 0 2024-04-26T12:06:59.425 INFO:tasks.workunit.client.0.smithi052.stdout:4/898: link d3/d12/d34/d43/da1/lc4 d3/d15/d12f/l136 0 2024-04-26T12:06:59.425 INFO:tasks.workunit.client.0.smithi052.stdout:0/996: write d0/d26/d74/da6/ffb [674091,50097] 0 2024-04-26T12:06:59.425 INFO:tasks.workunit.client.0.smithi052.stdout:9/927: mknod d3/d3b/d102/d122/d136/c14e 0 2024-04-26T12:06:59.426 INFO:tasks.workunit.client.0.smithi052.stdout:9/928: fsync d3/db/d10/d3c/d40/d96/db5/d8f/f5e 0 2024-04-26T12:06:59.427 INFO:tasks.workunit.client.0.smithi052.stdout:4/899: rename d3/d12/d34/d45/d67/d6c/f8f to d3/d44/d4b/db8/dde/d118/f137 0 2024-04-26T12:06:59.427 INFO:tasks.workunit.client.0.smithi052.stdout:9/929: fsync d3/d3b/f3e 0 2024-04-26T12:06:59.428 INFO:tasks.workunit.client.0.smithi052.stdout:9/930: readlink d3/db/d10/d2e/lc2 0 2024-04-26T12:06:59.428 INFO:tasks.workunit.client.0.smithi052.stdout:4/900: rename d3/d12/d34/d43/c7a to d3/d1f/d21/dd2/c138 0 2024-04-26T12:06:59.429 INFO:tasks.workunit.client.0.smithi052.stdout:9/931: fdatasync d3/d3b/d102/f135 0 2024-04-26T12:06:59.429 INFO:tasks.workunit.client.0.smithi052.stdout:4/901: read - d3/d15/f115 zero size 2024-04-26T12:06:59.430 INFO:tasks.workunit.client.0.smithi052.stdout:0/997: dwrite d0/d1/d54/f137 [0,4194304] 0 2024-04-26T12:06:59.430 INFO:tasks.workunit.client.0.smithi052.stdout:4/902: write d3/d15/f2a [3242525,82822] 0 2024-04-26T12:06:59.430 INFO:tasks.workunit.client.0.smithi052.stdout:9/932: read - d3/db/d10/d2e/d5c/f125 zero size 2024-04-26T12:06:59.432 INFO:tasks.workunit.client.0.smithi052.stdout:2/957: dread d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/dd3/d121/d3a/ff5 [4194304,4194304] 0 2024-04-26T12:06:59.432 INFO:tasks.workunit.client.0.smithi052.stdout:9/933: chown d3/d23/c4b 419788465 1 2024-04-26T12:06:59.432 INFO:tasks.workunit.client.0.smithi052.stdout:0/998: creat d0/d5b/d9d/d32/f147 x:0 0 0 2024-04-26T12:06:59.432 INFO:tasks.workunit.client.0.smithi052.stdout:4/903: symlink d3/d2b/dab/dec/l139 0 2024-04-26T12:06:59.433 INFO:tasks.workunit.client.0.smithi052.stdout:0/999: fdatasync d0/d1/dd/d12d/f139 0 2024-04-26T12:06:59.433 INFO:tasks.workunit.client.0.smithi052.stdout:4/904: creat d3/d44/d4b/db8/f13a x:0 0 0 2024-04-26T12:06:59.434 INFO:tasks.workunit.client.0.smithi052.stdout:4/905: chown d3/d22/d69 79514 1 2024-04-26T12:06:59.434 INFO:tasks.workunit.client.0.smithi052.stdout:7/930: dread d1/d1c/d21/d2f/f11a [0,4194304] 0 2024-04-26T12:06:59.434 INFO:tasks.workunit.client.0.smithi052.stdout:2/958: getdents d0/d3f/d56/d6d/d5a/d82/de2 0 2024-04-26T12:06:59.435 INFO:tasks.workunit.client.0.smithi052.stdout:9/934: rename d3/db/d10/d3c/d40/d96/db5/d8f/d49 to d3/db/d10/d2e/d134/d14f 0 2024-04-26T12:06:59.435 INFO:tasks.workunit.client.0.smithi052.stdout:7/931: unlink d1/d1c/dd3/f113 0 2024-04-26T12:06:59.435 INFO:tasks.workunit.client.0.smithi052.stdout:4/906: chown d3/d12/d34/d43/ff3 1 1 2024-04-26T12:06:59.436 INFO:tasks.workunit.client.0.smithi052.stdout:2/959: fsync d0/d3f/d56/d8d/f118 0 2024-04-26T12:06:59.436 INFO:tasks.workunit.client.0.smithi052.stdout:1/873: dread d0/d2/dd/d40/dc1/d1d/d23/fa1 [0,4194304] 0 2024-04-26T12:06:59.436 INFO:tasks.workunit.client.0.smithi052.stdout:4/907: readlink d3/d44/l85 0 2024-04-26T12:06:59.437 INFO:tasks.workunit.client.0.smithi052.stdout:3/895: sync 2024-04-26T12:06:59.437 INFO:tasks.workunit.client.0.smithi052.stdout:5/934: sync 2024-04-26T12:06:59.437 INFO:tasks.workunit.client.0.smithi052.stdout:6/917: sync 2024-04-26T12:06:59.438 INFO:tasks.workunit.client.0.smithi052.stdout:6/918: dread - da/d22/d3c/ff5 zero size 2024-04-26T12:06:59.439 INFO:tasks.workunit.client.0.smithi052.stdout:5/935: fdatasync db/dc/d5f/d50/fd7 0 2024-04-26T12:06:59.439 INFO:tasks.workunit.client.0.smithi052.stdout:1/874: getdents d0/d2/dd/d34/d95/d10b/dde 0 2024-04-26T12:06:59.440 INFO:tasks.workunit.client.0.smithi052.stdout:9/935: truncate d3/db/d10/d2e/fe6 2484834 0 2024-04-26T12:06:59.440 INFO:tasks.workunit.client.0.smithi052.stdout:3/896: stat d2/d4/dc/d1d/d25/d36/d1c/d4e/f10a 0 2024-04-26T12:06:59.440 INFO:tasks.workunit.client.0.smithi052.stdout:7/932: read d1/dab/d4c/fae [804071,88164] 0 2024-04-26T12:06:59.440 INFO:tasks.workunit.client.0.smithi052.stdout:6/919: unlink da/d22/d29/l2a 0 2024-04-26T12:06:59.441 INFO:tasks.workunit.client.0.smithi052.stdout:5/936: dread - db/dd/d34/d70/d59/ffb zero size 2024-04-26T12:06:59.442 INFO:tasks.workunit.client.0.smithi052.stdout:9/936: chown d3/l118 4017061 1 2024-04-26T12:06:59.442 INFO:tasks.workunit.client.0.smithi052.stdout:3/897: write d2/d4/d2a/f58 [4441855,65927] 0 2024-04-26T12:06:59.442 INFO:tasks.workunit.client.0.smithi052.stdout:1/875: write d0/d2/dd/f6e [2615756,120128] 0 2024-04-26T12:06:59.444 INFO:tasks.workunit.client.0.smithi052.stdout:4/908: dwrite d3/d12/d34/d43/fcf [4194304,4194304] 0 2024-04-26T12:06:59.444 INFO:tasks.workunit.client.0.smithi052.stdout:2/960: dwrite d0/d3f/d56/d8d/d99/db9/f10c [0,4194304] 0 2024-04-26T12:06:59.444 INFO:tasks.workunit.client.0.smithi052.stdout:3/898: stat d2/d4/d2a/d2d/f78 0 2024-04-26T12:06:59.445 INFO:tasks.workunit.client.0.smithi052.stdout:1/876: read - d0/d83/fcd zero size 2024-04-26T12:06:59.446 INFO:tasks.workunit.client.0.smithi052.stdout:5/937: dread - db/dd/d34/d69/d8a/da9/dd6/f127 zero size 2024-04-26T12:06:59.446 INFO:tasks.workunit.client.0.smithi052.stdout:6/920: link c7 da/d22/d29/d31/d6f/d13c/d9c/d123/c145 0 2024-04-26T12:06:59.446 INFO:tasks.workunit.client.0.smithi052.stdout:3/899: creat d2/d4/d2a/f10e x:0 0 0 2024-04-26T12:06:59.447 INFO:tasks.workunit.client.0.smithi052.stdout:9/937: write d3/db/d10/d3c/d40/d96/db5/d8f/fbd [2422921,25305] 0 2024-04-26T12:06:59.447 INFO:tasks.workunit.client.0.smithi052.stdout:1/877: write d0/d2/dd/d40/d81/f46 [76176,21546] 0 2024-04-26T12:06:59.448 INFO:tasks.workunit.client.0.smithi052.stdout:6/921: chown da/d22/d29/d31/d6f/d13c/c65 107298419 1 2024-04-26T12:06:59.448 INFO:tasks.workunit.client.0.smithi052.stdout:5/938: fsync db/dd/d34/d69/d8a/da9/dd6/f127 0 2024-04-26T12:06:59.449 INFO:tasks.workunit.client.0.smithi052.stdout:8/899: sync 2024-04-26T12:06:59.449 INFO:tasks.workunit.client.0.smithi052.stdout:4/909: link d3/d12/d34/d45/d67/d6c/d86/c11a d3/d2b/d40/c13b 0 2024-04-26T12:06:59.449 INFO:tasks.workunit.client.0.smithi052.stdout:2/961: link d0/d7/l1b d0/d3f/d56/d8d/d99/db9/l145 0 2024-04-26T12:06:59.449 INFO:tasks.workunit.client.0.smithi052.stdout:7/933: dwrite d1/d1c/d21/d2f/f7d [0,4194304] 0 2024-04-26T12:06:59.449 INFO:tasks.workunit.client.0.smithi052.stdout:3/900: write d2/d4/dc/d33/d75/dfa/f10d [1024231,110970] 0 2024-04-26T12:06:59.450 INFO:tasks.workunit.client.0.smithi052.stdout:1/878: write d0/da/d2e/fa8 [4117704,117740] 0 2024-04-26T12:06:59.451 INFO:tasks.workunit.client.0.smithi052.stdout:8/900: rmdir d0/d4/d5 39 2024-04-26T12:06:59.451 INFO:tasks.workunit.client.0.smithi052.stdout:4/910: stat d3/d12/d34/d45 0 2024-04-26T12:06:59.452 INFO:tasks.workunit.client.0.smithi052.stdout:5/939: mknod db/dd/d18/d60/c132 0 2024-04-26T12:06:59.452 INFO:tasks.workunit.client.0.smithi052.stdout:3/901: mkdir d2/d4/d6b/d10f 0 2024-04-26T12:06:59.452 INFO:tasks.workunit.client.0.smithi052.stdout:6/922: creat da/d22/d97/d115/f146 x:0 0 0 2024-04-26T12:06:59.452 INFO:tasks.workunit.client.0.smithi052.stdout:1/879: mknod d0/d83/d4b/db2/c126 0 2024-04-26T12:06:59.452 INFO:tasks.workunit.client.0.smithi052.stdout:7/934: chown d1/dab/d4c/l5e 248956617 1 2024-04-26T12:06:59.453 INFO:tasks.workunit.client.0.smithi052.stdout:8/901: write d0/d4/dc/d68/fa6 [549466,41919] 0 2024-04-26T12:06:59.453 INFO:tasks.workunit.client.0.smithi052.stdout:4/911: chown d3/d22/d69/c9f 96899 1 2024-04-26T12:06:59.453 INFO:tasks.workunit.client.0.smithi052.stdout:3/902: creat d2/d4/dc/f110 x:0 0 0 2024-04-26T12:06:59.454 INFO:tasks.workunit.client.0.smithi052.stdout:2/962: mknod d0/d3f/d56/d6d/d5a/d73/d4b/c146 0 2024-04-26T12:06:59.454 INFO:tasks.workunit.client.0.smithi052.stdout:7/935: dread - d1/dab/d4c/dd6/d102/f118 zero size 2024-04-26T12:06:59.455 INFO:tasks.workunit.client.0.smithi052.stdout:9/938: dwrite d3/d23/d7f/fb2 [0,4194304] 0 2024-04-26T12:06:59.455 INFO:tasks.workunit.client.0.smithi052.stdout:6/923: read da/d22/d29/dd4/ddf/d7c/f8e [159538,11039] 0 2024-04-26T12:06:59.456 INFO:tasks.workunit.client.0.smithi052.stdout:8/902: fdatasync d0/d4/d5/da3/ff8 0 2024-04-26T12:06:59.456 INFO:tasks.workunit.client.0.smithi052.stdout:3/903: write d2/d4/dc/f110 [705140,80512] 0 2024-04-26T12:06:59.456 INFO:tasks.workunit.client.0.smithi052.stdout:4/912: truncate d3/d15/f115 671245 0 2024-04-26T12:06:59.456 INFO:tasks.workunit.client.0.smithi052.stdout:5/940: rename db/dd/d34/d69/d8a/da9/d87/d6e/db8/d11e/fea to db/dd/d34/d70/d59/f133 0 2024-04-26T12:06:59.457 INFO:tasks.workunit.client.0.smithi052.stdout:4/913: chown d3/d15/d12f 96 1 2024-04-26T12:06:59.457 INFO:tasks.workunit.client.0.smithi052.stdout:1/880: truncate d0/d2/dd/d40/d81/d9a/dce/de9/ffd 250118 0 2024-04-26T12:06:59.457 INFO:tasks.workunit.client.0.smithi052.stdout:7/936: symlink d1/d1c/d21/d2f/d33/d3a/d64/l125 0 2024-04-26T12:06:59.458 INFO:tasks.workunit.client.0.smithi052.stdout:6/924: dread - da/d22/d29/d31/d39/dc7/d114/f122 zero size 2024-04-26T12:06:59.458 INFO:tasks.workunit.client.0.smithi052.stdout:9/939: creat d3/db/d10/d3c/d40/d96/db5/d8f/ddc/f150 x:0 0 0 2024-04-26T12:06:59.459 INFO:tasks.workunit.client.0.smithi052.stdout:1/881: chown d0/d2/dd/d34/d95/l9c 1665588 1 2024-04-26T12:06:59.459 INFO:tasks.workunit.client.0.smithi052.stdout:3/904: rename d2/d4/d2a/fb9 to d2/d4/d81/db6/f111 0 2024-04-26T12:06:59.459 INFO:tasks.workunit.client.0.smithi052.stdout:6/925: rmdir da/d22/d29/d31/d108 39 2024-04-26T12:06:59.460 INFO:tasks.workunit.client.0.smithi052.stdout:7/937: mknod d1/dab/d4c/c126 0 2024-04-26T12:06:59.461 INFO:tasks.workunit.client.0.smithi052.stdout:9/940: rename d3/db/d2b/dd4 to d3/db/d2b/ded/d151 0 2024-04-26T12:06:59.462 INFO:tasks.workunit.client.0.smithi052.stdout:3/905: link d2/d4/d41/d5c/c5d d2/d4/d6b/c112 0 2024-04-26T12:06:59.462 INFO:tasks.workunit.client.0.smithi052.stdout:7/938: rmdir d1/d1c/d21/d2f/d33/dc7 39 2024-04-26T12:06:59.462 INFO:tasks.workunit.client.0.smithi052.stdout:9/941: mkdir d3/d3b/dea/dfe/d152 0 2024-04-26T12:06:59.463 INFO:tasks.workunit.client.0.smithi052.stdout:7/939: creat d1/d1f/d55/ddd/f127 x:0 0 0 2024-04-26T12:06:59.463 INFO:tasks.workunit.client.0.smithi052.stdout:4/914: dwrite d3/d1f/d21/f119 [0,4194304] 0 2024-04-26T12:06:59.464 INFO:tasks.workunit.client.0.smithi052.stdout:4/915: rename d3/d22/d30/l35 to d3/d44/d4b/l13c 0 2024-04-26T12:06:59.465 INFO:tasks.workunit.client.0.smithi052.stdout:9/942: link d3/d23/d7f/cc9 d3/d23/dd0/c153 0 2024-04-26T12:06:59.465 INFO:tasks.workunit.client.0.smithi052.stdout:4/916: readlink d3/d22/d69/ld4 0 2024-04-26T12:06:59.466 INFO:tasks.workunit.client.0.smithi052.stdout:9/943: creat d3/db/d10/daa/f154 x:0 0 0 2024-04-26T12:06:59.467 INFO:tasks.workunit.client.0.smithi052.stdout:4/917: symlink d3/d12/d59/d96/l13d 0 2024-04-26T12:06:59.467 INFO:tasks.workunit.client.0.smithi052.stdout:9/944: mkdir d3/d23/df0/d155 0 2024-04-26T12:06:59.468 INFO:tasks.workunit.client.0.smithi052.stdout:7/940: dwrite d1/d1c/d21/d2f/ffa [0,4194304] 0 2024-04-26T12:06:59.469 INFO:tasks.workunit.client.0.smithi052.stdout:4/918: creat d3/d12/d34/d45/d67/d6c/f13e x:0 0 0 2024-04-26T12:06:59.470 INFO:tasks.workunit.client.0.smithi052.stdout:7/941: rename d1/f35 to d1/d1c/d10c/f128 0 2024-04-26T12:06:59.471 INFO:tasks.workunit.client.0.smithi052.stdout:1/882: truncate d0/d2/dd/f14 1166014 0 2024-04-26T12:06:59.472 INFO:tasks.workunit.client.0.smithi052.stdout:8/903: dread d0/d4/dc/d68/fa6 [0,4194304] 0 2024-04-26T12:06:59.473 INFO:tasks.workunit.client.0.smithi052.stdout:1/883: mkdir d0/da/db5/dcb/d127 0 2024-04-26T12:06:59.473 INFO:tasks.workunit.client.0.smithi052.stdout:8/904: write d0/d4/d5/d86/d9c/fdf [29514,89824] 0 2024-04-26T12:06:59.474 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:59.473+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:59.474 INFO:tasks.workunit.client.0.smithi052.stdout:8/905: sync 2024-04-26T12:06:59.474 INFO:tasks.workunit.client.0.smithi052.stdout:9/945: dwrite d3/d3b/fd2 [4194304,4194304] 0 2024-04-26T12:06:59.477 INFO:tasks.workunit.client.0.smithi052.stdout:9/946: unlink d3/db/d4a/f78 0 2024-04-26T12:06:59.478 INFO:tasks.workunit.client.0.smithi052.stdout:9/947: fdatasync d3/f11f 0 2024-04-26T12:06:59.478 INFO:tasks.workunit.client.0.smithi052.stdout:7/942: dwrite d1/d1c/d21/d2f/d68/ff3 [0,4194304] 0 2024-04-26T12:06:59.479 INFO:tasks.workunit.client.0.smithi052.stdout:9/948: chown d3/db/d2b/la0 29126 1 2024-04-26T12:06:59.483 INFO:tasks.workunit.client.0.smithi052.stdout:7/943: creat d1/db7/f129 x:0 0 0 2024-04-26T12:06:59.483 INFO:tasks.workunit.client.0.smithi052.stdout:9/949: write d3/d3b/fac [2618009,82417] 0 2024-04-26T12:06:59.483 INFO:tasks.workunit.client.0.smithi052.stdout:7/944: sync 2024-04-26T12:06:59.483 INFO:tasks.workunit.client.0.smithi052.stdout:9/950: chown d3/db/d13/f79 21675 1 2024-04-26T12:06:59.483 INFO:tasks.workunit.client.0.smithi052.stdout:9/951: sync 2024-04-26T12:06:59.484 INFO:tasks.workunit.client.0.smithi052.stdout:7/945: fsync d1/d1f/d55/feb 0 2024-04-26T12:06:59.484 INFO:tasks.workunit.client.0.smithi052.stdout:9/952: mknod d3/d23/df0/c156 0 2024-04-26T12:06:59.484 INFO:tasks.workunit.client.0.smithi052.stdout:3/906: dread d2/d4/dc/f6f [0,4194304] 0 2024-04-26T12:06:59.484 INFO:tasks.workunit.client.0.smithi052.stdout:7/946: chown d1/d1c/d21/d2f/lf1 121899 1 2024-04-26T12:06:59.484 INFO:tasks.workunit.client.0.smithi052.stdout:3/907: symlink d2/d4/d41/d5c/l113 0 2024-04-26T12:06:59.484 INFO:tasks.workunit.client.0.smithi052.stdout:3/908: fsync d2/d4/f64 0 2024-04-26T12:06:59.484 INFO:tasks.workunit.client.0.smithi052.stdout:1/884: dread d0/d83/d4b/db2/f11f [0,4194304] 0 2024-04-26T12:06:59.485 INFO:tasks.workunit.client.0.smithi052.stdout:7/947: creat d1/d1c/d21/d2f/d33/d92/f12a x:0 0 0 2024-04-26T12:06:59.485 INFO:tasks.workunit.client.0.smithi052.stdout:3/909: chown d2/d4/dc/d33/d37/fad 252384515 1 2024-04-26T12:06:59.486 INFO:tasks.workunit.client.0.smithi052.stdout:7/948: creat d1/d1c/d21/d2f/d33/d3a/d64/f12b x:0 0 0 2024-04-26T12:06:59.486 INFO:tasks.workunit.client.0.smithi052.stdout:3/910: write d2/d4/dc/f110 [1140654,10994] 0 2024-04-26T12:06:59.486 INFO:tasks.workunit.client.0.smithi052.stdout:1/885: rename d0/da/db5 to d0/d2/dd/d40/d81/d9a/dce/de9/d9b/d114/d128 0 2024-04-26T12:06:59.486 INFO:tasks.workunit.client.0.smithi052.stdout:7/949: stat d1/dab/d4c/c126 0 2024-04-26T12:06:59.487 INFO:tasks.workunit.client.0.smithi052.stdout:9/953: dwrite d3/db/d10/d3c/d40/d96/f100 [0,4194304] 0 2024-04-26T12:06:59.487 INFO:tasks.workunit.client.0.smithi052.stdout:7/950: write d1/f27 [1623717,84510] 0 2024-04-26T12:06:59.489 INFO:tasks.workunit.client.0.smithi052.stdout:6/926: dread da/d22/d3c/f66 [0,4194304] 0 2024-04-26T12:06:59.489 INFO:tasks.workunit.client.0.smithi052.stdout:9/954: symlink d3/db/d10/d3c/d40/d96/db5/da3/l157 0 2024-04-26T12:06:59.489 INFO:tasks.workunit.client.0.smithi052.stdout:9/955: sync 2024-04-26T12:06:59.490 INFO:tasks.workunit.client.0.smithi052.stdout:7/951: creat d1/dab/d4c/dd6/d102/f12c x:0 0 0 2024-04-26T12:06:59.491 INFO:tasks.workunit.client.0.smithi052.stdout:9/956: dread - d3/db/d4a/dc6/f110 zero size 2024-04-26T12:06:59.492 INFO:tasks.workunit.client.0.smithi052.stdout:6/927: truncate da/d22/f3b 4660523 0 2024-04-26T12:06:59.492 INFO:tasks.workunit.client.0.smithi052.stdout:3/911: dwrite d2/d4/d41/fdf [0,4194304] 0 2024-04-26T12:06:59.493 INFO:tasks.workunit.client.0.smithi052.stdout:7/952: creat d1/d1c/d21/d2f/d33/d3a/de8/f12d x:0 0 0 2024-04-26T12:06:59.493 INFO:tasks.workunit.client.0.smithi052.stdout:1/886: read - d0/da/ffe zero size 2024-04-26T12:06:59.494 INFO:tasks.workunit.client.0.smithi052.stdout:5/941: dread db/dc/d5f/d10c/fdb [0,4194304] 0 2024-04-26T12:06:59.495 INFO:tasks.workunit.client.0.smithi052.stdout:6/928: creat da/d22/d29/dd4/df7/d104/f147 x:0 0 0 2024-04-26T12:06:59.495 INFO:tasks.workunit.client.0.smithi052.stdout:7/953: write d1/d1c/d21/f7f [1454558,31485] 0 2024-04-26T12:06:59.496 INFO:tasks.workunit.client.0.smithi052.stdout:3/912: rename d2/d4/dc/d33/d37/f3a to d2/d4/d2a/d2d/f114 0 2024-04-26T12:06:59.496 INFO:tasks.workunit.client.0.smithi052.stdout:6/929: mknod da/d63/c148 0 2024-04-26T12:06:59.498 INFO:tasks.workunit.client.0.smithi052.stdout:7/954: mkdir d1/dab/d12e 0 2024-04-26T12:06:59.498 INFO:tasks.workunit.client.0.smithi052.stdout:5/942: creat db/dd/d18/d60/d64/d9c/da0/df1/dfa/f134 x:0 0 0 2024-04-26T12:06:59.498 INFO:tasks.workunit.client.0.smithi052.stdout:3/913: unlink d2/d4/d41/cec 0 2024-04-26T12:06:59.498 INFO:tasks.workunit.client.0.smithi052.stdout:6/930: read - da/d22/d3c/ff5 zero size 2024-04-26T12:06:59.498 INFO:tasks.workunit.client.0.smithi052.stdout:9/957: dwrite d3/d23/fec [4194304,4194304] 0 2024-04-26T12:06:59.499 INFO:tasks.workunit.client.0.smithi052.stdout:5/943: chown db/dd/d34/d70/l2c 14804 1 2024-04-26T12:06:59.499 INFO:tasks.workunit.client.0.smithi052.stdout:3/914: mkdir d2/d4/d6b/d10f/d115 0 2024-04-26T12:06:59.500 INFO:tasks.workunit.client.0.smithi052.stdout:4/919: dread d3/d2e/ffa [0,4194304] 0 2024-04-26T12:06:59.500 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:59.500 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:59.501 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:06:59.501 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:59.501 INFO:tasks.workunit.client.0.smithi052.stdout:9/958: mknod d3/db/d10/daa/c158 0 2024-04-26T12:06:59.501 INFO:tasks.workunit.client.0.smithi052.stdout:7/955: mkdir d1/d1c/d21/d2f/d33/d12f 0 2024-04-26T12:06:59.502 INFO:tasks.workunit.client.0.smithi052.stdout:3/915: read d2/d4/dc/d1d/d25/d61/f93 [398251,9919] 0 2024-04-26T12:06:59.504 INFO:tasks.workunit.client.0.smithi052.stdout:5/944: link db/dd/c98 db/dc/d5f/d50/d91/dd2/c135 0 2024-04-26T12:06:59.504 INFO:tasks.workunit.client.0.smithi052.stdout:3/916: rmdir d2/d1f 39 2024-04-26T12:06:59.505 INFO:tasks.workunit.client.0.smithi052.stdout:2/963: dread d0/f4 [0,4194304] 0 2024-04-26T12:06:59.505 INFO:tasks.workunit.client.0.smithi052.stdout:3/917: sync 2024-04-26T12:06:59.506 INFO:tasks.workunit.client.0.smithi052.stdout:5/945: mkdir db/d5c/db3/d136 0 2024-04-26T12:06:59.506 INFO:tasks.workunit.client.0.smithi052.stdout:2/964: stat d0/d7/d22/f84 0 2024-04-26T12:06:59.507 INFO:tasks.workunit.client.0.smithi052.stdout:6/931: dwrite da/d22/d29/dd4/ddf/d92/fb3 [0,4194304] 0 2024-04-26T12:06:59.508 INFO:tasks.workunit.client.0.smithi052.stdout:1/887: dread d0/d83/d4b/d56/f9d [0,4194304] 0 2024-04-26T12:06:59.509 INFO:tasks.workunit.client.0.smithi052.stdout:4/920: dwrite d3/d12/d34/d45/d67/d6c/f13e [0,4194304] 0 2024-04-26T12:06:59.510 INFO:tasks.workunit.client.0.smithi052.stdout:4/921: sync 2024-04-26T12:06:59.510 INFO:tasks.workunit.client.0.smithi052.stdout:9/959: dwrite d3/f99 [0,4194304] 0 2024-04-26T12:06:59.512 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:06:59.513 INFO:tasks.workunit.client.0.smithi052.stdout:8/906: dread d0/d4/d5/d86/d9c/db4/d58/d8f/f91 [0,4194304] 0 2024-04-26T12:06:59.514 INFO:tasks.workunit.client.0.smithi052.stdout:3/918: dwrite d2/d4/d81/db6/f111 [4194304,4194304] 0 2024-04-26T12:06:59.516 INFO:tasks.workunit.client.0.smithi052.stdout:5/946: symlink db/dd/d34/d69/d93/l137 0 2024-04-26T12:06:59.516 INFO:tasks.workunit.client.0.smithi052.stdout:1/888: creat d0/d2/dd/d40/d81/d9a/da6/f129 x:0 0 0 2024-04-26T12:06:59.517 INFO:tasks.workunit.client.0.smithi052.stdout:4/922: rmdir d3/d22/d69 39 2024-04-26T12:06:59.517 INFO:tasks.workunit.client.0.smithi052.stdout:3/919: creat d2/d4/d2a/d2d/f116 x:0 0 0 2024-04-26T12:06:59.517 INFO:tasks.workunit.client.0.smithi052.stdout:2/965: mkdir d0/d3f/d56/d6d/d5a/ded/d125/d147 0 2024-04-26T12:06:59.518 INFO:tasks.workunit.client.0.smithi052.stdout:6/932: mknod da/d22/d29/d31/d6f/d13c/c149 0 2024-04-26T12:06:59.518 INFO:tasks.workunit.client.0.smithi052.stdout:5/947: readlink db/d5c/db3/lb7 0 2024-04-26T12:06:59.519 INFO:tasks.workunit.client.0.smithi052.stdout:4/923: write d3/d2b/dab/dec/df8/f113 [777379,112167] 0 2024-04-26T12:06:59.520 INFO:tasks.workunit.client.0.smithi052.stdout:6/933: rmdir da/d22/d29/d31/d6f 39 2024-04-26T12:06:59.520 INFO:tasks.workunit.client.0.smithi052.stdout:2/966: mknod d0/d3f/d56/d6d/d5a/ded/d125/c148 0 2024-04-26T12:06:59.520 INFO:tasks.workunit.client.0.smithi052.stdout:5/948: dread - db/dc/d5f/d50/d46/d74/fff zero size 2024-04-26T12:06:59.521 INFO:tasks.workunit.client.0.smithi052.stdout:2/967: stat d0/d36 0 2024-04-26T12:06:59.521 INFO:tasks.workunit.client.0.smithi052.stdout:3/920: write d2/d4/dc/d1d/d25/d36/f86 [569610,124493] 0 2024-04-26T12:06:59.522 INFO:tasks.workunit.client.0.smithi052.stdout:7/956: dread d1/d1c/d21/d2f/d33/d3a/d64/ff9 [0,4194304] 0 2024-04-26T12:06:59.523 INFO:tasks.workunit.client.0.smithi052.stdout:6/934: mkdir da/d22/d29/dd4/ddf/d92/d96/d14a 0 2024-04-26T12:06:59.523 INFO:tasks.workunit.client.0.smithi052.stdout:8/907: dwrite d0/d4/d5/d86/d9c/db4/f9f [0,4194304] 0 2024-04-26T12:06:59.525 INFO:tasks.workunit.client.0.smithi052.stdout:2/968: mkdir d0/d3f/d56/d6d/d5a/d73/d4b/d8f/d149 0 2024-04-26T12:06:59.525 INFO:tasks.workunit.client.0.smithi052.stdout:1/889: dwrite d0/da/ffe [0,4194304] 0 2024-04-26T12:06:59.526 INFO:tasks.workunit.client.0.smithi052.stdout:6/935: rmdir da/d22/d29/dd4/ddf 39 2024-04-26T12:06:59.527 INFO:tasks.workunit.client.0.smithi052.stdout:7/957: getdents d1/dab/d4c 0 2024-04-26T12:06:59.527 INFO:tasks.workunit.client.0.smithi052.stdout:8/908: creat d0/d3e/d87/d11c/f128 x:0 0 0 2024-04-26T12:06:59.529 INFO:tasks.workunit.client.0.smithi052.stdout:4/924: dwrite d3/d12/d34/d43/ff3 [0,4194304] 0 2024-04-26T12:06:59.532 INFO:tasks.workunit.client.0.smithi052.stdout:4/925: chown d3/d15/d76 5405 1 2024-04-26T12:06:59.533 INFO:tasks.workunit.client.0.smithi052.stdout:8/909: creat d0/d4/d5/d86/d9c/db4/d58/d89/f129 x:0 0 0 2024-04-26T12:06:59.533 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-26T12:06:59.533 INFO:tasks.workunit.client.0.smithi052.stdout:1/890: write d0/d2/dd/d40/d81/d9a/dce/de9/d9b/d114/d128/dcb/ff7 [1026996,23175] 0 2024-04-26T12:06:59.533 INFO:tasks.workunit.client.0.smithi052.stdout:3/921: dwrite d2/d4/dc/d33/d37/f109 [0,4194304] 0 2024-04-26T12:06:59.537 INFO:tasks.workunit.client.0.smithi052.stdout:3/922: fdatasync d2/d4/d2a/dbf/db0/d6a/f5f 0 2024-04-26T12:06:59.537 INFO:tasks.workunit.client.0.smithi052.stdout:8/910: symlink d0/d4/d5/db/d20/d7b/l12a 0 2024-04-26T12:06:59.538 INFO:tasks.workunit.client.0.smithi052.stdout:3/923: rmdir d2/d4/dc/d68 39 2024-04-26T12:06:59.541 INFO:tasks.workunit.client.0.smithi052.stdout:3/924: symlink d2/d1f/l117 0 2024-04-26T12:06:59.541 INFO:tasks.workunit.client.0.smithi052.stdout:8/911: creat d0/d4/d1c/f12b x:0 0 0 2024-04-26T12:06:59.541 INFO:tasks.workunit.client.0.smithi052.stdout:1/891: dwrite d0/d2/dd/d40/dc1/d1d/f9f [0,4194304] 0 2024-04-26T12:06:59.542 INFO:tasks.workunit.client.0.smithi052.stdout:3/925: write d2/d4/d41/d5c/f92 [3355128,23234] 0 2024-04-26T12:06:59.543 INFO:tasks.workunit.client.0.smithi052.stdout:8/912: unlink d0/d4/d5/d27/d69/f11d 0 2024-04-26T12:06:59.544 INFO:tasks.workunit.client.0.smithi052.stdout:4/926: dwrite d3/d22/d30/f5c [0,4194304] 0 2024-04-26T12:06:59.544 INFO:tasks.workunit.client.0.smithi052.stdout:3/926: chown d2/d4/d2a/d2d 476 1 2024-04-26T12:06:59.545 INFO:tasks.workunit.client.0.smithi052.stdout:4/927: creat d3/d44/d4b/f13f x:0 0 0 2024-04-26T12:06:59.545 INFO:tasks.workunit.client.0.smithi052.stdout:8/913: mknod d0/d4/d5/db/d20/d7b/c12c 0 2024-04-26T12:06:59.546 INFO:tasks.workunit.client.0.smithi052.stdout:4/928: readlink d3/d15/d76/l100 0 2024-04-26T12:06:59.548 INFO:tasks.workunit.client.0.smithi052.stdout:4/929: mkdir d3/d12/d59/d96/dc0/d92/d140 0 2024-04-26T12:06:59.548 INFO:tasks.workunit.client.0.smithi052.stdout:5/949: dread db/dd/d18/d60/f9a [0,4194304] 0 2024-04-26T12:06:59.549 INFO:tasks.workunit.client.0.smithi052.stdout:5/950: fdatasync db/dd/d34/fed 0 2024-04-26T12:06:59.550 INFO:tasks.workunit.client.0.smithi052.stdout:5/951: truncate db/dd/d18/d60/f83 2946156 0 2024-04-26T12:06:59.551 INFO:tasks.workunit.client.0.smithi052.stdout:5/952: fsync db/dc/d5f/d50/d91/fe6 0 2024-04-26T12:06:59.552 INFO:tasks.workunit.client.0.smithi052.stdout:4/930: dwrite d3/d1f/d21/f66 [0,4194304] 0 2024-04-26T12:06:59.552 INFO:tasks.workunit.client.0.smithi052.stdout:5/953: write db/dc/d5f/d50/d46/d74/f126 [284728,37459] 0 2024-04-26T12:06:59.553 INFO:tasks.workunit.client.0.smithi052.stdout:5/954: dread - db/dd/d34/d70/d59/fee zero size 2024-04-26T12:06:59.554 INFO:tasks.workunit.client.0.smithi052.stdout:5/955: truncate db/d5c/f118 1772718 0 2024-04-26T12:06:59.566 INFO:tasks.workunit.client.0.smithi052.stdout:3/927: dread d2/d4/dc/d33/d75/f84 [0,4194304] 0 2024-04-26T12:06:59.574 INFO:tasks.workunit.client.0.smithi052.stdout:9/960: truncate d3/d23/d7f/fa1 432960 0 2024-04-26T12:06:59.574 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:06:59.573+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:06:59.577 INFO:tasks.workunit.client.0.smithi052.stdout:9/961: dwrite d3/d23/dd0/d11c/f123 [0,4194304] 0 2024-04-26T12:06:59.579 INFO:tasks.workunit.client.0.smithi052.stdout:9/962: rename d3/d23/f13b to d3/db/d10/d2e/f159 0 2024-04-26T12:06:59.579 INFO:tasks.workunit.client.0.smithi052.stdout:9/963: creat d3/db/d13/f15a x:0 0 0 2024-04-26T12:06:59.580 INFO:tasks.workunit.client.0.smithi052.stdout:8/914: sync 2024-04-26T12:06:59.580 INFO:tasks.workunit.client.0.smithi052.stdout:8/915: chown d0/d4/dc/d68/le9 178600099 1 2024-04-26T12:06:59.581 INFO:tasks.workunit.client.0.smithi052.stdout:9/964: truncate d3/db/d10/d54/fc8 865837 0 2024-04-26T12:06:59.581 INFO:tasks.workunit.client.0.smithi052.stdout:8/916: chown d0/d4/d5/dbf 846028 1 2024-04-26T12:06:59.582 INFO:tasks.workunit.client.0.smithi052.stdout:9/965: creat d3/db/d10/d3c/d40/d96/db5/d8f/ddc/f15b x:0 0 0 2024-04-26T12:06:59.582 INFO:tasks.workunit.client.0.smithi052.stdout:9/966: dread - d3/db/d10/d3c/d40/d96/db5/d8f/ddc/f15b zero size 2024-04-26T12:06:59.584 INFO:tasks.workunit.client.0.smithi052.stdout:7/958: write d1/f9f [2119284,50406] 0 2024-04-26T12:06:59.584 INFO:tasks.workunit.client.0.smithi052.stdout:2/969: write d0/d3f/d56/d8d/d99/fea [1043319,89771] 0 2024-04-26T12:06:59.585 INFO:tasks.workunit.client.0.smithi052.stdout:2/970: creat d0/d7/f14a x:0 0 0 2024-04-26T12:06:59.585 INFO:tasks.workunit.client.0.smithi052.stdout:7/959: truncate d1/d1f/d55/fca 1137192 0 2024-04-26T12:06:59.598 INFO:tasks.workunit.client.0.smithi052.stdout:7/960: dread d1/f9f [0,4194304] 0 2024-04-26T12:06:59.599 INFO:tasks.workunit.client.0.smithi052.stdout:7/961: chown d1/d1c/d23/d81 5 1 2024-04-26T12:06:59.603 INFO:tasks.workunit.client.0.smithi052.stdout:1/892: write d0/d2/dd/d40/dc1/d1d/d91/f8a [4518928,16240] 0 2024-04-26T12:06:59.603 INFO:tasks.workunit.client.0.smithi052.stdout:5/956: write db/dd/d34/d69/d8a/da9/d87/fb9 [562163,46079] 0 2024-04-26T12:06:59.604 INFO:tasks.workunit.client.0.smithi052.stdout:4/931: write d3/d12/fa2 [1783916,58073] 0 2024-04-26T12:06:59.604 INFO:tasks.workunit.client.0.smithi052.stdout:5/957: stat f1 0 2024-04-26T12:06:59.604 INFO:tasks.workunit.client.0.smithi052.stdout:1/893: fdatasync d0/d2/dd/d40/dc1/f116 0 2024-04-26T12:06:59.604 INFO:tasks.workunit.client.0.smithi052.stdout:4/932: creat d3/d15/f141 x:0 0 0 2024-04-26T12:06:59.605 INFO:tasks.workunit.client.0.smithi052.stdout:4/933: read d3/d15/f115 [468213,41621] 0 2024-04-26T12:06:59.605 INFO:tasks.workunit.client.0.smithi052.stdout:1/894: symlink d0/d2/dd/d40/d81/d9a/dce/de9/d9b/l12a 0 2024-04-26T12:06:59.608 INFO:tasks.workunit.client.0.smithi052.stdout:5/958: dwrite db/dd/d18/d60/d64/d9c/fe9 [0,4194304] 0 2024-04-26T12:06:59.609 INFO:tasks.workunit.client.0.smithi052.stdout:4/934: dread d3/d12/d59/d96/dc0/f74 [0,4194304] 0 2024-04-26T12:06:59.610 INFO:tasks.workunit.client.0.smithi052.stdout:5/959: write db/dc/d5f/d50/d46/f79 [1155224,100833] 0 2024-04-26T12:06:59.610 INFO:tasks.workunit.client.0.smithi052.stdout:4/935: fdatasync d3/d2b/dab/db6/db7/fd0 0 2024-04-26T12:06:59.611 INFO:tasks.workunit.client.0.smithi052.stdout:5/960: truncate db/dc/d5f/d50/d91/fe6 4724626 0 2024-04-26T12:06:59.612 INFO:tasks.workunit.client.0.smithi052.stdout:3/928: truncate d2/d4/d6b/d7b/f7d 4944118 0 2024-04-26T12:06:59.613 INFO:tasks.workunit.client.0.smithi052.stdout:5/961: truncate db/dd/d18/d60/d64/d9c/da0/df1/dfa/f134 320506 0 2024-04-26T12:06:59.613 INFO:tasks.workunit.client.0.smithi052.stdout:3/929: mknod d2/d4/d2a/d96/dfc/c118 0 2024-04-26T12:06:59.614 INFO:tasks.workunit.client.0.smithi052.stdout:4/936: dwrite d3/d12/d34/d45/d67/d6c/f13e [0,4194304] 0 2024-04-26T12:06:59.614 INFO:tasks.workunit.client.0.smithi052.stdout:3/930: write d2/d4/dc/d1d/d25/d36/d1c/d4e/fed [719345,24155] 0 2024-04-26T12:06:59.615 INFO:tasks.workunit.client.0.smithi052.stdout:5/962: getdents db/dd/d34/d69/d8a/da9/d87/d6e 0 2024-04-26T12:06:59.615 INFO:tasks.workunit.client.0.smithi052.stdout:4/937: chown d3/d12/fa2 8750872 1 2024-04-26T12:06:59.616 INFO:tasks.workunit.client.0.smithi052.stdout:5/963: mkdir db/d5c/db3/d138 0 2024-04-26T12:06:59.617 INFO:tasks.workunit.client.0.smithi052.stdout:3/931: read d2/d4/d6b/fc1 [92833,125139] 0 2024-04-26T12:06:59.617 INFO:tasks.workunit.client.0.smithi052.stdout:4/938: read d3/d22/d30/fae [970152,103386] 0 2024-04-26T12:06:59.617 INFO:tasks.workunit.client.0.smithi052.stdout:8/917: creat d0/d4/f12d x:0 0 0 2024-04-26T12:06:59.617 INFO:tasks.workunit.client.0.smithi052.stdout:3/932: rmdir d2/d4 39 2024-04-26T12:06:59.618 INFO:tasks.workunit.client.0.smithi052.stdout:4/939: mknod d3/d22/d69/c142 0 2024-04-26T12:06:59.618 INFO:tasks.workunit.client.0.smithi052.stdout:8/918: creat d0/d4/d5/dbf/f12e x:0 0 0 2024-04-26T12:06:59.618 INFO:tasks.workunit.client.0.smithi052.stdout:3/933: write d2/d4/d41/d59/f8f [512109,87010] 0 2024-04-26T12:06:59.619 INFO:tasks.workunit.client.0.smithi052.stdout:4/940: unlink d3/d2b/dab/db6/db7/cee 0 2024-04-26T12:06:59.620 INFO:tasks.workunit.client.0.smithi052.stdout:4/941: write d3/d12/d59/f82 [116070,126389] 0 2024-04-26T12:06:59.620 INFO:tasks.workunit.client.0.smithi052.stdout:3/934: getdents d2/d4/dc/d1d/d3f/da2 0 2024-04-26T12:06:59.620 INFO:tasks.workunit.client.0.smithi052.stdout:4/942: chown d3/d2b/dab/fe9 23483681 1 2024-04-26T12:06:59.621 INFO:tasks.workunit.client.0.smithi052.stdout:3/935: unlink d2/d4/d2a/d2d/fbd 0 2024-04-26T12:06:59.621 INFO:tasks.workunit.client.0.smithi052.stdout:4/943: write d3/d12/d34/d43/fb3 [1516189,103835] 0 2024-04-26T12:06:59.622 INFO:tasks.workunit.client.0.smithi052.stdout:9/967: rename d3/d23/d7f/fa1 to d3/db/d10/d3c/d40/d96/d147/f15c 0 2024-04-26T12:06:59.622 INFO:tasks.workunit.client.0.smithi052.stdout:3/936: truncate d2/d4/d81/db6/f111 9355219 0 2024-04-26T12:06:59.623 INFO:tasks.workunit.client.0.smithi052.stdout:3/937: mknod d2/d4/d2a/c119 0 2024-04-26T12:06:59.623 INFO:tasks.workunit.client.0.smithi052.stdout:4/944: rename d3/d2b/dab/db6/fbc to d3/d2b/d40/d10f/f143 0 2024-04-26T12:06:59.623 INFO:tasks.workunit.client.0.smithi052.stdout:5/964: dread db/dc/d5f/f36 [0,4194304] 0 2024-04-26T12:06:59.623 INFO:tasks.workunit.client.0.smithi052.stdout:9/968: dread - d3/db/d10/d3c/d40/d96/db5/da3/f117 zero size 2024-04-26T12:06:59.624 INFO:tasks.workunit.client.0.smithi052.stdout:3/938: fsync d2/d4/d2a/dbf/fab 0 2024-04-26T12:06:59.624 INFO:tasks.workunit.client.0.smithi052.stdout:3/939: symlink d2/d4/dc/d33/d8a/l11a 0 2024-04-26T12:06:59.625 INFO:tasks.workunit.client.0.smithi052.stdout:5/965: symlink db/dd/d18/d60/d64/d9c/da0/df1/df2/l139 0 2024-04-26T12:06:59.625 INFO:tasks.workunit.client.0.smithi052.stdout:3/940: fsync d2/d4/f64 0 2024-04-26T12:06:59.626 INFO:tasks.workunit.client.0.smithi052.stdout:5/966: unlink db/dd/d34/d69/d8a/da9/dd6/f128 0 2024-04-26T12:06:59.626 INFO:tasks.workunit.client.0.smithi052.stdout:3/941: creat d2/d4/d6b/dcf/de4/dc3/f11b x:0 0 0 2024-04-26T12:06:59.627 INFO:tasks.workunit.client.0.smithi052.stdout:5/967: symlink db/dd/d34/d69/d93/l13a 0 2024-04-26T12:06:59.627 INFO:tasks.workunit.client.0.smithi052.stdout:3/942: chown d2/f73 7073763 1 2024-04-26T12:06:59.628 INFO:tasks.workunit.client.0.smithi052.stdout:4/945: dwrite d3/d12/d59/d96/dc0/f77 [0,4194304] 0 2024-04-26T12:06:59.628 INFO:tasks.workunit.client.0.smithi052.stdout:2/971: write d0/d3f/d56/d8d/f118 [4352568,10354] 0 2024-04-26T12:06:59.628 INFO:tasks.workunit.client.0.smithi052.stdout:4/946: readlink d3/d12/d34/d45/l5f 0 2024-04-26T12:06:59.629 INFO:tasks.workunit.client.0.smithi052.stdout:1/895: sync 2024-04-26T12:06:59.629 INFO:tasks.workunit.client.0.smithi052.stdout:3/943: rename d2/d4/d2a/d96/fc7 to d2/d4/d41/db5/f11c 0 2024-04-26T12:06:59.629 INFO:tasks.workunit.client.0.smithi052.stdout:7/962: truncate d1/d1c/d21/f7f 4084282 0 2024-04-26T12:06:59.630 INFO:tasks.workunit.client.0.smithi052.stdout:5/968: rename db/dc/d5f/d50/c4f to db/dd/d34/d69/d8a/da9/d87/d6e/db8/c13b 0 2024-04-26T12:06:59.630 INFO:tasks.workunit.client.0.smithi052.stdout:7/963: unlink d1/d1c/d23/d81/caa 0 2024-04-26T12:06:59.630 INFO:tasks.workunit.client.0.smithi052.stdout:4/947: creat d3/d1f/d21/f144 x:0 0 0 2024-04-26T12:06:59.631 INFO:tasks.workunit.client.0.smithi052.stdout:2/972: mknod d0/d3f/d56/d6d/d5a/d73/d4b/d8f/c14b 0 2024-04-26T12:06:59.631 INFO:tasks.workunit.client.0.smithi052.stdout:1/896: truncate d0/d2/dd/d40/dc1/f116 425635 0 2024-04-26T12:06:59.632 INFO:tasks.workunit.client.0.smithi052.stdout:7/964: creat d1/d1c/f130 x:0 0 0 2024-04-26T12:06:59.632 INFO:tasks.workunit.client.0.smithi052.stdout:4/948: chown d3/d44/d4b/db8/fdb 46425 1 2024-04-26T12:06:59.632 INFO:tasks.workunit.client.0.smithi052.stdout:2/973: mkdir d0/d7/d2f/dee/d14c 0 2024-04-26T12:06:59.632 INFO:tasks.workunit.client.0.smithi052.stdout:8/919: truncate d0/d3e/f42 291372 0 2024-04-26T12:06:59.633 INFO:tasks.workunit.client.0.smithi052.stdout:4/949: creat d3/d22/d69/f145 x:0 0 0 2024-04-26T12:06:59.633 INFO:tasks.workunit.client.0.smithi052.stdout:5/969: rename db/dd/d34/d69/d8a/da9/d87/d6e/fec to db/d5c/f13c 0 2024-04-26T12:06:59.634 INFO:tasks.workunit.client.0.smithi052.stdout:1/897: write d0/d2/dd/d40/dc1/d1d/d91/fc3 [4153659,100909] 0 2024-04-26T12:06:59.634 INFO:tasks.workunit.client.0.smithi052.stdout:9/969: truncate d3/d23/dd0/d11c/f123 800152 0 2024-04-26T12:06:59.635 INFO:tasks.workunit.client.0.smithi052.stdout:4/950: creat d3/d1f/f146 x:0 0 0 2024-04-26T12:06:59.635 INFO:tasks.workunit.client.0.smithi052.stdout:7/965: creat d1/d1c/d21/d2f/d33/d3a/f131 x:0 0 0 2024-04-26T12:06:59.635 INFO:tasks.workunit.client.0.smithi052.stdout:8/920: symlink d0/d4/d5/d86/l12f 0 2024-04-26T12:06:59.636 INFO:tasks.workunit.client.0.smithi052.stdout:1/898: write d0/d83/d4b/d56/f74 [5020068,109535] 0 2024-04-26T12:06:59.637 INFO:tasks.workunit.client.0.smithi052.stdout:2/974: creat d0/d3f/d56/d6d/d5a/de4/df9/d132/f14d x:0 0 0 2024-04-26T12:06:59.637 INFO:tasks.workunit.client.0.smithi052.stdout:3/944: dwrite d2/d4/dc/d1d/d25/d36/d1c/f20 [0,4194304] 0 2024-04-26T12:06:59.638 INFO:tasks.workunit.client.0.smithi052.stdout:9/970: write d3/db/d2b/f84 [3361264,43581] 0 2024-04-26T12:06:59.638 INFO:tasks.workunit.client.0.smithi052.stdout:8/921: creat d0/f130 x:0 0 0 2024-04-26T12:06:59.639 INFO:tasks.workunit.client.0.smithi052.stdout:7/966: dread - d1/d1c/d21/d2f/d33/d3a/de8/f12d zero size 2024-04-26T12:06:59.640 INFO:tasks.workunit.client.0.smithi052.stdout:2/975: chown d0/d3f/d56/d6d/d5a/d82/d91/l126 106832 1 2024-04-26T12:06:59.641 INFO:tasks.workunit.client.0.smithi052.stdout:7/967: truncate d1/d1c/d21/d2f/fb1 510670 0 2024-04-26T12:06:59.642 INFO:tasks.workunit.client.0.smithi052.stdout:9/971: symlink d3/db/d10/d3c/d40/d96/da7/l15d 0 2024-04-26T12:06:59.643 INFO:tasks.workunit.client.0.smithi052.stdout:9/972: readlink d3/d23/dd0/ld6 0 2024-04-26T12:06:59.643 INFO:tasks.workunit.client.0.smithi052.stdout:4/951: truncate d3/d2e/ffa 3131222 0 2024-04-26T12:06:59.644 INFO:tasks.workunit.client.0.smithi052.stdout:7/968: mknod d1/d1c/d21/d2f/d33/d3a/de8/c132 0 2024-04-26T12:06:59.644 INFO:tasks.workunit.client.0.smithi052.stdout:6/936: dread f2 [0,4194304] 0 2024-04-26T12:06:59.645 INFO:tasks.workunit.client.0.smithi052.stdout:3/945: dwrite d2/d4/d2a/d2d/f2e [0,4194304] 0 2024-04-26T12:06:59.645 INFO:tasks.workunit.client.0.smithi052.stdout:7/969: readlink d1/dab/lf5 0 2024-04-26T12:06:59.646 INFO:tasks.workunit.client.0.smithi052.stdout:9/973: symlink d3/db/d10/d3c/d40/df6/l15e 0 2024-04-26T12:06:59.648 INFO:tasks.workunit.client.0.smithi052.stdout:6/937: creat da/d22/d29/dd4/df7/d104/f14b x:0 0 0 2024-04-26T12:06:59.648 INFO:tasks.workunit.client.0.smithi052.stdout:3/946: write d2/d4/f3e [4045833,102000] 0 2024-04-26T12:06:59.649 INFO:tasks.workunit.client.0.smithi052.stdout:9/974: write d3/fb8 [376694,121382] 0 2024-04-26T12:06:59.649 INFO:tasks.workunit.client.0.smithi052.stdout:7/970: creat d1/d1c/d23/f133 x:0 0 0 2024-04-26T12:06:59.650 INFO:tasks.workunit.client.0.smithi052.stdout:9/975: sync 2024-04-26T12:06:59.650 INFO:tasks.workunit.client.0.smithi052.stdout:2/976: dread d0/d3f/d56/d8d/d99/db9/f10c [0,4194304] 0 2024-04-26T12:06:59.651 INFO:tasks.workunit.client.0.smithi052.stdout:6/938: write da/d22/d29/dd4/df7/d104/f14b [856071,10923] 0 2024-04-26T12:06:59.651 INFO:tasks.workunit.client.0.smithi052.stdout:8/922: dwrite d0/d4/d5/da3/ff8 [0,4194304] 0 2024-04-26T12:06:59.653 INFO:tasks.workunit.client.0.smithi052.stdout:4/952: dwrite d3/d15/f99 [0,4194304] 0 2024-04-26T12:06:59.653 INFO:tasks.workunit.client.0.smithi052.stdout:3/947: rename d2/d4/d41/d59/fb1 to d2/d4/dc/d33/d8a/f11d 0 2024-04-26T12:06:59.655 INFO:tasks.workunit.client.0.smithi052.stdout:7/971: creat d1/d1c/d21/d2f/d33/dc7/f134 x:0 0 0 2024-04-26T12:06:59.655 INFO:tasks.workunit.client.0.smithi052.stdout:8/923: unlink d0/d4/d5/d86/d9c/db4/lfd 0 2024-04-26T12:06:59.656 INFO:tasks.workunit.client.0.smithi052.stdout:3/948: creat d2/d4/dc/d68/ddb/f11e x:0 0 0 2024-04-26T12:06:59.656 INFO:tasks.workunit.client.0.smithi052.stdout:6/939: mkdir da/d22/d29/dd4/ddf/d14c 0 2024-04-26T12:06:59.657 INFO:tasks.workunit.client.0.smithi052.stdout:8/924: write d0/d4/dc/d68/f124 [1203595,12680] 0 2024-04-26T12:06:59.657 INFO:tasks.workunit.client.0.smithi052.stdout:7/972: getdents d1/d1c 0 2024-04-26T12:06:59.657 INFO:tasks.workunit.client.0.smithi052.stdout:4/953: rename d3/d12/d34/d43/dc6/fd9 to d3/d12/d34/d45/d67/d6c/d86/f147 0 2024-04-26T12:06:59.658 INFO:tasks.workunit.client.0.smithi052.stdout:7/973: symlink d1/d1f/d55/dcb/l135 0 2024-04-26T12:06:59.658 INFO:tasks.workunit.client.0.smithi052.stdout:6/940: write da/d22/d29/dd4/df7/d87/fdc [611035,64168] 0 2024-04-26T12:06:59.659 INFO:tasks.workunit.client.0.smithi052.stdout:3/949: getdents d2/d4/dc/d1d/d25/d36 0 2024-04-26T12:06:59.659 INFO:tasks.workunit.client.0.smithi052.stdout:5/970: dread db/dd/d34/d69/d93/f58 [4194304,4194304] 0 2024-04-26T12:06:59.660 INFO:tasks.workunit.client.0.smithi052.stdout:7/974: truncate d1/db7/f129 75927 0 2024-04-26T12:06:59.661 INFO:tasks.workunit.client.0.smithi052.stdout:4/954: rename d3/d2b/dab/db6/ff6 to d3/d12/d34/d91/f148 0 2024-04-26T12:06:59.661 INFO:tasks.workunit.client.0.smithi052.stdout:6/941: write da/d22/d29/dd4/ddf/d7c/d94/fc6 [892588,82297] 0 2024-04-26T12:06:59.661 INFO:tasks.workunit.client.0.smithi052.stdout:3/950: mknod d2/d4/d6b/dcf/de4/dc3/c11f 0 2024-04-26T12:06:59.662 INFO:tasks.workunit.client.0.smithi052.stdout:5/971: chown db/dc/d5f/d50/d91/l111 2 1 2024-04-26T12:06:59.662 INFO:tasks.workunit.client.0.smithi052.stdout:2/977: dread d0/d3f/d56/d6d/d5a/d73/d4b/fd4 [0,4194304] 0 2024-04-26T12:06:59.662 INFO:tasks.workunit.client.0.smithi052.stdout:4/955: creat d3/d12/d59/d96/f149 x:0 0 0 2024-04-26T12:06:59.663 INFO:tasks.workunit.client.0.smithi052.stdout:1/899: dread d0/d2/dd/d40/d81/d9a/f10e [0,4194304] 0 2024-04-26T12:06:59.664 INFO:tasks.workunit.client.0.smithi052.stdout:7/975: write d1/d1c/d21/d2f/d33/d3a/d64/ff9 [797881,82645] 0 2024-04-26T12:06:59.664 INFO:tasks.workunit.client.0.smithi052.stdout:6/942: symlink da/d22/d29/d31/d6f/dcc/df6/l14d 0 2024-04-26T12:06:59.664 INFO:tasks.workunit.client.0.smithi052.stdout:5/972: creat db/dd/d34/d131/f13d x:0 0 0 2024-04-26T12:06:59.664 INFO:tasks.workunit.client.0.smithi052.stdout:4/956: creat d3/d12/d34/d43/da1/f14a x:0 0 0 2024-04-26T12:06:59.664 INFO:tasks.workunit.client.0.smithi052.stdout:1/900: rmdir d0/d2/dd/d34/d95 39 2024-04-26T12:06:59.664 INFO:tasks.workunit.client.0.smithi052.stdout:2/978: creat d0/d3f/d56/d6d/d5a/d82/f14e x:0 0 0 2024-04-26T12:06:59.665 INFO:tasks.workunit.client.0.smithi052.stdout:6/943: chown da/d22/d29/dd4/ddf/d7c/f10a 90704 1 2024-04-26T12:06:59.666 INFO:tasks.workunit.client.0.smithi052.stdout:2/979: creat d0/d3f/d56/f14f x:0 0 0 2024-04-26T12:06:59.668 INFO:tasks.workunit.client.0.smithi052.stdout:8/925: dread d0/d4/d5/d86/d9c/db4/d58/dae/fca [0,4194304] 0 2024-04-26T12:06:59.668 INFO:tasks.workunit.client.0.smithi052.stdout:5/973: creat db/dc/d5f/d50/d91/dd2/f13e x:0 0 0 2024-04-26T12:06:59.668 INFO:tasks.workunit.client.0.smithi052.stdout:4/957: truncate d3/d44/d4b/db8/dde/d118/f137 4986338 0 2024-04-26T12:06:59.671 INFO:tasks.workunit.client.0.smithi052.stdout:3/951: dwrite d2/d4/f64 [4194304,4194304] 0 2024-04-26T12:06:59.671 INFO:tasks.workunit.client.0.smithi052.stdout:6/944: link da/d22/ff9 da/d22/d29/d31/d6f/f14e 0 2024-04-26T12:06:59.671 INFO:tasks.workunit.client.0.smithi052.stdout:2/980: mknod d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/c150 0 2024-04-26T12:06:59.672 INFO:tasks.workunit.client.0.smithi052.stdout:5/974: write db/dc/d5f/d10c/fdb [4397946,8800] 0 2024-04-26T12:06:59.672 INFO:tasks.workunit.client.0.smithi052.stdout:4/958: rename d3/d22/f4e to d3/d15/d12f/f14b 0 2024-04-26T12:06:59.672 INFO:tasks.workunit.client.0.smithi052.stdout:7/976: dwrite d1/d1c/d21/d2f/f9b [0,4194304] 0 2024-04-26T12:06:59.673 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:59.673 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:06:59.673 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:06:59.673 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:06:59.673 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:59.674 INFO:tasks.workunit.client.0.smithi052.stdout:8/926: write d0/d4/d5/d86/d9c/db4/d58/d89/f129 [24868,3557] 0 2024-04-26T12:06:59.675 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:59.673+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:59.675 INFO:tasks.workunit.client.0.smithi052.stdout:9/976: dread d3/db/d10/d3c/d40/d96/f57 [0,4194304] 0 2024-04-26T12:06:59.675 INFO:tasks.workunit.client.0.smithi052.stdout:3/952: dread - d2/d4/dc/d1d/d25/d61/f10b zero size 2024-04-26T12:06:59.676 INFO:tasks.workunit.client.0.smithi052.stdout:6/945: rmdir da/d22/d29/d31/d39/d137 0 2024-04-26T12:06:59.677 INFO:tasks.workunit.client.0.smithi052.stdout:1/901: dwrite d0/d83/d4b/d56/f9d [0,4194304] 0 2024-04-26T12:06:59.677 INFO:tasks.workunit.client.0.smithi052.stdout:7/977: rename d1/d1c/f1e to d1/d1c/d21/d2f/d33/d92/f136 0 2024-04-26T12:06:59.678 INFO:tasks.workunit.client.0.smithi052.stdout:1/902: stat d0/d2/c21 0 2024-04-26T12:06:59.678 INFO:tasks.workunit.client.0.smithi052.stdout:9/977: mknod d3/d23/dd0/d144/c15f 0 2024-04-26T12:06:59.678 INFO:tasks.workunit.client.0.smithi052.stdout:8/927: rmdir d0/d4/d5/d27/d57/dda 39 2024-04-26T12:06:59.678 INFO:tasks.workunit.client.0.smithi052.stdout:6/946: chown da/d22/d29/dd4/ddf/d7c/d94 3471 1 2024-04-26T12:06:59.679 INFO:tasks.workunit.client.0.smithi052.stdout:5/975: getdents db/dd/d34/d69/d8a/da9/d87/d6e/db8/d11e 0 2024-04-26T12:06:59.681 INFO:tasks.workunit.client.0.smithi052.stdout:1/903: read - d0/d2/dd/d40/d81/d9a/dce/de9/d9b/fe5 zero size 2024-04-26T12:06:59.682 INFO:tasks.workunit.client.0.smithi052.stdout:6/947: chown da/d22/d29/dd4/ddf/d92/d96/d131/c143 20899928 1 2024-04-26T12:06:59.687 INFO:tasks.workunit.client.0.smithi052.stdout:2/981: dwrite d0/d7/fdc [0,4194304] 0 2024-04-26T12:06:59.688 INFO:tasks.workunit.client.0.smithi052.stdout:8/928: write d0/d4/d5/d86/d9c/db4/d58/dae/ff6 [5679315,33500] 0 2024-04-26T12:06:59.688 INFO:tasks.workunit.client.0.smithi052.stdout:4/959: dwrite d3/d22/d30/f5c [4194304,4194304] 0 2024-04-26T12:06:59.688 INFO:tasks.workunit.client.0.smithi052.stdout:5/976: rename db/dd/d18/c72 to db/dd/d34/d69/d108/c13f 0 2024-04-26T12:06:59.688 INFO:tasks.workunit.client.0.smithi052.stdout:2/982: chown d0/d36/c7c 99523 1 2024-04-26T12:06:59.688 INFO:tasks.workunit.client.0.smithi052.stdout:6/948: fdatasync da/d22/d3c/f4b 0 2024-04-26T12:06:59.688 INFO:tasks.workunit.client.0.smithi052.stdout:8/929: creat d0/d16/f131 x:0 0 0 2024-04-26T12:06:59.688 INFO:tasks.workunit.client.0.smithi052.stdout:7/978: link d1/d1c/d21/d2f/l34 d1/d1f/d55/l137 0 2024-04-26T12:06:59.689 INFO:tasks.workunit.client.0.smithi052.stdout:9/978: dwrite d3/d23/d7f/f46 [0,4194304] 0 2024-04-26T12:06:59.691 INFO:tasks.workunit.client.0.smithi052.stdout:6/949: creat da/d22/d29/dd4/ddf/d92/d96/d131/f14f x:0 0 0 2024-04-26T12:06:59.691 INFO:tasks.workunit.client.0.smithi052.stdout:9/979: symlink d3/db/d10/d3c/d40/l160 0 2024-04-26T12:06:59.691 INFO:tasks.workunit.client.0.smithi052.stdout:7/979: creat d1/d1c/f138 x:0 0 0 2024-04-26T12:06:59.692 INFO:tasks.workunit.client.0.smithi052.stdout:4/960: write d3/d12/d34/d91/fb5 [213460,104979] 0 2024-04-26T12:06:59.692 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:06:59.695 INFO:tasks.workunit.client.0.smithi052.stdout:1/904: dwrite d0/d2/dd/d40/d81/d52/ff0 [0,4194304] 0 2024-04-26T12:06:59.696 INFO:tasks.workunit.client.0.smithi052.stdout:6/950: creat da/d22/d29/dd4/ddf/d92/f150 x:0 0 0 2024-04-26T12:06:59.696 INFO:tasks.workunit.client.0.smithi052.stdout:7/980: dread - d1/d1c/d65/f11c zero size 2024-04-26T12:06:59.696 INFO:tasks.workunit.client.0.smithi052.stdout:4/961: write d3/d12/d34/d45/d67/fd1 [235339,109221] 0 2024-04-26T12:06:59.696 INFO:tasks.workunit.client.0.smithi052.stdout:5/977: truncate db/dd/d34/d69/d8a/da9/d87/d6e/fbd 3225068 0 2024-04-26T12:06:59.696 INFO:tasks.workunit.client.0.smithi052.stdout:6/951: symlink da/da2/l151 0 2024-04-26T12:06:59.696 INFO:tasks.workunit.client.0.smithi052.stdout:7/981: symlink d1/d1c/l139 0 2024-04-26T12:06:59.696 INFO:tasks.workunit.client.0.smithi052.stdout:2/983: dwrite d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/dd3/d121/d4d/d12a/f128 [0,4194304] 0 2024-04-26T12:06:59.696 INFO:tasks.workunit.client.0.smithi052.stdout:1/905: fsync d0/d2/dd/d34/d95/d10b/dde/f79 0 2024-04-26T12:06:59.697 INFO:tasks.workunit.client.0.smithi052.stdout:4/962: mknod d3/d15/c14c 0 2024-04-26T12:06:59.697 INFO:tasks.workunit.client.0.smithi052.stdout:9/980: read d3/db/d10/d54/fc8 [244957,67442] 0 2024-04-26T12:06:59.697 INFO:tasks.workunit.client.0.smithi052.stdout:1/906: sync 2024-04-26T12:06:59.697 INFO:tasks.workunit.client.0.smithi052.stdout:5/978: creat db/dd/d34/d69/d108/f140 x:0 0 0 2024-04-26T12:06:59.700 INFO:tasks.workunit.client.0.smithi052.stdout:2/984: unlink d0/d3f/d56/d6d/c103 0 2024-04-26T12:06:59.700 INFO:tasks.workunit.client.0.smithi052.stdout:6/952: mknod da/d22/d29/dd4/ddf/d95/df8/d68/c152 0 2024-04-26T12:06:59.700 INFO:tasks.workunit.client.0.smithi052.stdout:5/979: dread - db/dd/d34/d131/f13d zero size 2024-04-26T12:06:59.700 INFO:tasks.workunit.client.0.smithi052.stdout:4/963: symlink d3/d2b/d40/d10f/l14d 0 2024-04-26T12:06:59.701 INFO:tasks.workunit.client.0.smithi052.stdout:3/953: dread d2/d4/d41/d59/f8f [0,4194304] 0 2024-04-26T12:06:59.701 INFO:tasks.workunit.client.0.smithi052.stdout:1/907: mknod d0/d2/dd/d40/dc1/d11e/c12b 0 2024-04-26T12:06:59.701 INFO:tasks.workunit.client.0.smithi052.stdout:2/985: write d0/d7/d2f/ffc [335282,31864] 0 2024-04-26T12:06:59.701 INFO:tasks.workunit.client.0.smithi052.stdout:5/980: fdatasync db/dd/d34/fb2 0 2024-04-26T12:06:59.701 INFO:tasks.workunit.client.0.smithi052.stdout:4/964: truncate d3/d15/f12b 641195 0 2024-04-26T12:06:59.701 INFO:tasks.workunit.client.0.smithi052.stdout:2/986: stat d0/d7/d2f 0 2024-04-26T12:06:59.702 INFO:tasks.workunit.client.0.smithi052.stdout:6/953: unlink da/d22/d29/d31/d6f/d13c/d9c/f125 0 2024-04-26T12:06:59.702 INFO:tasks.workunit.client.0.smithi052.stdout:2/987: sync 2024-04-26T12:06:59.702 INFO:tasks.workunit.client.0.smithi052.stdout:3/954: fdatasync d2/d4/dc/d1d/f32 0 2024-04-26T12:06:59.703 INFO:tasks.workunit.client.0.smithi052.stdout:5/981: rmdir db/d5c 39 2024-04-26T12:06:59.703 INFO:tasks.workunit.client.0.smithi052.stdout:2/988: unlink d0/d7/d2f/l106 0 2024-04-26T12:06:59.704 INFO:tasks.workunit.client.0.smithi052.stdout:7/982: dwrite d1/f12 [0,4194304] 0 2024-04-26T12:06:59.704 INFO:tasks.workunit.client.0.smithi052.stdout:3/955: creat d2/d4/dc/d1d/d25/d36/d1c/f120 x:0 0 0 2024-04-26T12:06:59.704 INFO:tasks.workunit.client.0.smithi052.stdout:3/956: fsync d2/d4/d41/d59/fd5 0 2024-04-26T12:06:59.704 INFO:tasks.workunit.client.0.smithi052.stdout:4/965: truncate d3/d12/d59/d96/dc0/ddd/fc7 848873 0 2024-04-26T12:06:59.706 INFO:tasks.workunit.client.0.smithi052.stdout:2/989: rmdir d0/d3f/d56/d6d/d5a 39 2024-04-26T12:06:59.707 INFO:tasks.workunit.client.0.smithi052.stdout:3/957: chown d2/d4/d41/d59/cbe 57586835 1 2024-04-26T12:06:59.708 INFO:tasks.workunit.client.0.smithi052.stdout:4/966: creat d3/f14e x:0 0 0 2024-04-26T12:06:59.708 INFO:tasks.workunit.client.0.smithi052.stdout:1/908: dwrite d0/d2/dd/d40/d81/d52/f8d [0,4194304] 0 2024-04-26T12:06:59.709 INFO:tasks.workunit.client.0.smithi052.stdout:7/983: mkdir d1/d1c/d21/d2f/d33/d12f/d13a 0 2024-04-26T12:06:59.710 INFO:tasks.workunit.client.0.smithi052.stdout:3/958: creat d2/d1f/f121 x:0 0 0 2024-04-26T12:06:59.711 INFO:tasks.workunit.client.0.smithi052.stdout:4/967: creat d3/d15/d53/f14f x:0 0 0 2024-04-26T12:06:59.711 INFO:tasks.workunit.client.0.smithi052.stdout:7/984: read - d1/db7/f10d zero size 2024-04-26T12:06:59.711 INFO:tasks.workunit.client.0.smithi052.stdout:2/990: mkdir d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/d151 0 2024-04-26T12:06:59.711 INFO:tasks.workunit.client.0.smithi052.stdout:6/954: dwrite da/d22/d29/dd4/ddf/d92/fab [0,4194304] 0 2024-04-26T12:06:59.712 INFO:tasks.workunit.client.0.smithi052.stdout:5/982: dwrite db/dd/d34/d69/fa6 [4194304,4194304] 0 2024-04-26T12:06:59.713 INFO:tasks.workunit.client.0.smithi052.stdout:6/955: stat da/d22/d29/c34 0 2024-04-26T12:06:59.713 INFO:tasks.workunit.client.0.smithi052.stdout:1/909: getdents d0/d2/dd/d40/d111 0 2024-04-26T12:06:59.713 INFO:tasks.workunit.client.0.smithi052.stdout:3/959: chown d2/d4/d41/db5/fff 27450956 1 2024-04-26T12:06:59.714 INFO:tasks.workunit.client.0.smithi052.stdout:7/985: mkdir d1/d1c/d21/d2f/d68/d10a/d13b 0 2024-04-26T12:06:59.714 INFO:tasks.workunit.client.0.smithi052.stdout:8/930: dread d0/d4/d5/d86/d9c/db4/d58/d8f/f122 [0,4194304] 0 2024-04-26T12:06:59.714 INFO:tasks.workunit.client.0.smithi052.stdout:6/956: mknod da/d22/d29/dd4/df7/c153 0 2024-04-26T12:06:59.715 INFO:tasks.workunit.client.0.smithi052.stdout:2/991: mkdir d0/d3f/d56/d6d/d5a/d73/d4b/d8f/d152 0 2024-04-26T12:06:59.715 INFO:tasks.workunit.client.0.smithi052.stdout:4/968: rename d3/d12/d59/d96/dc0/d92/lf9 to d3/d2b/d40/l150 0 2024-04-26T12:06:59.716 INFO:tasks.workunit.client.0.smithi052.stdout:7/986: mkdir d1/dab/d4c/d13c 0 2024-04-26T12:06:59.716 INFO:tasks.workunit.client.0.smithi052.stdout:8/931: truncate d0/d16/f73 1017049 0 2024-04-26T12:06:59.717 INFO:tasks.workunit.client.0.smithi052.stdout:2/992: mknod d0/d3f/d56/d6d/d5a/d73/d4b/c153 0 2024-04-26T12:06:59.719 INFO:tasks.workunit.client.0.smithi052.stdout:6/957: link da/d22/d29/dd4/ddf/d95/dd2/db9/f121 da/d22/d29/dd4/df7/d87/dfb/f154 0 2024-04-26T12:06:59.720 INFO:tasks.workunit.client.0.smithi052.stdout:6/958: fsync da/d22/d29/d31/d39/dc7/d114/f122 0 2024-04-26T12:06:59.720 INFO:tasks.workunit.client.0.smithi052.stdout:1/910: dwrite d0/f4a [0,4194304] 0 2024-04-26T12:06:59.720 INFO:tasks.workunit.client.0.smithi052.stdout:2/993: truncate d0/d3f/d56/d6d/d5a/de4/df9/ffa 735828 0 2024-04-26T12:06:59.721 INFO:tasks.workunit.client.0.smithi052.stdout:4/969: truncate d3/d12/d34/d45/d67/d6c/f13e 183526 0 2024-04-26T12:06:59.722 INFO:tasks.workunit.client.0.smithi052.stdout:1/911: read - d0/da/d2e/fed zero size 2024-04-26T12:06:59.722 INFO:tasks.workunit.client.0.smithi052.stdout:8/932: dread d0/d4/d5/da3/ff8 [0,4194304] 0 2024-04-26T12:06:59.723 INFO:tasks.workunit.client.0.smithi052.stdout:8/933: readlink d0/d3e/l50 0 2024-04-26T12:06:59.723 INFO:tasks.workunit.client.0.smithi052.stdout:7/987: rename d1/d1c/d23/f2c to d1/dab/d4c/d13c/f13d 0 2024-04-26T12:06:59.723 INFO:tasks.workunit.client.0.smithi052.stdout:4/970: mkdir d3/d22/d30/d151 0 2024-04-26T12:06:59.723 INFO:tasks.workunit.client.0.smithi052.stdout:6/959: mknod da/d22/d29/dd4/ddf/d92/c155 0 2024-04-26T12:06:59.725 INFO:tasks.workunit.client.0.smithi052.stdout:1/912: fdatasync d0/d2/dd/d40/d81/f63 0 2024-04-26T12:06:59.725 INFO:tasks.workunit.client.0.smithi052.stdout:2/994: rename d0/d7/f39 to d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/dd3/f154 0 2024-04-26T12:06:59.725 INFO:tasks.workunit.client.0.smithi052.stdout:2/995: sync 2024-04-26T12:06:59.725 INFO:tasks.workunit.client.0.smithi052.stdout:8/934: mknod d0/c132 0 2024-04-26T12:06:59.725 INFO:tasks.workunit.client.0.smithi052.stdout:7/988: write d1/f9f [1102826,84147] 0 2024-04-26T12:06:59.726 INFO:tasks.workunit.client.0.smithi052.stdout:6/960: truncate da/d22/d3c/ff5 1017433 0 2024-04-26T12:06:59.726 INFO:tasks.workunit.client.0.smithi052.stdout:8/935: creat d0/d4/d5/d86/f133 x:0 0 0 2024-04-26T12:06:59.727 INFO:tasks.workunit.client.0.smithi052.stdout:6/961: write da/d22/d29/dd4/ddf/d92/fb3 [215932,24348] 0 2024-04-26T12:06:59.729 INFO:tasks.workunit.client.0.smithi052.stdout:6/962: creat da/d22/d29/dd4/f156 x:0 0 0 2024-04-26T12:06:59.730 INFO:tasks.workunit.client.0.smithi052.stdout:4/971: dwrite d3/d12/d59/d96/dc0/f74 [0,4194304] 0 2024-04-26T12:06:59.731 INFO:tasks.workunit.client.0.smithi052.stdout:6/963: write da/d22/d29/dd4/ddf/d92/fab [370385,54678] 0 2024-04-26T12:06:59.731 INFO:tasks.workunit.client.0.smithi052.stdout:6/964: sync 2024-04-26T12:06:59.732 INFO:tasks.workunit.client.0.smithi052.stdout:2/996: truncate d0/d3f/d56/d6d/d5a/d73/d4b/d9c/da4/dd3/f154 553621 0 2024-04-26T12:06:59.735 INFO:tasks.workunit.client.0.smithi052.stdout:2/997: creat d0/d7/d2f/d8c/f155 x:0 0 0 2024-04-26T12:06:59.735 INFO:tasks.workunit.client.0.smithi052.stdout:3/960: dread d2/d4/dc/d1d/d25/d36/f9a [0,4194304] 0 2024-04-26T12:06:59.735 INFO:tasks.workunit.client.0.smithi052.stdout:6/965: creat da/d22/d29/d31/f157 x:0 0 0 2024-04-26T12:06:59.735 INFO:tasks.workunit.client.0.smithi052.stdout:2/998: chown d0/d7/d22/f87 417 1 2024-04-26T12:06:59.738 INFO:tasks.workunit.client.0.smithi052.stdout:9/981: dread d3/d3b/dea/dfe/f12f [0,4194304] 0 2024-04-26T12:06:59.738 INFO:tasks.workunit.client.0.smithi052.stdout:6/966: getdents da/d22/d29/dd4/df7/d7e 0 2024-04-26T12:06:59.738 INFO:tasks.workunit.client.0.smithi052.stdout:2/999: write d0/d7/d2f/d9b/f6b [3952332,72968] 0 2024-04-26T12:06:59.739 INFO:tasks.workunit.client.0.smithi052.stdout:1/913: dread d0/d2/dd/d40/d81/d9a/dce/de9/d9b/fa9 [0,4194304] 0 2024-04-26T12:06:59.739 INFO:tasks.workunit.client.0.smithi052.stdout:9/982: creat d3/db/d52/f161 x:0 0 0 2024-04-26T12:06:59.739 INFO:tasks.workunit.client.0.smithi052.stdout:3/961: read d2/d4/d41/f66 [1575039,295] 0 2024-04-26T12:06:59.739 INFO:tasks.workunit.client.0.smithi052.stdout:6/967: write da/d22/d29/dd4/df7/d104/f14b [191421,75279] 0 2024-04-26T12:06:59.739 INFO:tasks.workunit.client.0.smithi052.stdout:9/983: unlink d3/db/d10/d2e/d134/d14f/c90 0 2024-04-26T12:06:59.739 INFO:tasks.workunit.client.0.smithi052.stdout:1/914: write d0/d2/dd/d40/dc1/d1d/f37 [2451759,55039] 0 2024-04-26T12:06:59.741 INFO:tasks.workunit.client.0.smithi052.stdout:6/968: dread - da/d22/d29/d31/f157 zero size 2024-04-26T12:06:59.741 INFO:tasks.workunit.client.0.smithi052.stdout:3/962: getdents d2/d4/dc/d1d/d25/d36/d1c/d4e 0 2024-04-26T12:06:59.741 INFO:tasks.workunit.client.0.smithi052.stdout:9/984: mkdir d3/db/d10/d2e/d162 0 2024-04-26T12:06:59.741 INFO:tasks.workunit.client.0.smithi052.stdout:6/969: write da/d22/f3b [875372,94310] 0 2024-04-26T12:06:59.741 INFO:tasks.workunit.client.0.smithi052.stdout:1/915: mknod d0/d2/dd/d40/d81/d9a/dce/dcf/c12c 0 2024-04-26T12:06:59.741 INFO:tasks.workunit.client.0.smithi052.stdout:3/963: chown d2/d4/d41/d5c/le7 1 1 2024-04-26T12:06:59.742 INFO:tasks.workunit.client.0.smithi052.stdout:3/964: chown d2/d4/dc/d1d/d3f 222614 1 2024-04-26T12:06:59.742 INFO:tasks.workunit.client.0.smithi052.stdout:1/916: unlink d0/d2/dd/d40/d81/c5b 0 2024-04-26T12:06:59.743 INFO:tasks.workunit.client.0.smithi052.stdout:6/970: creat da/d22/d29/dd4/df7/dcf/de0/f158 x:0 0 0 2024-04-26T12:06:59.743 INFO:tasks.workunit.client.0.smithi052.stdout:3/965: symlink d2/d4/d6b/dcf/l122 0 2024-04-26T12:06:59.743 INFO:tasks.workunit.client.0.smithi052.stdout:1/917: chown d0/f68 760516896 1 2024-04-26T12:06:59.743 INFO:tasks.workunit.client.0.smithi052.stdout:5/983: dread db/dc/d5f/f3a [0,4194304] 0 2024-04-26T12:06:59.744 INFO:tasks.workunit.client.0.smithi052.stdout:1/918: creat d0/d2/dd/d34/f12d x:0 0 0 2024-04-26T12:06:59.745 INFO:tasks.workunit.client.0.smithi052.stdout:3/966: rename d2/d4/d41/d59/de6 to d2/d123 0 2024-04-26T12:06:59.745 INFO:tasks.workunit.client.0.smithi052.stdout:5/984: unlink db/dc/d5f/l117 0 2024-04-26T12:06:59.745 INFO:tasks.workunit.client.0.smithi052.stdout:5/985: fdatasync db/dd/f27 0 2024-04-26T12:06:59.745 INFO:tasks.workunit.client.0.smithi052.stdout:1/919: chown d0/d2/dd/d40/dc1/d1d/l120 452670 1 2024-04-26T12:06:59.745 INFO:tasks.workunit.client.0.smithi052.stdout:3/967: creat d2/d4/d6b/dcf/de4/db7/f124 x:0 0 0 2024-04-26T12:06:59.746 INFO:tasks.workunit.client.0.smithi052.stdout:3/968: mknod d2/d4/d6b/dcf/de4/dc3/c125 0 2024-04-26T12:06:59.747 INFO:tasks.workunit.client.0.smithi052.stdout:1/920: creat d0/d2/dd/d40/d81/d9a/da6/dc4/f12e x:0 0 0 2024-04-26T12:06:59.747 INFO:tasks.workunit.client.0.smithi052.stdout:6/971: dread da/d22/d29/dd4/df7/d7e/f98 [0,4194304] 0 2024-04-26T12:06:59.748 INFO:tasks.workunit.client.0.smithi052.stdout:7/989: dread d1/d1c/d23/d81/f99 [0,4194304] 0 2024-04-26T12:06:59.748 INFO:tasks.workunit.client.0.smithi052.stdout:3/969: dread - d2/d4/d2a/d96/dfc/f107 zero size 2024-04-26T12:06:59.749 INFO:tasks.workunit.client.0.smithi052.stdout:5/986: link db/dd/d18/d60/d64/d9c/da0/df1/f107 db/dd/d18/d60/d64/d9c/da0/f141 0 2024-04-26T12:06:59.750 INFO:tasks.workunit.client.0.smithi052.stdout:1/921: creat d0/d2/dd/d40/d81/d9a/dce/de9/d9b/f12f x:0 0 0 2024-04-26T12:06:59.751 INFO:tasks.workunit.client.0.smithi052.stdout:3/970: rmdir d2/d4/d2a/d2d/df9 39 2024-04-26T12:06:59.751 INFO:tasks.workunit.client.0.smithi052.stdout:1/922: chown d0/f55 866 1 2024-04-26T12:06:59.754 INFO:tasks.workunit.client.0.smithi052.stdout:3/971: write d2/d4/d41/d5c/fc9 [698690,124910] 0 2024-04-26T12:06:59.758 INFO:tasks.workunit.client.0.smithi052.stdout:6/972: dwrite da/d22/d29/dd4/ddf/d7c/d94/fd7 [0,4194304] 0 2024-04-26T12:06:59.758 INFO:tasks.workunit.client.0.smithi052.stdout:7/990: dwrite d1/d1c/d21/d2f/d33/d3a/fd4 [0,4194304] 0 2024-04-26T12:06:59.758 INFO:tasks.workunit.client.0.smithi052.stdout:5/987: dwrite db/dd/d34/d70/f12c [0,4194304] 0 2024-04-26T12:06:59.758 INFO:tasks.workunit.client.0.smithi052.stdout:3/972: unlink d2/d4/d2a/dbf/db0/ff3 0 2024-04-26T12:06:59.759 INFO:tasks.workunit.client.0.smithi052.stdout:4/972: dread d3/d12/d59/f82 [0,4194304] 0 2024-04-26T12:06:59.759 INFO:tasks.workunit.client.0.smithi052.stdout:6/973: fsync da/d22/d29/f5a 0 2024-04-26T12:06:59.760 INFO:tasks.workunit.client.0.smithi052.stdout:5/988: readlink db/dd/d34/d69/d8a/da9/d87/l120 0 2024-04-26T12:06:59.760 INFO:tasks.workunit.client.0.smithi052.stdout:6/974: readlink da/d51/ld8 0 2024-04-26T12:06:59.761 INFO:tasks.workunit.client.0.smithi052.stdout:3/973: getdents d2/d4/dc/d33/d75/dc2 0 2024-04-26T12:06:59.761 INFO:tasks.workunit.client.0.smithi052.stdout:7/991: getdents d1/d1c/d23/d81/d88/d108 0 2024-04-26T12:06:59.761 INFO:tasks.workunit.client.0.smithi052.stdout:9/985: dread d3/d3b/f3e [0,4194304] 0 2024-04-26T12:06:59.762 INFO:tasks.workunit.client.0.smithi052.stdout:5/989: symlink db/dd/d34/d69/d8a/da9/l142 0 2024-04-26T12:06:59.762 INFO:tasks.workunit.client.0.smithi052.stdout:6/975: creat da/d22/d29/dd4/ddf/d95/dd2/f159 x:0 0 0 2024-04-26T12:06:59.762 INFO:tasks.workunit.client.0.smithi052.stdout:3/974: stat d2/d4/dc/d33/d75/dc2/cef 0 2024-04-26T12:06:59.762 INFO:tasks.workunit.client.0.smithi052.stdout:1/923: dread d0/f67 [0,4194304] 0 2024-04-26T12:06:59.763 INFO:tasks.workunit.client.0.smithi052.stdout:9/986: creat d3/db/d4a/f163 x:0 0 0 2024-04-26T12:06:59.763 INFO:tasks.workunit.client.0.smithi052.stdout:4/973: mknod d3/d12/d59/d96/dc0/c152 0 2024-04-26T12:06:59.763 INFO:tasks.workunit.client.0.smithi052.stdout:8/936: dread d0/d4/d5/d86/d9c/db4/d58/fbe [4194304,4194304] 0 2024-04-26T12:06:59.764 INFO:tasks.workunit.client.0.smithi052.stdout:7/992: getdents d1/d1c/d21/d2f 0 2024-04-26T12:06:59.765 INFO:tasks.workunit.client.0.smithi052.stdout:4/974: stat d3/d44/d4b/db8/dde/d118/f137 0 2024-04-26T12:06:59.765 INFO:tasks.workunit.client.0.smithi052.stdout:1/924: symlink d0/d2/dd/d40/dc1/l130 0 2024-04-26T12:06:59.765 INFO:tasks.workunit.client.0.smithi052.stdout:6/976: mknod da/d22/d29/dd4/ddf/d92/d96/d131/c15a 0 2024-04-26T12:06:59.765 INFO:tasks.workunit.client.0.smithi052.stdout:9/987: mkdir d3/db/d2b/ded/d164 0 2024-04-26T12:06:59.765 INFO:tasks.workunit.client.0.smithi052.stdout:4/975: readlink d3/d15/d76/lf1 0 2024-04-26T12:06:59.766 INFO:tasks.workunit.client.0.smithi052.stdout:3/975: creat d2/d4/dc/d1d/d25/d36/d1c/d4e/f126 x:0 0 0 2024-04-26T12:06:59.766 INFO:tasks.workunit.client.0.smithi052.stdout:5/990: unlink db/dc/d5f/d50/d46/f4b 0 2024-04-26T12:06:59.766 INFO:tasks.workunit.client.0.smithi052.stdout:7/993: write d1/d1c/d21/d2f/d33/d92/f12a [398248,96221] 0 2024-04-26T12:06:59.766 INFO:tasks.workunit.client.0.smithi052.stdout:6/977: readlink da/d22/d29/d31/d6f/d13c/l10f 0 2024-04-26T12:06:59.767 INFO:tasks.workunit.client.0.smithi052.stdout:9/988: chown d3/db/d10/d2e/lc2 60615643 1 2024-04-26T12:06:59.767 INFO:tasks.workunit.client.0.smithi052.stdout:4/976: write d3/d22/d69/f145 [266562,11193] 0 2024-04-26T12:06:59.767 INFO:tasks.workunit.client.0.smithi052.stdout:3/976: write d2/d4/d2a/dbf/fab [2753563,101244] 0 2024-04-26T12:06:59.767 INFO:tasks.workunit.client.0.smithi052.stdout:1/925: write d0/d2/dd/f32 [3124937,107164] 0 2024-04-26T12:06:59.768 INFO:tasks.workunit.client.0.smithi052.stdout:7/994: creat d1/d1c/d23/d81/f13e x:0 0 0 2024-04-26T12:06:59.769 INFO:tasks.workunit.client.0.smithi052.stdout:4/977: truncate d3/d2b/f7d 1562525 0 2024-04-26T12:06:59.769 INFO:tasks.workunit.client.0.smithi052.stdout:6/978: truncate da/f1e 1146664 0 2024-04-26T12:06:59.769 INFO:tasks.workunit.client.0.smithi052.stdout:3/977: write d2/d4/d2a/d96/dfc/f107 [940028,63497] 0 2024-04-26T12:06:59.769 INFO:tasks.workunit.client.0.smithi052.stdout:9/989: creat d3/db/d10/f165 x:0 0 0 2024-04-26T12:06:59.769 INFO:tasks.workunit.client.0.smithi052.stdout:5/991: getdents db/dd/d18/d60/d64/d9c/da0/df1/dfa 0 2024-04-26T12:06:59.769 INFO:tasks.workunit.client.0.smithi052.stdout:1/926: creat d0/d2/dd/d40/d81/d52/f131 x:0 0 0 2024-04-26T12:06:59.770 INFO:tasks.workunit.client.0.smithi052.stdout:7/995: creat d1/d1c/d10c/f13f x:0 0 0 2024-04-26T12:06:59.770 INFO:tasks.workunit.client.0.smithi052.stdout:5/992: stat db/dc/d5f/d50/d46/c5b 0 2024-04-26T12:06:59.770 INFO:tasks.workunit.client.0.smithi052.stdout:6/979: rmdir da/d22/d29/dd4/ddf/d95/df8 39 2024-04-26T12:06:59.771 INFO:tasks.workunit.client.0.smithi052.stdout:3/978: unlink d2/d4/dc/d1d/d3f/f5e 0 2024-04-26T12:06:59.771 INFO:tasks.workunit.client.0.smithi052.stdout:4/978: fdatasync d3/d12/d34/d45/d67/d6c/fad 0 2024-04-26T12:06:59.771 INFO:tasks.workunit.client.0.smithi052.stdout:8/937: truncate d0/d4/d5/db/f5e 3302986 0 2024-04-26T12:06:59.772 INFO:tasks.workunit.client.0.smithi052.stdout:9/990: creat d3/db/d10/d3c/f166 x:0 0 0 2024-04-26T12:06:59.772 INFO:tasks.workunit.client.0.smithi052.stdout:7/996: symlink d1/d1c/d21/d2f/d68/l140 0 2024-04-26T12:06:59.772 INFO:tasks.workunit.client.0.smithi052.stdout:3/979: symlink d2/d4/d41/l127 0 2024-04-26T12:06:59.772 INFO:tasks.workunit.client.0.smithi052.stdout:4/979: truncate d3/d2b/ffe 180977 0 2024-04-26T12:06:59.772 INFO:tasks.workunit.client.0.smithi052.stdout:5/993: mkdir db/dd/d18/d143 0 2024-04-26T12:06:59.772 INFO:tasks.workunit.client.0.smithi052.stdout:9/991: dread - d3/d3b/f124 zero size 2024-04-26T12:06:59.773 INFO:tasks.workunit.client.0.smithi052.stdout:8/938: creat d0/d16/d63/f134 x:0 0 0 2024-04-26T12:06:59.773 INFO:tasks.workunit.client.0.smithi052.stdout:6/980: rename da/d22/d29/d31/d39/l136 to da/d22/d29/dd4/df7/d87/l15b 0 2024-04-26T12:06:59.774 INFO:tasks.workunit.client.0.smithi052.stdout:4/980: write d3/d2b/dab/dec/f108 [646236,33399] 0 2024-04-26T12:06:59.774 INFO:tasks.workunit.client.0.smithi052.stdout:9/992: creat d3/db/d13/f167 x:0 0 0 2024-04-26T12:06:59.775 INFO:tasks.workunit.client.0.smithi052.stdout:5/994: readlink db/dd/d34/d69/d108/l10d 0 2024-04-26T12:06:59.775 INFO:tasks.workunit.client.0.smithi052.stdout:8/939: chown d0/d4/d5/dbf/f12e 8397 1 2024-04-26T12:06:59.775 INFO:tasks.workunit.client.0.smithi052.stdout:7/997: rename d1/d1c/f130 to d1/d1c/d21/d2f/d68/f141 0 2024-04-26T12:06:59.776 INFO:tasks.workunit.client.0.smithi052.stdout:6/981: mknod da/d22/d29/dd4/ddf/d95/df8/c15c 0 2024-04-26T12:06:59.776 INFO:tasks.workunit.client.0.smithi052.stdout:7/998: fdatasync d1/d1c/d21/f2e 0 2024-04-26T12:06:59.777 INFO:tasks.workunit.client.0.smithi052.stdout:5/995: mknod db/dc/d5f/d50/d46/c144 0 2024-04-26T12:06:59.777 INFO:tasks.workunit.client.0.smithi052.stdout:1/927: dwrite d0/d2/dd/d40/d81/d9a/f10e [4194304,4194304] 0 2024-04-26T12:06:59.778 INFO:tasks.workunit.client.0.smithi052.stdout:4/981: write d3/d12/d59/d96/dc0/d92/f135 [875338,67017] 0 2024-04-26T12:06:59.778 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:59.777+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:59.779 INFO:tasks.workunit.client.0.smithi052.stdout:8/940: getdents d0/d4/d5/dbf 0 2024-04-26T12:06:59.779 INFO:tasks.workunit.client.0.smithi052.stdout:7/999: stat d1/d1c/d21/d2f/d33/d3a/d64/fed 0 2024-04-26T12:06:59.779 INFO:tasks.workunit.client.0.smithi052.stdout:4/982: chown d3/d15/d76/f114 15 1 2024-04-26T12:06:59.780 INFO:tasks.workunit.client.0.smithi052.stdout:5/996: symlink db/dd/d34/d69/d8a/da9/dd6/l145 0 2024-04-26T12:06:59.781 INFO:tasks.workunit.client.0.smithi052.stdout:1/928: creat d0/d83/d4b/db2/d105/f132 x:0 0 0 2024-04-26T12:06:59.781 INFO:tasks.workunit.client.0.smithi052.stdout:8/941: creat d0/d4/dc/d80/f135 x:0 0 0 2024-04-26T12:06:59.782 INFO:tasks.workunit.client.0.smithi052.stdout:4/983: creat d3/f153 x:0 0 0 2024-04-26T12:06:59.782 INFO:tasks.workunit.client.0.smithi052.stdout:5/997: symlink db/dd/d18/d60/d64/d9c/da0/df1/l146 0 2024-04-26T12:06:59.782 INFO:tasks.workunit.client.0.smithi052.stdout:8/942: mkdir d0/d4/d5/d86/d136 0 2024-04-26T12:06:59.782 INFO:tasks.workunit.client.0.smithi052.stdout:9/993: dwrite d3/db/d10/daa/f154 [0,4194304] 0 2024-04-26T12:06:59.783 INFO:tasks.workunit.client.0.smithi052.stdout:4/984: mkdir d3/d12/d59/d96/df7/d154 0 2024-04-26T12:06:59.783 INFO:tasks.workunit.client.0.smithi052.stdout:8/943: fdatasync d0/d3e/d87/d11c/f128 0 2024-04-26T12:06:59.783 INFO:tasks.workunit.client.0.smithi052.stdout:5/998: write db/dd/d34/d69/d8a/da9/dd6/fde [540952,48906] 0 2024-04-26T12:06:59.783 INFO:tasks.workunit.client.0.smithi052.stdout:3/980: dread d2/d4/dc/d33/d75/dfa/f10d [0,4194304] 0 2024-04-26T12:06:59.784 INFO:tasks.workunit.client.0.smithi052.stdout:1/929: read d0/d2/dd/d40/d81/d9a/fb8 [2591995,116786] 0 2024-04-26T12:06:59.785 INFO:tasks.workunit.client.0.smithi052.stdout:4/985: mknod d3/d12/d59/d96/df7/c155 0 2024-04-26T12:06:59.786 INFO:tasks.workunit.client.0.smithi052.stdout:3/981: write d2/d4/dc/d1d/d25/d36/f9a [2786707,10613] 0 2024-04-26T12:06:59.787 INFO:tasks.workunit.client.0.smithi052.stdout:4/986: dread - d3/d15/d53/f14f zero size 2024-04-26T12:06:59.787 INFO:tasks.workunit.client.0.smithi052.stdout:1/930: mkdir d0/d2/dd/d40/d81/d9a/dce/de9/d9b/d114/d128/d133 0 2024-04-26T12:06:59.787 INFO:tasks.workunit.client.0.smithi052.stdout:6/982: truncate da/d22/d29/dd4/ddf/d7c/d94/fd7 864657 0 2024-04-26T12:06:59.788 INFO:tasks.workunit.client.0.smithi052.stdout:1/931: readlink d0/da/lc0 0 2024-04-26T12:06:59.789 INFO:tasks.workunit.client.0.smithi052.stdout:4/987: dread - d3/d12/d34/d45/d67/d6c/fbf zero size 2024-04-26T12:06:59.790 INFO:tasks.workunit.client.0.smithi052.stdout:6/983: symlink da/d22/d29/d31/d108/d118/l15d 0 2024-04-26T12:06:59.790 INFO:tasks.workunit.client.0.smithi052.stdout:3/982: rename d2/d4/dc/d33/d37/dd4/cf1 to d2/d4/d6b/c128 0 2024-04-26T12:06:59.791 INFO:tasks.workunit.client.0.smithi052.stdout:8/944: dwrite d0/d4/d5/d27/d57/d8a/fe4 [0,4194304] 0 2024-04-26T12:06:59.791 INFO:tasks.workunit.client.0.smithi052.stdout:5/999: dwrite db/dd/d34/d70/f6d [0,4194304] 0 2024-04-26T12:06:59.791 INFO:tasks.workunit.client.0.smithi052.stdout:9/994: truncate d3/d3b/dea/dfe/f111 928332 0 2024-04-26T12:06:59.792 INFO:tasks.workunit.client.0.smithi052.stdout:4/988: link d3/d12/d34/d45/d67/d6c/fad d3/d15/d11f/f156 0 2024-04-26T12:06:59.792 INFO:tasks.workunit.client.0.smithi052.stdout:3/983: mknod d2/d4/dc/d33/d37/dd4/c129 0 2024-04-26T12:06:59.792 INFO:tasks.workunit.client.0.smithi052.stdout:8/945: symlink d0/d4/d5/d27/d57/d8a/l137 0 2024-04-26T12:06:59.793 INFO:tasks.workunit.client.0.smithi052.stdout:9/995: write d3/d3b/fb7 [1026610,55453] 0 2024-04-26T12:06:59.794 INFO:tasks.workunit.client.0.smithi052.stdout:6/984: symlink da/d22/d29/dd4/ddf/d95/d141/l15e 0 2024-04-26T12:06:59.794 INFO:tasks.workunit.client.0.smithi052.stdout:3/984: chown d2/d4/dc/d33/l53 33690365 1 2024-04-26T12:06:59.794 INFO:tasks.workunit.client.0.smithi052.stdout:8/946: write d0/d4/d5/d27/d57/d8a/ff5 [461944,109151] 0 2024-04-26T12:06:59.795 INFO:tasks.workunit.client.0.smithi052.stdout:6/985: creat da/d51/d11e/f15f x:0 0 0 2024-04-26T12:06:59.795 INFO:tasks.workunit.client.0.smithi052.stdout:3/985: mkdir d2/d4/dc/d1d/d25/d36/d1c/d12a 0 2024-04-26T12:06:59.797 INFO:tasks.workunit.client.0.smithi052.stdout:8/947: mknod d0/d4/d5/d86/d9c/db4/d58/c138 0 2024-04-26T12:06:59.797 INFO:tasks.workunit.client.0.smithi052.stdout:8/948: symlink d0/d4/d5/da3/l139 0 2024-04-26T12:06:59.798 INFO:tasks.workunit.client.0.smithi052.stdout:4/989: dwrite d3/d2b/d40/fe6 [0,4194304] 0 2024-04-26T12:06:59.800 INFO:tasks.workunit.client.0.smithi052.stdout:3/986: read d2/d4/d41/fdf [2693783,28047] 0 2024-04-26T12:06:59.800 INFO:tasks.workunit.client.0.smithi052.stdout:6/986: dwrite da/d22/d29/f5a [0,4194304] 0 2024-04-26T12:06:59.802 INFO:tasks.workunit.client.0.smithi052.stdout:3/987: rmdir d2/d4/dc/d33/d37 39 2024-04-26T12:06:59.803 INFO:tasks.workunit.client.0.smithi052.stdout:6/987: write da/d22/d29/dd4/df7/d104/f147 [170015,33383] 0 2024-04-26T12:06:59.803 INFO:tasks.workunit.client.0.smithi052.stdout:9/996: dwrite d3/db/d10/d3c/d40/d96/db5/f8b [0,4194304] 0 2024-04-26T12:06:59.804 INFO:tasks.workunit.client.0.smithi052.stdout:3/988: unlink d2/d4/c62 0 2024-04-26T12:06:59.805 INFO:tasks.workunit.client.0.smithi052.stdout:9/997: creat d3/d23/dd0/d11c/f168 x:0 0 0 2024-04-26T12:06:59.805 INFO:tasks.workunit.client.0.smithi052.stdout:4/990: dwrite d3/d15/f127 [0,4194304] 0 2024-04-26T12:06:59.806 INFO:tasks.workunit.client.0.smithi052.stdout:3/989: mkdir d2/d4/dc/d33/d37/dd4/d12b 0 2024-04-26T12:06:59.806 INFO:tasks.workunit.client.0.smithi052.stdout:4/991: fdatasync d3/d12/d59/faa 0 2024-04-26T12:06:59.806 INFO:tasks.workunit.client.0.smithi052.stdout:9/998: truncate d3/db/d13/ffc 1664541 0 2024-04-26T12:06:59.808 INFO:tasks.workunit.client.0.smithi052.stdout:3/990: write d2/d4/dc/d33/d75/dfa/f10d [18527,49206] 0 2024-04-26T12:06:59.808 INFO:tasks.workunit.client.0.smithi052.stdout:4/992: link d3/d12/d59/f82 d3/d12/d59/d96/f157 0 2024-04-26T12:06:59.809 INFO:tasks.workunit.client.0.smithi052.stdout:3/991: stat d2/d4/dc/d33/d37/dd4/d12b 0 2024-04-26T12:06:59.809 INFO:tasks.workunit.client.0.smithi052.stdout:9/999: dread d3/d23/dd0/d11c/f123 [0,4194304] 0 2024-04-26T12:06:59.809 INFO:tasks.workunit.client.0.smithi052.stdout:4/993: write d3/d12/d59/d96/f149 [885470,29321] 0 2024-04-26T12:06:59.810 INFO:tasks.workunit.client.0.smithi052.stdout:3/992: dread - d2/d4/d2a/dbf/ff5 zero size 2024-04-26T12:06:59.810 INFO:tasks.workunit.client.0.smithi052.stdout:4/994: fdatasync d3/d12/d59/d96/f106 0 2024-04-26T12:06:59.812 INFO:tasks.workunit.client.0.smithi052.stdout:1/932: sync 2024-04-26T12:06:59.814 INFO:tasks.workunit.client.0.smithi052.stdout:6/988: dwrite da/d22/d29/dd4/ddf/d95/dd2/db9/f121 [0,4194304] 0 2024-04-26T12:06:59.814 INFO:tasks.workunit.client.0.smithi052.stdout:1/933: dread - d0/d2/dd/d40/d81/d9a/da6/dc4/f12e zero size 2024-04-26T12:06:59.815 INFO:tasks.workunit.client.0.smithi052.stdout:3/993: dwrite d2/d4/dc/d1d/f32 [0,4194304] 0 2024-04-26T12:06:59.815 INFO:tasks.workunit.client.0.smithi052.stdout:1/934: write d0/d2/dd/d40/d81/d9a/da6/fc5 [189841,1058] 0 2024-04-26T12:06:59.815 INFO:tasks.workunit.client.0.smithi052.stdout:6/989: symlink da/d22/d29/d31/d6f/dcc/df6/l160 0 2024-04-26T12:06:59.816 INFO:tasks.workunit.client.0.smithi052.stdout:1/935: unlink d0/d2/dd/d34/f12d 0 2024-04-26T12:06:59.816 INFO:tasks.workunit.client.0.smithi052.stdout:8/949: dread d0/d4/dc/d68/fa6 [0,4194304] 0 2024-04-26T12:06:59.818 INFO:tasks.workunit.client.0.smithi052.stdout:1/936: write d0/d2/dd/d40/dc1/d1d/d91/fc3 [1352528,10119] 0 2024-04-26T12:06:59.818 INFO:tasks.workunit.client.0.smithi052.stdout:1/937: readlink d0/d2/l84 0 2024-04-26T12:06:59.819 INFO:tasks.workunit.client.0.smithi052.stdout:8/950: link d0/d4/d5/d27/d57/d8a/ff5 d0/d4/d5/d27/f13a 0 2024-04-26T12:06:59.820 INFO:tasks.workunit.client.0.smithi052.stdout:8/951: stat d0/d4/d1c/fa9 0 2024-04-26T12:06:59.820 INFO:tasks.workunit.client.0.smithi052.stdout:3/994: dwrite d2/d4/d41/fdf [4194304,4194304] 0 2024-04-26T12:06:59.821 INFO:tasks.workunit.client.0.smithi052.stdout:1/938: getdents d0/d2/dd/d40/d81/d9a/dce/de9/d9b/d114/d128/dcb 0 2024-04-26T12:06:59.822 INFO:tasks.workunit.client.0.smithi052.stdout:8/952: rename d0/d4/d5/d3c/lf4 to d0/d16/d63/d8b/l13b 0 2024-04-26T12:06:59.824 INFO:tasks.workunit.client.0.smithi052.stdout:8/953: rename d0/d3e/c6c to d0/d4/d5/d27/c13c 0 2024-04-26T12:06:59.826 INFO:tasks.workunit.client.0.smithi052.stdout:3/995: dwrite d2/d4/dc/d1d/d25/d36/d1c/f120 [0,4194304] 0 2024-04-26T12:06:59.827 INFO:tasks.workunit.client.0.smithi052.stdout:1/939: dwrite d0/d2/dd/d40/d81/d9a/dce/de9/d9b/fa9 [0,4194304] 0 2024-04-26T12:06:59.828 INFO:tasks.workunit.client.0.smithi052.stdout:1/940: chown d0/d2/dd/d40 376167498 1 2024-04-26T12:06:59.828 INFO:tasks.workunit.client.0.smithi052.stdout:3/996: mknod d2/d4/d6b/dcf/de4/c12c 0 2024-04-26T12:06:59.830 INFO:tasks.workunit.client.0.smithi052.stdout:3/997: write d2/d4/d2a/f10e [34170,10504] 0 2024-04-26T12:06:59.830 INFO:tasks.workunit.client.0.smithi052.stdout:1/941: symlink d0/d2/dd/d40/d81/d9a/da6/dc4/dec/l134 0 2024-04-26T12:06:59.831 INFO:tasks.workunit.client.0.smithi052.stdout:1/942: fsync d0/d2/dd/d40/dc1/d1d/d91/f8a 0 2024-04-26T12:06:59.831 INFO:tasks.workunit.client.0.smithi052.stdout:3/998: write d2/d4/dc/d68/ff6 [236536,95896] 0 2024-04-26T12:06:59.831 INFO:tasks.workunit.client.0.smithi052.stdout:8/954: dwrite d0/d4/d5/db/d20/f24 [0,4194304] 0 2024-04-26T12:06:59.833 INFO:tasks.workunit.client.0.smithi052.stdout:3/999: link d2/d4/dc/d1d/d25/d61/f82 d2/d4/dc/d33/d8a/f12d 0 2024-04-26T12:06:59.836 INFO:tasks.workunit.client.0.smithi052.stdout:8/955: truncate d0/d4/dc/f11f 948860 0 2024-04-26T12:06:59.837 INFO:tasks.workunit.client.0.smithi052.stdout:8/956: unlink d0/d4/d5/db/l4e 0 2024-04-26T12:06:59.838 INFO:tasks.workunit.client.0.smithi052.stdout:4/995: sync 2024-04-26T12:06:59.839 INFO:tasks.workunit.client.0.smithi052.stdout:6/990: dread da/d22/d29/dd4/ddf/d95/df8/d68/ff1 [0,4194304] 0 2024-04-26T12:06:59.839 INFO:tasks.workunit.client.0.smithi052.stdout:4/996: link d3/c11b d3/d12/d59/d96/dc0/d92/d140/c158 0 2024-04-26T12:06:59.840 INFO:tasks.workunit.client.0.smithi052.stdout:6/991: write da/d22/ffc [2152341,121854] 0 2024-04-26T12:06:59.844 INFO:tasks.workunit.client.0.smithi052.stdout:6/992: dwrite da/d22/d29/d31/f13d [0,4194304] 0 2024-04-26T12:06:59.846 INFO:tasks.workunit.client.0.smithi052.stdout:6/993: rename da/d22/l33 to da/d22/d29/d31/d6f/dcc/df6/l161 0 2024-04-26T12:06:59.846 INFO:tasks.workunit.client.0.smithi052.stdout:4/997: truncate d3/d22/fc2 2328269 0 2024-04-26T12:06:59.847 INFO:tasks.workunit.client.0.smithi052.stdout:6/994: read da/d22/d29/dd4/fe3 [4175735,120403] 0 2024-04-26T12:06:59.848 INFO:tasks.workunit.client.0.smithi052.stdout:6/995: mkdir da/d51/d162 0 2024-04-26T12:06:59.849 INFO:tasks.workunit.client.0.smithi052.stdout:6/996: symlink da/d22/d29/dd4/ddf/d7c/l163 0 2024-04-26T12:06:59.850 INFO:tasks.workunit.client.0.smithi052.stdout:4/998: dwrite d3/d15/f141 [0,4194304] 0 2024-04-26T12:06:59.850 INFO:tasks.workunit.client.0.smithi052.stdout:6/997: dread - da/d22/d29/dd4/ddf/d92/d96/d131/f14f zero size 2024-04-26T12:06:59.851 INFO:tasks.workunit.client.0.smithi052.stdout:6/998: mknod da/d22/d29/dd4/ddf/d92/c164 0 2024-04-26T12:06:59.851 INFO:tasks.workunit.client.0.smithi052.stdout:4/999: mkdir d3/d12/d34/d45/d67/d6c/d159 0 2024-04-26T12:06:59.852 INFO:tasks.workunit.client.0.smithi052.stdout:6/999: fsync da/d22/d29/dd4/ddf/d7c/d94/fc6 0 2024-04-26T12:06:59.854 INFO:tasks.workunit.client.0.smithi052.stdout:1/943: dread d0/d2/f18 [0,4194304] 0 2024-04-26T12:06:59.855 INFO:tasks.workunit.client.0.smithi052.stdout:1/944: mkdir d0/d2/dd/d40/d81/d9a/dce/dcf/d135 0 2024-04-26T12:06:59.856 INFO:tasks.workunit.client.0.smithi052.stdout:1/945: write d0/d2/dd/d40/d81/d9a/f10e [7378422,91363] 0 2024-04-26T12:06:59.857 INFO:tasks.workunit.client.0.smithi052.stdout:1/946: creat d0/d83/d4b/db2/f136 x:0 0 0 2024-04-26T12:06:59.857 INFO:tasks.workunit.client.0.smithi052.stdout:1/947: creat d0/d2/dd/d40/dc1/d11e/f137 x:0 0 0 2024-04-26T12:06:59.865 INFO:tasks.workunit.client.0.smithi052.stdout:8/957: sync 2024-04-26T12:06:59.865 INFO:tasks.workunit.client.0.smithi052.stdout:8/958: fsync d0/d4/d5/d27/f100 0 2024-04-26T12:06:59.867 INFO:tasks.workunit.client.0.smithi052.stdout:8/959: read d0/d4/d5/db/f5e [1332841,90890] 0 2024-04-26T12:06:59.868 INFO:tasks.workunit.client.0.smithi052.stdout:8/960: mkdir d0/d4/d5/d27/d57/d8a/d13d 0 2024-04-26T12:06:59.869 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:06:59.870 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:06:59.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:06:59.870 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:06:59.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.870 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:536 3.2 3:4272d415:::200.0000000b:head [write 405817~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:59.870 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:06:59.870 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.3434966130000001, 2024-04-26T12:06:59.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053030282999999998, 2024-04-26T12:06:59.870 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:59.870 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.870 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:59.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:59.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:06:59.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:59.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:06:59.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:59.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524136+0000", 2024-04-26T12:06:59.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.872 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:59.872 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524139+0000", 2024-04-26T12:06:59.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2919999999999998e-06 2024-04-26T12:06:59.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.872 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:59.872 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524144+0000", 2024-04-26T12:06:59.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.502e-06 2024-04-26T12:06:59.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.872 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.872 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524149+0000", 2024-04-26T12:06:59.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7310000000000001e-06 2024-04-26T12:06:59.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:59.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570935+0000", 2024-04-26T12:06:59.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.046785603000000002 2024-04-26T12:06:59.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:59.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570981+0000", 2024-04-26T12:06:59.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6085999999999999e-05 2024-04-26T12:06:59.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:59.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577039+0000", 2024-04-26T12:06:59.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060582099999999996 2024-04-26T12:06:59.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:59.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577081+0000", 2024-04-26T12:06:59.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1927e-05 2024-04-26T12:06:59.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:59.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577167+0000", 2024-04-26T12:06:59.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6311999999999996e-05 2024-04-26T12:06:59.874 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.874 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:59.874 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.875 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:537 3.2 3:4272d415:::200.0000000b:head [write 407216~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:59.875 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:06:59.875 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.3434806750000003, 2024-04-26T12:06:59.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053131411000000003, 2024-04-26T12:06:59.875 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:59.875 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.875 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:59.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:59.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:06:59.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:59.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:06:59.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:59.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524152+0000", 2024-04-26T12:06:59.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:59.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524157+0000", 2024-04-26T12:06:59.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3529999999999997e-06 2024-04-26T12:06:59.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:59.877 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524162+0000", 2024-04-26T12:06:59.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5910000000000003e-06 2024-04-26T12:06:59.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.877 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524170+0000", 2024-04-26T12:06:59.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:06:59.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:59.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571323+0000", 2024-04-26T12:06:59.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047153289000000001 2024-04-26T12:06:59.878 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.878 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:59.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571367+0000", 2024-04-26T12:06:59.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4205000000000001e-05 2024-04-26T12:06:59.878 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.878 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:59.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577174+0000", 2024-04-26T12:06:59.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058072250000000001 2024-04-26T12:06:59.878 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:59.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577218+0000", 2024-04-26T12:06:59.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3294999999999998e-05 2024-04-26T12:06:59.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:59.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577284+0000", 2024-04-26T12:06:59.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6483999999999996e-05 2024-04-26T12:06:59.879 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.879 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:59.879 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.879 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:538 3.2 3:4272d415:::200.0000000b:head [write 408629~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:59.879 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:06:59.880 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.343459975, 2024-04-26T12:06:59.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053241841999999998, 2024-04-26T12:06:59.880 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:59.880 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.880 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:59.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:59.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:06:59.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:59.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:06:59.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:59.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:06:59.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:59.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524178+0000", 2024-04-26T12:06:59.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1420000000000001e-06 2024-04-26T12:06:59.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:59.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524184+0000", 2024-04-26T12:06:59.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4240000000000001e-06 2024-04-26T12:06:59.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.882 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.882 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524188+0000", 2024-04-26T12:06:59.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2710000000000003e-06 2024-04-26T12:06:59.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.882 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:59.882 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571623+0000", 2024-04-26T12:06:59.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047435119999999997 2024-04-26T12:06:59.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.883 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:59.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571668+0000", 2024-04-26T12:06:59.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5377000000000003e-05 2024-04-26T12:06:59.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.883 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.883 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:59.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577292+0000", 2024-04-26T12:06:59.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0056232030000000002 2024-04-26T12:06:59.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.883 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.883 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:59.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577330+0000", 2024-04-26T12:06:59.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8748999999999998e-05 2024-04-26T12:06:59.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:59.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577415+0000", 2024-04-26T12:06:59.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4913000000000005e-05 2024-04-26T12:06:59.884 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.884 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:59.884 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.884 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:539 3.2 3:4272d415:::200.0000000b:head [write 410547~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:59.884 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:06:59.884 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.3434418429999999, 2024-04-26T12:06:59.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053372670999999997, 2024-04-26T12:06:59.884 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:59.885 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.885 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:59.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:59.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:06:59.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:59.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:06:59.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:59.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524191+0000", 2024-04-26T12:06:59.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:59.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524199+0000", 2024-04-26T12:06:59.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6520000000000006e-06 2024-04-26T12:06:59.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:59.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524205+0000", 2024-04-26T12:06:59.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:06:59.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524209+0000", 2024-04-26T12:06:59.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.335e-06 2024-04-26T12:06:59.887 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:59.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572320+0000", 2024-04-26T12:06:59.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048110992999999998 2024-04-26T12:06:59.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:59.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572364+0000", 2024-04-26T12:06:59.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4577999999999999e-05 2024-04-26T12:06:59.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:59.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577426+0000", 2024-04-26T12:06:59.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050615139999999996 2024-04-26T12:06:59.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:59.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577480+0000", 2024-04-26T12:06:59.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3599e-05 2024-04-26T12:06:59.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:59.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577564+0000", 2024-04-26T12:06:59.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4699999999999999e-05 2024-04-26T12:06:59.892 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.892 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:59.892 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.892 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:540 3.2 3:4272d415:::200.0000000b:head [write 411948~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:59.892 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:06:59.892 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.3434208249999999, 2024-04-26T12:06:59.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053497045999999999, 2024-04-26T12:06:59.892 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:59.893 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.893 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:59.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:59.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:06:59.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:59.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:06:59.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:59.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524212+0000", 2024-04-26T12:06:59.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.894 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:59.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524215+0000", 2024-04-26T12:06:59.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.559e-06 2024-04-26T12:06:59.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.894 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:59.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524220+0000", 2024-04-26T12:06:59.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2920000000000003e-06 2024-04-26T12:06:59.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.895 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.895 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524224+0000", 2024-04-26T12:06:59.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3680000000000004e-06 2024-04-26T12:06:59.895 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.895 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:59.895 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572619+0000", 2024-04-26T12:06:59.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048394549000000002 2024-04-26T12:06:59.895 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.895 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:59.895 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572669+0000", 2024-04-26T12:06:59.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0249e-05 2024-04-26T12:06:59.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:59.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577575+0000", 2024-04-26T12:06:59.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049053329999999996 2024-04-26T12:06:59.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:59.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577625+0000", 2024-04-26T12:06:59.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0274e-05 2024-04-26T12:06:59.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:59.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577710+0000", 2024-04-26T12:06:59.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4741999999999996e-05 2024-04-26T12:06:59.897 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.897 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:59.897 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.897 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:543 3.2 3:4272d415:::200.0000000b:head [write 413907~2485 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:59.897 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:06:59.898 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.3433511310000004, 2024-04-26T12:06:59.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053578708000000003, 2024-04-26T12:06:59.898 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:59.898 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.898 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:59.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:59.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:06:59.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:59.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:06:59.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:59.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:06:59.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:59.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524287+0000", 2024-04-26T12:06:59.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2190000000000003e-06 2024-04-26T12:06:59.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:59.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524294+0000", 2024-04-26T12:06:59.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5660000000000003e-06 2024-04-26T12:06:59.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524298+0000", 2024-04-26T12:06:59.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3900000000000003e-06 2024-04-26T12:06:59.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:59.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572992+0000", 2024-04-26T12:06:59.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048693835999999997 2024-04-26T12:06:59.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:59.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573045+0000", 2024-04-26T12:06:59.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2793000000000001e-05 2024-04-26T12:06:59.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:59.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577721+0000", 2024-04-26T12:06:59.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046760550000000001 2024-04-26T12:06:59.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:59.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577777+0000", 2024-04-26T12:06:59.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5908000000000001e-05 2024-04-26T12:06:59.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:59.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577861+0000", 2024-04-26T12:06:59.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4337000000000002e-05 2024-04-26T12:06:59.903 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.903 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:59.903 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.904 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:544 3.2 3:4272d415:::200.0000000b:head [write 416392~3872 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:59.904 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:06:59.904 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.3433314090000001, 2024-04-26T12:06:59.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054810527999999997, 2024-04-26T12:06:59.904 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:59.904 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.904 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:59.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:59.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:06:59.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:59.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:06:59.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:59.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:06:59.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:59.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524307+0000", 2024-04-26T12:06:59.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1580000000000004e-06 2024-04-26T12:06:59.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:59.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524312+0000", 2024-04-26T12:06:59.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6380000000000001e-06 2024-04-26T12:06:59.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524317+0000", 2024-04-26T12:06:59.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4000000000000002e-06 2024-04-26T12:06:59.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:59.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573348+0000", 2024-04-26T12:06:59.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049031433999999999 2024-04-26T12:06:59.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:59.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573393+0000", 2024-04-26T12:06:59.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4536999999999997e-05 2024-04-26T12:06:59.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:59.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578978+0000", 2024-04-26T12:06:59.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055848299999999998 2024-04-26T12:06:59.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:59.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579031+0000", 2024-04-26T12:06:59.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3708000000000001e-05 2024-04-26T12:06:59.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:59.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579113+0000", 2024-04-26T12:06:59.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1258e-05 2024-04-26T12:06:59.910 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.910 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:59.910 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.910 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:545 3.2 3:4272d415:::200.0000000b:head [write 420264~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:59.910 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:06:59.910 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.343312783, 2024-04-26T12:06:59.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054927386000000002, 2024-04-26T12:06:59.911 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:59.911 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.911 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:59.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:59.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:06:59.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:59.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:06:59.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:59.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524320+0000", 2024-04-26T12:06:59.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:59.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524325+0000", 2024-04-26T12:06:59.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5249999999999999e-06 2024-04-26T12:06:59.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:59.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524330+0000", 2024-04-26T12:06:59.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5629999999999999e-06 2024-04-26T12:06:59.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524335+0000", 2024-04-26T12:06:59.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.685e-06 2024-04-26T12:06:59.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:59.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573727+0000", 2024-04-26T12:06:59.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049392034000000001 2024-04-26T12:06:59.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:59.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573775+0000", 2024-04-26T12:06:59.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7435999999999998e-05 2024-04-26T12:06:59.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:59.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579120+0000", 2024-04-26T12:06:59.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0053452949999999999 2024-04-26T12:06:59.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:59.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579167+0000", 2024-04-26T12:06:59.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7240000000000002e-05 2024-04-26T12:06:59.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:59.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579248+0000", 2024-04-26T12:06:59.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0947999999999998e-05 2024-04-26T12:06:59.915 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.915 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:59.915 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.915 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 422222~8537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:59.915 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:06:59.915 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.3432944659999997, 2024-04-26T12:06:59.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055065936000000003, 2024-04-26T12:06:59.915 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:59.915 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.916 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:59.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:59.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:06:59.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:59.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:06:59.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:59.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:06:59.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:59.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524347+0000", 2024-04-26T12:06:59.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7129999999999994e-06 2024-04-26T12:06:59.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:59.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524357+0000", 2024-04-26T12:06:59.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0232e-05 2024-04-26T12:06:59.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524362+0000", 2024-04-26T12:06:59.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:06:59.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:59.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574119+0000", 2024-04-26T12:06:59.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049756727000000001 2024-04-26T12:06:59.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:59.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574166+0000", 2024-04-26T12:06:59.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7086000000000003e-05 2024-04-26T12:06:59.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:59.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579261+0000", 2024-04-26T12:06:59.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050948310000000002 2024-04-26T12:06:59.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:59.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579316+0000", 2024-04-26T12:06:59.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5068000000000002e-05 2024-04-26T12:06:59.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:59.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579405+0000", 2024-04-26T12:06:59.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9251000000000003e-05 2024-04-26T12:06:59.919 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.920 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:59.920 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.920 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 430759~2035 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:59.920 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:06:59.920 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.3432674760000003, 2024-04-26T12:06:59.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055164950999999997, 2024-04-26T12:06:59.920 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:59.920 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.920 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:59.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:59.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:06:59.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:59.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:06:59.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:59.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:06:59.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:59.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524368+0000", 2024-04-26T12:06:59.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.57e-06 2024-04-26T12:06:59.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:59.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524375+0000", 2024-04-26T12:06:59.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6170000000000003e-06 2024-04-26T12:06:59.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524380+0000", 2024-04-26T12:06:59.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2700000000000004e-06 2024-04-26T12:06:59.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:59.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574639+0000", 2024-04-26T12:06:59.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050259459999999999 2024-04-26T12:06:59.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:59.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574687+0000", 2024-04-26T12:06:59.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7608999999999998e-05 2024-04-26T12:06:59.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:59.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579414+0000", 2024-04-26T12:06:59.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047268750000000002 2024-04-26T12:06:59.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:59.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579456+0000", 2024-04-26T12:06:59.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1885000000000003e-05 2024-04-26T12:06:59.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:59.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579531+0000", 2024-04-26T12:06:59.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5053000000000001e-05 2024-04-26T12:06:59.924 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.924 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:59.924 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.924 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 432794~10523 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:59.924 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:06:59.925 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.3422767520000001, 2024-04-26T12:06:59.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054314727, 2024-04-26T12:06:59.925 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:59.925 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.925 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:59.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:59.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:06:59.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:59.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:06:59.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:59.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525356+0000", 2024-04-26T12:06:59.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:59.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525414+0000", 2024-04-26T12:06:59.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8148e-05 2024-04-26T12:06:59.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:59.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525423+0000", 2024-04-26T12:06:59.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9749999999999996e-06 2024-04-26T12:06:59.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525428+0000", 2024-04-26T12:06:59.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0270000000000003e-06 2024-04-26T12:06:59.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:59.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574950+0000", 2024-04-26T12:06:59.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049521840999999997 2024-04-26T12:06:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575002+0000", 2024-04-26T12:06:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1586999999999999e-05 2024-04-26T12:06:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579543+0000", 2024-04-26T12:06:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045416340000000001 2024-04-26T12:06:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:59.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579587+0000", 2024-04-26T12:06:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3875999999999998e-05 2024-04-26T12:06:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579671+0000", 2024-04-26T12:06:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4351999999999995e-05 2024-04-26T12:06:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 443317~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:06:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.3422007770000004, 2024-04-26T12:06:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054381889000000003, 2024-04-26T12:06:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:06:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:06:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525432+0000", 2024-04-26T12:06:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525435+0000", 2024-04-26T12:06:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3070000000000001e-06 2024-04-26T12:06:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525439+0000", 2024-04-26T12:06:59.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.104e-06 2024-04-26T12:06:59.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525442+0000", 2024-04-26T12:06:59.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0460000000000001e-06 2024-04-26T12:06:59.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575405+0000", 2024-04-26T12:06:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049963059999999997 2024-04-26T12:06:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575450+0000", 2024-04-26T12:06:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5034000000000003e-05 2024-04-26T12:06:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579680+0000", 2024-04-26T12:06:59.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042302260000000001 2024-04-26T12:06:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579737+0000", 2024-04-26T12:06:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7241000000000003e-05 2024-04-26T12:06:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579815+0000", 2024-04-26T12:06:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7278000000000001e-05 2024-04-26T12:06:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 445275~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:06:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.3417736009999999, 2024-04-26T12:06:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054094668999999998, 2024-04-26T12:06:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:06:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:06:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525859+0000", 2024-04-26T12:06:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525864+0000", 2024-04-26T12:06:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:06:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525872+0000", 2024-04-26T12:06:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6790000000000005e-06 2024-04-26T12:06:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525877+0000", 2024-04-26T12:06:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0529999999999997e-06 2024-04-26T12:06:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575723+0000", 2024-04-26T12:06:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049846469999999997 2024-04-26T12:06:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575770+0000", 2024-04-26T12:06:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6387999999999997e-05 2024-04-26T12:06:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579823+0000", 2024-04-26T12:06:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0040534189999999999 2024-04-26T12:06:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579869+0000", 2024-04-26T12:06:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6218999999999999e-05 2024-04-26T12:06:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579954+0000", 2024-04-26T12:06:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5315999999999994e-05 2024-04-26T12:06:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:551 3.2 3:4272d415:::200.0000000b:head [write 448232~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:06:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.3413261670000001, 2024-04-26T12:06:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053798273000000001, 2024-04-26T12:06:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.939 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:06:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:06:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:59.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:06:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526310+0000", 2024-04-26T12:06:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5279999999999999e-06 2024-04-26T12:06:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526317+0000", 2024-04-26T12:06:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8430000000000004e-06 2024-04-26T12:06:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526322+0000", 2024-04-26T12:06:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3340000000000001e-06 2024-04-26T12:06:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576135+0000", 2024-04-26T12:06:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049812113999999998 2024-04-26T12:06:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576186+0000", 2024-04-26T12:06:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1443999999999997e-05 2024-04-26T12:06:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579962+0000", 2024-04-26T12:06:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037763359999999999 2024-04-26T12:06:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580016+0000", 2024-04-26T12:06:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3421000000000002e-05 2024-04-26T12:06:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580106+0000", 2024-04-26T12:06:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9790000000000006e-05 2024-04-26T12:06:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.943 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 450189~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:06:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.3412460379999995, 2024-04-26T12:06:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055070796999999998, 2024-04-26T12:06:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:59.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:06:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:06:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:06:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526390+0000", 2024-04-26T12:06:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8559999999999998e-06 2024-04-26T12:06:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526395+0000", 2024-04-26T12:06:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3319999999999999e-06 2024-04-26T12:06:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526399+0000", 2024-04-26T12:06:59.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.619e-06 2024-04-26T12:06:59.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:59.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576476+0000", 2024-04-26T12:06:59.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050077643999999998 2024-04-26T12:06:59.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576524+0000", 2024-04-26T12:06:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7184000000000001e-05 2024-04-26T12:06:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581347+0000", 2024-04-26T12:06:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0048231919999999996 2024-04-26T12:06:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:59.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581398+0000", 2024-04-26T12:06:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1345999999999999e-05 2024-04-26T12:06:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581458+0000", 2024-04-26T12:06:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0081000000000003e-05 2024-04-26T12:06:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 452113~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:06:59.949 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.3411348219999999, 2024-04-26T12:06:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055041448, 2024-04-26T12:06:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:06:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:06:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526498+0000", 2024-04-26T12:06:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526540+0000", 2024-04-26T12:06:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2267e-05 2024-04-26T12:06:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526547+0000", 2024-04-26T12:06:59.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7000000000000002e-06 2024-04-26T12:06:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526550+0000", 2024-04-26T12:06:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0299999999999998e-06 2024-04-26T12:06:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577902+0000", 2024-04-26T12:06:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051351648999999999 2024-04-26T12:06:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:59.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577953+0000", 2024-04-26T12:06:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1289000000000003e-05 2024-04-26T12:06:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581464+0000", 2024-04-26T12:06:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035111259999999998 2024-04-26T12:06:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581490+0000", 2024-04-26T12:06:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5717000000000001e-05 2024-04-26T12:06:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581540+0000", 2024-04-26T12:06:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0287999999999997e-05 2024-04-26T12:06:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 454070~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:06:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.340577873, 2024-04-26T12:06:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054564161, 2024-04-26T12:06:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.954 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:06:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:06:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527055+0000", 2024-04-26T12:06:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527058+0000", 2024-04-26T12:06:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9890000000000001e-06 2024-04-26T12:06:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527066+0000", 2024-04-26T12:06:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4730000000000003e-06 2024-04-26T12:06:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527069+0000", 2024-04-26T12:06:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5810000000000001e-06 2024-04-26T12:06:59.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578308+0000", 2024-04-26T12:06:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051238911999999998 2024-04-26T12:06:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578391+0000", 2024-04-26T12:06:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2713999999999994e-05 2024-04-26T12:06:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581548+0000", 2024-04-26T12:06:59.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031577530000000001 2024-04-26T12:06:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581574+0000", 2024-04-26T12:06:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5350999999999998e-05 2024-04-26T12:06:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581620+0000", 2024-04-26T12:06:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5868999999999997e-05 2024-04-26T12:06:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:59.958 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.959 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 456028~3870 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:59.959 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:06:59.959 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.3388216310000001, 2024-04-26T12:06:59.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055118997000000003, 2024-04-26T12:06:59.959 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:59.959 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.959 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:59.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:59.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:06:59.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:59.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:06:59.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528811+0000", 2024-04-26T12:06:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528887+0000", 2024-04-26T12:06:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5977999999999997e-05 2024-04-26T12:06:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528897+0000", 2024-04-26T12:06:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8730000000000002e-06 2024-04-26T12:06:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528901+0000", 2024-04-26T12:06:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4880000000000001e-06 2024-04-26T12:06:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580146+0000", 2024-04-26T12:06:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051244242000000002 2024-04-26T12:06:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580227+0000", 2024-04-26T12:06:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1044000000000005e-05 2024-04-26T12:06:59.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:59.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583864+0000", 2024-04-26T12:06:59.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036374419999999998 2024-04-26T12:06:59.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:59.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583894+0000", 2024-04-26T12:06:59.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9828999999999999e-05 2024-04-26T12:06:59.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:59.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583931+0000", 2024-04-26T12:06:59.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6908e-05 2024-04-26T12:06:59.964 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.964 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:59.964 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.964 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 459898~2037 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:59.964 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:06:59.964 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.3384336399999999, 2024-04-26T12:06:59.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055925713000000002, 2024-04-26T12:06:59.964 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:59.964 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.964 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:59.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:06:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:06:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529199+0000", 2024-04-26T12:06:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:06:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529203+0000", 2024-04-26T12:06:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:06:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529209+0000", 2024-04-26T12:06:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7939999999999999e-06 2024-04-26T12:06:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529212+0000", 2024-04-26T12:06:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7290000000000002e-06 2024-04-26T12:06:59.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580784+0000", 2024-04-26T12:06:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051572073000000003 2024-04-26T12:06:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580883+0000", 2024-04-26T12:06:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8330000000000002e-05 2024-04-26T12:06:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585050+0000", 2024-04-26T12:06:59.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041670209999999999 2024-04-26T12:06:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585088+0000", 2024-04-26T12:06:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8559999999999997e-05 2024-04-26T12:06:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585125+0000", 2024-04-26T12:06:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7197999999999999e-05 2024-04-26T12:06:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 461935~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:06:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:06:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.3377111859999999, 2024-04-26T12:06:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055266150999999999, 2024-04-26T12:06:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:06:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:06:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:06:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:06:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:06:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:06:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:06:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:06:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:06:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529921+0000", 2024-04-26T12:06:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:06:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:06:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529956+0000", 2024-04-26T12:06:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4687000000000002e-05 2024-04-26T12:06:59.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:06:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529966+0000", 2024-04-26T12:06:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0392e-05 2024-04-26T12:06:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:06:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529978+0000", 2024-04-26T12:06:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1348e-05 2024-04-26T12:06:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:06:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581659+0000", 2024-04-26T12:06:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051681454000000002 2024-04-26T12:06:59.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:06:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581746+0000", 2024-04-26T12:06:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6305999999999997e-05 2024-04-26T12:06:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:06:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585131+0000", 2024-04-26T12:06:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033853199999999998 2024-04-26T12:06:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:06:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585154+0000", 2024-04-26T12:06:59.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3258999999999999e-05 2024-04-26T12:06:59.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:06:59.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:06:59.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:06:59.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585188+0000", 2024-04-26T12:06:59.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4236000000000002e-05 2024-04-26T12:06:59.973 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.973 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:59.973 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.973 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:06:59.973 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:06:59.973 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:06:59.976 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:06:59.976 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:06:59.973+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:06:59.983 INFO:tasks.workunit.client.0.smithi052.stdout:1/948: dread d0/d2/dd/d40/dc1/d1d/d91/fc3 [0,4194304] 0 2024-04-26T12:06:59.983 INFO:tasks.workunit.client.0.smithi052.stdout:1/949: read d0/d2/dd/d40/d81/d9a/dce/de9/f10a [105183,20311] 0 2024-04-26T12:06:59.983 INFO:tasks.workunit.client.0.smithi052.stdout:8/961: dread d0/d4/d5/d27/f13a [0,4194304] 0 2024-04-26T12:06:59.983 INFO:tasks.workunit.client.0.smithi052.stdout:1/950: symlink d0/d2/dd/d40/d81/d9a/da6/dc4/df2/l138 0 2024-04-26T12:06:59.983 INFO:tasks.workunit.client.0.smithi052.stdout:8/962: rename d0/d4/d5/d27/d57/dda/fe1 to d0/d4/d1c/d83/f13e 0 2024-04-26T12:06:59.983 INFO:tasks.workunit.client.0.smithi052.stdout:1/951: write d0/d2/dd/d40/dc1/d1d/fe0 [522646,39336] 0 2024-04-26T12:06:59.983 INFO:tasks.workunit.client.0.smithi052.stdout:1/952: dread - d0/d2/dd/d40/df8/fff zero size 2024-04-26T12:06:59.983 INFO:tasks.workunit.client.0.smithi052.stdout:1/953: dread d0/d2/dd/d40/d81/d9a/dce/dcf/f113 [0,4194304] 0 2024-04-26T12:06:59.983 INFO:tasks.workunit.client.0.smithi052.stdout:1/954: mkdir d0/d2/dd/d40/d81/d9a/dce/de2/d139 0 2024-04-26T12:06:59.983 INFO:tasks.workunit.client.0.smithi052.stdout:1/955: chown d0/d83/l6c 29268 1 2024-04-26T12:06:59.983 INFO:tasks.workunit.client.0.smithi052.stdout:1/956: readlink d0/d2/dd/l39 0 2024-04-26T12:06:59.983 INFO:tasks.workunit.client.0.smithi052.stdout:1/957: dwrite d0/d2/dd/d40/d81/f46 [0,4194304] 0 2024-04-26T12:06:59.983 INFO:tasks.workunit.client.0.smithi052.stdout:1/958: stat d0/f4a 0 2024-04-26T12:06:59.984 INFO:tasks.workunit.client.0.smithi052.stdout:1/959: dwrite d0/da/d2e/fed [0,4194304] 0 2024-04-26T12:06:59.984 INFO:tasks.workunit.client.0.smithi052.stdout:1/960: dread - d0/d2/dd/d40/d81/d52/f131 zero size 2024-04-26T12:06:59.984 INFO:tasks.workunit.client.0.smithi052.stdout:1/961: dwrite d0/d2/dd/d40/d81/d9a/da6/dc4/f12e [0,4194304] 0 2024-04-26T12:06:59.984 INFO:tasks.workunit.client.0.smithi052.stdout:8/963: sync 2024-04-26T12:06:59.984 INFO:tasks.workunit.client.0.smithi052.stdout:8/964: fsync d0/f7a 0 2024-04-26T12:06:59.984 INFO:tasks.workunit.client.0.smithi052.stdout:8/965: getdents d0/d4/d5/d27/d57/dda/dfb 0 2024-04-26T12:06:59.984 INFO:tasks.workunit.client.0.smithi052.stdout:8/966: mkdir d0/d4/d5/d86/d13f 0 2024-04-26T12:06:59.984 INFO:tasks.workunit.client.0.smithi052.stdout:8/967: symlink d0/d3e/d87/l140 0 2024-04-26T12:06:59.984 INFO:tasks.workunit.client.0.smithi052.stdout:8/968: creat d0/d4/d5/db/d20/f141 x:0 0 0 2024-04-26T12:06:59.984 INFO:tasks.workunit.client.0.smithi052.stdout:8/969: mknod d0/d3e/d87/c142 0 2024-04-26T12:06:59.984 INFO:tasks.workunit.client.0.smithi052.stdout:8/970: mkdir d0/d4/d5/db/d20/d7b/d143 0 2024-04-26T12:06:59.984 INFO:tasks.workunit.client.0.smithi052.stdout:8/971: symlink d0/l144 0 2024-04-26T12:06:59.984 INFO:tasks.workunit.client.0.smithi052.stdout:8/972: fsync d0/d4/d5/f8c 0 2024-04-26T12:06:59.984 INFO:tasks.workunit.client.0.smithi052.stdout:8/973: symlink d0/d4/d5/db/d20/dec/l145 0 2024-04-26T12:06:59.985 INFO:tasks.workunit.client.0.smithi052.stdout:1/962: dread d0/d2/dd/d40/d81/d52/f72 [0,4194304] 0 2024-04-26T12:06:59.985 INFO:tasks.workunit.client.0.smithi052.stdout:8/974: getdents d0/d4/d5/d86/d9c/db4 0 2024-04-26T12:06:59.985 INFO:tasks.workunit.client.0.smithi052.stdout:8/975: rmdir d0/d4/d1c/d83 39 2024-04-26T12:06:59.985 INFO:tasks.workunit.client.0.smithi052.stdout:8/976: dread d0/d4/dc/d80/fc8 [0,4194304] 0 2024-04-26T12:06:59.985 INFO:tasks.workunit.client.0.smithi052.stdout:8/977: chown d0/d3e 256 1 2024-04-26T12:06:59.985 INFO:tasks.workunit.client.0.smithi052.stdout:1/963: truncate d0/d2/dd/d40/d81/d9a/da6/fc5 2512304 0 2024-04-26T12:06:59.985 INFO:tasks.workunit.client.0.smithi052.stdout:1/964: creat d0/d2/dd/d34/d95/f13a x:0 0 0 2024-04-26T12:06:59.985 INFO:tasks.workunit.client.0.smithi052.stdout:1/965: sync 2024-04-26T12:06:59.985 INFO:tasks.workunit.client.0.smithi052.stdout:1/966: unlink d0/d2/dd/d40/d81/d9a/dce/de9/d9b/cc9 0 2024-04-26T12:06:59.985 INFO:tasks.workunit.client.0.smithi052.stdout:1/967: symlink d0/d2/dd/d40/d81/d9a/dce/de2/l13b 0 2024-04-26T12:06:59.985 INFO:tasks.workunit.client.0.smithi052.stdout:8/978: dwrite d0/d16/d63/d8b/fc4 [0,4194304] 0 2024-04-26T12:06:59.985 INFO:tasks.workunit.client.0.smithi052.stdout:1/968: mkdir d0/d2/dd/d40/dc1/d11e/d13c 0 2024-04-26T12:06:59.985 INFO:tasks.workunit.client.0.smithi052.stdout:8/979: mknod d0/d4/d1c/c146 0 2024-04-26T12:06:59.985 INFO:tasks.workunit.client.0.smithi052.stdout:8/980: stat d0/d4/d5/f61 0 2024-04-26T12:06:59.985 INFO:tasks.workunit.client.0.smithi052.stdout:1/969: write d0/d2/dd/d40/d81/d9a/dce/dcf/f113 [5882321,67104] 0 2024-04-26T12:06:59.986 INFO:tasks.workunit.client.0.smithi052.stdout:8/981: mkdir d0/d16/d28/d147 0 2024-04-26T12:06:59.986 INFO:tasks.workunit.client.0.smithi052.stdout:1/970: symlink d0/d2/dd/d40/d81/d9a/dce/de9/d9b/d114/d128/dcb/l13d 0 2024-04-26T12:06:59.986 INFO:tasks.workunit.client.0.smithi052.stdout:1/971: link d0/d2/dd/d40/d81/d52/f125 d0/d2/dd/d40/d81/d9a/da6/dc4/df2/f13e 0 2024-04-26T12:06:59.986 INFO:tasks.workunit.client.0.smithi052.stdout:8/982: dwrite d0/d4/fba [0,4194304] 0 2024-04-26T12:06:59.986 INFO:tasks.workunit.client.0.smithi052.stdout:1/972: stat d0/d2/dd/d40/dc1/d1d/d91/fbb 0 2024-04-26T12:06:59.986 INFO:tasks.workunit.client.0.smithi052.stdout:8/983: dread d0/d4/d1c/f2b [0,4194304] 0 2024-04-26T12:06:59.986 INFO:tasks.workunit.client.0.smithi052.stdout:8/984: dwrite d0/d16/d28/f7d [4194304,4194304] 0 2024-04-26T12:06:59.986 INFO:tasks.workunit.client.0.smithi052.stdout:1/973: dread d0/d2/dd/d40/d81/d9a/da6/fc5 [0,4194304] 0 2024-04-26T12:06:59.986 INFO:tasks.workunit.client.0.smithi052.stdout:8/985: dwrite d0/d16/f1a [0,4194304] 0 2024-04-26T12:06:59.986 INFO:tasks.workunit.client.0.smithi052.stdout:8/986: chown d0/d4/d5/c6 55995 1 2024-04-26T12:06:59.986 INFO:tasks.workunit.client.0.smithi052.stdout:1/974: mkdir d0/d2/dd/d40/d81/d9a/dce/de9/d13f 0 2024-04-26T12:06:59.986 INFO:tasks.workunit.client.0.smithi052.stdout:8/987: write d0/d4/d5/d27/f10d [412030,108687] 0 2024-04-26T12:06:59.986 INFO:tasks.workunit.client.0.smithi052.stdout:8/988: creat d0/d16/d28/f148 x:0 0 0 2024-04-26T12:06:59.986 INFO:tasks.workunit.client.0.smithi052.stdout:8/989: stat d0/d4/d5/d86/f120 0 2024-04-26T12:06:59.987 INFO:tasks.workunit.client.0.smithi052.stdout:8/990: creat d0/d4/d5/da3/f149 x:0 0 0 2024-04-26T12:06:59.987 INFO:tasks.workunit.client.0.smithi052.stdout:1/975: dwrite d0/d2/dd/d40/d81/d9a/f10e [8388608,4194304] 0 2024-04-26T12:06:59.987 INFO:tasks.workunit.client.0.smithi052.stdout:1/976: symlink d0/d83/d4b/l140 0 2024-04-26T12:06:59.987 INFO:tasks.workunit.client.0.smithi052.stdout:1/977: mkdir d0/d2/dd/d40/d141 0 2024-04-26T12:06:59.987 INFO:tasks.workunit.client.0.smithi052.stdout:1/978: unlink d0/d2/dd/d40/dc1/d1d/d23/f61 0 2024-04-26T12:06:59.987 INFO:tasks.workunit.client.0.smithi052.stdout:1/979: mknod d0/d2/dd/d40/d81/d9a/dce/de9/c142 0 2024-04-26T12:06:59.987 INFO:tasks.workunit.client.0.smithi052.stdout:1/980: dread d0/d83/d4b/fd3 [0,4194304] 0 2024-04-26T12:06:59.987 INFO:tasks.workunit.client.0.smithi052.stdout:8/991: dread d0/d4/d5/d86/d9c/db4/d58/d89/f113 [0,4194304] 0 2024-04-26T12:06:59.987 INFO:tasks.workunit.client.0.smithi052.stdout:8/992: truncate d0/d4/d5/d86/d9c/db4/d58/d8f/f91 3339663 0 2024-04-26T12:06:59.987 INFO:tasks.workunit.client.0.smithi052.stdout:8/993: rmdir d0/d4/d5/d27 39 2024-04-26T12:06:59.987 INFO:tasks.workunit.client.0.smithi052.stdout:8/994: link d0/f71 d0/f14a 0 2024-04-26T12:06:59.987 INFO:tasks.workunit.client.0.smithi052.stdout:8/995: dread d0/d3e/fa0 [0,4194304] 0 2024-04-26T12:06:59.987 INFO:tasks.workunit.client.0.smithi052.stdout:8/996: mkdir d0/d4/d1c/d83/d14b 0 2024-04-26T12:06:59.987 INFO:tasks.workunit.client.0.smithi052.stdout:8/997: write d0/d4/d5/d86/d9c/db4/dd8/fdb [46265,3239] 0 2024-04-26T12:06:59.988 INFO:tasks.workunit.client.0.smithi052.stdout:8/998: rename d0/d4/d5/d27/f4c to d0/d4/d5/d86/d9c/db4/f14c 0 2024-04-26T12:06:59.988 INFO:tasks.workunit.client.0.smithi052.stdout:8/999: mknod d0/d4/d1c/d83/d14b/c14d 0 2024-04-26T12:06:59.996 INFO:tasks.workunit.client.0.smithi052.stdout:1/981: sync 2024-04-26T12:06:59.998 INFO:tasks.workunit.client.0.smithi052.stdout:1/982: read d0/d2/dd/d40/dc1/d1d/f37 [1952355,102632] 0 2024-04-26T12:07:00.000 INFO:tasks.workunit.client.0.smithi052.stdout:1/983: truncate d0/d2/dd/d40/d81/d9a/da6/dc4/df2/f13e 247031 0 2024-04-26T12:07:00.001 INFO:tasks.workunit.client.0.smithi052.stdout:1/984: creat d0/d2/dd/d40/d81/d9a/dce/f143 x:0 0 0 2024-04-26T12:07:00.001 INFO:tasks.workunit.client.0.smithi052.stdout:1/985: write d0/d2/dd/d40/d81/fd6 [494487,37484] 0 2024-04-26T12:07:00.002 INFO:tasks.workunit.client.0.smithi052.stdout:1/986: write d0/d2/dd/d40/d81/d9a/dce/de9/d9b/fa9 [3722657,22387] 0 2024-04-26T12:07:00.003 INFO:tasks.workunit.client.0.smithi052.stdout:1/987: symlink d0/d2/d88/l144 0 2024-04-26T12:07:00.004 INFO:tasks.workunit.client.0.smithi052.stdout:1/988: write d0/d2/dd/d40/d81/d9a/dce/de9/d9b/fa9 [220706,36876] 0 2024-04-26T12:07:00.006 INFO:tasks.workunit.client.0.smithi052.stdout:1/989: write d0/d2/dd/d40/dc1/d1d/d23/fa1 [10836088,121099] 0 2024-04-26T12:07:00.007 INFO:tasks.workunit.client.0.smithi052.stdout:1/990: truncate d0/d2/dd/d40/d81/d52/f72 79418 0 2024-04-26T12:07:00.009 INFO:tasks.workunit.client.0.smithi052.stdout:1/991: link d0/d2/dd/d40/df8/l100 d0/d83/d4b/db2/d105/l145 0 2024-04-26T12:07:00.009 INFO:tasks.workunit.client.0.smithi052.stdout:1/992: dread - d0/d2/dd/d34/d95/d10b/dde/ff4 zero size 2024-04-26T12:07:00.010 INFO:tasks.workunit.client.0.smithi052.stdout:1/993: rename d0/d2/c21 to d0/d2/dd/d40/d81/d9a/dce/de2/d139/c146 0 2024-04-26T12:07:00.010 INFO:tasks.workunit.client.0.smithi052.stdout:1/994: chown d0/d83 19 1 2024-04-26T12:07:00.015 INFO:tasks.workunit.client.0.smithi052.stdout:1/995: dwrite d0/d2/dd/d40/d81/f46 [4194304,4194304] 0 2024-04-26T12:07:00.016 INFO:tasks.workunit.client.0.smithi052.stdout:1/996: creat d0/d2/dd/d40/d81/d9a/dce/de9/f147 x:0 0 0 2024-04-26T12:07:00.033 INFO:tasks.workunit.client.0.smithi052.stdout:1/997: dread d0/d2/dd/d34/f4e [0,4194304] 0 2024-04-26T12:07:00.036 INFO:tasks.workunit.client.0.smithi052.stdout:1/998: dwrite d0/d83/f110 [0,4194304] 0 2024-04-26T12:07:00.037 INFO:tasks.workunit.client.0.smithi052.stdout:1/999: chown d0/d83 1565162 1 2024-04-26T12:07:00.040 INFO:tasks.workunit.client.0.smithi052.stderr:+ rm -rf -- ./tmp.BSZJEe4bnC 2024-04-26T12:07:00.075 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:00.074+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:00.084 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:00.084 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:00.085 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:07:00.085 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:00.095 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:00.176 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:00.175+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:00.236 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:00.236 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:00.236 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:07:00.236 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:07:00.236 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:00.245 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:00.277 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:00.276+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:00.348 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:00.348 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:07:00.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:07:00.348 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:07:00.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.348 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2989 3.d 3:b02ffd62:::200.00000010:head [write 3767903~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:00.348 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:00.349 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.82965654200000005, 2024-04-26T12:07:00.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057069768999999999, 2024-04-26T12:07:00.349 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:00.349 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.349 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:00.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:00.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:00.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:00.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:00.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:00.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:00.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:00.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:00.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516446+0000", 2024-04-26T12:07:00.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6469999999999997e-06 2024-04-26T12:07:00.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:00.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516449+0000", 2024-04-26T12:07:00.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.976e-06 2024-04-26T12:07:00.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516452+0000", 2024-04-26T12:07:00.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.509e-06 2024-04-26T12:07:00.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:00.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.568562+0000", 2024-04-26T12:07:00.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.052110030000000002 2024-04-26T12:07:00.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:00.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.568615+0000", 2024-04-26T12:07:00.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2809999999999998e-05 2024-04-26T12:07:00.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:00.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573425+0000", 2024-04-26T12:07:00.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048105149999999996 2024-04-26T12:07:00.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:00.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573452+0000", 2024-04-26T12:07:00.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6778e-05 2024-04-26T12:07:00.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.353 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:00.353 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573512+0000", 2024-04-26T12:07:00.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9710000000000003e-05 2024-04-26T12:07:00.353 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.353 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:00.353 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.353 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.353 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2990 3.d 3:b02ffd62:::200.00000010:head [write 3769302~4483 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:00.353 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:00.353 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.82964454300000001, 2024-04-26T12:07:00.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057131345, 2024-04-26T12:07:00.353 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:00.354 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.354 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:00.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:00.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:00.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:00.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:00.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:00.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:00.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:00.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:00.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516459+0000", 2024-04-26T12:07:00.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2859999999999999e-06 2024-04-26T12:07:00.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:00.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516462+0000", 2024-04-26T12:07:00.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0790000000000001e-06 2024-04-26T12:07:00.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516465+0000", 2024-04-26T12:07:00.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.464e-06 2024-04-26T12:07:00.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.357 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:00.357 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569035+0000", 2024-04-26T12:07:00.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.052570328999999999 2024-04-26T12:07:00.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.357 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:00.357 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569113+0000", 2024-04-26T12:07:00.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8118e-05 2024-04-26T12:07:00.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.357 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:00.357 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573517+0000", 2024-04-26T12:07:00.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044039200000000004 2024-04-26T12:07:00.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:00.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573541+0000", 2024-04-26T12:07:00.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3805999999999999e-05 2024-04-26T12:07:00.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:00.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573585+0000", 2024-04-26T12:07:00.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4567000000000002e-05 2024-04-26T12:07:00.358 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.358 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:00.358 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.358 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2991 3.d 3:b02ffd62:::200.00000010:head [write 3773785~4213 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:00.359 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:00.359 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.82963185399999995, 2024-04-26T12:07:00.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057230554000000003, 2024-04-26T12:07:00.359 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:00.359 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.359 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:00.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:00.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:00.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:00.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:00.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:00.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516466+0000", 2024-04-26T12:07:00.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:00.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:00.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516470+0000", 2024-04-26T12:07:00.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7960000000000002e-06 2024-04-26T12:07:00.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:00.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516478+0000", 2024-04-26T12:07:00.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:07:00.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516484+0000", 2024-04-26T12:07:00.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5300000000000002e-06 2024-04-26T12:07:00.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:00.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569662+0000", 2024-04-26T12:07:00.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053177896000000002 2024-04-26T12:07:00.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.362 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:00.362 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569749+0000", 2024-04-26T12:07:00.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7229000000000001e-05 2024-04-26T12:07:00.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.362 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:00.362 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573593+0000", 2024-04-26T12:07:00.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038433109999999999 2024-04-26T12:07:00.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.362 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:00.362 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573631+0000", 2024-04-26T12:07:00.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8615000000000002e-05 2024-04-26T12:07:00.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:00.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573697+0000", 2024-04-26T12:07:00.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5971999999999998e-05 2024-04-26T12:07:00.363 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.363 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:00.363 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.363 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2999 3.d 3:b02ffd62:::200.00000010:head [write 3797283~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:00.363 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:00.363 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.82511746600000002, 2024-04-26T12:07:00.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057330949999999999, 2024-04-26T12:07:00.364 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:00.364 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.364 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:00.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:00.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:00.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:00.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:00.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:00.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520980+0000", 2024-04-26T12:07:00.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:00.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:00.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520991+0000", 2024-04-26T12:07:00.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1154e-05 2024-04-26T12:07:00.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:00.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521014+0000", 2024-04-26T12:07:00.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2288000000000001e-05 2024-04-26T12:07:00.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521019+0000", 2024-04-26T12:07:00.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0889999999999999e-06 2024-04-26T12:07:00.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:00.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.575399+0000", 2024-04-26T12:07:00.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054380392999999999 2024-04-26T12:07:00.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:00.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.575440+0000", 2024-04-26T12:07:00.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1146000000000002e-05 2024-04-26T12:07:00.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:00.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578237+0000", 2024-04-26T12:07:00.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002796761 2024-04-26T12:07:00.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:00.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578260+0000", 2024-04-26T12:07:00.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3538999999999999e-05 2024-04-26T12:07:00.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:00.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578312+0000", 2024-04-26T12:07:00.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1508999999999998e-05 2024-04-26T12:07:00.368 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.368 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:00.368 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.368 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3000 3.d 3:b02ffd62:::200.00000010:head [write 3801160~9028 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:00.368 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:00.368 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.82449150000000004, 2024-04-26T12:07:00.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.059231688999999997, 2024-04-26T12:07:00.368 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:00.368 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.368 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:00.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:00.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:00.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:00.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:00.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:00.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521606+0000", 2024-04-26T12:07:00.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:00.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:00.370 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521627+0000", 2024-04-26T12:07:00.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1129e-05 2024-04-26T12:07:00.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:00.370 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521637+0000", 2024-04-26T12:07:00.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8789999999999998e-06 2024-04-26T12:07:00.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.370 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521644+0000", 2024-04-26T12:07:00.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:07:00.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:00.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576381+0000", 2024-04-26T12:07:00.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.05473629 2024-04-26T12:07:00.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:00.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576451+0000", 2024-04-26T12:07:00.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0525000000000007e-05 2024-04-26T12:07:00.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:00.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580734+0000", 2024-04-26T12:07:00.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042826699999999997 2024-04-26T12:07:00.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:00.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580780+0000", 2024-04-26T12:07:00.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6006e-05 2024-04-26T12:07:00.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:00.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580839+0000", 2024-04-26T12:07:00.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8783000000000003e-05 2024-04-26T12:07:00.372 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.372 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:00.372 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.373 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3001 3.d 3:b02ffd62:::200.00000010:head [write 3810188~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:00.373 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:00.373 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.823939168, 2024-04-26T12:07:00.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.060161213999999998, 2024-04-26T12:07:00.373 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:00.373 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.373 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:00.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.373 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522158+0000", 2024-04-26T12:07:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522165+0000", 2024-04-26T12:07:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.28e-06 2024-04-26T12:07:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522178+0000", 2024-04-26T12:07:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3738e-05 2024-04-26T12:07:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522186+0000", 2024-04-26T12:07:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.267e-06 2024-04-26T12:07:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576889+0000", 2024-04-26T12:07:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054703442999999997 2024-04-26T12:07:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576953+0000", 2024-04-26T12:07:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4213000000000003e-05 2024-04-26T12:07:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582185+0000", 2024-04-26T12:07:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052319209999999996 2024-04-26T12:07:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582243+0000", 2024-04-26T12:07:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7321999999999998e-05 2024-04-26T12:07:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582321+0000", 2024-04-26T12:07:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7911000000000007e-05 2024-04-26T12:07:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3002 3.d 3:b02ffd62:::200.00000010:head [write 3812103~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.82347040500000002, 2024-04-26T12:07:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.059796961000000003, 2024-04-26T12:07:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522627+0000", 2024-04-26T12:07:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522633+0000", 2024-04-26T12:07:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6699999999999999e-06 2024-04-26T12:07:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522643+0000", 2024-04-26T12:07:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6649999999999998e-06 2024-04-26T12:07:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522649+0000", 2024-04-26T12:07:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4200000000000004e-06 2024-04-26T12:07:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577413+0000", 2024-04-26T12:07:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054763714999999998 2024-04-26T12:07:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577460+0000", 2024-04-26T12:07:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7095000000000002e-05 2024-04-26T12:07:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582331+0000", 2024-04-26T12:07:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048716419999999998 2024-04-26T12:07:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582375+0000", 2024-04-26T12:07:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3053999999999998e-05 2024-04-26T12:07:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582425+0000", 2024-04-26T12:07:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0525000000000002e-05 2024-04-26T12:07:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3003 3.d 3:b02ffd62:::200.00000010:head [write 3814061~4170 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.82241534299999997, 2024-04-26T12:07:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058803394000000002, 2024-04-26T12:07:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523682+0000", 2024-04-26T12:07:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523690+0000", 2024-04-26T12:07:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0290000000000005e-06 2024-04-26T12:07:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523699+0000", 2024-04-26T12:07:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4589999999999998e-06 2024-04-26T12:07:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523703+0000", 2024-04-26T12:07:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6249999999999998e-06 2024-04-26T12:07:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577832+0000", 2024-04-26T12:07:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054128883000000003 2024-04-26T12:07:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577878+0000", 2024-04-26T12:07:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5841999999999999e-05 2024-04-26T12:07:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582430+0000", 2024-04-26T12:07:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045517270000000002 2024-04-26T12:07:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582453+0000", 2024-04-26T12:07:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3609999999999999e-05 2024-04-26T12:07:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582487+0000", 2024-04-26T12:07:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3080000000000002e-05 2024-04-26T12:07:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3004 3.d 3:b02ffd62:::200.00000010:head [write 3818231~3890 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.82156642000000002, 2024-04-26T12:07:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058024342999999999, 2024-04-26T12:07:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524531+0000", 2024-04-26T12:07:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524539+0000", 2024-04-26T12:07:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9249999999999995e-06 2024-04-26T12:07:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524547+0000", 2024-04-26T12:07:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5220000000000007e-06 2024-04-26T12:07:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524553+0000", 2024-04-26T12:07:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6659999999999996e-06 2024-04-26T12:07:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578335+0000", 2024-04-26T12:07:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.05378235 2024-04-26T12:07:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578378+0000", 2024-04-26T12:07:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2429999999999999e-05 2024-04-26T12:07:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582494+0000", 2024-04-26T12:07:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004116059 2024-04-26T12:07:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582519+0000", 2024-04-26T12:07:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4961999999999999e-05 2024-04-26T12:07:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582556+0000", 2024-04-26T12:07:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7728999999999997e-05 2024-04-26T12:07:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3005 3.d 3:b02ffd62:::200.00000010:head [write 3822121~5207 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.82114716399999998, 2024-04-26T12:07:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057662270000000002, 2024-04-26T12:07:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.393 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:00.393 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:00.393 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.393 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.393 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.393 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:00.393 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:00.393 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:00.393 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.393 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.393 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:00.393 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524961+0000", 2024-04-26T12:07:00.393 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0124e-05 2024-04-26T12:07:00.393 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.393 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.393 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524971+0000", 2024-04-26T12:07:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0200999999999999e-05 2024-04-26T12:07:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524979+0000", 2024-04-26T12:07:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5809999999999999e-06 2024-04-26T12:07:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578753+0000", 2024-04-26T12:07:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053774444999999997 2024-04-26T12:07:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578821+0000", 2024-04-26T12:07:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7640999999999998e-05 2024-04-26T12:07:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582561+0000", 2024-04-26T12:07:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037399870000000002 2024-04-26T12:07:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582582+0000", 2024-04-26T12:07:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0934999999999999e-05 2024-04-26T12:07:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582614+0000", 2024-04-26T12:07:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1948e-05 2024-04-26T12:07:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3006 3.d 3:b02ffd62:::200.00000010:head [write 3827328~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.82051382500000003, 2024-04-26T12:07:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057085404999999999, 2024-04-26T12:07:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525583+0000", 2024-04-26T12:07:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525594+0000", 2024-04-26T12:07:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0497e-05 2024-04-26T12:07:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525610+0000", 2024-04-26T12:07:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6392000000000002e-05 2024-04-26T12:07:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525621+0000", 2024-04-26T12:07:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0679999999999999e-05 2024-04-26T12:07:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.579270+0000", 2024-04-26T12:07:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053648802000000002 2024-04-26T12:07:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.579312+0000", 2024-04-26T12:07:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2268000000000003e-05 2024-04-26T12:07:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582618+0000", 2024-04-26T12:07:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033057049999999999 2024-04-26T12:07:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582637+0000", 2024-04-26T12:07:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9417000000000001e-05 2024-04-26T12:07:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582670+0000", 2024-04-26T12:07:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2969999999999998e-05 2024-04-26T12:07:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3015 3.d 3:b02ffd62:::200.00000010:head [write 3855113~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.81005806800000002, 2024-04-26T12:07:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057652729999999999, 2024-04-26T12:07:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536042+0000", 2024-04-26T12:07:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0849999999999999e-06 2024-04-26T12:07:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536046+0000", 2024-04-26T12:07:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:07:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536048+0000", 2024-04-26T12:07:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6019999999999998e-06 2024-04-26T12:07:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585409+0000", 2024-04-26T12:07:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.049360938 2024-04-26T12:07:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585506+0000", 2024-04-26T12:07:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6966999999999995e-05 2024-04-26T12:07:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593630+0000", 2024-04-26T12:07:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0081238160000000007 2024-04-26T12:07:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593656+0000", 2024-04-26T12:07:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6154000000000001e-05 2024-04-26T12:07:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593693+0000", 2024-04-26T12:07:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7185999999999999e-05 2024-04-26T12:07:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3016 3.d 3:b02ffd62:::200.00000010:head [write 3857020~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.81004812100000001, 2024-04-26T12:07:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058678157000000002, 2024-04-26T12:07:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536055+0000", 2024-04-26T12:07:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3669999999999999e-06 2024-04-26T12:07:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536058+0000", 2024-04-26T12:07:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3220000000000001e-06 2024-04-26T12:07:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536062+0000", 2024-04-26T12:07:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1520000000000002e-06 2024-04-26T12:07:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585965+0000", 2024-04-26T12:07:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.049902769999999999 2024-04-26T12:07:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586046+0000", 2024-04-26T12:07:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1032999999999995e-05 2024-04-26T12:07:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594667+0000", 2024-04-26T12:07:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0086214599999999992 2024-04-26T12:07:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594692+0000", 2024-04-26T12:07:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5191999999999999e-05 2024-04-26T12:07:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594729+0000", 2024-04-26T12:07:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6069000000000003e-05 2024-04-26T12:07:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3017 3.d 3:b02ffd62:::200.00000010:head [write 3859438~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.81003403699999998, 2024-04-26T12:07:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058723814999999999, 2024-04-26T12:07:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536066+0000", 2024-04-26T12:07:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8840000000000001e-06 2024-04-26T12:07:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536069+0000", 2024-04-26T12:07:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:07:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536072+0000", 2024-04-26T12:07:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4449999999999999e-06 2024-04-26T12:07:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586703+0000", 2024-04-26T12:07:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050631618000000003 2024-04-26T12:07:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586748+0000", 2024-04-26T12:07:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4682999999999999e-05 2024-04-26T12:07:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594734+0000", 2024-04-26T12:07:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079860369999999996 2024-04-26T12:07:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594756+0000", 2024-04-26T12:07:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1738000000000001e-05 2024-04-26T12:07:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594788+0000", 2024-04-26T12:07:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2604999999999997e-05 2024-04-26T12:07:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3018 3.d 3:b02ffd62:::200.00000010:head [write 3861345~3221 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.80920135000000004, 2024-04-26T12:07:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057946174000000003, 2024-04-26T12:07:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536896+0000", 2024-04-26T12:07:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536905+0000", 2024-04-26T12:07:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7839999999999998e-06 2024-04-26T12:07:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:00.417 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536929+0000", 2024-04-26T12:07:00.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3561999999999999e-05 2024-04-26T12:07:00.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.417 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536940+0000", 2024-04-26T12:07:00.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0742e-05 2024-04-26T12:07:00.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:00.417 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.587238+0000", 2024-04-26T12:07:00.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050297962000000002 2024-04-26T12:07:00.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:00.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.587315+0000", 2024-04-26T12:07:00.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7848000000000004e-05 2024-04-26T12:07:00.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:00.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594792+0000", 2024-04-26T12:07:00.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074766240000000003 2024-04-26T12:07:00.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:00.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594813+0000", 2024-04-26T12:07:00.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0876000000000001e-05 2024-04-26T12:07:00.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:00.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594843+0000", 2024-04-26T12:07:00.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0434999999999999e-05 2024-04-26T12:07:00.419 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.419 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:00.419 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.419 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3019 3.d 3:b02ffd62:::200.00000010:head [write 3864566~3989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:00.419 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:00.419 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.80745898999999999, 2024-04-26T12:07:00.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.061000094999999997, 2024-04-26T12:07:00.420 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:00.420 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.420 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:00.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:00.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:00.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:00.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:00.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:00.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538638+0000", 2024-04-26T12:07:00.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999981 2024-04-26T12:07:00.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:00.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538669+0000", 2024-04-26T12:07:00.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1689000000000001e-05 2024-04-26T12:07:00.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:00.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538703+0000", 2024-04-26T12:07:00.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3309000000000002e-05 2024-04-26T12:07:00.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538746+0000", 2024-04-26T12:07:00.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2803999999999999e-05 2024-04-26T12:07:00.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:00.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.589467+0000", 2024-04-26T12:07:00.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050721912000000001 2024-04-26T12:07:00.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:00.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.589517+0000", 2024-04-26T12:07:00.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9549999999999998e-05 2024-04-26T12:07:00.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.423 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:00.423 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599577+0000", 2024-04-26T12:07:00.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010059593 2024-04-26T12:07:00.423 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.423 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:00.423 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599603+0000", 2024-04-26T12:07:00.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6821e-05 2024-04-26T12:07:00.423 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.423 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:00.423 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599640+0000", 2024-04-26T12:07:00.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6177999999999998e-05 2024-04-26T12:07:00.423 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.423 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:00.424 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.424 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3020 3.d 3:b02ffd62:::200.00000010:head [write 3868555~7563 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:00.424 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:00.424 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.80484615500000001, 2024-04-26T12:07:00.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058446867, 2024-04-26T12:07:00.424 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:00.424 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.424 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:00.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:00.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:00.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:00.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:00.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:00.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541251+0000", 2024-04-26T12:07:00.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:00.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:00.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541286+0000", 2024-04-26T12:07:00.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4845999999999998e-05 2024-04-26T12:07:00.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.426 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:00.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541300+0000", 2024-04-26T12:07:00.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4251e-05 2024-04-26T12:07:00.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.426 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541307+0000", 2024-04-26T12:07:00.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3819999999999998e-06 2024-04-26T12:07:00.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.426 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:00.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.592596+0000", 2024-04-26T12:07:00.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051288215999999998 2024-04-26T12:07:00.427 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.427 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.427 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:00.427 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.592675+0000", 2024-04-26T12:07:00.427 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9197999999999996e-05 2024-04-26T12:07:00.427 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.427 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.427 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:00.427 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599645+0000", 2024-04-26T12:07:00.427 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069701759999999998 2024-04-26T12:07:00.427 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.427 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.427 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:00.427 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599667+0000", 2024-04-26T12:07:00.427 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2118999999999999e-05 2024-04-26T12:07:00.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:00.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599699+0000", 2024-04-26T12:07:00.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2048999999999998e-05 2024-04-26T12:07:00.428 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.428 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:00.428 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.428 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3021 3.d 3:b02ffd62:::200.00000010:head [write 3876118~3791 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:00.428 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:00.428 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.804784418, 2024-04-26T12:07:00.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058441157000000001, 2024-04-26T12:07:00.428 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:00.429 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.429 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:00.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:00.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:00.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:00.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:00.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:00.430 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:00.430 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:00.430 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.430 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.430 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:00.430 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541323+0000", 2024-04-26T12:07:00.430 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5510000000000005e-06 2024-04-26T12:07:00.430 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.430 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.430 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:00.430 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541327+0000", 2024-04-26T12:07:00.430 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2520000000000001e-06 2024-04-26T12:07:00.430 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.430 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.430 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.431 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541330+0000", 2024-04-26T12:07:00.431 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:07:00.431 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.431 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.431 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:00.431 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593229+0000", 2024-04-26T12:07:00.431 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051898044999999997 2024-04-26T12:07:00.431 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.431 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.431 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:00.431 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593278+0000", 2024-04-26T12:07:00.431 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9506999999999999e-05 2024-04-26T12:07:00.431 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.431 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.432 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:00.432 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599704+0000", 2024-04-26T12:07:00.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064259570000000004 2024-04-26T12:07:00.432 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.432 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.432 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:00.432 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599725+0000", 2024-04-26T12:07:00.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0562999999999999e-05 2024-04-26T12:07:00.432 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.432 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.432 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:00.432 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599755+0000", 2024-04-26T12:07:00.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0710000000000002e-05 2024-04-26T12:07:00.432 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.432 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:00.433 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.433 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.433 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.433 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3022 3.d 3:b02ffd62:::200.00000010:head [write 3879909~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:00.433 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:00.433 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.80353534900000001, 2024-04-26T12:07:00.433 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057246689000000003, 2024-04-26T12:07:00.433 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:00.433 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.433 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:00.433 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.433 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:00.433 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:00.433 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.434 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.434 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.434 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:00.434 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:00.434 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.434 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.434 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.434 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:00.434 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542561+0000", 2024-04-26T12:07:00.434 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999981 2024-04-26T12:07:00.434 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.434 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.434 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:00.434 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542570+0000", 2024-04-26T12:07:00.434 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9199999999999993e-06 2024-04-26T12:07:00.435 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.435 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.435 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:00.435 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542583+0000", 2024-04-26T12:07:00.435 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2227e-05 2024-04-26T12:07:00.435 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.435 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.435 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.435 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542598+0000", 2024-04-26T12:07:00.435 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5199e-05 2024-04-26T12:07:00.435 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.435 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.435 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:00.435 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593728+0000", 2024-04-26T12:07:00.435 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051129846 2024-04-26T12:07:00.436 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.436 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.436 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:00.436 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593806+0000", 2024-04-26T12:07:00.436 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8425999999999998e-05 2024-04-26T12:07:00.436 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.436 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.436 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:00.436 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599760+0000", 2024-04-26T12:07:00.436 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0059537399999999999 2024-04-26T12:07:00.436 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.436 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.436 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:00.436 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599779+0000", 2024-04-26T12:07:00.437 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9619e-05 2024-04-26T12:07:00.437 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.437 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.437 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:00.437 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599810+0000", 2024-04-26T12:07:00.437 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0508999999999999e-05 2024-04-26T12:07:00.437 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.437 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:00.437 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.437 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.437 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.437 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3023 3.d 3:b02ffd62:::200.00000010:head [write 3881868~5748 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:00.437 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:00.437 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.80306350100000001, 2024-04-26T12:07:00.437 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.056829994000000002, 2024-04-26T12:07:00.438 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:00.438 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.438 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:00.438 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.438 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:00.438 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:00.438 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.438 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.438 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.438 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:00.438 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:00.438 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:00.438 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.438 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.438 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:00.439 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543034+0000", 2024-04-26T12:07:00.439 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:00.439 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.439 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.439 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:00.439 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543044+0000", 2024-04-26T12:07:00.439 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0444e-05 2024-04-26T12:07:00.439 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.439 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.439 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:00.439 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543055+0000", 2024-04-26T12:07:00.439 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.096e-05 2024-04-26T12:07:00.439 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.439 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.440 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.440 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543063+0000", 2024-04-26T12:07:00.440 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2689999999999999e-06 2024-04-26T12:07:00.440 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.440 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.440 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:00.440 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594265+0000", 2024-04-26T12:07:00.440 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051201325999999998 2024-04-26T12:07:00.440 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.440 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.440 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:00.440 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594311+0000", 2024-04-26T12:07:00.440 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5918000000000003e-05 2024-04-26T12:07:00.440 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.440 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.441 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:00.441 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599815+0000", 2024-04-26T12:07:00.441 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055038370000000001 2024-04-26T12:07:00.441 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.441 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.441 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:00.441 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599834+0000", 2024-04-26T12:07:00.441 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9942e-05 2024-04-26T12:07:00.441 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:00.441 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:00.441 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:00.441 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599865+0000", 2024-04-26T12:07:00.441 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0549000000000002e-05 2024-04-26T12:07:00.441 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.441 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:00.442 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.442 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:00.442 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:00.442 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:00.443 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:00.442+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:00.443 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:07:00.544 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:00.543+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:00.556 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:00.556 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:07:00.556 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:07:00.556 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:00.566 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:07:00.645 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:00.644+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:00.712 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:00.712 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:07:00.712 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:07:00.712 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:07:00.712 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:00.722 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:07:00.747 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:00.746+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:00.831 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:00.831 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:07:00.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:07:00.831 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:07:00.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.831 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:536 3.2 3:4272d415:::200.0000000b:head [write 405817~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:00.831 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 6.3050084100000001, 2024-04-26T12:07:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053030282999999998, 2024-04-26T12:07:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524136+0000", 2024-04-26T12:07:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524139+0000", 2024-04-26T12:07:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2919999999999998e-06 2024-04-26T12:07:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524144+0000", 2024-04-26T12:07:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.502e-06 2024-04-26T12:07:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524149+0000", 2024-04-26T12:07:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7310000000000001e-06 2024-04-26T12:07:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570935+0000", 2024-04-26T12:07:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.046785603000000002 2024-04-26T12:07:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570981+0000", 2024-04-26T12:07:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6085999999999999e-05 2024-04-26T12:07:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577039+0000", 2024-04-26T12:07:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060582099999999996 2024-04-26T12:07:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577081+0000", 2024-04-26T12:07:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1927e-05 2024-04-26T12:07:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577167+0000", 2024-04-26T12:07:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6311999999999996e-05 2024-04-26T12:07:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:537 3.2 3:4272d415:::200.0000000b:head [write 407216~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 6.3049924720000003, 2024-04-26T12:07:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053131411000000003, 2024-04-26T12:07:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524152+0000", 2024-04-26T12:07:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524157+0000", 2024-04-26T12:07:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3529999999999997e-06 2024-04-26T12:07:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524162+0000", 2024-04-26T12:07:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5910000000000003e-06 2024-04-26T12:07:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524170+0000", 2024-04-26T12:07:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:07:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571323+0000", 2024-04-26T12:07:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047153289000000001 2024-04-26T12:07:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571367+0000", 2024-04-26T12:07:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4205000000000001e-05 2024-04-26T12:07:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577174+0000", 2024-04-26T12:07:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058072250000000001 2024-04-26T12:07:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577218+0000", 2024-04-26T12:07:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3294999999999998e-05 2024-04-26T12:07:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577284+0000", 2024-04-26T12:07:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6483999999999996e-05 2024-04-26T12:07:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.841 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:538 3.2 3:4272d415:::200.0000000b:head [write 408629~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:00.841 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:00.841 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 6.304971772, 2024-04-26T12:07:00.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053241841999999998, 2024-04-26T12:07:00.841 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:00.841 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.841 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:00.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:00.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:00.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524178+0000", 2024-04-26T12:07:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1420000000000001e-06 2024-04-26T12:07:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524184+0000", 2024-04-26T12:07:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4240000000000001e-06 2024-04-26T12:07:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524188+0000", 2024-04-26T12:07:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2710000000000003e-06 2024-04-26T12:07:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571623+0000", 2024-04-26T12:07:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047435119999999997 2024-04-26T12:07:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571668+0000", 2024-04-26T12:07:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5377000000000003e-05 2024-04-26T12:07:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577292+0000", 2024-04-26T12:07:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0056232030000000002 2024-04-26T12:07:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577330+0000", 2024-04-26T12:07:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8748999999999998e-05 2024-04-26T12:07:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577415+0000", 2024-04-26T12:07:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4913000000000005e-05 2024-04-26T12:07:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:539 3.2 3:4272d415:::200.0000000b:head [write 410547~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 6.3049536399999999, 2024-04-26T12:07:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053372670999999997, 2024-04-26T12:07:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524191+0000", 2024-04-26T12:07:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524199+0000", 2024-04-26T12:07:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6520000000000006e-06 2024-04-26T12:07:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:00.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524205+0000", 2024-04-26T12:07:00.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:07:00.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524209+0000", 2024-04-26T12:07:00.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.335e-06 2024-04-26T12:07:00.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.850 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:00.850 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572320+0000", 2024-04-26T12:07:00.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048110992999999998 2024-04-26T12:07:00.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572364+0000", 2024-04-26T12:07:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4577999999999999e-05 2024-04-26T12:07:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577426+0000", 2024-04-26T12:07:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050615139999999996 2024-04-26T12:07:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577480+0000", 2024-04-26T12:07:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3599e-05 2024-04-26T12:07:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577564+0000", 2024-04-26T12:07:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4699999999999999e-05 2024-04-26T12:07:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:540 3.2 3:4272d415:::200.0000000b:head [write 411948~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 6.3049326219999999, 2024-04-26T12:07:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053497045999999999, 2024-04-26T12:07:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524212+0000", 2024-04-26T12:07:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524215+0000", 2024-04-26T12:07:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.559e-06 2024-04-26T12:07:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524220+0000", 2024-04-26T12:07:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2920000000000003e-06 2024-04-26T12:07:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524224+0000", 2024-04-26T12:07:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3680000000000004e-06 2024-04-26T12:07:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572619+0000", 2024-04-26T12:07:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048394549000000002 2024-04-26T12:07:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572669+0000", 2024-04-26T12:07:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0249e-05 2024-04-26T12:07:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577575+0000", 2024-04-26T12:07:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049053329999999996 2024-04-26T12:07:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577625+0000", 2024-04-26T12:07:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0274e-05 2024-04-26T12:07:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577710+0000", 2024-04-26T12:07:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4741999999999996e-05 2024-04-26T12:07:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:543 3.2 3:4272d415:::200.0000000b:head [write 413907~2485 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 6.3048629280000004, 2024-04-26T12:07:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053578708000000003, 2024-04-26T12:07:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524287+0000", 2024-04-26T12:07:00.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2190000000000003e-06 2024-04-26T12:07:00.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:00.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524294+0000", 2024-04-26T12:07:00.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5660000000000003e-06 2024-04-26T12:07:00.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524298+0000", 2024-04-26T12:07:00.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3900000000000003e-06 2024-04-26T12:07:00.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:00.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572992+0000", 2024-04-26T12:07:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048693835999999997 2024-04-26T12:07:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573045+0000", 2024-04-26T12:07:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2793000000000001e-05 2024-04-26T12:07:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577721+0000", 2024-04-26T12:07:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046760550000000001 2024-04-26T12:07:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577777+0000", 2024-04-26T12:07:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5908000000000001e-05 2024-04-26T12:07:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577861+0000", 2024-04-26T12:07:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4337000000000002e-05 2024-04-26T12:07:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:544 3.2 3:4272d415:::200.0000000b:head [write 416392~3872 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 6.3048432060000001, 2024-04-26T12:07:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054810527999999997, 2024-04-26T12:07:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524307+0000", 2024-04-26T12:07:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1580000000000004e-06 2024-04-26T12:07:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524312+0000", 2024-04-26T12:07:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6380000000000001e-06 2024-04-26T12:07:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524317+0000", 2024-04-26T12:07:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4000000000000002e-06 2024-04-26T12:07:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573348+0000", 2024-04-26T12:07:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049031433999999999 2024-04-26T12:07:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573393+0000", 2024-04-26T12:07:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4536999999999997e-05 2024-04-26T12:07:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578978+0000", 2024-04-26T12:07:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055848299999999998 2024-04-26T12:07:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579031+0000", 2024-04-26T12:07:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3708000000000001e-05 2024-04-26T12:07:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579113+0000", 2024-04-26T12:07:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1258e-05 2024-04-26T12:07:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:545 3.2 3:4272d415:::200.0000000b:head [write 420264~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 6.30482458, 2024-04-26T12:07:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054927386000000002, 2024-04-26T12:07:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524320+0000", 2024-04-26T12:07:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524325+0000", 2024-04-26T12:07:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5249999999999999e-06 2024-04-26T12:07:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524330+0000", 2024-04-26T12:07:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5629999999999999e-06 2024-04-26T12:07:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524335+0000", 2024-04-26T12:07:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.685e-06 2024-04-26T12:07:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573727+0000", 2024-04-26T12:07:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049392034000000001 2024-04-26T12:07:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573775+0000", 2024-04-26T12:07:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7435999999999998e-05 2024-04-26T12:07:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579120+0000", 2024-04-26T12:07:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0053452949999999999 2024-04-26T12:07:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579167+0000", 2024-04-26T12:07:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7240000000000002e-05 2024-04-26T12:07:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579248+0000", 2024-04-26T12:07:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0947999999999998e-05 2024-04-26T12:07:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 422222~8537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 6.3048062629999997, 2024-04-26T12:07:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055065936000000003, 2024-04-26T12:07:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524347+0000", 2024-04-26T12:07:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7129999999999994e-06 2024-04-26T12:07:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524357+0000", 2024-04-26T12:07:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0232e-05 2024-04-26T12:07:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524362+0000", 2024-04-26T12:07:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:07:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574119+0000", 2024-04-26T12:07:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049756727000000001 2024-04-26T12:07:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574166+0000", 2024-04-26T12:07:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7086000000000003e-05 2024-04-26T12:07:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579261+0000", 2024-04-26T12:07:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050948310000000002 2024-04-26T12:07:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579316+0000", 2024-04-26T12:07:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5068000000000002e-05 2024-04-26T12:07:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579405+0000", 2024-04-26T12:07:00.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9251000000000003e-05 2024-04-26T12:07:00.875 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.875 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:00.875 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.875 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 430759~2035 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:00.875 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:00.875 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 6.3047792730000003, 2024-04-26T12:07:00.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055164950999999997, 2024-04-26T12:07:00.875 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:00.875 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.875 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:00.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:00.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:00.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:00.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:00.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:00.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:00.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:00.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:00.877 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524368+0000", 2024-04-26T12:07:00.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.57e-06 2024-04-26T12:07:00.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:00.877 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524375+0000", 2024-04-26T12:07:00.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6170000000000003e-06 2024-04-26T12:07:00.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.878 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524380+0000", 2024-04-26T12:07:00.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2700000000000004e-06 2024-04-26T12:07:00.878 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.878 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:00.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574639+0000", 2024-04-26T12:07:00.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050259459999999999 2024-04-26T12:07:00.878 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.878 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:00.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574687+0000", 2024-04-26T12:07:00.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7608999999999998e-05 2024-04-26T12:07:00.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:00.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579414+0000", 2024-04-26T12:07:00.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047268750000000002 2024-04-26T12:07:00.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:00.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579456+0000", 2024-04-26T12:07:00.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1885000000000003e-05 2024-04-26T12:07:00.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:00.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579531+0000", 2024-04-26T12:07:00.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5053000000000001e-05 2024-04-26T12:07:00.880 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.880 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:00.880 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.880 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 432794~10523 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:00.880 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:00.880 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 6.3037885490000001, 2024-04-26T12:07:00.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054314727, 2024-04-26T12:07:00.880 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:00.880 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.880 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:00.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:00.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:00.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:00.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:00.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:00.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525356+0000", 2024-04-26T12:07:00.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:00.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.882 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:00.882 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525414+0000", 2024-04-26T12:07:00.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8148e-05 2024-04-26T12:07:00.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.882 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:00.882 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525423+0000", 2024-04-26T12:07:00.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9749999999999996e-06 2024-04-26T12:07:00.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.883 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525428+0000", 2024-04-26T12:07:00.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0270000000000003e-06 2024-04-26T12:07:00.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.883 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.883 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:00.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574950+0000", 2024-04-26T12:07:00.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049521840999999997 2024-04-26T12:07:00.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.883 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.883 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:00.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575002+0000", 2024-04-26T12:07:00.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1586999999999999e-05 2024-04-26T12:07:00.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:00.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579543+0000", 2024-04-26T12:07:00.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045416340000000001 2024-04-26T12:07:00.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:00.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579587+0000", 2024-04-26T12:07:00.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3875999999999998e-05 2024-04-26T12:07:00.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:00.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579671+0000", 2024-04-26T12:07:00.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4351999999999995e-05 2024-04-26T12:07:00.885 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.885 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:00.885 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.885 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 443317~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:00.885 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:00.885 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 6.3037125740000004, 2024-04-26T12:07:00.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054381889000000003, 2024-04-26T12:07:00.885 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:00.885 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.885 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:00.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:00.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:00.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:00.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:00.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:00.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525432+0000", 2024-04-26T12:07:00.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:00.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:00.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525435+0000", 2024-04-26T12:07:00.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3070000000000001e-06 2024-04-26T12:07:00.887 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:00.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525439+0000", 2024-04-26T12:07:00.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.104e-06 2024-04-26T12:07:00.887 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525442+0000", 2024-04-26T12:07:00.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0460000000000001e-06 2024-04-26T12:07:00.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:00.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575405+0000", 2024-04-26T12:07:00.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049963059999999997 2024-04-26T12:07:00.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:00.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575450+0000", 2024-04-26T12:07:00.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5034000000000003e-05 2024-04-26T12:07:00.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:00.889 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579680+0000", 2024-04-26T12:07:00.889 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042302260000000001 2024-04-26T12:07:00.889 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.889 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.889 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:00.889 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579737+0000", 2024-04-26T12:07:00.889 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7241000000000003e-05 2024-04-26T12:07:00.889 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.889 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.889 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:00.889 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579815+0000", 2024-04-26T12:07:00.889 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7278000000000001e-05 2024-04-26T12:07:00.889 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.889 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:00.890 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.890 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 445275~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:00.890 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:00.890 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 6.3032853979999999, 2024-04-26T12:07:00.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054094668999999998, 2024-04-26T12:07:00.890 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:00.890 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.890 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:00.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:00.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:00.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:00.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:00.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:00.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525859+0000", 2024-04-26T12:07:00.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:00.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:00.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525864+0000", 2024-04-26T12:07:00.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:07:00.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:00.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525872+0000", 2024-04-26T12:07:00.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6790000000000005e-06 2024-04-26T12:07:00.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525877+0000", 2024-04-26T12:07:00.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0529999999999997e-06 2024-04-26T12:07:00.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:00.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575723+0000", 2024-04-26T12:07:00.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049846469999999997 2024-04-26T12:07:00.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:00.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575770+0000", 2024-04-26T12:07:00.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6387999999999997e-05 2024-04-26T12:07:00.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:00.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579823+0000", 2024-04-26T12:07:00.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0040534189999999999 2024-04-26T12:07:00.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:00.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579869+0000", 2024-04-26T12:07:00.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6218999999999999e-05 2024-04-26T12:07:00.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.894 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:00.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579954+0000", 2024-04-26T12:07:00.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5315999999999994e-05 2024-04-26T12:07:00.894 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.894 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:00.894 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.894 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:551 3.2 3:4272d415:::200.0000000b:head [write 448232~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:00.894 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:00.895 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 6.3028379640000001, 2024-04-26T12:07:00.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053798273000000001, 2024-04-26T12:07:00.895 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:00.895 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.895 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:00.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.895 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:00.895 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:00.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.895 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.895 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:00.895 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:00.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:00.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:00.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:00.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:00.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526310+0000", 2024-04-26T12:07:00.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5279999999999999e-06 2024-04-26T12:07:00.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:00.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526317+0000", 2024-04-26T12:07:00.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8430000000000004e-06 2024-04-26T12:07:00.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526322+0000", 2024-04-26T12:07:00.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3340000000000001e-06 2024-04-26T12:07:00.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:00.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576135+0000", 2024-04-26T12:07:00.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049812113999999998 2024-04-26T12:07:00.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:00.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576186+0000", 2024-04-26T12:07:00.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1443999999999997e-05 2024-04-26T12:07:00.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:00.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579962+0000", 2024-04-26T12:07:00.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037763359999999999 2024-04-26T12:07:00.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:00.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580016+0000", 2024-04-26T12:07:00.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3421000000000002e-05 2024-04-26T12:07:00.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:00.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580106+0000", 2024-04-26T12:07:00.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9790000000000006e-05 2024-04-26T12:07:00.899 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.899 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:00.899 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.899 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 450189~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:00.899 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:00.899 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 6.3027578349999995, 2024-04-26T12:07:00.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055070796999999998, 2024-04-26T12:07:00.899 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:00.899 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.899 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:00.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:00.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:00.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:00.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:00.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:00.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:00.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:00.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:00.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526390+0000", 2024-04-26T12:07:00.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8559999999999998e-06 2024-04-26T12:07:00.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:00.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526395+0000", 2024-04-26T12:07:00.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3319999999999999e-06 2024-04-26T12:07:00.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526399+0000", 2024-04-26T12:07:00.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.619e-06 2024-04-26T12:07:00.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:00.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576476+0000", 2024-04-26T12:07:00.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050077643999999998 2024-04-26T12:07:00.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:00.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576524+0000", 2024-04-26T12:07:00.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7184000000000001e-05 2024-04-26T12:07:00.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:00.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581347+0000", 2024-04-26T12:07:00.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0048231919999999996 2024-04-26T12:07:00.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:00.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581398+0000", 2024-04-26T12:07:00.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1345999999999999e-05 2024-04-26T12:07:00.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:00.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581458+0000", 2024-04-26T12:07:00.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0081000000000003e-05 2024-04-26T12:07:00.903 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.903 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:00.903 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.904 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 452113~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:00.904 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:00.904 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 6.3026466189999999, 2024-04-26T12:07:00.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055041448, 2024-04-26T12:07:00.904 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:00.904 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.904 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:00.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:00.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:00.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:00.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:00.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:00.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526498+0000", 2024-04-26T12:07:00.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:00.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:00.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526540+0000", 2024-04-26T12:07:00.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2267e-05 2024-04-26T12:07:00.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:00.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526547+0000", 2024-04-26T12:07:00.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7000000000000002e-06 2024-04-26T12:07:00.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526550+0000", 2024-04-26T12:07:00.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0299999999999998e-06 2024-04-26T12:07:00.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:00.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577902+0000", 2024-04-26T12:07:00.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051351648999999999 2024-04-26T12:07:00.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:00.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577953+0000", 2024-04-26T12:07:00.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1289000000000003e-05 2024-04-26T12:07:00.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:00.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581464+0000", 2024-04-26T12:07:00.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035111259999999998 2024-04-26T12:07:00.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:00.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581490+0000", 2024-04-26T12:07:00.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5717000000000001e-05 2024-04-26T12:07:00.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:00.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581540+0000", 2024-04-26T12:07:00.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0287999999999997e-05 2024-04-26T12:07:00.908 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.908 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:00.908 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.908 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 454070~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:00.908 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:00.908 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 6.30208967, 2024-04-26T12:07:00.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054564161, 2024-04-26T12:07:00.908 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:00.908 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.909 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:00.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:00.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:00.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:00.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:00.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:00.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527055+0000", 2024-04-26T12:07:00.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:00.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:00.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527058+0000", 2024-04-26T12:07:00.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9890000000000001e-06 2024-04-26T12:07:00.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:00.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527066+0000", 2024-04-26T12:07:00.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4730000000000003e-06 2024-04-26T12:07:00.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527069+0000", 2024-04-26T12:07:00.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5810000000000001e-06 2024-04-26T12:07:00.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:00.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578308+0000", 2024-04-26T12:07:00.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051238911999999998 2024-04-26T12:07:00.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:00.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578391+0000", 2024-04-26T12:07:00.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2713999999999994e-05 2024-04-26T12:07:00.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:00.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581548+0000", 2024-04-26T12:07:00.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031577530000000001 2024-04-26T12:07:00.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:00.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581574+0000", 2024-04-26T12:07:00.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5350999999999998e-05 2024-04-26T12:07:00.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:00.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581620+0000", 2024-04-26T12:07:00.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5868999999999997e-05 2024-04-26T12:07:00.912 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.912 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:00.912 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.913 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 456028~3870 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:00.913 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:00.913 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 6.3003334280000001, 2024-04-26T12:07:00.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055118997000000003, 2024-04-26T12:07:00.913 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:00.913 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.913 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:00.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:00.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:00.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:00.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:00.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:00.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528811+0000", 2024-04-26T12:07:00.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:00.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:00.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528887+0000", 2024-04-26T12:07:00.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5977999999999997e-05 2024-04-26T12:07:00.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:00.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528897+0000", 2024-04-26T12:07:00.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8730000000000002e-06 2024-04-26T12:07:00.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528901+0000", 2024-04-26T12:07:00.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4880000000000001e-06 2024-04-26T12:07:00.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:00.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580146+0000", 2024-04-26T12:07:00.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051244242000000002 2024-04-26T12:07:00.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:00.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580227+0000", 2024-04-26T12:07:00.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1044000000000005e-05 2024-04-26T12:07:00.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:00.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583864+0000", 2024-04-26T12:07:00.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036374419999999998 2024-04-26T12:07:00.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:00.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583894+0000", 2024-04-26T12:07:00.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9828999999999999e-05 2024-04-26T12:07:00.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:00.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583931+0000", 2024-04-26T12:07:00.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6908e-05 2024-04-26T12:07:00.917 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.917 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:00.917 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.917 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 459898~2037 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:00.917 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:00.917 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 6.2999454369999999, 2024-04-26T12:07:00.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055925713000000002, 2024-04-26T12:07:00.917 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:00.917 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.917 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:00.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:00.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:00.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:00.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:00.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:00.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529199+0000", 2024-04-26T12:07:00.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:00.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:00.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529203+0000", 2024-04-26T12:07:00.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:07:00.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:00.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529209+0000", 2024-04-26T12:07:00.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7939999999999999e-06 2024-04-26T12:07:00.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529212+0000", 2024-04-26T12:07:00.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7290000000000002e-06 2024-04-26T12:07:00.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:00.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580784+0000", 2024-04-26T12:07:00.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051572073000000003 2024-04-26T12:07:00.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:00.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580883+0000", 2024-04-26T12:07:00.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8330000000000002e-05 2024-04-26T12:07:00.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:00.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585050+0000", 2024-04-26T12:07:00.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041670209999999999 2024-04-26T12:07:00.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:00.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585088+0000", 2024-04-26T12:07:00.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8559999999999997e-05 2024-04-26T12:07:00.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:00.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585125+0000", 2024-04-26T12:07:00.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7197999999999999e-05 2024-04-26T12:07:00.921 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.921 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:00.921 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.922 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 461935~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:00.922 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:00.922 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 6.2992229829999999, 2024-04-26T12:07:00.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055266150999999999, 2024-04-26T12:07:00.922 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:00.922 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:00.922 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:00.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:00.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:00.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:00.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:00.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:00.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:00.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529921+0000", 2024-04-26T12:07:00.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:00.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:00.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529956+0000", 2024-04-26T12:07:00.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4687000000000002e-05 2024-04-26T12:07:00.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:00.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529966+0000", 2024-04-26T12:07:00.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0392e-05 2024-04-26T12:07:00.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:00.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529978+0000", 2024-04-26T12:07:00.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1348e-05 2024-04-26T12:07:00.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:00.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581659+0000", 2024-04-26T12:07:00.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051681454000000002 2024-04-26T12:07:00.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:00.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581746+0000", 2024-04-26T12:07:00.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6305999999999997e-05 2024-04-26T12:07:00.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:00.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585131+0000", 2024-04-26T12:07:00.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033853199999999998 2024-04-26T12:07:00.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:00.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585154+0000", 2024-04-26T12:07:00.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3258999999999999e-05 2024-04-26T12:07:00.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:00.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:00.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:00.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585188+0000", 2024-04-26T12:07:00.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4236000000000002e-05 2024-04-26T12:07:00.926 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.926 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:00.926 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.926 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:00.926 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:00.926 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:00.927 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:07:00.928 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:00.926+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:01.028 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:01.027+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:01.031 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:01.032 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:01.032 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:07:01.032 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:01.041 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:01.129 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:01.128+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:01.160 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:07:01.182 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:01.182 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:01.182 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:07:01.183 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:07:01.183 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:01.191 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:01.229 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:01.228+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:01.295 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:07:01.295 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:07:01.296 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:07:01.315 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:07:01.315 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:07:01.318 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:07:01.319 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:07:01.330 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:01.329+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:01.333 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:01.333 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:01.342 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:07:01.431 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:01.430+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:01.453 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:01.453 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:01.463 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:07:01.532 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:01.531+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:01.556 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:07:01.572 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:01.572 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:01.581 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:07:01.665 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:01.664+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:01.723 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:01.723 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:01.732 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:07:01.734 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:01.732+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:01.834 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:01.833+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:01.840 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:01.840 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:01.850 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:01.935 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:01.934+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:02.036 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:02.035+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:02.047 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:02.047 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:02.056 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:02.143 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:02.140+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:02.202 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:02.202 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:02.212 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:07:02.253 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:02.252+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:02.314 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:02.315 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:02.323 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:07:02.344 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:02.343+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:02.425 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:02.425 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:02.434 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:07:02.475 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T12:07:02.475 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T12:07:02.478 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:02.477+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:02.537 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:02.538 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:02.546 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-26T12:07:02.548 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:07:02.548 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:02.545+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:02.647 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:02.646+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:02.660 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:02.660 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:02.670 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:02.751 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:02.750+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:02.780 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:02.780 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:02.789 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:02.851 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:02.850+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:02.952 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:02.951+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:02.971 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:02.971 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:02.982 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:07:03.054 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:03.053+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:03.087 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:03.088 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:03.097 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:07:03.154 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:03.153+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:03.202 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:03.202 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:03.212 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:07:03.257 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:03.256+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:03.315 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:03.316 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:03.320 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:07:03.325 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:07:03.369 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:03.368+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:03.434 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:03.435 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:03.444 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:03.452 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:07:03.452 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:07:03.452 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:07:03.458 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:03.457+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:03.473 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:07:03.473 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:07:03.476 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:07:03.477 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:07:03.560 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:03.558+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:03.589 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:03.589 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:03.589 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:07:03.589 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:07:03.589 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:03.599 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:03.659 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:03.658+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:03.709 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:03.709 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:07:03.709 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:07:03.709 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:07:03.709 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.709 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2989 3.d 3:b02ffd62:::200.00000010:head [write 3767903~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:03.709 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:03.709 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.1902183629999996, 2024-04-26T12:07:03.709 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057069768999999999, 2024-04-26T12:07:03.709 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:03.709 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:03.709 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:03.709 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.710 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:03.710 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:03.710 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.710 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.710 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.710 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:03.710 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:03.710 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.710 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.710 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.710 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:03.710 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:03.710 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:03.710 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.711 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.711 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:03.711 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516446+0000", 2024-04-26T12:07:03.711 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6469999999999997e-06 2024-04-26T12:07:03.711 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.711 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.711 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:03.711 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516449+0000", 2024-04-26T12:07:03.711 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.976e-06 2024-04-26T12:07:03.711 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.711 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.711 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:03.711 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516452+0000", 2024-04-26T12:07:03.711 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.509e-06 2024-04-26T12:07:03.712 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.712 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.712 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:03.712 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.568562+0000", 2024-04-26T12:07:03.712 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.052110030000000002 2024-04-26T12:07:03.712 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.712 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.712 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:03.712 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.568615+0000", 2024-04-26T12:07:03.712 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2809999999999998e-05 2024-04-26T12:07:03.712 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.712 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.712 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:03.712 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573425+0000", 2024-04-26T12:07:03.712 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048105149999999996 2024-04-26T12:07:03.713 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.713 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.713 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:03.713 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573452+0000", 2024-04-26T12:07:03.713 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6778e-05 2024-04-26T12:07:03.713 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.713 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.713 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:03.713 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573512+0000", 2024-04-26T12:07:03.713 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9710000000000003e-05 2024-04-26T12:07:03.713 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.713 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:03.713 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.713 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.714 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.714 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2990 3.d 3:b02ffd62:::200.00000010:head [write 3769302~4483 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:03.714 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:03.714 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.1902063639999998, 2024-04-26T12:07:03.714 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057131345, 2024-04-26T12:07:03.714 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:03.714 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:03.714 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:03.714 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.714 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:03.714 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:03.714 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.714 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.714 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.715 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:03.715 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:03.715 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.715 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.715 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.715 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:03.715 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:03.715 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:03.715 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.715 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.715 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:03.715 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516459+0000", 2024-04-26T12:07:03.715 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2859999999999999e-06 2024-04-26T12:07:03.715 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.715 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.716 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:03.716 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516462+0000", 2024-04-26T12:07:03.716 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0790000000000001e-06 2024-04-26T12:07:03.716 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.716 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.716 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:03.716 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516465+0000", 2024-04-26T12:07:03.716 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.464e-06 2024-04-26T12:07:03.716 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.716 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.716 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:03.716 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569035+0000", 2024-04-26T12:07:03.716 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.052570328999999999 2024-04-26T12:07:03.716 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.716 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.717 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:03.717 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569113+0000", 2024-04-26T12:07:03.717 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8118e-05 2024-04-26T12:07:03.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.717 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.717 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:03.717 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573517+0000", 2024-04-26T12:07:03.717 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044039200000000004 2024-04-26T12:07:03.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.717 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.717 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:03.717 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573541+0000", 2024-04-26T12:07:03.717 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3805999999999999e-05 2024-04-26T12:07:03.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.717 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.718 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:03.718 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573585+0000", 2024-04-26T12:07:03.718 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4567000000000002e-05 2024-04-26T12:07:03.718 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.718 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:03.718 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.718 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.718 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.718 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2991 3.d 3:b02ffd62:::200.00000010:head [write 3773785~4213 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:03.718 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:03.718 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.1901936749999997, 2024-04-26T12:07:03.718 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057230554000000003, 2024-04-26T12:07:03.718 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:03.718 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:03.719 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:03.719 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.719 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:03.719 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:03.719 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.719 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.719 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.719 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:03.719 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:03.719 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.719 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.719 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.719 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:03.719 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516466+0000", 2024-04-26T12:07:03.720 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:03.720 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.720 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.720 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:03.720 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516470+0000", 2024-04-26T12:07:03.720 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7960000000000002e-06 2024-04-26T12:07:03.720 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.720 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.720 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:03.720 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516478+0000", 2024-04-26T12:07:03.720 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:07:03.720 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.720 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.720 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:03.720 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516484+0000", 2024-04-26T12:07:03.721 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5300000000000002e-06 2024-04-26T12:07:03.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.721 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.721 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:03.721 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569662+0000", 2024-04-26T12:07:03.721 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053177896000000002 2024-04-26T12:07:03.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.721 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.721 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:03.721 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569749+0000", 2024-04-26T12:07:03.721 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7229000000000001e-05 2024-04-26T12:07:03.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.721 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.721 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:03.721 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573593+0000", 2024-04-26T12:07:03.722 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038433109999999999 2024-04-26T12:07:03.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.722 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.722 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:03.722 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573631+0000", 2024-04-26T12:07:03.722 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8615000000000002e-05 2024-04-26T12:07:03.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.722 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.722 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:03.722 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573697+0000", 2024-04-26T12:07:03.722 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5971999999999998e-05 2024-04-26T12:07:03.722 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.722 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:03.723 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.723 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.723 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2999 3.d 3:b02ffd62:::200.00000010:head [write 3797283~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:03.723 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:03.723 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.1856792870000001, 2024-04-26T12:07:03.723 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057330949999999999, 2024-04-26T12:07:03.723 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:03.723 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:03.723 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:03.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.723 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:03.723 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:03.723 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.723 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.724 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.724 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:03.724 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:03.724 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.724 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.724 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.724 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:03.724 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520980+0000", 2024-04-26T12:07:03.724 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:03.724 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.724 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.724 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:03.724 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520991+0000", 2024-04-26T12:07:03.724 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1154e-05 2024-04-26T12:07:03.725 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.725 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.725 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:03.725 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521014+0000", 2024-04-26T12:07:03.725 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2288000000000001e-05 2024-04-26T12:07:03.725 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.725 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.725 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:03.725 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521019+0000", 2024-04-26T12:07:03.725 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0889999999999999e-06 2024-04-26T12:07:03.725 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.725 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.725 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:03.725 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.575399+0000", 2024-04-26T12:07:03.725 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054380392999999999 2024-04-26T12:07:03.726 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.726 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.726 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:03.726 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.575440+0000", 2024-04-26T12:07:03.726 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1146000000000002e-05 2024-04-26T12:07:03.726 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.726 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.726 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:03.726 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578237+0000", 2024-04-26T12:07:03.726 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002796761 2024-04-26T12:07:03.726 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.726 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.726 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:03.726 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578260+0000", 2024-04-26T12:07:03.727 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3538999999999999e-05 2024-04-26T12:07:03.727 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.727 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.727 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:03.727 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578312+0000", 2024-04-26T12:07:03.727 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1508999999999998e-05 2024-04-26T12:07:03.727 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.727 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:03.727 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.727 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.727 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.727 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3000 3.d 3:b02ffd62:::200.00000010:head [write 3801160~9028 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:03.727 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:03.727 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.1850533209999998, 2024-04-26T12:07:03.728 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.059231688999999997, 2024-04-26T12:07:03.728 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:03.728 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:03.728 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:03.728 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.728 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:03.728 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:03.728 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.728 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.728 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.728 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:03.728 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:03.728 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.728 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.728 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.729 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:03.729 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521606+0000", 2024-04-26T12:07:03.729 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:03.729 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.729 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.729 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:03.729 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521627+0000", 2024-04-26T12:07:03.729 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1129e-05 2024-04-26T12:07:03.729 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.729 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.729 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:03.729 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521637+0000", 2024-04-26T12:07:03.729 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8789999999999998e-06 2024-04-26T12:07:03.729 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.730 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.730 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:03.730 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521644+0000", 2024-04-26T12:07:03.730 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:07:03.730 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.730 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.730 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:03.730 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576381+0000", 2024-04-26T12:07:03.730 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.05473629 2024-04-26T12:07:03.730 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.730 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.730 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:03.730 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576451+0000", 2024-04-26T12:07:03.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0525000000000007e-05 2024-04-26T12:07:03.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:03.731 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580734+0000", 2024-04-26T12:07:03.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042826699999999997 2024-04-26T12:07:03.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:03.731 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580780+0000", 2024-04-26T12:07:03.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6006e-05 2024-04-26T12:07:03.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.732 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:03.732 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580839+0000", 2024-04-26T12:07:03.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8783000000000003e-05 2024-04-26T12:07:03.732 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.732 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:03.732 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.732 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3001 3.d 3:b02ffd62:::200.00000010:head [write 3810188~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:03.732 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:03.732 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.184500989, 2024-04-26T12:07:03.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.060161213999999998, 2024-04-26T12:07:03.732 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:03.733 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:03.733 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:03.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:03.733 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:03.733 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:03.733 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:03.733 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:03.734 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522158+0000", 2024-04-26T12:07:03.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:03.734 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.734 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.734 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:03.734 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522165+0000", 2024-04-26T12:07:03.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.28e-06 2024-04-26T12:07:03.734 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.734 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.734 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:03.734 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522178+0000", 2024-04-26T12:07:03.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3738e-05 2024-04-26T12:07:03.734 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.734 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.735 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:03.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522186+0000", 2024-04-26T12:07:03.735 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.267e-06 2024-04-26T12:07:03.735 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.735 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:03.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576889+0000", 2024-04-26T12:07:03.735 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054703442999999997 2024-04-26T12:07:03.735 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.735 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:03.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576953+0000", 2024-04-26T12:07:03.735 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4213000000000003e-05 2024-04-26T12:07:03.735 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.736 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:03.736 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582185+0000", 2024-04-26T12:07:03.736 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052319209999999996 2024-04-26T12:07:03.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.736 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:03.736 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582243+0000", 2024-04-26T12:07:03.736 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7321999999999998e-05 2024-04-26T12:07:03.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.736 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:03.736 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582321+0000", 2024-04-26T12:07:03.736 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7911000000000007e-05 2024-04-26T12:07:03.736 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.737 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:03.737 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.737 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3002 3.d 3:b02ffd62:::200.00000010:head [write 3812103~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:03.737 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:03.737 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.1840322260000002, 2024-04-26T12:07:03.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.059796961000000003, 2024-04-26T12:07:03.737 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:03.737 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:03.737 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:03.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:03.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:03.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.738 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.738 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:03.738 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:03.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.738 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.738 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:03.738 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522627+0000", 2024-04-26T12:07:03.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:03.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.738 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.738 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:03.738 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522633+0000", 2024-04-26T12:07:03.739 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6699999999999999e-06 2024-04-26T12:07:03.739 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.739 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.739 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:03.739 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522643+0000", 2024-04-26T12:07:03.739 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6649999999999998e-06 2024-04-26T12:07:03.739 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.739 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.739 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:03.739 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522649+0000", 2024-04-26T12:07:03.739 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4200000000000004e-06 2024-04-26T12:07:03.739 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.739 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.739 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:03.740 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577413+0000", 2024-04-26T12:07:03.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054763714999999998 2024-04-26T12:07:03.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.740 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.740 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:03.740 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577460+0000", 2024-04-26T12:07:03.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7095000000000002e-05 2024-04-26T12:07:03.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.740 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.740 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:03.740 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582331+0000", 2024-04-26T12:07:03.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048716419999999998 2024-04-26T12:07:03.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.740 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.740 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:03.741 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582375+0000", 2024-04-26T12:07:03.741 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3053999999999998e-05 2024-04-26T12:07:03.741 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.741 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.741 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:03.741 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582425+0000", 2024-04-26T12:07:03.741 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0525000000000002e-05 2024-04-26T12:07:03.741 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.741 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:03.741 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.741 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.741 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.741 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3003 3.d 3:b02ffd62:::200.00000010:head [write 3814061~4170 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:03.741 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:03.741 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.1829771640000004, 2024-04-26T12:07:03.742 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058803394000000002, 2024-04-26T12:07:03.742 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:03.742 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:03.742 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:03.742 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.742 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:03.742 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:03.742 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.742 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.742 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.742 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:03.742 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:03.742 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.742 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.743 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.743 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:03.743 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523682+0000", 2024-04-26T12:07:03.743 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:03.743 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.743 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.743 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:03.743 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523690+0000", 2024-04-26T12:07:03.743 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0290000000000005e-06 2024-04-26T12:07:03.743 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.743 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.743 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:03.743 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523699+0000", 2024-04-26T12:07:03.743 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4589999999999998e-06 2024-04-26T12:07:03.743 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.744 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.744 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:03.744 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523703+0000", 2024-04-26T12:07:03.744 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6249999999999998e-06 2024-04-26T12:07:03.744 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.744 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.744 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:03.744 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577832+0000", 2024-04-26T12:07:03.744 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054128883000000003 2024-04-26T12:07:03.744 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.744 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.744 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:03.744 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577878+0000", 2024-04-26T12:07:03.744 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5841999999999999e-05 2024-04-26T12:07:03.745 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.745 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.745 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:03.745 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582430+0000", 2024-04-26T12:07:03.745 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045517270000000002 2024-04-26T12:07:03.745 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.745 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.745 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:03.745 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582453+0000", 2024-04-26T12:07:03.745 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3609999999999999e-05 2024-04-26T12:07:03.745 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.745 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.745 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:03.745 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582487+0000", 2024-04-26T12:07:03.745 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3080000000000002e-05 2024-04-26T12:07:03.746 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.746 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:03.746 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.746 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.746 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.746 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3004 3.d 3:b02ffd62:::200.00000010:head [write 3818231~3890 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:03.746 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:03.746 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.182128241, 2024-04-26T12:07:03.746 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058024342999999999, 2024-04-26T12:07:03.746 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:03.746 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:03.746 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:03.746 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.746 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:03.747 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:03.747 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.747 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:03.747 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:03.747 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.747 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:03.747 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524531+0000", 2024-04-26T12:07:03.747 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:03.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.747 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:03.748 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524539+0000", 2024-04-26T12:07:03.748 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9249999999999995e-06 2024-04-26T12:07:03.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.748 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.748 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:03.748 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524547+0000", 2024-04-26T12:07:03.748 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5220000000000007e-06 2024-04-26T12:07:03.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.748 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.748 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:03.748 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524553+0000", 2024-04-26T12:07:03.748 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6659999999999996e-06 2024-04-26T12:07:03.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.748 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.748 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:03.749 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578335+0000", 2024-04-26T12:07:03.749 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.05378235 2024-04-26T12:07:03.749 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.749 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.749 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:03.749 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578378+0000", 2024-04-26T12:07:03.749 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2429999999999999e-05 2024-04-26T12:07:03.749 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.749 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.749 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:03.749 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582494+0000", 2024-04-26T12:07:03.749 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004116059 2024-04-26T12:07:03.749 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.749 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.750 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:03.750 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582519+0000", 2024-04-26T12:07:03.750 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4961999999999999e-05 2024-04-26T12:07:03.750 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.750 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.750 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:03.750 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582556+0000", 2024-04-26T12:07:03.750 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7728999999999997e-05 2024-04-26T12:07:03.750 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.750 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:03.750 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.751 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.751 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3005 3.d 3:b02ffd62:::200.00000010:head [write 3822121~5207 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:03.751 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:03.751 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.1817089850000002, 2024-04-26T12:07:03.751 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057662270000000002, 2024-04-26T12:07:03.751 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:03.751 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:03.751 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:03.751 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.751 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:03.751 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:03.751 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.752 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.752 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:03.752 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:03.752 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.752 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.752 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.752 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:03.752 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:03.752 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:03.752 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.752 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.752 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:03.752 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524961+0000", 2024-04-26T12:07:03.752 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0124e-05 2024-04-26T12:07:03.752 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.753 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:03.753 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524971+0000", 2024-04-26T12:07:03.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0200999999999999e-05 2024-04-26T12:07:03.753 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.753 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:03.753 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524979+0000", 2024-04-26T12:07:03.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5809999999999999e-06 2024-04-26T12:07:03.753 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.753 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:03.753 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578753+0000", 2024-04-26T12:07:03.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053774444999999997 2024-04-26T12:07:03.753 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.754 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.754 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:03.754 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578821+0000", 2024-04-26T12:07:03.754 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7640999999999998e-05 2024-04-26T12:07:03.754 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.754 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.754 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:03.754 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582561+0000", 2024-04-26T12:07:03.754 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037399870000000002 2024-04-26T12:07:03.754 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.754 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.754 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:03.754 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582582+0000", 2024-04-26T12:07:03.754 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0934999999999999e-05 2024-04-26T12:07:03.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.755 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.755 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:03.755 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582614+0000", 2024-04-26T12:07:03.755 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1948e-05 2024-04-26T12:07:03.755 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.755 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:03.755 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.756 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.756 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3006 3.d 3:b02ffd62:::200.00000010:head [write 3827328~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:03.756 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:03.756 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.181075646, 2024-04-26T12:07:03.756 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057085404999999999, 2024-04-26T12:07:03.756 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:03.756 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:03.756 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:03.756 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.756 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:03.757 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:03.757 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.757 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.757 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.757 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:03.757 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:03.757 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.757 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.757 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.757 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:03.757 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525583+0000", 2024-04-26T12:07:03.757 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:03.757 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.757 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.758 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:03.758 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525594+0000", 2024-04-26T12:07:03.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0497e-05 2024-04-26T12:07:03.758 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.758 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.758 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:03.758 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525610+0000", 2024-04-26T12:07:03.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6392000000000002e-05 2024-04-26T12:07:03.758 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.758 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.758 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:03.758 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525621+0000", 2024-04-26T12:07:03.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0679999999999999e-05 2024-04-26T12:07:03.758 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.759 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:03.759 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.579270+0000", 2024-04-26T12:07:03.759 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053648802000000002 2024-04-26T12:07:03.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.759 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:03.759 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.579312+0000", 2024-04-26T12:07:03.759 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2268000000000003e-05 2024-04-26T12:07:03.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.759 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:03.759 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582618+0000", 2024-04-26T12:07:03.759 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033057049999999999 2024-04-26T12:07:03.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:03.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582637+0000", 2024-04-26T12:07:03.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9417000000000001e-05 2024-04-26T12:07:03.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:03.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582670+0000", 2024-04-26T12:07:03.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2969999999999998e-05 2024-04-26T12:07:03.760 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.760 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:03.760 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.761 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3015 3.d 3:b02ffd62:::200.00000010:head [write 3855113~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:03.761 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:03.761 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.1706198890000001, 2024-04-26T12:07:03.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057652729999999999, 2024-04-26T12:07:03.761 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:03.761 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:03.761 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:03.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.761 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:03.761 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:03.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.761 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:03.761 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:03.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.762 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.762 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:03.762 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:03.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:03.762 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.762 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:03.762 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536042+0000", 2024-04-26T12:07:03.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0849999999999999e-06 2024-04-26T12:07:03.762 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.762 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:03.763 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536046+0000", 2024-04-26T12:07:03.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:07:03.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.763 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.763 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:03.763 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536048+0000", 2024-04-26T12:07:03.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6019999999999998e-06 2024-04-26T12:07:03.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.763 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.763 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:03.763 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585409+0000", 2024-04-26T12:07:03.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.049360938 2024-04-26T12:07:03.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.763 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.764 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:03.764 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585506+0000", 2024-04-26T12:07:03.764 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6966999999999995e-05 2024-04-26T12:07:03.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.764 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:03.764 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593630+0000", 2024-04-26T12:07:03.764 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0081238160000000007 2024-04-26T12:07:03.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.764 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:03.764 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593656+0000", 2024-04-26T12:07:03.764 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6154000000000001e-05 2024-04-26T12:07:03.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:03.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593693+0000", 2024-04-26T12:07:03.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7185999999999999e-05 2024-04-26T12:07:03.765 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.765 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:03.765 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.765 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3016 3.d 3:b02ffd62:::200.00000010:head [write 3857020~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:03.765 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:03.765 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.1706099419999996, 2024-04-26T12:07:03.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058678157000000002, 2024-04-26T12:07:03.765 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:03.765 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:03.766 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:03.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:03.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:03.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:03.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:03.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:03.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:03.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:03.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:03.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536055+0000", 2024-04-26T12:07:03.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3669999999999999e-06 2024-04-26T12:07:03.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:03.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536058+0000", 2024-04-26T12:07:03.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3220000000000001e-06 2024-04-26T12:07:03.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:03.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536062+0000", 2024-04-26T12:07:03.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1520000000000002e-06 2024-04-26T12:07:03.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.769 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:03.769 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585965+0000", 2024-04-26T12:07:03.769 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.049902769999999999 2024-04-26T12:07:03.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.769 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:03.769 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586046+0000", 2024-04-26T12:07:03.769 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1032999999999995e-05 2024-04-26T12:07:03.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:03.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594667+0000", 2024-04-26T12:07:03.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0086214599999999992 2024-04-26T12:07:03.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:03.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594692+0000", 2024-04-26T12:07:03.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5191999999999999e-05 2024-04-26T12:07:03.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:03.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594729+0000", 2024-04-26T12:07:03.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6069000000000003e-05 2024-04-26T12:07:03.770 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.771 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:03.771 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.771 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3017 3.d 3:b02ffd62:::200.00000010:head [write 3859438~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:03.771 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:03.771 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.1705958580000004, 2024-04-26T12:07:03.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058723814999999999, 2024-04-26T12:07:03.771 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:03.771 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:03.771 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:03.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:03.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:03.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:03.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:03.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:03.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:03.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:03.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:03.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536066+0000", 2024-04-26T12:07:03.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8840000000000001e-06 2024-04-26T12:07:03.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:03.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536069+0000", 2024-04-26T12:07:03.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:07:03.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:03.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536072+0000", 2024-04-26T12:07:03.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4449999999999999e-06 2024-04-26T12:07:03.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:03.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586703+0000", 2024-04-26T12:07:03.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050631618000000003 2024-04-26T12:07:03.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:03.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586748+0000", 2024-04-26T12:07:03.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4682999999999999e-05 2024-04-26T12:07:03.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:03.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594734+0000", 2024-04-26T12:07:03.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079860369999999996 2024-04-26T12:07:03.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:03.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594756+0000", 2024-04-26T12:07:03.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1738000000000001e-05 2024-04-26T12:07:03.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:03.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594788+0000", 2024-04-26T12:07:03.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2604999999999997e-05 2024-04-26T12:07:03.775 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.775 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:03.775 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.775 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3018 3.d 3:b02ffd62:::200.00000010:head [write 3861345~3221 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:03.775 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:03.775 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.1697631709999996, 2024-04-26T12:07:03.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057946174000000003, 2024-04-26T12:07:03.776 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:03.776 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:03.776 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:03.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:03.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:03.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:03.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:03.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:03.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536896+0000", 2024-04-26T12:07:03.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:03.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:03.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536905+0000", 2024-04-26T12:07:03.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7839999999999998e-06 2024-04-26T12:07:03.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:03.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536929+0000", 2024-04-26T12:07:03.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3561999999999999e-05 2024-04-26T12:07:03.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:03.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536940+0000", 2024-04-26T12:07:03.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0742e-05 2024-04-26T12:07:03.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:03.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.587238+0000", 2024-04-26T12:07:03.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050297962000000002 2024-04-26T12:07:03.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:03.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.587315+0000", 2024-04-26T12:07:03.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7848000000000004e-05 2024-04-26T12:07:03.779 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.779 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:03.779 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594792+0000", 2024-04-26T12:07:03.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074766240000000003 2024-04-26T12:07:03.779 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.779 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:03.779 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594813+0000", 2024-04-26T12:07:03.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0876000000000001e-05 2024-04-26T12:07:03.779 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.779 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:03.779 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594843+0000", 2024-04-26T12:07:03.780 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0434999999999999e-05 2024-04-26T12:07:03.780 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.780 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:03.780 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.780 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.780 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3019 3.d 3:b02ffd62:::200.00000010:head [write 3864566~3989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:03.780 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:03.780 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.1680208109999999, 2024-04-26T12:07:03.780 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.061000094999999997, 2024-04-26T12:07:03.780 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:03.780 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:03.780 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:03.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.780 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:03.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:03.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:03.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:03.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:03.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538638+0000", 2024-04-26T12:07:03.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999981 2024-04-26T12:07:03.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:03.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538669+0000", 2024-04-26T12:07:03.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1689000000000001e-05 2024-04-26T12:07:03.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:03.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538703+0000", 2024-04-26T12:07:03.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3309000000000002e-05 2024-04-26T12:07:03.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:03.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538746+0000", 2024-04-26T12:07:03.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2803999999999999e-05 2024-04-26T12:07:03.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:03.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.589467+0000", 2024-04-26T12:07:03.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050721912000000001 2024-04-26T12:07:03.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:03.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.589517+0000", 2024-04-26T12:07:03.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9549999999999998e-05 2024-04-26T12:07:03.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:03.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599577+0000", 2024-04-26T12:07:03.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010059593 2024-04-26T12:07:03.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.784 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:03.784 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599603+0000", 2024-04-26T12:07:03.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6821e-05 2024-04-26T12:07:03.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.784 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:03.784 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599640+0000", 2024-04-26T12:07:03.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6177999999999998e-05 2024-04-26T12:07:03.784 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.784 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:03.784 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.785 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3020 3.d 3:b02ffd62:::200.00000010:head [write 3868555~7563 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:03.785 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:03.785 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.165407976, 2024-04-26T12:07:03.785 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058446867, 2024-04-26T12:07:03.785 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:03.785 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:03.785 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:03.785 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.785 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:03.785 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:03.785 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.785 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.786 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:03.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:03.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.786 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.786 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:03.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541251+0000", 2024-04-26T12:07:03.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:03.786 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.786 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:03.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541286+0000", 2024-04-26T12:07:03.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4845999999999998e-05 2024-04-26T12:07:03.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:03.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541300+0000", 2024-04-26T12:07:03.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4251e-05 2024-04-26T12:07:03.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:03.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541307+0000", 2024-04-26T12:07:03.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3819999999999998e-06 2024-04-26T12:07:03.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:03.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.592596+0000", 2024-04-26T12:07:03.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051288215999999998 2024-04-26T12:07:03.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:03.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.592675+0000", 2024-04-26T12:07:03.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9197999999999996e-05 2024-04-26T12:07:03.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:03.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599645+0000", 2024-04-26T12:07:03.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069701759999999998 2024-04-26T12:07:03.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:03.789 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599667+0000", 2024-04-26T12:07:03.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2118999999999999e-05 2024-04-26T12:07:03.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.789 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.789 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:03.789 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599699+0000", 2024-04-26T12:07:03.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2048999999999998e-05 2024-04-26T12:07:03.789 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.789 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:03.789 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.789 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.789 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3021 3.d 3:b02ffd62:::200.00000010:head [write 3876118~3791 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:03.789 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:03.790 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.1653462389999998, 2024-04-26T12:07:03.790 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058441157000000001, 2024-04-26T12:07:03.790 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:03.790 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:03.790 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:03.790 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.790 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:03.790 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:03.790 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.790 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.790 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.790 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:03.790 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:03.790 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.791 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.791 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.791 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:03.791 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:03.791 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:03.791 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.791 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.791 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:03.791 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541323+0000", 2024-04-26T12:07:03.791 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5510000000000005e-06 2024-04-26T12:07:03.791 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.791 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.791 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:03.791 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541327+0000", 2024-04-26T12:07:03.792 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2520000000000001e-06 2024-04-26T12:07:03.792 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:03.792 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541330+0000", 2024-04-26T12:07:03.792 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:07:03.792 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:03.792 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593229+0000", 2024-04-26T12:07:03.792 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051898044999999997 2024-04-26T12:07:03.792 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:03.792 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593278+0000", 2024-04-26T12:07:03.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9506999999999999e-05 2024-04-26T12:07:03.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:03.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599704+0000", 2024-04-26T12:07:03.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064259570000000004 2024-04-26T12:07:03.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:03.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599725+0000", 2024-04-26T12:07:03.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0562999999999999e-05 2024-04-26T12:07:03.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:03.794 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599755+0000", 2024-04-26T12:07:03.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0710000000000002e-05 2024-04-26T12:07:03.794 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.794 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:03.794 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.794 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3022 3.d 3:b02ffd62:::200.00000010:head [write 3879909~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:03.794 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:03.794 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.1640971699999998, 2024-04-26T12:07:03.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057246689000000003, 2024-04-26T12:07:03.794 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:03.794 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:03.794 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:03.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.795 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:03.795 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:03.795 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.795 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.795 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:03.795 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:03.795 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.795 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.795 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:03.795 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542561+0000", 2024-04-26T12:07:03.795 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999981 2024-04-26T12:07:03.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.796 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.796 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:03.796 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542570+0000", 2024-04-26T12:07:03.796 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9199999999999993e-06 2024-04-26T12:07:03.796 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.796 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.796 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:03.796 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542583+0000", 2024-04-26T12:07:03.796 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2227e-05 2024-04-26T12:07:03.796 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.796 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.796 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:03.796 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542598+0000", 2024-04-26T12:07:03.796 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5199e-05 2024-04-26T12:07:03.796 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.797 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:03.797 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593728+0000", 2024-04-26T12:07:03.797 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051129846 2024-04-26T12:07:03.797 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.797 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:03.797 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593806+0000", 2024-04-26T12:07:03.797 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8425999999999998e-05 2024-04-26T12:07:03.797 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.797 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:03.797 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599760+0000", 2024-04-26T12:07:03.797 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0059537399999999999 2024-04-26T12:07:03.797 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.798 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.798 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:03.798 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599779+0000", 2024-04-26T12:07:03.798 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9619e-05 2024-04-26T12:07:03.798 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.798 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.798 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:03.798 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599810+0000", 2024-04-26T12:07:03.798 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0508999999999999e-05 2024-04-26T12:07:03.798 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.798 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:03.799 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.799 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.799 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.799 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3023 3.d 3:b02ffd62:::200.00000010:head [write 3881868~5748 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:03.799 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:03.799 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.1636253219999997, 2024-04-26T12:07:03.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.056829994000000002, 2024-04-26T12:07:03.799 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:03.799 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:03.799 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:03.799 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.799 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:03.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:03.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:03.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:03.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:03.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:03.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543034+0000", 2024-04-26T12:07:03.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:03.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:03.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543044+0000", 2024-04-26T12:07:03.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0444e-05 2024-04-26T12:07:03.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:03.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543055+0000", 2024-04-26T12:07:03.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.096e-05 2024-04-26T12:07:03.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:03.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543063+0000", 2024-04-26T12:07:03.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2689999999999999e-06 2024-04-26T12:07:03.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:03.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594265+0000", 2024-04-26T12:07:03.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051201325999999998 2024-04-26T12:07:03.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:03.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594311+0000", 2024-04-26T12:07:03.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5918000000000003e-05 2024-04-26T12:07:03.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:03.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599815+0000", 2024-04-26T12:07:03.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055038370000000001 2024-04-26T12:07:03.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.803 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:03.803 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599834+0000", 2024-04-26T12:07:03.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9942e-05 2024-04-26T12:07:03.803 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:03.803 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:03.803 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:03.803 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599865+0000", 2024-04-26T12:07:03.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0549000000000002e-05 2024-04-26T12:07:03.803 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.803 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:03.803 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.803 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:03.803 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:03.803 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:03.805 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:07:03.806 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:03.803+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:03.906 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:03.905+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:03.908 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:03.909 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:07:03.909 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:07:03.909 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:03.918 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:07:04.007 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:04.006+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:04.059 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:04.060 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:07:04.060 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:07:04.060 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:07:04.060 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:04.068 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:07:04.108 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:04.107+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:04.172 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:04.172 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:07:04.173 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:07:04.173 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:07:04.173 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.173 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:536 3.2 3:4272d415:::200.0000000b:head [write 405817~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:04.173 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:04.173 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.6464499460000006, 2024-04-26T12:07:04.173 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053030282999999998, 2024-04-26T12:07:04.173 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.173 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.173 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.173 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.173 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.173 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:04.174 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.174 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.174 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.174 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.174 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:04.174 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.174 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.174 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.174 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.174 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524136+0000", 2024-04-26T12:07:04.174 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.174 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.174 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.174 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.175 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524139+0000", 2024-04-26T12:07:04.175 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2919999999999998e-06 2024-04-26T12:07:04.175 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.175 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.175 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.175 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524144+0000", 2024-04-26T12:07:04.175 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.502e-06 2024-04-26T12:07:04.175 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.175 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.175 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.175 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524149+0000", 2024-04-26T12:07:04.175 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7310000000000001e-06 2024-04-26T12:07:04.175 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.175 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.176 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.176 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570935+0000", 2024-04-26T12:07:04.176 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.046785603000000002 2024-04-26T12:07:04.176 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.176 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.176 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.176 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570981+0000", 2024-04-26T12:07:04.176 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6085999999999999e-05 2024-04-26T12:07:04.176 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.176 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.176 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:04.176 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577039+0000", 2024-04-26T12:07:04.177 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060582099999999996 2024-04-26T12:07:04.177 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.177 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.177 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:04.177 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577081+0000", 2024-04-26T12:07:04.177 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1927e-05 2024-04-26T12:07:04.177 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.177 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.177 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:04.177 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577167+0000", 2024-04-26T12:07:04.177 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6311999999999996e-05 2024-04-26T12:07:04.177 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.177 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.177 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.178 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.178 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.178 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:537 3.2 3:4272d415:::200.0000000b:head [write 407216~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:04.178 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:04.178 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.6464340079999999, 2024-04-26T12:07:04.178 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053131411000000003, 2024-04-26T12:07:04.178 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.178 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.178 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.178 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.178 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.178 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:04.178 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.178 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.178 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.179 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.179 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:04.179 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.179 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.179 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.179 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.179 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524152+0000", 2024-04-26T12:07:04.179 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.179 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.179 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.179 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.179 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524157+0000", 2024-04-26T12:07:04.179 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3529999999999997e-06 2024-04-26T12:07:04.179 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.180 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.180 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.180 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524162+0000", 2024-04-26T12:07:04.180 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5910000000000003e-06 2024-04-26T12:07:04.180 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.180 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.180 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.180 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524170+0000", 2024-04-26T12:07:04.180 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:07:04.180 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.180 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.180 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.180 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571323+0000", 2024-04-26T12:07:04.180 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047153289000000001 2024-04-26T12:07:04.180 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.181 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.181 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.181 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571367+0000", 2024-04-26T12:07:04.181 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4205000000000001e-05 2024-04-26T12:07:04.181 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.181 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.181 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:04.181 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577174+0000", 2024-04-26T12:07:04.181 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058072250000000001 2024-04-26T12:07:04.181 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.181 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.181 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:04.181 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577218+0000", 2024-04-26T12:07:04.181 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3294999999999998e-05 2024-04-26T12:07:04.181 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.182 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.182 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:04.182 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577284+0000", 2024-04-26T12:07:04.182 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6483999999999996e-05 2024-04-26T12:07:04.182 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.182 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.182 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.182 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.182 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.182 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:538 3.2 3:4272d415:::200.0000000b:head [write 408629~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:04.182 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:04.182 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.6464133079999996, 2024-04-26T12:07:04.182 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053241841999999998, 2024-04-26T12:07:04.182 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.182 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.183 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.183 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.183 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.183 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:04.183 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.183 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.183 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.183 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.183 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:04.183 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.183 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.183 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.183 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.183 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:04.183 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.184 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.184 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.184 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.184 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524178+0000", 2024-04-26T12:07:04.184 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1420000000000001e-06 2024-04-26T12:07:04.184 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.184 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.184 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.184 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524184+0000", 2024-04-26T12:07:04.184 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4240000000000001e-06 2024-04-26T12:07:04.184 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.184 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.184 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.184 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524188+0000", 2024-04-26T12:07:04.184 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2710000000000003e-06 2024-04-26T12:07:04.185 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.185 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.185 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.185 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571623+0000", 2024-04-26T12:07:04.185 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047435119999999997 2024-04-26T12:07:04.185 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.185 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.185 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.185 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571668+0000", 2024-04-26T12:07:04.185 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5377000000000003e-05 2024-04-26T12:07:04.185 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.185 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.185 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:04.185 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577292+0000", 2024-04-26T12:07:04.185 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0056232030000000002 2024-04-26T12:07:04.185 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.186 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.186 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:04.186 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577330+0000", 2024-04-26T12:07:04.186 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8748999999999998e-05 2024-04-26T12:07:04.186 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.186 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.186 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:04.186 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577415+0000", 2024-04-26T12:07:04.186 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4913000000000005e-05 2024-04-26T12:07:04.186 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.186 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.186 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.186 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.186 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.187 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:539 3.2 3:4272d415:::200.0000000b:head [write 410547~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:04.187 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:04.187 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.6463951760000004, 2024-04-26T12:07:04.187 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053372670999999997, 2024-04-26T12:07:04.187 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.187 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.187 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.187 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.187 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.187 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:04.187 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.187 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.187 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.187 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.188 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:04.188 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.188 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.188 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.188 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.188 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524191+0000", 2024-04-26T12:07:04.188 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.188 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.188 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.188 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.188 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524199+0000", 2024-04-26T12:07:04.188 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6520000000000006e-06 2024-04-26T12:07:04.188 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.188 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.188 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.189 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524205+0000", 2024-04-26T12:07:04.189 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:07:04.189 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.189 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.189 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.189 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524209+0000", 2024-04-26T12:07:04.189 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.335e-06 2024-04-26T12:07:04.189 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.189 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.189 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.189 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572320+0000", 2024-04-26T12:07:04.189 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048110992999999998 2024-04-26T12:07:04.189 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.189 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.189 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.189 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572364+0000", 2024-04-26T12:07:04.190 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4577999999999999e-05 2024-04-26T12:07:04.190 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.190 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.190 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:04.190 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577426+0000", 2024-04-26T12:07:04.190 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050615139999999996 2024-04-26T12:07:04.190 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.190 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.190 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:04.190 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577480+0000", 2024-04-26T12:07:04.190 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3599e-05 2024-04-26T12:07:04.190 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.190 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.190 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:04.190 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577564+0000", 2024-04-26T12:07:04.191 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4699999999999999e-05 2024-04-26T12:07:04.191 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.191 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.191 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.191 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.191 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.191 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:540 3.2 3:4272d415:::200.0000000b:head [write 411948~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:04.191 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:04.191 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.6463741580000004, 2024-04-26T12:07:04.191 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053497045999999999, 2024-04-26T12:07:04.191 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.191 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.191 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.191 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.191 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.192 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:04.192 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.192 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.192 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.192 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.192 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:04.192 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.192 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.192 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.192 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.192 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524212+0000", 2024-04-26T12:07:04.192 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.192 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.192 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.192 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.193 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524215+0000", 2024-04-26T12:07:04.193 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.559e-06 2024-04-26T12:07:04.193 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.193 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.193 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.193 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524220+0000", 2024-04-26T12:07:04.193 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2920000000000003e-06 2024-04-26T12:07:04.193 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.193 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.193 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.193 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524224+0000", 2024-04-26T12:07:04.193 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3680000000000004e-06 2024-04-26T12:07:04.193 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.193 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.193 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.193 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572619+0000", 2024-04-26T12:07:04.194 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048394549000000002 2024-04-26T12:07:04.194 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.194 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.194 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.194 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572669+0000", 2024-04-26T12:07:04.194 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0249e-05 2024-04-26T12:07:04.194 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.194 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.194 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:04.194 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577575+0000", 2024-04-26T12:07:04.194 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049053329999999996 2024-04-26T12:07:04.194 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.194 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.194 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:04.195 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577625+0000", 2024-04-26T12:07:04.195 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0274e-05 2024-04-26T12:07:04.195 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.195 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.195 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:04.195 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577710+0000", 2024-04-26T12:07:04.195 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4741999999999996e-05 2024-04-26T12:07:04.195 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.195 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.195 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.195 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.195 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.195 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:543 3.2 3:4272d415:::200.0000000b:head [write 413907~2485 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:04.195 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:04.195 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.646304464, 2024-04-26T12:07:04.196 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053578708000000003, 2024-04-26T12:07:04.196 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.196 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.196 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.196 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.196 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.196 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:04.196 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.196 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.196 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.196 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.196 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:04.196 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.196 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.196 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.197 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.197 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:04.197 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.197 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.197 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.197 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.197 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524287+0000", 2024-04-26T12:07:04.197 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2190000000000003e-06 2024-04-26T12:07:04.197 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.197 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.197 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.197 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524294+0000", 2024-04-26T12:07:04.197 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5660000000000003e-06 2024-04-26T12:07:04.197 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.197 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.198 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.198 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524298+0000", 2024-04-26T12:07:04.198 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3900000000000003e-06 2024-04-26T12:07:04.198 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.198 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.198 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.198 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572992+0000", 2024-04-26T12:07:04.198 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048693835999999997 2024-04-26T12:07:04.198 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.198 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.198 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.198 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573045+0000", 2024-04-26T12:07:04.198 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2793000000000001e-05 2024-04-26T12:07:04.198 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.199 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.199 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:04.199 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577721+0000", 2024-04-26T12:07:04.199 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046760550000000001 2024-04-26T12:07:04.199 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.199 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.199 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:04.199 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577777+0000", 2024-04-26T12:07:04.199 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5908000000000001e-05 2024-04-26T12:07:04.199 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.199 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.199 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:04.199 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577861+0000", 2024-04-26T12:07:04.199 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4337000000000002e-05 2024-04-26T12:07:04.200 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.200 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.200 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.200 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.200 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.200 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:544 3.2 3:4272d415:::200.0000000b:head [write 416392~3872 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:04.200 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:04.200 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.6462847420000006, 2024-04-26T12:07:04.200 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054810527999999997, 2024-04-26T12:07:04.200 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.200 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.200 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.200 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.200 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.200 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:04.201 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.201 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.201 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.201 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.201 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:04.201 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.201 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.201 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.201 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.201 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:04.201 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.201 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.201 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.201 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.201 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524307+0000", 2024-04-26T12:07:04.201 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1580000000000004e-06 2024-04-26T12:07:04.202 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.202 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.202 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.202 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524312+0000", 2024-04-26T12:07:04.202 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6380000000000001e-06 2024-04-26T12:07:04.202 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.202 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.202 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.202 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524317+0000", 2024-04-26T12:07:04.202 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4000000000000002e-06 2024-04-26T12:07:04.202 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.202 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.202 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.202 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573348+0000", 2024-04-26T12:07:04.203 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049031433999999999 2024-04-26T12:07:04.203 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.203 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.203 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.203 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573393+0000", 2024-04-26T12:07:04.203 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4536999999999997e-05 2024-04-26T12:07:04.203 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.203 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.203 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:04.203 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578978+0000", 2024-04-26T12:07:04.203 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055848299999999998 2024-04-26T12:07:04.203 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.203 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.203 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:04.203 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579031+0000", 2024-04-26T12:07:04.204 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3708000000000001e-05 2024-04-26T12:07:04.204 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.204 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.204 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:04.204 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579113+0000", 2024-04-26T12:07:04.204 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1258e-05 2024-04-26T12:07:04.204 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.204 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.204 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.204 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.204 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.204 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:545 3.2 3:4272d415:::200.0000000b:head [write 420264~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:04.204 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:04.204 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.6462661159999996, 2024-04-26T12:07:04.204 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054927386000000002, 2024-04-26T12:07:04.205 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.205 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.205 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.205 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.205 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.205 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:04.205 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.205 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.205 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.205 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.205 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:04.205 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.205 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.205 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.205 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.206 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524320+0000", 2024-04-26T12:07:04.206 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.206 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.206 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.206 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.206 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524325+0000", 2024-04-26T12:07:04.206 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5249999999999999e-06 2024-04-26T12:07:04.206 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.206 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.206 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.206 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524330+0000", 2024-04-26T12:07:04.206 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5629999999999999e-06 2024-04-26T12:07:04.206 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.206 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.207 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.207 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524335+0000", 2024-04-26T12:07:04.207 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.685e-06 2024-04-26T12:07:04.207 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.207 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.207 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.207 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573727+0000", 2024-04-26T12:07:04.207 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049392034000000001 2024-04-26T12:07:04.207 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.207 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.207 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.207 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573775+0000", 2024-04-26T12:07:04.207 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7435999999999998e-05 2024-04-26T12:07:04.207 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.207 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.208 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:04.208 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579120+0000", 2024-04-26T12:07:04.208 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0053452949999999999 2024-04-26T12:07:04.208 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.208 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.208 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:04.208 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579167+0000", 2024-04-26T12:07:04.208 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7240000000000002e-05 2024-04-26T12:07:04.208 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.208 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.208 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:04.208 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579248+0000", 2024-04-26T12:07:04.208 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0947999999999998e-05 2024-04-26T12:07:04.208 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.208 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.209 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.209 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.209 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.209 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 422222~8537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:04.209 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:04.209 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.6462477989999993, 2024-04-26T12:07:04.209 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055065936000000003, 2024-04-26T12:07:04.209 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.209 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.209 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.209 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.209 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.209 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:04.209 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.210 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.210 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.210 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.210 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:04.210 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.210 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.210 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.210 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.210 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:04.210 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.210 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.210 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.210 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.210 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524347+0000", 2024-04-26T12:07:04.211 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7129999999999994e-06 2024-04-26T12:07:04.211 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.211 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.211 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.211 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524357+0000", 2024-04-26T12:07:04.211 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0232e-05 2024-04-26T12:07:04.211 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.211 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.211 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.211 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524362+0000", 2024-04-26T12:07:04.211 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:07:04.211 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.211 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.211 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.211 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574119+0000", 2024-04-26T12:07:04.212 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049756727000000001 2024-04-26T12:07:04.212 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.212 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.212 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.212 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574166+0000", 2024-04-26T12:07:04.212 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7086000000000003e-05 2024-04-26T12:07:04.212 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.212 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.212 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:04.212 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579261+0000", 2024-04-26T12:07:04.212 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050948310000000002 2024-04-26T12:07:04.212 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.212 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.212 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:04.212 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579316+0000", 2024-04-26T12:07:04.212 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5068000000000002e-05 2024-04-26T12:07:04.213 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.213 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.213 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:04.213 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579405+0000", 2024-04-26T12:07:04.213 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9251000000000003e-05 2024-04-26T12:07:04.213 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.213 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.213 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.213 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.213 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.213 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 430759~2035 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:04.213 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:04.213 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.6462208090000008, 2024-04-26T12:07:04.213 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055164950999999997, 2024-04-26T12:07:04.213 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.214 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.214 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.214 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.214 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.214 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:04.214 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.214 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.214 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.214 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.214 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:04.214 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.214 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.214 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.214 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.215 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:04.215 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.215 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.215 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.215 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.215 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524368+0000", 2024-04-26T12:07:04.215 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.57e-06 2024-04-26T12:07:04.215 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.215 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.215 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.215 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524375+0000", 2024-04-26T12:07:04.215 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6170000000000003e-06 2024-04-26T12:07:04.215 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.215 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.216 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.216 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524380+0000", 2024-04-26T12:07:04.216 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2700000000000004e-06 2024-04-26T12:07:04.216 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.216 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.216 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.216 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574639+0000", 2024-04-26T12:07:04.216 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050259459999999999 2024-04-26T12:07:04.216 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.216 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.216 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.216 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574687+0000", 2024-04-26T12:07:04.216 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7608999999999998e-05 2024-04-26T12:07:04.216 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.216 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.217 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:04.217 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579414+0000", 2024-04-26T12:07:04.217 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047268750000000002 2024-04-26T12:07:04.217 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.217 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.217 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:04.217 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579456+0000", 2024-04-26T12:07:04.217 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1885000000000003e-05 2024-04-26T12:07:04.217 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.217 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.217 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:04.217 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579531+0000", 2024-04-26T12:07:04.217 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5053000000000001e-05 2024-04-26T12:07:04.217 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.217 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.218 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.218 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.218 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.218 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 432794~10523 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:04.218 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:04.218 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.6452300849999997, 2024-04-26T12:07:04.218 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054314727, 2024-04-26T12:07:04.218 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.218 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.218 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.218 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.218 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.218 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:04.218 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.218 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.219 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.219 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.219 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:04.219 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.219 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.219 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.219 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.219 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525356+0000", 2024-04-26T12:07:04.219 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.219 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.219 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.219 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.219 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525414+0000", 2024-04-26T12:07:04.219 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8148e-05 2024-04-26T12:07:04.219 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.220 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.220 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.220 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525423+0000", 2024-04-26T12:07:04.220 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9749999999999996e-06 2024-04-26T12:07:04.220 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.220 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.220 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.220 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525428+0000", 2024-04-26T12:07:04.220 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0270000000000003e-06 2024-04-26T12:07:04.220 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.220 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.220 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.220 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574950+0000", 2024-04-26T12:07:04.220 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049521840999999997 2024-04-26T12:07:04.221 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.221 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.221 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.221 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575002+0000", 2024-04-26T12:07:04.221 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1586999999999999e-05 2024-04-26T12:07:04.221 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.221 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.221 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:04.221 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579543+0000", 2024-04-26T12:07:04.221 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045416340000000001 2024-04-26T12:07:04.221 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.221 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.221 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:04.221 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579587+0000", 2024-04-26T12:07:04.221 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3875999999999998e-05 2024-04-26T12:07:04.222 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.222 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.222 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:04.222 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579671+0000", 2024-04-26T12:07:04.222 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4351999999999995e-05 2024-04-26T12:07:04.222 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.222 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.222 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.222 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.222 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.222 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 443317~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:04.222 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:04.222 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.64515411, 2024-04-26T12:07:04.222 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054381889000000003, 2024-04-26T12:07:04.223 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.223 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.223 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.223 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.223 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.223 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:04.223 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.223 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.223 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.223 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.223 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:04.223 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.223 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.223 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.223 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.223 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525432+0000", 2024-04-26T12:07:04.224 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.224 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.224 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.224 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.224 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525435+0000", 2024-04-26T12:07:04.224 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3070000000000001e-06 2024-04-26T12:07:04.224 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.224 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.224 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.224 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525439+0000", 2024-04-26T12:07:04.224 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.104e-06 2024-04-26T12:07:04.224 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.224 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.224 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.224 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525442+0000", 2024-04-26T12:07:04.225 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0460000000000001e-06 2024-04-26T12:07:04.225 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.225 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.225 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.225 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575405+0000", 2024-04-26T12:07:04.225 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049963059999999997 2024-04-26T12:07:04.225 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.225 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.225 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.225 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575450+0000", 2024-04-26T12:07:04.225 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5034000000000003e-05 2024-04-26T12:07:04.225 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.225 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.225 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:04.225 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579680+0000", 2024-04-26T12:07:04.226 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042302260000000001 2024-04-26T12:07:04.226 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.226 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.226 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:04.226 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579737+0000", 2024-04-26T12:07:04.226 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7241000000000003e-05 2024-04-26T12:07:04.226 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.226 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.226 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:04.226 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579815+0000", 2024-04-26T12:07:04.226 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7278000000000001e-05 2024-04-26T12:07:04.226 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.226 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.226 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.227 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.227 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.227 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 445275~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:04.227 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:04.227 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.6447269339999995, 2024-04-26T12:07:04.227 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054094668999999998, 2024-04-26T12:07:04.227 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.227 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.227 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.227 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.227 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.227 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:04.227 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.227 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.227 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.228 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.228 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:04.228 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.228 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.228 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.228 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.228 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525859+0000", 2024-04-26T12:07:04.228 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.228 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.228 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.228 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.228 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525864+0000", 2024-04-26T12:07:04.228 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:07:04.228 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.228 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.229 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.229 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525872+0000", 2024-04-26T12:07:04.229 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6790000000000005e-06 2024-04-26T12:07:04.229 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.229 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.229 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.229 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525877+0000", 2024-04-26T12:07:04.229 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0529999999999997e-06 2024-04-26T12:07:04.229 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.229 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.229 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.229 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575723+0000", 2024-04-26T12:07:04.229 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049846469999999997 2024-04-26T12:07:04.229 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.229 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.229 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.230 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575770+0000", 2024-04-26T12:07:04.230 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6387999999999997e-05 2024-04-26T12:07:04.230 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.230 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.230 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:04.230 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579823+0000", 2024-04-26T12:07:04.230 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0040534189999999999 2024-04-26T12:07:04.230 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.230 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.230 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:04.230 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579869+0000", 2024-04-26T12:07:04.230 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6218999999999999e-05 2024-04-26T12:07:04.230 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.230 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.231 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:04.231 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579954+0000", 2024-04-26T12:07:04.231 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5315999999999994e-05 2024-04-26T12:07:04.231 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.231 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.231 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.231 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.231 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.231 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:551 3.2 3:4272d415:::200.0000000b:head [write 448232~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:04.231 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:04.231 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.6442794999999997, 2024-04-26T12:07:04.231 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053798273000000001, 2024-04-26T12:07:04.231 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.231 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.231 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.231 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.232 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.232 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:04.232 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.232 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.232 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.232 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.232 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:04.232 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.232 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.232 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.232 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.232 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:04.232 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.232 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.232 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.233 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.233 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526310+0000", 2024-04-26T12:07:04.233 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5279999999999999e-06 2024-04-26T12:07:04.233 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.233 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.233 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.233 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526317+0000", 2024-04-26T12:07:04.233 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8430000000000004e-06 2024-04-26T12:07:04.233 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.233 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.233 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.233 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526322+0000", 2024-04-26T12:07:04.233 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3340000000000001e-06 2024-04-26T12:07:04.233 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.233 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.234 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.234 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576135+0000", 2024-04-26T12:07:04.234 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049812113999999998 2024-04-26T12:07:04.234 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.234 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.234 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.234 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576186+0000", 2024-04-26T12:07:04.234 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1443999999999997e-05 2024-04-26T12:07:04.234 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.234 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.234 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:04.234 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579962+0000", 2024-04-26T12:07:04.234 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037763359999999999 2024-04-26T12:07:04.234 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.234 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.235 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:04.235 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580016+0000", 2024-04-26T12:07:04.235 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3421000000000002e-05 2024-04-26T12:07:04.235 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.235 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.235 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:04.235 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580106+0000", 2024-04-26T12:07:04.235 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9790000000000006e-05 2024-04-26T12:07:04.235 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.235 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.235 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.235 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.235 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.235 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 450189~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:04.236 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:04.236 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.6441993709999991, 2024-04-26T12:07:04.236 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055070796999999998, 2024-04-26T12:07:04.236 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.236 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.236 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.236 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.236 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.236 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:04.236 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.236 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.236 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.236 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.236 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:04.236 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.236 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.237 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.237 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.237 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:04.237 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.237 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.237 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.237 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.237 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526390+0000", 2024-04-26T12:07:04.237 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8559999999999998e-06 2024-04-26T12:07:04.237 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.237 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.237 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.237 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526395+0000", 2024-04-26T12:07:04.237 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3319999999999999e-06 2024-04-26T12:07:04.238 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.238 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.238 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.238 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526399+0000", 2024-04-26T12:07:04.238 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.619e-06 2024-04-26T12:07:04.238 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.238 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.238 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.238 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576476+0000", 2024-04-26T12:07:04.238 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050077643999999998 2024-04-26T12:07:04.238 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.238 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.238 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.238 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576524+0000", 2024-04-26T12:07:04.238 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7184000000000001e-05 2024-04-26T12:07:04.239 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.239 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.239 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:04.239 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581347+0000", 2024-04-26T12:07:04.239 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0048231919999999996 2024-04-26T12:07:04.239 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.239 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.239 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:04.239 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581398+0000", 2024-04-26T12:07:04.239 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1345999999999999e-05 2024-04-26T12:07:04.239 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.239 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.239 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:04.239 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581458+0000", 2024-04-26T12:07:04.239 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0081000000000003e-05 2024-04-26T12:07:04.240 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.240 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.240 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.240 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.240 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.240 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 452113~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:04.240 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:04.240 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.6440881550000004, 2024-04-26T12:07:04.240 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055041448, 2024-04-26T12:07:04.240 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.240 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.240 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.240 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.240 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.240 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:04.240 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.241 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.241 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.241 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.241 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:04.241 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.241 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.241 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.241 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.241 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526498+0000", 2024-04-26T12:07:04.241 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.241 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.241 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.241 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.241 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526540+0000", 2024-04-26T12:07:04.241 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2267e-05 2024-04-26T12:07:04.242 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.242 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.242 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.242 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526547+0000", 2024-04-26T12:07:04.242 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7000000000000002e-06 2024-04-26T12:07:04.242 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.242 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.242 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.242 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526550+0000", 2024-04-26T12:07:04.242 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0299999999999998e-06 2024-04-26T12:07:04.242 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.242 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.242 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.242 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577902+0000", 2024-04-26T12:07:04.242 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051351648999999999 2024-04-26T12:07:04.243 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.243 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.243 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.243 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577953+0000", 2024-04-26T12:07:04.243 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1289000000000003e-05 2024-04-26T12:07:04.243 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.243 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.243 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:04.243 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581464+0000", 2024-04-26T12:07:04.243 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035111259999999998 2024-04-26T12:07:04.243 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.243 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.243 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:04.243 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581490+0000", 2024-04-26T12:07:04.243 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5717000000000001e-05 2024-04-26T12:07:04.244 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.244 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.244 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:04.244 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581540+0000", 2024-04-26T12:07:04.244 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0287999999999997e-05 2024-04-26T12:07:04.244 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.244 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.244 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.244 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.244 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.244 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 454070~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:04.244 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:04.244 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.6435312060000005, 2024-04-26T12:07:04.244 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054564161, 2024-04-26T12:07:04.244 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.245 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.245 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.245 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.245 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.245 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:04.245 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.245 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.245 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.245 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.245 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:04.245 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.245 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.245 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.245 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.245 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527055+0000", 2024-04-26T12:07:04.246 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.246 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.246 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.246 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.246 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527058+0000", 2024-04-26T12:07:04.246 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9890000000000001e-06 2024-04-26T12:07:04.246 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.246 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.246 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.246 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527066+0000", 2024-04-26T12:07:04.246 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4730000000000003e-06 2024-04-26T12:07:04.246 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.246 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.246 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.246 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527069+0000", 2024-04-26T12:07:04.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5810000000000001e-06 2024-04-26T12:07:04.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.247 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578308+0000", 2024-04-26T12:07:04.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051238911999999998 2024-04-26T12:07:04.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.247 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578391+0000", 2024-04-26T12:07:04.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2713999999999994e-05 2024-04-26T12:07:04.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.247 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:04.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581548+0000", 2024-04-26T12:07:04.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031577530000000001 2024-04-26T12:07:04.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:04.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581574+0000", 2024-04-26T12:07:04.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5350999999999998e-05 2024-04-26T12:07:04.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:04.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581620+0000", 2024-04-26T12:07:04.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5868999999999997e-05 2024-04-26T12:07:04.248 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.248 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.248 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.249 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 456028~3870 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:04.249 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:04.249 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.6417749639999997, 2024-04-26T12:07:04.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055118997000000003, 2024-04-26T12:07:04.249 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.249 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.249 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.249 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.249 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:04.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.249 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.249 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.250 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:04.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.250 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.250 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528811+0000", 2024-04-26T12:07:04.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:04.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.250 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.250 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528887+0000", 2024-04-26T12:07:04.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5977999999999997e-05 2024-04-26T12:07:04.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528897+0000", 2024-04-26T12:07:04.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8730000000000002e-06 2024-04-26T12:07:04.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528901+0000", 2024-04-26T12:07:04.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4880000000000001e-06 2024-04-26T12:07:04.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580146+0000", 2024-04-26T12:07:04.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051244242000000002 2024-04-26T12:07:04.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.252 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.252 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580227+0000", 2024-04-26T12:07:04.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1044000000000005e-05 2024-04-26T12:07:04.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.252 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:04.252 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583864+0000", 2024-04-26T12:07:04.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036374419999999998 2024-04-26T12:07:04.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.252 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:04.252 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583894+0000", 2024-04-26T12:07:04.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9828999999999999e-05 2024-04-26T12:07:04.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.253 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:04.253 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583931+0000", 2024-04-26T12:07:04.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6908e-05 2024-04-26T12:07:04.253 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.253 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.253 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.253 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 459898~2037 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:04.253 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:04.253 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.6413869729999995, 2024-04-26T12:07:04.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055925713000000002, 2024-04-26T12:07:04.253 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.253 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.253 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:04.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:04.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529199+0000", 2024-04-26T12:07:04.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529203+0000", 2024-04-26T12:07:04.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:07:04.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529209+0000", 2024-04-26T12:07:04.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7939999999999999e-06 2024-04-26T12:07:04.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529212+0000", 2024-04-26T12:07:04.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7290000000000002e-06 2024-04-26T12:07:04.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580784+0000", 2024-04-26T12:07:04.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051572073000000003 2024-04-26T12:07:04.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580883+0000", 2024-04-26T12:07:04.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8330000000000002e-05 2024-04-26T12:07:04.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:04.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585050+0000", 2024-04-26T12:07:04.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041670209999999999 2024-04-26T12:07:04.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:04.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585088+0000", 2024-04-26T12:07:04.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8559999999999997e-05 2024-04-26T12:07:04.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:04.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585125+0000", 2024-04-26T12:07:04.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7197999999999999e-05 2024-04-26T12:07:04.257 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.257 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.257 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.258 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 461935~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:04.258 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:04.258 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.6406645189999995, 2024-04-26T12:07:04.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055266150999999999, 2024-04-26T12:07:04.258 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.258 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.259 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:04.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:04.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529921+0000", 2024-04-26T12:07:04.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:04.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529956+0000", 2024-04-26T12:07:04.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4687000000000002e-05 2024-04-26T12:07:04.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529966+0000", 2024-04-26T12:07:04.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0392e-05 2024-04-26T12:07:04.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529978+0000", 2024-04-26T12:07:04.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1348e-05 2024-04-26T12:07:04.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581659+0000", 2024-04-26T12:07:04.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051681454000000002 2024-04-26T12:07:04.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581746+0000", 2024-04-26T12:07:04.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6305999999999997e-05 2024-04-26T12:07:04.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:04.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585131+0000", 2024-04-26T12:07:04.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033853199999999998 2024-04-26T12:07:04.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:04.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585154+0000", 2024-04-26T12:07:04.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3258999999999999e-05 2024-04-26T12:07:04.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:04.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585188+0000", 2024-04-26T12:07:04.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4236000000000002e-05 2024-04-26T12:07:04.262 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.262 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.262 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.263 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.263 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.263 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:04.264 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:07:04.265 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:04.263+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:04.365 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:04.364+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:04.366 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:04.366 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:04.367 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:07:04.367 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:04.375 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:04.466 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:04.465+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:04.524 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:04.524 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:04.525 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:07:04.525 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:07:04.525 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:04.534 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:04.560 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:07:04.575 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:04.574+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:04.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~47s 2024-04-26T12:07:04.669 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:04.668+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:04.679 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:04.679 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:07:04.680 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:07:04.680 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:07:04.680 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.680 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2989 3.d 3:b02ffd62:::200.00000010:head [write 3767903~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:04.680 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:04.680 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 5.1612929550000004, 2024-04-26T12:07:04.680 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057069768999999999, 2024-04-26T12:07:04.680 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:04.680 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.680 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:04.680 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.680 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:04.681 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:04.681 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.681 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.681 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.681 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:04.681 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:04.681 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.681 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.681 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.681 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:04.681 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:04.681 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:04.682 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.682 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.682 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:04.682 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516446+0000", 2024-04-26T12:07:04.682 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6469999999999997e-06 2024-04-26T12:07:04.682 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.682 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.682 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:04.682 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516449+0000", 2024-04-26T12:07:04.682 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.976e-06 2024-04-26T12:07:04.682 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.682 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.683 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.683 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516452+0000", 2024-04-26T12:07:04.683 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.509e-06 2024-04-26T12:07:04.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.683 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:04.683 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.568562+0000", 2024-04-26T12:07:04.683 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.052110030000000002 2024-04-26T12:07:04.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.683 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:04.683 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.568615+0000", 2024-04-26T12:07:04.683 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2809999999999998e-05 2024-04-26T12:07:04.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.684 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.684 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:04.684 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573425+0000", 2024-04-26T12:07:04.684 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048105149999999996 2024-04-26T12:07:04.684 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.684 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.684 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:04.684 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573452+0000", 2024-04-26T12:07:04.684 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6778e-05 2024-04-26T12:07:04.684 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.684 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.684 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:04.684 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573512+0000", 2024-04-26T12:07:04.685 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9710000000000003e-05 2024-04-26T12:07:04.685 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.685 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:04.685 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.685 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.685 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.685 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2990 3.d 3:b02ffd62:::200.00000010:head [write 3769302~4483 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:04.685 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:04.685 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 5.1612809559999997, 2024-04-26T12:07:04.685 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057131345, 2024-04-26T12:07:04.685 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:04.685 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.685 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:04.685 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.686 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:04.686 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:04.686 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.686 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.686 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.686 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:04.686 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:04.686 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.686 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.686 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.686 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:04.686 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:04.686 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:04.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.687 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.687 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:04.687 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516459+0000", 2024-04-26T12:07:04.687 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2859999999999999e-06 2024-04-26T12:07:04.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.687 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.687 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:04.687 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516462+0000", 2024-04-26T12:07:04.687 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0790000000000001e-06 2024-04-26T12:07:04.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.687 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.688 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.688 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516465+0000", 2024-04-26T12:07:04.688 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.464e-06 2024-04-26T12:07:04.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.688 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.688 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:04.688 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569035+0000", 2024-04-26T12:07:04.688 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.052570328999999999 2024-04-26T12:07:04.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.688 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.688 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:04.688 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569113+0000", 2024-04-26T12:07:04.688 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8118e-05 2024-04-26T12:07:04.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.689 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.689 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:04.689 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573517+0000", 2024-04-26T12:07:04.689 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044039200000000004 2024-04-26T12:07:04.689 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.689 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.689 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:04.689 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573541+0000", 2024-04-26T12:07:04.689 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3805999999999999e-05 2024-04-26T12:07:04.689 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.689 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.689 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:04.689 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573585+0000", 2024-04-26T12:07:04.689 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4567000000000002e-05 2024-04-26T12:07:04.690 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.690 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:04.690 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.690 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.690 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2991 3.d 3:b02ffd62:::200.00000010:head [write 3773785~4213 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:04.690 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:04.690 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 5.1612682669999996, 2024-04-26T12:07:04.690 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057230554000000003, 2024-04-26T12:07:04.690 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:04.690 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.690 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:04.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.691 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:04.691 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:04.691 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.691 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.691 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.691 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:04.691 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:04.691 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.691 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.691 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.691 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:04.691 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516466+0000", 2024-04-26T12:07:04.691 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.692 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.692 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.692 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:04.692 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516470+0000", 2024-04-26T12:07:04.692 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7960000000000002e-06 2024-04-26T12:07:04.692 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.692 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.692 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:04.692 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516478+0000", 2024-04-26T12:07:04.692 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:07:04.692 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.692 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.693 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.693 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516484+0000", 2024-04-26T12:07:04.693 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5300000000000002e-06 2024-04-26T12:07:04.693 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.693 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.693 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:04.693 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569662+0000", 2024-04-26T12:07:04.693 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053177896000000002 2024-04-26T12:07:04.693 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.693 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.693 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:04.693 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569749+0000", 2024-04-26T12:07:04.694 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7229000000000001e-05 2024-04-26T12:07:04.694 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.694 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.694 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:04.694 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573593+0000", 2024-04-26T12:07:04.694 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038433109999999999 2024-04-26T12:07:04.694 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.694 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.694 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:04.694 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573631+0000", 2024-04-26T12:07:04.694 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8615000000000002e-05 2024-04-26T12:07:04.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.695 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:04.695 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573697+0000", 2024-04-26T12:07:04.695 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5971999999999998e-05 2024-04-26T12:07:04.695 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.695 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:04.695 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.695 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2999 3.d 3:b02ffd62:::200.00000010:head [write 3797283~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:04.695 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:04.695 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 5.156753879, 2024-04-26T12:07:04.696 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057330949999999999, 2024-04-26T12:07:04.696 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:04.696 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.696 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:04.696 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.696 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:04.696 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:04.696 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.696 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.696 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.696 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:04.696 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:04.696 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.696 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.697 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.697 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:04.697 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520980+0000", 2024-04-26T12:07:04.697 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:04.697 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.697 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.697 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:04.697 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520991+0000", 2024-04-26T12:07:04.697 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1154e-05 2024-04-26T12:07:04.697 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.697 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.697 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:04.697 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521014+0000", 2024-04-26T12:07:04.698 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2288000000000001e-05 2024-04-26T12:07:04.698 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.698 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.698 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.698 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521019+0000", 2024-04-26T12:07:04.698 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0889999999999999e-06 2024-04-26T12:07:04.698 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.698 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.698 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:04.698 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.575399+0000", 2024-04-26T12:07:04.698 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054380392999999999 2024-04-26T12:07:04.698 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.698 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.698 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:04.699 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.575440+0000", 2024-04-26T12:07:04.699 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1146000000000002e-05 2024-04-26T12:07:04.699 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.699 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.699 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:04.699 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578237+0000", 2024-04-26T12:07:04.699 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002796761 2024-04-26T12:07:04.699 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.699 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.699 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:04.699 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578260+0000", 2024-04-26T12:07:04.699 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3538999999999999e-05 2024-04-26T12:07:04.699 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.699 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.699 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:04.700 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578312+0000", 2024-04-26T12:07:04.700 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1508999999999998e-05 2024-04-26T12:07:04.700 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.700 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:04.700 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.700 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.700 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.700 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3000 3.d 3:b02ffd62:::200.00000010:head [write 3801160~9028 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:04.700 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:04.700 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 5.1561279129999997, 2024-04-26T12:07:04.700 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.059231688999999997, 2024-04-26T12:07:04.700 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:04.700 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.700 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:04.701 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.701 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:04.701 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:04.701 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.701 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.701 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.701 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:04.701 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:04.701 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.701 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.701 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.701 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:04.701 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521606+0000", 2024-04-26T12:07:04.701 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:04.701 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.702 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.702 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:04.702 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521627+0000", 2024-04-26T12:07:04.702 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1129e-05 2024-04-26T12:07:04.702 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.702 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.702 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:04.702 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521637+0000", 2024-04-26T12:07:04.702 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8789999999999998e-06 2024-04-26T12:07:04.702 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.702 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.702 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.702 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521644+0000", 2024-04-26T12:07:04.702 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:07:04.703 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.703 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.703 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:04.703 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576381+0000", 2024-04-26T12:07:04.703 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.05473629 2024-04-26T12:07:04.703 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.703 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.703 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:04.703 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576451+0000", 2024-04-26T12:07:04.703 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0525000000000007e-05 2024-04-26T12:07:04.703 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.703 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.703 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:04.703 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580734+0000", 2024-04-26T12:07:04.704 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042826699999999997 2024-04-26T12:07:04.704 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.704 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.704 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:04.704 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580780+0000", 2024-04-26T12:07:04.704 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6006e-05 2024-04-26T12:07:04.704 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.704 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.704 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:04.704 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580839+0000", 2024-04-26T12:07:04.704 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8783000000000003e-05 2024-04-26T12:07:04.704 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.704 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:04.705 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.705 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.705 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.705 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3001 3.d 3:b02ffd62:::200.00000010:head [write 3810188~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:04.705 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:04.705 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 5.1555755809999999, 2024-04-26T12:07:04.705 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.060161213999999998, 2024-04-26T12:07:04.705 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:04.705 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.705 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:04.705 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.705 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:04.706 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:04.706 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.706 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.706 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.706 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:04.706 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:04.706 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.706 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.706 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.706 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:04.706 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522158+0000", 2024-04-26T12:07:04.706 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:04.706 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.707 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:04.707 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522165+0000", 2024-04-26T12:07:04.707 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.28e-06 2024-04-26T12:07:04.707 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.707 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:04.707 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522178+0000", 2024-04-26T12:07:04.707 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3738e-05 2024-04-26T12:07:04.707 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.708 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.708 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522186+0000", 2024-04-26T12:07:04.708 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.267e-06 2024-04-26T12:07:04.708 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.708 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.708 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:04.708 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576889+0000", 2024-04-26T12:07:04.708 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054703442999999997 2024-04-26T12:07:04.708 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.708 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.708 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:04.708 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576953+0000", 2024-04-26T12:07:04.708 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4213000000000003e-05 2024-04-26T12:07:04.708 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.709 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.709 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:04.709 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582185+0000", 2024-04-26T12:07:04.709 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052319209999999996 2024-04-26T12:07:04.709 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.709 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.709 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:04.709 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582243+0000", 2024-04-26T12:07:04.709 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7321999999999998e-05 2024-04-26T12:07:04.709 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.709 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.709 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:04.709 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582321+0000", 2024-04-26T12:07:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7911000000000007e-05 2024-04-26T12:07:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3002 3.d 3:b02ffd62:::200.00000010:head [write 3812103~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 5.1551068180000001, 2024-04-26T12:07:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.059796961000000003, 2024-04-26T12:07:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522627+0000", 2024-04-26T12:07:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522633+0000", 2024-04-26T12:07:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6699999999999999e-06 2024-04-26T12:07:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522643+0000", 2024-04-26T12:07:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6649999999999998e-06 2024-04-26T12:07:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522649+0000", 2024-04-26T12:07:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4200000000000004e-06 2024-04-26T12:07:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577413+0000", 2024-04-26T12:07:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054763714999999998 2024-04-26T12:07:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577460+0000", 2024-04-26T12:07:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7095000000000002e-05 2024-04-26T12:07:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582331+0000", 2024-04-26T12:07:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048716419999999998 2024-04-26T12:07:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582375+0000", 2024-04-26T12:07:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3053999999999998e-05 2024-04-26T12:07:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582425+0000", 2024-04-26T12:07:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0525000000000002e-05 2024-04-26T12:07:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3003 3.d 3:b02ffd62:::200.00000010:head [write 3814061~4170 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 5.1540517560000003, 2024-04-26T12:07:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058803394000000002, 2024-04-26T12:07:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523682+0000", 2024-04-26T12:07:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523690+0000", 2024-04-26T12:07:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0290000000000005e-06 2024-04-26T12:07:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523699+0000", 2024-04-26T12:07:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4589999999999998e-06 2024-04-26T12:07:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523703+0000", 2024-04-26T12:07:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6249999999999998e-06 2024-04-26T12:07:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577832+0000", 2024-04-26T12:07:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054128883000000003 2024-04-26T12:07:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577878+0000", 2024-04-26T12:07:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5841999999999999e-05 2024-04-26T12:07:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582430+0000", 2024-04-26T12:07:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045517270000000002 2024-04-26T12:07:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582453+0000", 2024-04-26T12:07:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3609999999999999e-05 2024-04-26T12:07:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582487+0000", 2024-04-26T12:07:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3080000000000002e-05 2024-04-26T12:07:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3004 3.d 3:b02ffd62:::200.00000010:head [write 3818231~3890 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 5.1532028329999999, 2024-04-26T12:07:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058024342999999999, 2024-04-26T12:07:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524531+0000", 2024-04-26T12:07:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524539+0000", 2024-04-26T12:07:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9249999999999995e-06 2024-04-26T12:07:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524547+0000", 2024-04-26T12:07:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5220000000000007e-06 2024-04-26T12:07:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524553+0000", 2024-04-26T12:07:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6659999999999996e-06 2024-04-26T12:07:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578335+0000", 2024-04-26T12:07:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.05378235 2024-04-26T12:07:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578378+0000", 2024-04-26T12:07:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2429999999999999e-05 2024-04-26T12:07:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582494+0000", 2024-04-26T12:07:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004116059 2024-04-26T12:07:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582519+0000", 2024-04-26T12:07:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4961999999999999e-05 2024-04-26T12:07:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582556+0000", 2024-04-26T12:07:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7728999999999997e-05 2024-04-26T12:07:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3005 3.d 3:b02ffd62:::200.00000010:head [write 3822121~5207 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 5.1527835770000001, 2024-04-26T12:07:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057662270000000002, 2024-04-26T12:07:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:04.726 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:04.726 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.726 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.726 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.726 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:04.726 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:04.726 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.726 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.726 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.726 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524961+0000", 2024-04-26T12:07:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0124e-05 2024-04-26T12:07:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524971+0000", 2024-04-26T12:07:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0200999999999999e-05 2024-04-26T12:07:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524979+0000", 2024-04-26T12:07:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5809999999999999e-06 2024-04-26T12:07:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578753+0000", 2024-04-26T12:07:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053774444999999997 2024-04-26T12:07:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578821+0000", 2024-04-26T12:07:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7640999999999998e-05 2024-04-26T12:07:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582561+0000", 2024-04-26T12:07:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037399870000000002 2024-04-26T12:07:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582582+0000", 2024-04-26T12:07:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0934999999999999e-05 2024-04-26T12:07:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582614+0000", 2024-04-26T12:07:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1948e-05 2024-04-26T12:07:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3006 3.d 3:b02ffd62:::200.00000010:head [write 3827328~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 5.1521502379999999, 2024-04-26T12:07:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057085404999999999, 2024-04-26T12:07:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525583+0000", 2024-04-26T12:07:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525594+0000", 2024-04-26T12:07:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0497e-05 2024-04-26T12:07:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525610+0000", 2024-04-26T12:07:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6392000000000002e-05 2024-04-26T12:07:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525621+0000", 2024-04-26T12:07:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0679999999999999e-05 2024-04-26T12:07:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.579270+0000", 2024-04-26T12:07:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053648802000000002 2024-04-26T12:07:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.579312+0000", 2024-04-26T12:07:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2268000000000003e-05 2024-04-26T12:07:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582618+0000", 2024-04-26T12:07:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033057049999999999 2024-04-26T12:07:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582637+0000", 2024-04-26T12:07:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9417000000000001e-05 2024-04-26T12:07:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582670+0000", 2024-04-26T12:07:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2969999999999998e-05 2024-04-26T12:07:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3015 3.d 3:b02ffd62:::200.00000010:head [write 3855113~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 5.141694481, 2024-04-26T12:07:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057652729999999999, 2024-04-26T12:07:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536042+0000", 2024-04-26T12:07:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0849999999999999e-06 2024-04-26T12:07:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536046+0000", 2024-04-26T12:07:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:07:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536048+0000", 2024-04-26T12:07:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6019999999999998e-06 2024-04-26T12:07:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585409+0000", 2024-04-26T12:07:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.049360938 2024-04-26T12:07:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585506+0000", 2024-04-26T12:07:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6966999999999995e-05 2024-04-26T12:07:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593630+0000", 2024-04-26T12:07:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0081238160000000007 2024-04-26T12:07:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593656+0000", 2024-04-26T12:07:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6154000000000001e-05 2024-04-26T12:07:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593693+0000", 2024-04-26T12:07:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7185999999999999e-05 2024-04-26T12:07:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3016 3.d 3:b02ffd62:::200.00000010:head [write 3857020~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 5.1416845340000004, 2024-04-26T12:07:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058678157000000002, 2024-04-26T12:07:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536055+0000", 2024-04-26T12:07:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3669999999999999e-06 2024-04-26T12:07:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536058+0000", 2024-04-26T12:07:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3220000000000001e-06 2024-04-26T12:07:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536062+0000", 2024-04-26T12:07:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1520000000000002e-06 2024-04-26T12:07:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585965+0000", 2024-04-26T12:07:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.049902769999999999 2024-04-26T12:07:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586046+0000", 2024-04-26T12:07:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1032999999999995e-05 2024-04-26T12:07:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594667+0000", 2024-04-26T12:07:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0086214599999999992 2024-04-26T12:07:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594692+0000", 2024-04-26T12:07:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5191999999999999e-05 2024-04-26T12:07:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594729+0000", 2024-04-26T12:07:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6069000000000003e-05 2024-04-26T12:07:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3017 3.d 3:b02ffd62:::200.00000010:head [write 3859438~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 5.1416704500000003, 2024-04-26T12:07:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058723814999999999, 2024-04-26T12:07:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536066+0000", 2024-04-26T12:07:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8840000000000001e-06 2024-04-26T12:07:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536069+0000", 2024-04-26T12:07:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:07:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536072+0000", 2024-04-26T12:07:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4449999999999999e-06 2024-04-26T12:07:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586703+0000", 2024-04-26T12:07:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050631618000000003 2024-04-26T12:07:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586748+0000", 2024-04-26T12:07:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4682999999999999e-05 2024-04-26T12:07:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594734+0000", 2024-04-26T12:07:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079860369999999996 2024-04-26T12:07:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594756+0000", 2024-04-26T12:07:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1738000000000001e-05 2024-04-26T12:07:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594788+0000", 2024-04-26T12:07:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2604999999999997e-05 2024-04-26T12:07:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3018 3.d 3:b02ffd62:::200.00000010:head [write 3861345~3221 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 5.1408377630000004, 2024-04-26T12:07:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057946174000000003, 2024-04-26T12:07:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:04.750 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:04.750 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.750 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.750 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.750 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:04.750 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536896+0000", 2024-04-26T12:07:04.750 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:04.750 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.750 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.750 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:04.750 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536905+0000", 2024-04-26T12:07:04.750 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7839999999999998e-06 2024-04-26T12:07:04.750 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.750 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536929+0000", 2024-04-26T12:07:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3561999999999999e-05 2024-04-26T12:07:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536940+0000", 2024-04-26T12:07:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0742e-05 2024-04-26T12:07:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.587238+0000", 2024-04-26T12:07:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050297962000000002 2024-04-26T12:07:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.587315+0000", 2024-04-26T12:07:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7848000000000004e-05 2024-04-26T12:07:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594792+0000", 2024-04-26T12:07:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074766240000000003 2024-04-26T12:07:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594813+0000", 2024-04-26T12:07:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0876000000000001e-05 2024-04-26T12:07:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594843+0000", 2024-04-26T12:07:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0434999999999999e-05 2024-04-26T12:07:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3019 3.d 3:b02ffd62:::200.00000010:head [write 3864566~3989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 5.1390954029999998, 2024-04-26T12:07:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.061000094999999997, 2024-04-26T12:07:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.755 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:04.755 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538638+0000", 2024-04-26T12:07:04.755 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999981 2024-04-26T12:07:04.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.755 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.755 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:04.755 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538669+0000", 2024-04-26T12:07:04.755 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1689000000000001e-05 2024-04-26T12:07:04.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.755 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.755 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:04.755 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538703+0000", 2024-04-26T12:07:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3309000000000002e-05 2024-04-26T12:07:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538746+0000", 2024-04-26T12:07:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2803999999999999e-05 2024-04-26T12:07:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.589467+0000", 2024-04-26T12:07:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050721912000000001 2024-04-26T12:07:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.589517+0000", 2024-04-26T12:07:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9549999999999998e-05 2024-04-26T12:07:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599577+0000", 2024-04-26T12:07:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010059593 2024-04-26T12:07:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599603+0000", 2024-04-26T12:07:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6821e-05 2024-04-26T12:07:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599640+0000", 2024-04-26T12:07:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6177999999999998e-05 2024-04-26T12:07:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3020 3.d 3:b02ffd62:::200.00000010:head [write 3868555~7563 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 5.1364825679999999, 2024-04-26T12:07:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058446867, 2024-04-26T12:07:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541251+0000", 2024-04-26T12:07:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541286+0000", 2024-04-26T12:07:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4845999999999998e-05 2024-04-26T12:07:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541300+0000", 2024-04-26T12:07:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4251e-05 2024-04-26T12:07:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541307+0000", 2024-04-26T12:07:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3819999999999998e-06 2024-04-26T12:07:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.592596+0000", 2024-04-26T12:07:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051288215999999998 2024-04-26T12:07:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.762 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:04.762 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.592675+0000", 2024-04-26T12:07:04.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9197999999999996e-05 2024-04-26T12:07:04.762 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.762 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:04.762 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599645+0000", 2024-04-26T12:07:04.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069701759999999998 2024-04-26T12:07:04.762 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.762 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:04.762 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599667+0000", 2024-04-26T12:07:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2118999999999999e-05 2024-04-26T12:07:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599699+0000", 2024-04-26T12:07:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2048999999999998e-05 2024-04-26T12:07:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3021 3.d 3:b02ffd62:::200.00000010:head [write 3876118~3791 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 5.1364208309999997, 2024-04-26T12:07:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058441157000000001, 2024-04-26T12:07:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541323+0000", 2024-04-26T12:07:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5510000000000005e-06 2024-04-26T12:07:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541327+0000", 2024-04-26T12:07:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2520000000000001e-06 2024-04-26T12:07:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541330+0000", 2024-04-26T12:07:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:07:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593229+0000", 2024-04-26T12:07:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051898044999999997 2024-04-26T12:07:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593278+0000", 2024-04-26T12:07:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9506999999999999e-05 2024-04-26T12:07:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599704+0000", 2024-04-26T12:07:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064259570000000004 2024-04-26T12:07:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599725+0000", 2024-04-26T12:07:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0562999999999999e-05 2024-04-26T12:07:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599755+0000", 2024-04-26T12:07:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0710000000000002e-05 2024-04-26T12:07:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3022 3.d 3:b02ffd62:::200.00000010:head [write 3879909~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 5.1351717619999997, 2024-04-26T12:07:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057246689000000003, 2024-04-26T12:07:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542561+0000", 2024-04-26T12:07:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999981 2024-04-26T12:07:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542570+0000", 2024-04-26T12:07:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9199999999999993e-06 2024-04-26T12:07:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542583+0000", 2024-04-26T12:07:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2227e-05 2024-04-26T12:07:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542598+0000", 2024-04-26T12:07:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5199e-05 2024-04-26T12:07:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593728+0000", 2024-04-26T12:07:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051129846 2024-04-26T12:07:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593806+0000", 2024-04-26T12:07:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8425999999999998e-05 2024-04-26T12:07:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599760+0000", 2024-04-26T12:07:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0059537399999999999 2024-04-26T12:07:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599779+0000", 2024-04-26T12:07:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9619e-05 2024-04-26T12:07:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599810+0000", 2024-04-26T12:07:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0508999999999999e-05 2024-04-26T12:07:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3023 3.d 3:b02ffd62:::200.00000010:head [write 3881868~5748 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 5.1346999139999996, 2024-04-26T12:07:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.056829994000000002, 2024-04-26T12:07:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543034+0000", 2024-04-26T12:07:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543044+0000", 2024-04-26T12:07:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0444e-05 2024-04-26T12:07:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543055+0000", 2024-04-26T12:07:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.096e-05 2024-04-26T12:07:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543063+0000", 2024-04-26T12:07:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2689999999999999e-06 2024-04-26T12:07:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594265+0000", 2024-04-26T12:07:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051201325999999998 2024-04-26T12:07:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594311+0000", 2024-04-26T12:07:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5918000000000003e-05 2024-04-26T12:07:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599815+0000", 2024-04-26T12:07:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055038370000000001 2024-04-26T12:07:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599834+0000", 2024-04-26T12:07:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9942e-05 2024-04-26T12:07:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599865+0000", 2024-04-26T12:07:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0549000000000002e-05 2024-04-26T12:07:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:04.778 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:04.779 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:04.778+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:04.780 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:07:04.879 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:04.878+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:04.906 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:04.906 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:07:04.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.906 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:7830 4.2d 4:b407c00e:::100000015f9.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:07:04.906 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.901021+0000", 2024-04-26T12:07:04.906 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0022967270000000001, 2024-04-26T12:07:04.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0023183209999999999, 2024-04-26T12:07:04.906 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.906 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:07:04.906 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901021+0000", 2024-04-26T12:07:04.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901021+0000", 2024-04-26T12:07:04.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901020+0000", 2024-04-26T12:07:04.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901023+0000", 2024-04-26T12:07:04.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6599999999999999e-06 2024-04-26T12:07:04.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901029+0000", 2024-04-26T12:07:04.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7690000000000002e-06 2024-04-26T12:07:04.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901033+0000", 2024-04-26T12:07:04.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5539999999999999e-06 2024-04-26T12:07:04.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901068+0000", 2024-04-26T12:07:04.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4999999999999997e-05 2024-04-26T12:07:04.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901174+0000", 2024-04-26T12:07:04.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000105976 2024-04-26T12:07:04.909 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.909 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.909 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.910 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:7832 4.28 4:17b4432b:::100000015fb.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:07:04.910 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.901042+0000", 2024-04-26T12:07:04.910 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0022755499999999999, 2024-04-26T12:07:04.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0023625429999999999, 2024-04-26T12:07:04.910 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.910 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:07:04.910 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901042+0000", 2024-04-26T12:07:04.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901042+0000", 2024-04-26T12:07:04.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901042+0000", 2024-04-26T12:07:04.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901044+0000", 2024-04-26T12:07:04.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6649999999999999e-06 2024-04-26T12:07:04.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901051+0000", 2024-04-26T12:07:04.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7870000000000004e-06 2024-04-26T12:07:04.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901056+0000", 2024-04-26T12:07:04.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:07:04.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901600+0000", 2024-04-26T12:07:04.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00054396000000000002 2024-04-26T12:07:04.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901724+0000", 2024-04-26T12:07:04.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012395 2024-04-26T12:07:04.913 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.913 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.913 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.913 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:7836 4.b 4:d22b19ef:::100000015ff.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:07:04.913 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.901062+0000", 2024-04-26T12:07:04.913 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0022556529999999998, 2024-04-26T12:07:04.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002402052, 2024-04-26T12:07:04.913 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.913 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:07:04.913 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901062+0000", 2024-04-26T12:07:04.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901062+0000", 2024-04-26T12:07:04.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901061+0000", 2024-04-26T12:07:04.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901064+0000", 2024-04-26T12:07:04.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2850000000000001e-06 2024-04-26T12:07:04.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901068+0000", 2024-04-26T12:07:04.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3789999999999999e-06 2024-04-26T12:07:04.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901071+0000", 2024-04-26T12:07:04.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6749999999999998e-06 2024-04-26T12:07:04.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901101+0000", 2024-04-26T12:07:04.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0395999999999998e-05 2024-04-26T12:07:04.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901184+0000", 2024-04-26T12:07:04.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2355999999999996e-05 2024-04-26T12:07:04.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:07:04.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901266+0000", 2024-04-26T12:07:04.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2174000000000003e-05 2024-04-26T12:07:04.917 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.917 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.917 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.917 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:7837 3.18 3:1b3ce147:::10000001600.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:07:04.917 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.901079+0000", 2024-04-26T12:07:04.918 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0022386709999999998, 2024-04-26T12:07:04.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0024496489999999999, 2024-04-26T12:07:04.918 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.918 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:07:04.918 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901079+0000", 2024-04-26T12:07:04.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901079+0000", 2024-04-26T12:07:04.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901078+0000", 2024-04-26T12:07:04.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901081+0000", 2024-04-26T12:07:04.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2759999999999999e-06 2024-04-26T12:07:04.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901086+0000", 2024-04-26T12:07:04.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6529999999999999e-06 2024-04-26T12:07:04.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901091+0000", 2024-04-26T12:07:04.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:07:04.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901631+0000", 2024-04-26T12:07:04.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00053931400000000005 2024-04-26T12:07:04.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901743+0000", 2024-04-26T12:07:04.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112036 2024-04-26T12:07:04.921 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.921 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.921 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.921 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:7839 4.36 4:6e34b785:::10000001602.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:07:04.921 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.901101+0000", 2024-04-26T12:07:04.921 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0022166339999999999, 2024-04-26T12:07:04.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0024891969999999999, 2024-04-26T12:07:04.922 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.922 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:07:04.922 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901101+0000", 2024-04-26T12:07:04.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901101+0000", 2024-04-26T12:07:04.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901100+0000", 2024-04-26T12:07:04.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901103+0000", 2024-04-26T12:07:04.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0710000000000002e-06 2024-04-26T12:07:04.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901109+0000", 2024-04-26T12:07:04.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8920000000000003e-06 2024-04-26T12:07:04.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901114+0000", 2024-04-26T12:07:04.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7419999999999997e-06 2024-04-26T12:07:04.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901543+0000", 2024-04-26T12:07:04.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000428878 2024-04-26T12:07:04.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901610+0000", 2024-04-26T12:07:04.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7193999999999994e-05 2024-04-26T12:07:04.925 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.925 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.925 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.926 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:7840 4.6 4:61eec094:::10000001603.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:07:04.926 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.901118+0000", 2024-04-26T12:07:04.926 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0021990709999999999, 2024-04-26T12:07:04.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025303909999999999, 2024-04-26T12:07:04.926 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.926 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:07:04.926 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901118+0000", 2024-04-26T12:07:04.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901118+0000", 2024-04-26T12:07:04.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901118+0000", 2024-04-26T12:07:04.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901120+0000", 2024-04-26T12:07:04.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9099999999999999e-06 2024-04-26T12:07:04.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901126+0000", 2024-04-26T12:07:04.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0959999999999997e-06 2024-04-26T12:07:04.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901131+0000", 2024-04-26T12:07:04.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5820000000000003e-06 2024-04-26T12:07:04.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901720+0000", 2024-04-26T12:07:04.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00058880499999999997 2024-04-26T12:07:04.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901832+0000", 2024-04-26T12:07:04.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112489 2024-04-26T12:07:04.929 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.929 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.929 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.929 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:7822 4.39 e56/16 4:9e8eac4a:::10000001593.00000000:head v 56'256, mlcod=56'253)", 2024-04-26T12:07:04.929 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.901237+0000", 2024-04-26T12:07:04.929 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0020803940000000002, 2024-04-26T12:07:04.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0024692630000000002, 2024-04-26T12:07:04.930 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.930 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:07:04.930 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901237+0000", 2024-04-26T12:07:04.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901237+0000", 2024-04-26T12:07:04.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901237+0000", 2024-04-26T12:07:04.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901244+0000", 2024-04-26T12:07:04.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3880000000000002e-06 2024-04-26T12:07:04.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901252+0000", 2024-04-26T12:07:04.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2020000000000004e-06 2024-04-26T12:07:04.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901257+0000", 2024-04-26T12:07:04.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:07:04.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901648+0000", 2024-04-26T12:07:04.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00039045300000000002 2024-04-26T12:07:04.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901664+0000", 2024-04-26T12:07:04.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5628e-05 2024-04-26T12:07:04.933 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.933 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.933 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.933 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:7827 4.20 e56/16 4:0679f695:::100000015f6.00000000:head v 56'251, mlcod=56'248)", 2024-04-26T12:07:04.933 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.901633+0000", 2024-04-26T12:07:04.933 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0016844819999999999, 2024-04-26T12:07:04.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0021291560000000001, 2024-04-26T12:07:04.933 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.933 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:07:04.933 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901633+0000", 2024-04-26T12:07:04.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901633+0000", 2024-04-26T12:07:04.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901633+0000", 2024-04-26T12:07:04.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901637+0000", 2024-04-26T12:07:04.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5730000000000001e-06 2024-04-26T12:07:04.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901645+0000", 2024-04-26T12:07:04.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2460000000000003e-06 2024-04-26T12:07:04.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901651+0000", 2024-04-26T12:07:04.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6760000000000004e-06 2024-04-26T12:07:04.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902074+0000", 2024-04-26T12:07:04.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00042306100000000002 2024-04-26T12:07:04.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902091+0000", 2024-04-26T12:07:04.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7161000000000001e-05 2024-04-26T12:07:04.936 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.936 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.936 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.937 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:7833 4.a e56/16 4:5270ad0d:::100000015fc.00000000:head v 56'290, mlcod=56'288)", 2024-04-26T12:07:04.937 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.901661+0000", 2024-04-26T12:07:04.937 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0016562949999999999, 2024-04-26T12:07:04.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0021563939999999998, 2024-04-26T12:07:04.937 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.937 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:07:04.937 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901661+0000", 2024-04-26T12:07:04.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901661+0000", 2024-04-26T12:07:04.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901661+0000", 2024-04-26T12:07:04.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901664+0000", 2024-04-26T12:07:04.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1930000000000002e-06 2024-04-26T12:07:04.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901669+0000", 2024-04-26T12:07:04.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2639999999999999e-06 2024-04-26T12:07:04.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901673+0000", 2024-04-26T12:07:04.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:07:04.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901706+0000", 2024-04-26T12:07:04.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2877999999999999e-05 2024-04-26T12:07:04.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901724+0000", 2024-04-26T12:07:04.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7484000000000001e-05 2024-04-26T12:07:04.940 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.940 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.940 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.940 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:7842 4.1e 4:78935b64:::10000001605.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:07:04.940 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.901983+0000", 2024-04-26T12:07:04.940 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0013341659999999999, 2024-04-26T12:07:04.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018947930000000001, 2024-04-26T12:07:04.941 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.941 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:07:04.941 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901983+0000", 2024-04-26T12:07:04.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901983+0000", 2024-04-26T12:07:04.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901983+0000", 2024-04-26T12:07:04.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:04.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901987+0000", 2024-04-26T12:07:04.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3019999999999996e-06 2024-04-26T12:07:04.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902002+0000", 2024-04-26T12:07:04.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4949e-05 2024-04-26T12:07:04.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902008+0000", 2024-04-26T12:07:04.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4139999999999999e-06 2024-04-26T12:07:04.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902040+0000", 2024-04-26T12:07:04.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2063000000000001e-05 2024-04-26T12:07:04.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902137+0000", 2024-04-26T12:07:04.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7063000000000002e-05 2024-04-26T12:07:04.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:07:04.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902225+0000", 2024-04-26T12:07:04.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7268000000000005e-05 2024-04-26T12:07:04.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:07:04.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903867+0000", 2024-04-26T12:07:04.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016427080000000001 2024-04-26T12:07:04.944 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.944 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.944 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.945 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:7843 4.f 4:f20461f0:::10000001606.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:07:04.945 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.902017+0000", 2024-04-26T12:07:04.945 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.001300736, 2024-04-26T12:07:04.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001929521, 2024-04-26T12:07:04.945 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.945 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:07:04.945 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902017+0000", 2024-04-26T12:07:04.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902017+0000", 2024-04-26T12:07:04.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902016+0000", 2024-04-26T12:07:04.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902019+0000", 2024-04-26T12:07:04.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:07:04.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902026+0000", 2024-04-26T12:07:04.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1790000000000002e-06 2024-04-26T12:07:04.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902031+0000", 2024-04-26T12:07:04.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8720000000000001e-06 2024-04-26T12:07:04.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902063+0000", 2024-04-26T12:07:04.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2113000000000002e-05 2024-04-26T12:07:04.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902164+0000", 2024-04-26T12:07:04.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000101389 2024-04-26T12:07:04.948 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.948 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.948 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.948 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:7845 4.26 4:6732e159:::10000001630.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:07:04.948 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.902040+0000", 2024-04-26T12:07:04.948 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.001277367, 2024-04-26T12:07:04.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019380459999999999, 2024-04-26T12:07:04.948 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.949 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:07:04.949 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902040+0000", 2024-04-26T12:07:04.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902040+0000", 2024-04-26T12:07:04.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902040+0000", 2024-04-26T12:07:04.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902042+0000", 2024-04-26T12:07:04.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5050000000000002e-06 2024-04-26T12:07:04.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902049+0000", 2024-04-26T12:07:04.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0489999999999998e-06 2024-04-26T12:07:04.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902055+0000", 2024-04-26T12:07:04.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2879999999999998e-06 2024-04-26T12:07:04.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902254+0000", 2024-04-26T12:07:04.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00019898499999999999 2024-04-26T12:07:04.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902369+0000", 2024-04-26T12:07:04.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011438399999999999 2024-04-26T12:07:04.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:07:04.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902470+0000", 2024-04-26T12:07:04.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010088400000000001 2024-04-26T12:07:04.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:07:04.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903892+0000", 2024-04-26T12:07:04.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001421957 2024-04-26T12:07:04.952 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.952 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.952 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.952 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:7846 4.f 4:f0908b0b:::10000001631.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:07:04.953 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.902060+0000", 2024-04-26T12:07:04.953 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0012575290000000001, 2024-04-26T12:07:04.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001961637, 2024-04-26T12:07:04.953 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.953 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:07:04.953 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902060+0000", 2024-04-26T12:07:04.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902060+0000", 2024-04-26T12:07:04.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902059+0000", 2024-04-26T12:07:04.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902062+0000", 2024-04-26T12:07:04.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4490000000000002e-06 2024-04-26T12:07:04.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902068+0000", 2024-04-26T12:07:04.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8239999999999996e-06 2024-04-26T12:07:04.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902072+0000", 2024-04-26T12:07:04.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6190000000000002e-06 2024-04-26T12:07:04.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902505+0000", 2024-04-26T12:07:04.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00043232900000000001 2024-04-26T12:07:04.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902613+0000", 2024-04-26T12:07:04.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000108176 2024-04-26T12:07:04.956 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.956 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.956 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.956 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:7847 4.1e 4:795238fb:::10000001632.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:07:04.956 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.902080+0000", 2024-04-26T12:07:04.956 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.001237349, 2024-04-26T12:07:04.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019715499999999999, 2024-04-26T12:07:04.956 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.957 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:07:04.957 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902080+0000", 2024-04-26T12:07:04.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902080+0000", 2024-04-26T12:07:04.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902080+0000", 2024-04-26T12:07:04.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902082+0000", 2024-04-26T12:07:04.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1490000000000001e-06 2024-04-26T12:07:04.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902088+0000", 2024-04-26T12:07:04.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0959999999999997e-06 2024-04-26T12:07:04.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902093+0000", 2024-04-26T12:07:04.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7790000000000003e-06 2024-04-26T12:07:04.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902716+0000", 2024-04-26T12:07:04.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00062324500000000003 2024-04-26T12:07:04.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902817+0000", 2024-04-26T12:07:04.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010075 2024-04-26T12:07:04.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:07:04.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902904+0000", 2024-04-26T12:07:04.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7047999999999997e-05 2024-04-26T12:07:04.960 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.960 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.960 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.960 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:7848 4.14 4:2977f897:::10000001633.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:07:04.960 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.902122+0000", 2024-04-26T12:07:04.960 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0011952709999999999, 2024-04-26T12:07:04.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001965063, 2024-04-26T12:07:04.960 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.960 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:07:04.960 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902122+0000", 2024-04-26T12:07:04.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902122+0000", 2024-04-26T12:07:04.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902122+0000", 2024-04-26T12:07:04.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902125+0000", 2024-04-26T12:07:04.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0469999999999998e-06 2024-04-26T12:07:04.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902132+0000", 2024-04-26T12:07:04.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2629999999999997e-06 2024-04-26T12:07:04.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902137+0000", 2024-04-26T12:07:04.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1569999999999999e-06 2024-04-26T12:07:04.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902351+0000", 2024-04-26T12:07:04.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000214136 2024-04-26T12:07:04.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902488+0000", 2024-04-26T12:07:04.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000136694 2024-04-26T12:07:04.963 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.963 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.963 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.964 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:7841 4.30 e56/16 4:0e3dd0c4:::10000001604.00000000:head v 56'253, mlcod=56'251)", 2024-04-26T12:07:04.964 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.902157+0000", 2024-04-26T12:07:04.964 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0011608689999999999, 2024-04-26T12:07:04.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019646619999999998, 2024-04-26T12:07:04.964 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.964 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:07:04.964 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902157+0000", 2024-04-26T12:07:04.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902157+0000", 2024-04-26T12:07:04.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902156+0000", 2024-04-26T12:07:04.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902160+0000", 2024-04-26T12:07:04.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8010000000000001e-06 2024-04-26T12:07:04.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902166+0000", 2024-04-26T12:07:04.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3369999999999996e-06 2024-04-26T12:07:04.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902171+0000", 2024-04-26T12:07:04.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2339999999999996e-06 2024-04-26T12:07:04.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902205+0000", 2024-04-26T12:07:04.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4650999999999997e-05 2024-04-26T12:07:04.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902222+0000", 2024-04-26T12:07:04.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6354e-05 2024-04-26T12:07:04.967 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.967 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.967 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.967 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_update_log_missing(3.3 epoch 56/15 rep_tid 10803 entries 56'18 (0'0) error 3:c79f0c41:::1000000162f.00000000:head by mds.0.3:7844 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 56'16)", 2024-04-26T12:07:04.967 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.902178+0000", 2024-04-26T12:07:04.967 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0011393709999999999, 2024-04-26T12:07:04.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019771200000000002, 2024-04-26T12:07:04.967 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.968 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-04-26T12:07:04.968 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902178+0000", 2024-04-26T12:07:04.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902178+0000", 2024-04-26T12:07:04.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902178+0000", 2024-04-26T12:07:04.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967296 2024-04-26T12:07:04.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902183+0000", 2024-04-26T12:07:04.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7210000000000002e-06 2024-04-26T12:07:04.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902193+0000", 2024-04-26T12:07:04.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9979999999999998e-06 2024-04-26T12:07:04.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902201+0000", 2024-04-26T12:07:04.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9389999999999997e-06 2024-04-26T12:07:04.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902243+0000", 2024-04-26T12:07:04.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2697999999999997e-05 2024-04-26T12:07:04.970 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.970 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.970 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.970 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:7849 3.1a 3:5e792913:::10000001639.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:07:04.970 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.902467+0000", 2024-04-26T12:07:04.971 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.000850409, 2024-04-26T12:07:04.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001716228, 2024-04-26T12:07:04.971 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.971 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:07:04.971 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902467+0000", 2024-04-26T12:07:04.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902467+0000", 2024-04-26T12:07:04.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902466+0000", 2024-04-26T12:07:04.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:04.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902471+0000", 2024-04-26T12:07:04.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9320000000000004e-06 2024-04-26T12:07:04.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902480+0000", 2024-04-26T12:07:04.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2e-06 2024-04-26T12:07:04.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902487+0000", 2024-04-26T12:07:04.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2650000000000002e-06 2024-04-26T12:07:04.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902525+0000", 2024-04-26T12:07:04.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8145000000000002e-05 2024-04-26T12:07:04.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902631+0000", 2024-04-26T12:07:04.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010653 2024-04-26T12:07:04.974 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.974 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.974 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.974 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:7851 4.15 4:a9df9ef8:::1000000163b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:07:04.974 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.902496+0000", 2024-04-26T12:07:04.974 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00082153499999999997, 2024-04-26T12:07:04.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0017174239999999999, 2024-04-26T12:07:04.974 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.974 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:07:04.974 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902496+0000", 2024-04-26T12:07:04.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902496+0000", 2024-04-26T12:07:04.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902496+0000", 2024-04-26T12:07:04.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902498+0000", 2024-04-26T12:07:04.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8780000000000001e-06 2024-04-26T12:07:04.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902502+0000", 2024-04-26T12:07:04.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1010000000000002e-06 2024-04-26T12:07:04.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902505+0000", 2024-04-26T12:07:04.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.749e-06 2024-04-26T12:07:04.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902536+0000", 2024-04-26T12:07:04.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0227e-05 2024-04-26T12:07:04.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902634+0000", 2024-04-26T12:07:04.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8743e-05 2024-04-26T12:07:04.977 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.977 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.977 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.977 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:7853 4.12 4:4a0171f8:::1000000163d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:07:04.978 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.902512+0000", 2024-04-26T12:07:04.978 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00080572, 2024-04-26T12:07:04.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0017312689999999999, 2024-04-26T12:07:04.978 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.978 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:07:04.978 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902512+0000", 2024-04-26T12:07:04.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902512+0000", 2024-04-26T12:07:04.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902511+0000", 2024-04-26T12:07:04.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902513+0000", 2024-04-26T12:07:04.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0209999999999998e-06 2024-04-26T12:07:04.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902520+0000", 2024-04-26T12:07:04.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7750000000000004e-06 2024-04-26T12:07:04.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902525+0000", 2024-04-26T12:07:04.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7129999999999996e-06 2024-04-26T12:07:04.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902815+0000", 2024-04-26T12:07:04.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000290069 2024-04-26T12:07:04.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902910+0000", 2024-04-26T12:07:04.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5228000000000004e-05 2024-04-26T12:07:04.981 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.981 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.981 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.981 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:7857 4.14 4:2b9f4877:::10000001640.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:07:04.981 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.903005+0000", 2024-04-26T12:07:04.981 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00031293299999999999, 2024-04-26T12:07:04.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0012681999999999999, 2024-04-26T12:07:04.981 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.981 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:07:04.981 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903005+0000", 2024-04-26T12:07:04.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903005+0000", 2024-04-26T12:07:04.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903004+0000", 2024-04-26T12:07:04.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:04.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903008+0000", 2024-04-26T12:07:04.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3510000000000004e-06 2024-04-26T12:07:04.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903017+0000", 2024-04-26T12:07:04.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7700000000000007e-06 2024-04-26T12:07:04.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903023+0000", 2024-04-26T12:07:04.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4099999999999996e-06 2024-04-26T12:07:04.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903226+0000", 2024-04-26T12:07:04.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020266300000000001 2024-04-26T12:07:04.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903325+0000", 2024-04-26T12:07:04.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9358000000000007e-05 2024-04-26T12:07:04.984 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.984 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.984 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.984 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:7850 4.18 e56/16 4:1ae08423:::1000000163a.00000000:head v 56'261, mlcod=56'259)", 2024-04-26T12:07:04.984 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.903015+0000", 2024-04-26T12:07:04.985 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00030243400000000003, 2024-04-26T12:07:04.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0012868529999999999, 2024-04-26T12:07:04.985 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.985 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:07:04.985 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903015+0000", 2024-04-26T12:07:04.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903015+0000", 2024-04-26T12:07:04.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903014+0000", 2024-04-26T12:07:04.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903024+0000", 2024-04-26T12:07:04.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9250000000000007e-06 2024-04-26T12:07:04.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903033+0000", 2024-04-26T12:07:04.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:07:04.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903039+0000", 2024-04-26T12:07:04.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6520000000000003e-06 2024-04-26T12:07:04.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903070+0000", 2024-04-26T12:07:04.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1628000000000003e-05 2024-04-26T12:07:04.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903086+0000", 2024-04-26T12:07:04.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5214999999999999e-05 2024-04-26T12:07:04.988 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.988 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.988 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.988 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:7855 3.a e56/15 3:545c15c7:::200.00000017:head v 56'27, mlcod=56'25)", 2024-04-26T12:07:04.988 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.903057+0000", 2024-04-26T12:07:04.988 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00026010999999999997, 2024-04-26T12:07:04.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0012730160000000001, 2024-04-26T12:07:04.988 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.988 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:07:04.988 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903057+0000", 2024-04-26T12:07:04.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903057+0000", 2024-04-26T12:07:04.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903057+0000", 2024-04-26T12:07:04.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903064+0000", 2024-04-26T12:07:04.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1779999999999997e-06 2024-04-26T12:07:04.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903071+0000", 2024-04-26T12:07:04.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3709999999999996e-06 2024-04-26T12:07:04.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903075+0000", 2024-04-26T12:07:04.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6399999999999996e-06 2024-04-26T12:07:04.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903203+0000", 2024-04-26T12:07:04.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012752799999999999 2024-04-26T12:07:04.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903213+0000", 2024-04-26T12:07:04.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0005e-05 2024-04-26T12:07:04.991 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.991 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.991 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.991 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:7858 4.39 e56/16 4:9c15f76d:::10000001641.00000000:head v 56'257, mlcod=56'254)", 2024-04-26T12:07:04.992 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.903546+0000", 2024-04-26T12:07:04.992 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4294967295.9997716, 2024-04-26T12:07:04.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00081463900000000003, 2024-04-26T12:07:04.992 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.992 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:07:04.992 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.992 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.992 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903546+0000", 2024-04-26T12:07:04.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.992 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.992 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903546+0000", 2024-04-26T12:07:04.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903545+0000", 2024-04-26T12:07:04.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:04.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903549+0000", 2024-04-26T12:07:04.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4000000000000001e-06 2024-04-26T12:07:04.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903555+0000", 2024-04-26T12:07:04.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9120000000000003e-06 2024-04-26T12:07:04.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903560+0000", 2024-04-26T12:07:04.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3299999999999998e-06 2024-04-26T12:07:04.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903636+0000", 2024-04-26T12:07:04.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5420999999999995e-05 2024-04-26T12:07:04.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903653+0000", 2024-04-26T12:07:04.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7125e-05 2024-04-26T12:07:04.995 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.995 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.995 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.995 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:7821 4.9 4:91594555:::10000001592.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:07:04.995 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.900618+0000", 2024-04-26T12:07:04.995 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0026990270000000001, 2024-04-26T12:07:04.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00378489, 2024-04-26T12:07:04.995 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.995 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:07:04.995 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900618+0000", 2024-04-26T12:07:04.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900618+0000", 2024-04-26T12:07:04.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:04.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900618+0000", 2024-04-26T12:07:04.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:04.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:04.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900626+0000", 2024-04-26T12:07:04.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3629999999999994e-06 2024-04-26T12:07:04.997 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.997 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:04.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900635+0000", 2024-04-26T12:07:04.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6049999999999998e-06 2024-04-26T12:07:04.997 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.997 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:04.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900641+0000", 2024-04-26T12:07:04.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6830000000000002e-06 2024-04-26T12:07:04.997 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.997 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:04.998 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900676+0000", 2024-04-26T12:07:04.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4619000000000002e-05 2024-04-26T12:07:04.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:04.998 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900789+0000", 2024-04-26T12:07:04.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112706 2024-04-26T12:07:04.998 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.998 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:04.998 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:04.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.998 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:7860 4.16 4:6a1105f8:::10000001643.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:07:04.998 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.903579+0000", 2024-04-26T12:07:04.999 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4294967295.9997382, 2024-04-26T12:07:04.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00085488299999999997, 2024-04-26T12:07:04.999 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:04.999 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:07:04.999 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:04.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:04.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903579+0000", 2024-04-26T12:07:04.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:04.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:04.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:04.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903579+0000", 2024-04-26T12:07:04.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:04.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:05.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903578+0000", 2024-04-26T12:07:05.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:05.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:05.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903583+0000", 2024-04-26T12:07:05.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7779999999999998e-06 2024-04-26T12:07:05.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:05.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903592+0000", 2024-04-26T12:07:05.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9029999999999993e-06 2024-04-26T12:07:05.001 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.001 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:05.001 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903599+0000", 2024-04-26T12:07:05.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6610000000000003e-06 2024-04-26T12:07:05.001 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.001 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:05.001 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903640+0000", 2024-04-26T12:07:05.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1511999999999998e-05 2024-04-26T12:07:05.001 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.001 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:05.001 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903754+0000", 2024-04-26T12:07:05.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011414800000000001 2024-04-26T12:07:05.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:07:05.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903839+0000", 2024-04-26T12:07:05.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5137999999999997e-05 2024-04-26T12:07:05.002 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.002 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.002 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.002 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:7823 4.26 4:6684e7d0:::10000001594.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:07:05.002 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.900652+0000", 2024-04-26T12:07:05.002 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0026651980000000001, 2024-04-26T12:07:05.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0038153919999999999, 2024-04-26T12:07:05.003 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:05.003 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:07:05.003 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:05.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:05.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900652+0000", 2024-04-26T12:07:05.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:05.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900652+0000", 2024-04-26T12:07:05.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:05.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900652+0000", 2024-04-26T12:07:05.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:05.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:05.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900655+0000", 2024-04-26T12:07:05.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.836e-06 2024-04-26T12:07:05.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:05.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900662+0000", 2024-04-26T12:07:05.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.8329999999999994e-06 2024-04-26T12:07:05.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.005 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:05.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900668+0000", 2024-04-26T12:07:05.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.519e-06 2024-04-26T12:07:05.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.005 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:05.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900701+0000", 2024-04-26T12:07:05.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3225999999999997e-05 2024-04-26T12:07:05.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.005 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:05.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900817+0000", 2024-04-26T12:07:05.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011555700000000001 2024-04-26T12:07:05.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.006 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:07:05.006 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900931+0000", 2024-04-26T12:07:05.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114051 2024-04-26T12:07:05.006 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.006 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.006 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:07:05.006 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.902729+0000", 2024-04-26T12:07:05.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0017982930000000001 2024-04-26T12:07:05.006 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.006 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.006 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.006 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.006 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.006 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(mds.0.3:7859 4.3a e56/16 4:5fdb1a9d:::10000001642.00000000:head v 56'216, mlcod=56'214)", 2024-04-26T12:07:05.007 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.903625+0000", 2024-04-26T12:07:05.007 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4294967295.9996924, 2024-04-26T12:07:05.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00087835799999999998, 2024-04-26T12:07:05.007 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:05.007 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-04-26T12:07:05.007 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:05.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:05.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903625+0000", 2024-04-26T12:07:05.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:05.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903625+0000", 2024-04-26T12:07:05.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.008 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:05.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903625+0000", 2024-04-26T12:07:05.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:05.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.008 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:05.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903629+0000", 2024-04-26T12:07:05.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9439999999999998e-06 2024-04-26T12:07:05.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.008 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:05.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903634+0000", 2024-04-26T12:07:05.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2270000000000001e-06 2024-04-26T12:07:05.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:05.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903637+0000", 2024-04-26T12:07:05.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8720000000000002e-06 2024-04-26T12:07:05.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:05.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903671+0000", 2024-04-26T12:07:05.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4516e-05 2024-04-26T12:07:05.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:05.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903689+0000", 2024-04-26T12:07:05.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7070000000000001e-05 2024-04-26T12:07:05.010 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.010 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.010 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.010 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.010 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:7825 4.26 4:66ca7fa2:::100000015f4.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:07:05.010 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.900678+0000", 2024-04-26T12:07:05.010 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0026390939999999998, 2024-04-26T12:07:05.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0038549579999999999, 2024-04-26T12:07:05.010 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:05.010 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:07:05.010 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:05.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.011 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:05.011 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900678+0000", 2024-04-26T12:07:05.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.011 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:05.011 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900678+0000", 2024-04-26T12:07:05.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.011 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:05.011 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900678+0000", 2024-04-26T12:07:05.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:05.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.012 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:05.012 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900680+0000", 2024-04-26T12:07:05.012 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5490000000000001e-06 2024-04-26T12:07:05.012 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.012 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:05.012 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900687+0000", 2024-04-26T12:07:05.012 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1909999999999997e-06 2024-04-26T12:07:05.012 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.012 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:05.012 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900691+0000", 2024-04-26T12:07:05.012 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8609999999999997e-06 2024-04-26T12:07:05.012 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.013 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:05.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901224+0000", 2024-04-26T12:07:05.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00053226 2024-04-26T12:07:05.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.013 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:05.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901308+0000", 2024-04-26T12:07:05.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4682e-05 2024-04-26T12:07:05.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.013 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:07:05.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901363+0000", 2024-04-26T12:07:05.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4630999999999999e-05 2024-04-26T12:07:05.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:07:05.014 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903586+0000", 2024-04-26T12:07:05.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022225349999999999 2024-04-26T12:07:05.014 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.014 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.014 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.014 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.014 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:7829 4.1e 4:7bbfbabb:::100000015f8.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:07:05.014 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:07:04.900989+0000", 2024-04-26T12:07:05.014 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0023287709999999999, 2024-04-26T12:07:05.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035802310000000001, 2024-04-26T12:07:05.014 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:05.015 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:07:05.015 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:05.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:05.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900989+0000", 2024-04-26T12:07:05.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:05.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900989+0000", 2024-04-26T12:07:05.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:05.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900988+0000", 2024-04-26T12:07:05.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:05.016 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:05.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.900992+0000", 2024-04-26T12:07:05.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0090000000000001e-06 2024-04-26T12:07:05.016 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:05.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901007+0000", 2024-04-26T12:07:05.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5424999999999999e-05 2024-04-26T12:07:05.016 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:05.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901014+0000", 2024-04-26T12:07:05.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8510000000000001e-06 2024-04-26T12:07:05.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.017 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:05.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901213+0000", 2024-04-26T12:07:05.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000198965 2024-04-26T12:07:05.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.017 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:05.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901316+0000", 2024-04-26T12:07:05.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000103051 2024-04-26T12:07:05.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.017 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-04-26T12:07:05.018 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.901392+0000", 2024-04-26T12:07:05.018 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5321999999999995e-05 2024-04-26T12:07:05.018 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.018 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.018 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:07:05.018 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:07:04.903616+0000", 2024-04-26T12:07:05.018 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002224621 2024-04-26T12:07:05.018 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.018 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.018 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.018 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.018 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-04-26T12:07:05.018 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 30 2024-04-26T12:07:05.018 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:05.020 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:07:05.020 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:05.018+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:05.121 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:05.120+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:05.162 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:05.163 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:07:05.163 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:07:05.163 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:07:05.163 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:05.172 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:07:05.256 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:05.255+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:05.320 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:05.320 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:07:05.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:07:05.320 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:07:05.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.320 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:536 3.2 3:4272d415:::200.0000000b:head [write 405817~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:05.320 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:05.320 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 10.793754158, 2024-04-26T12:07:05.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053030282999999998, 2024-04-26T12:07:05.320 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:05.320 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:05.321 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:05.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:05.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:05.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:05.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:05.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:05.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524136+0000", 2024-04-26T12:07:05.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:05.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:05.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524139+0000", 2024-04-26T12:07:05.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2919999999999998e-06 2024-04-26T12:07:05.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:05.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524144+0000", 2024-04-26T12:07:05.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.502e-06 2024-04-26T12:07:05.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:05.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524149+0000", 2024-04-26T12:07:05.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7310000000000001e-06 2024-04-26T12:07:05.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:05.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570935+0000", 2024-04-26T12:07:05.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.046785603000000002 2024-04-26T12:07:05.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:05.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570981+0000", 2024-04-26T12:07:05.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6085999999999999e-05 2024-04-26T12:07:05.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:05.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577039+0000", 2024-04-26T12:07:05.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060582099999999996 2024-04-26T12:07:05.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:05.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577081+0000", 2024-04-26T12:07:05.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1927e-05 2024-04-26T12:07:05.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:05.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577167+0000", 2024-04-26T12:07:05.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6311999999999996e-05 2024-04-26T12:07:05.324 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.324 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.324 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.325 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:537 3.2 3:4272d415:::200.0000000b:head [write 407216~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:05.325 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:05.325 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 10.79373822, 2024-04-26T12:07:05.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053131411000000003, 2024-04-26T12:07:05.325 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:05.325 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:05.325 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:05.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:05.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:05.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:05.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:05.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:05.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524152+0000", 2024-04-26T12:07:05.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:05.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:05.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524157+0000", 2024-04-26T12:07:05.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3529999999999997e-06 2024-04-26T12:07:05.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:05.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524162+0000", 2024-04-26T12:07:05.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5910000000000003e-06 2024-04-26T12:07:05.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:05.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524170+0000", 2024-04-26T12:07:05.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:07:05.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:05.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571323+0000", 2024-04-26T12:07:05.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047153289000000001 2024-04-26T12:07:05.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:05.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571367+0000", 2024-04-26T12:07:05.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4205000000000001e-05 2024-04-26T12:07:05.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:05.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577174+0000", 2024-04-26T12:07:05.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058072250000000001 2024-04-26T12:07:05.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:05.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577218+0000", 2024-04-26T12:07:05.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3294999999999998e-05 2024-04-26T12:07:05.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:05.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577284+0000", 2024-04-26T12:07:05.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6483999999999996e-05 2024-04-26T12:07:05.329 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.329 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.329 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.329 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:538 3.2 3:4272d415:::200.0000000b:head [write 408629~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:05.329 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:05.329 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 10.79371752, 2024-04-26T12:07:05.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053241841999999998, 2024-04-26T12:07:05.329 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:05.329 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:05.329 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:05.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:05.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:05.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:05.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:05.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:05.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:05.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:05.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:05.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524178+0000", 2024-04-26T12:07:05.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1420000000000001e-06 2024-04-26T12:07:05.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:05.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524184+0000", 2024-04-26T12:07:05.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4240000000000001e-06 2024-04-26T12:07:05.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:05.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524188+0000", 2024-04-26T12:07:05.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2710000000000003e-06 2024-04-26T12:07:05.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:05.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571623+0000", 2024-04-26T12:07:05.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047435119999999997 2024-04-26T12:07:05.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:05.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571668+0000", 2024-04-26T12:07:05.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5377000000000003e-05 2024-04-26T12:07:05.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:05.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577292+0000", 2024-04-26T12:07:05.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0056232030000000002 2024-04-26T12:07:05.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:05.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577330+0000", 2024-04-26T12:07:05.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8748999999999998e-05 2024-04-26T12:07:05.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:05.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577415+0000", 2024-04-26T12:07:05.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4913000000000005e-05 2024-04-26T12:07:05.333 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.333 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.334 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.334 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:539 3.2 3:4272d415:::200.0000000b:head [write 410547~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:05.334 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:05.334 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 10.793699388, 2024-04-26T12:07:05.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053372670999999997, 2024-04-26T12:07:05.334 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:05.334 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:05.334 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:05.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.334 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:05.334 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:05.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.335 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:05.335 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:05.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.335 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.335 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:05.335 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524191+0000", 2024-04-26T12:07:05.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:05.335 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.335 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:05.335 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524199+0000", 2024-04-26T12:07:05.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6520000000000006e-06 2024-04-26T12:07:05.335 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:05.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524205+0000", 2024-04-26T12:07:05.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:07:05.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:05.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524209+0000", 2024-04-26T12:07:05.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.335e-06 2024-04-26T12:07:05.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:05.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572320+0000", 2024-04-26T12:07:05.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048110992999999998 2024-04-26T12:07:05.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:05.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572364+0000", 2024-04-26T12:07:05.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4577999999999999e-05 2024-04-26T12:07:05.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:05.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577426+0000", 2024-04-26T12:07:05.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050615139999999996 2024-04-26T12:07:05.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:05.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577480+0000", 2024-04-26T12:07:05.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3599e-05 2024-04-26T12:07:05.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:05.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577564+0000", 2024-04-26T12:07:05.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4699999999999999e-05 2024-04-26T12:07:05.338 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.338 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.338 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.338 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:540 3.2 3:4272d415:::200.0000000b:head [write 411948~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:05.338 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:05.338 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 10.79367837, 2024-04-26T12:07:05.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053497045999999999, 2024-04-26T12:07:05.338 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:05.339 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:05.339 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:05.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.339 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:05.339 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:05.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.339 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:05.339 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:05.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.339 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:05.339 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524212+0000", 2024-04-26T12:07:05.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:05.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:05.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524215+0000", 2024-04-26T12:07:05.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.559e-06 2024-04-26T12:07:05.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:05.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524220+0000", 2024-04-26T12:07:05.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2920000000000003e-06 2024-04-26T12:07:05.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:05.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524224+0000", 2024-04-26T12:07:05.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3680000000000004e-06 2024-04-26T12:07:05.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:05.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572619+0000", 2024-04-26T12:07:05.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048394549000000002 2024-04-26T12:07:05.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:05.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572669+0000", 2024-04-26T12:07:05.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0249e-05 2024-04-26T12:07:05.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:05.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577575+0000", 2024-04-26T12:07:05.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049053329999999996 2024-04-26T12:07:05.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:05.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577625+0000", 2024-04-26T12:07:05.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0274e-05 2024-04-26T12:07:05.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:05.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577710+0000", 2024-04-26T12:07:05.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4741999999999996e-05 2024-04-26T12:07:05.342 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.342 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.342 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.343 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:543 3.2 3:4272d415:::200.0000000b:head [write 413907~2485 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:05.343 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:05.343 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 10.793608676, 2024-04-26T12:07:05.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053578708000000003, 2024-04-26T12:07:05.343 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:05.343 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:05.343 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:05.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.343 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:05.343 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:05.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:05.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:05.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:05.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:05.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:05.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:05.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524287+0000", 2024-04-26T12:07:05.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2190000000000003e-06 2024-04-26T12:07:05.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:05.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524294+0000", 2024-04-26T12:07:05.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5660000000000003e-06 2024-04-26T12:07:05.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:05.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524298+0000", 2024-04-26T12:07:05.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3900000000000003e-06 2024-04-26T12:07:05.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:05.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572992+0000", 2024-04-26T12:07:05.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048693835999999997 2024-04-26T12:07:05.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:05.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573045+0000", 2024-04-26T12:07:05.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2793000000000001e-05 2024-04-26T12:07:05.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:05.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577721+0000", 2024-04-26T12:07:05.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046760550000000001 2024-04-26T12:07:05.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:05.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577777+0000", 2024-04-26T12:07:05.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5908000000000001e-05 2024-04-26T12:07:05.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:05.347 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577861+0000", 2024-04-26T12:07:05.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4337000000000002e-05 2024-04-26T12:07:05.347 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.347 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.347 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.347 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:544 3.2 3:4272d415:::200.0000000b:head [write 416392~3872 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:05.347 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:05.347 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 10.793588954000001, 2024-04-26T12:07:05.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054810527999999997, 2024-04-26T12:07:05.347 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:05.348 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:05.348 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:05.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:05.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:05.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:05.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:05.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:05.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:05.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:05.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:05.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524307+0000", 2024-04-26T12:07:05.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1580000000000004e-06 2024-04-26T12:07:05.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:05.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524312+0000", 2024-04-26T12:07:05.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6380000000000001e-06 2024-04-26T12:07:05.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:05.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524317+0000", 2024-04-26T12:07:05.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4000000000000002e-06 2024-04-26T12:07:05.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:05.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573348+0000", 2024-04-26T12:07:05.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049031433999999999 2024-04-26T12:07:05.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:05.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573393+0000", 2024-04-26T12:07:05.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4536999999999997e-05 2024-04-26T12:07:05.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:05.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578978+0000", 2024-04-26T12:07:05.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055848299999999998 2024-04-26T12:07:05.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:05.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579031+0000", 2024-04-26T12:07:05.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3708000000000001e-05 2024-04-26T12:07:05.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:05.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579113+0000", 2024-04-26T12:07:05.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1258e-05 2024-04-26T12:07:05.351 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.351 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.351 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.352 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:545 3.2 3:4272d415:::200.0000000b:head [write 420264~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:05.352 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:05.352 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 10.793570327999999, 2024-04-26T12:07:05.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054927386000000002, 2024-04-26T12:07:05.352 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:05.352 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:05.352 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:05.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.352 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:05.352 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:05.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:05.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:05.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:05.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524320+0000", 2024-04-26T12:07:05.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:05.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:05.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524325+0000", 2024-04-26T12:07:05.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5249999999999999e-06 2024-04-26T12:07:05.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:05.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524330+0000", 2024-04-26T12:07:05.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5629999999999999e-06 2024-04-26T12:07:05.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:05.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524335+0000", 2024-04-26T12:07:05.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.685e-06 2024-04-26T12:07:05.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:05.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573727+0000", 2024-04-26T12:07:05.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049392034000000001 2024-04-26T12:07:05.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:05.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573775+0000", 2024-04-26T12:07:05.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7435999999999998e-05 2024-04-26T12:07:05.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:05.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579120+0000", 2024-04-26T12:07:05.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0053452949999999999 2024-04-26T12:07:05.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:05.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579167+0000", 2024-04-26T12:07:05.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7240000000000002e-05 2024-04-26T12:07:05.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.356 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:05.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579248+0000", 2024-04-26T12:07:05.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0947999999999998e-05 2024-04-26T12:07:05.356 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.356 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.356 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.356 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 422222~8537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:05.356 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:05.356 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 10.793552010999999, 2024-04-26T12:07:05.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055065936000000003, 2024-04-26T12:07:05.356 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:05.356 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:05.356 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:05.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:05.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:05.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:05.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:05.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:05.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:05.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:05.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:05.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524347+0000", 2024-04-26T12:07:05.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7129999999999994e-06 2024-04-26T12:07:05.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:05.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524357+0000", 2024-04-26T12:07:05.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0232e-05 2024-04-26T12:07:05.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:05.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524362+0000", 2024-04-26T12:07:05.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:07:05.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:05.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574119+0000", 2024-04-26T12:07:05.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049756727000000001 2024-04-26T12:07:05.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:05.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574166+0000", 2024-04-26T12:07:05.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7086000000000003e-05 2024-04-26T12:07:05.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:05.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579261+0000", 2024-04-26T12:07:05.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050948310000000002 2024-04-26T12:07:05.360 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.360 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.360 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:05.360 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579316+0000", 2024-04-26T12:07:05.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5068000000000002e-05 2024-04-26T12:07:05.360 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.360 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.360 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:05.360 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579405+0000", 2024-04-26T12:07:05.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9251000000000003e-05 2024-04-26T12:07:05.360 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.360 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.360 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.360 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.360 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.361 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 430759~2035 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:05.361 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:05.361 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 10.793525021000001, 2024-04-26T12:07:05.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055164950999999997, 2024-04-26T12:07:05.361 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:05.361 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:05.361 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:05.361 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.361 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:05.361 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:05.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.361 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.361 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.361 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:05.361 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:05.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:05.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:05.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:05.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:05.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524368+0000", 2024-04-26T12:07:05.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.57e-06 2024-04-26T12:07:05.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:05.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524375+0000", 2024-04-26T12:07:05.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6170000000000003e-06 2024-04-26T12:07:05.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:05.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524380+0000", 2024-04-26T12:07:05.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2700000000000004e-06 2024-04-26T12:07:05.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:05.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574639+0000", 2024-04-26T12:07:05.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050259459999999999 2024-04-26T12:07:05.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:05.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574687+0000", 2024-04-26T12:07:05.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7608999999999998e-05 2024-04-26T12:07:05.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:05.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579414+0000", 2024-04-26T12:07:05.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047268750000000002 2024-04-26T12:07:05.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:05.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579456+0000", 2024-04-26T12:07:05.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1885000000000003e-05 2024-04-26T12:07:05.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:05.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579531+0000", 2024-04-26T12:07:05.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5053000000000001e-05 2024-04-26T12:07:05.364 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.365 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.365 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.365 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.365 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.365 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 432794~10523 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:05.365 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:05.365 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 10.792534297, 2024-04-26T12:07:05.365 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054314727, 2024-04-26T12:07:05.365 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:05.365 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:05.365 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:05.365 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.365 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:05.365 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:05.365 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:05.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:05.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:05.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525356+0000", 2024-04-26T12:07:05.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:05.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:05.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525414+0000", 2024-04-26T12:07:05.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8148e-05 2024-04-26T12:07:05.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:05.367 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525423+0000", 2024-04-26T12:07:05.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9749999999999996e-06 2024-04-26T12:07:05.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:05.367 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525428+0000", 2024-04-26T12:07:05.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0270000000000003e-06 2024-04-26T12:07:05.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:05.367 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574950+0000", 2024-04-26T12:07:05.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049521840999999997 2024-04-26T12:07:05.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.368 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:05.368 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575002+0000", 2024-04-26T12:07:05.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1586999999999999e-05 2024-04-26T12:07:05.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.368 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:05.368 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579543+0000", 2024-04-26T12:07:05.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045416340000000001 2024-04-26T12:07:05.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.368 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:05.368 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579587+0000", 2024-04-26T12:07:05.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3875999999999998e-05 2024-04-26T12:07:05.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:05.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579671+0000", 2024-04-26T12:07:05.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4351999999999995e-05 2024-04-26T12:07:05.369 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.369 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.369 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.369 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 443317~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:05.369 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:05.369 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 10.792458322, 2024-04-26T12:07:05.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054381889000000003, 2024-04-26T12:07:05.370 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:05.370 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:05.370 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:05.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:05.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:05.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:05.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:05.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:05.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525432+0000", 2024-04-26T12:07:05.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:05.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:05.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525435+0000", 2024-04-26T12:07:05.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3070000000000001e-06 2024-04-26T12:07:05.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:05.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525439+0000", 2024-04-26T12:07:05.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.104e-06 2024-04-26T12:07:05.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.372 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:05.372 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525442+0000", 2024-04-26T12:07:05.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0460000000000001e-06 2024-04-26T12:07:05.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.372 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:05.372 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575405+0000", 2024-04-26T12:07:05.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049963059999999997 2024-04-26T12:07:05.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.372 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:05.372 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575450+0000", 2024-04-26T12:07:05.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5034000000000003e-05 2024-04-26T12:07:05.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:05.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579680+0000", 2024-04-26T12:07:05.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042302260000000001 2024-04-26T12:07:05.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:05.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579737+0000", 2024-04-26T12:07:05.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7241000000000003e-05 2024-04-26T12:07:05.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:05.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579815+0000", 2024-04-26T12:07:05.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7278000000000001e-05 2024-04-26T12:07:05.373 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.374 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.374 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.374 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 445275~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:05.374 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:05.374 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 10.792031145999999, 2024-04-26T12:07:05.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054094668999999998, 2024-04-26T12:07:05.374 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:05.374 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:05.374 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:05.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:05.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:05.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:05.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:05.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:05.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525859+0000", 2024-04-26T12:07:05.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:05.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:05.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525864+0000", 2024-04-26T12:07:05.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:07:05.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:05.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525872+0000", 2024-04-26T12:07:05.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6790000000000005e-06 2024-04-26T12:07:05.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:05.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525877+0000", 2024-04-26T12:07:05.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0529999999999997e-06 2024-04-26T12:07:05.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:05.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575723+0000", 2024-04-26T12:07:05.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049846469999999997 2024-04-26T12:07:05.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:05.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575770+0000", 2024-04-26T12:07:05.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6387999999999997e-05 2024-04-26T12:07:05.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:05.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579823+0000", 2024-04-26T12:07:05.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0040534189999999999 2024-04-26T12:07:05.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:05.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579869+0000", 2024-04-26T12:07:05.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6218999999999999e-05 2024-04-26T12:07:05.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:05.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579954+0000", 2024-04-26T12:07:05.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5315999999999994e-05 2024-04-26T12:07:05.378 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.378 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.378 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.378 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:551 3.2 3:4272d415:::200.0000000b:head [write 448232~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:05.378 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:05.378 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 10.791583712, 2024-04-26T12:07:05.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053798273000000001, 2024-04-26T12:07:05.378 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:05.379 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:05.379 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:05.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:05.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:05.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:05.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:05.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:05.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:05.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:05.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:05.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526310+0000", 2024-04-26T12:07:05.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5279999999999999e-06 2024-04-26T12:07:05.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:05.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526317+0000", 2024-04-26T12:07:05.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8430000000000004e-06 2024-04-26T12:07:05.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:05.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526322+0000", 2024-04-26T12:07:05.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3340000000000001e-06 2024-04-26T12:07:05.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:05.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576135+0000", 2024-04-26T12:07:05.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049812113999999998 2024-04-26T12:07:05.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:05.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576186+0000", 2024-04-26T12:07:05.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1443999999999997e-05 2024-04-26T12:07:05.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:05.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579962+0000", 2024-04-26T12:07:05.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037763359999999999 2024-04-26T12:07:05.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:05.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580016+0000", 2024-04-26T12:07:05.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3421000000000002e-05 2024-04-26T12:07:05.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:05.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580106+0000", 2024-04-26T12:07:05.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9790000000000006e-05 2024-04-26T12:07:05.382 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.382 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.382 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.383 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 450189~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:05.383 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:05.383 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 10.791503583000001, 2024-04-26T12:07:05.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055070796999999998, 2024-04-26T12:07:05.383 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:05.383 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:05.383 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:05.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:05.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:05.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:05.384 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:05.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.384 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.384 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:05.384 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:05.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:05.384 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.384 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:05.384 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526390+0000", 2024-04-26T12:07:05.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8559999999999998e-06 2024-04-26T12:07:05.384 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:05.385 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526395+0000", 2024-04-26T12:07:05.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3319999999999999e-06 2024-04-26T12:07:05.385 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:05.385 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526399+0000", 2024-04-26T12:07:05.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.619e-06 2024-04-26T12:07:05.385 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:05.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576476+0000", 2024-04-26T12:07:05.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050077643999999998 2024-04-26T12:07:05.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.386 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:05.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576524+0000", 2024-04-26T12:07:05.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7184000000000001e-05 2024-04-26T12:07:05.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.386 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:05.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581347+0000", 2024-04-26T12:07:05.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0048231919999999996 2024-04-26T12:07:05.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:05.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581398+0000", 2024-04-26T12:07:05.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1345999999999999e-05 2024-04-26T12:07:05.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:05.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581458+0000", 2024-04-26T12:07:05.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0081000000000003e-05 2024-04-26T12:07:05.387 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.387 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.387 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.387 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 452113~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:05.387 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:05.387 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 10.791392367, 2024-04-26T12:07:05.388 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055041448, 2024-04-26T12:07:05.388 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:05.388 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:05.388 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:05.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.388 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:05.388 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:05.388 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.388 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.388 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:05.388 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:05.388 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.388 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.389 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:05.389 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526498+0000", 2024-04-26T12:07:05.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:05.389 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.389 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:05.389 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526540+0000", 2024-04-26T12:07:05.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2267e-05 2024-04-26T12:07:05.389 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.389 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:05.389 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526547+0000", 2024-04-26T12:07:05.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7000000000000002e-06 2024-04-26T12:07:05.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.390 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:05.390 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526550+0000", 2024-04-26T12:07:05.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0299999999999998e-06 2024-04-26T12:07:05.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.390 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:05.390 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577902+0000", 2024-04-26T12:07:05.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051351648999999999 2024-04-26T12:07:05.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.390 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:05.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577953+0000", 2024-04-26T12:07:05.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1289000000000003e-05 2024-04-26T12:07:05.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:05.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581464+0000", 2024-04-26T12:07:05.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035111259999999998 2024-04-26T12:07:05.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:05.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581490+0000", 2024-04-26T12:07:05.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5717000000000001e-05 2024-04-26T12:07:05.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:05.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581540+0000", 2024-04-26T12:07:05.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0287999999999997e-05 2024-04-26T12:07:05.392 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.392 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.392 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.392 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 454070~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:05.392 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:05.392 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 10.790835418, 2024-04-26T12:07:05.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054564161, 2024-04-26T12:07:05.392 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:05.392 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:05.392 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:05.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:05.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:05.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:05.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:05.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:05.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527055+0000", 2024-04-26T12:07:05.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:05.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:05.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527058+0000", 2024-04-26T12:07:05.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9890000000000001e-06 2024-04-26T12:07:05.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:05.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527066+0000", 2024-04-26T12:07:05.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4730000000000003e-06 2024-04-26T12:07:05.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:05.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527069+0000", 2024-04-26T12:07:05.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5810000000000001e-06 2024-04-26T12:07:05.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:05.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578308+0000", 2024-04-26T12:07:05.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051238911999999998 2024-04-26T12:07:05.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:05.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578391+0000", 2024-04-26T12:07:05.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2713999999999994e-05 2024-04-26T12:07:05.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:05.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581548+0000", 2024-04-26T12:07:05.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031577530000000001 2024-04-26T12:07:05.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.396 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:05.396 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581574+0000", 2024-04-26T12:07:05.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5350999999999998e-05 2024-04-26T12:07:05.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.396 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:05.396 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581620+0000", 2024-04-26T12:07:05.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5868999999999997e-05 2024-04-26T12:07:05.396 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.396 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.396 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.396 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 456028~3870 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:05.396 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:05.396 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 10.789079176, 2024-04-26T12:07:05.397 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055118997000000003, 2024-04-26T12:07:05.397 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:05.397 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:05.397 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:05.397 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.397 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:05.397 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:05.397 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.397 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.397 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.397 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:05.397 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:05.397 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.397 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:05.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528811+0000", 2024-04-26T12:07:05.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:05.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:05.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528887+0000", 2024-04-26T12:07:05.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5977999999999997e-05 2024-04-26T12:07:05.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:05.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528897+0000", 2024-04-26T12:07:05.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8730000000000002e-06 2024-04-26T12:07:05.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:05.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528901+0000", 2024-04-26T12:07:05.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4880000000000001e-06 2024-04-26T12:07:05.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:05.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580146+0000", 2024-04-26T12:07:05.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051244242000000002 2024-04-26T12:07:05.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:05.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580227+0000", 2024-04-26T12:07:05.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1044000000000005e-05 2024-04-26T12:07:05.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:05.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583864+0000", 2024-04-26T12:07:05.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036374419999999998 2024-04-26T12:07:05.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:05.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583894+0000", 2024-04-26T12:07:05.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9828999999999999e-05 2024-04-26T12:07:05.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.402 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:05.402 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583931+0000", 2024-04-26T12:07:05.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6908e-05 2024-04-26T12:07:05.402 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.402 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.402 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.402 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 459898~2037 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:05.402 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:05.402 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 10.788691184999999, 2024-04-26T12:07:05.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055925713000000002, 2024-04-26T12:07:05.403 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:05.403 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:05.403 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:05.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:05.403 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:05.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.403 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:05.403 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:05.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.403 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:05.403 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529199+0000", 2024-04-26T12:07:05.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:05.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:05.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529203+0000", 2024-04-26T12:07:05.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:07:05.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:05.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529209+0000", 2024-04-26T12:07:05.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7939999999999999e-06 2024-04-26T12:07:05.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:05.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529212+0000", 2024-04-26T12:07:05.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7290000000000002e-06 2024-04-26T12:07:05.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.405 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:05.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580784+0000", 2024-04-26T12:07:05.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051572073000000003 2024-04-26T12:07:05.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.405 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:05.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580883+0000", 2024-04-26T12:07:05.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8330000000000002e-05 2024-04-26T12:07:05.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.405 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:05.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585050+0000", 2024-04-26T12:07:05.406 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041670209999999999 2024-04-26T12:07:05.406 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.406 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.406 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:05.406 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585088+0000", 2024-04-26T12:07:05.406 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8559999999999997e-05 2024-04-26T12:07:05.406 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.406 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.406 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:05.406 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585125+0000", 2024-04-26T12:07:05.406 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7197999999999999e-05 2024-04-26T12:07:05.406 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.406 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.406 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.406 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.407 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 461935~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:05.407 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:05.407 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 10.787968730999999, 2024-04-26T12:07:05.407 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055266150999999999, 2024-04-26T12:07:05.407 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:05.407 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:05.407 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:05.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.407 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:05.407 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:05.407 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.407 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.407 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:05.408 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:05.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:05.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.408 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:05.408 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529921+0000", 2024-04-26T12:07:05.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:05.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.408 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:05.408 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529956+0000", 2024-04-26T12:07:05.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4687000000000002e-05 2024-04-26T12:07:05.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.408 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:05.409 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529966+0000", 2024-04-26T12:07:05.409 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0392e-05 2024-04-26T12:07:05.409 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.409 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:05.409 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529978+0000", 2024-04-26T12:07:05.409 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1348e-05 2024-04-26T12:07:05.409 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.409 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:05.409 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581659+0000", 2024-04-26T12:07:05.409 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051681454000000002 2024-04-26T12:07:05.409 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.409 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:05.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581746+0000", 2024-04-26T12:07:05.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6305999999999997e-05 2024-04-26T12:07:05.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:05.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585131+0000", 2024-04-26T12:07:05.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033853199999999998 2024-04-26T12:07:05.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:05.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585154+0000", 2024-04-26T12:07:05.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3258999999999999e-05 2024-04-26T12:07:05.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:05.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:05.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:05.411 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585188+0000", 2024-04-26T12:07:05.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4236000000000002e-05 2024-04-26T12:07:05.411 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.411 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.411 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.411 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:05.411 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:05.411 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:05.413 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:07:05.413 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:05.411+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:05.477 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:07:05.513 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:05.512+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:05.520 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:05.520 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:05.520 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:07:05.520 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:05.529 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:05.550 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-26T12:07:05.614 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:05.613+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:05.620 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:07:05.620 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:07:05.620 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:07:05.643 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:07:05.643 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:07:05.646 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:07:05.647 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:07:05.671 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:05.671 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:05.680 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:05.714 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:05.713+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:05.815 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:05.815+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:05.822 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:05.822 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:05.830 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:07:05.916 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:05.915+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:05.973 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:05.973 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:05.987 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:07:06.028 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:06.027+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:06.119 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:06.118+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:06.139 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:06.139 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:06.149 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:07:06.219 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:06.219+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:06.253 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:06.253 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:06.262 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:07:06.321 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:06.319+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:06.368 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:06.369 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:06.378 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:06.421 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:06.420+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:06.522 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:06.521+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:06.524 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:06.524 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:06.534 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:06.623 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:06.622+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:06.637 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:06.637 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:06.646 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:07:06.724 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:06.723+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:06.748 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:06.748 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:06.757 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:07:06.825 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:06.824+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:06.858 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:06.858 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:06.867 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:07:06.927 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:06.926+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:07.028 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:07.027+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:07.045 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:07.045 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:07.054 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:07:07.129 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:07.128+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:07.161 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:07.161 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:07.170 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:07.230 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:07.228+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:07.275 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:07.275 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:07.284 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:07.369 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:07.368+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:07.429 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:07.430 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:07.432 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:07.431+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:07.439 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:07:07.533 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:07.532+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:07.545 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:07.545 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:07.554 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:07:07.566 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:07:07.638 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:07.637+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:07.650 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:07:07.698 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:07.699 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:07.707 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:07:07.748 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:07.747+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:07.807 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:07:07.807 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:07:07.808 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:07:07.828 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:07:07.828 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:07:07.831 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:07:07.832 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:07:07.835 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:07.834+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:07.855 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:07.855 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:07:07.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:07:07.855 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:07:07.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.855 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:536 3.2 3:4272d415:::200.0000000b:head [write 405817~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:07.855 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:07.855 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.328428708000001, 2024-04-26T12:07:07.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053030282999999998, 2024-04-26T12:07:07.855 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:07.855 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:07.855 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:07.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:07.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:07.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:07.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:07.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:07.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524136+0000", 2024-04-26T12:07:07.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:07.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:07.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524139+0000", 2024-04-26T12:07:07.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2919999999999998e-06 2024-04-26T12:07:07.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:07.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524144+0000", 2024-04-26T12:07:07.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.502e-06 2024-04-26T12:07:07.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:07.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524149+0000", 2024-04-26T12:07:07.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7310000000000001e-06 2024-04-26T12:07:07.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:07.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570935+0000", 2024-04-26T12:07:07.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.046785603000000002 2024-04-26T12:07:07.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:07.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570981+0000", 2024-04-26T12:07:07.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6085999999999999e-05 2024-04-26T12:07:07.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:07.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577039+0000", 2024-04-26T12:07:07.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060582099999999996 2024-04-26T12:07:07.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:07.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577081+0000", 2024-04-26T12:07:07.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1927e-05 2024-04-26T12:07:07.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:07.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577167+0000", 2024-04-26T12:07:07.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6311999999999996e-05 2024-04-26T12:07:07.859 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.859 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:07.859 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.860 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:537 3.2 3:4272d415:::200.0000000b:head [write 407216~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:07.860 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:07.860 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.32841277, 2024-04-26T12:07:07.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053131411000000003, 2024-04-26T12:07:07.860 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:07.860 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:07.860 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:07.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:07.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:07.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:07.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:07.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:07.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524152+0000", 2024-04-26T12:07:07.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:07.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:07.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524157+0000", 2024-04-26T12:07:07.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3529999999999997e-06 2024-04-26T12:07:07.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:07.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524162+0000", 2024-04-26T12:07:07.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5910000000000003e-06 2024-04-26T12:07:07.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:07.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524170+0000", 2024-04-26T12:07:07.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:07:07.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:07.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571323+0000", 2024-04-26T12:07:07.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047153289000000001 2024-04-26T12:07:07.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:07.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571367+0000", 2024-04-26T12:07:07.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4205000000000001e-05 2024-04-26T12:07:07.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:07.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577174+0000", 2024-04-26T12:07:07.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058072250000000001 2024-04-26T12:07:07.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:07.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577218+0000", 2024-04-26T12:07:07.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3294999999999998e-05 2024-04-26T12:07:07.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:07.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577284+0000", 2024-04-26T12:07:07.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6483999999999996e-05 2024-04-26T12:07:07.864 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.864 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:07.864 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.864 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:538 3.2 3:4272d415:::200.0000000b:head [write 408629~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:07.864 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:07.864 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.32839207, 2024-04-26T12:07:07.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053241841999999998, 2024-04-26T12:07:07.864 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:07.864 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:07.865 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:07.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:07.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:07.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:07.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:07.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:07.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:07.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:07.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:07.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524178+0000", 2024-04-26T12:07:07.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1420000000000001e-06 2024-04-26T12:07:07.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:07.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524184+0000", 2024-04-26T12:07:07.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4240000000000001e-06 2024-04-26T12:07:07.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:07.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524188+0000", 2024-04-26T12:07:07.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2710000000000003e-06 2024-04-26T12:07:07.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:07.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571623+0000", 2024-04-26T12:07:07.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047435119999999997 2024-04-26T12:07:07.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:07.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571668+0000", 2024-04-26T12:07:07.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5377000000000003e-05 2024-04-26T12:07:07.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:07.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577292+0000", 2024-04-26T12:07:07.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0056232030000000002 2024-04-26T12:07:07.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:07.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577330+0000", 2024-04-26T12:07:07.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8748999999999998e-05 2024-04-26T12:07:07.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:07.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577415+0000", 2024-04-26T12:07:07.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4913000000000005e-05 2024-04-26T12:07:07.869 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.869 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:07.869 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.869 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:539 3.2 3:4272d415:::200.0000000b:head [write 410547~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:07.869 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:07.869 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.328373938, 2024-04-26T12:07:07.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053372670999999997, 2024-04-26T12:07:07.869 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:07.869 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:07.869 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:07.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.869 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:07.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:07.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.870 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.870 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:07.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:07.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.870 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.870 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:07.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524191+0000", 2024-04-26T12:07:07.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:07.870 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:07.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524199+0000", 2024-04-26T12:07:07.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6520000000000006e-06 2024-04-26T12:07:07.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:07.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524205+0000", 2024-04-26T12:07:07.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:07:07.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:07.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524209+0000", 2024-04-26T12:07:07.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.335e-06 2024-04-26T12:07:07.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.872 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:07.872 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572320+0000", 2024-04-26T12:07:07.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048110992999999998 2024-04-26T12:07:07.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.872 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:07.872 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572364+0000", 2024-04-26T12:07:07.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4577999999999999e-05 2024-04-26T12:07:07.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.872 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:07.872 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577426+0000", 2024-04-26T12:07:07.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050615139999999996 2024-04-26T12:07:07.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:07.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577480+0000", 2024-04-26T12:07:07.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3599e-05 2024-04-26T12:07:07.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:07.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577564+0000", 2024-04-26T12:07:07.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4699999999999999e-05 2024-04-26T12:07:07.873 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.873 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:07.873 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.874 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:540 3.2 3:4272d415:::200.0000000b:head [write 411948~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:07.874 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:07.874 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.32835292, 2024-04-26T12:07:07.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053497045999999999, 2024-04-26T12:07:07.874 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:07.874 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:07.874 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:07.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:07.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:07.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:07.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:07.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:07.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524212+0000", 2024-04-26T12:07:07.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:07.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:07.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524215+0000", 2024-04-26T12:07:07.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.559e-06 2024-04-26T12:07:07.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:07.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524220+0000", 2024-04-26T12:07:07.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2920000000000003e-06 2024-04-26T12:07:07.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:07.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524224+0000", 2024-04-26T12:07:07.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3680000000000004e-06 2024-04-26T12:07:07.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:07.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572619+0000", 2024-04-26T12:07:07.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048394549000000002 2024-04-26T12:07:07.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:07.877 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572669+0000", 2024-04-26T12:07:07.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0249e-05 2024-04-26T12:07:07.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:07.877 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577575+0000", 2024-04-26T12:07:07.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049053329999999996 2024-04-26T12:07:07.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:07.877 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577625+0000", 2024-04-26T12:07:07.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0274e-05 2024-04-26T12:07:07.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:07.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577710+0000", 2024-04-26T12:07:07.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4741999999999996e-05 2024-04-26T12:07:07.878 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.878 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:07.878 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.878 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.878 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:543 3.2 3:4272d415:::200.0000000b:head [write 413907~2485 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:07.878 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:07.878 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.328283226, 2024-04-26T12:07:07.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053578708000000003, 2024-04-26T12:07:07.878 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:07.878 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:07.878 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:07.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:07.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:07.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.882 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:07.882 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:07.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.883 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.883 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:07.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:07.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:07.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.883 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.883 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:07.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524287+0000", 2024-04-26T12:07:07.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2190000000000003e-06 2024-04-26T12:07:07.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.883 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.883 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:07.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524294+0000", 2024-04-26T12:07:07.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5660000000000003e-06 2024-04-26T12:07:07.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:07.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524298+0000", 2024-04-26T12:07:07.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3900000000000003e-06 2024-04-26T12:07:07.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:07.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572992+0000", 2024-04-26T12:07:07.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048693835999999997 2024-04-26T12:07:07.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:07.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573045+0000", 2024-04-26T12:07:07.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2793000000000001e-05 2024-04-26T12:07:07.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:07.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577721+0000", 2024-04-26T12:07:07.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046760550000000001 2024-04-26T12:07:07.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:07.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577777+0000", 2024-04-26T12:07:07.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5908000000000001e-05 2024-04-26T12:07:07.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:07.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577861+0000", 2024-04-26T12:07:07.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4337000000000002e-05 2024-04-26T12:07:07.886 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.886 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:07.886 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.886 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:544 3.2 3:4272d415:::200.0000000b:head [write 416392~3872 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:07.886 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:07.886 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.328263504000001, 2024-04-26T12:07:07.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054810527999999997, 2024-04-26T12:07:07.886 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:07.886 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:07.887 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:07.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:07.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:07.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.887 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:07.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:07.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.887 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:07.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:07.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:07.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:07.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524307+0000", 2024-04-26T12:07:07.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1580000000000004e-06 2024-04-26T12:07:07.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:07.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524312+0000", 2024-04-26T12:07:07.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6380000000000001e-06 2024-04-26T12:07:07.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:07.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524317+0000", 2024-04-26T12:07:07.889 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4000000000000002e-06 2024-04-26T12:07:07.889 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.889 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.889 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:07.889 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573348+0000", 2024-04-26T12:07:07.889 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049031433999999999 2024-04-26T12:07:07.889 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.889 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.889 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:07.889 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573393+0000", 2024-04-26T12:07:07.889 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4536999999999997e-05 2024-04-26T12:07:07.889 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.889 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.889 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:07.889 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578978+0000", 2024-04-26T12:07:07.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055848299999999998 2024-04-26T12:07:07.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:07.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579031+0000", 2024-04-26T12:07:07.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3708000000000001e-05 2024-04-26T12:07:07.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:07.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579113+0000", 2024-04-26T12:07:07.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1258e-05 2024-04-26T12:07:07.890 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.890 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:07.890 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.892 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:545 3.2 3:4272d415:::200.0000000b:head [write 420264~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:07.892 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:07.892 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.328244878, 2024-04-26T12:07:07.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054927386000000002, 2024-04-26T12:07:07.892 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:07.892 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:07.892 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:07.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:07.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:07.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:07.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:07.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:07.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524320+0000", 2024-04-26T12:07:07.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:07.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:07.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524325+0000", 2024-04-26T12:07:07.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5249999999999999e-06 2024-04-26T12:07:07.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.894 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:07.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524330+0000", 2024-04-26T12:07:07.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5629999999999999e-06 2024-04-26T12:07:07.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.894 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:07.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524335+0000", 2024-04-26T12:07:07.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.685e-06 2024-04-26T12:07:07.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.895 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:07.895 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573727+0000", 2024-04-26T12:07:07.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049392034000000001 2024-04-26T12:07:07.895 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:07.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573775+0000", 2024-04-26T12:07:07.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7435999999999998e-05 2024-04-26T12:07:07.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:07.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579120+0000", 2024-04-26T12:07:07.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0053452949999999999 2024-04-26T12:07:07.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:07.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579167+0000", 2024-04-26T12:07:07.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7240000000000002e-05 2024-04-26T12:07:07.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:07.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579248+0000", 2024-04-26T12:07:07.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0947999999999998e-05 2024-04-26T12:07:07.897 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.897 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:07.897 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.897 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 422222~8537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:07.897 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:07.897 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.328226560999999, 2024-04-26T12:07:07.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055065936000000003, 2024-04-26T12:07:07.897 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:07.898 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:07.898 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:07.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:07.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:07.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:07.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:07.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:07.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:07.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:07.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:07.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524347+0000", 2024-04-26T12:07:07.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7129999999999994e-06 2024-04-26T12:07:07.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:07.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524357+0000", 2024-04-26T12:07:07.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0232e-05 2024-04-26T12:07:07.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:07.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524362+0000", 2024-04-26T12:07:07.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:07:07.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:07.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574119+0000", 2024-04-26T12:07:07.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049756727000000001 2024-04-26T12:07:07.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:07.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574166+0000", 2024-04-26T12:07:07.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7086000000000003e-05 2024-04-26T12:07:07.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:07.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579261+0000", 2024-04-26T12:07:07.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050948310000000002 2024-04-26T12:07:07.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:07.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579316+0000", 2024-04-26T12:07:07.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5068000000000002e-05 2024-04-26T12:07:07.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:07.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579405+0000", 2024-04-26T12:07:07.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9251000000000003e-05 2024-04-26T12:07:07.901 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.902 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:07.902 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.902 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 430759~2035 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:07.902 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:07.902 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.328199571000001, 2024-04-26T12:07:07.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055164950999999997, 2024-04-26T12:07:07.902 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:07.902 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:07.902 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:07.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:07.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:07.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:07.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:07.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:07.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:07.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:07.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:07.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524368+0000", 2024-04-26T12:07:07.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.57e-06 2024-04-26T12:07:07.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:07.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524375+0000", 2024-04-26T12:07:07.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6170000000000003e-06 2024-04-26T12:07:07.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:07.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524380+0000", 2024-04-26T12:07:07.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2700000000000004e-06 2024-04-26T12:07:07.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:07.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574639+0000", 2024-04-26T12:07:07.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050259459999999999 2024-04-26T12:07:07.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:07.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574687+0000", 2024-04-26T12:07:07.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7608999999999998e-05 2024-04-26T12:07:07.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:07.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579414+0000", 2024-04-26T12:07:07.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047268750000000002 2024-04-26T12:07:07.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:07.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579456+0000", 2024-04-26T12:07:07.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1885000000000003e-05 2024-04-26T12:07:07.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:07.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579531+0000", 2024-04-26T12:07:07.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5053000000000001e-05 2024-04-26T12:07:07.906 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.906 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:07.906 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.906 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 432794~10523 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:07.906 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:07.907 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.327208847, 2024-04-26T12:07:07.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054314727, 2024-04-26T12:07:07.907 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:07.907 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:07.907 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:07.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:07.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:07.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:07.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:07.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:07.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525356+0000", 2024-04-26T12:07:07.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:07.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:07.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525414+0000", 2024-04-26T12:07:07.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8148e-05 2024-04-26T12:07:07.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:07.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525423+0000", 2024-04-26T12:07:07.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9749999999999996e-06 2024-04-26T12:07:07.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:07.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525428+0000", 2024-04-26T12:07:07.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0270000000000003e-06 2024-04-26T12:07:07.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:07.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574950+0000", 2024-04-26T12:07:07.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049521840999999997 2024-04-26T12:07:07.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:07.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575002+0000", 2024-04-26T12:07:07.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1586999999999999e-05 2024-04-26T12:07:07.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:07.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579543+0000", 2024-04-26T12:07:07.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045416340000000001 2024-04-26T12:07:07.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:07.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579587+0000", 2024-04-26T12:07:07.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3875999999999998e-05 2024-04-26T12:07:07.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:07.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579671+0000", 2024-04-26T12:07:07.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4351999999999995e-05 2024-04-26T12:07:07.911 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.911 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:07.911 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.911 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 443317~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:07.911 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:07.911 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.327132872, 2024-04-26T12:07:07.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054381889000000003, 2024-04-26T12:07:07.911 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:07.911 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:07.911 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:07.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:07.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:07.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:07.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:07.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:07.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525432+0000", 2024-04-26T12:07:07.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:07.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:07.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525435+0000", 2024-04-26T12:07:07.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3070000000000001e-06 2024-04-26T12:07:07.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:07.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525439+0000", 2024-04-26T12:07:07.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.104e-06 2024-04-26T12:07:07.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:07.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525442+0000", 2024-04-26T12:07:07.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0460000000000001e-06 2024-04-26T12:07:07.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:07.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575405+0000", 2024-04-26T12:07:07.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049963059999999997 2024-04-26T12:07:07.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:07.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575450+0000", 2024-04-26T12:07:07.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5034000000000003e-05 2024-04-26T12:07:07.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:07.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579680+0000", 2024-04-26T12:07:07.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042302260000000001 2024-04-26T12:07:07.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:07.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579737+0000", 2024-04-26T12:07:07.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7241000000000003e-05 2024-04-26T12:07:07.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:07.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579815+0000", 2024-04-26T12:07:07.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7278000000000001e-05 2024-04-26T12:07:07.915 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.915 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:07.915 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.916 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 445275~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:07.916 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:07.916 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.326705695999999, 2024-04-26T12:07:07.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054094668999999998, 2024-04-26T12:07:07.916 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:07.916 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:07.916 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:07.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:07.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:07.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:07.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:07.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:07.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525859+0000", 2024-04-26T12:07:07.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:07.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:07.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525864+0000", 2024-04-26T12:07:07.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:07:07.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:07.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525872+0000", 2024-04-26T12:07:07.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6790000000000005e-06 2024-04-26T12:07:07.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:07.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525877+0000", 2024-04-26T12:07:07.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0529999999999997e-06 2024-04-26T12:07:07.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:07.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575723+0000", 2024-04-26T12:07:07.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049846469999999997 2024-04-26T12:07:07.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:07.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575770+0000", 2024-04-26T12:07:07.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6387999999999997e-05 2024-04-26T12:07:07.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:07.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579823+0000", 2024-04-26T12:07:07.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0040534189999999999 2024-04-26T12:07:07.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:07.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579869+0000", 2024-04-26T12:07:07.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6218999999999999e-05 2024-04-26T12:07:07.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:07.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579954+0000", 2024-04-26T12:07:07.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5315999999999994e-05 2024-04-26T12:07:07.920 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.920 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:07.920 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.920 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:551 3.2 3:4272d415:::200.0000000b:head [write 448232~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:07.920 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:07.920 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.326258262, 2024-04-26T12:07:07.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053798273000000001, 2024-04-26T12:07:07.920 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:07.920 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:07.921 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:07.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:07.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:07.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:07.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:07.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:07.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:07.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:07.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:07.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526310+0000", 2024-04-26T12:07:07.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5279999999999999e-06 2024-04-26T12:07:07.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:07.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526317+0000", 2024-04-26T12:07:07.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8430000000000004e-06 2024-04-26T12:07:07.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:07.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526322+0000", 2024-04-26T12:07:07.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3340000000000001e-06 2024-04-26T12:07:07.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:07.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576135+0000", 2024-04-26T12:07:07.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049812113999999998 2024-04-26T12:07:07.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:07.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576186+0000", 2024-04-26T12:07:07.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1443999999999997e-05 2024-04-26T12:07:07.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:07.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579962+0000", 2024-04-26T12:07:07.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037763359999999999 2024-04-26T12:07:07.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:07.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580016+0000", 2024-04-26T12:07:07.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3421000000000002e-05 2024-04-26T12:07:07.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:07.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580106+0000", 2024-04-26T12:07:07.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9790000000000006e-05 2024-04-26T12:07:07.924 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.924 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:07.924 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.925 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 450189~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:07.925 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:07.925 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.326178132999999, 2024-04-26T12:07:07.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055070796999999998, 2024-04-26T12:07:07.925 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:07.925 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:07.925 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:07.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:07.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:07.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:07.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:07.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:07.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:07.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:07.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:07.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526390+0000", 2024-04-26T12:07:07.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8559999999999998e-06 2024-04-26T12:07:07.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:07.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526395+0000", 2024-04-26T12:07:07.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3319999999999999e-06 2024-04-26T12:07:07.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:07.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526399+0000", 2024-04-26T12:07:07.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.619e-06 2024-04-26T12:07:07.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:07.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576476+0000", 2024-04-26T12:07:07.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050077643999999998 2024-04-26T12:07:07.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:07.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576524+0000", 2024-04-26T12:07:07.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7184000000000001e-05 2024-04-26T12:07:07.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:07.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581347+0000", 2024-04-26T12:07:07.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0048231919999999996 2024-04-26T12:07:07.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:07.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581398+0000", 2024-04-26T12:07:07.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1345999999999999e-05 2024-04-26T12:07:07.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:07.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581458+0000", 2024-04-26T12:07:07.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0081000000000003e-05 2024-04-26T12:07:07.929 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.929 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:07.929 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.929 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 452113~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:07.929 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:07.929 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.326066917, 2024-04-26T12:07:07.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055041448, 2024-04-26T12:07:07.929 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:07.929 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:07.930 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:07.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:07.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:07.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:07.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:07.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:07.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526498+0000", 2024-04-26T12:07:07.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:07.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:07.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526540+0000", 2024-04-26T12:07:07.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2267e-05 2024-04-26T12:07:07.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:07.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526547+0000", 2024-04-26T12:07:07.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7000000000000002e-06 2024-04-26T12:07:07.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:07.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526550+0000", 2024-04-26T12:07:07.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0299999999999998e-06 2024-04-26T12:07:07.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:07.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577902+0000", 2024-04-26T12:07:07.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051351648999999999 2024-04-26T12:07:07.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:07.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577953+0000", 2024-04-26T12:07:07.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1289000000000003e-05 2024-04-26T12:07:07.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:07.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581464+0000", 2024-04-26T12:07:07.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035111259999999998 2024-04-26T12:07:07.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:07.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581490+0000", 2024-04-26T12:07:07.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5717000000000001e-05 2024-04-26T12:07:07.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:07.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581540+0000", 2024-04-26T12:07:07.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0287999999999997e-05 2024-04-26T12:07:07.933 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.933 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:07.933 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.934 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 454070~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:07.934 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:07.934 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.325509968, 2024-04-26T12:07:07.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054564161, 2024-04-26T12:07:07.934 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:07.934 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:07.934 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:07.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:07.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:07.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:07.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:07.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:07.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527055+0000", 2024-04-26T12:07:07.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:07.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:07.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527058+0000", 2024-04-26T12:07:07.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9890000000000001e-06 2024-04-26T12:07:07.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:07.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527066+0000", 2024-04-26T12:07:07.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4730000000000003e-06 2024-04-26T12:07:07.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:07.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527069+0000", 2024-04-26T12:07:07.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5810000000000001e-06 2024-04-26T12:07:07.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:07.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578308+0000", 2024-04-26T12:07:07.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051238911999999998 2024-04-26T12:07:07.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:07.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578391+0000", 2024-04-26T12:07:07.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2713999999999994e-05 2024-04-26T12:07:07.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:07.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581548+0000", 2024-04-26T12:07:07.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031577530000000001 2024-04-26T12:07:07.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:07.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581574+0000", 2024-04-26T12:07:07.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5350999999999998e-05 2024-04-26T12:07:07.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:07.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581620+0000", 2024-04-26T12:07:07.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5868999999999997e-05 2024-04-26T12:07:07.938 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.938 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:07.938 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.938 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 456028~3870 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:07.938 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:07.938 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.323753726, 2024-04-26T12:07:07.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055118997000000003, 2024-04-26T12:07:07.938 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:07.939 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:07.939 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:07.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:07.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:07.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:07.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:07.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:07.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528811+0000", 2024-04-26T12:07:07.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:07.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:07.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528887+0000", 2024-04-26T12:07:07.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5977999999999997e-05 2024-04-26T12:07:07.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:07.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528897+0000", 2024-04-26T12:07:07.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8730000000000002e-06 2024-04-26T12:07:07.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:07.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528901+0000", 2024-04-26T12:07:07.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4880000000000001e-06 2024-04-26T12:07:07.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:07.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580146+0000", 2024-04-26T12:07:07.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051244242000000002 2024-04-26T12:07:07.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:07.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580227+0000", 2024-04-26T12:07:07.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1044000000000005e-05 2024-04-26T12:07:07.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:07.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583864+0000", 2024-04-26T12:07:07.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036374419999999998 2024-04-26T12:07:07.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:07.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583894+0000", 2024-04-26T12:07:07.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9828999999999999e-05 2024-04-26T12:07:07.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:07.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583931+0000", 2024-04-26T12:07:07.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6908e-05 2024-04-26T12:07:07.942 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.943 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:07.943 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.943 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 459898~2037 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:07.943 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:07.943 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.323365734999999, 2024-04-26T12:07:07.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055925713000000002, 2024-04-26T12:07:07.943 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:07.943 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:07.943 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:07.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:07.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:07.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:07.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:07.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:07.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529199+0000", 2024-04-26T12:07:07.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:07.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:07.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529203+0000", 2024-04-26T12:07:07.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:07:07.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:07.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529209+0000", 2024-04-26T12:07:07.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7939999999999999e-06 2024-04-26T12:07:07.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:07.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529212+0000", 2024-04-26T12:07:07.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7290000000000002e-06 2024-04-26T12:07:07.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:07.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580784+0000", 2024-04-26T12:07:07.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051572073000000003 2024-04-26T12:07:07.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:07.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580883+0000", 2024-04-26T12:07:07.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8330000000000002e-05 2024-04-26T12:07:07.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:07.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585050+0000", 2024-04-26T12:07:07.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041670209999999999 2024-04-26T12:07:07.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:07.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585088+0000", 2024-04-26T12:07:07.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8559999999999997e-05 2024-04-26T12:07:07.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:07.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585125+0000", 2024-04-26T12:07:07.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7197999999999999e-05 2024-04-26T12:07:07.947 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.947 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:07.947 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.947 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 461935~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:07.947 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:07.948 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.322643281, 2024-04-26T12:07:07.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055266150999999999, 2024-04-26T12:07:07.948 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:07.948 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:07.948 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:07.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:07.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:07.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:07.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:07.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:07.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:07.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529921+0000", 2024-04-26T12:07:07.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:07.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:07.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529956+0000", 2024-04-26T12:07:07.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4687000000000002e-05 2024-04-26T12:07:07.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:07.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529966+0000", 2024-04-26T12:07:07.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0392e-05 2024-04-26T12:07:07.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:07.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529978+0000", 2024-04-26T12:07:07.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1348e-05 2024-04-26T12:07:07.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:07.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581659+0000", 2024-04-26T12:07:07.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051681454000000002 2024-04-26T12:07:07.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:07.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581746+0000", 2024-04-26T12:07:07.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6305999999999997e-05 2024-04-26T12:07:07.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:07.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585131+0000", 2024-04-26T12:07:07.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033853199999999998 2024-04-26T12:07:07.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:07.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585154+0000", 2024-04-26T12:07:07.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3258999999999999e-05 2024-04-26T12:07:07.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:07.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:07.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:07.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585188+0000", 2024-04-26T12:07:07.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4236000000000002e-05 2024-04-26T12:07:07.952 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.952 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:07.952 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.952 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:07.952 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:07.952 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:07.954 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:07:07.954 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:07.952+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:08.054 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:08.053+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:08.100 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:08.100 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:08.100 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:07:08.100 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:08.110 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:08.155 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:08.154+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:08.214 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:08.214 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:08.214 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:07:08.214 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:07:08.214 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:08.223 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:08.256 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:08.255+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:08.337 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:08.337 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:07:08.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:07:08.337 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:07:08.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.338 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2989 3.d 3:b02ffd62:::200.00000010:head [write 3767903~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:08.338 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:08.338 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 8.8188094439999993, 2024-04-26T12:07:08.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057069768999999999, 2024-04-26T12:07:08.338 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:08.338 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.338 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:08.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:08.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:08.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:08.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:08.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:08.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:08.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:08.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:08.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516446+0000", 2024-04-26T12:07:08.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6469999999999997e-06 2024-04-26T12:07:08.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.340 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:08.340 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516449+0000", 2024-04-26T12:07:08.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.976e-06 2024-04-26T12:07:08.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.340 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.340 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516452+0000", 2024-04-26T12:07:08.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.509e-06 2024-04-26T12:07:08.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.340 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:08.340 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.568562+0000", 2024-04-26T12:07:08.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.052110030000000002 2024-04-26T12:07:08.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:08.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.568615+0000", 2024-04-26T12:07:08.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2809999999999998e-05 2024-04-26T12:07:08.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:08.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573425+0000", 2024-04-26T12:07:08.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048105149999999996 2024-04-26T12:07:08.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:08.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573452+0000", 2024-04-26T12:07:08.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6778e-05 2024-04-26T12:07:08.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:08.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573512+0000", 2024-04-26T12:07:08.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9710000000000003e-05 2024-04-26T12:07:08.342 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.342 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:08.342 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.342 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2990 3.d 3:b02ffd62:::200.00000010:head [write 3769302~4483 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:08.342 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:08.342 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 8.8187974449999995, 2024-04-26T12:07:08.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057131345, 2024-04-26T12:07:08.342 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:08.343 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.343 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:08.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:08.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:08.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:08.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:08.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:08.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:08.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:08.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:08.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516459+0000", 2024-04-26T12:07:08.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2859999999999999e-06 2024-04-26T12:07:08.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:08.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516462+0000", 2024-04-26T12:07:08.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0790000000000001e-06 2024-04-26T12:07:08.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516465+0000", 2024-04-26T12:07:08.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.464e-06 2024-04-26T12:07:08.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:08.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569035+0000", 2024-04-26T12:07:08.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.052570328999999999 2024-04-26T12:07:08.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:08.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569113+0000", 2024-04-26T12:07:08.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8118e-05 2024-04-26T12:07:08.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:08.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573517+0000", 2024-04-26T12:07:08.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044039200000000004 2024-04-26T12:07:08.346 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.346 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:08.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573541+0000", 2024-04-26T12:07:08.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3805999999999999e-05 2024-04-26T12:07:08.346 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.346 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:08.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573585+0000", 2024-04-26T12:07:08.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4567000000000002e-05 2024-04-26T12:07:08.346 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.346 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:08.347 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.347 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2991 3.d 3:b02ffd62:::200.00000010:head [write 3773785~4213 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:08.347 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:08.347 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 8.8187847559999994, 2024-04-26T12:07:08.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057230554000000003, 2024-04-26T12:07:08.347 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:08.347 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.347 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:08.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:08.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:08.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.348 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:08.348 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:08.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.348 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:08.348 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516466+0000", 2024-04-26T12:07:08.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:08.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.348 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:08.348 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516470+0000", 2024-04-26T12:07:08.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7960000000000002e-06 2024-04-26T12:07:08.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:08.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516478+0000", 2024-04-26T12:07:08.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:07:08.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516484+0000", 2024-04-26T12:07:08.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5300000000000002e-06 2024-04-26T12:07:08.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:08.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569662+0000", 2024-04-26T12:07:08.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053177896000000002 2024-04-26T12:07:08.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:08.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569749+0000", 2024-04-26T12:07:08.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7229000000000001e-05 2024-04-26T12:07:08.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:08.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573593+0000", 2024-04-26T12:07:08.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038433109999999999 2024-04-26T12:07:08.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:08.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573631+0000", 2024-04-26T12:07:08.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8615000000000002e-05 2024-04-26T12:07:08.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:08.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573697+0000", 2024-04-26T12:07:08.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5971999999999998e-05 2024-04-26T12:07:08.351 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.351 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:08.351 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.351 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2999 3.d 3:b02ffd62:::200.00000010:head [write 3797283~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:08.351 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:08.352 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 8.8142703680000007, 2024-04-26T12:07:08.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057330949999999999, 2024-04-26T12:07:08.352 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:08.352 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.352 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:08.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:08.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:08.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:08.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:08.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.353 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:08.353 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520980+0000", 2024-04-26T12:07:08.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:08.353 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.353 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:08.353 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520991+0000", 2024-04-26T12:07:08.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1154e-05 2024-04-26T12:07:08.353 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.353 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:08.353 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521014+0000", 2024-04-26T12:07:08.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2288000000000001e-05 2024-04-26T12:07:08.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521019+0000", 2024-04-26T12:07:08.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0889999999999999e-06 2024-04-26T12:07:08.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:08.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.575399+0000", 2024-04-26T12:07:08.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054380392999999999 2024-04-26T12:07:08.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:08.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.575440+0000", 2024-04-26T12:07:08.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1146000000000002e-05 2024-04-26T12:07:08.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:08.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578237+0000", 2024-04-26T12:07:08.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002796761 2024-04-26T12:07:08.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:08.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578260+0000", 2024-04-26T12:07:08.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3538999999999999e-05 2024-04-26T12:07:08.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:08.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578312+0000", 2024-04-26T12:07:08.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1508999999999998e-05 2024-04-26T12:07:08.356 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.356 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:08.356 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.356 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3000 3.d 3:b02ffd62:::200.00000010:head [write 3801160~9028 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:08.356 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:08.356 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 8.8136444019999995, 2024-04-26T12:07:08.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.059231688999999997, 2024-04-26T12:07:08.356 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:08.356 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.356 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:08.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:08.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:08.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.357 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:08.357 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:08.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.357 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:08.357 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521606+0000", 2024-04-26T12:07:08.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:08.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.357 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:08.357 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521627+0000", 2024-04-26T12:07:08.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1129e-05 2024-04-26T12:07:08.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:08.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521637+0000", 2024-04-26T12:07:08.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8789999999999998e-06 2024-04-26T12:07:08.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521644+0000", 2024-04-26T12:07:08.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:07:08.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:08.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576381+0000", 2024-04-26T12:07:08.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.05473629 2024-04-26T12:07:08.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:08.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576451+0000", 2024-04-26T12:07:08.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0525000000000007e-05 2024-04-26T12:07:08.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:08.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580734+0000", 2024-04-26T12:07:08.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042826699999999997 2024-04-26T12:07:08.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:08.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580780+0000", 2024-04-26T12:07:08.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6006e-05 2024-04-26T12:07:08.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:08.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580839+0000", 2024-04-26T12:07:08.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8783000000000003e-05 2024-04-26T12:07:08.360 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.360 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:08.360 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.361 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3001 3.d 3:b02ffd62:::200.00000010:head [write 3810188~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:08.361 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:08.361 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 8.8130920699999997, 2024-04-26T12:07:08.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.060161213999999998, 2024-04-26T12:07:08.361 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:08.361 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.361 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:08.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:08.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:08.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:08.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:08.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.362 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:08.362 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522158+0000", 2024-04-26T12:07:08.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:08.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.362 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:08.362 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522165+0000", 2024-04-26T12:07:08.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.28e-06 2024-04-26T12:07:08.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:08.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522178+0000", 2024-04-26T12:07:08.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3738e-05 2024-04-26T12:07:08.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522186+0000", 2024-04-26T12:07:08.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.267e-06 2024-04-26T12:07:08.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:08.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576889+0000", 2024-04-26T12:07:08.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054703442999999997 2024-04-26T12:07:08.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:08.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576953+0000", 2024-04-26T12:07:08.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4213000000000003e-05 2024-04-26T12:07:08.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:08.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582185+0000", 2024-04-26T12:07:08.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052319209999999996 2024-04-26T12:07:08.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:08.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582243+0000", 2024-04-26T12:07:08.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7321999999999998e-05 2024-04-26T12:07:08.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:08.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582321+0000", 2024-04-26T12:07:08.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7911000000000007e-05 2024-04-26T12:07:08.365 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.365 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:08.365 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.365 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3002 3.d 3:b02ffd62:::200.00000010:head [write 3812103~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:08.365 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:08.365 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 8.8126233069999991, 2024-04-26T12:07:08.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.059796961000000003, 2024-04-26T12:07:08.365 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:08.365 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.366 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:08.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:08.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:08.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:08.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:08.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:08.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522627+0000", 2024-04-26T12:07:08.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:08.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:08.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522633+0000", 2024-04-26T12:07:08.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6699999999999999e-06 2024-04-26T12:07:08.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:08.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522643+0000", 2024-04-26T12:07:08.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6649999999999998e-06 2024-04-26T12:07:08.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522649+0000", 2024-04-26T12:07:08.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4200000000000004e-06 2024-04-26T12:07:08.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:08.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577413+0000", 2024-04-26T12:07:08.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054763714999999998 2024-04-26T12:07:08.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:08.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577460+0000", 2024-04-26T12:07:08.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7095000000000002e-05 2024-04-26T12:07:08.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:08.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582331+0000", 2024-04-26T12:07:08.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048716419999999998 2024-04-26T12:07:08.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:08.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582375+0000", 2024-04-26T12:07:08.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3053999999999998e-05 2024-04-26T12:07:08.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:08.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582425+0000", 2024-04-26T12:07:08.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0525000000000002e-05 2024-04-26T12:07:08.370 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.370 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:08.370 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.370 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3003 3.d 3:b02ffd62:::200.00000010:head [write 3814061~4170 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:08.370 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:08.370 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 8.8115682450000001, 2024-04-26T12:07:08.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058803394000000002, 2024-04-26T12:07:08.370 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:08.370 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.370 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:08.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:08.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:08.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:08.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:08.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:08.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523682+0000", 2024-04-26T12:07:08.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:08.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:08.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523690+0000", 2024-04-26T12:07:08.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0290000000000005e-06 2024-04-26T12:07:08.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:08.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523699+0000", 2024-04-26T12:07:08.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4589999999999998e-06 2024-04-26T12:07:08.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523703+0000", 2024-04-26T12:07:08.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6249999999999998e-06 2024-04-26T12:07:08.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.373 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:08.373 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577832+0000", 2024-04-26T12:07:08.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054128883000000003 2024-04-26T12:07:08.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.373 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:08.373 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577878+0000", 2024-04-26T12:07:08.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5841999999999999e-05 2024-04-26T12:07:08.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.373 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:08.373 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582430+0000", 2024-04-26T12:07:08.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045517270000000002 2024-04-26T12:07:08.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:08.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582453+0000", 2024-04-26T12:07:08.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3609999999999999e-05 2024-04-26T12:07:08.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:08.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582487+0000", 2024-04-26T12:07:08.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3080000000000002e-05 2024-04-26T12:07:08.374 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.374 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:08.374 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.375 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3004 3.d 3:b02ffd62:::200.00000010:head [write 3818231~3890 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:08.375 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:08.375 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 8.8107193220000006, 2024-04-26T12:07:08.375 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058024342999999999, 2024-04-26T12:07:08.375 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:08.375 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.375 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:08.375 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.375 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:08.375 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:08.375 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.375 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.375 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.375 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:08.376 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:08.376 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.376 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.376 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.376 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:08.376 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524531+0000", 2024-04-26T12:07:08.376 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:08.376 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.376 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.376 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:08.376 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524539+0000", 2024-04-26T12:07:08.376 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9249999999999995e-06 2024-04-26T12:07:08.376 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.376 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.376 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:08.377 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524547+0000", 2024-04-26T12:07:08.377 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5220000000000007e-06 2024-04-26T12:07:08.377 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.377 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.377 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.377 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524553+0000", 2024-04-26T12:07:08.377 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6659999999999996e-06 2024-04-26T12:07:08.377 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.377 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.377 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:08.377 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578335+0000", 2024-04-26T12:07:08.377 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.05378235 2024-04-26T12:07:08.377 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.377 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.378 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:08.378 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578378+0000", 2024-04-26T12:07:08.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2429999999999999e-05 2024-04-26T12:07:08.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.378 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.378 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:08.378 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582494+0000", 2024-04-26T12:07:08.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004116059 2024-04-26T12:07:08.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.378 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.378 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:08.378 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582519+0000", 2024-04-26T12:07:08.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4961999999999999e-05 2024-04-26T12:07:08.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.379 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:08.379 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582556+0000", 2024-04-26T12:07:08.379 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7728999999999997e-05 2024-04-26T12:07:08.379 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.379 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:08.379 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.379 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.379 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3005 3.d 3:b02ffd62:::200.00000010:head [write 3822121~5207 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:08.379 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:08.379 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 8.8103000659999999, 2024-04-26T12:07:08.379 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057662270000000002, 2024-04-26T12:07:08.379 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:08.380 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.380 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:08.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.380 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:08.380 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:08.380 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.380 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.380 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:08.380 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:08.380 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.380 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.380 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:08.380 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:08.381 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:08.381 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.381 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.381 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:08.381 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524961+0000", 2024-04-26T12:07:08.381 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0124e-05 2024-04-26T12:07:08.381 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.381 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.381 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:08.381 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524971+0000", 2024-04-26T12:07:08.381 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0200999999999999e-05 2024-04-26T12:07:08.381 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.381 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.381 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.381 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524979+0000", 2024-04-26T12:07:08.382 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5809999999999999e-06 2024-04-26T12:07:08.382 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.382 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.382 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:08.382 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578753+0000", 2024-04-26T12:07:08.382 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053774444999999997 2024-04-26T12:07:08.382 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.382 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.382 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:08.382 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578821+0000", 2024-04-26T12:07:08.382 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7640999999999998e-05 2024-04-26T12:07:08.382 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.382 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.383 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:08.383 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582561+0000", 2024-04-26T12:07:08.383 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037399870000000002 2024-04-26T12:07:08.383 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.383 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.383 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:08.383 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582582+0000", 2024-04-26T12:07:08.383 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0934999999999999e-05 2024-04-26T12:07:08.383 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.383 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.383 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:08.383 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582614+0000", 2024-04-26T12:07:08.383 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1948e-05 2024-04-26T12:07:08.383 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.384 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:08.384 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.384 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.384 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.384 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3006 3.d 3:b02ffd62:::200.00000010:head [write 3827328~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:08.384 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:08.384 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 8.8096667269999998, 2024-04-26T12:07:08.384 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057085404999999999, 2024-04-26T12:07:08.384 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:08.384 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.384 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:08.384 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.384 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:08.384 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:08.384 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.385 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.385 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.385 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:08.385 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:08.385 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.385 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.385 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.385 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:08.385 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525583+0000", 2024-04-26T12:07:08.385 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:08.385 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.385 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.385 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:08.385 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525594+0000", 2024-04-26T12:07:08.385 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0497e-05 2024-04-26T12:07:08.386 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.386 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.386 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:08.386 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525610+0000", 2024-04-26T12:07:08.386 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6392000000000002e-05 2024-04-26T12:07:08.386 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.386 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.386 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.386 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525621+0000", 2024-04-26T12:07:08.386 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0679999999999999e-05 2024-04-26T12:07:08.386 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.386 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.386 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:08.386 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.579270+0000", 2024-04-26T12:07:08.387 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053648802000000002 2024-04-26T12:07:08.387 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.387 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.387 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:08.387 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.579312+0000", 2024-04-26T12:07:08.387 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2268000000000003e-05 2024-04-26T12:07:08.387 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.387 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.387 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:08.387 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582618+0000", 2024-04-26T12:07:08.387 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033057049999999999 2024-04-26T12:07:08.387 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.387 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.387 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:08.388 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582637+0000", 2024-04-26T12:07:08.388 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9417000000000001e-05 2024-04-26T12:07:08.388 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.388 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.388 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:08.388 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582670+0000", 2024-04-26T12:07:08.388 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2969999999999998e-05 2024-04-26T12:07:08.388 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.388 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:08.388 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.388 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.388 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.388 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3015 3.d 3:b02ffd62:::200.00000010:head [write 3855113~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:08.388 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:08.388 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 8.7992109700000007, 2024-04-26T12:07:08.389 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057652729999999999, 2024-04-26T12:07:08.389 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:08.389 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.389 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:08.389 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.389 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:08.389 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:08.389 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.389 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.389 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.389 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:08.389 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:08.389 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.390 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.390 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.390 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:08.390 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:08.390 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:08.390 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.390 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.390 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:08.390 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536042+0000", 2024-04-26T12:07:08.390 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0849999999999999e-06 2024-04-26T12:07:08.390 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.390 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.390 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:08.390 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536046+0000", 2024-04-26T12:07:08.391 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:07:08.391 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.391 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.391 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.391 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536048+0000", 2024-04-26T12:07:08.391 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6019999999999998e-06 2024-04-26T12:07:08.391 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.391 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.391 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:08.391 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585409+0000", 2024-04-26T12:07:08.391 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.049360938 2024-04-26T12:07:08.392 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.392 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.392 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:08.392 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585506+0000", 2024-04-26T12:07:08.392 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6966999999999995e-05 2024-04-26T12:07:08.392 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.392 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.392 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:08.392 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593630+0000", 2024-04-26T12:07:08.392 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0081238160000000007 2024-04-26T12:07:08.392 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.392 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.392 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:08.392 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593656+0000", 2024-04-26T12:07:08.393 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6154000000000001e-05 2024-04-26T12:07:08.393 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.393 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.393 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:08.393 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593693+0000", 2024-04-26T12:07:08.393 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7185999999999999e-05 2024-04-26T12:07:08.393 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.393 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:08.393 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.393 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.393 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.393 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3016 3.d 3:b02ffd62:::200.00000010:head [write 3857020~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:08.393 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:08.393 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 8.7992010230000002, 2024-04-26T12:07:08.393 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058678157000000002, 2024-04-26T12:07:08.394 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:08.394 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.394 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:08.394 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.394 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:08.394 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:08.394 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.394 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.394 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.394 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:08.394 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:08.394 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.394 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.395 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.395 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:08.395 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:08.395 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:08.395 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.395 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.395 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:08.395 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536055+0000", 2024-04-26T12:07:08.395 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3669999999999999e-06 2024-04-26T12:07:08.395 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.395 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.395 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:08.395 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536058+0000", 2024-04-26T12:07:08.395 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3220000000000001e-06 2024-04-26T12:07:08.395 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.396 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.396 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.396 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536062+0000", 2024-04-26T12:07:08.396 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1520000000000002e-06 2024-04-26T12:07:08.396 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.396 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.396 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:08.396 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585965+0000", 2024-04-26T12:07:08.396 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.049902769999999999 2024-04-26T12:07:08.396 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.396 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.396 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:08.396 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586046+0000", 2024-04-26T12:07:08.396 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1032999999999995e-05 2024-04-26T12:07:08.397 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.397 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.397 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:08.397 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594667+0000", 2024-04-26T12:07:08.397 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0086214599999999992 2024-04-26T12:07:08.397 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.397 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.397 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:08.397 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594692+0000", 2024-04-26T12:07:08.397 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5191999999999999e-05 2024-04-26T12:07:08.397 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.397 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.397 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:08.397 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594729+0000", 2024-04-26T12:07:08.397 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6069000000000003e-05 2024-04-26T12:07:08.398 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.398 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:08.398 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.398 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.398 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.398 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3017 3.d 3:b02ffd62:::200.00000010:head [write 3859438~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:08.398 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:08.398 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 8.7991869390000002, 2024-04-26T12:07:08.398 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058723814999999999, 2024-04-26T12:07:08.398 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:08.398 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.398 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:08.398 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.398 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:08.399 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:08.399 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.399 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.399 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.399 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:08.399 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:08.399 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.399 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.399 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.399 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:08.399 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:08.399 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:08.399 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.399 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.399 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:08.400 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536066+0000", 2024-04-26T12:07:08.400 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8840000000000001e-06 2024-04-26T12:07:08.400 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.400 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.400 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:08.400 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536069+0000", 2024-04-26T12:07:08.400 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:07:08.400 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.400 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.400 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.400 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536072+0000", 2024-04-26T12:07:08.401 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4449999999999999e-06 2024-04-26T12:07:08.401 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.401 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.401 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:08.401 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586703+0000", 2024-04-26T12:07:08.401 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050631618000000003 2024-04-26T12:07:08.401 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.401 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.401 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:08.401 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586748+0000", 2024-04-26T12:07:08.401 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4682999999999999e-05 2024-04-26T12:07:08.401 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.401 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.401 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:08.401 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594734+0000", 2024-04-26T12:07:08.402 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079860369999999996 2024-04-26T12:07:08.402 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.402 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.402 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:08.402 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594756+0000", 2024-04-26T12:07:08.402 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1738000000000001e-05 2024-04-26T12:07:08.402 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.402 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.402 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:08.402 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594788+0000", 2024-04-26T12:07:08.402 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2604999999999997e-05 2024-04-26T12:07:08.402 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.402 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:08.402 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.403 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3018 3.d 3:b02ffd62:::200.00000010:head [write 3861345~3221 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:08.403 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:08.403 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 8.7983542519999993, 2024-04-26T12:07:08.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057946174000000003, 2024-04-26T12:07:08.403 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:08.403 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.403 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:08.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.403 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:08.403 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:08.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:08.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:08.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:08.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536896+0000", 2024-04-26T12:07:08.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:08.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:08.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536905+0000", 2024-04-26T12:07:08.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7839999999999998e-06 2024-04-26T12:07:08.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.405 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:08.405 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536929+0000", 2024-04-26T12:07:08.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3561999999999999e-05 2024-04-26T12:07:08.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.405 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.405 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536940+0000", 2024-04-26T12:07:08.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0742e-05 2024-04-26T12:07:08.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.405 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:08.405 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.587238+0000", 2024-04-26T12:07:08.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050297962000000002 2024-04-26T12:07:08.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:08.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.587315+0000", 2024-04-26T12:07:08.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7848000000000004e-05 2024-04-26T12:07:08.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:08.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594792+0000", 2024-04-26T12:07:08.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074766240000000003 2024-04-26T12:07:08.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:08.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594813+0000", 2024-04-26T12:07:08.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0876000000000001e-05 2024-04-26T12:07:08.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.407 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:08.407 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594843+0000", 2024-04-26T12:07:08.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0434999999999999e-05 2024-04-26T12:07:08.407 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.407 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:08.407 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.407 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3019 3.d 3:b02ffd62:::200.00000010:head [write 3864566~3989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:08.407 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:08.407 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 8.7966118919999996, 2024-04-26T12:07:08.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.061000094999999997, 2024-04-26T12:07:08.408 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:08.408 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.408 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:08.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:08.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:08.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:08.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:08.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:08.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538638+0000", 2024-04-26T12:07:08.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999981 2024-04-26T12:07:08.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:08.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538669+0000", 2024-04-26T12:07:08.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1689000000000001e-05 2024-04-26T12:07:08.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:08.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538703+0000", 2024-04-26T12:07:08.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3309000000000002e-05 2024-04-26T12:07:08.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538746+0000", 2024-04-26T12:07:08.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2803999999999999e-05 2024-04-26T12:07:08.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.410 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:08.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.589467+0000", 2024-04-26T12:07:08.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050721912000000001 2024-04-26T12:07:08.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.410 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:08.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.589517+0000", 2024-04-26T12:07:08.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9549999999999998e-05 2024-04-26T12:07:08.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:08.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599577+0000", 2024-04-26T12:07:08.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010059593 2024-04-26T12:07:08.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:08.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599603+0000", 2024-04-26T12:07:08.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6821e-05 2024-04-26T12:07:08.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:08.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599640+0000", 2024-04-26T12:07:08.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6177999999999998e-05 2024-04-26T12:07:08.411 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.411 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:08.412 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.412 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3020 3.d 3:b02ffd62:::200.00000010:head [write 3868555~7563 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:08.412 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:08.412 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 8.7939990570000006, 2024-04-26T12:07:08.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058446867, 2024-04-26T12:07:08.412 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:08.412 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.412 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:08.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:08.412 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:08.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:08.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:08.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:08.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541251+0000", 2024-04-26T12:07:08.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:08.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:08.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541286+0000", 2024-04-26T12:07:08.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4845999999999998e-05 2024-04-26T12:07:08.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.414 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.414 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:08.414 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541300+0000", 2024-04-26T12:07:08.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4251e-05 2024-04-26T12:07:08.414 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.414 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.414 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.414 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541307+0000", 2024-04-26T12:07:08.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3819999999999998e-06 2024-04-26T12:07:08.414 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.414 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.414 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:08.414 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.592596+0000", 2024-04-26T12:07:08.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051288215999999998 2024-04-26T12:07:08.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:08.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.592675+0000", 2024-04-26T12:07:08.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9197999999999996e-05 2024-04-26T12:07:08.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:08.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599645+0000", 2024-04-26T12:07:08.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069701759999999998 2024-04-26T12:07:08.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:08.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599667+0000", 2024-04-26T12:07:08.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2118999999999999e-05 2024-04-26T12:07:08.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:08.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599699+0000", 2024-04-26T12:07:08.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2048999999999998e-05 2024-04-26T12:07:08.416 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.416 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:08.416 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.416 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3021 3.d 3:b02ffd62:::200.00000010:head [write 3876118~3791 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:08.416 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:08.416 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 8.7939373199999995, 2024-04-26T12:07:08.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058441157000000001, 2024-04-26T12:07:08.417 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:08.417 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.417 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:08.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:08.417 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:08.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:08.417 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:08.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:08.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:08.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:08.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:08.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541323+0000", 2024-04-26T12:07:08.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5510000000000005e-06 2024-04-26T12:07:08.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:08.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541327+0000", 2024-04-26T12:07:08.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2520000000000001e-06 2024-04-26T12:07:08.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541330+0000", 2024-04-26T12:07:08.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:07:08.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:08.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593229+0000", 2024-04-26T12:07:08.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051898044999999997 2024-04-26T12:07:08.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:08.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593278+0000", 2024-04-26T12:07:08.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9506999999999999e-05 2024-04-26T12:07:08.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:08.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599704+0000", 2024-04-26T12:07:08.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064259570000000004 2024-04-26T12:07:08.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:08.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599725+0000", 2024-04-26T12:07:08.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0562999999999999e-05 2024-04-26T12:07:08.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:08.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599755+0000", 2024-04-26T12:07:08.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0710000000000002e-05 2024-04-26T12:07:08.421 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.421 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:08.421 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.421 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3022 3.d 3:b02ffd62:::200.00000010:head [write 3879909~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:08.421 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:08.421 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 8.7926882509999995, 2024-04-26T12:07:08.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057246689000000003, 2024-04-26T12:07:08.421 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:08.421 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.421 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:08.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:08.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:08.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:08.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:08.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:08.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542561+0000", 2024-04-26T12:07:08.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999981 2024-04-26T12:07:08.423 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.423 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:08.423 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542570+0000", 2024-04-26T12:07:08.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9199999999999993e-06 2024-04-26T12:07:08.423 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.423 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:08.423 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542583+0000", 2024-04-26T12:07:08.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2227e-05 2024-04-26T12:07:08.423 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.423 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.423 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542598+0000", 2024-04-26T12:07:08.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5199e-05 2024-04-26T12:07:08.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:08.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593728+0000", 2024-04-26T12:07:08.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051129846 2024-04-26T12:07:08.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:08.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593806+0000", 2024-04-26T12:07:08.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8425999999999998e-05 2024-04-26T12:07:08.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:08.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599760+0000", 2024-04-26T12:07:08.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0059537399999999999 2024-04-26T12:07:08.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:08.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599779+0000", 2024-04-26T12:07:08.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9619e-05 2024-04-26T12:07:08.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:08.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599810+0000", 2024-04-26T12:07:08.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0508999999999999e-05 2024-04-26T12:07:08.425 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.425 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:08.425 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.426 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3023 3.d 3:b02ffd62:::200.00000010:head [write 3881868~5748 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:08.426 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:08.426 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 8.7922164029999994, 2024-04-26T12:07:08.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.056829994000000002, 2024-04-26T12:07:08.426 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:08.426 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.426 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:08.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.426 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:08.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:08.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.427 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:08.427 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:08.427 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:08.427 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.427 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.427 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:08.427 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543034+0000", 2024-04-26T12:07:08.427 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:08.427 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.427 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.427 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:08.427 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543044+0000", 2024-04-26T12:07:08.427 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0444e-05 2024-04-26T12:07:08.427 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.427 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:08.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543055+0000", 2024-04-26T12:07:08.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.096e-05 2024-04-26T12:07:08.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543063+0000", 2024-04-26T12:07:08.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2689999999999999e-06 2024-04-26T12:07:08.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:08.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594265+0000", 2024-04-26T12:07:08.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051201325999999998 2024-04-26T12:07:08.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:08.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594311+0000", 2024-04-26T12:07:08.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5918000000000003e-05 2024-04-26T12:07:08.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:08.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599815+0000", 2024-04-26T12:07:08.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055038370000000001 2024-04-26T12:07:08.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:08.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599834+0000", 2024-04-26T12:07:08.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9942e-05 2024-04-26T12:07:08.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:08.430 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:08.430 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:08.430 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599865+0000", 2024-04-26T12:07:08.430 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0549000000000002e-05 2024-04-26T12:07:08.430 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.430 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:08.430 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.430 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:08.430 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:08.430 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:08.432 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:08.430+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:08.432 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:07:08.535 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:08.534+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:08.541 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:08.541 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:07:08.541 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:07:08.541 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:08.550 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:07:08.558 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-26T12:07:08.636 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:08.635+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:08.654 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:08.654 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:07:08.655 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:07:08.655 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:07:08.655 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:08.664 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:07:08.748 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:08.747+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:08.811 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:08.811 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:07:08.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:07:08.811 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:07:08.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.811 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:536 3.2 3:4272d415:::200.0000000b:head [write 405817~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:08.811 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:08.811 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 14.28409226, 2024-04-26T12:07:08.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053030282999999998, 2024-04-26T12:07:08.811 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:08.812 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.812 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:08.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:08.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:08.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:08.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:08.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:08.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524136+0000", 2024-04-26T12:07:08.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:08.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:08.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524139+0000", 2024-04-26T12:07:08.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2919999999999998e-06 2024-04-26T12:07:08.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:08.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524144+0000", 2024-04-26T12:07:08.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.502e-06 2024-04-26T12:07:08.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524149+0000", 2024-04-26T12:07:08.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7310000000000001e-06 2024-04-26T12:07:08.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:08.815 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570935+0000", 2024-04-26T12:07:08.815 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.046785603000000002 2024-04-26T12:07:08.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.815 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:08.815 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570981+0000", 2024-04-26T12:07:08.815 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6085999999999999e-05 2024-04-26T12:07:08.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.815 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:08.816 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577039+0000", 2024-04-26T12:07:08.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060582099999999996 2024-04-26T12:07:08.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.816 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:08.816 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577081+0000", 2024-04-26T12:07:08.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1927e-05 2024-04-26T12:07:08.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.816 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:08.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577167+0000", 2024-04-26T12:07:08.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6311999999999996e-05 2024-04-26T12:07:08.817 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.817 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:08.817 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.817 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.817 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:537 3.2 3:4272d415:::200.0000000b:head [write 407216~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:08.817 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:08.817 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 14.284076322000001, 2024-04-26T12:07:08.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053131411000000003, 2024-04-26T12:07:08.817 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:08.817 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.817 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:08.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:08.818 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:08.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:08.818 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:08.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:08.818 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524152+0000", 2024-04-26T12:07:08.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:08.819 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.819 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.819 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:08.819 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524157+0000", 2024-04-26T12:07:08.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3529999999999997e-06 2024-04-26T12:07:08.819 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.819 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:08.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524162+0000", 2024-04-26T12:07:08.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5910000000000003e-06 2024-04-26T12:07:08.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524170+0000", 2024-04-26T12:07:08.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:07:08.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:08.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571323+0000", 2024-04-26T12:07:08.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047153289000000001 2024-04-26T12:07:08.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.821 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.821 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:08.821 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571367+0000", 2024-04-26T12:07:08.821 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4205000000000001e-05 2024-04-26T12:07:08.821 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.821 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.821 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:08.821 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577174+0000", 2024-04-26T12:07:08.821 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058072250000000001 2024-04-26T12:07:08.821 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.822 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:08.822 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577218+0000", 2024-04-26T12:07:08.822 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3294999999999998e-05 2024-04-26T12:07:08.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.822 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:08.822 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577284+0000", 2024-04-26T12:07:08.822 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6483999999999996e-05 2024-04-26T12:07:08.822 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.822 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:08.822 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.823 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:538 3.2 3:4272d415:::200.0000000b:head [write 408629~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:08.823 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:08.823 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 14.284055622, 2024-04-26T12:07:08.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053241841999999998, 2024-04-26T12:07:08.823 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:08.823 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.823 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:08.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:08.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:08.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:08.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:08.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:08.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:08.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:08.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:08.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524178+0000", 2024-04-26T12:07:08.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1420000000000001e-06 2024-04-26T12:07:08.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:08.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524184+0000", 2024-04-26T12:07:08.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4240000000000001e-06 2024-04-26T12:07:08.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524188+0000", 2024-04-26T12:07:08.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2710000000000003e-06 2024-04-26T12:07:08.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:08.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571623+0000", 2024-04-26T12:07:08.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047435119999999997 2024-04-26T12:07:08.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:08.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571668+0000", 2024-04-26T12:07:08.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5377000000000003e-05 2024-04-26T12:07:08.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:08.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577292+0000", 2024-04-26T12:07:08.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0056232030000000002 2024-04-26T12:07:08.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:08.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577330+0000", 2024-04-26T12:07:08.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8748999999999998e-05 2024-04-26T12:07:08.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:08.828 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577415+0000", 2024-04-26T12:07:08.828 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4913000000000005e-05 2024-04-26T12:07:08.828 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.828 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:08.828 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.828 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.828 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.828 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:539 3.2 3:4272d415:::200.0000000b:head [write 410547~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:08.828 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:08.828 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 14.284037489999999, 2024-04-26T12:07:08.828 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053372670999999997, 2024-04-26T12:07:08.828 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:08.828 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.828 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:08.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:08.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:08.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:08.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:08.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:08.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524191+0000", 2024-04-26T12:07:08.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:08.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:08.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524199+0000", 2024-04-26T12:07:08.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6520000000000006e-06 2024-04-26T12:07:08.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:08.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524205+0000", 2024-04-26T12:07:08.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:07:08.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.831 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524209+0000", 2024-04-26T12:07:08.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.335e-06 2024-04-26T12:07:08.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.831 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:08.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572320+0000", 2024-04-26T12:07:08.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048110992999999998 2024-04-26T12:07:08.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.831 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:08.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572364+0000", 2024-04-26T12:07:08.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4577999999999999e-05 2024-04-26T12:07:08.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:08.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577426+0000", 2024-04-26T12:07:08.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050615139999999996 2024-04-26T12:07:08.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:08.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577480+0000", 2024-04-26T12:07:08.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3599e-05 2024-04-26T12:07:08.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:08.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577564+0000", 2024-04-26T12:07:08.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4699999999999999e-05 2024-04-26T12:07:08.833 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.833 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:08.833 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.833 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:540 3.2 3:4272d415:::200.0000000b:head [write 411948~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:08.833 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:08.833 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 14.284016471999999, 2024-04-26T12:07:08.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053497045999999999, 2024-04-26T12:07:08.833 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:08.834 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.834 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:08.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.834 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:08.834 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:08.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.834 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.834 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:08.834 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:08.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.834 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.834 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:08.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524212+0000", 2024-04-26T12:07:08.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:08.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:08.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524215+0000", 2024-04-26T12:07:08.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.559e-06 2024-04-26T12:07:08.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:08.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524220+0000", 2024-04-26T12:07:08.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2920000000000003e-06 2024-04-26T12:07:08.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524224+0000", 2024-04-26T12:07:08.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3680000000000004e-06 2024-04-26T12:07:08.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:08.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572619+0000", 2024-04-26T12:07:08.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048394549000000002 2024-04-26T12:07:08.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:08.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572669+0000", 2024-04-26T12:07:08.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0249e-05 2024-04-26T12:07:08.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:08.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577575+0000", 2024-04-26T12:07:08.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049053329999999996 2024-04-26T12:07:08.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:08.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577625+0000", 2024-04-26T12:07:08.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0274e-05 2024-04-26T12:07:08.838 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.838 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:08.838 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577710+0000", 2024-04-26T12:07:08.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4741999999999996e-05 2024-04-26T12:07:08.838 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.838 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:08.838 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.838 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.839 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:543 3.2 3:4272d415:::200.0000000b:head [write 413907~2485 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:08.839 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:08.839 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 14.283946778000001, 2024-04-26T12:07:08.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053578708000000003, 2024-04-26T12:07:08.839 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:08.839 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.839 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:08.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:08.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:08.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:08.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:08.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:08.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:08.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:08.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:08.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524287+0000", 2024-04-26T12:07:08.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2190000000000003e-06 2024-04-26T12:07:08.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:08.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524294+0000", 2024-04-26T12:07:08.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5660000000000003e-06 2024-04-26T12:07:08.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524298+0000", 2024-04-26T12:07:08.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3900000000000003e-06 2024-04-26T12:07:08.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:08.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572992+0000", 2024-04-26T12:07:08.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048693835999999997 2024-04-26T12:07:08.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:08.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573045+0000", 2024-04-26T12:07:08.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2793000000000001e-05 2024-04-26T12:07:08.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:08.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577721+0000", 2024-04-26T12:07:08.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046760550000000001 2024-04-26T12:07:08.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:08.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577777+0000", 2024-04-26T12:07:08.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5908000000000001e-05 2024-04-26T12:07:08.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:08.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577861+0000", 2024-04-26T12:07:08.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4337000000000002e-05 2024-04-26T12:07:08.843 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.843 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:08.843 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.844 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:544 3.2 3:4272d415:::200.0000000b:head [write 416392~3872 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:08.844 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:08.844 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 14.283927056, 2024-04-26T12:07:08.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054810527999999997, 2024-04-26T12:07:08.844 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:08.844 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.844 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:08.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.844 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:08.844 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:08.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.844 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.844 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:08.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:08.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:08.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:08.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:08.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:08.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524307+0000", 2024-04-26T12:07:08.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1580000000000004e-06 2024-04-26T12:07:08.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:08.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524312+0000", 2024-04-26T12:07:08.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6380000000000001e-06 2024-04-26T12:07:08.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.846 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524317+0000", 2024-04-26T12:07:08.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4000000000000002e-06 2024-04-26T12:07:08.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.846 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:08.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573348+0000", 2024-04-26T12:07:08.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049031433999999999 2024-04-26T12:07:08.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:08.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573393+0000", 2024-04-26T12:07:08.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4536999999999997e-05 2024-04-26T12:07:08.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:08.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578978+0000", 2024-04-26T12:07:08.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055848299999999998 2024-04-26T12:07:08.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:08.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579031+0000", 2024-04-26T12:07:08.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3708000000000001e-05 2024-04-26T12:07:08.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:08.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579113+0000", 2024-04-26T12:07:08.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1258e-05 2024-04-26T12:07:08.848 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.848 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:08.848 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.848 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:545 3.2 3:4272d415:::200.0000000b:head [write 420264~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:08.848 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:08.848 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 14.28390843, 2024-04-26T12:07:08.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054927386000000002, 2024-04-26T12:07:08.848 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:08.848 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.849 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:08.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:08.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:08.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:08.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:08.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:08.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524320+0000", 2024-04-26T12:07:08.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:08.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.850 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:08.850 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524325+0000", 2024-04-26T12:07:08.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5249999999999999e-06 2024-04-26T12:07:08.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.850 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:08.850 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524330+0000", 2024-04-26T12:07:08.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5629999999999999e-06 2024-04-26T12:07:08.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524335+0000", 2024-04-26T12:07:08.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.685e-06 2024-04-26T12:07:08.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:08.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573727+0000", 2024-04-26T12:07:08.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049392034000000001 2024-04-26T12:07:08.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:08.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573775+0000", 2024-04-26T12:07:08.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7435999999999998e-05 2024-04-26T12:07:08.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:08.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579120+0000", 2024-04-26T12:07:08.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0053452949999999999 2024-04-26T12:07:08.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:08.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579167+0000", 2024-04-26T12:07:08.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7240000000000002e-05 2024-04-26T12:07:08.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:08.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579248+0000", 2024-04-26T12:07:08.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0947999999999998e-05 2024-04-26T12:07:08.853 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.853 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:08.853 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.853 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 422222~8537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:08.853 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:08.853 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 14.283890113, 2024-04-26T12:07:08.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055065936000000003, 2024-04-26T12:07:08.854 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:08.854 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.854 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:08.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:08.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:08.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:08.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:08.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:08.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:08.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:08.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:08.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524347+0000", 2024-04-26T12:07:08.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7129999999999994e-06 2024-04-26T12:07:08.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:08.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524357+0000", 2024-04-26T12:07:08.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0232e-05 2024-04-26T12:07:08.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524362+0000", 2024-04-26T12:07:08.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:07:08.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:08.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574119+0000", 2024-04-26T12:07:08.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049756727000000001 2024-04-26T12:07:08.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:08.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574166+0000", 2024-04-26T12:07:08.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7086000000000003e-05 2024-04-26T12:07:08.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:08.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579261+0000", 2024-04-26T12:07:08.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050948310000000002 2024-04-26T12:07:08.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:08.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579316+0000", 2024-04-26T12:07:08.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5068000000000002e-05 2024-04-26T12:07:08.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:08.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579405+0000", 2024-04-26T12:07:08.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9251000000000003e-05 2024-04-26T12:07:08.858 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.858 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:08.858 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.858 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 430759~2035 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:08.858 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:08.858 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 14.283863123, 2024-04-26T12:07:08.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055164950999999997, 2024-04-26T12:07:08.858 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:08.858 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.859 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:08.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:08.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:08.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:08.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:08.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:08.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:08.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:08.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:08.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524368+0000", 2024-04-26T12:07:08.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.57e-06 2024-04-26T12:07:08.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:08.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524375+0000", 2024-04-26T12:07:08.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6170000000000003e-06 2024-04-26T12:07:08.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524380+0000", 2024-04-26T12:07:08.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2700000000000004e-06 2024-04-26T12:07:08.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:08.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574639+0000", 2024-04-26T12:07:08.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050259459999999999 2024-04-26T12:07:08.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:08.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574687+0000", 2024-04-26T12:07:08.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7608999999999998e-05 2024-04-26T12:07:08.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:08.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579414+0000", 2024-04-26T12:07:08.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047268750000000002 2024-04-26T12:07:08.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:08.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579456+0000", 2024-04-26T12:07:08.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1885000000000003e-05 2024-04-26T12:07:08.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:08.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579531+0000", 2024-04-26T12:07:08.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5053000000000001e-05 2024-04-26T12:07:08.862 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.862 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:08.863 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.863 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 432794~10523 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:08.863 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:08.863 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 14.282872399, 2024-04-26T12:07:08.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054314727, 2024-04-26T12:07:08.863 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:08.863 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.863 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:08.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:08.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:08.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:08.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:08.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:08.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525356+0000", 2024-04-26T12:07:08.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:08.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:08.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525414+0000", 2024-04-26T12:07:08.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8148e-05 2024-04-26T12:07:08.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:08.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525423+0000", 2024-04-26T12:07:08.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9749999999999996e-06 2024-04-26T12:07:08.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525428+0000", 2024-04-26T12:07:08.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0270000000000003e-06 2024-04-26T12:07:08.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:08.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574950+0000", 2024-04-26T12:07:08.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049521840999999997 2024-04-26T12:07:08.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:08.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575002+0000", 2024-04-26T12:07:08.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1586999999999999e-05 2024-04-26T12:07:08.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:08.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579543+0000", 2024-04-26T12:07:08.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045416340000000001 2024-04-26T12:07:08.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:08.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579587+0000", 2024-04-26T12:07:08.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3875999999999998e-05 2024-04-26T12:07:08.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:08.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579671+0000", 2024-04-26T12:07:08.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4351999999999995e-05 2024-04-26T12:07:08.867 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.867 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:08.867 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.867 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 443317~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:08.867 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:08.868 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 14.282796424000001, 2024-04-26T12:07:08.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054381889000000003, 2024-04-26T12:07:08.868 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:08.868 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.868 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:08.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:08.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:08.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:08.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:08.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.869 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:08.869 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525432+0000", 2024-04-26T12:07:08.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:08.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.869 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:08.869 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525435+0000", 2024-04-26T12:07:08.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3070000000000001e-06 2024-04-26T12:07:08.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.869 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:08.869 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525439+0000", 2024-04-26T12:07:08.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.104e-06 2024-04-26T12:07:08.870 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.870 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525442+0000", 2024-04-26T12:07:08.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0460000000000001e-06 2024-04-26T12:07:08.870 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.870 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:08.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575405+0000", 2024-04-26T12:07:08.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049963059999999997 2024-04-26T12:07:08.870 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.870 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:08.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575450+0000", 2024-04-26T12:07:08.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5034000000000003e-05 2024-04-26T12:07:08.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:08.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579680+0000", 2024-04-26T12:07:08.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042302260000000001 2024-04-26T12:07:08.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:08.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579737+0000", 2024-04-26T12:07:08.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7241000000000003e-05 2024-04-26T12:07:08.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:08.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579815+0000", 2024-04-26T12:07:08.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7278000000000001e-05 2024-04-26T12:07:08.873 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.873 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:08.873 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.873 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 445275~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:08.873 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:08.873 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 14.282369248, 2024-04-26T12:07:08.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054094668999999998, 2024-04-26T12:07:08.874 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:08.874 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.874 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:08.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:08.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:08.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:08.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:08.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:08.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525859+0000", 2024-04-26T12:07:08.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:08.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:08.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525864+0000", 2024-04-26T12:07:08.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:07:08.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:08.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525872+0000", 2024-04-26T12:07:08.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6790000000000005e-06 2024-04-26T12:07:08.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525877+0000", 2024-04-26T12:07:08.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0529999999999997e-06 2024-04-26T12:07:08.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:08.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575723+0000", 2024-04-26T12:07:08.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049846469999999997 2024-04-26T12:07:08.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:08.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575770+0000", 2024-04-26T12:07:08.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6387999999999997e-05 2024-04-26T12:07:08.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:08.877 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579823+0000", 2024-04-26T12:07:08.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0040534189999999999 2024-04-26T12:07:08.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:08.877 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579869+0000", 2024-04-26T12:07:08.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6218999999999999e-05 2024-04-26T12:07:08.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:08.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579954+0000", 2024-04-26T12:07:08.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5315999999999994e-05 2024-04-26T12:07:08.878 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.878 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:08.878 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.878 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.878 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:551 3.2 3:4272d415:::200.0000000b:head [write 448232~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:08.878 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:08.878 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 14.281921814, 2024-04-26T12:07:08.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053798273000000001, 2024-04-26T12:07:08.878 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:08.878 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.878 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:08.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:08.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:08.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:08.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:08.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:08.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:08.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:08.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:08.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526310+0000", 2024-04-26T12:07:08.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5279999999999999e-06 2024-04-26T12:07:08.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:08.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526317+0000", 2024-04-26T12:07:08.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8430000000000004e-06 2024-04-26T12:07:08.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526322+0000", 2024-04-26T12:07:08.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3340000000000001e-06 2024-04-26T12:07:08.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:08.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576135+0000", 2024-04-26T12:07:08.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049812113999999998 2024-04-26T12:07:08.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:08.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576186+0000", 2024-04-26T12:07:08.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1443999999999997e-05 2024-04-26T12:07:08.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:08.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579962+0000", 2024-04-26T12:07:08.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037763359999999999 2024-04-26T12:07:08.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.882 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:08.882 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580016+0000", 2024-04-26T12:07:08.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3421000000000002e-05 2024-04-26T12:07:08.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.882 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:08.882 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580106+0000", 2024-04-26T12:07:08.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9790000000000006e-05 2024-04-26T12:07:08.882 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.882 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:08.882 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.882 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 450189~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:08.882 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:08.883 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 14.281841685, 2024-04-26T12:07:08.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055070796999999998, 2024-04-26T12:07:08.883 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:08.883 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.883 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:08.883 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.883 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:08.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:08.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.883 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.883 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:08.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:08.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:08.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:08.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:08.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:08.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526390+0000", 2024-04-26T12:07:08.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8559999999999998e-06 2024-04-26T12:07:08.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:08.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526395+0000", 2024-04-26T12:07:08.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3319999999999999e-06 2024-04-26T12:07:08.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526399+0000", 2024-04-26T12:07:08.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.619e-06 2024-04-26T12:07:08.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:08.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576476+0000", 2024-04-26T12:07:08.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050077643999999998 2024-04-26T12:07:08.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:08.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576524+0000", 2024-04-26T12:07:08.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7184000000000001e-05 2024-04-26T12:07:08.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:08.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581347+0000", 2024-04-26T12:07:08.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0048231919999999996 2024-04-26T12:07:08.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:08.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581398+0000", 2024-04-26T12:07:08.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1345999999999999e-05 2024-04-26T12:07:08.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:08.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581458+0000", 2024-04-26T12:07:08.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0081000000000003e-05 2024-04-26T12:07:08.887 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.887 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:08.887 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.887 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.887 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 452113~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:08.887 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:08.887 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 14.281730468999999, 2024-04-26T12:07:08.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055041448, 2024-04-26T12:07:08.887 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:08.887 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.887 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:08.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:08.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:08.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:08.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:08.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:08.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526498+0000", 2024-04-26T12:07:08.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:08.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:08.889 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526540+0000", 2024-04-26T12:07:08.889 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2267e-05 2024-04-26T12:07:08.889 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.889 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.889 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:08.889 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526547+0000", 2024-04-26T12:07:08.889 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7000000000000002e-06 2024-04-26T12:07:08.889 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.889 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.889 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.889 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526550+0000", 2024-04-26T12:07:08.889 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0299999999999998e-06 2024-04-26T12:07:08.889 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.889 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.889 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:08.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577902+0000", 2024-04-26T12:07:08.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051351648999999999 2024-04-26T12:07:08.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:08.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577953+0000", 2024-04-26T12:07:08.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1289000000000003e-05 2024-04-26T12:07:08.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:08.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581464+0000", 2024-04-26T12:07:08.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035111259999999998 2024-04-26T12:07:08.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:08.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581490+0000", 2024-04-26T12:07:08.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5717000000000001e-05 2024-04-26T12:07:08.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:08.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581540+0000", 2024-04-26T12:07:08.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0287999999999997e-05 2024-04-26T12:07:08.891 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.891 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:08.891 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.891 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 454070~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:08.891 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:08.891 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 14.281173519999999, 2024-04-26T12:07:08.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054564161, 2024-04-26T12:07:08.892 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:08.892 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.892 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:08.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:08.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:08.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:08.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:08.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:08.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527055+0000", 2024-04-26T12:07:08.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:08.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:08.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527058+0000", 2024-04-26T12:07:08.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9890000000000001e-06 2024-04-26T12:07:08.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:08.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527066+0000", 2024-04-26T12:07:08.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4730000000000003e-06 2024-04-26T12:07:08.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.894 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527069+0000", 2024-04-26T12:07:08.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5810000000000001e-06 2024-04-26T12:07:08.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.894 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:08.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578308+0000", 2024-04-26T12:07:08.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051238911999999998 2024-04-26T12:07:08.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.894 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:08.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578391+0000", 2024-04-26T12:07:08.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2713999999999994e-05 2024-04-26T12:07:08.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.895 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:08.895 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581548+0000", 2024-04-26T12:07:08.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031577530000000001 2024-04-26T12:07:08.895 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.895 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:08.895 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581574+0000", 2024-04-26T12:07:08.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5350999999999998e-05 2024-04-26T12:07:08.895 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.895 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:08.895 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581620+0000", 2024-04-26T12:07:08.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5868999999999997e-05 2024-04-26T12:07:08.895 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.896 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:08.896 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.896 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 456028~3870 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:08.896 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:08.896 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 14.279417278, 2024-04-26T12:07:08.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055118997000000003, 2024-04-26T12:07:08.896 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:08.896 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.896 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:08.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:08.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:08.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:08.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:08.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:08.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528811+0000", 2024-04-26T12:07:08.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:08.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:08.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528887+0000", 2024-04-26T12:07:08.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5977999999999997e-05 2024-04-26T12:07:08.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:08.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528897+0000", 2024-04-26T12:07:08.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8730000000000002e-06 2024-04-26T12:07:08.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528901+0000", 2024-04-26T12:07:08.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4880000000000001e-06 2024-04-26T12:07:08.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:08.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580146+0000", 2024-04-26T12:07:08.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051244242000000002 2024-04-26T12:07:08.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:08.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580227+0000", 2024-04-26T12:07:08.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1044000000000005e-05 2024-04-26T12:07:08.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:08.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583864+0000", 2024-04-26T12:07:08.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036374419999999998 2024-04-26T12:07:08.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:08.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583894+0000", 2024-04-26T12:07:08.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9828999999999999e-05 2024-04-26T12:07:08.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:08.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583931+0000", 2024-04-26T12:07:08.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6908e-05 2024-04-26T12:07:08.901 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.901 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:08.901 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.901 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 459898~2037 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:08.901 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:08.901 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 14.279029287, 2024-04-26T12:07:08.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055925713000000002, 2024-04-26T12:07:08.901 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:08.901 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.901 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:08.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:08.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:08.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:08.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:08.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:08.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529199+0000", 2024-04-26T12:07:08.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:08.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:08.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529203+0000", 2024-04-26T12:07:08.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:07:08.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:08.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529209+0000", 2024-04-26T12:07:08.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7939999999999999e-06 2024-04-26T12:07:08.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529212+0000", 2024-04-26T12:07:08.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7290000000000002e-06 2024-04-26T12:07:08.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:08.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580784+0000", 2024-04-26T12:07:08.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051572073000000003 2024-04-26T12:07:08.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:08.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580883+0000", 2024-04-26T12:07:08.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8330000000000002e-05 2024-04-26T12:07:08.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:08.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585050+0000", 2024-04-26T12:07:08.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041670209999999999 2024-04-26T12:07:08.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:08.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585088+0000", 2024-04-26T12:07:08.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8559999999999997e-05 2024-04-26T12:07:08.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:08.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585125+0000", 2024-04-26T12:07:08.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7197999999999999e-05 2024-04-26T12:07:08.905 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.905 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:08.905 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.905 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 461935~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:08.906 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:08.906 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 14.278306833, 2024-04-26T12:07:08.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055266150999999999, 2024-04-26T12:07:08.906 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:08.906 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:08.906 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:08.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:08.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:08.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:08.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:08.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:08.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:08.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529921+0000", 2024-04-26T12:07:08.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:08.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:08.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529956+0000", 2024-04-26T12:07:08.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4687000000000002e-05 2024-04-26T12:07:08.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:08.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529966+0000", 2024-04-26T12:07:08.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0392e-05 2024-04-26T12:07:08.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:08.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529978+0000", 2024-04-26T12:07:08.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1348e-05 2024-04-26T12:07:08.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:08.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581659+0000", 2024-04-26T12:07:08.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051681454000000002 2024-04-26T12:07:08.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:08.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581746+0000", 2024-04-26T12:07:08.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6305999999999997e-05 2024-04-26T12:07:08.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:08.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585131+0000", 2024-04-26T12:07:08.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033853199999999998 2024-04-26T12:07:08.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:08.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585154+0000", 2024-04-26T12:07:08.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3258999999999999e-05 2024-04-26T12:07:08.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:08.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:08.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:08.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585188+0000", 2024-04-26T12:07:08.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4236000000000002e-05 2024-04-26T12:07:08.910 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.910 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:08.910 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.910 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:08.910 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:08.910 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:08.912 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:07:08.912 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:08.910+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:09.012 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:09.011+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:09.045 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:09.046 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:09.046 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:07:09.046 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:09.055 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:09.113 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:09.112+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:09.159 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:09.159 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:09.159 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:07:09.159 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:07:09.160 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:09.169 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:09.214 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:09.213+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:09.282 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:09.282 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:07:09.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:07:09.282 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:07:09.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.282 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2989 3.d 3:b02ffd62:::200.00000010:head [write 3767903~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:09.282 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:09.282 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 9.7622734290000004, 2024-04-26T12:07:09.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057069768999999999, 2024-04-26T12:07:09.283 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:09.283 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.283 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:09.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:09.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:09.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:09.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:09.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:09.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:09.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:09.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:09.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516446+0000", 2024-04-26T12:07:09.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6469999999999997e-06 2024-04-26T12:07:09.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:09.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516449+0000", 2024-04-26T12:07:09.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.976e-06 2024-04-26T12:07:09.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516452+0000", 2024-04-26T12:07:09.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.509e-06 2024-04-26T12:07:09.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:09.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.568562+0000", 2024-04-26T12:07:09.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.052110030000000002 2024-04-26T12:07:09.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:09.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.568615+0000", 2024-04-26T12:07:09.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2809999999999998e-05 2024-04-26T12:07:09.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:09.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573425+0000", 2024-04-26T12:07:09.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048105149999999996 2024-04-26T12:07:09.286 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:09.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573452+0000", 2024-04-26T12:07:09.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6778e-05 2024-04-26T12:07:09.286 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:09.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573512+0000", 2024-04-26T12:07:09.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9710000000000003e-05 2024-04-26T12:07:09.286 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.287 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:09.287 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.287 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2990 3.d 3:b02ffd62:::200.00000010:head [write 3769302~4483 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:09.287 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:09.287 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 9.7622614300000006, 2024-04-26T12:07:09.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057131345, 2024-04-26T12:07:09.287 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:09.287 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.287 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:09.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:09.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:09.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:09.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:09.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:09.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:09.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:09.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:09.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516459+0000", 2024-04-26T12:07:09.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2859999999999999e-06 2024-04-26T12:07:09.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:09.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516462+0000", 2024-04-26T12:07:09.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0790000000000001e-06 2024-04-26T12:07:09.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.290 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.290 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516465+0000", 2024-04-26T12:07:09.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.464e-06 2024-04-26T12:07:09.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.290 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:09.290 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569035+0000", 2024-04-26T12:07:09.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.052570328999999999 2024-04-26T12:07:09.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.290 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:09.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569113+0000", 2024-04-26T12:07:09.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8118e-05 2024-04-26T12:07:09.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:09.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573517+0000", 2024-04-26T12:07:09.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044039200000000004 2024-04-26T12:07:09.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:09.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573541+0000", 2024-04-26T12:07:09.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3805999999999999e-05 2024-04-26T12:07:09.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:09.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573585+0000", 2024-04-26T12:07:09.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4567000000000002e-05 2024-04-26T12:07:09.292 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.292 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:09.292 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.292 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2991 3.d 3:b02ffd62:::200.00000010:head [write 3773785~4213 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:09.292 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:09.292 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 9.7622487410000005, 2024-04-26T12:07:09.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057230554000000003, 2024-04-26T12:07:09.292 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:09.292 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.292 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:09.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:09.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:09.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:09.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:09.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:09.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516466+0000", 2024-04-26T12:07:09.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:09.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:09.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516470+0000", 2024-04-26T12:07:09.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7960000000000002e-06 2024-04-26T12:07:09.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:09.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516478+0000", 2024-04-26T12:07:09.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:07:09.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516484+0000", 2024-04-26T12:07:09.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5300000000000002e-06 2024-04-26T12:07:09.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:09.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569662+0000", 2024-04-26T12:07:09.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053177896000000002 2024-04-26T12:07:09.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:09.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569749+0000", 2024-04-26T12:07:09.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7229000000000001e-05 2024-04-26T12:07:09.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:09.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573593+0000", 2024-04-26T12:07:09.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038433109999999999 2024-04-26T12:07:09.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:09.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573631+0000", 2024-04-26T12:07:09.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8615000000000002e-05 2024-04-26T12:07:09.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:09.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573697+0000", 2024-04-26T12:07:09.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5971999999999998e-05 2024-04-26T12:07:09.296 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.296 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:09.296 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.297 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2999 3.d 3:b02ffd62:::200.00000010:head [write 3797283~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:09.297 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:09.297 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 9.757734353, 2024-04-26T12:07:09.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057330949999999999, 2024-04-26T12:07:09.297 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:09.297 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.297 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:09.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:09.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:09.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:09.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:09.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:09.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520980+0000", 2024-04-26T12:07:09.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:09.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:09.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520991+0000", 2024-04-26T12:07:09.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1154e-05 2024-04-26T12:07:09.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:09.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521014+0000", 2024-04-26T12:07:09.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2288000000000001e-05 2024-04-26T12:07:09.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521019+0000", 2024-04-26T12:07:09.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0889999999999999e-06 2024-04-26T12:07:09.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:09.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.575399+0000", 2024-04-26T12:07:09.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054380392999999999 2024-04-26T12:07:09.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:09.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.575440+0000", 2024-04-26T12:07:09.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1146000000000002e-05 2024-04-26T12:07:09.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:09.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578237+0000", 2024-04-26T12:07:09.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002796761 2024-04-26T12:07:09.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:09.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578260+0000", 2024-04-26T12:07:09.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3538999999999999e-05 2024-04-26T12:07:09.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:09.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578312+0000", 2024-04-26T12:07:09.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1508999999999998e-05 2024-04-26T12:07:09.301 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.301 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:09.301 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.302 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3000 3.d 3:b02ffd62:::200.00000010:head [write 3801160~9028 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:09.302 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:09.302 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 9.7571083870000006, 2024-04-26T12:07:09.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.059231688999999997, 2024-04-26T12:07:09.302 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:09.302 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.302 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:09.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:09.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:09.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:09.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:09.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:09.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521606+0000", 2024-04-26T12:07:09.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:09.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:09.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521627+0000", 2024-04-26T12:07:09.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1129e-05 2024-04-26T12:07:09.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:09.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521637+0000", 2024-04-26T12:07:09.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8789999999999998e-06 2024-04-26T12:07:09.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521644+0000", 2024-04-26T12:07:09.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:07:09.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:09.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576381+0000", 2024-04-26T12:07:09.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.05473629 2024-04-26T12:07:09.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:09.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576451+0000", 2024-04-26T12:07:09.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0525000000000007e-05 2024-04-26T12:07:09.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:09.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580734+0000", 2024-04-26T12:07:09.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042826699999999997 2024-04-26T12:07:09.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:09.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580780+0000", 2024-04-26T12:07:09.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6006e-05 2024-04-26T12:07:09.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:09.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580839+0000", 2024-04-26T12:07:09.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8783000000000003e-05 2024-04-26T12:07:09.306 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.306 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:09.306 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.306 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3001 3.d 3:b02ffd62:::200.00000010:head [write 3810188~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:09.306 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:09.306 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 9.7565560550000008, 2024-04-26T12:07:09.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.060161213999999998, 2024-04-26T12:07:09.306 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:09.306 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.307 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:09.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:09.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:09.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:09.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:09.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:09.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522158+0000", 2024-04-26T12:07:09.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:09.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:09.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522165+0000", 2024-04-26T12:07:09.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.28e-06 2024-04-26T12:07:09.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:09.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522178+0000", 2024-04-26T12:07:09.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3738e-05 2024-04-26T12:07:09.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522186+0000", 2024-04-26T12:07:09.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.267e-06 2024-04-26T12:07:09.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:09.309 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576889+0000", 2024-04-26T12:07:09.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054703442999999997 2024-04-26T12:07:09.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:09.309 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576953+0000", 2024-04-26T12:07:09.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4213000000000003e-05 2024-04-26T12:07:09.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:09.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582185+0000", 2024-04-26T12:07:09.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052319209999999996 2024-04-26T12:07:09.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:09.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582243+0000", 2024-04-26T12:07:09.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7321999999999998e-05 2024-04-26T12:07:09.311 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.311 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:09.311 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582321+0000", 2024-04-26T12:07:09.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7911000000000007e-05 2024-04-26T12:07:09.311 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.311 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:09.311 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.311 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.311 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3002 3.d 3:b02ffd62:::200.00000010:head [write 3812103~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:09.311 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:09.311 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 9.7560872920000001, 2024-04-26T12:07:09.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.059796961000000003, 2024-04-26T12:07:09.312 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:09.312 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.312 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:09.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:09.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:09.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:09.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:09.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:09.313 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522627+0000", 2024-04-26T12:07:09.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:09.313 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.313 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:09.313 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522633+0000", 2024-04-26T12:07:09.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6699999999999999e-06 2024-04-26T12:07:09.313 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.313 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:09.313 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522643+0000", 2024-04-26T12:07:09.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6649999999999998e-06 2024-04-26T12:07:09.313 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.313 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522649+0000", 2024-04-26T12:07:09.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4200000000000004e-06 2024-04-26T12:07:09.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:09.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577413+0000", 2024-04-26T12:07:09.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054763714999999998 2024-04-26T12:07:09.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:09.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577460+0000", 2024-04-26T12:07:09.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7095000000000002e-05 2024-04-26T12:07:09.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:09.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582331+0000", 2024-04-26T12:07:09.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048716419999999998 2024-04-26T12:07:09.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:09.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582375+0000", 2024-04-26T12:07:09.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3053999999999998e-05 2024-04-26T12:07:09.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:09.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582425+0000", 2024-04-26T12:07:09.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0525000000000002e-05 2024-04-26T12:07:09.315 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.315 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:09.316 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.316 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.316 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.316 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3003 3.d 3:b02ffd62:::200.00000010:head [write 3814061~4170 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:09.316 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:09.316 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 9.7550322299999994, 2024-04-26T12:07:09.316 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058803394000000002, 2024-04-26T12:07:09.316 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:09.316 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.316 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:09.316 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.316 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:09.316 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:09.316 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:09.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:09.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:09.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523682+0000", 2024-04-26T12:07:09.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:09.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:09.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523690+0000", 2024-04-26T12:07:09.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0290000000000005e-06 2024-04-26T12:07:09.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.318 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:09.318 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523699+0000", 2024-04-26T12:07:09.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4589999999999998e-06 2024-04-26T12:07:09.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.318 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.318 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523703+0000", 2024-04-26T12:07:09.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6249999999999998e-06 2024-04-26T12:07:09.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.318 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:09.318 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577832+0000", 2024-04-26T12:07:09.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054128883000000003 2024-04-26T12:07:09.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.319 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:09.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577878+0000", 2024-04-26T12:07:09.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5841999999999999e-05 2024-04-26T12:07:09.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.319 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:09.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582430+0000", 2024-04-26T12:07:09.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045517270000000002 2024-04-26T12:07:09.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.319 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:09.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582453+0000", 2024-04-26T12:07:09.320 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3609999999999999e-05 2024-04-26T12:07:09.320 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.320 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.320 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:09.320 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582487+0000", 2024-04-26T12:07:09.320 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3080000000000002e-05 2024-04-26T12:07:09.320 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.320 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:09.320 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.320 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.320 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.320 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3004 3.d 3:b02ffd62:::200.00000010:head [write 3818231~3890 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:09.320 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:09.320 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 9.7541833069999999, 2024-04-26T12:07:09.321 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058024342999999999, 2024-04-26T12:07:09.321 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:09.321 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.321 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:09.321 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.321 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:09.321 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:09.321 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.321 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.321 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.321 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:09.321 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:09.321 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.321 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.321 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.322 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:09.322 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524531+0000", 2024-04-26T12:07:09.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:09.322 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.322 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:09.322 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524539+0000", 2024-04-26T12:07:09.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9249999999999995e-06 2024-04-26T12:07:09.322 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.322 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:09.322 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524547+0000", 2024-04-26T12:07:09.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5220000000000007e-06 2024-04-26T12:07:09.323 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524553+0000", 2024-04-26T12:07:09.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6659999999999996e-06 2024-04-26T12:07:09.323 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:09.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578335+0000", 2024-04-26T12:07:09.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.05378235 2024-04-26T12:07:09.323 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:09.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578378+0000", 2024-04-26T12:07:09.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2429999999999999e-05 2024-04-26T12:07:09.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:09.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582494+0000", 2024-04-26T12:07:09.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004116059 2024-04-26T12:07:09.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:09.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582519+0000", 2024-04-26T12:07:09.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4961999999999999e-05 2024-04-26T12:07:09.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:09.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582556+0000", 2024-04-26T12:07:09.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7728999999999997e-05 2024-04-26T12:07:09.325 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.325 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:09.325 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.325 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3005 3.d 3:b02ffd62:::200.00000010:head [write 3822121~5207 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:09.325 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:09.325 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 9.7537640509999992, 2024-04-26T12:07:09.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057662270000000002, 2024-04-26T12:07:09.325 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:09.325 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.325 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:09.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:09.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:09.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:09.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:09.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:09.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:09.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:09.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:09.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524961+0000", 2024-04-26T12:07:09.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0124e-05 2024-04-26T12:07:09.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:09.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524971+0000", 2024-04-26T12:07:09.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0200999999999999e-05 2024-04-26T12:07:09.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524979+0000", 2024-04-26T12:07:09.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5809999999999999e-06 2024-04-26T12:07:09.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.328 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:09.328 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578753+0000", 2024-04-26T12:07:09.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053774444999999997 2024-04-26T12:07:09.328 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.328 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:09.328 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578821+0000", 2024-04-26T12:07:09.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7640999999999998e-05 2024-04-26T12:07:09.328 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.328 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:09.328 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582561+0000", 2024-04-26T12:07:09.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037399870000000002 2024-04-26T12:07:09.328 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:09.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582582+0000", 2024-04-26T12:07:09.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0934999999999999e-05 2024-04-26T12:07:09.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:09.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582614+0000", 2024-04-26T12:07:09.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1948e-05 2024-04-26T12:07:09.329 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.329 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:09.329 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.330 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3006 3.d 3:b02ffd62:::200.00000010:head [write 3827328~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:09.330 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:09.330 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 9.7531307120000008, 2024-04-26T12:07:09.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057085404999999999, 2024-04-26T12:07:09.330 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:09.330 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.330 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:09.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:09.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:09.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:09.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:09.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:09.331 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525583+0000", 2024-04-26T12:07:09.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:09.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:09.331 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525594+0000", 2024-04-26T12:07:09.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0497e-05 2024-04-26T12:07:09.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:09.332 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525610+0000", 2024-04-26T12:07:09.332 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6392000000000002e-05 2024-04-26T12:07:09.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.332 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.332 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525621+0000", 2024-04-26T12:07:09.332 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0679999999999999e-05 2024-04-26T12:07:09.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.332 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:09.332 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.579270+0000", 2024-04-26T12:07:09.332 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053648802000000002 2024-04-26T12:07:09.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.332 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:09.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.579312+0000", 2024-04-26T12:07:09.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2268000000000003e-05 2024-04-26T12:07:09.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:09.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582618+0000", 2024-04-26T12:07:09.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033057049999999999 2024-04-26T12:07:09.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:09.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582637+0000", 2024-04-26T12:07:09.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9417000000000001e-05 2024-04-26T12:07:09.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.334 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:09.334 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582670+0000", 2024-04-26T12:07:09.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2969999999999998e-05 2024-04-26T12:07:09.334 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.334 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:09.334 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.334 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.334 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.334 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3015 3.d 3:b02ffd62:::200.00000010:head [write 3855113~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:09.334 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:09.334 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 9.742674955, 2024-04-26T12:07:09.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057652729999999999, 2024-04-26T12:07:09.334 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:09.334 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.335 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:09.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:09.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:09.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:09.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:09.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:09.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:09.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:09.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:09.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536042+0000", 2024-04-26T12:07:09.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0849999999999999e-06 2024-04-26T12:07:09.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:09.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536046+0000", 2024-04-26T12:07:09.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:07:09.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536048+0000", 2024-04-26T12:07:09.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6019999999999998e-06 2024-04-26T12:07:09.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:09.337 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585409+0000", 2024-04-26T12:07:09.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.049360938 2024-04-26T12:07:09.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:09.337 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585506+0000", 2024-04-26T12:07:09.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6966999999999995e-05 2024-04-26T12:07:09.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:09.337 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593630+0000", 2024-04-26T12:07:09.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0081238160000000007 2024-04-26T12:07:09.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:09.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593656+0000", 2024-04-26T12:07:09.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6154000000000001e-05 2024-04-26T12:07:09.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:09.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593693+0000", 2024-04-26T12:07:09.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7185999999999999e-05 2024-04-26T12:07:09.338 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.338 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:09.338 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.339 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3016 3.d 3:b02ffd62:::200.00000010:head [write 3857020~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:09.339 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:09.339 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 9.7426650079999995, 2024-04-26T12:07:09.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058678157000000002, 2024-04-26T12:07:09.339 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:09.339 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.339 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:09.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:09.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:09.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.340 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:09.340 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:09.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.340 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:09.340 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:09.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:09.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.340 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:09.340 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536055+0000", 2024-04-26T12:07:09.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3669999999999999e-06 2024-04-26T12:07:09.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:09.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536058+0000", 2024-04-26T12:07:09.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3220000000000001e-06 2024-04-26T12:07:09.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536062+0000", 2024-04-26T12:07:09.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1520000000000002e-06 2024-04-26T12:07:09.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:09.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585965+0000", 2024-04-26T12:07:09.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.049902769999999999 2024-04-26T12:07:09.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:09.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586046+0000", 2024-04-26T12:07:09.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1032999999999995e-05 2024-04-26T12:07:09.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:09.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594667+0000", 2024-04-26T12:07:09.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0086214599999999992 2024-04-26T12:07:09.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:09.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594692+0000", 2024-04-26T12:07:09.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5191999999999999e-05 2024-04-26T12:07:09.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:09.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594729+0000", 2024-04-26T12:07:09.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6069000000000003e-05 2024-04-26T12:07:09.343 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.343 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:09.343 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.343 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3017 3.d 3:b02ffd62:::200.00000010:head [write 3859438~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:09.343 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:09.343 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 9.7426509239999994, 2024-04-26T12:07:09.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058723814999999999, 2024-04-26T12:07:09.343 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:09.343 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.343 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:09.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:09.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:09.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:09.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:09.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:09.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:09.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:09.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:09.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536066+0000", 2024-04-26T12:07:09.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8840000000000001e-06 2024-04-26T12:07:09.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:09.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536069+0000", 2024-04-26T12:07:09.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:07:09.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536072+0000", 2024-04-26T12:07:09.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4449999999999999e-06 2024-04-26T12:07:09.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.346 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:09.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586703+0000", 2024-04-26T12:07:09.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050631618000000003 2024-04-26T12:07:09.346 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.346 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:09.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586748+0000", 2024-04-26T12:07:09.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4682999999999999e-05 2024-04-26T12:07:09.346 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.346 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:09.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594734+0000", 2024-04-26T12:07:09.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079860369999999996 2024-04-26T12:07:09.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:09.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594756+0000", 2024-04-26T12:07:09.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1738000000000001e-05 2024-04-26T12:07:09.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:09.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594788+0000", 2024-04-26T12:07:09.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2604999999999997e-05 2024-04-26T12:07:09.347 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.347 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:09.347 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.348 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3018 3.d 3:b02ffd62:::200.00000010:head [write 3861345~3221 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:09.348 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:09.348 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 9.7418182370000004, 2024-04-26T12:07:09.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057946174000000003, 2024-04-26T12:07:09.348 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:09.348 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.348 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:09.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.348 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:09.348 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:09.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.348 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:09.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:09.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:09.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536896+0000", 2024-04-26T12:07:09.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:09.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:09.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536905+0000", 2024-04-26T12:07:09.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7839999999999998e-06 2024-04-26T12:07:09.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:09.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536929+0000", 2024-04-26T12:07:09.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3561999999999999e-05 2024-04-26T12:07:09.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536940+0000", 2024-04-26T12:07:09.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0742e-05 2024-04-26T12:07:09.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:09.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.587238+0000", 2024-04-26T12:07:09.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050297962000000002 2024-04-26T12:07:09.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:09.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.587315+0000", 2024-04-26T12:07:09.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7848000000000004e-05 2024-04-26T12:07:09.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:09.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594792+0000", 2024-04-26T12:07:09.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074766240000000003 2024-04-26T12:07:09.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:09.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594813+0000", 2024-04-26T12:07:09.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0876000000000001e-05 2024-04-26T12:07:09.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:09.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594843+0000", 2024-04-26T12:07:09.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0434999999999999e-05 2024-04-26T12:07:09.352 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.352 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:09.352 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.352 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3019 3.d 3:b02ffd62:::200.00000010:head [write 3864566~3989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:09.352 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:09.352 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 9.7400758770000007, 2024-04-26T12:07:09.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.061000094999999997, 2024-04-26T12:07:09.352 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:09.352 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.353 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:09.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.353 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:09.353 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:09.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.353 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.353 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:09.353 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:09.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.353 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.353 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:09.353 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538638+0000", 2024-04-26T12:07:09.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999981 2024-04-26T12:07:09.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:09.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538669+0000", 2024-04-26T12:07:09.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1689000000000001e-05 2024-04-26T12:07:09.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:09.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538703+0000", 2024-04-26T12:07:09.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3309000000000002e-05 2024-04-26T12:07:09.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538746+0000", 2024-04-26T12:07:09.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2803999999999999e-05 2024-04-26T12:07:09.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:09.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.589467+0000", 2024-04-26T12:07:09.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050721912000000001 2024-04-26T12:07:09.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:09.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.589517+0000", 2024-04-26T12:07:09.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9549999999999998e-05 2024-04-26T12:07:09.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:09.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599577+0000", 2024-04-26T12:07:09.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010059593 2024-04-26T12:07:09.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:09.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599603+0000", 2024-04-26T12:07:09.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6821e-05 2024-04-26T12:07:09.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:09.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599640+0000", 2024-04-26T12:07:09.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6177999999999998e-05 2024-04-26T12:07:09.356 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.356 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:09.356 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.357 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3020 3.d 3:b02ffd62:::200.00000010:head [write 3868555~7563 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:09.357 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:09.357 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 9.7374630419999999, 2024-04-26T12:07:09.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058446867, 2024-04-26T12:07:09.357 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:09.357 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.357 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:09.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.357 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:09.357 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:09.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:09.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:09.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:09.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541251+0000", 2024-04-26T12:07:09.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:09.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:09.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541286+0000", 2024-04-26T12:07:09.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4845999999999998e-05 2024-04-26T12:07:09.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:09.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541300+0000", 2024-04-26T12:07:09.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4251e-05 2024-04-26T12:07:09.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541307+0000", 2024-04-26T12:07:09.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3819999999999998e-06 2024-04-26T12:07:09.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:09.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.592596+0000", 2024-04-26T12:07:09.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051288215999999998 2024-04-26T12:07:09.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:09.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.592675+0000", 2024-04-26T12:07:09.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9197999999999996e-05 2024-04-26T12:07:09.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:09.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599645+0000", 2024-04-26T12:07:09.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069701759999999998 2024-04-26T12:07:09.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:09.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599667+0000", 2024-04-26T12:07:09.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2118999999999999e-05 2024-04-26T12:07:09.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:09.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599699+0000", 2024-04-26T12:07:09.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2048999999999998e-05 2024-04-26T12:07:09.361 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.361 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:09.361 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.361 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3021 3.d 3:b02ffd62:::200.00000010:head [write 3876118~3791 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:09.361 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:09.361 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 9.7374013050000006, 2024-04-26T12:07:09.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058441157000000001, 2024-04-26T12:07:09.362 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:09.362 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.362 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:09.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.362 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:09.362 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:09.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.362 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:09.362 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:09.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:09.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:09.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:09.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:09.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541323+0000", 2024-04-26T12:07:09.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5510000000000005e-06 2024-04-26T12:07:09.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:09.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541327+0000", 2024-04-26T12:07:09.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2520000000000001e-06 2024-04-26T12:07:09.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541330+0000", 2024-04-26T12:07:09.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:07:09.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:09.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593229+0000", 2024-04-26T12:07:09.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051898044999999997 2024-04-26T12:07:09.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:09.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593278+0000", 2024-04-26T12:07:09.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9506999999999999e-05 2024-04-26T12:07:09.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:09.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599704+0000", 2024-04-26T12:07:09.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064259570000000004 2024-04-26T12:07:09.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:09.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599725+0000", 2024-04-26T12:07:09.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0562999999999999e-05 2024-04-26T12:07:09.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:09.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599755+0000", 2024-04-26T12:07:09.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0710000000000002e-05 2024-04-26T12:07:09.366 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.366 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:09.366 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.366 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3022 3.d 3:b02ffd62:::200.00000010:head [write 3879909~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:09.366 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:09.366 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 9.7361522360000006, 2024-04-26T12:07:09.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057246689000000003, 2024-04-26T12:07:09.366 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:09.366 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.366 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:09.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:09.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:09.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:09.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:09.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:09.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542561+0000", 2024-04-26T12:07:09.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999981 2024-04-26T12:07:09.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:09.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542570+0000", 2024-04-26T12:07:09.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9199999999999993e-06 2024-04-26T12:07:09.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:09.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542583+0000", 2024-04-26T12:07:09.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2227e-05 2024-04-26T12:07:09.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542598+0000", 2024-04-26T12:07:09.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5199e-05 2024-04-26T12:07:09.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:09.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593728+0000", 2024-04-26T12:07:09.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051129846 2024-04-26T12:07:09.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:09.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593806+0000", 2024-04-26T12:07:09.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8425999999999998e-05 2024-04-26T12:07:09.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:09.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599760+0000", 2024-04-26T12:07:09.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0059537399999999999 2024-04-26T12:07:09.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:09.370 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599779+0000", 2024-04-26T12:07:09.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9619e-05 2024-04-26T12:07:09.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:09.370 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599810+0000", 2024-04-26T12:07:09.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0508999999999999e-05 2024-04-26T12:07:09.370 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.370 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:09.370 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.370 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3023 3.d 3:b02ffd62:::200.00000010:head [write 3881868~5748 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:09.371 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:09.371 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 9.7356803880000005, 2024-04-26T12:07:09.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.056829994000000002, 2024-04-26T12:07:09.371 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:09.371 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.371 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:09.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:09.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:09.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:09.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:09.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:09.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:09.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543034+0000", 2024-04-26T12:07:09.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:09.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:09.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543044+0000", 2024-04-26T12:07:09.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0444e-05 2024-04-26T12:07:09.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:09.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543055+0000", 2024-04-26T12:07:09.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.096e-05 2024-04-26T12:07:09.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.373 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.373 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543063+0000", 2024-04-26T12:07:09.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2689999999999999e-06 2024-04-26T12:07:09.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.373 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:09.373 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594265+0000", 2024-04-26T12:07:09.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051201325999999998 2024-04-26T12:07:09.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.373 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:09.373 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594311+0000", 2024-04-26T12:07:09.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5918000000000003e-05 2024-04-26T12:07:09.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:09.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599815+0000", 2024-04-26T12:07:09.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055038370000000001 2024-04-26T12:07:09.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:09.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599834+0000", 2024-04-26T12:07:09.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9942e-05 2024-04-26T12:07:09.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:09.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:09.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:09.375 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599865+0000", 2024-04-26T12:07:09.375 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0549000000000002e-05 2024-04-26T12:07:09.375 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.375 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:09.375 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.375 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:09.375 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:09.375 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:09.377 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:09.374+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:09.377 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:07:09.477 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:09.475+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:09.482 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:09.483 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:07:09.483 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:07:09.483 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:09.492 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:07:09.579 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:09.577+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:09.600 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:09.600 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:07:09.600 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:07:09.600 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:07:09.600 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:09.609 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:07:09.679 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:09.677+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:09.757 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:09.757 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:07:09.757 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:07:09.757 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:07:09.757 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.757 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:536 3.2 3:4272d415:::200.0000000b:head [write 405817~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:09.758 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:09.758 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 15.230219978999999, 2024-04-26T12:07:09.758 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053030282999999998, 2024-04-26T12:07:09.758 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:09.758 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.759 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:09.759 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.759 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:09.759 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:09.759 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.759 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.759 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.760 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:09.761 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:09.761 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.761 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.761 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.761 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:09.761 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524136+0000", 2024-04-26T12:07:09.761 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:09.762 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.762 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.762 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:09.762 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524139+0000", 2024-04-26T12:07:09.762 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2919999999999998e-06 2024-04-26T12:07:09.762 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.763 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:09.763 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524144+0000", 2024-04-26T12:07:09.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.502e-06 2024-04-26T12:07:09.763 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.763 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.764 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524149+0000", 2024-04-26T12:07:09.764 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7310000000000001e-06 2024-04-26T12:07:09.764 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.764 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.764 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:09.764 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570935+0000", 2024-04-26T12:07:09.765 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.046785603000000002 2024-04-26T12:07:09.765 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.765 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.765 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:09.765 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570981+0000", 2024-04-26T12:07:09.765 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6085999999999999e-05 2024-04-26T12:07:09.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.766 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.766 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:09.766 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577039+0000", 2024-04-26T12:07:09.766 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060582099999999996 2024-04-26T12:07:09.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.766 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.767 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:09.767 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577081+0000", 2024-04-26T12:07:09.767 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1927e-05 2024-04-26T12:07:09.767 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.767 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.767 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:09.768 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577167+0000", 2024-04-26T12:07:09.768 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6311999999999996e-05 2024-04-26T12:07:09.768 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.768 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:09.768 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.768 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.769 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.769 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:537 3.2 3:4272d415:::200.0000000b:head [write 407216~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:09.769 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:09.769 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 15.230204041, 2024-04-26T12:07:09.769 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053131411000000003, 2024-04-26T12:07:09.769 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:09.770 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.770 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:09.771 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.771 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:09.771 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:09.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:09.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:09.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:09.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524152+0000", 2024-04-26T12:07:09.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:09.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:09.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524157+0000", 2024-04-26T12:07:09.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3529999999999997e-06 2024-04-26T12:07:09.773 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.773 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.773 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:09.773 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524162+0000", 2024-04-26T12:07:09.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5910000000000003e-06 2024-04-26T12:07:09.773 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.773 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.773 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.773 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524170+0000", 2024-04-26T12:07:09.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:07:09.773 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.773 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.773 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:09.774 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571323+0000", 2024-04-26T12:07:09.774 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047153289000000001 2024-04-26T12:07:09.774 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.774 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.774 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:09.774 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571367+0000", 2024-04-26T12:07:09.774 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4205000000000001e-05 2024-04-26T12:07:09.774 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.774 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.774 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:09.774 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577174+0000", 2024-04-26T12:07:09.774 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058072250000000001 2024-04-26T12:07:09.774 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.774 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:09.775 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577218+0000", 2024-04-26T12:07:09.775 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3294999999999998e-05 2024-04-26T12:07:09.775 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:09.775 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577284+0000", 2024-04-26T12:07:09.775 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6483999999999996e-05 2024-04-26T12:07:09.775 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.775 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:09.775 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.775 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.775 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:538 3.2 3:4272d415:::200.0000000b:head [write 408629~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:09.775 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:09.776 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 15.230183341, 2024-04-26T12:07:09.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053241841999999998, 2024-04-26T12:07:09.776 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:09.776 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.776 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:09.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:09.776 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:09.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:09.776 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:09.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.777 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:09.777 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:09.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:09.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.777 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:09.777 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524178+0000", 2024-04-26T12:07:09.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1420000000000001e-06 2024-04-26T12:07:09.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.777 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:09.777 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524184+0000", 2024-04-26T12:07:09.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4240000000000001e-06 2024-04-26T12:07:09.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524188+0000", 2024-04-26T12:07:09.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2710000000000003e-06 2024-04-26T12:07:09.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:09.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571623+0000", 2024-04-26T12:07:09.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047435119999999997 2024-04-26T12:07:09.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:09.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571668+0000", 2024-04-26T12:07:09.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5377000000000003e-05 2024-04-26T12:07:09.779 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.779 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.779 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:09.779 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577292+0000", 2024-04-26T12:07:09.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0056232030000000002 2024-04-26T12:07:09.779 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.779 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.779 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:09.779 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577330+0000", 2024-04-26T12:07:09.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8748999999999998e-05 2024-04-26T12:07:09.779 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.779 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.779 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:09.779 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577415+0000", 2024-04-26T12:07:09.780 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4913000000000005e-05 2024-04-26T12:07:09.780 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.780 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:09.780 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.780 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.780 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.780 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:539 3.2 3:4272d415:::200.0000000b:head [write 410547~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:09.780 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:09.780 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 15.230165209000001, 2024-04-26T12:07:09.780 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053372670999999997, 2024-04-26T12:07:09.780 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:09.780 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.780 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:09.780 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.781 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:09.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:09.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.781 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:09.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:09.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:09.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524191+0000", 2024-04-26T12:07:09.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:09.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:09.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524199+0000", 2024-04-26T12:07:09.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6520000000000006e-06 2024-04-26T12:07:09.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:09.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524205+0000", 2024-04-26T12:07:09.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:07:09.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.784 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524209+0000", 2024-04-26T12:07:09.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.335e-06 2024-04-26T12:07:09.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:09.784 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572320+0000", 2024-04-26T12:07:09.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048110992999999998 2024-04-26T12:07:09.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:09.784 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572364+0000", 2024-04-26T12:07:09.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4577999999999999e-05 2024-04-26T12:07:09.785 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.785 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.785 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:09.785 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577426+0000", 2024-04-26T12:07:09.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050615139999999996 2024-04-26T12:07:09.785 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.785 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.785 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:09.785 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577480+0000", 2024-04-26T12:07:09.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3599e-05 2024-04-26T12:07:09.785 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.785 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.785 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:09.785 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577564+0000", 2024-04-26T12:07:09.786 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4699999999999999e-05 2024-04-26T12:07:09.786 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.786 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:09.786 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.786 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.786 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.786 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:540 3.2 3:4272d415:::200.0000000b:head [write 411948~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:09.786 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:09.786 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 15.230144191000001, 2024-04-26T12:07:09.786 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053497045999999999, 2024-04-26T12:07:09.786 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:09.787 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.787 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:09.787 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.787 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:09.787 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:09.787 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.787 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.787 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:09.787 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:09.787 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.787 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.787 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:09.787 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524212+0000", 2024-04-26T12:07:09.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:09.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:09.788 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524215+0000", 2024-04-26T12:07:09.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.559e-06 2024-04-26T12:07:09.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:09.788 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524220+0000", 2024-04-26T12:07:09.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2920000000000003e-06 2024-04-26T12:07:09.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524224+0000", 2024-04-26T12:07:09.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3680000000000004e-06 2024-04-26T12:07:09.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:09.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572619+0000", 2024-04-26T12:07:09.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048394549000000002 2024-04-26T12:07:09.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.790 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.790 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:09.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572669+0000", 2024-04-26T12:07:09.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0249e-05 2024-04-26T12:07:09.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.791 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:09.791 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577575+0000", 2024-04-26T12:07:09.791 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049053329999999996 2024-04-26T12:07:09.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.791 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:09.791 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577625+0000", 2024-04-26T12:07:09.791 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0274e-05 2024-04-26T12:07:09.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.791 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:09.791 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577710+0000", 2024-04-26T12:07:09.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4741999999999996e-05 2024-04-26T12:07:09.792 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.792 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:09.792 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.792 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.792 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.792 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:543 3.2 3:4272d415:::200.0000000b:head [write 413907~2485 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:09.792 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:09.792 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 15.230074497, 2024-04-26T12:07:09.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053578708000000003, 2024-04-26T12:07:09.792 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:09.792 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.793 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:09.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:09.793 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:09.793 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:09.793 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:09.793 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:09.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:09.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:09.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:09.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524287+0000", 2024-04-26T12:07:09.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2190000000000003e-06 2024-04-26T12:07:09.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:09.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524294+0000", 2024-04-26T12:07:09.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5660000000000003e-06 2024-04-26T12:07:09.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524298+0000", 2024-04-26T12:07:09.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3900000000000003e-06 2024-04-26T12:07:09.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:09.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572992+0000", 2024-04-26T12:07:09.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048693835999999997 2024-04-26T12:07:09.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:09.797 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573045+0000", 2024-04-26T12:07:09.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2793000000000001e-05 2024-04-26T12:07:09.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.797 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:09.797 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577721+0000", 2024-04-26T12:07:09.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046760550000000001 2024-04-26T12:07:09.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.797 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:09.797 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577777+0000", 2024-04-26T12:07:09.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5908000000000001e-05 2024-04-26T12:07:09.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.798 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:09.798 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577861+0000", 2024-04-26T12:07:09.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4337000000000002e-05 2024-04-26T12:07:09.798 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.798 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:09.798 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.798 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.798 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:544 3.2 3:4272d415:::200.0000000b:head [write 416392~3872 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:09.798 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:09.798 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 15.230054774999999, 2024-04-26T12:07:09.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054810527999999997, 2024-04-26T12:07:09.799 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:09.799 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.799 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:09.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:09.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:09.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:09.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:09.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:09.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:09.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:09.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:09.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524307+0000", 2024-04-26T12:07:09.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1580000000000004e-06 2024-04-26T12:07:09.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:09.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524312+0000", 2024-04-26T12:07:09.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6380000000000001e-06 2024-04-26T12:07:09.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524317+0000", 2024-04-26T12:07:09.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4000000000000002e-06 2024-04-26T12:07:09.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:09.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573348+0000", 2024-04-26T12:07:09.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049031433999999999 2024-04-26T12:07:09.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:09.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573393+0000", 2024-04-26T12:07:09.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4536999999999997e-05 2024-04-26T12:07:09.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:09.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578978+0000", 2024-04-26T12:07:09.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055848299999999998 2024-04-26T12:07:09.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:09.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579031+0000", 2024-04-26T12:07:09.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3708000000000001e-05 2024-04-26T12:07:09.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:09.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579113+0000", 2024-04-26T12:07:09.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1258e-05 2024-04-26T12:07:09.803 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.803 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:09.803 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.803 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:545 3.2 3:4272d415:::200.0000000b:head [write 420264~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:09.803 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:09.803 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 15.230036149, 2024-04-26T12:07:09.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054927386000000002, 2024-04-26T12:07:09.803 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:09.803 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.803 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:09.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.803 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:09.804 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:09.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:09.804 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:09.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:09.804 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524320+0000", 2024-04-26T12:07:09.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:09.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:09.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524325+0000", 2024-04-26T12:07:09.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5249999999999999e-06 2024-04-26T12:07:09.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:09.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524330+0000", 2024-04-26T12:07:09.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5629999999999999e-06 2024-04-26T12:07:09.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524335+0000", 2024-04-26T12:07:09.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.685e-06 2024-04-26T12:07:09.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:09.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573727+0000", 2024-04-26T12:07:09.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049392034000000001 2024-04-26T12:07:09.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:09.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573775+0000", 2024-04-26T12:07:09.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7435999999999998e-05 2024-04-26T12:07:09.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:09.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579120+0000", 2024-04-26T12:07:09.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0053452949999999999 2024-04-26T12:07:09.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:09.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579167+0000", 2024-04-26T12:07:09.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7240000000000002e-05 2024-04-26T12:07:09.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:09.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579248+0000", 2024-04-26T12:07:09.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0947999999999998e-05 2024-04-26T12:07:09.808 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.808 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:09.808 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.809 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 422222~8537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:09.809 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:09.809 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 15.230017832, 2024-04-26T12:07:09.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055065936000000003, 2024-04-26T12:07:09.809 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:09.809 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.809 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:09.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.809 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:09.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:09.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:09.810 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:09.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:09.810 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:09.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:09.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:09.811 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524347+0000", 2024-04-26T12:07:09.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7129999999999994e-06 2024-04-26T12:07:09.811 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.811 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:09.811 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524357+0000", 2024-04-26T12:07:09.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0232e-05 2024-04-26T12:07:09.811 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.811 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.811 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524362+0000", 2024-04-26T12:07:09.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:07:09.811 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:09.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574119+0000", 2024-04-26T12:07:09.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049756727000000001 2024-04-26T12:07:09.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:09.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574166+0000", 2024-04-26T12:07:09.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7086000000000003e-05 2024-04-26T12:07:09.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:09.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579261+0000", 2024-04-26T12:07:09.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050948310000000002 2024-04-26T12:07:09.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:09.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579316+0000", 2024-04-26T12:07:09.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5068000000000002e-05 2024-04-26T12:07:09.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:09.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579405+0000", 2024-04-26T12:07:09.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9251000000000003e-05 2024-04-26T12:07:09.813 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.813 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:09.814 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.814 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 430759~2035 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:09.814 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:09.814 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 15.229990841999999, 2024-04-26T12:07:09.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055164950999999997, 2024-04-26T12:07:09.814 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:09.814 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.814 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:09.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:09.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:09.815 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.815 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:09.815 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:09.815 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.815 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:09.815 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:09.815 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:09.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.816 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:09.816 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524368+0000", 2024-04-26T12:07:09.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.57e-06 2024-04-26T12:07:09.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.816 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:09.816 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524375+0000", 2024-04-26T12:07:09.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6170000000000003e-06 2024-04-26T12:07:09.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.816 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.816 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524380+0000", 2024-04-26T12:07:09.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2700000000000004e-06 2024-04-26T12:07:09.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:09.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574639+0000", 2024-04-26T12:07:09.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050259459999999999 2024-04-26T12:07:09.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.817 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:09.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574687+0000", 2024-04-26T12:07:09.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7608999999999998e-05 2024-04-26T12:07:09.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.817 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:09.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579414+0000", 2024-04-26T12:07:09.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047268750000000002 2024-04-26T12:07:09.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:09.818 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579456+0000", 2024-04-26T12:07:09.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1885000000000003e-05 2024-04-26T12:07:09.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:09.818 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579531+0000", 2024-04-26T12:07:09.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5053000000000001e-05 2024-04-26T12:07:09.818 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.818 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:09.818 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.818 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 432794~10523 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:09.819 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:09.819 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 15.229000118, 2024-04-26T12:07:09.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054314727, 2024-04-26T12:07:09.819 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:09.819 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.819 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:09.819 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.819 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:09.819 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:09.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.819 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.819 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.819 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:09.819 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:09.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:09.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525356+0000", 2024-04-26T12:07:09.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:09.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:09.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525414+0000", 2024-04-26T12:07:09.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8148e-05 2024-04-26T12:07:09.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:09.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525423+0000", 2024-04-26T12:07:09.821 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9749999999999996e-06 2024-04-26T12:07:09.821 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.821 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.821 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.821 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525428+0000", 2024-04-26T12:07:09.821 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0270000000000003e-06 2024-04-26T12:07:09.821 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.821 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.821 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:09.821 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574950+0000", 2024-04-26T12:07:09.821 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049521840999999997 2024-04-26T12:07:09.821 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.821 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.821 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:09.821 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575002+0000", 2024-04-26T12:07:09.822 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1586999999999999e-05 2024-04-26T12:07:09.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.822 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:09.822 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579543+0000", 2024-04-26T12:07:09.822 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045416340000000001 2024-04-26T12:07:09.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.822 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:09.822 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579587+0000", 2024-04-26T12:07:09.822 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3875999999999998e-05 2024-04-26T12:07:09.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.822 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:09.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579671+0000", 2024-04-26T12:07:09.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4351999999999995e-05 2024-04-26T12:07:09.823 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.823 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:09.823 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.823 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 443317~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:09.823 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:09.823 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 15.228924143, 2024-04-26T12:07:09.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054381889000000003, 2024-04-26T12:07:09.823 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:09.823 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.824 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:09.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:09.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:09.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:09.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:09.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:09.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525432+0000", 2024-04-26T12:07:09.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:09.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:09.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525435+0000", 2024-04-26T12:07:09.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3070000000000001e-06 2024-04-26T12:07:09.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:09.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525439+0000", 2024-04-26T12:07:09.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.104e-06 2024-04-26T12:07:09.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525442+0000", 2024-04-26T12:07:09.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0460000000000001e-06 2024-04-26T12:07:09.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:09.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575405+0000", 2024-04-26T12:07:09.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049963059999999997 2024-04-26T12:07:09.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:09.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575450+0000", 2024-04-26T12:07:09.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5034000000000003e-05 2024-04-26T12:07:09.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:09.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579680+0000", 2024-04-26T12:07:09.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042302260000000001 2024-04-26T12:07:09.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:09.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579737+0000", 2024-04-26T12:07:09.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7241000000000003e-05 2024-04-26T12:07:09.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:09.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579815+0000", 2024-04-26T12:07:09.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7278000000000001e-05 2024-04-26T12:07:09.828 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.828 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:09.828 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.828 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.828 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.828 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 445275~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:09.828 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:09.828 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 15.228496967, 2024-04-26T12:07:09.828 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054094668999999998, 2024-04-26T12:07:09.828 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:09.828 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.828 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:09.828 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:09.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:09.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:09.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:09.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:09.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525859+0000", 2024-04-26T12:07:09.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:09.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:09.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525864+0000", 2024-04-26T12:07:09.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:07:09.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:09.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525872+0000", 2024-04-26T12:07:09.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6790000000000005e-06 2024-04-26T12:07:09.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.831 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525877+0000", 2024-04-26T12:07:09.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0529999999999997e-06 2024-04-26T12:07:09.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.831 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:09.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575723+0000", 2024-04-26T12:07:09.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049846469999999997 2024-04-26T12:07:09.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.831 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:09.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575770+0000", 2024-04-26T12:07:09.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6387999999999997e-05 2024-04-26T12:07:09.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:09.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579823+0000", 2024-04-26T12:07:09.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0040534189999999999 2024-04-26T12:07:09.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:09.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579869+0000", 2024-04-26T12:07:09.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6218999999999999e-05 2024-04-26T12:07:09.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:09.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579954+0000", 2024-04-26T12:07:09.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5315999999999994e-05 2024-04-26T12:07:09.833 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.833 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:09.833 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.833 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:551 3.2 3:4272d415:::200.0000000b:head [write 448232~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:09.833 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:09.833 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 15.228049533, 2024-04-26T12:07:09.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053798273000000001, 2024-04-26T12:07:09.833 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:09.833 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.833 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:09.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.833 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:09.834 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:09.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.834 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.834 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:09.834 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:09.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.834 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.834 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:09.834 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:09.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:09.834 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:09.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526310+0000", 2024-04-26T12:07:09.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5279999999999999e-06 2024-04-26T12:07:09.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:09.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526317+0000", 2024-04-26T12:07:09.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8430000000000004e-06 2024-04-26T12:07:09.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526322+0000", 2024-04-26T12:07:09.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3340000000000001e-06 2024-04-26T12:07:09.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:09.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576135+0000", 2024-04-26T12:07:09.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049812113999999998 2024-04-26T12:07:09.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:09.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576186+0000", 2024-04-26T12:07:09.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1443999999999997e-05 2024-04-26T12:07:09.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:09.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579962+0000", 2024-04-26T12:07:09.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037763359999999999 2024-04-26T12:07:09.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:09.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580016+0000", 2024-04-26T12:07:09.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3421000000000002e-05 2024-04-26T12:07:09.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.838 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:09.838 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580106+0000", 2024-04-26T12:07:09.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9790000000000006e-05 2024-04-26T12:07:09.838 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.838 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:09.838 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.838 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.838 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 450189~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:09.838 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:09.838 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 15.227969404, 2024-04-26T12:07:09.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055070796999999998, 2024-04-26T12:07:09.838 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:09.838 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.839 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:09.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:09.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:09.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:09.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:09.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:09.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:09.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:09.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:09.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526390+0000", 2024-04-26T12:07:09.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8559999999999998e-06 2024-04-26T12:07:09.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:09.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526395+0000", 2024-04-26T12:07:09.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3319999999999999e-06 2024-04-26T12:07:09.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526399+0000", 2024-04-26T12:07:09.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.619e-06 2024-04-26T12:07:09.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:09.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576476+0000", 2024-04-26T12:07:09.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050077643999999998 2024-04-26T12:07:09.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:09.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576524+0000", 2024-04-26T12:07:09.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7184000000000001e-05 2024-04-26T12:07:09.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:09.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581347+0000", 2024-04-26T12:07:09.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0048231919999999996 2024-04-26T12:07:09.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:09.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581398+0000", 2024-04-26T12:07:09.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1345999999999999e-05 2024-04-26T12:07:09.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:09.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581458+0000", 2024-04-26T12:07:09.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0081000000000003e-05 2024-04-26T12:07:09.842 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.843 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:09.843 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.843 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 452113~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:09.843 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:09.843 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 15.227858188000001, 2024-04-26T12:07:09.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055041448, 2024-04-26T12:07:09.843 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:09.843 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.843 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:09.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:09.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:09.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.844 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.844 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:09.844 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:09.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.844 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.844 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:09.844 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526498+0000", 2024-04-26T12:07:09.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:09.844 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.844 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:09.844 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526540+0000", 2024-04-26T12:07:09.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2267e-05 2024-04-26T12:07:09.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:09.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526547+0000", 2024-04-26T12:07:09.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7000000000000002e-06 2024-04-26T12:07:09.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526550+0000", 2024-04-26T12:07:09.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0299999999999998e-06 2024-04-26T12:07:09.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:09.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577902+0000", 2024-04-26T12:07:09.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051351648999999999 2024-04-26T12:07:09.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.846 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:09.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577953+0000", 2024-04-26T12:07:09.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1289000000000003e-05 2024-04-26T12:07:09.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.846 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:09.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581464+0000", 2024-04-26T12:07:09.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035111259999999998 2024-04-26T12:07:09.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:09.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581490+0000", 2024-04-26T12:07:09.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5717000000000001e-05 2024-04-26T12:07:09.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:09.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581540+0000", 2024-04-26T12:07:09.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0287999999999997e-05 2024-04-26T12:07:09.847 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.847 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:09.847 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.848 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 454070~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:09.848 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:09.848 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 15.227301238999999, 2024-04-26T12:07:09.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054564161, 2024-04-26T12:07:09.848 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:09.848 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.848 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:09.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:09.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:09.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:09.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:09.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:09.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527055+0000", 2024-04-26T12:07:09.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:09.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:09.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527058+0000", 2024-04-26T12:07:09.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9890000000000001e-06 2024-04-26T12:07:09.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.850 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:09.850 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527066+0000", 2024-04-26T12:07:09.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4730000000000003e-06 2024-04-26T12:07:09.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.850 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.850 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527069+0000", 2024-04-26T12:07:09.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5810000000000001e-06 2024-04-26T12:07:09.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.850 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:09.850 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578308+0000", 2024-04-26T12:07:09.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051238911999999998 2024-04-26T12:07:09.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:09.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578391+0000", 2024-04-26T12:07:09.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2713999999999994e-05 2024-04-26T12:07:09.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:09.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581548+0000", 2024-04-26T12:07:09.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031577530000000001 2024-04-26T12:07:09.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:09.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581574+0000", 2024-04-26T12:07:09.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5350999999999998e-05 2024-04-26T12:07:09.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:09.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581620+0000", 2024-04-26T12:07:09.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5868999999999997e-05 2024-04-26T12:07:09.852 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.852 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:09.852 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.852 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 456028~3870 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:09.852 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:09.853 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 15.225544997, 2024-04-26T12:07:09.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055118997000000003, 2024-04-26T12:07:09.853 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:09.853 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.853 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:09.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:09.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:09.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:09.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:09.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:09.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528811+0000", 2024-04-26T12:07:09.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:09.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:09.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528887+0000", 2024-04-26T12:07:09.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5977999999999997e-05 2024-04-26T12:07:09.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:09.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528897+0000", 2024-04-26T12:07:09.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8730000000000002e-06 2024-04-26T12:07:09.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528901+0000", 2024-04-26T12:07:09.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4880000000000001e-06 2024-04-26T12:07:09.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:09.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580146+0000", 2024-04-26T12:07:09.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051244242000000002 2024-04-26T12:07:09.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:09.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580227+0000", 2024-04-26T12:07:09.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1044000000000005e-05 2024-04-26T12:07:09.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:09.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583864+0000", 2024-04-26T12:07:09.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036374419999999998 2024-04-26T12:07:09.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:09.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583894+0000", 2024-04-26T12:07:09.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9828999999999999e-05 2024-04-26T12:07:09.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:09.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583931+0000", 2024-04-26T12:07:09.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6908e-05 2024-04-26T12:07:09.857 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.857 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:09.857 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.857 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 459898~2037 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:09.858 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:09.858 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 15.225157006, 2024-04-26T12:07:09.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055925713000000002, 2024-04-26T12:07:09.858 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:09.858 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.858 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:09.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:09.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:09.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:09.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:09.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:09.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529199+0000", 2024-04-26T12:07:09.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:09.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:09.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529203+0000", 2024-04-26T12:07:09.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:07:09.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:09.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529209+0000", 2024-04-26T12:07:09.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7939999999999999e-06 2024-04-26T12:07:09.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529212+0000", 2024-04-26T12:07:09.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7290000000000002e-06 2024-04-26T12:07:09.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:09.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580784+0000", 2024-04-26T12:07:09.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051572073000000003 2024-04-26T12:07:09.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:09.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580883+0000", 2024-04-26T12:07:09.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8330000000000002e-05 2024-04-26T12:07:09.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:09.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585050+0000", 2024-04-26T12:07:09.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041670209999999999 2024-04-26T12:07:09.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:09.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585088+0000", 2024-04-26T12:07:09.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8559999999999997e-05 2024-04-26T12:07:09.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:09.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585125+0000", 2024-04-26T12:07:09.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7197999999999999e-05 2024-04-26T12:07:09.862 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.862 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:09.862 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.862 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 461935~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:09.862 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:09.862 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 15.224434552, 2024-04-26T12:07:09.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055266150999999999, 2024-04-26T12:07:09.862 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:09.863 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:09.863 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:09.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:09.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:09.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:09.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:09.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:09.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:09.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529921+0000", 2024-04-26T12:07:09.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:09.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:09.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529956+0000", 2024-04-26T12:07:09.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4687000000000002e-05 2024-04-26T12:07:09.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:09.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529966+0000", 2024-04-26T12:07:09.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0392e-05 2024-04-26T12:07:09.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:09.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529978+0000", 2024-04-26T12:07:09.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1348e-05 2024-04-26T12:07:09.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:09.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581659+0000", 2024-04-26T12:07:09.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051681454000000002 2024-04-26T12:07:09.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:09.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581746+0000", 2024-04-26T12:07:09.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6305999999999997e-05 2024-04-26T12:07:09.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:09.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585131+0000", 2024-04-26T12:07:09.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033853199999999998 2024-04-26T12:07:09.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:09.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585154+0000", 2024-04-26T12:07:09.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3258999999999999e-05 2024-04-26T12:07:09.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:09.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:09.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:09.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585188+0000", 2024-04-26T12:07:09.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4236000000000002e-05 2024-04-26T12:07:09.866 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.866 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:09.867 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.867 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:09.867 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:09.867 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:09.867 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:07:09.869 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:07:09.870 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:09.867+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:09.969 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:09.968+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:10.009 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:07:10.009 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:07:10.009 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:07:10.018 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:10.018 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:10.018 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:07:10.018 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:10.027 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:10.030 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:07:10.031 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:07:10.034 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:07:10.034 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:07:10.071 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:10.069+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:10.128 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:10.128 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:10.137 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:10.178 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:10.176+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:10.272 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:10.271+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:10.279 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:10.279 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:10.288 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:07:10.374 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:10.372+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:10.394 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:10.394 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:10.403 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:07:10.475 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:10.473+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:10.548 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:10.548 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:10.557 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:07:10.574 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:07:10.575 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~53s 2024-04-26T12:07:10.576 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:10.574+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:10.662 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:10.662 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:10.671 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:07:10.716 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:10.714+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:10.774 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:10.775 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:10.777 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:10.776+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:10.783 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:10.872 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-26T12:07:10.873 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-26T12:07:10.877 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:10.875+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:10.936 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:10.937 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:10.948 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:10.989 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:10.987+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:11.078 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:11.076+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:11.103 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:11.103 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:11.111 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:07:11.179 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:11.178+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:11.182 DEBUG:teuthology.parallel:result is None 2024-04-26T12:07:11.182 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T12:07:11.208 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T12:07:11.208 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-26T12:07:11.221 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-26T12:07:11.221 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T12:07:11.221 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T12:07:11.222 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:11.222 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:11.223 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:07:11.265 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T12:07:11.265 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T12:07:11.280 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:11.278+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:11.320 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:07:11.367 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:11.367 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:11.376 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:07:11.419 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:11.418+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:11.476 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:11.477 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:11.482 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:11.481+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:11.485 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:07:11.566 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-26T12:07:11.583 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:11.582+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:11.592 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:11.592 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:11.601 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:11.654 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:07:11.655 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":59,"fsid":"5bc300ae-e948-4ce3-81bb-5abae8c06799","created":"2024-04-26T12:04:41.919527+0000","modified":"2024-04-26T12:07:11.560128+0000","last_up_change":"2024-04-26T12:06:11.948237+0000","last_in_change":"2024-04-26T12:04:43.540390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:04:52.376506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":3.0299999713897705,"score_stable":3.0299999713897705,"optimal_score":0.33000001311302185,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:04:57.775333+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:05:02.226064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":0.67000001668930054,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:05:02.758806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5399999618530273,"score_stable":1.5399999618530273,"optimal_score":0.67000001668930054,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"638cfa85-e921-4403-9bcb-a7f4653cc3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":28597},{"type":"v1","addr":"172.21.15.143:6801","nonce":28597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":28597},{"type":"v1","addr":"172.21.15.143:6803","nonce":28597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":28597},{"type":"v1","addr":"172.21.15.143:6807","nonce":28597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":28597},{"type":"v1","addr":"172.21.15.143:6805","nonce":28597}]},"public_addr":"172.21.15.143:6801/28597","cluster_addr":"172.21.15.143:6803/28597","heartbeat_back_addr":"172.21.15.143:6807/28597","heartbeat_front_addr":"172.21.15.143:6805/28597","state":["exists","up"]},{"osd":1,"uuid":"2abc8d1e-ad72-4643-ad1e-3566e5113c44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":38,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":28560},{"type":"v1","addr":"172.21.15.154:6801","nonce":28560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":28560},{"type":"v1","addr":"172.21.15.154:6803","nonce":28560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":28560},{"type":"v1","addr":"172.21.15.154:6807","nonce":28560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":28560},{"type":"v1","addr":"172.21.15.154:6805","nonce":28560}]},"public_addr":"172.21.15.154:6801/28560","cluster_addr":"172.21.15.154:6803/28560","heartbeat_back_addr":"172.21.15.154:6807/28560","heartbeat_front_addr":"172.21.15.154:6805/28560","state":["exists"]},{"osd":2,"uuid":"d2ebc562-cb9b-4089-a19b-1788b70b57dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":28709},{"type":"v1","addr":"172.21.15.164:6801","nonce":28709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":28709},{"type":"v1","addr":"172.21.15.164:6803","nonce":28709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":28709},{"type":"v1","addr":"172.21.15.164:6807","nonce":28709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":28709},{"type":"v1","addr":"172.21.15.164:6805","nonce":28709}]},"public_addr":"172.21.15.164:6801/28709","cluster_addr":"172.21.15.164:6803/28709","heartbeat_back_addr":"172.21.15.164:6807/28709","heartbeat_front_addr":"172.21.15.164:6805/28709","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.573478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.624482+0000","dead_epoch":37},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.615449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:07:11.667 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:04:52.376506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:04:57.775333+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:05:02.226064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:05:02.758806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5399999618530273, 'score_stable': 1.5399999618530273, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T12:07:11.668 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:07:11.683 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:11.681+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:11.703 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:11.703 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:11.712 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:11.784 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:11.783+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:11.854 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:11.854 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:11.862 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:07:11.908 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:11.907+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:11.963 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-04-26T12:07:11.976 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:07:11.986 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:11.985+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:12.004 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:12.004 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:12.017 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:07:12.035 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:07:12.102 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:12.101+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:12.159 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:12.159 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:12.163 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:07:12.163 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:07:12.163 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:07:12.168 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:07:12.181 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:07:12.181 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:07:12.184 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:07:12.185 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:07:12.189 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:12.187+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:12.283 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2024-04-26T12:07:12.294 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:12.290+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:12.296 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T12:07:12.316 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:12.316 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:07:12.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:07:12.317 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:07:12.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.317 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:536 3.2 3:4272d415:::200.0000000b:head [write 405817~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:12.317 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:12.317 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.786652908000001, 2024-04-26T12:07:12.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053030282999999998, 2024-04-26T12:07:12.317 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:12.317 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.317 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:12.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:12.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:12.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:12.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:12.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:12.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524136+0000", 2024-04-26T12:07:12.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:12.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:12.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524139+0000", 2024-04-26T12:07:12.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2919999999999998e-06 2024-04-26T12:07:12.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:12.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524144+0000", 2024-04-26T12:07:12.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.502e-06 2024-04-26T12:07:12.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524149+0000", 2024-04-26T12:07:12.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7310000000000001e-06 2024-04-26T12:07:12.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:12.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570935+0000", 2024-04-26T12:07:12.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.046785603000000002 2024-04-26T12:07:12.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:12.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570981+0000", 2024-04-26T12:07:12.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6085999999999999e-05 2024-04-26T12:07:12.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:12.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577039+0000", 2024-04-26T12:07:12.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060582099999999996 2024-04-26T12:07:12.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:12.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577081+0000", 2024-04-26T12:07:12.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1927e-05 2024-04-26T12:07:12.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:12.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577167+0000", 2024-04-26T12:07:12.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6311999999999996e-05 2024-04-26T12:07:12.323 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.323 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:12.323 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.323 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:537 3.2 3:4272d415:::200.0000000b:head [write 407216~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:12.324 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:12.324 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.78663697, 2024-04-26T12:07:12.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053131411000000003, 2024-04-26T12:07:12.324 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:12.324 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.324 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:12.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:12.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:12.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:12.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:12.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:12.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524152+0000", 2024-04-26T12:07:12.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:12.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:12.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524157+0000", 2024-04-26T12:07:12.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3529999999999997e-06 2024-04-26T12:07:12.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:12.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524162+0000", 2024-04-26T12:07:12.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5910000000000003e-06 2024-04-26T12:07:12.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524170+0000", 2024-04-26T12:07:12.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:07:12.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:12.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571323+0000", 2024-04-26T12:07:12.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047153289000000001 2024-04-26T12:07:12.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:12.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571367+0000", 2024-04-26T12:07:12.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4205000000000001e-05 2024-04-26T12:07:12.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.329 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:12.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577174+0000", 2024-04-26T12:07:12.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058072250000000001 2024-04-26T12:07:12.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.329 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:12.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577218+0000", 2024-04-26T12:07:12.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3294999999999998e-05 2024-04-26T12:07:12.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.329 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:12.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577284+0000", 2024-04-26T12:07:12.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6483999999999996e-05 2024-04-26T12:07:12.330 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.330 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:12.330 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.330 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:538 3.2 3:4272d415:::200.0000000b:head [write 408629~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:12.330 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:12.330 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.78661627, 2024-04-26T12:07:12.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053241841999999998, 2024-04-26T12:07:12.330 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:12.330 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.330 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:12.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:12.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:12.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:12.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:12.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:12.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:12.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:12.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:12.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524178+0000", 2024-04-26T12:07:12.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1420000000000001e-06 2024-04-26T12:07:12.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:12.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524184+0000", 2024-04-26T12:07:12.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4240000000000001e-06 2024-04-26T12:07:12.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524188+0000", 2024-04-26T12:07:12.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2710000000000003e-06 2024-04-26T12:07:12.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:12.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571623+0000", 2024-04-26T12:07:12.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047435119999999997 2024-04-26T12:07:12.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:12.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571668+0000", 2024-04-26T12:07:12.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5377000000000003e-05 2024-04-26T12:07:12.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:12.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577292+0000", 2024-04-26T12:07:12.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0056232030000000002 2024-04-26T12:07:12.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:12.334 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577330+0000", 2024-04-26T12:07:12.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8748999999999998e-05 2024-04-26T12:07:12.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.334 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:12.334 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577415+0000", 2024-04-26T12:07:12.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4913000000000005e-05 2024-04-26T12:07:12.334 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.334 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:12.334 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.334 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:539 3.2 3:4272d415:::200.0000000b:head [write 410547~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:12.335 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:12.335 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.786598137999999, 2024-04-26T12:07:12.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053372670999999997, 2024-04-26T12:07:12.335 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:12.335 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.335 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:12.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.335 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:12.335 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:12.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.335 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.335 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:12.335 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:12.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:12.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524191+0000", 2024-04-26T12:07:12.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:12.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:12.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524199+0000", 2024-04-26T12:07:12.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6520000000000006e-06 2024-04-26T12:07:12.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:12.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524205+0000", 2024-04-26T12:07:12.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:07:12.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524209+0000", 2024-04-26T12:07:12.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.335e-06 2024-04-26T12:07:12.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:12.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572320+0000", 2024-04-26T12:07:12.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048110992999999998 2024-04-26T12:07:12.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:12.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572364+0000", 2024-04-26T12:07:12.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4577999999999999e-05 2024-04-26T12:07:12.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:12.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577426+0000", 2024-04-26T12:07:12.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050615139999999996 2024-04-26T12:07:12.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:12.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577480+0000", 2024-04-26T12:07:12.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3599e-05 2024-04-26T12:07:12.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:12.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577564+0000", 2024-04-26T12:07:12.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4699999999999999e-05 2024-04-26T12:07:12.341 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.341 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:12.341 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.342 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:540 3.2 3:4272d415:::200.0000000b:head [write 411948~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:12.342 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:12.342 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.78657712, 2024-04-26T12:07:12.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053497045999999999, 2024-04-26T12:07:12.342 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:12.342 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.342 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:12.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:12.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:12.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.343 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:12.343 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:12.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.343 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:12.343 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524212+0000", 2024-04-26T12:07:12.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:12.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.343 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:12.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524215+0000", 2024-04-26T12:07:12.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.559e-06 2024-04-26T12:07:12.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:12.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524220+0000", 2024-04-26T12:07:12.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2920000000000003e-06 2024-04-26T12:07:12.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524224+0000", 2024-04-26T12:07:12.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3680000000000004e-06 2024-04-26T12:07:12.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:12.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572619+0000", 2024-04-26T12:07:12.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048394549000000002 2024-04-26T12:07:12.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:12.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572669+0000", 2024-04-26T12:07:12.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0249e-05 2024-04-26T12:07:12.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:12.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577575+0000", 2024-04-26T12:07:12.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049053329999999996 2024-04-26T12:07:12.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:12.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577625+0000", 2024-04-26T12:07:12.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0274e-05 2024-04-26T12:07:12.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:12.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577710+0000", 2024-04-26T12:07:12.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4741999999999996e-05 2024-04-26T12:07:12.346 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.346 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:12.346 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.347 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:543 3.2 3:4272d415:::200.0000000b:head [write 413907~2485 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:12.347 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:12.347 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.786507426, 2024-04-26T12:07:12.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053578708000000003, 2024-04-26T12:07:12.347 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:12.347 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.347 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:12.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:12.347 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:12.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:12.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:12.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:12.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:12.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:12.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:12.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524287+0000", 2024-04-26T12:07:12.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2190000000000003e-06 2024-04-26T12:07:12.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:12.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524294+0000", 2024-04-26T12:07:12.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5660000000000003e-06 2024-04-26T12:07:12.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524298+0000", 2024-04-26T12:07:12.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3900000000000003e-06 2024-04-26T12:07:12.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:12.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572992+0000", 2024-04-26T12:07:12.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048693835999999997 2024-04-26T12:07:12.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:12.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573045+0000", 2024-04-26T12:07:12.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2793000000000001e-05 2024-04-26T12:07:12.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:12.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577721+0000", 2024-04-26T12:07:12.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046760550000000001 2024-04-26T12:07:12.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:12.352 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577777+0000", 2024-04-26T12:07:12.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5908000000000001e-05 2024-04-26T12:07:12.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.352 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:12.352 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577861+0000", 2024-04-26T12:07:12.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4337000000000002e-05 2024-04-26T12:07:12.352 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.352 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:12.353 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.353 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:544 3.2 3:4272d415:::200.0000000b:head [write 416392~3872 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:12.353 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:12.353 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.786487703999999, 2024-04-26T12:07:12.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054810527999999997, 2024-04-26T12:07:12.353 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:12.353 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.353 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:12.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:12.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:12.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:12.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:12.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:12.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:12.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:12.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:12.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524307+0000", 2024-04-26T12:07:12.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1580000000000004e-06 2024-04-26T12:07:12.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.356 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:12.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524312+0000", 2024-04-26T12:07:12.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6380000000000001e-06 2024-04-26T12:07:12.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.356 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524317+0000", 2024-04-26T12:07:12.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4000000000000002e-06 2024-04-26T12:07:12.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:12.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573348+0000", 2024-04-26T12:07:12.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049031433999999999 2024-04-26T12:07:12.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:12.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573393+0000", 2024-04-26T12:07:12.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4536999999999997e-05 2024-04-26T12:07:12.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:12.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578978+0000", 2024-04-26T12:07:12.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055848299999999998 2024-04-26T12:07:12.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:12.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579031+0000", 2024-04-26T12:07:12.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3708000000000001e-05 2024-04-26T12:07:12.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:12.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579113+0000", 2024-04-26T12:07:12.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1258e-05 2024-04-26T12:07:12.359 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.359 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:12.359 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.360 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:545 3.2 3:4272d415:::200.0000000b:head [write 420264~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:12.360 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:12.360 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.786469078, 2024-04-26T12:07:12.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054927386000000002, 2024-04-26T12:07:12.360 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:12.360 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.360 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:12.360 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.360 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:12.360 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:12.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.360 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.361 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.361 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:12.361 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:12.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.361 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.361 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.361 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:12.361 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524320+0000", 2024-04-26T12:07:12.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:12.361 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.361 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.361 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:12.361 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524325+0000", 2024-04-26T12:07:12.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5249999999999999e-06 2024-04-26T12:07:12.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:12.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524330+0000", 2024-04-26T12:07:12.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5629999999999999e-06 2024-04-26T12:07:12.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524335+0000", 2024-04-26T12:07:12.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.685e-06 2024-04-26T12:07:12.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:12.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573727+0000", 2024-04-26T12:07:12.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049392034000000001 2024-04-26T12:07:12.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:12.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573775+0000", 2024-04-26T12:07:12.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7435999999999998e-05 2024-04-26T12:07:12.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:12.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579120+0000", 2024-04-26T12:07:12.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0053452949999999999 2024-04-26T12:07:12.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:12.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579167+0000", 2024-04-26T12:07:12.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7240000000000002e-05 2024-04-26T12:07:12.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:12.365 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579248+0000", 2024-04-26T12:07:12.365 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0947999999999998e-05 2024-04-26T12:07:12.365 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.365 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:12.365 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.365 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.365 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.365 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 422222~8537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:12.365 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:12.365 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.786450761000001, 2024-04-26T12:07:12.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055065936000000003, 2024-04-26T12:07:12.366 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:12.366 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.366 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:12.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:12.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:12.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:12.367 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:12.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:12.367 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:12.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:12.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:12.368 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524347+0000", 2024-04-26T12:07:12.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7129999999999994e-06 2024-04-26T12:07:12.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.368 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:12.368 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524357+0000", 2024-04-26T12:07:12.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0232e-05 2024-04-26T12:07:12.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.368 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.368 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524362+0000", 2024-04-26T12:07:12.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:07:12.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:12.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574119+0000", 2024-04-26T12:07:12.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049756727000000001 2024-04-26T12:07:12.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:12.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574166+0000", 2024-04-26T12:07:12.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7086000000000003e-05 2024-04-26T12:07:12.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:12.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579261+0000", 2024-04-26T12:07:12.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050948310000000002 2024-04-26T12:07:12.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:12.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579316+0000", 2024-04-26T12:07:12.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5068000000000002e-05 2024-04-26T12:07:12.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:12.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579405+0000", 2024-04-26T12:07:12.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9251000000000003e-05 2024-04-26T12:07:12.371 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.371 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:12.371 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.371 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 430759~2035 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:12.371 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:12.371 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.786423770999999, 2024-04-26T12:07:12.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055164950999999997, 2024-04-26T12:07:12.371 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:12.371 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.372 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:12.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.372 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:12.372 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:12.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.372 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:12.372 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:12.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.372 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:12.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:12.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:12.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:12.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524368+0000", 2024-04-26T12:07:12.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.57e-06 2024-04-26T12:07:12.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:12.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524375+0000", 2024-04-26T12:07:12.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6170000000000003e-06 2024-04-26T12:07:12.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524380+0000", 2024-04-26T12:07:12.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2700000000000004e-06 2024-04-26T12:07:12.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:12.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574639+0000", 2024-04-26T12:07:12.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050259459999999999 2024-04-26T12:07:12.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:12.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574687+0000", 2024-04-26T12:07:12.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7608999999999998e-05 2024-04-26T12:07:12.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:12.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579414+0000", 2024-04-26T12:07:12.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047268750000000002 2024-04-26T12:07:12.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:12.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579456+0000", 2024-04-26T12:07:12.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1885000000000003e-05 2024-04-26T12:07:12.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:12.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579531+0000", 2024-04-26T12:07:12.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5053000000000001e-05 2024-04-26T12:07:12.377 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.377 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:12.377 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.378 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 432794~10523 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:12.378 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:12.378 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.785433047000001, 2024-04-26T12:07:12.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054314727, 2024-04-26T12:07:12.378 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:12.378 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.378 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:12.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:12.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:12.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:12.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:12.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:12.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525356+0000", 2024-04-26T12:07:12.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:12.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:12.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525414+0000", 2024-04-26T12:07:12.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8148e-05 2024-04-26T12:07:12.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:12.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525423+0000", 2024-04-26T12:07:12.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9749999999999996e-06 2024-04-26T12:07:12.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525428+0000", 2024-04-26T12:07:12.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0270000000000003e-06 2024-04-26T12:07:12.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:12.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574950+0000", 2024-04-26T12:07:12.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049521840999999997 2024-04-26T12:07:12.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:12.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575002+0000", 2024-04-26T12:07:12.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1586999999999999e-05 2024-04-26T12:07:12.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:12.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579543+0000", 2024-04-26T12:07:12.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045416340000000001 2024-04-26T12:07:12.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:12.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579587+0000", 2024-04-26T12:07:12.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3875999999999998e-05 2024-04-26T12:07:12.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:12.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579671+0000", 2024-04-26T12:07:12.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4351999999999995e-05 2024-04-26T12:07:12.383 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.383 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:12.383 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.383 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 443317~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:12.383 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:12.384 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.785357072, 2024-04-26T12:07:12.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054381889000000003, 2024-04-26T12:07:12.384 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:12.384 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.384 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:12.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:12.385 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:12.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.385 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:12.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:12.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.386 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:12.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525432+0000", 2024-04-26T12:07:12.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:12.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:12.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525435+0000", 2024-04-26T12:07:12.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3070000000000001e-06 2024-04-26T12:07:12.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:12.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525439+0000", 2024-04-26T12:07:12.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.104e-06 2024-04-26T12:07:12.389 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.389 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.389 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525442+0000", 2024-04-26T12:07:12.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0460000000000001e-06 2024-04-26T12:07:12.389 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.390 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:12.390 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575405+0000", 2024-04-26T12:07:12.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049963059999999997 2024-04-26T12:07:12.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.390 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:12.390 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575450+0000", 2024-04-26T12:07:12.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5034000000000003e-05 2024-04-26T12:07:12.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.390 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:12.390 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579680+0000", 2024-04-26T12:07:12.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042302260000000001 2024-04-26T12:07:12.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:12.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579737+0000", 2024-04-26T12:07:12.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7241000000000003e-05 2024-04-26T12:07:12.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:12.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579815+0000", 2024-04-26T12:07:12.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7278000000000001e-05 2024-04-26T12:07:12.391 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.391 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:12.391 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.391 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 445275~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:12.392 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:12.392 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.784929896000001, 2024-04-26T12:07:12.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054094668999999998, 2024-04-26T12:07:12.392 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:12.392 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.392 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:12.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.392 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:12.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:12.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.392 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:12.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:12.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:12.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525859+0000", 2024-04-26T12:07:12.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:12.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:12.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525864+0000", 2024-04-26T12:07:12.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:07:12.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:12.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525872+0000", 2024-04-26T12:07:12.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6790000000000005e-06 2024-04-26T12:07:12.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525877+0000", 2024-04-26T12:07:12.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0529999999999997e-06 2024-04-26T12:07:12.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.396 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:12.396 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575723+0000", 2024-04-26T12:07:12.397 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049846469999999997 2024-04-26T12:07:12.397 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.397 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.397 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:12.397 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575770+0000", 2024-04-26T12:07:12.397 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6387999999999997e-05 2024-04-26T12:07:12.397 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.397 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:12.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579823+0000", 2024-04-26T12:07:12.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0040534189999999999 2024-04-26T12:07:12.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:12.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579869+0000", 2024-04-26T12:07:12.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6218999999999999e-05 2024-04-26T12:07:12.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:12.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579954+0000", 2024-04-26T12:07:12.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5315999999999994e-05 2024-04-26T12:07:12.399 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:551 3.2 3:4272d415:::200.0000000b:head [write 448232~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.784482462, 2024-04-26T12:07:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053798273000000001, 2024-04-26T12:07:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.400 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:12.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:12.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:12.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:12.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:12.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.402 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:12.402 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:12.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:12.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.402 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:12.402 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526310+0000", 2024-04-26T12:07:12.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5279999999999999e-06 2024-04-26T12:07:12.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526317+0000", 2024-04-26T12:07:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8430000000000004e-06 2024-04-26T12:07:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526322+0000", 2024-04-26T12:07:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3340000000000001e-06 2024-04-26T12:07:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576135+0000", 2024-04-26T12:07:12.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049812113999999998 2024-04-26T12:07:12.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:12.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576186+0000", 2024-04-26T12:07:12.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1443999999999997e-05 2024-04-26T12:07:12.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:12.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579962+0000", 2024-04-26T12:07:12.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037763359999999999 2024-04-26T12:07:12.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.405 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:12.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580016+0000", 2024-04-26T12:07:12.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3421000000000002e-05 2024-04-26T12:07:12.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.406 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:12.406 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580106+0000", 2024-04-26T12:07:12.406 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9790000000000006e-05 2024-04-26T12:07:12.406 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.406 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:12.406 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.406 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.407 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 450189~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:12.407 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:12.407 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.784402332999999, 2024-04-26T12:07:12.407 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055070796999999998, 2024-04-26T12:07:12.407 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:12.408 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.408 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:12.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.408 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:12.408 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:12.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.409 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:12.409 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:12.409 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.409 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.409 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:12.409 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:12.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:12.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:12.411 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526390+0000", 2024-04-26T12:07:12.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8559999999999998e-06 2024-04-26T12:07:12.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.411 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:12.411 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526395+0000", 2024-04-26T12:07:12.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3319999999999999e-06 2024-04-26T12:07:12.412 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.412 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.412 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.412 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526399+0000", 2024-04-26T12:07:12.412 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.619e-06 2024-04-26T12:07:12.412 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.412 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.412 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:12.412 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576476+0000", 2024-04-26T12:07:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050077643999999998 2024-04-26T12:07:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576524+0000", 2024-04-26T12:07:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7184000000000001e-05 2024-04-26T12:07:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581347+0000", 2024-04-26T12:07:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0048231919999999996 2024-04-26T12:07:12.413 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581398+0000", 2024-04-26T12:07:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1345999999999999e-05 2024-04-26T12:07:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581458+0000", 2024-04-26T12:07:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0081000000000003e-05 2024-04-26T12:07:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.414 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 452113~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.784291116999999, 2024-04-26T12:07:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055041448, 2024-04-26T12:07:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.415 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:12.416 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526498+0000", 2024-04-26T12:07:12.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:12.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:12.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526540+0000", 2024-04-26T12:07:12.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2267e-05 2024-04-26T12:07:12.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:12.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526547+0000", 2024-04-26T12:07:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7000000000000002e-06 2024-04-26T12:07:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526550+0000", 2024-04-26T12:07:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0299999999999998e-06 2024-04-26T12:07:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577902+0000", 2024-04-26T12:07:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051351648999999999 2024-04-26T12:07:12.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.419 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:12.419 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577953+0000", 2024-04-26T12:07:12.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1289000000000003e-05 2024-04-26T12:07:12.419 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.419 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:12.419 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581464+0000", 2024-04-26T12:07:12.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035111259999999998 2024-04-26T12:07:12.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:12.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581490+0000", 2024-04-26T12:07:12.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5717000000000001e-05 2024-04-26T12:07:12.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581540+0000", 2024-04-26T12:07:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0287999999999997e-05 2024-04-26T12:07:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 454070~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.783734167999999, 2024-04-26T12:07:12.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054564161, 2024-04-26T12:07:12.422 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:12.422 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.422 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:12.422 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.422 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:12.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:12.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.422 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.422 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:12.423 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:12.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:12.423 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527055+0000", 2024-04-26T12:07:12.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:12.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.424 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.424 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:12.424 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527058+0000", 2024-04-26T12:07:12.424 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9890000000000001e-06 2024-04-26T12:07:12.424 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.424 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.424 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:12.424 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527066+0000", 2024-04-26T12:07:12.424 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4730000000000003e-06 2024-04-26T12:07:12.424 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.425 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527069+0000", 2024-04-26T12:07:12.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5810000000000001e-06 2024-04-26T12:07:12.425 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.425 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:12.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578308+0000", 2024-04-26T12:07:12.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051238911999999998 2024-04-26T12:07:12.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:12.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578391+0000", 2024-04-26T12:07:12.426 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2713999999999994e-05 2024-04-26T12:07:12.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:12.427 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581548+0000", 2024-04-26T12:07:12.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031577530000000001 2024-04-26T12:07:12.427 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.427 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:12.427 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581574+0000", 2024-04-26T12:07:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5350999999999998e-05 2024-04-26T12:07:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581620+0000", 2024-04-26T12:07:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5868999999999997e-05 2024-04-26T12:07:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.428 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.429 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 456028~3870 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:12.429 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:12.429 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.781977926, 2024-04-26T12:07:12.429 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055118997000000003, 2024-04-26T12:07:12.429 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:12.429 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.429 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:12.429 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.429 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:12.430 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:12.430 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.430 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.430 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.430 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:12.430 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:12.430 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.431 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.431 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.431 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:12.431 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528811+0000", 2024-04-26T12:07:12.431 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:12.431 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.431 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.432 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:12.432 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528887+0000", 2024-04-26T12:07:12.432 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5977999999999997e-05 2024-04-26T12:07:12.432 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.432 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.432 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:12.432 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528897+0000", 2024-04-26T12:07:12.432 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8730000000000002e-06 2024-04-26T12:07:12.433 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.433 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.433 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.433 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528901+0000", 2024-04-26T12:07:12.433 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4880000000000001e-06 2024-04-26T12:07:12.433 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.433 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.434 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:12.434 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580146+0000", 2024-04-26T12:07:12.434 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051244242000000002 2024-04-26T12:07:12.434 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.434 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.434 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:12.434 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580227+0000", 2024-04-26T12:07:12.435 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1044000000000005e-05 2024-04-26T12:07:12.435 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.435 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.435 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:12.435 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583864+0000", 2024-04-26T12:07:12.435 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036374419999999998 2024-04-26T12:07:12.435 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.435 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.435 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:12.435 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583894+0000", 2024-04-26T12:07:12.436 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9828999999999999e-05 2024-04-26T12:07:12.436 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.436 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.436 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:12.436 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583931+0000", 2024-04-26T12:07:12.436 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6908e-05 2024-04-26T12:07:12.436 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.436 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:12.436 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.437 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.437 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.437 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 459898~2037 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:12.437 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:12.437 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.781589935, 2024-04-26T12:07:12.437 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055925713000000002, 2024-04-26T12:07:12.437 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:12.437 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.437 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:12.438 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.438 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:12.438 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:12.438 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.438 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.438 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.438 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:12.438 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:12.438 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.438 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.438 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529199+0000", 2024-04-26T12:07:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529203+0000", 2024-04-26T12:07:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:07:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:12.439 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529209+0000", 2024-04-26T12:07:12.440 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7939999999999999e-06 2024-04-26T12:07:12.440 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.440 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.440 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.440 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529212+0000", 2024-04-26T12:07:12.440 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7290000000000002e-06 2024-04-26T12:07:12.440 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.440 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.441 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:12.441 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580784+0000", 2024-04-26T12:07:12.441 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051572073000000003 2024-04-26T12:07:12.441 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.441 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.441 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:12.441 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580883+0000", 2024-04-26T12:07:12.441 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8330000000000002e-05 2024-04-26T12:07:12.441 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.442 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.442 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:12.442 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585050+0000", 2024-04-26T12:07:12.442 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041670209999999999 2024-04-26T12:07:12.442 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.442 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.442 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:12.442 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585088+0000", 2024-04-26T12:07:12.443 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8559999999999997e-05 2024-04-26T12:07:12.443 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.443 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.443 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:12.443 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585125+0000", 2024-04-26T12:07:12.443 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7197999999999999e-05 2024-04-26T12:07:12.443 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.443 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:12.444 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.444 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.444 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.444 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 461935~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:12.444 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:12.444 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.780867481000001, 2024-04-26T12:07:12.444 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055266150999999999, 2024-04-26T12:07:12.444 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:12.444 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.444 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:12.445 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.445 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:12.445 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:12.445 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.445 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.445 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.445 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:12.445 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:12.445 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529921+0000", 2024-04-26T12:07:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529956+0000", 2024-04-26T12:07:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4687000000000002e-05 2024-04-26T12:07:12.446 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.447 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.447 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:12.447 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529966+0000", 2024-04-26T12:07:12.447 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0392e-05 2024-04-26T12:07:12.447 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.447 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.447 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.447 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529978+0000", 2024-04-26T12:07:12.447 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1348e-05 2024-04-26T12:07:12.448 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.448 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.448 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:12.448 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581659+0000", 2024-04-26T12:07:12.448 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051681454000000002 2024-04-26T12:07:12.448 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.448 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.448 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:12.448 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581746+0000", 2024-04-26T12:07:12.448 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6305999999999997e-05 2024-04-26T12:07:12.449 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.449 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.449 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:12.449 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585131+0000", 2024-04-26T12:07:12.449 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033853199999999998 2024-04-26T12:07:12.449 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.449 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.449 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:12.450 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585154+0000", 2024-04-26T12:07:12.450 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3258999999999999e-05 2024-04-26T12:07:12.450 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:12.450 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:12.450 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:12.450 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585188+0000", 2024-04-26T12:07:12.450 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4236000000000002e-05 2024-04-26T12:07:12.450 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.450 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:12.450 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.450 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:12.451 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:12.451 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:12.451 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:07:12.453 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:12.452+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:12.554 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:12.553+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:12.556 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:12.556 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:12.556 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:07:12.556 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:12.566 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:12.596 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-04-26T12:07:12.609 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T12:07:12.654 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:12.652+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:12.669 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:12.669 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:12.669 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:07:12.669 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:07:12.670 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:12.677 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:12.769 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:12.767+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:12.823 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:12.823 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:07:12.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:07:12.824 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:07:12.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.824 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2989 3.d 3:b02ffd62:::200.00000010:head [write 3767903~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:12.824 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:12.824 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.305137427, 2024-04-26T12:07:12.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057069768999999999, 2024-04-26T12:07:12.824 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:12.824 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.824 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:12.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:12.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:12.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:12.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:12.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:12.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:12.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:12.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:12.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516446+0000", 2024-04-26T12:07:12.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6469999999999997e-06 2024-04-26T12:07:12.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:12.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516449+0000", 2024-04-26T12:07:12.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.976e-06 2024-04-26T12:07:12.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516452+0000", 2024-04-26T12:07:12.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.509e-06 2024-04-26T12:07:12.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:12.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.568562+0000", 2024-04-26T12:07:12.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.052110030000000002 2024-04-26T12:07:12.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:12.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.568615+0000", 2024-04-26T12:07:12.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2809999999999998e-05 2024-04-26T12:07:12.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:12.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573425+0000", 2024-04-26T12:07:12.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048105149999999996 2024-04-26T12:07:12.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.828 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:12.828 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573452+0000", 2024-04-26T12:07:12.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6778e-05 2024-04-26T12:07:12.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.828 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.828 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:12.828 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573512+0000", 2024-04-26T12:07:12.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9710000000000003e-05 2024-04-26T12:07:12.828 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.828 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:12.828 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.828 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.828 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2990 3.d 3:b02ffd62:::200.00000010:head [write 3769302~4483 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:12.829 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:12.829 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.305125428, 2024-04-26T12:07:12.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057131345, 2024-04-26T12:07:12.829 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:12.829 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.829 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:12.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.829 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:12.829 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:12.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.829 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:12.829 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:12.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:12.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:12.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:12.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:12.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516459+0000", 2024-04-26T12:07:12.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2859999999999999e-06 2024-04-26T12:07:12.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:12.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516462+0000", 2024-04-26T12:07:12.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0790000000000001e-06 2024-04-26T12:07:12.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516465+0000", 2024-04-26T12:07:12.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.464e-06 2024-04-26T12:07:12.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:12.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569035+0000", 2024-04-26T12:07:12.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.052570328999999999 2024-04-26T12:07:12.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:12.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569113+0000", 2024-04-26T12:07:12.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8118e-05 2024-04-26T12:07:12.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:12.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573517+0000", 2024-04-26T12:07:12.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044039200000000004 2024-04-26T12:07:12.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:12.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573541+0000", 2024-04-26T12:07:12.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3805999999999999e-05 2024-04-26T12:07:12.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:12.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573585+0000", 2024-04-26T12:07:12.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4567000000000002e-05 2024-04-26T12:07:12.833 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.833 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:12.833 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.833 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2991 3.d 3:b02ffd62:::200.00000010:head [write 3773785~4213 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:12.833 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:12.833 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.305112739, 2024-04-26T12:07:12.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057230554000000003, 2024-04-26T12:07:12.834 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:12.834 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.834 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:12.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.834 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:12.834 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:12.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.834 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.834 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:12.834 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:12.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.835 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.835 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.835 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:12.835 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516466+0000", 2024-04-26T12:07:12.835 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:12.835 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.835 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.835 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:12.835 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516470+0000", 2024-04-26T12:07:12.835 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7960000000000002e-06 2024-04-26T12:07:12.836 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.836 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.836 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:12.836 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516478+0000", 2024-04-26T12:07:12.836 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:07:12.836 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.836 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.836 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.836 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516484+0000", 2024-04-26T12:07:12.836 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5300000000000002e-06 2024-04-26T12:07:12.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:12.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569662+0000", 2024-04-26T12:07:12.837 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053177896000000002 2024-04-26T12:07:12.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:12.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569749+0000", 2024-04-26T12:07:12.837 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7229000000000001e-05 2024-04-26T12:07:12.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:12.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573593+0000", 2024-04-26T12:07:12.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038433109999999999 2024-04-26T12:07:12.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.838 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.838 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:12.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573631+0000", 2024-04-26T12:07:12.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8615000000000002e-05 2024-04-26T12:07:12.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.838 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.838 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:12.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573697+0000", 2024-04-26T12:07:12.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5971999999999998e-05 2024-04-26T12:07:12.838 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.839 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:12.839 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.843 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2999 3.d 3:b02ffd62:::200.00000010:head [write 3797283~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:12.843 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:12.843 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.300598351, 2024-04-26T12:07:12.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057330949999999999, 2024-04-26T12:07:12.843 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:12.843 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.843 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:12.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:12.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:12.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.843 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:12.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:12.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:12.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520980+0000", 2024-04-26T12:07:12.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:12.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:12.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520991+0000", 2024-04-26T12:07:12.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1154e-05 2024-04-26T12:07:12.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:12.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521014+0000", 2024-04-26T12:07:12.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2288000000000001e-05 2024-04-26T12:07:12.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521019+0000", 2024-04-26T12:07:12.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0889999999999999e-06 2024-04-26T12:07:12.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:12.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.575399+0000", 2024-04-26T12:07:12.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054380392999999999 2024-04-26T12:07:12.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:12.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.575440+0000", 2024-04-26T12:07:12.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1146000000000002e-05 2024-04-26T12:07:12.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:12.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578237+0000", 2024-04-26T12:07:12.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002796761 2024-04-26T12:07:12.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:12.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578260+0000", 2024-04-26T12:07:12.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3538999999999999e-05 2024-04-26T12:07:12.847 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.847 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.847 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:12.847 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578312+0000", 2024-04-26T12:07:12.847 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1508999999999998e-05 2024-04-26T12:07:12.847 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.847 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:12.847 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.847 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.847 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.847 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3000 3.d 3:b02ffd62:::200.00000010:head [write 3801160~9028 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:12.847 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:12.847 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.299972385, 2024-04-26T12:07:12.847 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.059231688999999997, 2024-04-26T12:07:12.847 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:12.848 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.848 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:12.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.848 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:12.848 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:12.848 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.848 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.848 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:12.848 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:12.848 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.848 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.848 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:12.848 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521606+0000", 2024-04-26T12:07:12.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:12.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:12.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521627+0000", 2024-04-26T12:07:12.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1129e-05 2024-04-26T12:07:12.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:12.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521637+0000", 2024-04-26T12:07:12.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8789999999999998e-06 2024-04-26T12:07:12.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521644+0000", 2024-04-26T12:07:12.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:07:12.850 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.850 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:12.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576381+0000", 2024-04-26T12:07:12.850 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.05473629 2024-04-26T12:07:12.850 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.850 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:12.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576451+0000", 2024-04-26T12:07:12.850 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0525000000000007e-05 2024-04-26T12:07:12.850 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.850 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:12.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580734+0000", 2024-04-26T12:07:12.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042826699999999997 2024-04-26T12:07:12.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.851 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.851 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:12.851 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580780+0000", 2024-04-26T12:07:12.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6006e-05 2024-04-26T12:07:12.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.851 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.851 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:12.851 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580839+0000", 2024-04-26T12:07:12.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8783000000000003e-05 2024-04-26T12:07:12.851 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.851 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:12.851 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.852 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3001 3.d 3:b02ffd62:::200.00000010:head [write 3810188~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:12.852 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:12.852 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.299420053, 2024-04-26T12:07:12.852 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.060161213999999998, 2024-04-26T12:07:12.852 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:12.852 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.852 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:12.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.852 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:12.852 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:12.852 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.852 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.852 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:12.852 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:12.853 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.853 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.853 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:12.853 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522158+0000", 2024-04-26T12:07:12.853 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:12.853 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.853 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:12.853 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522165+0000", 2024-04-26T12:07:12.853 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.28e-06 2024-04-26T12:07:12.853 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.853 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:12.853 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522178+0000", 2024-04-26T12:07:12.854 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3738e-05 2024-04-26T12:07:12.854 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.855 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522186+0000", 2024-04-26T12:07:12.855 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.267e-06 2024-04-26T12:07:12.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:12.855 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576889+0000", 2024-04-26T12:07:12.855 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054703442999999997 2024-04-26T12:07:12.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:12.855 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576953+0000", 2024-04-26T12:07:12.855 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4213000000000003e-05 2024-04-26T12:07:12.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.856 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.856 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:12.856 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582185+0000", 2024-04-26T12:07:12.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052319209999999996 2024-04-26T12:07:12.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.856 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.856 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:12.856 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582243+0000", 2024-04-26T12:07:12.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7321999999999998e-05 2024-04-26T12:07:12.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.856 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.856 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:12.856 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582321+0000", 2024-04-26T12:07:12.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7911000000000007e-05 2024-04-26T12:07:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3002 3.d 3:b02ffd62:::200.00000010:head [write 3812103~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.29895129, 2024-04-26T12:07:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.059796961000000003, 2024-04-26T12:07:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:12.857 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522627+0000", 2024-04-26T12:07:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:12.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522633+0000", 2024-04-26T12:07:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6699999999999999e-06 2024-04-26T12:07:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522643+0000", 2024-04-26T12:07:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6649999999999998e-06 2024-04-26T12:07:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522649+0000", 2024-04-26T12:07:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4200000000000004e-06 2024-04-26T12:07:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:12.859 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577413+0000", 2024-04-26T12:07:12.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054763714999999998 2024-04-26T12:07:12.860 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.860 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:12.860 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577460+0000", 2024-04-26T12:07:12.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7095000000000002e-05 2024-04-26T12:07:12.860 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.860 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:12.860 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582331+0000", 2024-04-26T12:07:12.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048716419999999998 2024-04-26T12:07:12.860 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.860 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:12.860 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582375+0000", 2024-04-26T12:07:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3053999999999998e-05 2024-04-26T12:07:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582425+0000", 2024-04-26T12:07:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0525000000000002e-05 2024-04-26T12:07:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3003 3.d 3:b02ffd62:::200.00000010:head [write 3814061~4170 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.297896228000001, 2024-04-26T12:07:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058803394000000002, 2024-04-26T12:07:12.861 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.862 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523682+0000", 2024-04-26T12:07:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523690+0000", 2024-04-26T12:07:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0290000000000005e-06 2024-04-26T12:07:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523699+0000", 2024-04-26T12:07:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4589999999999998e-06 2024-04-26T12:07:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523703+0000", 2024-04-26T12:07:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6249999999999998e-06 2024-04-26T12:07:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577832+0000", 2024-04-26T12:07:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054128883000000003 2024-04-26T12:07:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577878+0000", 2024-04-26T12:07:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5841999999999999e-05 2024-04-26T12:07:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:12.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582430+0000", 2024-04-26T12:07:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045517270000000002 2024-04-26T12:07:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582453+0000", 2024-04-26T12:07:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3609999999999999e-05 2024-04-26T12:07:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582487+0000", 2024-04-26T12:07:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3080000000000002e-05 2024-04-26T12:07:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.865 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.866 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3004 3.d 3:b02ffd62:::200.00000010:head [write 3818231~3890 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:12.866 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:12.866 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.297047305, 2024-04-26T12:07:12.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058024342999999999, 2024-04-26T12:07:12.866 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:12.866 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.866 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:12.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524531+0000", 2024-04-26T12:07:12.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524539+0000", 2024-04-26T12:07:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9249999999999995e-06 2024-04-26T12:07:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524547+0000", 2024-04-26T12:07:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5220000000000007e-06 2024-04-26T12:07:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524553+0000", 2024-04-26T12:07:12.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6659999999999996e-06 2024-04-26T12:07:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578335+0000", 2024-04-26T12:07:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.05378235 2024-04-26T12:07:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578378+0000", 2024-04-26T12:07:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2429999999999999e-05 2024-04-26T12:07:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582494+0000", 2024-04-26T12:07:12.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004116059 2024-04-26T12:07:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582519+0000", 2024-04-26T12:07:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4961999999999999e-05 2024-04-26T12:07:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582556+0000", 2024-04-26T12:07:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7728999999999997e-05 2024-04-26T12:07:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3005 3.d 3:b02ffd62:::200.00000010:head [write 3822121~5207 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.296628049000001, 2024-04-26T12:07:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057662270000000002, 2024-04-26T12:07:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524961+0000", 2024-04-26T12:07:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0124e-05 2024-04-26T12:07:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:12.872 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524971+0000", 2024-04-26T12:07:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0200999999999999e-05 2024-04-26T12:07:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524979+0000", 2024-04-26T12:07:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5809999999999999e-06 2024-04-26T12:07:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578753+0000", 2024-04-26T12:07:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053774444999999997 2024-04-26T12:07:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:12.873 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578821+0000", 2024-04-26T12:07:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7640999999999998e-05 2024-04-26T12:07:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582561+0000", 2024-04-26T12:07:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037399870000000002 2024-04-26T12:07:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582582+0000", 2024-04-26T12:07:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0934999999999999e-05 2024-04-26T12:07:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:12.874 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582614+0000", 2024-04-26T12:07:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1948e-05 2024-04-26T12:07:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3006 3.d 3:b02ffd62:::200.00000010:head [write 3827328~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.29599471, 2024-04-26T12:07:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057085404999999999, 2024-04-26T12:07:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.875 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525583+0000", 2024-04-26T12:07:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.876 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525594+0000", 2024-04-26T12:07:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0497e-05 2024-04-26T12:07:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525610+0000", 2024-04-26T12:07:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6392000000000002e-05 2024-04-26T12:07:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525621+0000", 2024-04-26T12:07:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0679999999999999e-05 2024-04-26T12:07:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:12.877 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.579270+0000", 2024-04-26T12:07:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053648802000000002 2024-04-26T12:07:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.579312+0000", 2024-04-26T12:07:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2268000000000003e-05 2024-04-26T12:07:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582618+0000", 2024-04-26T12:07:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033057049999999999 2024-04-26T12:07:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.878 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582637+0000", 2024-04-26T12:07:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9417000000000001e-05 2024-04-26T12:07:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582670+0000", 2024-04-26T12:07:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2969999999999998e-05 2024-04-26T12:07:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3015 3.d 3:b02ffd62:::200.00000010:head [write 3855113~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:12.879 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.285538953, 2024-04-26T12:07:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057652729999999999, 2024-04-26T12:07:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.880 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.881 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.882 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:12.882 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:12.882 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:12.882 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.882 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.882 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:12.882 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536042+0000", 2024-04-26T12:07:12.882 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0849999999999999e-06 2024-04-26T12:07:12.882 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.882 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.883 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:12.883 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536046+0000", 2024-04-26T12:07:12.883 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:07:12.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.883 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536048+0000", 2024-04-26T12:07:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6019999999999998e-06 2024-04-26T12:07:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585409+0000", 2024-04-26T12:07:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.049360938 2024-04-26T12:07:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585506+0000", 2024-04-26T12:07:12.885 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6966999999999995e-05 2024-04-26T12:07:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593630+0000", 2024-04-26T12:07:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0081238160000000007 2024-04-26T12:07:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593656+0000", 2024-04-26T12:07:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6154000000000001e-05 2024-04-26T12:07:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.886 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593693+0000", 2024-04-26T12:07:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7185999999999999e-05 2024-04-26T12:07:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3016 3.d 3:b02ffd62:::200.00000010:head [write 3857020~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.285529006000001, 2024-04-26T12:07:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058678157000000002, 2024-04-26T12:07:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.887 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:12.888 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536055+0000", 2024-04-26T12:07:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3669999999999999e-06 2024-04-26T12:07:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536058+0000", 2024-04-26T12:07:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3220000000000001e-06 2024-04-26T12:07:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536062+0000", 2024-04-26T12:07:12.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1520000000000002e-06 2024-04-26T12:07:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585965+0000", 2024-04-26T12:07:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.049902769999999999 2024-04-26T12:07:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586046+0000", 2024-04-26T12:07:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1032999999999995e-05 2024-04-26T12:07:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:12.890 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594667+0000", 2024-04-26T12:07:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0086214599999999992 2024-04-26T12:07:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594692+0000", 2024-04-26T12:07:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5191999999999999e-05 2024-04-26T12:07:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594729+0000", 2024-04-26T12:07:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6069000000000003e-05 2024-04-26T12:07:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.891 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3017 3.d 3:b02ffd62:::200.00000010:head [write 3859438~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.285514922000001, 2024-04-26T12:07:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058723814999999999, 2024-04-26T12:07:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:12.892 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536066+0000", 2024-04-26T12:07:12.893 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8840000000000001e-06 2024-04-26T12:07:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536069+0000", 2024-04-26T12:07:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:07:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536072+0000", 2024-04-26T12:07:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4449999999999999e-06 2024-04-26T12:07:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:12.894 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586703+0000", 2024-04-26T12:07:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050631618000000003 2024-04-26T12:07:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586748+0000", 2024-04-26T12:07:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4682999999999999e-05 2024-04-26T12:07:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594734+0000", 2024-04-26T12:07:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079860369999999996 2024-04-26T12:07:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:12.895 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594756+0000", 2024-04-26T12:07:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1738000000000001e-05 2024-04-26T12:07:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594788+0000", 2024-04-26T12:07:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2604999999999997e-05 2024-04-26T12:07:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3018 3.d 3:b02ffd62:::200.00000010:head [write 3861345~3221 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:12.896 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.284682235, 2024-04-26T12:07:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057946174000000003, 2024-04-26T12:07:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.897 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536896+0000", 2024-04-26T12:07:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536905+0000", 2024-04-26T12:07:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7839999999999998e-06 2024-04-26T12:07:12.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536929+0000", 2024-04-26T12:07:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3561999999999999e-05 2024-04-26T12:07:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536940+0000", 2024-04-26T12:07:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0742e-05 2024-04-26T12:07:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.899 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.587238+0000", 2024-04-26T12:07:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050297962000000002 2024-04-26T12:07:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.587315+0000", 2024-04-26T12:07:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7848000000000004e-05 2024-04-26T12:07:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594792+0000", 2024-04-26T12:07:12.900 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074766240000000003 2024-04-26T12:07:12.901 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.901 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.901 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:12.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594813+0000", 2024-04-26T12:07:12.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0876000000000001e-05 2024-04-26T12:07:12.901 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.901 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.901 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:12.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594843+0000", 2024-04-26T12:07:12.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0434999999999999e-05 2024-04-26T12:07:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3019 3.d 3:b02ffd62:::200.00000010:head [write 3864566~3989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.282939875, 2024-04-26T12:07:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.061000094999999997, 2024-04-26T12:07:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.902 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538638+0000", 2024-04-26T12:07:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999981 2024-04-26T12:07:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.903 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538669+0000", 2024-04-26T12:07:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1689000000000001e-05 2024-04-26T12:07:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538703+0000", 2024-04-26T12:07:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3309000000000002e-05 2024-04-26T12:07:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538746+0000", 2024-04-26T12:07:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2803999999999999e-05 2024-04-26T12:07:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.904 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.589467+0000", 2024-04-26T12:07:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050721912000000001 2024-04-26T12:07:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.589517+0000", 2024-04-26T12:07:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9549999999999998e-05 2024-04-26T12:07:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599577+0000", 2024-04-26T12:07:12.905 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010059593 2024-04-26T12:07:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599603+0000", 2024-04-26T12:07:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6821e-05 2024-04-26T12:07:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599640+0000", 2024-04-26T12:07:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6177999999999998e-05 2024-04-26T12:07:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:12.906 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3020 3.d 3:b02ffd62:::200.00000010:head [write 3868555~7563 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.28032704, 2024-04-26T12:07:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058446867, 2024-04-26T12:07:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.907 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541251+0000", 2024-04-26T12:07:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541286+0000", 2024-04-26T12:07:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4845999999999998e-05 2024-04-26T12:07:12.908 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541300+0000", 2024-04-26T12:07:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4251e-05 2024-04-26T12:07:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541307+0000", 2024-04-26T12:07:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3819999999999998e-06 2024-04-26T12:07:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.592596+0000", 2024-04-26T12:07:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051288215999999998 2024-04-26T12:07:12.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.592675+0000", 2024-04-26T12:07:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9197999999999996e-05 2024-04-26T12:07:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599645+0000", 2024-04-26T12:07:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069701759999999998 2024-04-26T12:07:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599667+0000", 2024-04-26T12:07:12.910 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2118999999999999e-05 2024-04-26T12:07:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599699+0000", 2024-04-26T12:07:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2048999999999998e-05 2024-04-26T12:07:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3021 3.d 3:b02ffd62:::200.00000010:head [write 3876118~3791 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.280265303, 2024-04-26T12:07:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058441157000000001, 2024-04-26T12:07:12.911 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.912 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541323+0000", 2024-04-26T12:07:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5510000000000005e-06 2024-04-26T12:07:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541327+0000", 2024-04-26T12:07:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2520000000000001e-06 2024-04-26T12:07:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.913 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541330+0000", 2024-04-26T12:07:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:07:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593229+0000", 2024-04-26T12:07:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051898044999999997 2024-04-26T12:07:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593278+0000", 2024-04-26T12:07:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9506999999999999e-05 2024-04-26T12:07:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.914 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599704+0000", 2024-04-26T12:07:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064259570000000004 2024-04-26T12:07:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599725+0000", 2024-04-26T12:07:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0562999999999999e-05 2024-04-26T12:07:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599755+0000", 2024-04-26T12:07:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0710000000000002e-05 2024-04-26T12:07:12.915 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3022 3.d 3:b02ffd62:::200.00000010:head [write 3879909~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.279016234, 2024-04-26T12:07:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057246689000000003, 2024-04-26T12:07:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:12.916 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542561+0000", 2024-04-26T12:07:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999981 2024-04-26T12:07:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542570+0000", 2024-04-26T12:07:12.917 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9199999999999993e-06 2024-04-26T12:07:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542583+0000", 2024-04-26T12:07:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2227e-05 2024-04-26T12:07:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542598+0000", 2024-04-26T12:07:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5199e-05 2024-04-26T12:07:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.918 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593728+0000", 2024-04-26T12:07:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051129846 2024-04-26T12:07:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593806+0000", 2024-04-26T12:07:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8425999999999998e-05 2024-04-26T12:07:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599760+0000", 2024-04-26T12:07:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0059537399999999999 2024-04-26T12:07:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.919 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599779+0000", 2024-04-26T12:07:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9619e-05 2024-04-26T12:07:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599810+0000", 2024-04-26T12:07:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0508999999999999e-05 2024-04-26T12:07:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3023 3.d 3:b02ffd62:::200.00000010:head [write 3881868~5748 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:12.920 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.278544386, 2024-04-26T12:07:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.056829994000000002, 2024-04-26T12:07:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.921 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543034+0000", 2024-04-26T12:07:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543044+0000", 2024-04-26T12:07:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0444e-05 2024-04-26T12:07:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543055+0000", 2024-04-26T12:07:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.096e-05 2024-04-26T12:07:12.922 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543063+0000", 2024-04-26T12:07:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2689999999999999e-06 2024-04-26T12:07:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594265+0000", 2024-04-26T12:07:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051201325999999998 2024-04-26T12:07:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594311+0000", 2024-04-26T12:07:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5918000000000003e-05 2024-04-26T12:07:12.923 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599815+0000", 2024-04-26T12:07:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055038370000000001 2024-04-26T12:07:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599834+0000", 2024-04-26T12:07:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9942e-05 2024-04-26T12:07:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599865+0000", 2024-04-26T12:07:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0549000000000002e-05 2024-04-26T12:07:12.924 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.925 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:12.925 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.925 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:12.925 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:12.925 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:12.925 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:07:12.926 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:12.883+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:12.927 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2024-04-26T12:07:12.928 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T12:07:12.985 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:12.984+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:13.043 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:13.044 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:07:13.044 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:07:13.044 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:13.052 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:07:13.094 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:13.092+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:13.187 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:13.185+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:13.194 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:13.194 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:07:13.195 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:07:13.195 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:07:13.195 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:13.203 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:07:13.232 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-04-26T12:07:13.245 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T12:07:13.246 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T12:07:13.261 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:07:13.288 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:13.287+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:13.307 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:13.309 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:07:13.309 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:07:13.309 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:07:13.309 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.309 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:536 3.2 3:4272d415:::200.0000000b:head [write 405817~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:13.309 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:13.310 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.780426516999999, 2024-04-26T12:07:13.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053030282999999998, 2024-04-26T12:07:13.310 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:13.310 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.310 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:13.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:13.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:13.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.310 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:13.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:13.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.311 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:13.311 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524136+0000", 2024-04-26T12:07:13.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:13.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.311 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:13.311 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524139+0000", 2024-04-26T12:07:13.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2919999999999998e-06 2024-04-26T12:07:13.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.311 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:13.312 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524144+0000", 2024-04-26T12:07:13.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.502e-06 2024-04-26T12:07:13.312 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.312 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.312 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524149+0000", 2024-04-26T12:07:13.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7310000000000001e-06 2024-04-26T12:07:13.312 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:13.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570935+0000", 2024-04-26T12:07:13.313 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.046785603000000002 2024-04-26T12:07:13.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:13.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570981+0000", 2024-04-26T12:07:13.313 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6085999999999999e-05 2024-04-26T12:07:13.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:13.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577039+0000", 2024-04-26T12:07:13.313 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060582099999999996 2024-04-26T12:07:13.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.314 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:13.314 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577081+0000", 2024-04-26T12:07:13.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1927e-05 2024-04-26T12:07:13.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.314 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:13.314 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577167+0000", 2024-04-26T12:07:13.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6311999999999996e-05 2024-04-26T12:07:13.314 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.314 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:13.314 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.315 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:537 3.2 3:4272d415:::200.0000000b:head [write 407216~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:13.315 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:13.315 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.780410579000002, 2024-04-26T12:07:13.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053131411000000003, 2024-04-26T12:07:13.315 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:13.315 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.315 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:13.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:13.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:13.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:13.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:13.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:13.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524152+0000", 2024-04-26T12:07:13.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:13.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:13.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524157+0000", 2024-04-26T12:07:13.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3529999999999997e-06 2024-04-26T12:07:13.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:13.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524162+0000", 2024-04-26T12:07:13.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5910000000000003e-06 2024-04-26T12:07:13.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524170+0000", 2024-04-26T12:07:13.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:07:13.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:13.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571323+0000", 2024-04-26T12:07:13.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047153289000000001 2024-04-26T12:07:13.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:13.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571367+0000", 2024-04-26T12:07:13.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4205000000000001e-05 2024-04-26T12:07:13.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:13.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577174+0000", 2024-04-26T12:07:13.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058072250000000001 2024-04-26T12:07:13.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:13.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577218+0000", 2024-04-26T12:07:13.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3294999999999998e-05 2024-04-26T12:07:13.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:13.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577284+0000", 2024-04-26T12:07:13.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6483999999999996e-05 2024-04-26T12:07:13.319 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.319 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:13.319 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.319 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:538 3.2 3:4272d415:::200.0000000b:head [write 408629~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:13.319 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:13.319 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.780389879000001, 2024-04-26T12:07:13.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053241841999999998, 2024-04-26T12:07:13.319 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:13.319 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.320 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:13.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:13.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:13.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:13.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:13.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:13.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:13.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:13.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:13.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524178+0000", 2024-04-26T12:07:13.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1420000000000001e-06 2024-04-26T12:07:13.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:13.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524184+0000", 2024-04-26T12:07:13.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4240000000000001e-06 2024-04-26T12:07:13.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524188+0000", 2024-04-26T12:07:13.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2710000000000003e-06 2024-04-26T12:07:13.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:13.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571623+0000", 2024-04-26T12:07:13.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047435119999999997 2024-04-26T12:07:13.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:13.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571668+0000", 2024-04-26T12:07:13.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5377000000000003e-05 2024-04-26T12:07:13.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:13.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577292+0000", 2024-04-26T12:07:13.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0056232030000000002 2024-04-26T12:07:13.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:13.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577330+0000", 2024-04-26T12:07:13.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8748999999999998e-05 2024-04-26T12:07:13.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:13.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577415+0000", 2024-04-26T12:07:13.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4913000000000005e-05 2024-04-26T12:07:13.324 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.324 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:13.324 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.325 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:539 3.2 3:4272d415:::200.0000000b:head [write 410547~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:13.325 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:13.325 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.780371747, 2024-04-26T12:07:13.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053372670999999997, 2024-04-26T12:07:13.325 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:13.325 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.325 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:13.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:13.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:13.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:13.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:13.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:13.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524191+0000", 2024-04-26T12:07:13.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:13.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:13.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524199+0000", 2024-04-26T12:07:13.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6520000000000006e-06 2024-04-26T12:07:13.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:13.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524205+0000", 2024-04-26T12:07:13.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:07:13.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524209+0000", 2024-04-26T12:07:13.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.335e-06 2024-04-26T12:07:13.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:13.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572320+0000", 2024-04-26T12:07:13.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048110992999999998 2024-04-26T12:07:13.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:13.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572364+0000", 2024-04-26T12:07:13.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4577999999999999e-05 2024-04-26T12:07:13.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:13.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577426+0000", 2024-04-26T12:07:13.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050615139999999996 2024-04-26T12:07:13.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:13.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577480+0000", 2024-04-26T12:07:13.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3599e-05 2024-04-26T12:07:13.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.329 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:13.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577564+0000", 2024-04-26T12:07:13.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4699999999999999e-05 2024-04-26T12:07:13.329 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.329 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:13.329 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.329 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:540 3.2 3:4272d415:::200.0000000b:head [write 411948~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:13.329 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:13.329 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.780350728999998, 2024-04-26T12:07:13.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053497045999999999, 2024-04-26T12:07:13.329 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:13.330 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.330 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:13.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:13.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:13.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:13.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:13.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:13.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524212+0000", 2024-04-26T12:07:13.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:13.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:13.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524215+0000", 2024-04-26T12:07:13.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.559e-06 2024-04-26T12:07:13.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:13.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524220+0000", 2024-04-26T12:07:13.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2920000000000003e-06 2024-04-26T12:07:13.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524224+0000", 2024-04-26T12:07:13.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3680000000000004e-06 2024-04-26T12:07:13.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:13.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572619+0000", 2024-04-26T12:07:13.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048394549000000002 2024-04-26T12:07:13.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:13.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572669+0000", 2024-04-26T12:07:13.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0249e-05 2024-04-26T12:07:13.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:13.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577575+0000", 2024-04-26T12:07:13.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049053329999999996 2024-04-26T12:07:13.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:13.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577625+0000", 2024-04-26T12:07:13.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0274e-05 2024-04-26T12:07:13.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:13.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577710+0000", 2024-04-26T12:07:13.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4741999999999996e-05 2024-04-26T12:07:13.333 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.333 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:13.334 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.334 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:543 3.2 3:4272d415:::200.0000000b:head [write 413907~2485 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:13.334 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:13.334 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.780281035000002, 2024-04-26T12:07:13.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053578708000000003, 2024-04-26T12:07:13.334 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:13.334 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.334 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:13.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.334 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:13.334 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:13.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.335 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.335 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:13.335 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:13.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.335 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.335 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:13.335 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:13.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:13.335 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.335 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:13.335 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524287+0000", 2024-04-26T12:07:13.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2190000000000003e-06 2024-04-26T12:07:13.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:13.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524294+0000", 2024-04-26T12:07:13.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5660000000000003e-06 2024-04-26T12:07:13.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524298+0000", 2024-04-26T12:07:13.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3900000000000003e-06 2024-04-26T12:07:13.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:13.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572992+0000", 2024-04-26T12:07:13.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048693835999999997 2024-04-26T12:07:13.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:13.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573045+0000", 2024-04-26T12:07:13.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2793000000000001e-05 2024-04-26T12:07:13.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:13.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577721+0000", 2024-04-26T12:07:13.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046760550000000001 2024-04-26T12:07:13.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:13.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577777+0000", 2024-04-26T12:07:13.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5908000000000001e-05 2024-04-26T12:07:13.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:13.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577861+0000", 2024-04-26T12:07:13.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4337000000000002e-05 2024-04-26T12:07:13.338 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.338 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:13.338 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.338 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:544 3.2 3:4272d415:::200.0000000b:head [write 416392~3872 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:13.338 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:13.338 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.780261313, 2024-04-26T12:07:13.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054810527999999997, 2024-04-26T12:07:13.339 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:13.339 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.339 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:13.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.339 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:13.339 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:13.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.339 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:13.339 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:13.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:13.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:13.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:13.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:13.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524307+0000", 2024-04-26T12:07:13.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1580000000000004e-06 2024-04-26T12:07:13.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:13.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524312+0000", 2024-04-26T12:07:13.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6380000000000001e-06 2024-04-26T12:07:13.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524317+0000", 2024-04-26T12:07:13.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4000000000000002e-06 2024-04-26T12:07:13.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:13.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573348+0000", 2024-04-26T12:07:13.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049031433999999999 2024-04-26T12:07:13.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:13.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573393+0000", 2024-04-26T12:07:13.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4536999999999997e-05 2024-04-26T12:07:13.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:13.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578978+0000", 2024-04-26T12:07:13.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055848299999999998 2024-04-26T12:07:13.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:13.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579031+0000", 2024-04-26T12:07:13.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3708000000000001e-05 2024-04-26T12:07:13.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:13.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579113+0000", 2024-04-26T12:07:13.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1258e-05 2024-04-26T12:07:13.343 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.343 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:13.343 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.343 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:545 3.2 3:4272d415:::200.0000000b:head [write 420264~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:13.343 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:13.343 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.780242687000001, 2024-04-26T12:07:13.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054927386000000002, 2024-04-26T12:07:13.343 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:13.343 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.343 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:13.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.343 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:13.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:13.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:13.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:13.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:13.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524320+0000", 2024-04-26T12:07:13.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:13.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:13.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524325+0000", 2024-04-26T12:07:13.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5249999999999999e-06 2024-04-26T12:07:13.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:13.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524330+0000", 2024-04-26T12:07:13.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5629999999999999e-06 2024-04-26T12:07:13.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524335+0000", 2024-04-26T12:07:13.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.685e-06 2024-04-26T12:07:13.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:13.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573727+0000", 2024-04-26T12:07:13.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049392034000000001 2024-04-26T12:07:13.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:13.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573775+0000", 2024-04-26T12:07:13.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7435999999999998e-05 2024-04-26T12:07:13.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:13.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579120+0000", 2024-04-26T12:07:13.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0053452949999999999 2024-04-26T12:07:13.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:13.347 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579167+0000", 2024-04-26T12:07:13.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7240000000000002e-05 2024-04-26T12:07:13.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:13.347 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579248+0000", 2024-04-26T12:07:13.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0947999999999998e-05 2024-04-26T12:07:13.347 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.347 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:13.347 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.347 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 422222~8537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:13.347 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:13.348 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.780224369999999, 2024-04-26T12:07:13.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055065936000000003, 2024-04-26T12:07:13.348 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:13.348 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.348 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:13.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:13.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:13.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:13.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:13.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:13.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:13.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:13.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:13.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524347+0000", 2024-04-26T12:07:13.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7129999999999994e-06 2024-04-26T12:07:13.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:13.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524357+0000", 2024-04-26T12:07:13.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0232e-05 2024-04-26T12:07:13.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524362+0000", 2024-04-26T12:07:13.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:07:13.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:13.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574119+0000", 2024-04-26T12:07:13.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049756727000000001 2024-04-26T12:07:13.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574166+0000", 2024-04-26T12:07:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7086000000000003e-05 2024-04-26T12:07:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579261+0000", 2024-04-26T12:07:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050948310000000002 2024-04-26T12:07:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579316+0000", 2024-04-26T12:07:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5068000000000002e-05 2024-04-26T12:07:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579405+0000", 2024-04-26T12:07:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9251000000000003e-05 2024-04-26T12:07:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 430759~2035 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.780197380000001, 2024-04-26T12:07:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055164950999999997, 2024-04-26T12:07:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524368+0000", 2024-04-26T12:07:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.57e-06 2024-04-26T12:07:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524375+0000", 2024-04-26T12:07:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6170000000000003e-06 2024-04-26T12:07:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524380+0000", 2024-04-26T12:07:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2700000000000004e-06 2024-04-26T12:07:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574639+0000", 2024-04-26T12:07:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050259459999999999 2024-04-26T12:07:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574687+0000", 2024-04-26T12:07:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7608999999999998e-05 2024-04-26T12:07:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579414+0000", 2024-04-26T12:07:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047268750000000002 2024-04-26T12:07:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579456+0000", 2024-04-26T12:07:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1885000000000003e-05 2024-04-26T12:07:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579531+0000", 2024-04-26T12:07:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5053000000000001e-05 2024-04-26T12:07:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 432794~10523 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.779206655999999, 2024-04-26T12:07:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054314727, 2024-04-26T12:07:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525356+0000", 2024-04-26T12:07:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525414+0000", 2024-04-26T12:07:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8148e-05 2024-04-26T12:07:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525423+0000", 2024-04-26T12:07:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9749999999999996e-06 2024-04-26T12:07:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525428+0000", 2024-04-26T12:07:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0270000000000003e-06 2024-04-26T12:07:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574950+0000", 2024-04-26T12:07:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049521840999999997 2024-04-26T12:07:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575002+0000", 2024-04-26T12:07:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1586999999999999e-05 2024-04-26T12:07:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579543+0000", 2024-04-26T12:07:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045416340000000001 2024-04-26T12:07:13.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:13.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579587+0000", 2024-04-26T12:07:13.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3875999999999998e-05 2024-04-26T12:07:13.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:13.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579671+0000", 2024-04-26T12:07:13.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4351999999999995e-05 2024-04-26T12:07:13.362 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.362 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:13.362 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 443317~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.779130681000002, 2024-04-26T12:07:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054381889000000003, 2024-04-26T12:07:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:13.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:13.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:13.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525432+0000", 2024-04-26T12:07:13.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:13.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:13.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525435+0000", 2024-04-26T12:07:13.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3070000000000001e-06 2024-04-26T12:07:13.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:13.365 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525439+0000", 2024-04-26T12:07:13.365 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.104e-06 2024-04-26T12:07:13.365 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.365 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.365 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.365 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525442+0000", 2024-04-26T12:07:13.365 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0460000000000001e-06 2024-04-26T12:07:13.365 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.365 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.365 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:13.365 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575405+0000", 2024-04-26T12:07:13.365 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049963059999999997 2024-04-26T12:07:13.365 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.365 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575450+0000", 2024-04-26T12:07:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5034000000000003e-05 2024-04-26T12:07:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579680+0000", 2024-04-26T12:07:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042302260000000001 2024-04-26T12:07:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579737+0000", 2024-04-26T12:07:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7241000000000003e-05 2024-04-26T12:07:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579815+0000", 2024-04-26T12:07:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7278000000000001e-05 2024-04-26T12:07:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 445275~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.778703504999999, 2024-04-26T12:07:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054094668999999998, 2024-04-26T12:07:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525859+0000", 2024-04-26T12:07:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525864+0000", 2024-04-26T12:07:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:07:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525872+0000", 2024-04-26T12:07:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6790000000000005e-06 2024-04-26T12:07:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525877+0000", 2024-04-26T12:07:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0529999999999997e-06 2024-04-26T12:07:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575723+0000", 2024-04-26T12:07:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049846469999999997 2024-04-26T12:07:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575770+0000", 2024-04-26T12:07:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6387999999999997e-05 2024-04-26T12:07:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579823+0000", 2024-04-26T12:07:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0040534189999999999 2024-04-26T12:07:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579869+0000", 2024-04-26T12:07:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6218999999999999e-05 2024-04-26T12:07:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579954+0000", 2024-04-26T12:07:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5315999999999994e-05 2024-04-26T12:07:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.372 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:551 3.2 3:4272d415:::200.0000000b:head [write 448232~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:13.372 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:13.372 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.778256071000001, 2024-04-26T12:07:13.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053798273000000001, 2024-04-26T12:07:13.372 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:13.372 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.372 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:13.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.372 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:13.372 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:13.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526310+0000", 2024-04-26T12:07:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5279999999999999e-06 2024-04-26T12:07:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526317+0000", 2024-04-26T12:07:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8430000000000004e-06 2024-04-26T12:07:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526322+0000", 2024-04-26T12:07:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3340000000000001e-06 2024-04-26T12:07:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576135+0000", 2024-04-26T12:07:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049812113999999998 2024-04-26T12:07:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576186+0000", 2024-04-26T12:07:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1443999999999997e-05 2024-04-26T12:07:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579962+0000", 2024-04-26T12:07:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037763359999999999 2024-04-26T12:07:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580016+0000", 2024-04-26T12:07:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3421000000000002e-05 2024-04-26T12:07:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580106+0000", 2024-04-26T12:07:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9790000000000006e-05 2024-04-26T12:07:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 450189~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.778175942000001, 2024-04-26T12:07:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055070796999999998, 2024-04-26T12:07:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526390+0000", 2024-04-26T12:07:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8559999999999998e-06 2024-04-26T12:07:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526395+0000", 2024-04-26T12:07:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3319999999999999e-06 2024-04-26T12:07:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526399+0000", 2024-04-26T12:07:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.619e-06 2024-04-26T12:07:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576476+0000", 2024-04-26T12:07:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050077643999999998 2024-04-26T12:07:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576524+0000", 2024-04-26T12:07:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7184000000000001e-05 2024-04-26T12:07:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581347+0000", 2024-04-26T12:07:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0048231919999999996 2024-04-26T12:07:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581398+0000", 2024-04-26T12:07:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1345999999999999e-05 2024-04-26T12:07:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581458+0000", 2024-04-26T12:07:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0081000000000003e-05 2024-04-26T12:07:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 452113~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.778064726, 2024-04-26T12:07:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055041448, 2024-04-26T12:07:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526498+0000", 2024-04-26T12:07:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526540+0000", 2024-04-26T12:07:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2267e-05 2024-04-26T12:07:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526547+0000", 2024-04-26T12:07:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7000000000000002e-06 2024-04-26T12:07:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526550+0000", 2024-04-26T12:07:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0299999999999998e-06 2024-04-26T12:07:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577902+0000", 2024-04-26T12:07:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051351648999999999 2024-04-26T12:07:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577953+0000", 2024-04-26T12:07:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1289000000000003e-05 2024-04-26T12:07:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581464+0000", 2024-04-26T12:07:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035111259999999998 2024-04-26T12:07:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581490+0000", 2024-04-26T12:07:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5717000000000001e-05 2024-04-26T12:07:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581540+0000", 2024-04-26T12:07:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0287999999999997e-05 2024-04-26T12:07:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 454070~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.777507777, 2024-04-26T12:07:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054564161, 2024-04-26T12:07:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527055+0000", 2024-04-26T12:07:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527058+0000", 2024-04-26T12:07:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9890000000000001e-06 2024-04-26T12:07:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527066+0000", 2024-04-26T12:07:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4730000000000003e-06 2024-04-26T12:07:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527069+0000", 2024-04-26T12:07:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5810000000000001e-06 2024-04-26T12:07:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578308+0000", 2024-04-26T12:07:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051238911999999998 2024-04-26T12:07:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578391+0000", 2024-04-26T12:07:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2713999999999994e-05 2024-04-26T12:07:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581548+0000", 2024-04-26T12:07:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031577530000000001 2024-04-26T12:07:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581574+0000", 2024-04-26T12:07:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5350999999999998e-05 2024-04-26T12:07:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581620+0000", 2024-04-26T12:07:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5868999999999997e-05 2024-04-26T12:07:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 456028~3870 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.775751535000001, 2024-04-26T12:07:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055118997000000003, 2024-04-26T12:07:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:13.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.392 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:13.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:13.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528811+0000", 2024-04-26T12:07:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528887+0000", 2024-04-26T12:07:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5977999999999997e-05 2024-04-26T12:07:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528897+0000", 2024-04-26T12:07:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8730000000000002e-06 2024-04-26T12:07:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528901+0000", 2024-04-26T12:07:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4880000000000001e-06 2024-04-26T12:07:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580146+0000", 2024-04-26T12:07:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051244242000000002 2024-04-26T12:07:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580227+0000", 2024-04-26T12:07:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1044000000000005e-05 2024-04-26T12:07:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583864+0000", 2024-04-26T12:07:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036374419999999998 2024-04-26T12:07:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583894+0000", 2024-04-26T12:07:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9828999999999999e-05 2024-04-26T12:07:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583931+0000", 2024-04-26T12:07:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6908e-05 2024-04-26T12:07:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 459898~2037 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.775363544000001, 2024-04-26T12:07:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055925713000000002, 2024-04-26T12:07:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529199+0000", 2024-04-26T12:07:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529203+0000", 2024-04-26T12:07:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:07:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529209+0000", 2024-04-26T12:07:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7939999999999999e-06 2024-04-26T12:07:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529212+0000", 2024-04-26T12:07:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7290000000000002e-06 2024-04-26T12:07:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580784+0000", 2024-04-26T12:07:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051572073000000003 2024-04-26T12:07:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580883+0000", 2024-04-26T12:07:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8330000000000002e-05 2024-04-26T12:07:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585050+0000", 2024-04-26T12:07:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041670209999999999 2024-04-26T12:07:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585088+0000", 2024-04-26T12:07:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8559999999999997e-05 2024-04-26T12:07:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585125+0000", 2024-04-26T12:07:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7197999999999999e-05 2024-04-26T12:07:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 461935~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.774641089999999, 2024-04-26T12:07:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055266150999999999, 2024-04-26T12:07:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529921+0000", 2024-04-26T12:07:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529956+0000", 2024-04-26T12:07:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4687000000000002e-05 2024-04-26T12:07:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529966+0000", 2024-04-26T12:07:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0392e-05 2024-04-26T12:07:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529978+0000", 2024-04-26T12:07:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1348e-05 2024-04-26T12:07:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581659+0000", 2024-04-26T12:07:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051681454000000002 2024-04-26T12:07:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581746+0000", 2024-04-26T12:07:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6305999999999997e-05 2024-04-26T12:07:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585131+0000", 2024-04-26T12:07:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033853199999999998 2024-04-26T12:07:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585154+0000", 2024-04-26T12:07:13.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3258999999999999e-05 2024-04-26T12:07:13.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:13.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:13.405 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:13.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585188+0000", 2024-04-26T12:07:13.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4236000000000002e-05 2024-04-26T12:07:13.405 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.405 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:13.405 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.405 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:13.405 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:13.405 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:13.406 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:07:13.406 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:13.391+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:13.495 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:13.492+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:13.514 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:13.514 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:13.514 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:07:13.514 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:13.523 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:13.580 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:07:13.594 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:07:13.595 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":59,"fsid":"5bc300ae-e948-4ce3-81bb-5abae8c06799","created":"2024-04-26T12:04:41.919527+0000","modified":"2024-04-26T12:07:11.560128+0000","last_up_change":"2024-04-26T12:06:11.948237+0000","last_in_change":"2024-04-26T12:04:43.540390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:04:52.376506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":3.0299999713897705,"score_stable":3.0299999713897705,"optimal_score":0.33000001311302185,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:04:57.775333+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:05:02.226064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":0.67000001668930054,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:05:02.758806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5399999618530273,"score_stable":1.5399999618530273,"optimal_score":0.67000001668930054,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"638cfa85-e921-4403-9bcb-a7f4653cc3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":28597},{"type":"v1","addr":"172.21.15.143:6801","nonce":28597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":28597},{"type":"v1","addr":"172.21.15.143:6803","nonce":28597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":28597},{"type":"v1","addr":"172.21.15.143:6807","nonce":28597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":28597},{"type":"v1","addr":"172.21.15.143:6805","nonce":28597}]},"public_addr":"172.21.15.143:6801/28597","cluster_addr":"172.21.15.143:6803/28597","heartbeat_back_addr":"172.21.15.143:6807/28597","heartbeat_front_addr":"172.21.15.143:6805/28597","state":["exists","up"]},{"osd":1,"uuid":"2abc8d1e-ad72-4643-ad1e-3566e5113c44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":38,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":28560},{"type":"v1","addr":"172.21.15.154:6801","nonce":28560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":28560},{"type":"v1","addr":"172.21.15.154:6803","nonce":28560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":28560},{"type":"v1","addr":"172.21.15.154:6807","nonce":28560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":28560},{"type":"v1","addr":"172.21.15.154:6805","nonce":28560}]},"public_addr":"172.21.15.154:6801/28560","cluster_addr":"172.21.15.154:6803/28560","heartbeat_back_addr":"172.21.15.154:6807/28560","heartbeat_front_addr":"172.21.15.154:6805/28560","state":["exists"]},{"osd":2,"uuid":"d2ebc562-cb9b-4089-a19b-1788b70b57dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":28709},{"type":"v1","addr":"172.21.15.164:6801","nonce":28709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":28709},{"type":"v1","addr":"172.21.15.164:6803","nonce":28709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":28709},{"type":"v1","addr":"172.21.15.164:6807","nonce":28709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":28709},{"type":"v1","addr":"172.21.15.164:6805","nonce":28709}]},"public_addr":"172.21.15.164:6801/28709","cluster_addr":"172.21.15.164:6803/28709","heartbeat_back_addr":"172.21.15.164:6807/28709","heartbeat_front_addr":"172.21.15.164:6805/28709","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.573478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.624482+0000","dead_epoch":37},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.615449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:07:13.608 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:04:52.376506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:04:57.775333+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:05:02.226064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:05:02.758806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5399999618530273, 'score_stable': 1.5399999618530273, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T12:07:13.609 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:07:13.609 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:13.608+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:13.665 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:13.666 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:13.666 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:07:13.666 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:07:13.666 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:13.675 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:13.717 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:13.715+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:13.797 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:13.795+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:13.819 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:13.819 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:07:13.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:07:13.819 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:07:13.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.819 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2989 3.d 3:b02ffd62:::200.00000010:head [write 3767903~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:13.819 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:13.819 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 14.300648461, 2024-04-26T12:07:13.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057069768999999999, 2024-04-26T12:07:13.820 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:13.820 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.820 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:13.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.820 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:13.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:13.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.820 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:13.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:13.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.821 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:13.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:13.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:13.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.821 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:13.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516446+0000", 2024-04-26T12:07:13.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6469999999999997e-06 2024-04-26T12:07:13.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.821 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:13.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516449+0000", 2024-04-26T12:07:13.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.976e-06 2024-04-26T12:07:13.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.822 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.822 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516452+0000", 2024-04-26T12:07:13.822 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.509e-06 2024-04-26T12:07:13.822 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.822 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:13.822 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.568562+0000", 2024-04-26T12:07:13.822 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.052110030000000002 2024-04-26T12:07:13.822 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.822 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:13.822 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.568615+0000", 2024-04-26T12:07:13.822 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2809999999999998e-05 2024-04-26T12:07:13.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.823 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:13.823 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573425+0000", 2024-04-26T12:07:13.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048105149999999996 2024-04-26T12:07:13.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.823 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:13.823 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573452+0000", 2024-04-26T12:07:13.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6778e-05 2024-04-26T12:07:13.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:13.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573512+0000", 2024-04-26T12:07:13.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9710000000000003e-05 2024-04-26T12:07:13.824 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.824 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:13.824 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.824 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2990 3.d 3:b02ffd62:::200.00000010:head [write 3769302~4483 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:13.824 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:13.824 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 14.300636462, 2024-04-26T12:07:13.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057131345, 2024-04-26T12:07:13.824 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:13.824 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.824 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:13.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:13.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:13.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:13.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:13.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:13.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:13.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:13.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:13.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516459+0000", 2024-04-26T12:07:13.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2859999999999999e-06 2024-04-26T12:07:13.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:13.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516462+0000", 2024-04-26T12:07:13.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0790000000000001e-06 2024-04-26T12:07:13.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516465+0000", 2024-04-26T12:07:13.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.464e-06 2024-04-26T12:07:13.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:13.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569035+0000", 2024-04-26T12:07:13.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.052570328999999999 2024-04-26T12:07:13.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:13.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569113+0000", 2024-04-26T12:07:13.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8118e-05 2024-04-26T12:07:13.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:13.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573517+0000", 2024-04-26T12:07:13.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044039200000000004 2024-04-26T12:07:13.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.828 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.828 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:13.828 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573541+0000", 2024-04-26T12:07:13.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3805999999999999e-05 2024-04-26T12:07:13.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.828 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.828 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:13.828 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573585+0000", 2024-04-26T12:07:13.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4567000000000002e-05 2024-04-26T12:07:13.828 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.828 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:13.828 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.829 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2991 3.d 3:b02ffd62:::200.00000010:head [write 3773785~4213 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:13.829 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:13.829 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 14.300623773, 2024-04-26T12:07:13.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057230554000000003, 2024-04-26T12:07:13.829 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:13.829 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.829 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:13.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.829 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:13.829 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:13.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:13.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:13.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:13.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516466+0000", 2024-04-26T12:07:13.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:13.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:13.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516470+0000", 2024-04-26T12:07:13.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7960000000000002e-06 2024-04-26T12:07:13.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:13.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516478+0000", 2024-04-26T12:07:13.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:07:13.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516484+0000", 2024-04-26T12:07:13.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5300000000000002e-06 2024-04-26T12:07:13.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:13.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569662+0000", 2024-04-26T12:07:13.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053177896000000002 2024-04-26T12:07:13.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:13.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569749+0000", 2024-04-26T12:07:13.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7229000000000001e-05 2024-04-26T12:07:13.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:13.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573593+0000", 2024-04-26T12:07:13.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038433109999999999 2024-04-26T12:07:13.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:13.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573631+0000", 2024-04-26T12:07:13.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8615000000000002e-05 2024-04-26T12:07:13.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:13.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573697+0000", 2024-04-26T12:07:13.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5971999999999998e-05 2024-04-26T12:07:13.833 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.833 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:13.833 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.833 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2999 3.d 3:b02ffd62:::200.00000010:head [write 3797283~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:13.834 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:13.834 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 14.296109384999999, 2024-04-26T12:07:13.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057330949999999999, 2024-04-26T12:07:13.834 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:13.834 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.834 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:13.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.834 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:13.834 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:13.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.834 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.834 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:13.834 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:13.835 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.835 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.835 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.835 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:13.835 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520980+0000", 2024-04-26T12:07:13.835 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:13.835 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.835 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.835 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:13.835 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520991+0000", 2024-04-26T12:07:13.835 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1154e-05 2024-04-26T12:07:13.835 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.835 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.835 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:13.835 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521014+0000", 2024-04-26T12:07:13.836 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2288000000000001e-05 2024-04-26T12:07:13.836 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.836 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.836 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.836 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521019+0000", 2024-04-26T12:07:13.836 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0889999999999999e-06 2024-04-26T12:07:13.836 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.836 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.836 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:13.836 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.575399+0000", 2024-04-26T12:07:13.836 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054380392999999999 2024-04-26T12:07:13.836 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.836 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.836 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:13.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.575440+0000", 2024-04-26T12:07:13.837 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1146000000000002e-05 2024-04-26T12:07:13.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:13.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578237+0000", 2024-04-26T12:07:13.837 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002796761 2024-04-26T12:07:13.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:13.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578260+0000", 2024-04-26T12:07:13.837 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3538999999999999e-05 2024-04-26T12:07:13.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:13.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578312+0000", 2024-04-26T12:07:13.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1508999999999998e-05 2024-04-26T12:07:13.838 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.838 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:13.838 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.838 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.838 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3000 3.d 3:b02ffd62:::200.00000010:head [write 3801160~9028 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:13.838 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:13.838 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 14.295483419, 2024-04-26T12:07:13.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.059231688999999997, 2024-04-26T12:07:13.838 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:13.838 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.838 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:13.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.839 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:13.839 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:13.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.839 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:13.839 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:13.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.839 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:13.839 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521606+0000", 2024-04-26T12:07:13.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:13.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:13.840 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521627+0000", 2024-04-26T12:07:13.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1129e-05 2024-04-26T12:07:13.840 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:13.840 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521637+0000", 2024-04-26T12:07:13.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8789999999999998e-06 2024-04-26T12:07:13.840 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.840 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521644+0000", 2024-04-26T12:07:13.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:07:13.840 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.841 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:13.841 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576381+0000", 2024-04-26T12:07:13.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.05473629 2024-04-26T12:07:13.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.841 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:13.841 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576451+0000", 2024-04-26T12:07:13.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0525000000000007e-05 2024-04-26T12:07:13.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.841 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:13.841 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580734+0000", 2024-04-26T12:07:13.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042826699999999997 2024-04-26T12:07:13.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.842 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:13.842 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580780+0000", 2024-04-26T12:07:13.842 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6006e-05 2024-04-26T12:07:13.842 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.842 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:13.842 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580839+0000", 2024-04-26T12:07:13.842 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8783000000000003e-05 2024-04-26T12:07:13.842 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.842 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:13.842 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.842 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.842 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3001 3.d 3:b02ffd62:::200.00000010:head [write 3810188~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:13.843 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:13.843 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 14.294931087, 2024-04-26T12:07:13.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.060161213999999998, 2024-04-26T12:07:13.843 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:13.843 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.843 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:13.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:13.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:13.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.843 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:13.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:13.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:13.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522158+0000", 2024-04-26T12:07:13.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:13.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:13.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522165+0000", 2024-04-26T12:07:13.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.28e-06 2024-04-26T12:07:13.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:13.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522178+0000", 2024-04-26T12:07:13.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3738e-05 2024-04-26T12:07:13.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522186+0000", 2024-04-26T12:07:13.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.267e-06 2024-04-26T12:07:13.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:13.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576889+0000", 2024-04-26T12:07:13.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054703442999999997 2024-04-26T12:07:13.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:13.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576953+0000", 2024-04-26T12:07:13.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4213000000000003e-05 2024-04-26T12:07:13.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:13.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582185+0000", 2024-04-26T12:07:13.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052319209999999996 2024-04-26T12:07:13.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:13.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582243+0000", 2024-04-26T12:07:13.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7321999999999998e-05 2024-04-26T12:07:13.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:13.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582321+0000", 2024-04-26T12:07:13.847 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7911000000000007e-05 2024-04-26T12:07:13.847 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.847 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:13.847 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.847 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.847 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.847 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3002 3.d 3:b02ffd62:::200.00000010:head [write 3812103~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:13.847 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:13.847 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 14.294462323999999, 2024-04-26T12:07:13.847 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.059796961000000003, 2024-04-26T12:07:13.847 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:13.847 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.847 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:13.847 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.847 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:13.848 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:13.848 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.848 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.848 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:13.848 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:13.848 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.848 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.848 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:13.848 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522627+0000", 2024-04-26T12:07:13.848 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:13.848 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.848 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:13.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522633+0000", 2024-04-26T12:07:13.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6699999999999999e-06 2024-04-26T12:07:13.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:13.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522643+0000", 2024-04-26T12:07:13.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6649999999999998e-06 2024-04-26T12:07:13.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522649+0000", 2024-04-26T12:07:13.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4200000000000004e-06 2024-04-26T12:07:13.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.850 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:13.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577413+0000", 2024-04-26T12:07:13.850 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054763714999999998 2024-04-26T12:07:13.850 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.850 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:13.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577460+0000", 2024-04-26T12:07:13.850 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7095000000000002e-05 2024-04-26T12:07:13.850 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.850 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:13.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582331+0000", 2024-04-26T12:07:13.850 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048716419999999998 2024-04-26T12:07:13.850 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.851 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.851 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:13.851 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582375+0000", 2024-04-26T12:07:13.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3053999999999998e-05 2024-04-26T12:07:13.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.851 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.851 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:13.851 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582425+0000", 2024-04-26T12:07:13.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0525000000000002e-05 2024-04-26T12:07:13.851 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.851 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:13.851 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.851 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.851 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3003 3.d 3:b02ffd62:::200.00000010:head [write 3814061~4170 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:13.852 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:13.852 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 14.293407262000001, 2024-04-26T12:07:13.852 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058803394000000002, 2024-04-26T12:07:13.852 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:13.852 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.852 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:13.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.852 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:13.852 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:13.852 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.852 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.852 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:13.852 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:13.852 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.853 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.853 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:13.853 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523682+0000", 2024-04-26T12:07:13.853 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:13.853 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.853 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:13.853 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523690+0000", 2024-04-26T12:07:13.853 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0290000000000005e-06 2024-04-26T12:07:13.853 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.853 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:13.853 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523699+0000", 2024-04-26T12:07:13.853 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4589999999999998e-06 2024-04-26T12:07:13.854 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.854 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.854 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.854 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523703+0000", 2024-04-26T12:07:13.854 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6249999999999998e-06 2024-04-26T12:07:13.854 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.854 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.854 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:13.854 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577832+0000", 2024-04-26T12:07:13.854 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054128883000000003 2024-04-26T12:07:13.854 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.854 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.854 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:13.854 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577878+0000", 2024-04-26T12:07:13.854 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5841999999999999e-05 2024-04-26T12:07:13.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:13.855 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582430+0000", 2024-04-26T12:07:13.855 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045517270000000002 2024-04-26T12:07:13.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:13.855 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582453+0000", 2024-04-26T12:07:13.855 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3609999999999999e-05 2024-04-26T12:07:13.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:13.855 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582487+0000", 2024-04-26T12:07:13.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3080000000000002e-05 2024-04-26T12:07:13.856 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.856 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:13.856 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.856 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.856 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3004 3.d 3:b02ffd62:::200.00000010:head [write 3818231~3890 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:13.856 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:13.856 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 14.292558338999999, 2024-04-26T12:07:13.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058024342999999999, 2024-04-26T12:07:13.856 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:13.856 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.856 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:13.856 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.856 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:13.857 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:13.857 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.857 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.857 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:13.857 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:13.857 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.857 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.857 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:13.857 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524531+0000", 2024-04-26T12:07:13.857 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:13.857 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.857 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:13.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524539+0000", 2024-04-26T12:07:13.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9249999999999995e-06 2024-04-26T12:07:13.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:13.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524547+0000", 2024-04-26T12:07:13.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5220000000000007e-06 2024-04-26T12:07:13.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524553+0000", 2024-04-26T12:07:13.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6659999999999996e-06 2024-04-26T12:07:13.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.859 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:13.859 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578335+0000", 2024-04-26T12:07:13.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.05378235 2024-04-26T12:07:13.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.859 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.859 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:13.859 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578378+0000", 2024-04-26T12:07:13.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2429999999999999e-05 2024-04-26T12:07:13.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.859 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.859 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:13.859 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582494+0000", 2024-04-26T12:07:13.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004116059 2024-04-26T12:07:13.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.860 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:13.860 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582519+0000", 2024-04-26T12:07:13.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4961999999999999e-05 2024-04-26T12:07:13.860 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.860 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:13.860 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582556+0000", 2024-04-26T12:07:13.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7728999999999997e-05 2024-04-26T12:07:13.860 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.860 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:13.860 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.860 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.861 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3005 3.d 3:b02ffd62:::200.00000010:head [write 3822121~5207 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:13.861 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:13.861 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 14.292139083, 2024-04-26T12:07:13.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057662270000000002, 2024-04-26T12:07:13.861 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:13.861 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.861 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:13.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:13.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:13.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.862 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:13.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:13.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.862 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:13.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:13.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:13.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.862 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:13.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524961+0000", 2024-04-26T12:07:13.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0124e-05 2024-04-26T12:07:13.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:13.863 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524971+0000", 2024-04-26T12:07:13.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0200999999999999e-05 2024-04-26T12:07:13.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.863 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524979+0000", 2024-04-26T12:07:13.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5809999999999999e-06 2024-04-26T12:07:13.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:13.863 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578753+0000", 2024-04-26T12:07:13.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053774444999999997 2024-04-26T12:07:13.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:13.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578821+0000", 2024-04-26T12:07:13.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7640999999999998e-05 2024-04-26T12:07:13.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:13.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582561+0000", 2024-04-26T12:07:13.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037399870000000002 2024-04-26T12:07:13.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:13.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582582+0000", 2024-04-26T12:07:13.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0934999999999999e-05 2024-04-26T12:07:13.865 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.865 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.865 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:13.865 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582614+0000", 2024-04-26T12:07:13.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1948e-05 2024-04-26T12:07:13.865 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.865 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:13.865 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.865 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.865 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.865 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3006 3.d 3:b02ffd62:::200.00000010:head [write 3827328~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:13.865 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:13.865 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 14.291505744, 2024-04-26T12:07:13.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057085404999999999, 2024-04-26T12:07:13.866 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:13.866 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.866 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:13.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.866 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:13.866 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:13.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.866 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:13.866 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:13.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:13.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525583+0000", 2024-04-26T12:07:13.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:13.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:13.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525594+0000", 2024-04-26T12:07:13.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0497e-05 2024-04-26T12:07:13.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:13.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525610+0000", 2024-04-26T12:07:13.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6392000000000002e-05 2024-04-26T12:07:13.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.868 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525621+0000", 2024-04-26T12:07:13.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0679999999999999e-05 2024-04-26T12:07:13.868 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.868 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:13.868 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.579270+0000", 2024-04-26T12:07:13.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053648802000000002 2024-04-26T12:07:13.868 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.868 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:13.868 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.579312+0000", 2024-04-26T12:07:13.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2268000000000003e-05 2024-04-26T12:07:13.868 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:13.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582618+0000", 2024-04-26T12:07:13.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033057049999999999 2024-04-26T12:07:13.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:13.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582637+0000", 2024-04-26T12:07:13.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9417000000000001e-05 2024-04-26T12:07:13.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:13.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582670+0000", 2024-04-26T12:07:13.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2969999999999998e-05 2024-04-26T12:07:13.870 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.870 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:13.870 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.870 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.870 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.870 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3015 3.d 3:b02ffd62:::200.00000010:head [write 3855113~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:13.870 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:13.870 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 14.281049986999999, 2024-04-26T12:07:13.870 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057652729999999999, 2024-04-26T12:07:13.870 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:13.870 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.870 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:13.870 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.870 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:13.870 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:13.871 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.871 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.871 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.871 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:13.871 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:13.871 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.871 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.871 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.871 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:13.871 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:13.871 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:13.871 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.871 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.871 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:13.872 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536042+0000", 2024-04-26T12:07:13.872 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0849999999999999e-06 2024-04-26T12:07:13.872 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.872 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.872 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:13.872 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536046+0000", 2024-04-26T12:07:13.872 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:07:13.872 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.872 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.872 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.872 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536048+0000", 2024-04-26T12:07:13.872 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6019999999999998e-06 2024-04-26T12:07:13.872 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.872 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.873 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:13.873 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585409+0000", 2024-04-26T12:07:13.873 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.049360938 2024-04-26T12:07:13.873 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.873 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.873 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:13.873 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585506+0000", 2024-04-26T12:07:13.873 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6966999999999995e-05 2024-04-26T12:07:13.873 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.873 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.873 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:13.873 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593630+0000", 2024-04-26T12:07:13.873 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0081238160000000007 2024-04-26T12:07:13.873 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.874 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.874 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:13.874 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593656+0000", 2024-04-26T12:07:13.874 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6154000000000001e-05 2024-04-26T12:07:13.874 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.874 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.874 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:13.874 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593693+0000", 2024-04-26T12:07:13.874 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7185999999999999e-05 2024-04-26T12:07:13.874 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.874 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:13.874 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.874 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.874 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.874 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3016 3.d 3:b02ffd62:::200.00000010:head [write 3857020~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:13.875 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:13.875 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 14.281040040000001, 2024-04-26T12:07:13.875 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058678157000000002, 2024-04-26T12:07:13.875 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:13.875 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.875 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:13.875 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.875 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:13.875 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:13.875 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.875 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.875 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.875 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:13.875 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:13.876 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.876 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.876 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:13.876 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:13.876 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:13.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.876 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.876 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:13.876 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536055+0000", 2024-04-26T12:07:13.876 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3669999999999999e-06 2024-04-26T12:07:13.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.876 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.876 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:13.876 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536058+0000", 2024-04-26T12:07:13.877 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3220000000000001e-06 2024-04-26T12:07:13.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.877 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.877 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.877 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536062+0000", 2024-04-26T12:07:13.877 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1520000000000002e-06 2024-04-26T12:07:13.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.877 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.877 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:13.877 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585965+0000", 2024-04-26T12:07:13.877 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.049902769999999999 2024-04-26T12:07:13.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.877 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.877 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:13.877 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586046+0000", 2024-04-26T12:07:13.878 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1032999999999995e-05 2024-04-26T12:07:13.878 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.878 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.878 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:13.878 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594667+0000", 2024-04-26T12:07:13.878 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0086214599999999992 2024-04-26T12:07:13.878 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.878 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.878 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:13.878 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594692+0000", 2024-04-26T12:07:13.878 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5191999999999999e-05 2024-04-26T12:07:13.878 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.878 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.878 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:13.879 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594729+0000", 2024-04-26T12:07:13.879 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6069000000000003e-05 2024-04-26T12:07:13.879 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.879 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:13.879 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.879 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.879 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.879 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3017 3.d 3:b02ffd62:::200.00000010:head [write 3859438~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:13.879 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:13.879 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 14.281025956000001, 2024-04-26T12:07:13.879 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058723814999999999, 2024-04-26T12:07:13.879 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:13.879 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.879 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:13.879 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.880 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:13.880 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:13.880 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.880 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.880 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.880 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:13.880 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:13.880 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.880 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.880 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.880 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:13.880 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:13.880 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:13.880 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.880 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.881 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:13.881 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536066+0000", 2024-04-26T12:07:13.881 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8840000000000001e-06 2024-04-26T12:07:13.881 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.881 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.881 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:13.881 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536069+0000", 2024-04-26T12:07:13.881 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:07:13.881 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.881 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.881 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.881 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536072+0000", 2024-04-26T12:07:13.881 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4449999999999999e-06 2024-04-26T12:07:13.881 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.882 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.882 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:13.882 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586703+0000", 2024-04-26T12:07:13.882 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050631618000000003 2024-04-26T12:07:13.882 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.882 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.882 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:13.882 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586748+0000", 2024-04-26T12:07:13.882 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4682999999999999e-05 2024-04-26T12:07:13.882 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.882 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.882 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:13.882 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594734+0000", 2024-04-26T12:07:13.882 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079860369999999996 2024-04-26T12:07:13.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.883 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.883 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:13.883 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594756+0000", 2024-04-26T12:07:13.883 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1738000000000001e-05 2024-04-26T12:07:13.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.883 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.883 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:13.883 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594788+0000", 2024-04-26T12:07:13.883 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2604999999999997e-05 2024-04-26T12:07:13.883 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.883 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:13.883 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.883 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.884 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3018 3.d 3:b02ffd62:::200.00000010:head [write 3861345~3221 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:13.884 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:13.884 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 14.280193269, 2024-04-26T12:07:13.884 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057946174000000003, 2024-04-26T12:07:13.884 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:13.884 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.884 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:13.884 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.884 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:13.884 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:13.884 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.884 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.884 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.884 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:13.885 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:13.885 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.885 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.885 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.885 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:13.885 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536896+0000", 2024-04-26T12:07:13.885 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:13.885 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.885 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.885 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:13.885 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536905+0000", 2024-04-26T12:07:13.885 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7839999999999998e-06 2024-04-26T12:07:13.885 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.886 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.886 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:13.886 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536929+0000", 2024-04-26T12:07:13.886 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3561999999999999e-05 2024-04-26T12:07:13.886 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.886 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.886 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.886 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536940+0000", 2024-04-26T12:07:13.886 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0742e-05 2024-04-26T12:07:13.886 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.886 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.887 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:13.887 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.587238+0000", 2024-04-26T12:07:13.887 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050297962000000002 2024-04-26T12:07:13.887 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.887 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.887 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:13.887 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.587315+0000", 2024-04-26T12:07:13.887 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7848000000000004e-05 2024-04-26T12:07:13.887 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.887 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.887 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:13.887 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594792+0000", 2024-04-26T12:07:13.887 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074766240000000003 2024-04-26T12:07:13.887 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.888 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:13.888 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594813+0000", 2024-04-26T12:07:13.888 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0876000000000001e-05 2024-04-26T12:07:13.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.888 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:13.888 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594843+0000", 2024-04-26T12:07:13.888 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0434999999999999e-05 2024-04-26T12:07:13.888 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.888 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:13.888 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.888 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3019 3.d 3:b02ffd62:::200.00000010:head [write 3864566~3989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:13.889 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:13.889 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 14.278450909, 2024-04-26T12:07:13.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.061000094999999997, 2024-04-26T12:07:13.889 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:13.889 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.889 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:13.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.889 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:13.889 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:13.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.889 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:13.889 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:13.890 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.890 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.890 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.890 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:13.890 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538638+0000", 2024-04-26T12:07:13.890 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999981 2024-04-26T12:07:13.890 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.890 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.890 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:13.890 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538669+0000", 2024-04-26T12:07:13.890 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1689000000000001e-05 2024-04-26T12:07:13.890 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.890 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.890 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:13.890 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538703+0000", 2024-04-26T12:07:13.891 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3309000000000002e-05 2024-04-26T12:07:13.891 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.891 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.891 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.891 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538746+0000", 2024-04-26T12:07:13.891 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2803999999999999e-05 2024-04-26T12:07:13.891 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.891 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.891 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:13.891 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.589467+0000", 2024-04-26T12:07:13.891 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050721912000000001 2024-04-26T12:07:13.891 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.891 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.891 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:13.892 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.589517+0000", 2024-04-26T12:07:13.892 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9549999999999998e-05 2024-04-26T12:07:13.892 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.892 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.892 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:13.892 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599577+0000", 2024-04-26T12:07:13.892 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010059593 2024-04-26T12:07:13.892 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.892 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.892 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:13.892 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599603+0000", 2024-04-26T12:07:13.892 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6821e-05 2024-04-26T12:07:13.892 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.892 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.892 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:13.893 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599640+0000", 2024-04-26T12:07:13.893 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6177999999999998e-05 2024-04-26T12:07:13.893 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.893 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:13.893 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.893 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.893 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.893 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3020 3.d 3:b02ffd62:::200.00000010:head [write 3868555~7563 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:13.893 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:13.893 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 14.275838073999999, 2024-04-26T12:07:13.893 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058446867, 2024-04-26T12:07:13.893 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:13.893 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.893 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:13.894 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.894 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:13.894 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:13.894 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.894 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.894 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:13.894 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:13.894 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.894 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.894 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:13.894 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541251+0000", 2024-04-26T12:07:13.894 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:13.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.895 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.895 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:13.895 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541286+0000", 2024-04-26T12:07:13.895 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4845999999999998e-05 2024-04-26T12:07:13.895 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.895 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.895 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:13.895 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541300+0000", 2024-04-26T12:07:13.895 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4251e-05 2024-04-26T12:07:13.895 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.895 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.895 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.895 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541307+0000", 2024-04-26T12:07:13.895 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3819999999999998e-06 2024-04-26T12:07:13.895 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.896 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.896 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:13.896 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.592596+0000", 2024-04-26T12:07:13.896 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051288215999999998 2024-04-26T12:07:13.896 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.896 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.896 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:13.896 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.592675+0000", 2024-04-26T12:07:13.896 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9197999999999996e-05 2024-04-26T12:07:13.896 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.896 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.896 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:13.896 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599645+0000", 2024-04-26T12:07:13.896 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069701759999999998 2024-04-26T12:07:13.896 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.897 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.897 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:13.897 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599667+0000", 2024-04-26T12:07:13.897 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2118999999999999e-05 2024-04-26T12:07:13.897 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.897 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.897 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:13.897 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599699+0000", 2024-04-26T12:07:13.897 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2048999999999998e-05 2024-04-26T12:07:13.897 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.897 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:13.897 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.897 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.897 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.898 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3021 3.d 3:b02ffd62:::200.00000010:head [write 3876118~3791 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:13.898 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:13.898 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 14.275776337, 2024-04-26T12:07:13.898 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058441157000000001, 2024-04-26T12:07:13.898 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:13.898 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.898 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:13.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.898 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:13.898 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:13.898 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.898 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:13.898 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:13.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.899 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.899 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:13.899 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:13.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:13.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.899 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.899 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:13.899 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541323+0000", 2024-04-26T12:07:13.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5510000000000005e-06 2024-04-26T12:07:13.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.899 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.899 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:13.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541327+0000", 2024-04-26T12:07:13.900 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2520000000000001e-06 2024-04-26T12:07:13.900 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.900 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.900 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541330+0000", 2024-04-26T12:07:13.900 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:07:13.900 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.900 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.900 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:13.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593229+0000", 2024-04-26T12:07:13.900 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051898044999999997 2024-04-26T12:07:13.900 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.900 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.901 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:13.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593278+0000", 2024-04-26T12:07:13.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9506999999999999e-05 2024-04-26T12:07:13.901 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.901 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.901 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:13.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599704+0000", 2024-04-26T12:07:13.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064259570000000004 2024-04-26T12:07:13.901 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.901 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.901 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:13.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599725+0000", 2024-04-26T12:07:13.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0562999999999999e-05 2024-04-26T12:07:13.901 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.902 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.902 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:13.902 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599755+0000", 2024-04-26T12:07:13.902 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0710000000000002e-05 2024-04-26T12:07:13.902 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.902 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:13.902 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.902 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.902 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.902 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3022 3.d 3:b02ffd62:::200.00000010:head [write 3879909~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:13.902 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:13.902 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 14.274527268, 2024-04-26T12:07:13.902 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057246689000000003, 2024-04-26T12:07:13.903 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:13.903 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.903 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:13.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.903 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:13.903 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:13.903 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.903 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:13.903 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:13.903 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.903 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:13.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542561+0000", 2024-04-26T12:07:13.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999981 2024-04-26T12:07:13.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.904 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.904 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:13.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542570+0000", 2024-04-26T12:07:13.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9199999999999993e-06 2024-04-26T12:07:13.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.904 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.904 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:13.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542583+0000", 2024-04-26T12:07:13.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2227e-05 2024-04-26T12:07:13.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.904 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.904 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542598+0000", 2024-04-26T12:07:13.905 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5199e-05 2024-04-26T12:07:13.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.905 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.905 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:13.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593728+0000", 2024-04-26T12:07:13.905 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051129846 2024-04-26T12:07:13.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.905 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.905 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:13.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593806+0000", 2024-04-26T12:07:13.905 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8425999999999998e-05 2024-04-26T12:07:13.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.905 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.906 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:13.906 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599760+0000", 2024-04-26T12:07:13.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0059537399999999999 2024-04-26T12:07:13.906 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.906 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:13.906 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599779+0000", 2024-04-26T12:07:13.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9619e-05 2024-04-26T12:07:13.906 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.906 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:13.906 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599810+0000", 2024-04-26T12:07:13.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0508999999999999e-05 2024-04-26T12:07:13.906 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.906 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:13.907 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.907 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.907 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.907 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3023 3.d 3:b02ffd62:::200.00000010:head [write 3881868~5748 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:13.907 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:13.907 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 14.27405542, 2024-04-26T12:07:13.907 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.056829994000000002, 2024-04-26T12:07:13.907 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:13.907 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:13.907 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:13.907 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.907 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:13.907 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:13.907 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.908 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.908 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.908 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:13.908 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:13.908 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:13.908 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.908 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.908 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:13.908 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543034+0000", 2024-04-26T12:07:13.908 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:13.908 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.908 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.908 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:13.908 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543044+0000", 2024-04-26T12:07:13.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0444e-05 2024-04-26T12:07:13.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.909 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:13.909 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543055+0000", 2024-04-26T12:07:13.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.096e-05 2024-04-26T12:07:13.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.909 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:13.909 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543063+0000", 2024-04-26T12:07:13.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2689999999999999e-06 2024-04-26T12:07:13.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.909 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:13.909 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594265+0000", 2024-04-26T12:07:13.910 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051201325999999998 2024-04-26T12:07:13.910 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.910 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.910 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:13.910 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594311+0000", 2024-04-26T12:07:13.910 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5918000000000003e-05 2024-04-26T12:07:13.910 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.910 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.910 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:13.910 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599815+0000", 2024-04-26T12:07:13.910 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055038370000000001 2024-04-26T12:07:13.910 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.910 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.910 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:13.911 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599834+0000", 2024-04-26T12:07:13.911 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9942e-05 2024-04-26T12:07:13.911 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:13.911 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:13.911 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:13.911 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599865+0000", 2024-04-26T12:07:13.911 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0549000000000002e-05 2024-04-26T12:07:13.911 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.911 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:13.911 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.911 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:13.911 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:13.911 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:13.913 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:07:13.914 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:13.912+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:13.947 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-04-26T12:07:13.960 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:07:14.014 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:14.012+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:14.019 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:14.019 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:07:14.019 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:07:14.019 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:14.028 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:07:14.114 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:14.113+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:14.130 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:14.130 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:07:14.130 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:07:14.131 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:07:14.131 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:14.139 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:07:14.185 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:07:14.223 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:14.222+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:14.257 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2024-04-26T12:07:14.271 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T12:07:14.282 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:14.282 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:07:14.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:07:14.282 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:07:14.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.282 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:536 3.2 3:4272d415:::200.0000000b:head [write 405817~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:14.282 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:14.283 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 19.755931375999999, 2024-04-26T12:07:14.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053030282999999998, 2024-04-26T12:07:14.283 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:14.283 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:14.283 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:14.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:14.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:14.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:14.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:14.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.285 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:14.285 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524136+0000", 2024-04-26T12:07:14.286 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:14.286 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.286 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.286 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:14.286 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524139+0000", 2024-04-26T12:07:14.286 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2919999999999998e-06 2024-04-26T12:07:14.286 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.286 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.286 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:14.286 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524144+0000", 2024-04-26T12:07:14.286 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.502e-06 2024-04-26T12:07:14.286 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.286 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.286 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:14.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524149+0000", 2024-04-26T12:07:14.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7310000000000001e-06 2024-04-26T12:07:14.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:14.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570935+0000", 2024-04-26T12:07:14.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.046785603000000002 2024-04-26T12:07:14.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:14.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570981+0000", 2024-04-26T12:07:14.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6085999999999999e-05 2024-04-26T12:07:14.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:14.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577039+0000", 2024-04-26T12:07:14.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060582099999999996 2024-04-26T12:07:14.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:14.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577081+0000", 2024-04-26T12:07:14.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1927e-05 2024-04-26T12:07:14.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:14.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577167+0000", 2024-04-26T12:07:14.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6311999999999996e-05 2024-04-26T12:07:14.288 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.288 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:14.289 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.289 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.289 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.289 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:537 3.2 3:4272d415:::200.0000000b:head [write 407216~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:14.289 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:14.289 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 19.755915437999999, 2024-04-26T12:07:14.289 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053131411000000003, 2024-04-26T12:07:14.289 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:14.289 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:14.289 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:14.289 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.289 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:14.289 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:14.289 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.289 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.290 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.290 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:14.290 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:14.290 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.290 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.290 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.290 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:14.290 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524152+0000", 2024-04-26T12:07:14.290 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:14.290 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.290 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.290 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:14.290 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524157+0000", 2024-04-26T12:07:14.290 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3529999999999997e-06 2024-04-26T12:07:14.291 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.291 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:14.291 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524162+0000", 2024-04-26T12:07:14.291 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5910000000000003e-06 2024-04-26T12:07:14.291 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.292 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:14.292 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524170+0000", 2024-04-26T12:07:14.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:07:14.292 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.292 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.292 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:14.292 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571323+0000", 2024-04-26T12:07:14.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047153289000000001 2024-04-26T12:07:14.292 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.292 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.293 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:14.293 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571367+0000", 2024-04-26T12:07:14.293 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4205000000000001e-05 2024-04-26T12:07:14.293 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.293 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.293 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:14.293 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577174+0000", 2024-04-26T12:07:14.293 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058072250000000001 2024-04-26T12:07:14.293 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.293 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.293 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:14.293 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577218+0000", 2024-04-26T12:07:14.294 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3294999999999998e-05 2024-04-26T12:07:14.294 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.294 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.294 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:14.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577284+0000", 2024-04-26T12:07:14.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6483999999999996e-05 2024-04-26T12:07:14.295 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.295 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:14.295 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.296 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:538 3.2 3:4272d415:::200.0000000b:head [write 408629~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:14.296 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:14.296 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 19.755894737999999, 2024-04-26T12:07:14.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053241841999999998, 2024-04-26T12:07:14.296 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:14.296 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:14.296 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:14.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:14.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:14.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.297 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.297 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:14.297 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:14.297 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.297 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.297 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.297 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:14.297 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:14.297 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:14.297 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.297 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.297 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:14.297 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524178+0000", 2024-04-26T12:07:14.297 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1420000000000001e-06 2024-04-26T12:07:14.298 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.298 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.298 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:14.298 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524184+0000", 2024-04-26T12:07:14.298 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4240000000000001e-06 2024-04-26T12:07:14.298 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.298 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.298 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:14.298 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524188+0000", 2024-04-26T12:07:14.298 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2710000000000003e-06 2024-04-26T12:07:14.298 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.298 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.298 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:14.299 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571623+0000", 2024-04-26T12:07:14.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047435119999999997 2024-04-26T12:07:14.299 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.299 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.299 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:14.299 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571668+0000", 2024-04-26T12:07:14.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5377000000000003e-05 2024-04-26T12:07:14.299 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.299 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.299 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:14.299 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577292+0000", 2024-04-26T12:07:14.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0056232030000000002 2024-04-26T12:07:14.299 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:14.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577330+0000", 2024-04-26T12:07:14.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8748999999999998e-05 2024-04-26T12:07:14.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:14.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577415+0000", 2024-04-26T12:07:14.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4913000000000005e-05 2024-04-26T12:07:14.300 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.301 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:14.301 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.301 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:539 3.2 3:4272d415:::200.0000000b:head [write 410547~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:14.301 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:14.301 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 19.755876606000001, 2024-04-26T12:07:14.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053372670999999997, 2024-04-26T12:07:14.301 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:14.301 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:14.301 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:14.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.301 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:14.301 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:14.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.302 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.302 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:14.302 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:14.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.302 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.303 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:14.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524191+0000", 2024-04-26T12:07:14.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:14.303 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.303 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:14.304 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524199+0000", 2024-04-26T12:07:14.304 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6520000000000006e-06 2024-04-26T12:07:14.304 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.304 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.304 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:14.304 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524205+0000", 2024-04-26T12:07:14.304 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:07:14.304 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.304 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.304 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:14.304 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524209+0000", 2024-04-26T12:07:14.305 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.335e-06 2024-04-26T12:07:14.305 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.305 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.305 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:14.305 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572320+0000", 2024-04-26T12:07:14.306 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048110992999999998 2024-04-26T12:07:14.306 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.306 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.306 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:14.306 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572364+0000", 2024-04-26T12:07:14.306 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4577999999999999e-05 2024-04-26T12:07:14.306 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.306 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.306 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:14.307 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577426+0000", 2024-04-26T12:07:14.307 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050615139999999996 2024-04-26T12:07:14.307 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.307 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.307 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:14.307 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577480+0000", 2024-04-26T12:07:14.307 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3599e-05 2024-04-26T12:07:14.307 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.308 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.308 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:14.308 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577564+0000", 2024-04-26T12:07:14.308 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4699999999999999e-05 2024-04-26T12:07:14.308 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.308 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:14.308 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.308 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.308 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.308 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:540 3.2 3:4272d415:::200.0000000b:head [write 411948~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:14.308 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:14.308 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 19.755855587999999, 2024-04-26T12:07:14.308 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053497045999999999, 2024-04-26T12:07:14.308 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:14.309 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:14.309 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:14.309 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.309 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:14.309 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:14.309 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.309 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.309 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.309 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:14.309 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:14.309 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.309 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.309 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.309 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:14.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524212+0000", 2024-04-26T12:07:14.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:14.310 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:14.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524215+0000", 2024-04-26T12:07:14.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.559e-06 2024-04-26T12:07:14.310 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:14.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524220+0000", 2024-04-26T12:07:14.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2920000000000003e-06 2024-04-26T12:07:14.310 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.311 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:14.311 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524224+0000", 2024-04-26T12:07:14.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3680000000000004e-06 2024-04-26T12:07:14.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.311 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:14.311 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572619+0000", 2024-04-26T12:07:14.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048394549000000002 2024-04-26T12:07:14.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.311 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:14.311 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572669+0000", 2024-04-26T12:07:14.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0249e-05 2024-04-26T12:07:14.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.312 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:14.312 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577575+0000", 2024-04-26T12:07:14.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049053329999999996 2024-04-26T12:07:14.312 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.312 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:14.312 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577625+0000", 2024-04-26T12:07:14.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0274e-05 2024-04-26T12:07:14.312 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:14.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577710+0000", 2024-04-26T12:07:14.313 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4741999999999996e-05 2024-04-26T12:07:14.313 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.313 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:14.313 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.313 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:543 3.2 3:4272d415:::200.0000000b:head [write 413907~2485 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:14.314 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:14.314 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 19.755785893999999, 2024-04-26T12:07:14.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053578708000000003, 2024-04-26T12:07:14.314 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:14.314 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:14.314 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:14.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.314 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:14.314 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:14.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:14.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:14.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:14.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:14.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:14.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:14.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524287+0000", 2024-04-26T12:07:14.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2190000000000003e-06 2024-04-26T12:07:14.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:14.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524294+0000", 2024-04-26T12:07:14.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5660000000000003e-06 2024-04-26T12:07:14.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:14.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524298+0000", 2024-04-26T12:07:14.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3900000000000003e-06 2024-04-26T12:07:14.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:14.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572992+0000", 2024-04-26T12:07:14.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048693835999999997 2024-04-26T12:07:14.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:14.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573045+0000", 2024-04-26T12:07:14.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2793000000000001e-05 2024-04-26T12:07:14.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:14.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577721+0000", 2024-04-26T12:07:14.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046760550000000001 2024-04-26T12:07:14.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:14.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577777+0000", 2024-04-26T12:07:14.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5908000000000001e-05 2024-04-26T12:07:14.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:14.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577861+0000", 2024-04-26T12:07:14.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4337000000000002e-05 2024-04-26T12:07:14.319 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.319 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:14.319 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.319 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:544 3.2 3:4272d415:::200.0000000b:head [write 416392~3872 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:14.319 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:14.319 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 19.755766172000001, 2024-04-26T12:07:14.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054810527999999997, 2024-04-26T12:07:14.319 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:14.320 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:14.320 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:14.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:14.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:14.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:14.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:14.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:14.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:14.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:14.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:14.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524307+0000", 2024-04-26T12:07:14.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1580000000000004e-06 2024-04-26T12:07:14.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:14.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524312+0000", 2024-04-26T12:07:14.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6380000000000001e-06 2024-04-26T12:07:14.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:14.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524317+0000", 2024-04-26T12:07:14.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4000000000000002e-06 2024-04-26T12:07:14.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:14.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573348+0000", 2024-04-26T12:07:14.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049031433999999999 2024-04-26T12:07:14.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:14.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573393+0000", 2024-04-26T12:07:14.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4536999999999997e-05 2024-04-26T12:07:14.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:14.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578978+0000", 2024-04-26T12:07:14.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055848299999999998 2024-04-26T12:07:14.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:14.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579031+0000", 2024-04-26T12:07:14.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3708000000000001e-05 2024-04-26T12:07:14.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:14.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579113+0000", 2024-04-26T12:07:14.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1258e-05 2024-04-26T12:07:14.326 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.326 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:14.326 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.326 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:545 3.2 3:4272d415:::200.0000000b:head [write 420264~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:14.327 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:14.327 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 19.755747545999998, 2024-04-26T12:07:14.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054927386000000002, 2024-04-26T12:07:14.327 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:14.327 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:14.327 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:14.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:14.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:14.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:14.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:14.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.329 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:14.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524320+0000", 2024-04-26T12:07:14.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:14.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:14.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524325+0000", 2024-04-26T12:07:14.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5249999999999999e-06 2024-04-26T12:07:14.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:14.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524330+0000", 2024-04-26T12:07:14.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5629999999999999e-06 2024-04-26T12:07:14.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:14.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524335+0000", 2024-04-26T12:07:14.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.685e-06 2024-04-26T12:07:14.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:14.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573727+0000", 2024-04-26T12:07:14.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049392034000000001 2024-04-26T12:07:14.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:14.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573775+0000", 2024-04-26T12:07:14.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7435999999999998e-05 2024-04-26T12:07:14.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.334 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:14.334 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579120+0000", 2024-04-26T12:07:14.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0053452949999999999 2024-04-26T12:07:14.335 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.335 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:14.335 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579167+0000", 2024-04-26T12:07:14.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7240000000000002e-05 2024-04-26T12:07:14.335 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:14.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579248+0000", 2024-04-26T12:07:14.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0947999999999998e-05 2024-04-26T12:07:14.336 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.336 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:14.336 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.337 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 422222~8537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:14.337 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:14.337 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 19.755729229, 2024-04-26T12:07:14.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055065936000000003, 2024-04-26T12:07:14.338 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:14.338 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:14.338 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:14.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:14.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:14.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.339 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:14.339 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:14.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:14.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:14.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:14.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:14.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524347+0000", 2024-04-26T12:07:14.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7129999999999994e-06 2024-04-26T12:07:14.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:14.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524357+0000", 2024-04-26T12:07:14.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0232e-05 2024-04-26T12:07:14.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:14.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524362+0000", 2024-04-26T12:07:14.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:07:14.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.343 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:14.343 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574119+0000", 2024-04-26T12:07:14.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049756727000000001 2024-04-26T12:07:14.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:14.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574166+0000", 2024-04-26T12:07:14.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7086000000000003e-05 2024-04-26T12:07:14.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:14.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579261+0000", 2024-04-26T12:07:14.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050948310000000002 2024-04-26T12:07:14.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:14.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579316+0000", 2024-04-26T12:07:14.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5068000000000002e-05 2024-04-26T12:07:14.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:14.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579405+0000", 2024-04-26T12:07:14.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9251000000000003e-05 2024-04-26T12:07:14.347 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.347 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:14.347 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.347 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 430759~2035 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:14.347 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:14.347 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 19.755702239000001, 2024-04-26T12:07:14.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055164950999999997, 2024-04-26T12:07:14.348 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:14.348 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:14.348 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:14.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:14.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:14.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:14.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:14.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:14.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:14.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:14.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:14.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524368+0000", 2024-04-26T12:07:14.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.57e-06 2024-04-26T12:07:14.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:14.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524375+0000", 2024-04-26T12:07:14.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6170000000000003e-06 2024-04-26T12:07:14.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:14.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524380+0000", 2024-04-26T12:07:14.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2700000000000004e-06 2024-04-26T12:07:14.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:14.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574639+0000", 2024-04-26T12:07:14.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050259459999999999 2024-04-26T12:07:14.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:14.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574687+0000", 2024-04-26T12:07:14.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7608999999999998e-05 2024-04-26T12:07:14.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:14.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579414+0000", 2024-04-26T12:07:14.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047268750000000002 2024-04-26T12:07:14.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:14.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579456+0000", 2024-04-26T12:07:14.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1885000000000003e-05 2024-04-26T12:07:14.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:14.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579531+0000", 2024-04-26T12:07:14.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5053000000000001e-05 2024-04-26T12:07:14.351 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.352 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:14.352 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.352 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 432794~10523 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:14.352 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:14.352 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 19.754711515, 2024-04-26T12:07:14.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054314727, 2024-04-26T12:07:14.352 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:14.352 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:14.352 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:14.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.352 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:14.352 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:14.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:14.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:14.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:14.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525356+0000", 2024-04-26T12:07:14.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:14.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:14.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525414+0000", 2024-04-26T12:07:14.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8148e-05 2024-04-26T12:07:14.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:14.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525423+0000", 2024-04-26T12:07:14.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9749999999999996e-06 2024-04-26T12:07:14.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:14.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525428+0000", 2024-04-26T12:07:14.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0270000000000003e-06 2024-04-26T12:07:14.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:14.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574950+0000", 2024-04-26T12:07:14.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049521840999999997 2024-04-26T12:07:14.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:14.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575002+0000", 2024-04-26T12:07:14.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1586999999999999e-05 2024-04-26T12:07:14.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:14.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579543+0000", 2024-04-26T12:07:14.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045416340000000001 2024-04-26T12:07:14.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:14.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579587+0000", 2024-04-26T12:07:14.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3875999999999998e-05 2024-04-26T12:07:14.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.356 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:14.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579671+0000", 2024-04-26T12:07:14.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4351999999999995e-05 2024-04-26T12:07:14.356 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.356 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:14.356 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.356 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 443317~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:14.356 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:14.356 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 19.754635539999999, 2024-04-26T12:07:14.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054381889000000003, 2024-04-26T12:07:14.356 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:14.357 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:14.357 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:14.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:14.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:14.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:14.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:14.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:14.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525432+0000", 2024-04-26T12:07:14.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:14.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:14.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525435+0000", 2024-04-26T12:07:14.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3070000000000001e-06 2024-04-26T12:07:14.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:14.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525439+0000", 2024-04-26T12:07:14.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.104e-06 2024-04-26T12:07:14.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:14.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525442+0000", 2024-04-26T12:07:14.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0460000000000001e-06 2024-04-26T12:07:14.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:14.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575405+0000", 2024-04-26T12:07:14.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049963059999999997 2024-04-26T12:07:14.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:14.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575450+0000", 2024-04-26T12:07:14.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5034000000000003e-05 2024-04-26T12:07:14.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:14.360 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579680+0000", 2024-04-26T12:07:14.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042302260000000001 2024-04-26T12:07:14.360 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.360 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.360 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:14.360 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579737+0000", 2024-04-26T12:07:14.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7241000000000003e-05 2024-04-26T12:07:14.360 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.360 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.360 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:14.360 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579815+0000", 2024-04-26T12:07:14.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7278000000000001e-05 2024-04-26T12:07:14.361 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.361 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:14.361 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.361 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.361 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.361 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 445275~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:14.361 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:14.361 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 19.754208364, 2024-04-26T12:07:14.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054094668999999998, 2024-04-26T12:07:14.361 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:14.361 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:14.361 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:14.361 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.361 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:14.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:14.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:14.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:14.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:14.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525859+0000", 2024-04-26T12:07:14.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:14.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:14.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525864+0000", 2024-04-26T12:07:14.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:07:14.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:14.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525872+0000", 2024-04-26T12:07:14.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6790000000000005e-06 2024-04-26T12:07:14.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:14.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525877+0000", 2024-04-26T12:07:14.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0529999999999997e-06 2024-04-26T12:07:14.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:14.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575723+0000", 2024-04-26T12:07:14.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049846469999999997 2024-04-26T12:07:14.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:14.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575770+0000", 2024-04-26T12:07:14.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6387999999999997e-05 2024-04-26T12:07:14.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:14.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579823+0000", 2024-04-26T12:07:14.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0040534189999999999 2024-04-26T12:07:14.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:14.365 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579869+0000", 2024-04-26T12:07:14.365 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6218999999999999e-05 2024-04-26T12:07:14.365 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.365 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.365 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:14.365 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579954+0000", 2024-04-26T12:07:14.365 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5315999999999994e-05 2024-04-26T12:07:14.365 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.365 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:14.365 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.365 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.365 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.365 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:551 3.2 3:4272d415:::200.0000000b:head [write 448232~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:14.365 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:14.365 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 19.753760929999999, 2024-04-26T12:07:14.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053798273000000001, 2024-04-26T12:07:14.366 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:14.366 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:14.366 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:14.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:14.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:14.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:14.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:14.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:14.367 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:14.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:14.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:14.367 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526310+0000", 2024-04-26T12:07:14.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5279999999999999e-06 2024-04-26T12:07:14.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:14.367 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526317+0000", 2024-04-26T12:07:14.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8430000000000004e-06 2024-04-26T12:07:14.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.368 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:14.368 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526322+0000", 2024-04-26T12:07:14.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3340000000000001e-06 2024-04-26T12:07:14.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.368 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:14.368 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576135+0000", 2024-04-26T12:07:14.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049812113999999998 2024-04-26T12:07:14.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.368 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:14.368 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576186+0000", 2024-04-26T12:07:14.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1443999999999997e-05 2024-04-26T12:07:14.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:14.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579962+0000", 2024-04-26T12:07:14.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037763359999999999 2024-04-26T12:07:14.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:14.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580016+0000", 2024-04-26T12:07:14.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3421000000000002e-05 2024-04-26T12:07:14.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:14.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580106+0000", 2024-04-26T12:07:14.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9790000000000006e-05 2024-04-26T12:07:14.369 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.370 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:14.370 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.370 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 450189~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:14.370 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:14.370 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 19.753680801000002, 2024-04-26T12:07:14.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055070796999999998, 2024-04-26T12:07:14.370 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:14.370 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:14.370 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:14.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:14.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:14.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:14.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:14.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:14.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:14.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:14.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:14.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526390+0000", 2024-04-26T12:07:14.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8559999999999998e-06 2024-04-26T12:07:14.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.372 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:14.372 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526395+0000", 2024-04-26T12:07:14.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3319999999999999e-06 2024-04-26T12:07:14.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.372 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:14.372 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526399+0000", 2024-04-26T12:07:14.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.619e-06 2024-04-26T12:07:14.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.372 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:14.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576476+0000", 2024-04-26T12:07:14.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050077643999999998 2024-04-26T12:07:14.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:14.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576524+0000", 2024-04-26T12:07:14.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7184000000000001e-05 2024-04-26T12:07:14.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:14.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581347+0000", 2024-04-26T12:07:14.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0048231919999999996 2024-04-26T12:07:14.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:14.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581398+0000", 2024-04-26T12:07:14.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1345999999999999e-05 2024-04-26T12:07:14.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:14.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581458+0000", 2024-04-26T12:07:14.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0081000000000003e-05 2024-04-26T12:07:14.374 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.374 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:14.374 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.374 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 452113~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:14.374 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:14.375 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 19.753569585000001, 2024-04-26T12:07:14.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055041448, 2024-04-26T12:07:14.375 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:14.375 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:14.375 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:14.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:14.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:14.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:14.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:14.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:14.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526498+0000", 2024-04-26T12:07:14.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:14.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:14.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526540+0000", 2024-04-26T12:07:14.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2267e-05 2024-04-26T12:07:14.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:14.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526547+0000", 2024-04-26T12:07:14.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7000000000000002e-06 2024-04-26T12:07:14.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:14.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526550+0000", 2024-04-26T12:07:14.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0299999999999998e-06 2024-04-26T12:07:14.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:14.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577902+0000", 2024-04-26T12:07:14.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051351648999999999 2024-04-26T12:07:14.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:14.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577953+0000", 2024-04-26T12:07:14.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1289000000000003e-05 2024-04-26T12:07:14.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:14.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581464+0000", 2024-04-26T12:07:14.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035111259999999998 2024-04-26T12:07:14.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:14.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581490+0000", 2024-04-26T12:07:14.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5717000000000001e-05 2024-04-26T12:07:14.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:14.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581540+0000", 2024-04-26T12:07:14.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0287999999999997e-05 2024-04-26T12:07:14.378 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.379 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:14.379 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.379 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 454070~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:14.379 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:14.379 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 19.753012636000001, 2024-04-26T12:07:14.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054564161, 2024-04-26T12:07:14.379 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:14.379 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:14.379 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:14.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:14.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:14.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:14.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:14.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:14.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527055+0000", 2024-04-26T12:07:14.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:14.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:14.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527058+0000", 2024-04-26T12:07:14.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9890000000000001e-06 2024-04-26T12:07:14.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:14.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527066+0000", 2024-04-26T12:07:14.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4730000000000003e-06 2024-04-26T12:07:14.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:14.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527069+0000", 2024-04-26T12:07:14.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5810000000000001e-06 2024-04-26T12:07:14.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:14.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578308+0000", 2024-04-26T12:07:14.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051238911999999998 2024-04-26T12:07:14.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:14.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578391+0000", 2024-04-26T12:07:14.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2713999999999994e-05 2024-04-26T12:07:14.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:14.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581548+0000", 2024-04-26T12:07:14.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031577530000000001 2024-04-26T12:07:14.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:14.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581574+0000", 2024-04-26T12:07:14.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5350999999999998e-05 2024-04-26T12:07:14.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:14.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581620+0000", 2024-04-26T12:07:14.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5868999999999997e-05 2024-04-26T12:07:14.383 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.383 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:14.383 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.383 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 456028~3870 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:14.383 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:14.383 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 19.751256393999999, 2024-04-26T12:07:14.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055118997000000003, 2024-04-26T12:07:14.383 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:14.384 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:14.384 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:14.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.384 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:14.384 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:14.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.384 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.384 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:14.384 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:14.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.384 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.384 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:14.385 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528811+0000", 2024-04-26T12:07:14.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:14.385 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:14.385 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528887+0000", 2024-04-26T12:07:14.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5977999999999997e-05 2024-04-26T12:07:14.385 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:14.385 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528897+0000", 2024-04-26T12:07:14.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8730000000000002e-06 2024-04-26T12:07:14.385 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:14.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528901+0000", 2024-04-26T12:07:14.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4880000000000001e-06 2024-04-26T12:07:14.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.386 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:14.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580146+0000", 2024-04-26T12:07:14.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051244242000000002 2024-04-26T12:07:14.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.386 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:14.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580227+0000", 2024-04-26T12:07:14.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1044000000000005e-05 2024-04-26T12:07:14.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.386 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:14.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583864+0000", 2024-04-26T12:07:14.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036374419999999998 2024-04-26T12:07:14.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:14.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583894+0000", 2024-04-26T12:07:14.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9828999999999999e-05 2024-04-26T12:07:14.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:14.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583931+0000", 2024-04-26T12:07:14.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6908e-05 2024-04-26T12:07:14.387 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.387 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:14.387 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.388 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.388 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 459898~2037 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:14.388 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:14.388 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 19.750868402999998, 2024-04-26T12:07:14.388 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055925713000000002, 2024-04-26T12:07:14.388 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:14.388 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:14.388 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:14.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.388 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:14.388 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:14.388 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.388 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.389 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:14.389 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:14.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.389 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.389 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:14.389 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529199+0000", 2024-04-26T12:07:14.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:14.389 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.389 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:14.389 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529203+0000", 2024-04-26T12:07:14.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:07:14.389 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.390 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:14.390 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529209+0000", 2024-04-26T12:07:14.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7939999999999999e-06 2024-04-26T12:07:14.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.390 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:14.390 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529212+0000", 2024-04-26T12:07:14.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7290000000000002e-06 2024-04-26T12:07:14.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.390 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:14.390 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580784+0000", 2024-04-26T12:07:14.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051572073000000003 2024-04-26T12:07:14.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:14.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580883+0000", 2024-04-26T12:07:14.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8330000000000002e-05 2024-04-26T12:07:14.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:14.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585050+0000", 2024-04-26T12:07:14.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041670209999999999 2024-04-26T12:07:14.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:14.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585088+0000", 2024-04-26T12:07:14.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8559999999999997e-05 2024-04-26T12:07:14.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.392 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:14.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585125+0000", 2024-04-26T12:07:14.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7197999999999999e-05 2024-04-26T12:07:14.392 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.392 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:14.392 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.392 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 461935~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:14.392 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:14.392 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 19.750145949, 2024-04-26T12:07:14.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055266150999999999, 2024-04-26T12:07:14.392 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:14.393 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:14.393 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:14.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:14.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:14.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:14.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:14.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:14.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:14.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529921+0000", 2024-04-26T12:07:14.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:14.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:14.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529956+0000", 2024-04-26T12:07:14.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4687000000000002e-05 2024-04-26T12:07:14.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:14.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529966+0000", 2024-04-26T12:07:14.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0392e-05 2024-04-26T12:07:14.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:14.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529978+0000", 2024-04-26T12:07:14.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1348e-05 2024-04-26T12:07:14.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:14.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581659+0000", 2024-04-26T12:07:14.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051681454000000002 2024-04-26T12:07:14.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.396 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:14.396 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581746+0000", 2024-04-26T12:07:14.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6305999999999997e-05 2024-04-26T12:07:14.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.396 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:14.396 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585131+0000", 2024-04-26T12:07:14.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033853199999999998 2024-04-26T12:07:14.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.396 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:14.396 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585154+0000", 2024-04-26T12:07:14.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3258999999999999e-05 2024-04-26T12:07:14.397 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:14.397 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:14.397 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:14.397 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585188+0000", 2024-04-26T12:07:14.397 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4236000000000002e-05 2024-04-26T12:07:14.397 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.397 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:14.397 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.397 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:14.397 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:14.397 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:14.398 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:07:14.399 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:07:14.399 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:07:14.399 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:07:14.400 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:07:14.401 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:07:14.401 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:07:14.401 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:07:14.402 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:14.397+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:14.499 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:14.499+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:14.509 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:14.509 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:14.519 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:14.573 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-26T12:07:14.575 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-04-26T12:07:14.589 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T12:07:14.600 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:14.598+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:14.621 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:14.622 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:14.630 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:14.701 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:14.700+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:14.772 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:14.772 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:14.780 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:07:14.824 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:14.823+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:14.884 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:14.885 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:14.893 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:07:14.927 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2024-04-26T12:07:14.934 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:14.933+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:14.940 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T12:07:15.004 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:15.002+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:15.034 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:15.035 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:15.043 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:07:15.104 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:15.103+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:15.145 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:15.145 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:15.154 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:07:15.205 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:15.203+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:15.244 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-04-26T12:07:15.256 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi052.front.sepia.ceph.com... 2024-04-26T12:07:15.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:07:15.257 DEBUG:teuthology.orchestra.run.smithi052:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-26T12:07:15.258 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:15.258 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:15.266 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:15.282 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:07:15.282 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:ceph-fuse[31800]: fuse finished with error 0 and tester_r 0 2024-04-26T12:07:15.307 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:15.304+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:15.381 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:15.381 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:15.390 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:15.433 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:15.432+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:15.491 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:15.491 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:15.499 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:07:15.543 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:15.542+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:15.601 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:15.601 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:15.609 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:15.608+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:15.610 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:07:15.710 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:15.709+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:15.751 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:15.752 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:15.760 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:07:15.811 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:15.810+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:15.902 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:15.902 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:15.910 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:07:15.911 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:15.910+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:16.012 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:16.012 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:16.012 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:16.011+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:16.020 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:16.113 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:16.113+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:16.122 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:16.122 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:16.131 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:16.215 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:16.213+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:16.233 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:16.234 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:16.240 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:07:16.316 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:16.315+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:16.345 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:16.345 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:16.353 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:07:16.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~59s 2024-04-26T12:07:16.402 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:07:16.438 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:16.437+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:16.494 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:16.494 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:16.502 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:07:16.539 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:07:16.540 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:07:16.540 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:07:16.543 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:16.542+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:16.558 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:07:16.558 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:07:16.561 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:07:16.561 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:07:16.589 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:07:16.618 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:16.617+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:16.644 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:16.645 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:07:16.645 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:07:16.645 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:07:16.645 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.645 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:536 3.2 3:4272d415:::200.0000000b:head [write 405817~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:16.645 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:16.645 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.118709194000001, 2024-04-26T12:07:16.645 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053030282999999998, 2024-04-26T12:07:16.645 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:16.645 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:16.645 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:16.645 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.645 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:16.645 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:16.646 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.646 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.646 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.646 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:16.646 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:16.646 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.646 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.646 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.646 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:16.646 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524136+0000", 2024-04-26T12:07:16.646 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524139+0000", 2024-04-26T12:07:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2919999999999998e-06 2024-04-26T12:07:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524144+0000", 2024-04-26T12:07:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.502e-06 2024-04-26T12:07:16.647 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.649 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.649 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:16.649 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524149+0000", 2024-04-26T12:07:16.649 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7310000000000001e-06 2024-04-26T12:07:16.649 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.649 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.649 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:16.649 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570935+0000", 2024-04-26T12:07:16.649 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.046785603000000002 2024-04-26T12:07:16.649 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570981+0000", 2024-04-26T12:07:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6085999999999999e-05 2024-04-26T12:07:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577039+0000", 2024-04-26T12:07:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060582099999999996 2024-04-26T12:07:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:16.650 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577081+0000", 2024-04-26T12:07:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1927e-05 2024-04-26T12:07:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577167+0000", 2024-04-26T12:07:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6311999999999996e-05 2024-04-26T12:07:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:537 3.2 3:4272d415:::200.0000000b:head [write 407216~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.118693256, 2024-04-26T12:07:16.651 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053131411000000003, 2024-04-26T12:07:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.652 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524152+0000", 2024-04-26T12:07:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524157+0000", 2024-04-26T12:07:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3529999999999997e-06 2024-04-26T12:07:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524162+0000", 2024-04-26T12:07:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5910000000000003e-06 2024-04-26T12:07:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.654 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:16.654 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524170+0000", 2024-04-26T12:07:16.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:07:16.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.654 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.654 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:16.654 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571323+0000", 2024-04-26T12:07:16.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047153289000000001 2024-04-26T12:07:16.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.654 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.654 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571367+0000", 2024-04-26T12:07:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4205000000000001e-05 2024-04-26T12:07:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577174+0000", 2024-04-26T12:07:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058072250000000001 2024-04-26T12:07:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577218+0000", 2024-04-26T12:07:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3294999999999998e-05 2024-04-26T12:07:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.655 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577284+0000", 2024-04-26T12:07:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6483999999999996e-05 2024-04-26T12:07:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:538 3.2 3:4272d415:::200.0000000b:head [write 408629~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:16.656 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.118672556, 2024-04-26T12:07:16.657 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053241841999999998, 2024-04-26T12:07:16.657 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:16.657 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:16.657 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:16.657 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.657 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:16.657 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:16.657 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.657 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.657 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524178+0000", 2024-04-26T12:07:16.658 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1420000000000001e-06 2024-04-26T12:07:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524184+0000", 2024-04-26T12:07:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4240000000000001e-06 2024-04-26T12:07:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524188+0000", 2024-04-26T12:07:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2710000000000003e-06 2024-04-26T12:07:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.659 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571623+0000", 2024-04-26T12:07:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047435119999999997 2024-04-26T12:07:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571668+0000", 2024-04-26T12:07:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5377000000000003e-05 2024-04-26T12:07:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577292+0000", 2024-04-26T12:07:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0056232030000000002 2024-04-26T12:07:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.660 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:16.661 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577330+0000", 2024-04-26T12:07:16.661 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8748999999999998e-05 2024-04-26T12:07:16.661 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.661 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.661 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:16.661 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577415+0000", 2024-04-26T12:07:16.661 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4913000000000005e-05 2024-04-26T12:07:16.661 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.661 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:16.661 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.661 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.661 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.661 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:539 3.2 3:4272d415:::200.0000000b:head [write 410547~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.118654423999999, 2024-04-26T12:07:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053372670999999997, 2024-04-26T12:07:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.662 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524191+0000", 2024-04-26T12:07:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524199+0000", 2024-04-26T12:07:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6520000000000006e-06 2024-04-26T12:07:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.663 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524205+0000", 2024-04-26T12:07:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:07:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524209+0000", 2024-04-26T12:07:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.335e-06 2024-04-26T12:07:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572320+0000", 2024-04-26T12:07:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048110992999999998 2024-04-26T12:07:16.664 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572364+0000", 2024-04-26T12:07:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4577999999999999e-05 2024-04-26T12:07:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577426+0000", 2024-04-26T12:07:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050615139999999996 2024-04-26T12:07:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577480+0000", 2024-04-26T12:07:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3599e-05 2024-04-26T12:07:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577564+0000", 2024-04-26T12:07:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4699999999999999e-05 2024-04-26T12:07:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.666 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:540 3.2 3:4272d415:::200.0000000b:head [write 411948~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.118633406000001, 2024-04-26T12:07:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053497045999999999, 2024-04-26T12:07:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.668 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:16.668 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:16.668 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.668 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.668 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.668 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:16.668 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524212+0000", 2024-04-26T12:07:16.668 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:16.668 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.668 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.669 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:16.669 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524215+0000", 2024-04-26T12:07:16.669 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.559e-06 2024-04-26T12:07:16.669 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.669 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.669 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:16.669 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524220+0000", 2024-04-26T12:07:16.669 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2920000000000003e-06 2024-04-26T12:07:16.669 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.669 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.669 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:16.669 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524224+0000", 2024-04-26T12:07:16.669 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3680000000000004e-06 2024-04-26T12:07:16.669 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.670 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.670 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:16.670 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572619+0000", 2024-04-26T12:07:16.670 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048394549000000002 2024-04-26T12:07:16.670 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.670 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.670 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:16.670 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572669+0000", 2024-04-26T12:07:16.670 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0249e-05 2024-04-26T12:07:16.670 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.670 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.670 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:16.670 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577575+0000", 2024-04-26T12:07:16.670 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049053329999999996 2024-04-26T12:07:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577625+0000", 2024-04-26T12:07:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0274e-05 2024-04-26T12:07:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577710+0000", 2024-04-26T12:07:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4741999999999996e-05 2024-04-26T12:07:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.671 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.672 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:543 3.2 3:4272d415:::200.0000000b:head [write 413907~2485 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:16.672 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:16.672 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.118563712, 2024-04-26T12:07:16.672 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053578708000000003, 2024-04-26T12:07:16.672 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:16.672 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:16.672 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:16.672 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.672 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:16.672 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:16.672 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.672 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.672 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524287+0000", 2024-04-26T12:07:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2190000000000003e-06 2024-04-26T12:07:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.673 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524294+0000", 2024-04-26T12:07:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5660000000000003e-06 2024-04-26T12:07:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524298+0000", 2024-04-26T12:07:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3900000000000003e-06 2024-04-26T12:07:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572992+0000", 2024-04-26T12:07:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048693835999999997 2024-04-26T12:07:16.674 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573045+0000", 2024-04-26T12:07:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2793000000000001e-05 2024-04-26T12:07:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577721+0000", 2024-04-26T12:07:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046760550000000001 2024-04-26T12:07:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577777+0000", 2024-04-26T12:07:16.675 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5908000000000001e-05 2024-04-26T12:07:16.676 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.676 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.676 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:16.676 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577861+0000", 2024-04-26T12:07:16.676 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4337000000000002e-05 2024-04-26T12:07:16.676 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.676 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:16.676 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.676 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.676 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.676 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:544 3.2 3:4272d415:::200.0000000b:head [write 416392~3872 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:16.676 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:16.677 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.118543989999999, 2024-04-26T12:07:16.677 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054810527999999997, 2024-04-26T12:07:16.677 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:16.677 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:16.677 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:16.677 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.677 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:16.677 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:16.677 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.677 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.678 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.678 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:16.678 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:16.678 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.678 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.678 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.678 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:16.678 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:16.678 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:16.678 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.678 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.678 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:16.679 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524307+0000", 2024-04-26T12:07:16.679 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1580000000000004e-06 2024-04-26T12:07:16.679 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.679 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.679 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:16.679 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524312+0000", 2024-04-26T12:07:16.679 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6380000000000001e-06 2024-04-26T12:07:16.679 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.679 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.679 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:16.679 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524317+0000", 2024-04-26T12:07:16.679 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4000000000000002e-06 2024-04-26T12:07:16.679 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.679 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.680 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:16.680 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573348+0000", 2024-04-26T12:07:16.680 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049031433999999999 2024-04-26T12:07:16.680 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.680 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.680 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:16.680 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573393+0000", 2024-04-26T12:07:16.680 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4536999999999997e-05 2024-04-26T12:07:16.680 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.680 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.680 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:16.680 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578978+0000", 2024-04-26T12:07:16.681 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055848299999999998 2024-04-26T12:07:16.681 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.681 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.681 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:16.681 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579031+0000", 2024-04-26T12:07:16.681 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3708000000000001e-05 2024-04-26T12:07:16.681 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.681 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.681 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:16.682 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579113+0000", 2024-04-26T12:07:16.682 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1258e-05 2024-04-26T12:07:16.682 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.682 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:16.682 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.682 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.682 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.682 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:545 3.2 3:4272d415:::200.0000000b:head [write 420264~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:16.682 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:16.682 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.118525364, 2024-04-26T12:07:16.682 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054927386000000002, 2024-04-26T12:07:16.682 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:16.682 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:16.682 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:16.683 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.683 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:16.683 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:16.683 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.683 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.683 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.683 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:16.683 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:16.683 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.683 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.683 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.683 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:16.683 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524320+0000", 2024-04-26T12:07:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524325+0000", 2024-04-26T12:07:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5249999999999999e-06 2024-04-26T12:07:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524330+0000", 2024-04-26T12:07:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5629999999999999e-06 2024-04-26T12:07:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:16.684 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524335+0000", 2024-04-26T12:07:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.685e-06 2024-04-26T12:07:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573727+0000", 2024-04-26T12:07:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049392034000000001 2024-04-26T12:07:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573775+0000", 2024-04-26T12:07:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7435999999999998e-05 2024-04-26T12:07:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:16.685 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579120+0000", 2024-04-26T12:07:16.686 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0053452949999999999 2024-04-26T12:07:16.686 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.686 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.686 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:16.686 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579167+0000", 2024-04-26T12:07:16.686 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7240000000000002e-05 2024-04-26T12:07:16.686 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.686 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579248+0000", 2024-04-26T12:07:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0947999999999998e-05 2024-04-26T12:07:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 422222~8537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.118507047000001, 2024-04-26T12:07:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055065936000000003, 2024-04-26T12:07:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:16.687 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:16.688 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524347+0000", 2024-04-26T12:07:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7129999999999994e-06 2024-04-26T12:07:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524357+0000", 2024-04-26T12:07:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0232e-05 2024-04-26T12:07:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524362+0000", 2024-04-26T12:07:16.689 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:07:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574119+0000", 2024-04-26T12:07:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049756727000000001 2024-04-26T12:07:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574166+0000", 2024-04-26T12:07:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7086000000000003e-05 2024-04-26T12:07:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.690 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579261+0000", 2024-04-26T12:07:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050948310000000002 2024-04-26T12:07:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579316+0000", 2024-04-26T12:07:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5068000000000002e-05 2024-04-26T12:07:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579405+0000", 2024-04-26T12:07:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9251000000000003e-05 2024-04-26T12:07:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:16.691 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 430759~2035 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.118480056999999, 2024-04-26T12:07:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055164950999999997, 2024-04-26T12:07:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.692 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524368+0000", 2024-04-26T12:07:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.57e-06 2024-04-26T12:07:16.693 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.694 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.694 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:16.694 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524375+0000", 2024-04-26T12:07:16.694 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6170000000000003e-06 2024-04-26T12:07:16.694 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.694 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.694 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:16.694 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524380+0000", 2024-04-26T12:07:16.694 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2700000000000004e-06 2024-04-26T12:07:16.694 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.694 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.694 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:16.694 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574639+0000", 2024-04-26T12:07:16.694 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050259459999999999 2024-04-26T12:07:16.694 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.695 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.695 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:16.695 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574687+0000", 2024-04-26T12:07:16.695 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7608999999999998e-05 2024-04-26T12:07:16.695 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.695 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.695 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:16.695 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579414+0000", 2024-04-26T12:07:16.695 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047268750000000002 2024-04-26T12:07:16.695 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.695 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.695 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:16.695 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579456+0000", 2024-04-26T12:07:16.695 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1885000000000003e-05 2024-04-26T12:07:16.695 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579531+0000", 2024-04-26T12:07:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5053000000000001e-05 2024-04-26T12:07:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 432794~10523 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.117489333000002, 2024-04-26T12:07:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054314727, 2024-04-26T12:07:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:16.696 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525356+0000", 2024-04-26T12:07:16.697 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525414+0000", 2024-04-26T12:07:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8148e-05 2024-04-26T12:07:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525423+0000", 2024-04-26T12:07:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9749999999999996e-06 2024-04-26T12:07:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:16.698 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525428+0000", 2024-04-26T12:07:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0270000000000003e-06 2024-04-26T12:07:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574950+0000", 2024-04-26T12:07:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049521840999999997 2024-04-26T12:07:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575002+0000", 2024-04-26T12:07:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1586999999999999e-05 2024-04-26T12:07:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:16.699 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579543+0000", 2024-04-26T12:07:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045416340000000001 2024-04-26T12:07:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579587+0000", 2024-04-26T12:07:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3875999999999998e-05 2024-04-26T12:07:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579671+0000", 2024-04-26T12:07:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4351999999999995e-05 2024-04-26T12:07:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.700 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 443317~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.117413358, 2024-04-26T12:07:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054381889000000003, 2024-04-26T12:07:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.701 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525432+0000", 2024-04-26T12:07:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525435+0000", 2024-04-26T12:07:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3070000000000001e-06 2024-04-26T12:07:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.702 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525439+0000", 2024-04-26T12:07:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.104e-06 2024-04-26T12:07:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525442+0000", 2024-04-26T12:07:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0460000000000001e-06 2024-04-26T12:07:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575405+0000", 2024-04-26T12:07:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049963059999999997 2024-04-26T12:07:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.703 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575450+0000", 2024-04-26T12:07:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5034000000000003e-05 2024-04-26T12:07:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579680+0000", 2024-04-26T12:07:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042302260000000001 2024-04-26T12:07:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579737+0000", 2024-04-26T12:07:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7241000000000003e-05 2024-04-26T12:07:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.704 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579815+0000", 2024-04-26T12:07:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7278000000000001e-05 2024-04-26T12:07:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 445275~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.116986182000002, 2024-04-26T12:07:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054094668999999998, 2024-04-26T12:07:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:16.705 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:16.706 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.706 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:16.706 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:16.706 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.706 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.706 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.706 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:16.706 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:16.706 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.706 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.706 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.706 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:16.706 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525859+0000", 2024-04-26T12:07:16.706 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:16.706 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525864+0000", 2024-04-26T12:07:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:07:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525872+0000", 2024-04-26T12:07:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6790000000000005e-06 2024-04-26T12:07:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525877+0000", 2024-04-26T12:07:16.707 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0529999999999997e-06 2024-04-26T12:07:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575723+0000", 2024-04-26T12:07:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049846469999999997 2024-04-26T12:07:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575770+0000", 2024-04-26T12:07:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6387999999999997e-05 2024-04-26T12:07:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579823+0000", 2024-04-26T12:07:16.708 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0040534189999999999 2024-04-26T12:07:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579869+0000", 2024-04-26T12:07:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6218999999999999e-05 2024-04-26T12:07:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579954+0000", 2024-04-26T12:07:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5315999999999994e-05 2024-04-26T12:07:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.709 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:551 3.2 3:4272d415:::200.0000000b:head [write 448232~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.116538748, 2024-04-26T12:07:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053798273000000001, 2024-04-26T12:07:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.710 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526310+0000", 2024-04-26T12:07:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5279999999999999e-06 2024-04-26T12:07:16.711 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526317+0000", 2024-04-26T12:07:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8430000000000004e-06 2024-04-26T12:07:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526322+0000", 2024-04-26T12:07:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3340000000000001e-06 2024-04-26T12:07:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576135+0000", 2024-04-26T12:07:16.712 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049812113999999998 2024-04-26T12:07:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576186+0000", 2024-04-26T12:07:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1443999999999997e-05 2024-04-26T12:07:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579962+0000", 2024-04-26T12:07:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037763359999999999 2024-04-26T12:07:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580016+0000", 2024-04-26T12:07:16.713 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3421000000000002e-05 2024-04-26T12:07:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580106+0000", 2024-04-26T12:07:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9790000000000006e-05 2024-04-26T12:07:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 450189~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.116458618999999, 2024-04-26T12:07:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055070796999999998, 2024-04-26T12:07:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:16.715 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526390+0000", 2024-04-26T12:07:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8559999999999998e-06 2024-04-26T12:07:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526395+0000", 2024-04-26T12:07:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3319999999999999e-06 2024-04-26T12:07:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.716 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526399+0000", 2024-04-26T12:07:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.619e-06 2024-04-26T12:07:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576476+0000", 2024-04-26T12:07:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050077643999999998 2024-04-26T12:07:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576524+0000", 2024-04-26T12:07:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7184000000000001e-05 2024-04-26T12:07:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.717 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581347+0000", 2024-04-26T12:07:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0048231919999999996 2024-04-26T12:07:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581398+0000", 2024-04-26T12:07:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1345999999999999e-05 2024-04-26T12:07:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581458+0000", 2024-04-26T12:07:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0081000000000003e-05 2024-04-26T12:07:16.718 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 452113~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.116347402999999, 2024-04-26T12:07:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055041448, 2024-04-26T12:07:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:16.719 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526498+0000", 2024-04-26T12:07:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.720 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:16.721 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526540+0000", 2024-04-26T12:07:16.721 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2267e-05 2024-04-26T12:07:16.721 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.721 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.721 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:16.721 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526547+0000", 2024-04-26T12:07:16.721 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7000000000000002e-06 2024-04-26T12:07:16.721 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.721 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.721 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:16.721 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526550+0000", 2024-04-26T12:07:16.721 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0299999999999998e-06 2024-04-26T12:07:16.721 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.721 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.722 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:16.722 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577902+0000", 2024-04-26T12:07:16.722 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051351648999999999 2024-04-26T12:07:16.722 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.722 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.722 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:16.722 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577953+0000", 2024-04-26T12:07:16.722 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1289000000000003e-05 2024-04-26T12:07:16.722 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.722 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.722 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:16.722 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581464+0000", 2024-04-26T12:07:16.722 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035111259999999998 2024-04-26T12:07:16.722 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.723 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.723 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:16.723 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581490+0000", 2024-04-26T12:07:16.723 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5717000000000001e-05 2024-04-26T12:07:16.723 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.723 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.723 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:16.723 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581540+0000", 2024-04-26T12:07:16.723 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0287999999999997e-05 2024-04-26T12:07:16.723 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.723 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:16.723 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.723 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.723 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.723 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 454070~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:16.724 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:16.724 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.115790453999999, 2024-04-26T12:07:16.724 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054564161, 2024-04-26T12:07:16.724 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:16.724 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:16.724 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:16.724 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.724 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:16.724 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:16.724 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.724 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.724 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.724 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:16.724 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:16.724 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527055+0000", 2024-04-26T12:07:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527058+0000", 2024-04-26T12:07:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9890000000000001e-06 2024-04-26T12:07:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527066+0000", 2024-04-26T12:07:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4730000000000003e-06 2024-04-26T12:07:16.725 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527069+0000", 2024-04-26T12:07:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5810000000000001e-06 2024-04-26T12:07:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578308+0000", 2024-04-26T12:07:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051238911999999998 2024-04-26T12:07:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578391+0000", 2024-04-26T12:07:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2713999999999994e-05 2024-04-26T12:07:16.726 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581548+0000", 2024-04-26T12:07:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031577530000000001 2024-04-26T12:07:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581574+0000", 2024-04-26T12:07:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5350999999999998e-05 2024-04-26T12:07:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581620+0000", 2024-04-26T12:07:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5868999999999997e-05 2024-04-26T12:07:16.727 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.728 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:16.728 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.728 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.728 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.728 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 456028~3870 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:16.728 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:16.728 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.114034212, 2024-04-26T12:07:16.728 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055118997000000003, 2024-04-26T12:07:16.728 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:16.728 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:16.728 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:16.728 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.728 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:16.728 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528811+0000", 2024-04-26T12:07:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:16.729 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528887+0000", 2024-04-26T12:07:16.730 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5977999999999997e-05 2024-04-26T12:07:16.730 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.730 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.730 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:16.730 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528897+0000", 2024-04-26T12:07:16.730 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8730000000000002e-06 2024-04-26T12:07:16.730 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.730 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.730 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:16.730 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528901+0000", 2024-04-26T12:07:16.730 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4880000000000001e-06 2024-04-26T12:07:16.730 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.730 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580146+0000", 2024-04-26T12:07:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051244242000000002 2024-04-26T12:07:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580227+0000", 2024-04-26T12:07:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1044000000000005e-05 2024-04-26T12:07:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583864+0000", 2024-04-26T12:07:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036374419999999998 2024-04-26T12:07:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.731 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583894+0000", 2024-04-26T12:07:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9828999999999999e-05 2024-04-26T12:07:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583931+0000", 2024-04-26T12:07:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6908e-05 2024-04-26T12:07:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 459898~2037 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:16.732 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:16.733 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.113646221, 2024-04-26T12:07:16.733 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055925713000000002, 2024-04-26T12:07:16.733 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:16.733 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:16.733 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:16.733 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.733 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:16.733 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:16.733 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.733 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.733 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.733 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:16.733 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:16.733 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.733 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.734 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.734 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:16.734 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529199+0000", 2024-04-26T12:07:16.734 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:16.734 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.734 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.734 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:16.734 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529203+0000", 2024-04-26T12:07:16.734 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:07:16.734 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.734 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.734 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:16.734 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529209+0000", 2024-04-26T12:07:16.734 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7939999999999999e-06 2024-04-26T12:07:16.734 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.735 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.735 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:16.735 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529212+0000", 2024-04-26T12:07:16.735 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7290000000000002e-06 2024-04-26T12:07:16.735 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.735 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.735 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:16.735 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580784+0000", 2024-04-26T12:07:16.735 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051572073000000003 2024-04-26T12:07:16.735 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.735 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.735 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:16.735 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580883+0000", 2024-04-26T12:07:16.735 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8330000000000002e-05 2024-04-26T12:07:16.736 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.736 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.736 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:16.736 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585050+0000", 2024-04-26T12:07:16.736 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041670209999999999 2024-04-26T12:07:16.736 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.736 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.736 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:16.736 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585088+0000", 2024-04-26T12:07:16.736 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8559999999999997e-05 2024-04-26T12:07:16.736 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.736 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.736 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:16.736 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585125+0000", 2024-04-26T12:07:16.737 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7197999999999999e-05 2024-04-26T12:07:16.737 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.737 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:16.737 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.737 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.737 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.737 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 461935~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:16.737 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:16.737 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.112923767000002, 2024-04-26T12:07:16.737 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055266150999999999, 2024-04-26T12:07:16.737 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:16.737 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:16.737 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:16.737 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.737 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:16.738 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:16.738 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.738 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.738 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.738 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:16.738 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:16.738 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:16.738 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.738 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.738 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:16.738 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529921+0000", 2024-04-26T12:07:16.738 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:16.738 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.738 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.738 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:16.739 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529956+0000", 2024-04-26T12:07:16.739 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4687000000000002e-05 2024-04-26T12:07:16.739 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.739 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.739 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:16.739 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529966+0000", 2024-04-26T12:07:16.739 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0392e-05 2024-04-26T12:07:16.739 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.739 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.739 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:16.739 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529978+0000", 2024-04-26T12:07:16.739 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1348e-05 2024-04-26T12:07:16.739 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.739 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.739 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:16.740 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581659+0000", 2024-04-26T12:07:16.740 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051681454000000002 2024-04-26T12:07:16.740 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.740 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.740 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:16.740 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581746+0000", 2024-04-26T12:07:16.740 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6305999999999997e-05 2024-04-26T12:07:16.740 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.740 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.740 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:16.740 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585131+0000", 2024-04-26T12:07:16.740 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033853199999999998 2024-04-26T12:07:16.740 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.740 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.740 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:16.741 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585154+0000", 2024-04-26T12:07:16.741 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3258999999999999e-05 2024-04-26T12:07:16.741 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:16.741 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:16.741 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:16.741 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585188+0000", 2024-04-26T12:07:16.741 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4236000000000002e-05 2024-04-26T12:07:16.741 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.741 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:16.741 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.741 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:16.741 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:16.741 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:16.743 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:07:16.743 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:16.741+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:16.843 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:16.842+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:16.844 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:16.845 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:16.845 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:07:16.845 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:16.853 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:16.945 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:16.944+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:16.995 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:16.995 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:16.995 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:07:16.996 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:07:16.996 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:17.004 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:17.045 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:17.045+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:17.108 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:17.108 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:07:17.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:07:17.108 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:07:17.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.108 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2989 3.d 3:b02ffd62:::200.00000010:head [write 3767903~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:17.108 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:17.108 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 17.589034754, 2024-04-26T12:07:17.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057069768999999999, 2024-04-26T12:07:17.108 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:17.108 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.108 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:17.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.109 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:17.109 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:17.109 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.109 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.109 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.109 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:17.109 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:17.109 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.109 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.109 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.109 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:17.109 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:17.109 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:17.109 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.109 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.110 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:17.110 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516446+0000", 2024-04-26T12:07:17.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6469999999999997e-06 2024-04-26T12:07:17.110 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.110 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.110 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:17.110 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516449+0000", 2024-04-26T12:07:17.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.976e-06 2024-04-26T12:07:17.110 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.110 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.110 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.110 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516452+0000", 2024-04-26T12:07:17.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.509e-06 2024-04-26T12:07:17.110 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.111 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.111 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:17.111 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.568562+0000", 2024-04-26T12:07:17.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.052110030000000002 2024-04-26T12:07:17.111 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.111 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.111 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:17.111 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.568615+0000", 2024-04-26T12:07:17.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2809999999999998e-05 2024-04-26T12:07:17.111 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.111 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.111 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:17.111 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573425+0000", 2024-04-26T12:07:17.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048105149999999996 2024-04-26T12:07:17.111 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.112 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.112 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:17.112 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573452+0000", 2024-04-26T12:07:17.112 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6778e-05 2024-04-26T12:07:17.112 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.112 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.112 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:17.112 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573512+0000", 2024-04-26T12:07:17.112 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9710000000000003e-05 2024-04-26T12:07:17.112 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.112 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:17.112 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.112 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.112 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.112 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2990 3.d 3:b02ffd62:::200.00000010:head [write 3769302~4483 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:17.113 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:17.113 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 17.589022754999998, 2024-04-26T12:07:17.113 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057131345, 2024-04-26T12:07:17.113 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:17.113 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.113 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:17.113 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.113 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:17.113 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:17.113 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.113 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.113 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.113 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:17.113 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:17.114 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.114 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.114 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:17.114 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:17.114 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:17.114 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.114 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:17.114 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516459+0000", 2024-04-26T12:07:17.114 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2859999999999999e-06 2024-04-26T12:07:17.114 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.114 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:17.114 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516462+0000", 2024-04-26T12:07:17.115 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0790000000000001e-06 2024-04-26T12:07:17.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.115 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.115 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.115 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516465+0000", 2024-04-26T12:07:17.115 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.464e-06 2024-04-26T12:07:17.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.115 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.115 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:17.115 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569035+0000", 2024-04-26T12:07:17.115 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.052570328999999999 2024-04-26T12:07:17.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.115 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.115 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:17.115 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569113+0000", 2024-04-26T12:07:17.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8118e-05 2024-04-26T12:07:17.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.116 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:17.116 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573517+0000", 2024-04-26T12:07:17.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044039200000000004 2024-04-26T12:07:17.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.116 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:17.116 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573541+0000", 2024-04-26T12:07:17.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3805999999999999e-05 2024-04-26T12:07:17.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.116 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:17.116 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573585+0000", 2024-04-26T12:07:17.117 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4567000000000002e-05 2024-04-26T12:07:17.117 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.117 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:17.117 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.117 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.117 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.117 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2991 3.d 3:b02ffd62:::200.00000010:head [write 3773785~4213 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:17.117 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:17.117 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 17.589010066, 2024-04-26T12:07:17.117 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057230554000000003, 2024-04-26T12:07:17.117 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:17.117 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.117 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:17.117 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.117 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:17.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:17.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:17.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:17.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:17.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516466+0000", 2024-04-26T12:07:17.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:17.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:17.119 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516470+0000", 2024-04-26T12:07:17.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7960000000000002e-06 2024-04-26T12:07:17.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.119 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:17.119 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516478+0000", 2024-04-26T12:07:17.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:07:17.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.119 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.119 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516484+0000", 2024-04-26T12:07:17.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5300000000000002e-06 2024-04-26T12:07:17.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.119 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:17.120 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569662+0000", 2024-04-26T12:07:17.120 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053177896000000002 2024-04-26T12:07:17.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.120 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:17.120 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569749+0000", 2024-04-26T12:07:17.120 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7229000000000001e-05 2024-04-26T12:07:17.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.120 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:17.120 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573593+0000", 2024-04-26T12:07:17.120 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038433109999999999 2024-04-26T12:07:17.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.120 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:17.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573631+0000", 2024-04-26T12:07:17.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8615000000000002e-05 2024-04-26T12:07:17.121 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.121 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:17.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573697+0000", 2024-04-26T12:07:17.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5971999999999998e-05 2024-04-26T12:07:17.121 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.121 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:17.121 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.121 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.121 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2999 3.d 3:b02ffd62:::200.00000010:head [write 3797283~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:17.121 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:17.122 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 17.584495678, 2024-04-26T12:07:17.122 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057330949999999999, 2024-04-26T12:07:17.122 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:17.122 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.122 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:17.122 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.122 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:17.122 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:17.122 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.122 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.122 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.122 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:17.122 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:17.122 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.123 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:17.123 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520980+0000", 2024-04-26T12:07:17.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:17.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.123 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:17.123 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520991+0000", 2024-04-26T12:07:17.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1154e-05 2024-04-26T12:07:17.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.123 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:17.123 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521014+0000", 2024-04-26T12:07:17.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2288000000000001e-05 2024-04-26T12:07:17.124 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.124 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.124 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.124 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521019+0000", 2024-04-26T12:07:17.124 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0889999999999999e-06 2024-04-26T12:07:17.124 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.124 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.124 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:17.124 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.575399+0000", 2024-04-26T12:07:17.124 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054380392999999999 2024-04-26T12:07:17.124 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.124 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.124 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:17.124 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.575440+0000", 2024-04-26T12:07:17.125 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1146000000000002e-05 2024-04-26T12:07:17.125 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.125 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.125 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:17.125 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578237+0000", 2024-04-26T12:07:17.125 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002796761 2024-04-26T12:07:17.125 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.125 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.125 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:17.125 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578260+0000", 2024-04-26T12:07:17.125 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3538999999999999e-05 2024-04-26T12:07:17.125 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.125 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.125 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:17.125 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578312+0000", 2024-04-26T12:07:17.125 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1508999999999998e-05 2024-04-26T12:07:17.126 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.126 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:17.126 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.126 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.126 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.126 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3000 3.d 3:b02ffd62:::200.00000010:head [write 3801160~9028 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:17.126 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:17.126 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 17.583869711999998, 2024-04-26T12:07:17.126 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.059231688999999997, 2024-04-26T12:07:17.126 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:17.126 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.126 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:17.126 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.126 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:17.127 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:17.127 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.127 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.127 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.127 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:17.127 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:17.127 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.127 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.127 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.127 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:17.127 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521606+0000", 2024-04-26T12:07:17.127 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:17.127 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.127 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.127 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:17.128 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521627+0000", 2024-04-26T12:07:17.128 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1129e-05 2024-04-26T12:07:17.128 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.128 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.128 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:17.128 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521637+0000", 2024-04-26T12:07:17.128 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8789999999999998e-06 2024-04-26T12:07:17.128 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.128 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.128 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.128 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521644+0000", 2024-04-26T12:07:17.128 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:07:17.128 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.128 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.128 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:17.129 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576381+0000", 2024-04-26T12:07:17.129 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.05473629 2024-04-26T12:07:17.129 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.129 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.129 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:17.129 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576451+0000", 2024-04-26T12:07:17.129 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0525000000000007e-05 2024-04-26T12:07:17.129 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.129 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.129 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:17.129 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580734+0000", 2024-04-26T12:07:17.129 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042826699999999997 2024-04-26T12:07:17.129 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.129 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.130 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:17.130 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580780+0000", 2024-04-26T12:07:17.130 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6006e-05 2024-04-26T12:07:17.130 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.130 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.130 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:17.130 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580839+0000", 2024-04-26T12:07:17.130 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8783000000000003e-05 2024-04-26T12:07:17.130 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.130 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:17.130 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.130 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.130 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.130 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3001 3.d 3:b02ffd62:::200.00000010:head [write 3810188~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:17.130 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:17.131 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 17.58331738, 2024-04-26T12:07:17.131 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.060161213999999998, 2024-04-26T12:07:17.131 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:17.131 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.131 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:17.131 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.131 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:17.131 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:17.131 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.131 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.131 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.131 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:17.131 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:17.131 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.131 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.132 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.132 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:17.132 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522158+0000", 2024-04-26T12:07:17.132 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:17.132 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.132 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.132 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:17.132 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522165+0000", 2024-04-26T12:07:17.132 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.28e-06 2024-04-26T12:07:17.132 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.132 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.132 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:17.132 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522178+0000", 2024-04-26T12:07:17.132 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3738e-05 2024-04-26T12:07:17.133 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.133 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.133 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.133 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522186+0000", 2024-04-26T12:07:17.133 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.267e-06 2024-04-26T12:07:17.133 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.133 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.133 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:17.133 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576889+0000", 2024-04-26T12:07:17.133 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054703442999999997 2024-04-26T12:07:17.133 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.133 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.133 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:17.133 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576953+0000", 2024-04-26T12:07:17.133 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4213000000000003e-05 2024-04-26T12:07:17.133 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.134 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.134 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:17.134 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582185+0000", 2024-04-26T12:07:17.134 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052319209999999996 2024-04-26T12:07:17.134 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.134 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.134 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:17.134 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582243+0000", 2024-04-26T12:07:17.134 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7321999999999998e-05 2024-04-26T12:07:17.134 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.134 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.134 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:17.135 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582321+0000", 2024-04-26T12:07:17.135 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7911000000000007e-05 2024-04-26T12:07:17.135 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.135 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:17.135 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.135 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.135 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.135 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3002 3.d 3:b02ffd62:::200.00000010:head [write 3812103~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:17.135 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:17.135 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 17.582848617, 2024-04-26T12:07:17.135 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.059796961000000003, 2024-04-26T12:07:17.135 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:17.135 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.135 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:17.136 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.136 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:17.136 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:17.136 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.136 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.136 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.136 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:17.136 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:17.136 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.136 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.136 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.136 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:17.136 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522627+0000", 2024-04-26T12:07:17.136 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:17.136 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.137 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.137 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:17.137 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522633+0000", 2024-04-26T12:07:17.137 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6699999999999999e-06 2024-04-26T12:07:17.137 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.137 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.137 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:17.137 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522643+0000", 2024-04-26T12:07:17.137 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6649999999999998e-06 2024-04-26T12:07:17.137 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.137 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.137 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.137 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522649+0000", 2024-04-26T12:07:17.137 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4200000000000004e-06 2024-04-26T12:07:17.137 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.138 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.138 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:17.138 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577413+0000", 2024-04-26T12:07:17.138 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054763714999999998 2024-04-26T12:07:17.138 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.138 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.138 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:17.138 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577460+0000", 2024-04-26T12:07:17.138 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7095000000000002e-05 2024-04-26T12:07:17.138 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.138 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.138 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:17.138 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582331+0000", 2024-04-26T12:07:17.138 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048716419999999998 2024-04-26T12:07:17.139 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.139 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.139 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:17.139 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582375+0000", 2024-04-26T12:07:17.139 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3053999999999998e-05 2024-04-26T12:07:17.139 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.139 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.139 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:17.139 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582425+0000", 2024-04-26T12:07:17.139 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0525000000000002e-05 2024-04-26T12:07:17.139 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.139 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:17.139 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.139 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.140 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.140 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3003 3.d 3:b02ffd62:::200.00000010:head [write 3814061~4170 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:17.140 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:17.140 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 17.581793555000001, 2024-04-26T12:07:17.140 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058803394000000002, 2024-04-26T12:07:17.140 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:17.140 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.140 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:17.140 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.140 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:17.140 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:17.140 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.140 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.140 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.141 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:17.141 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:17.141 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.141 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.141 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.141 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:17.141 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523682+0000", 2024-04-26T12:07:17.141 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:17.141 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.141 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.141 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:17.141 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523690+0000", 2024-04-26T12:07:17.142 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0290000000000005e-06 2024-04-26T12:07:17.142 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.142 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.142 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:17.142 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523699+0000", 2024-04-26T12:07:17.142 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4589999999999998e-06 2024-04-26T12:07:17.142 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.142 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.142 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.142 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523703+0000", 2024-04-26T12:07:17.142 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6249999999999998e-06 2024-04-26T12:07:17.142 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.142 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.142 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:17.142 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577832+0000", 2024-04-26T12:07:17.143 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054128883000000003 2024-04-26T12:07:17.143 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.143 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.143 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:17.143 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577878+0000", 2024-04-26T12:07:17.143 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5841999999999999e-05 2024-04-26T12:07:17.143 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.143 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.143 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:17.143 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582430+0000", 2024-04-26T12:07:17.143 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045517270000000002 2024-04-26T12:07:17.143 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.143 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.143 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:17.143 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582453+0000", 2024-04-26T12:07:17.144 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3609999999999999e-05 2024-04-26T12:07:17.144 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.144 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.144 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:17.144 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582487+0000", 2024-04-26T12:07:17.144 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3080000000000002e-05 2024-04-26T12:07:17.144 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.144 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:17.144 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.144 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.144 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.144 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3004 3.d 3:b02ffd62:::200.00000010:head [write 3818231~3890 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:17.144 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:17.144 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 17.580944632000001, 2024-04-26T12:07:17.144 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058024342999999999, 2024-04-26T12:07:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.145 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524531+0000", 2024-04-26T12:07:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524539+0000", 2024-04-26T12:07:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9249999999999995e-06 2024-04-26T12:07:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524547+0000", 2024-04-26T12:07:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5220000000000007e-06 2024-04-26T12:07:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524553+0000", 2024-04-26T12:07:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6659999999999996e-06 2024-04-26T12:07:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578335+0000", 2024-04-26T12:07:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.05378235 2024-04-26T12:07:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578378+0000", 2024-04-26T12:07:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2429999999999999e-05 2024-04-26T12:07:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.147 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582494+0000", 2024-04-26T12:07:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004116059 2024-04-26T12:07:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582519+0000", 2024-04-26T12:07:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4961999999999999e-05 2024-04-26T12:07:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582556+0000", 2024-04-26T12:07:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7728999999999997e-05 2024-04-26T12:07:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:17.148 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3005 3.d 3:b02ffd62:::200.00000010:head [write 3822121~5207 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 17.580525376000001, 2024-04-26T12:07:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057662270000000002, 2024-04-26T12:07:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.149 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524961+0000", 2024-04-26T12:07:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0124e-05 2024-04-26T12:07:17.150 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524971+0000", 2024-04-26T12:07:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0200999999999999e-05 2024-04-26T12:07:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524979+0000", 2024-04-26T12:07:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5809999999999999e-06 2024-04-26T12:07:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578753+0000", 2024-04-26T12:07:17.151 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053774444999999997 2024-04-26T12:07:17.152 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.152 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.152 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:17.152 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578821+0000", 2024-04-26T12:07:17.152 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7640999999999998e-05 2024-04-26T12:07:17.152 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.152 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.152 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:17.152 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582561+0000", 2024-04-26T12:07:17.152 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037399870000000002 2024-04-26T12:07:17.152 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.152 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.152 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:17.152 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582582+0000", 2024-04-26T12:07:17.152 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0934999999999999e-05 2024-04-26T12:07:17.152 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582614+0000", 2024-04-26T12:07:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1948e-05 2024-04-26T12:07:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3006 3.d 3:b02ffd62:::200.00000010:head [write 3827328~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 17.579892037, 2024-04-26T12:07:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057085404999999999, 2024-04-26T12:07:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:17.153 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:17.154 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525583+0000", 2024-04-26T12:07:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525594+0000", 2024-04-26T12:07:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0497e-05 2024-04-26T12:07:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525610+0000", 2024-04-26T12:07:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6392000000000002e-05 2024-04-26T12:07:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.155 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525621+0000", 2024-04-26T12:07:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0679999999999999e-05 2024-04-26T12:07:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.579270+0000", 2024-04-26T12:07:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053648802000000002 2024-04-26T12:07:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.579312+0000", 2024-04-26T12:07:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2268000000000003e-05 2024-04-26T12:07:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:17.156 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582618+0000", 2024-04-26T12:07:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033057049999999999 2024-04-26T12:07:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582637+0000", 2024-04-26T12:07:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9417000000000001e-05 2024-04-26T12:07:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582670+0000", 2024-04-26T12:07:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2969999999999998e-05 2024-04-26T12:07:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.157 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3015 3.d 3:b02ffd62:::200.00000010:head [write 3855113~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 17.569436280000001, 2024-04-26T12:07:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057652729999999999, 2024-04-26T12:07:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.158 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536042+0000", 2024-04-26T12:07:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0849999999999999e-06 2024-04-26T12:07:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:17.159 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536046+0000", 2024-04-26T12:07:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:07:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536048+0000", 2024-04-26T12:07:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6019999999999998e-06 2024-04-26T12:07:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585409+0000", 2024-04-26T12:07:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.049360938 2024-04-26T12:07:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585506+0000", 2024-04-26T12:07:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6966999999999995e-05 2024-04-26T12:07:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593630+0000", 2024-04-26T12:07:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0081238160000000007 2024-04-26T12:07:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593656+0000", 2024-04-26T12:07:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6154000000000001e-05 2024-04-26T12:07:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593693+0000", 2024-04-26T12:07:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7185999999999999e-05 2024-04-26T12:07:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3016 3.d 3:b02ffd62:::200.00000010:head [write 3857020~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 17.569426332999999, 2024-04-26T12:07:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058678157000000002, 2024-04-26T12:07:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:17.162 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.163 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536055+0000", 2024-04-26T12:07:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3669999999999999e-06 2024-04-26T12:07:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536058+0000", 2024-04-26T12:07:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3220000000000001e-06 2024-04-26T12:07:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536062+0000", 2024-04-26T12:07:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1520000000000002e-06 2024-04-26T12:07:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.164 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585965+0000", 2024-04-26T12:07:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.049902769999999999 2024-04-26T12:07:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586046+0000", 2024-04-26T12:07:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1032999999999995e-05 2024-04-26T12:07:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594667+0000", 2024-04-26T12:07:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0086214599999999992 2024-04-26T12:07:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.165 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594692+0000", 2024-04-26T12:07:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5191999999999999e-05 2024-04-26T12:07:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594729+0000", 2024-04-26T12:07:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6069000000000003e-05 2024-04-26T12:07:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3017 3.d 3:b02ffd62:::200.00000010:head [write 3859438~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:17.166 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 17.569412248999999, 2024-04-26T12:07:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058723814999999999, 2024-04-26T12:07:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.167 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536066+0000", 2024-04-26T12:07:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8840000000000001e-06 2024-04-26T12:07:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536069+0000", 2024-04-26T12:07:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:07:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.168 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536072+0000", 2024-04-26T12:07:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4449999999999999e-06 2024-04-26T12:07:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586703+0000", 2024-04-26T12:07:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050631618000000003 2024-04-26T12:07:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586748+0000", 2024-04-26T12:07:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4682999999999999e-05 2024-04-26T12:07:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.169 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594734+0000", 2024-04-26T12:07:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079860369999999996 2024-04-26T12:07:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594756+0000", 2024-04-26T12:07:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1738000000000001e-05 2024-04-26T12:07:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594788+0000", 2024-04-26T12:07:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2604999999999997e-05 2024-04-26T12:07:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.170 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3018 3.d 3:b02ffd62:::200.00000010:head [write 3861345~3221 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 17.568579562, 2024-04-26T12:07:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057946174000000003, 2024-04-26T12:07:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.171 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536896+0000", 2024-04-26T12:07:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536905+0000", 2024-04-26T12:07:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7839999999999998e-06 2024-04-26T12:07:17.172 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536929+0000", 2024-04-26T12:07:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3561999999999999e-05 2024-04-26T12:07:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536940+0000", 2024-04-26T12:07:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0742e-05 2024-04-26T12:07:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.587238+0000", 2024-04-26T12:07:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050297962000000002 2024-04-26T12:07:17.173 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.587315+0000", 2024-04-26T12:07:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7848000000000004e-05 2024-04-26T12:07:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594792+0000", 2024-04-26T12:07:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074766240000000003 2024-04-26T12:07:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594813+0000", 2024-04-26T12:07:17.174 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0876000000000001e-05 2024-04-26T12:07:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594843+0000", 2024-04-26T12:07:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0434999999999999e-05 2024-04-26T12:07:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3019 3.d 3:b02ffd62:::200.00000010:head [write 3864566~3989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 17.566837201999999, 2024-04-26T12:07:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.061000094999999997, 2024-04-26T12:07:17.175 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:17.176 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538638+0000", 2024-04-26T12:07:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999981 2024-04-26T12:07:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538669+0000", 2024-04-26T12:07:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1689000000000001e-05 2024-04-26T12:07:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538703+0000", 2024-04-26T12:07:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3309000000000002e-05 2024-04-26T12:07:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.177 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538746+0000", 2024-04-26T12:07:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2803999999999999e-05 2024-04-26T12:07:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.589467+0000", 2024-04-26T12:07:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050721912000000001 2024-04-26T12:07:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.589517+0000", 2024-04-26T12:07:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9549999999999998e-05 2024-04-26T12:07:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.178 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599577+0000", 2024-04-26T12:07:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010059593 2024-04-26T12:07:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599603+0000", 2024-04-26T12:07:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6821e-05 2024-04-26T12:07:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599640+0000", 2024-04-26T12:07:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6177999999999998e-05 2024-04-26T12:07:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.179 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:17.180 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.180 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.180 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.180 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3020 3.d 3:b02ffd62:::200.00000010:head [write 3868555~7563 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:17.180 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:17.180 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 17.564224367000001, 2024-04-26T12:07:17.180 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058446867, 2024-04-26T12:07:17.180 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:17.180 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.180 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:17.180 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.180 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:17.180 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:17.180 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.180 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541251+0000", 2024-04-26T12:07:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541286+0000", 2024-04-26T12:07:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4845999999999998e-05 2024-04-26T12:07:17.181 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541300+0000", 2024-04-26T12:07:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4251e-05 2024-04-26T12:07:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541307+0000", 2024-04-26T12:07:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3819999999999998e-06 2024-04-26T12:07:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.592596+0000", 2024-04-26T12:07:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051288215999999998 2024-04-26T12:07:17.182 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.592675+0000", 2024-04-26T12:07:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9197999999999996e-05 2024-04-26T12:07:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599645+0000", 2024-04-26T12:07:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069701759999999998 2024-04-26T12:07:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599667+0000", 2024-04-26T12:07:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2118999999999999e-05 2024-04-26T12:07:17.183 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599699+0000", 2024-04-26T12:07:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2048999999999998e-05 2024-04-26T12:07:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3021 3.d 3:b02ffd62:::200.00000010:head [write 3876118~3791 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 17.564162629999998, 2024-04-26T12:07:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058441157000000001, 2024-04-26T12:07:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:17.184 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:17.185 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541323+0000", 2024-04-26T12:07:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5510000000000005e-06 2024-04-26T12:07:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541327+0000", 2024-04-26T12:07:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2520000000000001e-06 2024-04-26T12:07:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.186 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541330+0000", 2024-04-26T12:07:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:07:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593229+0000", 2024-04-26T12:07:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051898044999999997 2024-04-26T12:07:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593278+0000", 2024-04-26T12:07:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9506999999999999e-05 2024-04-26T12:07:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599704+0000", 2024-04-26T12:07:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064259570000000004 2024-04-26T12:07:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599725+0000", 2024-04-26T12:07:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0562999999999999e-05 2024-04-26T12:07:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599755+0000", 2024-04-26T12:07:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0710000000000002e-05 2024-04-26T12:07:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.188 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3022 3.d 3:b02ffd62:::200.00000010:head [write 3879909~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 17.562913560999998, 2024-04-26T12:07:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057246689000000003, 2024-04-26T12:07:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.189 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542561+0000", 2024-04-26T12:07:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999981 2024-04-26T12:07:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542570+0000", 2024-04-26T12:07:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9199999999999993e-06 2024-04-26T12:07:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.190 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542583+0000", 2024-04-26T12:07:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2227e-05 2024-04-26T12:07:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542598+0000", 2024-04-26T12:07:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5199e-05 2024-04-26T12:07:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593728+0000", 2024-04-26T12:07:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051129846 2024-04-26T12:07:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593806+0000", 2024-04-26T12:07:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8425999999999998e-05 2024-04-26T12:07:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599760+0000", 2024-04-26T12:07:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0059537399999999999 2024-04-26T12:07:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599779+0000", 2024-04-26T12:07:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9619e-05 2024-04-26T12:07:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.192 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599810+0000", 2024-04-26T12:07:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0508999999999999e-05 2024-04-26T12:07:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3023 3.d 3:b02ffd62:::200.00000010:head [write 3881868~5748 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 17.562441712999998, 2024-04-26T12:07:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.056829994000000002, 2024-04-26T12:07:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.193 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543034+0000", 2024-04-26T12:07:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.194 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543044+0000", 2024-04-26T12:07:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0444e-05 2024-04-26T12:07:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543055+0000", 2024-04-26T12:07:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.096e-05 2024-04-26T12:07:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543063+0000", 2024-04-26T12:07:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2689999999999999e-06 2024-04-26T12:07:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.195 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594265+0000", 2024-04-26T12:07:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051201325999999998 2024-04-26T12:07:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594311+0000", 2024-04-26T12:07:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5918000000000003e-05 2024-04-26T12:07:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599815+0000", 2024-04-26T12:07:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055038370000000001 2024-04-26T12:07:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.196 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.197 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:17.197 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599834+0000", 2024-04-26T12:07:17.197 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9942e-05 2024-04-26T12:07:17.197 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:17.197 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:17.197 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:17.197 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599865+0000", 2024-04-26T12:07:17.197 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0549000000000002e-05 2024-04-26T12:07:17.197 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.197 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:17.197 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.197 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:17.197 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:17.197 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:17.199 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:17.198+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:17.199 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:07:17.300 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:17.299+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:17.306 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:17.306 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:07:17.306 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:07:17.307 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:17.315 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:07:17.401 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:17.400+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:17.416 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:17.416 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:07:17.417 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:07:17.417 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:07:17.417 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:17.425 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:07:17.510 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:17.509+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:17.571 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:17.571 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:07:17.571 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:07:17.571 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:07:17.571 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.572 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:536 3.2 3:4272d415:::200.0000000b:head [write 405817~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:17.572 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:17.572 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.044025316999999, 2024-04-26T12:07:17.572 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053030282999999998, 2024-04-26T12:07:17.572 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:17.572 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.573 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:17.573 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.573 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:17.573 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:17.573 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.573 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.574 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:17.574 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:17.574 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.574 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.575 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:17.575 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524136+0000", 2024-04-26T12:07:17.575 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:17.575 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.575 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.575 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:17.576 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524139+0000", 2024-04-26T12:07:17.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2919999999999998e-06 2024-04-26T12:07:17.576 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.576 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.576 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:17.576 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524144+0000", 2024-04-26T12:07:17.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.502e-06 2024-04-26T12:07:17.577 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.577 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.577 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.577 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524149+0000", 2024-04-26T12:07:17.577 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7310000000000001e-06 2024-04-26T12:07:17.577 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.578 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.578 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:17.578 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570935+0000", 2024-04-26T12:07:17.578 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.046785603000000002 2024-04-26T12:07:17.578 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.578 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.579 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:17.579 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570981+0000", 2024-04-26T12:07:17.579 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6085999999999999e-05 2024-04-26T12:07:17.579 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.579 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.579 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:17.580 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577039+0000", 2024-04-26T12:07:17.580 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060582099999999996 2024-04-26T12:07:17.580 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.580 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.580 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:17.580 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577081+0000", 2024-04-26T12:07:17.581 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1927e-05 2024-04-26T12:07:17.581 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.581 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.581 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:17.581 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577167+0000", 2024-04-26T12:07:17.581 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6311999999999996e-05 2024-04-26T12:07:17.582 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.582 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:17.582 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.582 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.582 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.582 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:537 3.2 3:4272d415:::200.0000000b:head [write 407216~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:17.583 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:17.583 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.044009378999998, 2024-04-26T12:07:17.583 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053131411000000003, 2024-04-26T12:07:17.583 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:17.583 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.583 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:17.584 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.584 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:17.584 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:17.584 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.584 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.584 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.584 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:17.585 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:17.585 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.585 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.585 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.585 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:17.585 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524152+0000", 2024-04-26T12:07:17.586 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:17.586 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.586 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.586 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:17.586 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524157+0000", 2024-04-26T12:07:17.587 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3529999999999997e-06 2024-04-26T12:07:17.587 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.587 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.587 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:17.587 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524162+0000", 2024-04-26T12:07:17.587 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5910000000000003e-06 2024-04-26T12:07:17.588 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.588 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.588 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.588 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524170+0000", 2024-04-26T12:07:17.588 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:07:17.588 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.589 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.589 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:17.589 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571323+0000", 2024-04-26T12:07:17.589 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047153289000000001 2024-04-26T12:07:17.589 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:17.590 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571367+0000", 2024-04-26T12:07:17.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4205000000000001e-05 2024-04-26T12:07:17.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:17.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577174+0000", 2024-04-26T12:07:17.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058072250000000001 2024-04-26T12:07:17.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.592 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:17.592 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577218+0000", 2024-04-26T12:07:17.592 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3294999999999998e-05 2024-04-26T12:07:17.592 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.592 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.592 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:17.593 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577284+0000", 2024-04-26T12:07:17.593 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6483999999999996e-05 2024-04-26T12:07:17.593 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.593 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:17.593 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.593 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.594 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.594 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:538 3.2 3:4272d415:::200.0000000b:head [write 408629~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:17.594 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:17.594 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.043988679000002, 2024-04-26T12:07:17.594 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053241841999999998, 2024-04-26T12:07:17.594 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:17.595 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.595 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:17.595 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.595 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:17.595 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:17.596 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.596 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.596 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.596 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:17.596 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:17.596 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.597 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.597 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.597 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:17.597 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:17.597 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:17.597 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.597 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.598 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:17.598 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524178+0000", 2024-04-26T12:07:17.598 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1420000000000001e-06 2024-04-26T12:07:17.598 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.598 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.599 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:17.599 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524184+0000", 2024-04-26T12:07:17.599 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4240000000000001e-06 2024-04-26T12:07:17.599 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.599 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.599 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.600 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524188+0000", 2024-04-26T12:07:17.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2710000000000003e-06 2024-04-26T12:07:17.600 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.600 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.600 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:17.600 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571623+0000", 2024-04-26T12:07:17.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047435119999999997 2024-04-26T12:07:17.600 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.601 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.601 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:17.601 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571668+0000", 2024-04-26T12:07:17.601 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5377000000000003e-05 2024-04-26T12:07:17.601 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.601 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.601 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:17.601 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577292+0000", 2024-04-26T12:07:17.601 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0056232030000000002 2024-04-26T12:07:17.602 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.602 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.602 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:17.602 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577330+0000", 2024-04-26T12:07:17.602 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8748999999999998e-05 2024-04-26T12:07:17.602 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.602 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.602 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:17.602 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577415+0000", 2024-04-26T12:07:17.603 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4913000000000005e-05 2024-04-26T12:07:17.603 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.603 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:17.603 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.603 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.603 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.603 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:539 3.2 3:4272d415:::200.0000000b:head [write 410547~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:17.603 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:17.603 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.043970547000001, 2024-04-26T12:07:17.603 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053372670999999997, 2024-04-26T12:07:17.604 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:17.604 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.604 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:17.604 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.604 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:17.604 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:17.604 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.604 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.604 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.605 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:17.605 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:17.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.605 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.605 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.605 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:17.605 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524191+0000", 2024-04-26T12:07:17.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:17.605 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.605 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:17.606 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524199+0000", 2024-04-26T12:07:17.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6520000000000006e-06 2024-04-26T12:07:17.606 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.606 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:17.606 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524205+0000", 2024-04-26T12:07:17.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:07:17.606 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.607 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.607 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.607 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524209+0000", 2024-04-26T12:07:17.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.335e-06 2024-04-26T12:07:17.607 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.607 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.607 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:17.607 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572320+0000", 2024-04-26T12:07:17.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048110992999999998 2024-04-26T12:07:17.608 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.608 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.608 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:17.608 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572364+0000", 2024-04-26T12:07:17.608 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4577999999999999e-05 2024-04-26T12:07:17.608 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.608 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.608 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:17.609 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577426+0000", 2024-04-26T12:07:17.609 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050615139999999996 2024-04-26T12:07:17.609 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.609 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.609 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:17.609 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577480+0000", 2024-04-26T12:07:17.609 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3599e-05 2024-04-26T12:07:17.609 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.609 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.609 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:17.610 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577564+0000", 2024-04-26T12:07:17.610 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4699999999999999e-05 2024-04-26T12:07:17.610 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.610 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:17.610 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.610 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.610 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.610 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:540 3.2 3:4272d415:::200.0000000b:head [write 411948~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:17.611 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:17.611 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.043949528999999, 2024-04-26T12:07:17.611 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053497045999999999, 2024-04-26T12:07:17.611 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:17.611 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.611 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:17.611 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.611 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:17.611 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:17.611 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.612 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.612 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.612 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:17.612 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:17.612 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.612 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.613 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.613 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:17.613 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524212+0000", 2024-04-26T12:07:17.613 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:17.613 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.613 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.614 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:17.614 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524215+0000", 2024-04-26T12:07:17.614 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.559e-06 2024-04-26T12:07:17.614 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.614 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.614 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:17.615 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524220+0000", 2024-04-26T12:07:17.615 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2920000000000003e-06 2024-04-26T12:07:17.615 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.615 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.615 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.615 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524224+0000", 2024-04-26T12:07:17.616 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3680000000000004e-06 2024-04-26T12:07:17.616 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.616 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.616 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:17.616 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572619+0000", 2024-04-26T12:07:17.617 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048394549000000002 2024-04-26T12:07:17.617 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.617 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.617 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:17.617 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572669+0000", 2024-04-26T12:07:17.617 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0249e-05 2024-04-26T12:07:17.618 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.618 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.618 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:17.618 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577575+0000", 2024-04-26T12:07:17.618 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049053329999999996 2024-04-26T12:07:17.619 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.619 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.619 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:17.619 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577625+0000", 2024-04-26T12:07:17.619 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0274e-05 2024-04-26T12:07:17.619 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.619 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.620 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:17.620 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577710+0000", 2024-04-26T12:07:17.620 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4741999999999996e-05 2024-04-26T12:07:17.620 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.621 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:17.621 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.621 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.621 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.621 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:543 3.2 3:4272d415:::200.0000000b:head [write 413907~2485 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:17.621 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:17.622 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.043879834999998, 2024-04-26T12:07:17.622 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053578708000000003, 2024-04-26T12:07:17.622 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:17.622 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.622 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:17.623 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.623 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:17.623 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:17.623 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.623 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.623 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.624 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:17.624 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:17.624 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.624 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.624 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.624 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:17.625 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:17.625 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:17.625 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.625 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.625 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:17.625 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524287+0000", 2024-04-26T12:07:17.626 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2190000000000003e-06 2024-04-26T12:07:17.626 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.626 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.626 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:17.626 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524294+0000", 2024-04-26T12:07:17.627 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5660000000000003e-06 2024-04-26T12:07:17.627 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.627 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.627 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.627 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524298+0000", 2024-04-26T12:07:17.627 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3900000000000003e-06 2024-04-26T12:07:17.627 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.627 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.628 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:17.628 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572992+0000", 2024-04-26T12:07:17.628 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048693835999999997 2024-04-26T12:07:17.628 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.628 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.628 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:17.628 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573045+0000", 2024-04-26T12:07:17.628 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2793000000000001e-05 2024-04-26T12:07:17.628 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.628 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.628 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:17.628 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577721+0000", 2024-04-26T12:07:17.628 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046760550000000001 2024-04-26T12:07:17.628 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.629 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.629 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:17.629 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577777+0000", 2024-04-26T12:07:17.629 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5908000000000001e-05 2024-04-26T12:07:17.629 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.629 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.629 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:17.629 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577861+0000", 2024-04-26T12:07:17.629 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4337000000000002e-05 2024-04-26T12:07:17.629 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.629 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:17.629 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.629 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.629 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.630 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:544 3.2 3:4272d415:::200.0000000b:head [write 416392~3872 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:17.630 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:17.630 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.043860113000001, 2024-04-26T12:07:17.630 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054810527999999997, 2024-04-26T12:07:17.630 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:17.630 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.630 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:17.630 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.630 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:17.630 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:17.630 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.630 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.630 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.630 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:17.631 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:17.631 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.631 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.631 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.631 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:17.631 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:17.631 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:17.631 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.631 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.631 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:17.631 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524307+0000", 2024-04-26T12:07:17.631 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1580000000000004e-06 2024-04-26T12:07:17.631 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.631 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.632 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:17.632 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524312+0000", 2024-04-26T12:07:17.632 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6380000000000001e-06 2024-04-26T12:07:17.632 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.632 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.632 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.632 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524317+0000", 2024-04-26T12:07:17.632 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4000000000000002e-06 2024-04-26T12:07:17.632 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.632 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.632 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:17.632 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573348+0000", 2024-04-26T12:07:17.632 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049031433999999999 2024-04-26T12:07:17.632 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.633 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.633 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:17.633 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573393+0000", 2024-04-26T12:07:17.633 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4536999999999997e-05 2024-04-26T12:07:17.633 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.633 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.633 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:17.633 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578978+0000", 2024-04-26T12:07:17.633 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055848299999999998 2024-04-26T12:07:17.633 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.633 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.633 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:17.633 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579031+0000", 2024-04-26T12:07:17.633 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3708000000000001e-05 2024-04-26T12:07:17.633 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.634 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.634 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:17.634 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579113+0000", 2024-04-26T12:07:17.634 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1258e-05 2024-04-26T12:07:17.634 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.634 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:17.634 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.634 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.634 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.634 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:545 3.2 3:4272d415:::200.0000000b:head [write 420264~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:17.634 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:17.634 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.043841487000002, 2024-04-26T12:07:17.634 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054927386000000002, 2024-04-26T12:07:17.635 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:17.635 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.635 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:17.635 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.635 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:17.635 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:17.635 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.635 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.635 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.635 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:17.635 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:17.635 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.635 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.635 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.636 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:17.636 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524320+0000", 2024-04-26T12:07:17.636 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:17.636 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.636 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.636 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:17.636 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524325+0000", 2024-04-26T12:07:17.636 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5249999999999999e-06 2024-04-26T12:07:17.636 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.636 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.636 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:17.636 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524330+0000", 2024-04-26T12:07:17.636 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5629999999999999e-06 2024-04-26T12:07:17.636 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.637 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.637 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.637 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524335+0000", 2024-04-26T12:07:17.637 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.685e-06 2024-04-26T12:07:17.637 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.637 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.637 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:17.637 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573727+0000", 2024-04-26T12:07:17.637 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049392034000000001 2024-04-26T12:07:17.637 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.637 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.637 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:17.637 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573775+0000", 2024-04-26T12:07:17.638 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7435999999999998e-05 2024-04-26T12:07:17.638 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.638 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.638 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:17.638 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579120+0000", 2024-04-26T12:07:17.638 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0053452949999999999 2024-04-26T12:07:17.638 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.638 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.638 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:17.638 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579167+0000", 2024-04-26T12:07:17.638 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7240000000000002e-05 2024-04-26T12:07:17.638 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.638 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.638 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:17.639 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579248+0000", 2024-04-26T12:07:17.639 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0947999999999998e-05 2024-04-26T12:07:17.639 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.639 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:17.639 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.639 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.639 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.639 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 422222~8537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:17.639 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:17.639 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.04382317, 2024-04-26T12:07:17.639 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055065936000000003, 2024-04-26T12:07:17.639 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:17.639 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.639 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:17.639 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.640 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:17.640 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:17.640 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.640 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.640 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.640 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:17.640 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:17.640 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.640 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.640 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.640 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:17.640 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:17.640 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:17.640 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.640 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.641 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:17.641 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524347+0000", 2024-04-26T12:07:17.641 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7129999999999994e-06 2024-04-26T12:07:17.641 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.641 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.641 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:17.641 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524357+0000", 2024-04-26T12:07:17.641 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0232e-05 2024-04-26T12:07:17.641 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.641 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.641 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.641 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524362+0000", 2024-04-26T12:07:17.641 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:07:17.641 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.641 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.642 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:17.642 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574119+0000", 2024-04-26T12:07:17.642 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049756727000000001 2024-04-26T12:07:17.642 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.642 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.642 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:17.642 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574166+0000", 2024-04-26T12:07:17.642 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7086000000000003e-05 2024-04-26T12:07:17.642 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.642 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.642 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:17.642 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579261+0000", 2024-04-26T12:07:17.642 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050948310000000002 2024-04-26T12:07:17.643 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.643 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.643 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:17.643 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579316+0000", 2024-04-26T12:07:17.643 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5068000000000002e-05 2024-04-26T12:07:17.643 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.643 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.643 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:17.643 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579405+0000", 2024-04-26T12:07:17.643 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9251000000000003e-05 2024-04-26T12:07:17.643 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.643 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:17.643 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.643 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.644 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.644 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 430759~2035 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:17.644 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:17.644 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.043796180000001, 2024-04-26T12:07:17.644 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055164950999999997, 2024-04-26T12:07:17.644 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:17.644 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.644 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:17.644 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.644 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:17.644 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:17.644 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.644 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.644 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.644 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:17.645 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:17.645 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.645 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.645 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.645 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:17.645 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:17.645 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:17.645 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.645 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.645 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:17.645 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524368+0000", 2024-04-26T12:07:17.645 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.57e-06 2024-04-26T12:07:17.645 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.645 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.645 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:17.646 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524375+0000", 2024-04-26T12:07:17.646 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6170000000000003e-06 2024-04-26T12:07:17.646 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.646 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.646 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.646 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524380+0000", 2024-04-26T12:07:17.646 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2700000000000004e-06 2024-04-26T12:07:17.646 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.646 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.646 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:17.646 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574639+0000", 2024-04-26T12:07:17.646 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050259459999999999 2024-04-26T12:07:17.646 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.646 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.647 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:17.647 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574687+0000", 2024-04-26T12:07:17.647 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7608999999999998e-05 2024-04-26T12:07:17.647 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.647 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.647 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:17.647 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579414+0000", 2024-04-26T12:07:17.647 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047268750000000002 2024-04-26T12:07:17.647 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.647 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.647 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:17.647 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579456+0000", 2024-04-26T12:07:17.647 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1885000000000003e-05 2024-04-26T12:07:17.647 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.647 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.648 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:17.648 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579531+0000", 2024-04-26T12:07:17.648 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5053000000000001e-05 2024-04-26T12:07:17.648 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.648 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:17.648 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.648 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.648 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.648 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 432794~10523 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:17.648 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:17.648 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.042805456, 2024-04-26T12:07:17.648 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054314727, 2024-04-26T12:07:17.648 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:17.648 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.649 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:17.649 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.649 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:17.649 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:17.649 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.649 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.649 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.649 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:17.649 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:17.649 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.649 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.649 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.649 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:17.649 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525356+0000", 2024-04-26T12:07:17.649 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:17.650 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.650 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.650 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:17.650 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525414+0000", 2024-04-26T12:07:17.650 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8148e-05 2024-04-26T12:07:17.650 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.650 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.650 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:17.650 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525423+0000", 2024-04-26T12:07:17.650 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9749999999999996e-06 2024-04-26T12:07:17.650 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.650 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.650 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.650 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525428+0000", 2024-04-26T12:07:17.651 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0270000000000003e-06 2024-04-26T12:07:17.651 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.651 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.651 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:17.651 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574950+0000", 2024-04-26T12:07:17.651 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049521840999999997 2024-04-26T12:07:17.651 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.651 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.651 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:17.651 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575002+0000", 2024-04-26T12:07:17.651 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1586999999999999e-05 2024-04-26T12:07:17.651 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.651 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.651 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:17.652 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579543+0000", 2024-04-26T12:07:17.652 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045416340000000001 2024-04-26T12:07:17.652 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.652 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.652 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:17.652 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579587+0000", 2024-04-26T12:07:17.652 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3875999999999998e-05 2024-04-26T12:07:17.652 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.652 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.652 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:17.652 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579671+0000", 2024-04-26T12:07:17.652 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4351999999999995e-05 2024-04-26T12:07:17.652 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.652 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:17.652 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.652 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.653 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 443317~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:17.653 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:17.653 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.042729480999999, 2024-04-26T12:07:17.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054381889000000003, 2024-04-26T12:07:17.653 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:17.653 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.653 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:17.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:17.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:17.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.653 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:17.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:17.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.654 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.654 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:17.654 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525432+0000", 2024-04-26T12:07:17.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:17.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.654 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.654 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:17.654 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525435+0000", 2024-04-26T12:07:17.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3070000000000001e-06 2024-04-26T12:07:17.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.654 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.654 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:17.654 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525439+0000", 2024-04-26T12:07:17.655 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.104e-06 2024-04-26T12:07:17.655 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.655 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.655 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.655 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525442+0000", 2024-04-26T12:07:17.655 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0460000000000001e-06 2024-04-26T12:07:17.655 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.655 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.655 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:17.655 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575405+0000", 2024-04-26T12:07:17.655 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049963059999999997 2024-04-26T12:07:17.655 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.655 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.655 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:17.656 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575450+0000", 2024-04-26T12:07:17.656 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5034000000000003e-05 2024-04-26T12:07:17.656 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.656 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.656 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:17.656 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579680+0000", 2024-04-26T12:07:17.656 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042302260000000001 2024-04-26T12:07:17.656 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.656 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.656 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:17.656 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579737+0000", 2024-04-26T12:07:17.656 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7241000000000003e-05 2024-04-26T12:07:17.656 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.656 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.656 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:17.657 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579815+0000", 2024-04-26T12:07:17.657 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7278000000000001e-05 2024-04-26T12:07:17.657 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.657 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:17.657 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.657 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.657 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.657 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 445275~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:17.657 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:17.657 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.042302305, 2024-04-26T12:07:17.657 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054094668999999998, 2024-04-26T12:07:17.657 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:17.657 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.657 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:17.657 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.658 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:17.658 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:17.658 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.658 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.658 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.658 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:17.658 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:17.658 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.658 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.658 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.658 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:17.658 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525859+0000", 2024-04-26T12:07:17.658 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:17.658 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.659 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:17.659 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525864+0000", 2024-04-26T12:07:17.659 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:07:17.659 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.659 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:17.659 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525872+0000", 2024-04-26T12:07:17.659 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6790000000000005e-06 2024-04-26T12:07:17.659 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.659 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.659 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525877+0000", 2024-04-26T12:07:17.659 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0529999999999997e-06 2024-04-26T12:07:17.659 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.660 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.660 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:17.660 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575723+0000", 2024-04-26T12:07:17.660 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049846469999999997 2024-04-26T12:07:17.660 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.660 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.660 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:17.660 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575770+0000", 2024-04-26T12:07:17.660 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6387999999999997e-05 2024-04-26T12:07:17.660 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.660 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.660 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:17.660 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579823+0000", 2024-04-26T12:07:17.660 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0040534189999999999 2024-04-26T12:07:17.661 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.661 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.661 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:17.661 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579869+0000", 2024-04-26T12:07:17.661 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6218999999999999e-05 2024-04-26T12:07:17.661 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.661 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.661 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:17.661 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579954+0000", 2024-04-26T12:07:17.661 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5315999999999994e-05 2024-04-26T12:07:17.661 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.661 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:17.661 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.661 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.661 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.662 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:551 3.2 3:4272d415:::200.0000000b:head [write 448232~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:17.662 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:17.662 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.041854871000002, 2024-04-26T12:07:17.662 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053798273000000001, 2024-04-26T12:07:17.662 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:17.662 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.662 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:17.662 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.662 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:17.662 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:17.662 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.662 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.662 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.663 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:17.663 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:17.663 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.663 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.663 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.663 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:17.663 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:17.663 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:17.663 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.663 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.663 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:17.663 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526310+0000", 2024-04-26T12:07:17.663 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5279999999999999e-06 2024-04-26T12:07:17.663 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.663 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.664 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:17.664 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526317+0000", 2024-04-26T12:07:17.664 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8430000000000004e-06 2024-04-26T12:07:17.664 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.664 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.664 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.664 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526322+0000", 2024-04-26T12:07:17.664 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3340000000000001e-06 2024-04-26T12:07:17.664 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.664 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.664 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:17.664 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576135+0000", 2024-04-26T12:07:17.664 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049812113999999998 2024-04-26T12:07:17.664 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.665 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.665 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:17.665 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576186+0000", 2024-04-26T12:07:17.665 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1443999999999997e-05 2024-04-26T12:07:17.665 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.665 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.665 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:17.665 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579962+0000", 2024-04-26T12:07:17.665 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037763359999999999 2024-04-26T12:07:17.665 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.665 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.665 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:17.665 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580016+0000", 2024-04-26T12:07:17.665 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3421000000000002e-05 2024-04-26T12:07:17.665 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.666 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.666 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:17.666 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580106+0000", 2024-04-26T12:07:17.666 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9790000000000006e-05 2024-04-26T12:07:17.666 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.666 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:17.666 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.666 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.666 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.666 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 450189~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:17.666 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:17.666 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.041774742000001, 2024-04-26T12:07:17.666 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055070796999999998, 2024-04-26T12:07:17.666 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:17.667 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.667 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:17.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.667 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:17.667 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:17.667 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.667 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.667 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:17.667 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:17.667 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.667 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.667 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:17.668 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:17.668 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:17.668 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.668 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.668 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:17.668 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526390+0000", 2024-04-26T12:07:17.668 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8559999999999998e-06 2024-04-26T12:07:17.668 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.668 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.668 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:17.668 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526395+0000", 2024-04-26T12:07:17.668 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3319999999999999e-06 2024-04-26T12:07:17.668 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.668 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.669 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.669 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526399+0000", 2024-04-26T12:07:17.669 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.619e-06 2024-04-26T12:07:17.669 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.669 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.669 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:17.669 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576476+0000", 2024-04-26T12:07:17.669 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050077643999999998 2024-04-26T12:07:17.669 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.669 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.669 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:17.669 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576524+0000", 2024-04-26T12:07:17.669 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7184000000000001e-05 2024-04-26T12:07:17.669 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.670 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.670 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:17.670 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581347+0000", 2024-04-26T12:07:17.670 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0048231919999999996 2024-04-26T12:07:17.670 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.670 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.670 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:17.670 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581398+0000", 2024-04-26T12:07:17.670 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1345999999999999e-05 2024-04-26T12:07:17.670 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.670 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.670 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:17.670 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581458+0000", 2024-04-26T12:07:17.670 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0081000000000003e-05 2024-04-26T12:07:17.671 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.671 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:17.671 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.671 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.671 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.671 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 452113~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:17.671 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:17.671 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.041663526000001, 2024-04-26T12:07:17.671 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055041448, 2024-04-26T12:07:17.671 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:17.671 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.671 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:17.671 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.671 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:17.672 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:17.672 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.672 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.672 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.672 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:17.672 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:17.672 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.672 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.672 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.672 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:17.672 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526498+0000", 2024-04-26T12:07:17.672 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:17.672 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.673 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.673 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:17.673 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526540+0000", 2024-04-26T12:07:17.673 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2267e-05 2024-04-26T12:07:17.673 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.673 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.673 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:17.673 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526547+0000", 2024-04-26T12:07:17.673 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7000000000000002e-06 2024-04-26T12:07:17.673 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.673 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.673 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.673 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526550+0000", 2024-04-26T12:07:17.673 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0299999999999998e-06 2024-04-26T12:07:17.674 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.674 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:17.674 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577902+0000", 2024-04-26T12:07:17.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051351648999999999 2024-04-26T12:07:17.674 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.674 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:17.674 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577953+0000", 2024-04-26T12:07:17.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1289000000000003e-05 2024-04-26T12:07:17.674 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.674 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:17.674 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581464+0000", 2024-04-26T12:07:17.675 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035111259999999998 2024-04-26T12:07:17.675 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.675 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.675 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:17.675 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581490+0000", 2024-04-26T12:07:17.675 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5717000000000001e-05 2024-04-26T12:07:17.675 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.675 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.675 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:17.675 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581540+0000", 2024-04-26T12:07:17.675 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0287999999999997e-05 2024-04-26T12:07:17.675 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.675 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:17.677 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.677 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.677 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.677 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 454070~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:17.677 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:17.677 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.041106577000001, 2024-04-26T12:07:17.677 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054564161, 2024-04-26T12:07:17.677 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:17.677 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.677 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:17.678 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.678 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:17.678 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:17.678 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.678 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.678 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.678 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:17.678 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:17.678 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.678 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.678 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.678 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:17.678 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527055+0000", 2024-04-26T12:07:17.679 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:17.679 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.679 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.679 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:17.679 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527058+0000", 2024-04-26T12:07:17.679 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9890000000000001e-06 2024-04-26T12:07:17.679 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.679 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.679 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:17.679 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527066+0000", 2024-04-26T12:07:17.679 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4730000000000003e-06 2024-04-26T12:07:17.679 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.679 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.679 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.680 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527069+0000", 2024-04-26T12:07:17.680 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5810000000000001e-06 2024-04-26T12:07:17.680 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.680 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.680 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:17.680 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578308+0000", 2024-04-26T12:07:17.680 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051238911999999998 2024-04-26T12:07:17.680 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.680 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.680 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:17.680 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578391+0000", 2024-04-26T12:07:17.680 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2713999999999994e-05 2024-04-26T12:07:17.680 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.680 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.680 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:17.681 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581548+0000", 2024-04-26T12:07:17.681 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031577530000000001 2024-04-26T12:07:17.681 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.681 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.681 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:17.681 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581574+0000", 2024-04-26T12:07:17.681 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5350999999999998e-05 2024-04-26T12:07:17.681 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.681 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.681 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:17.681 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581620+0000", 2024-04-26T12:07:17.681 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5868999999999997e-05 2024-04-26T12:07:17.681 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.681 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:17.682 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.682 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.682 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.682 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 456028~3870 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:17.682 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:17.682 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.039350335000002, 2024-04-26T12:07:17.682 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055118997000000003, 2024-04-26T12:07:17.682 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:17.682 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.682 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:17.682 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.682 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:17.682 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:17.682 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.682 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.683 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.683 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:17.683 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:17.683 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.683 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.683 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.683 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:17.683 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528811+0000", 2024-04-26T12:07:17.683 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:17.683 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.683 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.683 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:17.683 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528887+0000", 2024-04-26T12:07:17.683 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5977999999999997e-05 2024-04-26T12:07:17.684 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.684 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.684 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:17.684 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528897+0000", 2024-04-26T12:07:17.684 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8730000000000002e-06 2024-04-26T12:07:17.684 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.684 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.684 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.684 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528901+0000", 2024-04-26T12:07:17.684 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4880000000000001e-06 2024-04-26T12:07:17.684 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.684 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.684 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:17.684 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580146+0000", 2024-04-26T12:07:17.685 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051244242000000002 2024-04-26T12:07:17.685 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.685 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.685 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:17.685 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580227+0000", 2024-04-26T12:07:17.685 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1044000000000005e-05 2024-04-26T12:07:17.685 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.685 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.685 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:17.685 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583864+0000", 2024-04-26T12:07:17.685 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036374419999999998 2024-04-26T12:07:17.685 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.685 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.685 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:17.685 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583894+0000", 2024-04-26T12:07:17.686 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9828999999999999e-05 2024-04-26T12:07:17.686 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.686 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.686 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:17.686 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583931+0000", 2024-04-26T12:07:17.686 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6908e-05 2024-04-26T12:07:17.686 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.686 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:17.686 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.686 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.686 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.686 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 459898~2037 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:17.686 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:17.686 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.038962344000002, 2024-04-26T12:07:17.686 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055925713000000002, 2024-04-26T12:07:17.687 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:17.687 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.687 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:17.687 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.687 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:17.687 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:17.687 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.687 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.687 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.687 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:17.687 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:17.687 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.687 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.687 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.687 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:17.688 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529199+0000", 2024-04-26T12:07:17.688 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:17.688 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.688 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.688 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:17.688 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529203+0000", 2024-04-26T12:07:17.688 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:07:17.688 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.688 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.688 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:17.688 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529209+0000", 2024-04-26T12:07:17.688 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7939999999999999e-06 2024-04-26T12:07:17.688 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.688 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.689 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.689 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529212+0000", 2024-04-26T12:07:17.689 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7290000000000002e-06 2024-04-26T12:07:17.689 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.689 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.689 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:17.689 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580784+0000", 2024-04-26T12:07:17.689 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051572073000000003 2024-04-26T12:07:17.689 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.689 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.689 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:17.689 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580883+0000", 2024-04-26T12:07:17.689 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8330000000000002e-05 2024-04-26T12:07:17.689 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.689 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.690 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:17.690 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585050+0000", 2024-04-26T12:07:17.690 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041670209999999999 2024-04-26T12:07:17.690 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.690 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.690 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:17.690 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585088+0000", 2024-04-26T12:07:17.690 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8559999999999997e-05 2024-04-26T12:07:17.690 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.690 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.690 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:17.690 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585125+0000", 2024-04-26T12:07:17.690 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7197999999999999e-05 2024-04-26T12:07:17.690 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.691 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:17.691 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.691 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.691 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.691 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 461935~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:17.691 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:17.691 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.03823989, 2024-04-26T12:07:17.691 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055266150999999999, 2024-04-26T12:07:17.691 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:17.691 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:17.691 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:17.691 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.691 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:17.691 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:17.691 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529921+0000", 2024-04-26T12:07:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529956+0000", 2024-04-26T12:07:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4687000000000002e-05 2024-04-26T12:07:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529966+0000", 2024-04-26T12:07:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0392e-05 2024-04-26T12:07:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529978+0000", 2024-04-26T12:07:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1348e-05 2024-04-26T12:07:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581659+0000", 2024-04-26T12:07:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051681454000000002 2024-04-26T12:07:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581746+0000", 2024-04-26T12:07:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6305999999999997e-05 2024-04-26T12:07:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585131+0000", 2024-04-26T12:07:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033853199999999998 2024-04-26T12:07:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585154+0000", 2024-04-26T12:07:17.695 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3258999999999999e-05 2024-04-26T12:07:17.695 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:17.695 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:17.695 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:17.695 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585188+0000", 2024-04-26T12:07:17.695 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4236000000000002e-05 2024-04-26T12:07:17.695 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.695 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:17.695 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.695 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:17.695 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:17.695 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:17.697 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-26T12:07:17.698 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:07:17.698 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:17.695+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:17.798 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:17.797+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:17.801 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:17.801 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:17.801 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:07:17.802 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:17.810 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:17.898 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:17.898+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:17.912 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:17.912 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:17.912 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:07:17.912 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:07:17.913 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:17.921 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:17.999 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:17.998+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:18.024 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:18.024 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:07:18.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:07:18.024 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:07:18.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.024 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2989 3.d 3:b02ffd62:::200.00000010:head [write 3767903~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:18.024 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:18.024 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 18.505352396999999, 2024-04-26T12:07:18.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057069768999999999, 2024-04-26T12:07:18.025 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:18.025 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.025 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:18.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:18.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:18.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:18.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:18.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:18.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:18.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:18.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:18.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516446+0000", 2024-04-26T12:07:18.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6469999999999997e-06 2024-04-26T12:07:18.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:18.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516449+0000", 2024-04-26T12:07:18.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.976e-06 2024-04-26T12:07:18.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516452+0000", 2024-04-26T12:07:18.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.509e-06 2024-04-26T12:07:18.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:18.028 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.568562+0000", 2024-04-26T12:07:18.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.052110030000000002 2024-04-26T12:07:18.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:18.028 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.568615+0000", 2024-04-26T12:07:18.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2809999999999998e-05 2024-04-26T12:07:18.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:18.029 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573425+0000", 2024-04-26T12:07:18.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048105149999999996 2024-04-26T12:07:18.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:18.029 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573452+0000", 2024-04-26T12:07:18.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6778e-05 2024-04-26T12:07:18.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:18.029 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573512+0000", 2024-04-26T12:07:18.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9710000000000003e-05 2024-04-26T12:07:18.029 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.029 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:18.030 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.030 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2990 3.d 3:b02ffd62:::200.00000010:head [write 3769302~4483 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:18.030 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:18.030 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 18.505340398000001, 2024-04-26T12:07:18.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057131345, 2024-04-26T12:07:18.030 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:18.030 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.030 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:18.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:18.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:18.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:18.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:18.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:18.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:18.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:18.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:18.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516459+0000", 2024-04-26T12:07:18.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2859999999999999e-06 2024-04-26T12:07:18.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:18.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516462+0000", 2024-04-26T12:07:18.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0790000000000001e-06 2024-04-26T12:07:18.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516465+0000", 2024-04-26T12:07:18.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.464e-06 2024-04-26T12:07:18.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:18.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569035+0000", 2024-04-26T12:07:18.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.052570328999999999 2024-04-26T12:07:18.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:18.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569113+0000", 2024-04-26T12:07:18.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8118e-05 2024-04-26T12:07:18.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:18.034 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573517+0000", 2024-04-26T12:07:18.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044039200000000004 2024-04-26T12:07:18.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:18.034 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573541+0000", 2024-04-26T12:07:18.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3805999999999999e-05 2024-04-26T12:07:18.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.035 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.035 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:18.035 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573585+0000", 2024-04-26T12:07:18.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4567000000000002e-05 2024-04-26T12:07:18.035 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.035 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:18.035 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.035 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.035 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.035 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2991 3.d 3:b02ffd62:::200.00000010:head [write 3773785~4213 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:18.035 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:18.035 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 18.505327708999999, 2024-04-26T12:07:18.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057230554000000003, 2024-04-26T12:07:18.035 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:18.036 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.036 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:18.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.036 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:18.036 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:18.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.036 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:18.036 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:18.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:18.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516466+0000", 2024-04-26T12:07:18.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:18.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:18.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516470+0000", 2024-04-26T12:07:18.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7960000000000002e-06 2024-04-26T12:07:18.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:18.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516478+0000", 2024-04-26T12:07:18.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:07:18.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516484+0000", 2024-04-26T12:07:18.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5300000000000002e-06 2024-04-26T12:07:18.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:18.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569662+0000", 2024-04-26T12:07:18.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053177896000000002 2024-04-26T12:07:18.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.039 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:18.039 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569749+0000", 2024-04-26T12:07:18.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7229000000000001e-05 2024-04-26T12:07:18.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.039 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:18.039 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573593+0000", 2024-04-26T12:07:18.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038433109999999999 2024-04-26T12:07:18.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.039 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:18.040 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573631+0000", 2024-04-26T12:07:18.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8615000000000002e-05 2024-04-26T12:07:18.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.040 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:18.040 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573697+0000", 2024-04-26T12:07:18.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5971999999999998e-05 2024-04-26T12:07:18.040 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.040 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:18.040 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.041 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2999 3.d 3:b02ffd62:::200.00000010:head [write 3797283~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:18.041 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:18.041 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 18.500813320999999, 2024-04-26T12:07:18.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057330949999999999, 2024-04-26T12:07:18.041 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:18.041 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.041 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:18.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:18.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:18.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:18.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:18.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:18.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520980+0000", 2024-04-26T12:07:18.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:18.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:18.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520991+0000", 2024-04-26T12:07:18.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1154e-05 2024-04-26T12:07:18.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:18.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521014+0000", 2024-04-26T12:07:18.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2288000000000001e-05 2024-04-26T12:07:18.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521019+0000", 2024-04-26T12:07:18.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0889999999999999e-06 2024-04-26T12:07:18.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.044 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:18.044 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.575399+0000", 2024-04-26T12:07:18.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054380392999999999 2024-04-26T12:07:18.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.044 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:18.044 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.575440+0000", 2024-04-26T12:07:18.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1146000000000002e-05 2024-04-26T12:07:18.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:18.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578237+0000", 2024-04-26T12:07:18.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002796761 2024-04-26T12:07:18.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:18.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578260+0000", 2024-04-26T12:07:18.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3538999999999999e-05 2024-04-26T12:07:18.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.046 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.046 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:18.046 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578312+0000", 2024-04-26T12:07:18.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1508999999999998e-05 2024-04-26T12:07:18.046 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.046 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:18.046 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.046 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.046 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3000 3.d 3:b02ffd62:::200.00000010:head [write 3801160~9028 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:18.046 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:18.047 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 18.500187355000001, 2024-04-26T12:07:18.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.059231688999999997, 2024-04-26T12:07:18.047 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:18.047 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.047 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:18.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:18.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:18.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:18.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:18.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:18.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521606+0000", 2024-04-26T12:07:18.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:18.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.049 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:18.049 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521627+0000", 2024-04-26T12:07:18.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1129e-05 2024-04-26T12:07:18.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.049 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:18.049 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521637+0000", 2024-04-26T12:07:18.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8789999999999998e-06 2024-04-26T12:07:18.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.050 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.050 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521644+0000", 2024-04-26T12:07:18.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:07:18.050 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.050 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:18.050 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576381+0000", 2024-04-26T12:07:18.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.05473629 2024-04-26T12:07:18.050 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:18.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576451+0000", 2024-04-26T12:07:18.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0525000000000007e-05 2024-04-26T12:07:18.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:18.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580734+0000", 2024-04-26T12:07:18.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042826699999999997 2024-04-26T12:07:18.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:18.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580780+0000", 2024-04-26T12:07:18.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6006e-05 2024-04-26T12:07:18.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:18.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580839+0000", 2024-04-26T12:07:18.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8783000000000003e-05 2024-04-26T12:07:18.052 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.052 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:18.052 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.053 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3001 3.d 3:b02ffd62:::200.00000010:head [write 3810188~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:18.053 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:18.053 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 18.499635023, 2024-04-26T12:07:18.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.060161213999999998, 2024-04-26T12:07:18.053 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:18.053 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.053 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:18.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.054 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:18.054 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:18.054 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.054 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.054 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.054 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:18.054 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:18.054 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.054 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.054 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.055 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:18.055 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522158+0000", 2024-04-26T12:07:18.055 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:18.055 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.055 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.055 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:18.055 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522165+0000", 2024-04-26T12:07:18.055 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.28e-06 2024-04-26T12:07:18.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.056 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.056 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:18.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522178+0000", 2024-04-26T12:07:18.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3738e-05 2024-04-26T12:07:18.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.056 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.057 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.057 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522186+0000", 2024-04-26T12:07:18.057 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.267e-06 2024-04-26T12:07:18.057 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.057 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.057 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:18.057 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576889+0000", 2024-04-26T12:07:18.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054703442999999997 2024-04-26T12:07:18.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.058 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:18.058 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576953+0000", 2024-04-26T12:07:18.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4213000000000003e-05 2024-04-26T12:07:18.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:18.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582185+0000", 2024-04-26T12:07:18.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052319209999999996 2024-04-26T12:07:18.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:18.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582243+0000", 2024-04-26T12:07:18.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7321999999999998e-05 2024-04-26T12:07:18.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:18.060 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582321+0000", 2024-04-26T12:07:18.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7911000000000007e-05 2024-04-26T12:07:18.060 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.060 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:18.060 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.060 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.060 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3002 3.d 3:b02ffd62:::200.00000010:head [write 3812103~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:18.060 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:18.060 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 18.499166259999999, 2024-04-26T12:07:18.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.059796961000000003, 2024-04-26T12:07:18.060 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:18.061 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.061 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:18.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.061 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:18.061 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:18.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.061 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:18.061 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:18.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.062 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:18.062 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522627+0000", 2024-04-26T12:07:18.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:18.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.062 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:18.062 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522633+0000", 2024-04-26T12:07:18.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6699999999999999e-06 2024-04-26T12:07:18.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:18.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522643+0000", 2024-04-26T12:07:18.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6649999999999998e-06 2024-04-26T12:07:18.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522649+0000", 2024-04-26T12:07:18.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4200000000000004e-06 2024-04-26T12:07:18.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:18.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577413+0000", 2024-04-26T12:07:18.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054763714999999998 2024-04-26T12:07:18.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:18.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577460+0000", 2024-04-26T12:07:18.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7095000000000002e-05 2024-04-26T12:07:18.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:18.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582331+0000", 2024-04-26T12:07:18.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048716419999999998 2024-04-26T12:07:18.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:18.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582375+0000", 2024-04-26T12:07:18.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3053999999999998e-05 2024-04-26T12:07:18.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:18.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582425+0000", 2024-04-26T12:07:18.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0525000000000002e-05 2024-04-26T12:07:18.065 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.065 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:18.066 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.066 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3003 3.d 3:b02ffd62:::200.00000010:head [write 3814061~4170 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:18.066 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:18.066 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 18.498111198, 2024-04-26T12:07:18.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058803394000000002, 2024-04-26T12:07:18.066 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:18.066 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.066 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:18.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.066 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:18.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:18.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:18.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:18.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:18.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523682+0000", 2024-04-26T12:07:18.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:18.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:18.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523690+0000", 2024-04-26T12:07:18.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0290000000000005e-06 2024-04-26T12:07:18.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:18.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523699+0000", 2024-04-26T12:07:18.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4589999999999998e-06 2024-04-26T12:07:18.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523703+0000", 2024-04-26T12:07:18.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6249999999999998e-06 2024-04-26T12:07:18.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:18.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577832+0000", 2024-04-26T12:07:18.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054128883000000003 2024-04-26T12:07:18.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:18.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577878+0000", 2024-04-26T12:07:18.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5841999999999999e-05 2024-04-26T12:07:18.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:18.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582430+0000", 2024-04-26T12:07:18.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045517270000000002 2024-04-26T12:07:18.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:18.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582453+0000", 2024-04-26T12:07:18.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3609999999999999e-05 2024-04-26T12:07:18.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:18.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582487+0000", 2024-04-26T12:07:18.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3080000000000002e-05 2024-04-26T12:07:18.071 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.071 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:18.071 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.071 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3004 3.d 3:b02ffd62:::200.00000010:head [write 3818231~3890 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:18.071 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:18.071 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 18.497262275000001, 2024-04-26T12:07:18.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058024342999999999, 2024-04-26T12:07:18.071 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:18.072 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.072 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:18.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:18.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:18.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:18.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:18.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.073 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:18.073 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524531+0000", 2024-04-26T12:07:18.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:18.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.073 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:18.073 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524539+0000", 2024-04-26T12:07:18.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9249999999999995e-06 2024-04-26T12:07:18.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.073 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:18.073 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524547+0000", 2024-04-26T12:07:18.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5220000000000007e-06 2024-04-26T12:07:18.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524553+0000", 2024-04-26T12:07:18.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6659999999999996e-06 2024-04-26T12:07:18.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:18.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578335+0000", 2024-04-26T12:07:18.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.05378235 2024-04-26T12:07:18.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.075 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:18.075 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578378+0000", 2024-04-26T12:07:18.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2429999999999999e-05 2024-04-26T12:07:18.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.075 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:18.075 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582494+0000", 2024-04-26T12:07:18.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004116059 2024-04-26T12:07:18.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:18.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582519+0000", 2024-04-26T12:07:18.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4961999999999999e-05 2024-04-26T12:07:18.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:18.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582556+0000", 2024-04-26T12:07:18.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7728999999999997e-05 2024-04-26T12:07:18.076 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.076 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:18.076 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.077 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3005 3.d 3:b02ffd62:::200.00000010:head [write 3822121~5207 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:18.077 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:18.077 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 18.496843019, 2024-04-26T12:07:18.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057662270000000002, 2024-04-26T12:07:18.077 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:18.077 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.077 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:18.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:18.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:18.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:18.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:18.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:18.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:18.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:18.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.079 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:18.079 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524961+0000", 2024-04-26T12:07:18.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0124e-05 2024-04-26T12:07:18.079 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.079 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:18.079 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524971+0000", 2024-04-26T12:07:18.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0200999999999999e-05 2024-04-26T12:07:18.079 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.079 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.079 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524979+0000", 2024-04-26T12:07:18.080 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5809999999999999e-06 2024-04-26T12:07:18.080 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.080 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:18.080 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578753+0000", 2024-04-26T12:07:18.080 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053774444999999997 2024-04-26T12:07:18.080 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.080 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:18.081 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578821+0000", 2024-04-26T12:07:18.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7640999999999998e-05 2024-04-26T12:07:18.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.081 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.081 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:18.081 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582561+0000", 2024-04-26T12:07:18.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037399870000000002 2024-04-26T12:07:18.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.081 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.081 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:18.081 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582582+0000", 2024-04-26T12:07:18.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0934999999999999e-05 2024-04-26T12:07:18.082 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.082 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.082 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:18.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582614+0000", 2024-04-26T12:07:18.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1948e-05 2024-04-26T12:07:18.082 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.082 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:18.082 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.082 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.083 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.083 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3006 3.d 3:b02ffd62:::200.00000010:head [write 3827328~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:18.083 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:18.083 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 18.49620968, 2024-04-26T12:07:18.083 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057085404999999999, 2024-04-26T12:07:18.083 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:18.083 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.083 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:18.083 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.084 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:18.084 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:18.084 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.085 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.085 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.086 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:18.086 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:18.086 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.086 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.086 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:18.086 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525583+0000", 2024-04-26T12:07:18.086 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:18.087 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.087 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.087 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:18.087 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525594+0000", 2024-04-26T12:07:18.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0497e-05 2024-04-26T12:07:18.087 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.087 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.087 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:18.087 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525610+0000", 2024-04-26T12:07:18.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6392000000000002e-05 2024-04-26T12:07:18.087 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525621+0000", 2024-04-26T12:07:18.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0679999999999999e-05 2024-04-26T12:07:18.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:18.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.579270+0000", 2024-04-26T12:07:18.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053648802000000002 2024-04-26T12:07:18.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:18.089 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.579312+0000", 2024-04-26T12:07:18.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2268000000000003e-05 2024-04-26T12:07:18.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:18.089 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582618+0000", 2024-04-26T12:07:18.090 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033057049999999999 2024-04-26T12:07:18.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.090 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.090 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:18.090 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582637+0000", 2024-04-26T12:07:18.090 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9417000000000001e-05 2024-04-26T12:07:18.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.090 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.090 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:18.090 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582670+0000", 2024-04-26T12:07:18.091 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2969999999999998e-05 2024-04-26T12:07:18.091 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.091 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:18.091 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.091 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.091 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.091 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3015 3.d 3:b02ffd62:::200.00000010:head [write 3855113~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:18.091 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:18.092 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 18.485753923000001, 2024-04-26T12:07:18.092 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057652729999999999, 2024-04-26T12:07:18.092 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:18.092 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.092 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:18.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.092 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:18.092 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:18.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.093 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.093 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:18.093 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:18.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.093 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.093 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:18.094 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:18.094 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:18.094 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.094 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:18.094 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536042+0000", 2024-04-26T12:07:18.094 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0849999999999999e-06 2024-04-26T12:07:18.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:18.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536046+0000", 2024-04-26T12:07:18.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:07:18.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536048+0000", 2024-04-26T12:07:18.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6019999999999998e-06 2024-04-26T12:07:18.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.096 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:18.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585409+0000", 2024-04-26T12:07:18.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.049360938 2024-04-26T12:07:18.096 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.096 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.096 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:18.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585506+0000", 2024-04-26T12:07:18.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6966999999999995e-05 2024-04-26T12:07:18.096 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.096 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.096 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:18.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593630+0000", 2024-04-26T12:07:18.097 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0081238160000000007 2024-04-26T12:07:18.097 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.097 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.097 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:18.097 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593656+0000", 2024-04-26T12:07:18.097 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6154000000000001e-05 2024-04-26T12:07:18.097 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.097 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.097 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:18.097 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593693+0000", 2024-04-26T12:07:18.098 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7185999999999999e-05 2024-04-26T12:07:18.098 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.098 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:18.098 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.098 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.098 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.098 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3016 3.d 3:b02ffd62:::200.00000010:head [write 3857020~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:18.098 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:18.098 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 18.485743975999998, 2024-04-26T12:07:18.098 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058678157000000002, 2024-04-26T12:07:18.099 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:18.099 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.099 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:18.099 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.099 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:18.099 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:18.099 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.099 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.099 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.099 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:18.099 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:18.099 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.100 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.100 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.100 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:18.100 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:18.100 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:18.100 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.100 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.100 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:18.100 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536055+0000", 2024-04-26T12:07:18.101 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3669999999999999e-06 2024-04-26T12:07:18.101 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.101 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.101 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:18.101 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536058+0000", 2024-04-26T12:07:18.101 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3220000000000001e-06 2024-04-26T12:07:18.101 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.101 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.101 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.101 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536062+0000", 2024-04-26T12:07:18.101 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1520000000000002e-06 2024-04-26T12:07:18.101 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.101 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.102 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:18.102 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585965+0000", 2024-04-26T12:07:18.102 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.049902769999999999 2024-04-26T12:07:18.102 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.102 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.102 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:18.102 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586046+0000", 2024-04-26T12:07:18.102 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1032999999999995e-05 2024-04-26T12:07:18.102 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.102 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.102 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:18.102 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594667+0000", 2024-04-26T12:07:18.102 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0086214599999999992 2024-04-26T12:07:18.103 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.103 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.103 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:18.103 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594692+0000", 2024-04-26T12:07:18.103 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5191999999999999e-05 2024-04-26T12:07:18.103 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.103 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.103 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:18.103 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594729+0000", 2024-04-26T12:07:18.103 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6069000000000003e-05 2024-04-26T12:07:18.103 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.103 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:18.103 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.104 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.104 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.104 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3017 3.d 3:b02ffd62:::200.00000010:head [write 3859438~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:18.104 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:18.104 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 18.485729891999998, 2024-04-26T12:07:18.104 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058723814999999999, 2024-04-26T12:07:18.104 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:18.104 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.104 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:18.104 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.104 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:18.104 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:18.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.105 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:18.105 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:18.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.105 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:18.105 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:18.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:18.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.106 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:18.106 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536066+0000", 2024-04-26T12:07:18.106 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8840000000000001e-06 2024-04-26T12:07:18.106 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.106 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.106 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:18.106 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536069+0000", 2024-04-26T12:07:18.106 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:07:18.106 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.106 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.106 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.106 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536072+0000", 2024-04-26T12:07:18.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4449999999999999e-06 2024-04-26T12:07:18.107 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.107 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.107 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:18.107 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586703+0000", 2024-04-26T12:07:18.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050631618000000003 2024-04-26T12:07:18.107 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.107 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.107 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:18.107 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586748+0000", 2024-04-26T12:07:18.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4682999999999999e-05 2024-04-26T12:07:18.107 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:18.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594734+0000", 2024-04-26T12:07:18.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079860369999999996 2024-04-26T12:07:18.108 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:18.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594756+0000", 2024-04-26T12:07:18.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1738000000000001e-05 2024-04-26T12:07:18.108 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:18.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594788+0000", 2024-04-26T12:07:18.109 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2604999999999997e-05 2024-04-26T12:07:18.109 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.109 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:18.109 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.109 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.109 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.109 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3018 3.d 3:b02ffd62:::200.00000010:head [write 3861345~3221 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:18.109 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:18.109 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 18.484897204999999, 2024-04-26T12:07:18.109 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057946174000000003, 2024-04-26T12:07:18.109 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:18.109 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.109 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:18.110 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.110 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:18.110 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:18.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.110 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.110 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.110 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:18.110 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:18.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.110 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.110 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.110 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:18.111 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536896+0000", 2024-04-26T12:07:18.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:18.111 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.111 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.111 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:18.111 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536905+0000", 2024-04-26T12:07:18.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7839999999999998e-06 2024-04-26T12:07:18.111 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.111 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.111 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:18.111 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536929+0000", 2024-04-26T12:07:18.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3561999999999999e-05 2024-04-26T12:07:18.112 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.112 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.112 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.112 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536940+0000", 2024-04-26T12:07:18.112 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0742e-05 2024-04-26T12:07:18.112 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.112 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.112 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:18.112 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.587238+0000", 2024-04-26T12:07:18.112 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050297962000000002 2024-04-26T12:07:18.112 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.112 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.112 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:18.113 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.587315+0000", 2024-04-26T12:07:18.113 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7848000000000004e-05 2024-04-26T12:07:18.113 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.113 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.113 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:18.113 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594792+0000", 2024-04-26T12:07:18.113 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074766240000000003 2024-04-26T12:07:18.113 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.113 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.113 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:18.113 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594813+0000", 2024-04-26T12:07:18.114 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0876000000000001e-05 2024-04-26T12:07:18.114 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.114 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:18.114 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594843+0000", 2024-04-26T12:07:18.114 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0434999999999999e-05 2024-04-26T12:07:18.114 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.114 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:18.114 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.114 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.114 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3019 3.d 3:b02ffd62:::200.00000010:head [write 3864566~3989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:18.115 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:18.115 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 18.483154845000001, 2024-04-26T12:07:18.115 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.061000094999999997, 2024-04-26T12:07:18.115 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:18.115 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.115 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:18.115 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.115 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:18.115 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:18.115 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.115 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.116 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:18.116 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:18.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.116 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:18.116 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538638+0000", 2024-04-26T12:07:18.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999981 2024-04-26T12:07:18.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.117 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:18.117 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538669+0000", 2024-04-26T12:07:18.117 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1689000000000001e-05 2024-04-26T12:07:18.117 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.117 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.117 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:18.117 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538703+0000", 2024-04-26T12:07:18.117 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3309000000000002e-05 2024-04-26T12:07:18.117 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.117 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538746+0000", 2024-04-26T12:07:18.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2803999999999999e-05 2024-04-26T12:07:18.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:18.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.589467+0000", 2024-04-26T12:07:18.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050721912000000001 2024-04-26T12:07:18.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:18.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.589517+0000", 2024-04-26T12:07:18.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9549999999999998e-05 2024-04-26T12:07:18.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.119 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:18.119 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599577+0000", 2024-04-26T12:07:18.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010059593 2024-04-26T12:07:18.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.119 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:18.119 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599603+0000", 2024-04-26T12:07:18.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6821e-05 2024-04-26T12:07:18.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.120 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:18.120 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599640+0000", 2024-04-26T12:07:18.120 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6177999999999998e-05 2024-04-26T12:07:18.120 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.120 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:18.120 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.120 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3020 3.d 3:b02ffd62:::200.00000010:head [write 3868555~7563 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:18.120 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:18.121 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 18.480542010000001, 2024-04-26T12:07:18.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058446867, 2024-04-26T12:07:18.121 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:18.121 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.121 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:18.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.121 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:18.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:18.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.122 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.122 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.122 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:18.122 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:18.122 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.122 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.122 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.122 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:18.122 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541251+0000", 2024-04-26T12:07:18.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:18.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.123 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:18.123 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541286+0000", 2024-04-26T12:07:18.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4845999999999998e-05 2024-04-26T12:07:18.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.123 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:18.123 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541300+0000", 2024-04-26T12:07:18.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4251e-05 2024-04-26T12:07:18.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.124 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.124 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541307+0000", 2024-04-26T12:07:18.124 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3819999999999998e-06 2024-04-26T12:07:18.124 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.124 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.124 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:18.124 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.592596+0000", 2024-04-26T12:07:18.124 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051288215999999998 2024-04-26T12:07:18.124 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.125 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.125 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:18.125 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.592675+0000", 2024-04-26T12:07:18.125 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9197999999999996e-05 2024-04-26T12:07:18.125 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.125 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.125 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:18.125 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599645+0000", 2024-04-26T12:07:18.125 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069701759999999998 2024-04-26T12:07:18.125 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.126 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.126 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:18.126 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599667+0000", 2024-04-26T12:07:18.126 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2118999999999999e-05 2024-04-26T12:07:18.126 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.126 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.126 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:18.126 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599699+0000", 2024-04-26T12:07:18.127 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2048999999999998e-05 2024-04-26T12:07:18.127 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.127 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:18.127 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.127 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.127 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.127 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3021 3.d 3:b02ffd62:::200.00000010:head [write 3876118~3791 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:18.127 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:18.127 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 18.480480273000001, 2024-04-26T12:07:18.128 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058441157000000001, 2024-04-26T12:07:18.128 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:18.128 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.128 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:18.128 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.128 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:18.128 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:18.128 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.128 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.129 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.129 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:18.129 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:18.129 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.129 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.129 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.129 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:18.129 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:18.130 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:18.130 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.130 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.130 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:18.130 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541323+0000", 2024-04-26T12:07:18.130 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5510000000000005e-06 2024-04-26T12:07:18.130 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.130 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.130 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:18.131 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541327+0000", 2024-04-26T12:07:18.131 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2520000000000001e-06 2024-04-26T12:07:18.131 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.131 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.131 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.131 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541330+0000", 2024-04-26T12:07:18.131 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:07:18.131 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.132 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.132 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:18.132 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593229+0000", 2024-04-26T12:07:18.132 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051898044999999997 2024-04-26T12:07:18.132 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.132 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.132 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:18.133 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593278+0000", 2024-04-26T12:07:18.133 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9506999999999999e-05 2024-04-26T12:07:18.133 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.133 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.133 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:18.133 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599704+0000", 2024-04-26T12:07:18.133 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064259570000000004 2024-04-26T12:07:18.133 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.133 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.133 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:18.133 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599725+0000", 2024-04-26T12:07:18.134 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0562999999999999e-05 2024-04-26T12:07:18.134 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.134 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.134 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:18.134 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599755+0000", 2024-04-26T12:07:18.134 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0710000000000002e-05 2024-04-26T12:07:18.134 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.134 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:18.134 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.134 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.134 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.134 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3022 3.d 3:b02ffd62:::200.00000010:head [write 3879909~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:18.134 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:18.135 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 18.479231204000001, 2024-04-26T12:07:18.135 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057246689000000003, 2024-04-26T12:07:18.135 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:18.135 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.135 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:18.135 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.135 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:18.135 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:18.135 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.135 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.135 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.135 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:18.135 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:18.136 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.136 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.136 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.136 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:18.136 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542561+0000", 2024-04-26T12:07:18.136 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999981 2024-04-26T12:07:18.136 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.136 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.136 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:18.136 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542570+0000", 2024-04-26T12:07:18.136 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9199999999999993e-06 2024-04-26T12:07:18.136 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.137 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.137 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:18.137 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542583+0000", 2024-04-26T12:07:18.137 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2227e-05 2024-04-26T12:07:18.137 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.137 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.137 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.137 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542598+0000", 2024-04-26T12:07:18.137 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5199e-05 2024-04-26T12:07:18.137 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.137 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.137 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:18.137 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593728+0000", 2024-04-26T12:07:18.138 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051129846 2024-04-26T12:07:18.138 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.138 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.138 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:18.138 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593806+0000", 2024-04-26T12:07:18.138 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8425999999999998e-05 2024-04-26T12:07:18.138 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.138 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.138 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:18.138 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599760+0000", 2024-04-26T12:07:18.138 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0059537399999999999 2024-04-26T12:07:18.138 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.138 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.139 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:18.139 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599779+0000", 2024-04-26T12:07:18.139 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9619e-05 2024-04-26T12:07:18.139 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.139 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.139 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:18.139 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599810+0000", 2024-04-26T12:07:18.139 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0508999999999999e-05 2024-04-26T12:07:18.139 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.139 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:18.139 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.139 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.139 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.140 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3023 3.d 3:b02ffd62:::200.00000010:head [write 3881868~5748 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:18.140 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:18.140 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 18.478759356000001, 2024-04-26T12:07:18.140 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.056829994000000002, 2024-04-26T12:07:18.140 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:18.140 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.140 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:18.140 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.140 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:18.140 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:18.140 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.140 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.140 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.141 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:18.141 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:18.141 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:18.141 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.141 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.141 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:18.141 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543034+0000", 2024-04-26T12:07:18.141 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:18.141 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.141 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.141 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:18.141 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543044+0000", 2024-04-26T12:07:18.141 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0444e-05 2024-04-26T12:07:18.142 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.142 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.142 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:18.142 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543055+0000", 2024-04-26T12:07:18.142 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.096e-05 2024-04-26T12:07:18.142 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.142 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.142 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.142 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543063+0000", 2024-04-26T12:07:18.142 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2689999999999999e-06 2024-04-26T12:07:18.142 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.142 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.143 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:18.143 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594265+0000", 2024-04-26T12:07:18.143 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051201325999999998 2024-04-26T12:07:18.143 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.143 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.143 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:18.143 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594311+0000", 2024-04-26T12:07:18.143 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5918000000000003e-05 2024-04-26T12:07:18.143 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.143 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.143 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:18.143 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599815+0000", 2024-04-26T12:07:18.144 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055038370000000001 2024-04-26T12:07:18.144 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.144 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.144 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:18.144 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599834+0000", 2024-04-26T12:07:18.144 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9942e-05 2024-04-26T12:07:18.144 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:18.144 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:18.144 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:18.144 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599865+0000", 2024-04-26T12:07:18.144 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0549000000000002e-05 2024-04-26T12:07:18.144 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.144 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:18.145 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.145 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:18.145 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:18.145 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:18.146 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:18.145+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:18.147 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:07:18.247 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:18.246+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:18.252 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:18.252 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:07:18.252 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:07:18.252 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:18.261 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:07:18.349 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:18.348+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:18.402 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:18.402 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:07:18.403 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:07:18.403 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:07:18.403 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:18.411 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:07:18.449 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:18.448+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:18.513 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:18.513 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:07:18.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:07:18.513 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:07:18.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.513 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:536 3.2 3:4272d415:::200.0000000b:head [write 405817~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:18.513 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:18.513 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.986880969000001, 2024-04-26T12:07:18.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053030282999999998, 2024-04-26T12:07:18.514 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:18.514 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.514 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:18.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.514 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:18.514 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:18.514 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.514 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.514 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:18.514 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:18.514 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.514 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.515 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:18.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524136+0000", 2024-04-26T12:07:18.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:18.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.515 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:18.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524139+0000", 2024-04-26T12:07:18.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2919999999999998e-06 2024-04-26T12:07:18.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.515 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:18.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524144+0000", 2024-04-26T12:07:18.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.502e-06 2024-04-26T12:07:18.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.516 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.516 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524149+0000", 2024-04-26T12:07:18.516 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7310000000000001e-06 2024-04-26T12:07:18.516 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.516 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:18.516 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570935+0000", 2024-04-26T12:07:18.516 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.046785603000000002 2024-04-26T12:07:18.516 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.516 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:18.516 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570981+0000", 2024-04-26T12:07:18.516 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6085999999999999e-05 2024-04-26T12:07:18.516 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.517 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.517 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:18.517 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577039+0000", 2024-04-26T12:07:18.517 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060582099999999996 2024-04-26T12:07:18.517 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.517 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.517 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:18.517 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577081+0000", 2024-04-26T12:07:18.517 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1927e-05 2024-04-26T12:07:18.517 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.517 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.517 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:18.517 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577167+0000", 2024-04-26T12:07:18.517 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6311999999999996e-05 2024-04-26T12:07:18.518 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.518 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:18.518 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.518 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.518 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.518 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:537 3.2 3:4272d415:::200.0000000b:head [write 407216~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:18.518 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:18.518 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.986865031000001, 2024-04-26T12:07:18.518 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053131411000000003, 2024-04-26T12:07:18.518 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:18.518 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.518 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:18.518 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:18.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:18.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:18.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:18.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:18.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524152+0000", 2024-04-26T12:07:18.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:18.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:18.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524157+0000", 2024-04-26T12:07:18.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3529999999999997e-06 2024-04-26T12:07:18.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:18.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524162+0000", 2024-04-26T12:07:18.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5910000000000003e-06 2024-04-26T12:07:18.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524170+0000", 2024-04-26T12:07:18.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:07:18.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:18.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571323+0000", 2024-04-26T12:07:18.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047153289000000001 2024-04-26T12:07:18.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:18.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571367+0000", 2024-04-26T12:07:18.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4205000000000001e-05 2024-04-26T12:07:18.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:18.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577174+0000", 2024-04-26T12:07:18.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058072250000000001 2024-04-26T12:07:18.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.522 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:18.522 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577218+0000", 2024-04-26T12:07:18.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3294999999999998e-05 2024-04-26T12:07:18.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.522 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:18.522 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577284+0000", 2024-04-26T12:07:18.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6483999999999996e-05 2024-04-26T12:07:18.522 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.522 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:18.522 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.522 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:538 3.2 3:4272d415:::200.0000000b:head [write 408629~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:18.523 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:18.523 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.986844331, 2024-04-26T12:07:18.523 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053241841999999998, 2024-04-26T12:07:18.523 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:18.523 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.523 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:18.523 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.523 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:18.523 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:18.523 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.523 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.523 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.523 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:18.523 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:18.523 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.524 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.524 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.524 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:18.524 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:18.524 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:18.524 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.524 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.524 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:18.524 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524178+0000", 2024-04-26T12:07:18.524 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1420000000000001e-06 2024-04-26T12:07:18.524 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.524 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.524 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:18.524 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524184+0000", 2024-04-26T12:07:18.525 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4240000000000001e-06 2024-04-26T12:07:18.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.525 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.525 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.525 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524188+0000", 2024-04-26T12:07:18.525 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2710000000000003e-06 2024-04-26T12:07:18.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.525 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.525 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:18.525 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571623+0000", 2024-04-26T12:07:18.525 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047435119999999997 2024-04-26T12:07:18.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.525 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.525 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:18.525 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571668+0000", 2024-04-26T12:07:18.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5377000000000003e-05 2024-04-26T12:07:18.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:18.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577292+0000", 2024-04-26T12:07:18.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0056232030000000002 2024-04-26T12:07:18.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:18.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577330+0000", 2024-04-26T12:07:18.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8748999999999998e-05 2024-04-26T12:07:18.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:18.527 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577415+0000", 2024-04-26T12:07:18.527 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4913000000000005e-05 2024-04-26T12:07:18.527 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.527 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:18.527 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.527 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.527 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.527 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:539 3.2 3:4272d415:::200.0000000b:head [write 410547~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:18.527 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:18.527 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.986826198999999, 2024-04-26T12:07:18.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053372670999999997, 2024-04-26T12:07:18.528 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:18.528 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.528 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:18.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:18.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:18.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:18.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:18.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.529 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:18.529 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524191+0000", 2024-04-26T12:07:18.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:18.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.529 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:18.529 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524199+0000", 2024-04-26T12:07:18.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6520000000000006e-06 2024-04-26T12:07:18.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.529 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:18.529 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524205+0000", 2024-04-26T12:07:18.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:07:18.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.530 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.530 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524209+0000", 2024-04-26T12:07:18.530 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.335e-06 2024-04-26T12:07:18.530 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.530 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:18.530 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572320+0000", 2024-04-26T12:07:18.530 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048110992999999998 2024-04-26T12:07:18.530 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.530 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:18.530 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572364+0000", 2024-04-26T12:07:18.530 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4577999999999999e-05 2024-04-26T12:07:18.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:18.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577426+0000", 2024-04-26T12:07:18.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050615139999999996 2024-04-26T12:07:18.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:18.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577480+0000", 2024-04-26T12:07:18.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3599e-05 2024-04-26T12:07:18.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:18.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577564+0000", 2024-04-26T12:07:18.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4699999999999999e-05 2024-04-26T12:07:18.532 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.532 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:18.532 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.532 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:540 3.2 3:4272d415:::200.0000000b:head [write 411948~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:18.532 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:18.532 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.986805181000001, 2024-04-26T12:07:18.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053497045999999999, 2024-04-26T12:07:18.532 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:18.532 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.532 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:18.533 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.533 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:18.533 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:18.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.533 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.533 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.533 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:18.533 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:18.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.533 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.533 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.533 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:18.533 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524212+0000", 2024-04-26T12:07:18.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:18.533 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.534 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:18.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524215+0000", 2024-04-26T12:07:18.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.559e-06 2024-04-26T12:07:18.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.534 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:18.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524220+0000", 2024-04-26T12:07:18.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2920000000000003e-06 2024-04-26T12:07:18.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.534 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524224+0000", 2024-04-26T12:07:18.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3680000000000004e-06 2024-04-26T12:07:18.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:18.535 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572619+0000", 2024-04-26T12:07:18.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048394549000000002 2024-04-26T12:07:18.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:18.535 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572669+0000", 2024-04-26T12:07:18.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0249e-05 2024-04-26T12:07:18.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:18.535 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577575+0000", 2024-04-26T12:07:18.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049053329999999996 2024-04-26T12:07:18.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:18.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577625+0000", 2024-04-26T12:07:18.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0274e-05 2024-04-26T12:07:18.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:18.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577710+0000", 2024-04-26T12:07:18.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4741999999999996e-05 2024-04-26T12:07:18.536 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.536 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:18.536 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.536 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:543 3.2 3:4272d415:::200.0000000b:head [write 413907~2485 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:18.537 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:18.537 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.986735487000001, 2024-04-26T12:07:18.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053578708000000003, 2024-04-26T12:07:18.537 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:18.537 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.537 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:18.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.537 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:18.537 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:18.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.537 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.537 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:18.537 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:18.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:18.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:18.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:18.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:18.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524287+0000", 2024-04-26T12:07:18.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2190000000000003e-06 2024-04-26T12:07:18.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:18.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524294+0000", 2024-04-26T12:07:18.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5660000000000003e-06 2024-04-26T12:07:18.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.539 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.539 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524298+0000", 2024-04-26T12:07:18.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3900000000000003e-06 2024-04-26T12:07:18.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.539 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:18.539 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572992+0000", 2024-04-26T12:07:18.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048693835999999997 2024-04-26T12:07:18.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.539 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:18.539 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573045+0000", 2024-04-26T12:07:18.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2793000000000001e-05 2024-04-26T12:07:18.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.540 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:18.540 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577721+0000", 2024-04-26T12:07:18.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046760550000000001 2024-04-26T12:07:18.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.540 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:18.540 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577777+0000", 2024-04-26T12:07:18.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5908000000000001e-05 2024-04-26T12:07:18.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.540 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:18.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577861+0000", 2024-04-26T12:07:18.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4337000000000002e-05 2024-04-26T12:07:18.541 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.541 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:18.541 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.541 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:544 3.2 3:4272d415:::200.0000000b:head [write 416392~3872 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:18.541 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:18.541 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.986715765, 2024-04-26T12:07:18.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054810527999999997, 2024-04-26T12:07:18.541 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:18.541 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.541 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:18.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:18.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:18.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:18.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:18.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:18.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:18.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:18.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:18.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524307+0000", 2024-04-26T12:07:18.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1580000000000004e-06 2024-04-26T12:07:18.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:18.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524312+0000", 2024-04-26T12:07:18.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6380000000000001e-06 2024-04-26T12:07:18.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524317+0000", 2024-04-26T12:07:18.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4000000000000002e-06 2024-04-26T12:07:18.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.544 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:18.544 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573348+0000", 2024-04-26T12:07:18.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049031433999999999 2024-04-26T12:07:18.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.544 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:18.544 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573393+0000", 2024-04-26T12:07:18.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4536999999999997e-05 2024-04-26T12:07:18.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.545 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:18.545 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578978+0000", 2024-04-26T12:07:18.545 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055848299999999998 2024-04-26T12:07:18.545 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.545 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.545 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:18.545 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579031+0000", 2024-04-26T12:07:18.545 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3708000000000001e-05 2024-04-26T12:07:18.545 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.545 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.545 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:18.545 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579113+0000", 2024-04-26T12:07:18.545 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1258e-05 2024-04-26T12:07:18.545 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.545 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:18.546 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.546 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.546 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.546 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:545 3.2 3:4272d415:::200.0000000b:head [write 420264~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:18.546 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:18.546 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.986697139, 2024-04-26T12:07:18.546 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054927386000000002, 2024-04-26T12:07:18.546 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:18.546 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.546 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:18.546 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.546 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:18.546 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:18.546 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:18.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:18.547 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:18.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524320+0000", 2024-04-26T12:07:18.547 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:18.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:18.548 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524325+0000", 2024-04-26T12:07:18.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5249999999999999e-06 2024-04-26T12:07:18.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.548 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.548 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:18.548 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524330+0000", 2024-04-26T12:07:18.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5629999999999999e-06 2024-04-26T12:07:18.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.548 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.548 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.548 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524335+0000", 2024-04-26T12:07:18.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.685e-06 2024-04-26T12:07:18.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.548 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.548 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:18.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573727+0000", 2024-04-26T12:07:18.549 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049392034000000001 2024-04-26T12:07:18.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.549 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:18.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573775+0000", 2024-04-26T12:07:18.549 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7435999999999998e-05 2024-04-26T12:07:18.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.549 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:18.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579120+0000", 2024-04-26T12:07:18.549 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0053452949999999999 2024-04-26T12:07:18.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.549 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:18.550 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579167+0000", 2024-04-26T12:07:18.550 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7240000000000002e-05 2024-04-26T12:07:18.550 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.550 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.550 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:18.550 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579248+0000", 2024-04-26T12:07:18.550 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0947999999999998e-05 2024-04-26T12:07:18.550 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.550 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:18.550 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.550 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.550 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.550 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 422222~8537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:18.551 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:18.551 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.986678822000002, 2024-04-26T12:07:18.551 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055065936000000003, 2024-04-26T12:07:18.551 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:18.551 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.551 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:18.551 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.551 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:18.551 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:18.551 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.551 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.551 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.551 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:18.551 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:18.551 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.551 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.552 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.552 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:18.552 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:18.552 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:18.552 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.552 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.552 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:18.552 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524347+0000", 2024-04-26T12:07:18.552 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7129999999999994e-06 2024-04-26T12:07:18.552 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.552 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.552 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:18.552 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524357+0000", 2024-04-26T12:07:18.552 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0232e-05 2024-04-26T12:07:18.553 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.553 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.553 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.553 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524362+0000", 2024-04-26T12:07:18.553 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:07:18.553 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.553 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.553 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:18.553 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574119+0000", 2024-04-26T12:07:18.553 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049756727000000001 2024-04-26T12:07:18.553 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.553 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.553 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:18.553 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574166+0000", 2024-04-26T12:07:18.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7086000000000003e-05 2024-04-26T12:07:18.554 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.554 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.554 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:18.554 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579261+0000", 2024-04-26T12:07:18.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050948310000000002 2024-04-26T12:07:18.554 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.554 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.554 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:18.554 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579316+0000", 2024-04-26T12:07:18.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5068000000000002e-05 2024-04-26T12:07:18.554 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.555 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:18.555 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579405+0000", 2024-04-26T12:07:18.555 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9251000000000003e-05 2024-04-26T12:07:18.555 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.555 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:18.555 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.555 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.555 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 430759~2035 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:18.555 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:18.555 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.986651832, 2024-04-26T12:07:18.555 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055164950999999997, 2024-04-26T12:07:18.555 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:18.556 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.556 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:18.556 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.556 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:18.556 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:18.556 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.556 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.556 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:18.556 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:18.556 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.556 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.556 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:18.557 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:18.557 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:18.557 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.557 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.557 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:18.557 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524368+0000", 2024-04-26T12:07:18.557 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.57e-06 2024-04-26T12:07:18.557 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.557 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.557 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:18.557 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524375+0000", 2024-04-26T12:07:18.557 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6170000000000003e-06 2024-04-26T12:07:18.557 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.557 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.557 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.557 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524380+0000", 2024-04-26T12:07:18.558 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2700000000000004e-06 2024-04-26T12:07:18.558 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.558 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.558 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:18.558 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574639+0000", 2024-04-26T12:07:18.558 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050259459999999999 2024-04-26T12:07:18.558 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.558 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.558 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:18.558 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574687+0000", 2024-04-26T12:07:18.558 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7608999999999998e-05 2024-04-26T12:07:18.558 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.558 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.558 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:18.559 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579414+0000", 2024-04-26T12:07:18.559 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047268750000000002 2024-04-26T12:07:18.559 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.559 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.559 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:18.559 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579456+0000", 2024-04-26T12:07:18.559 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1885000000000003e-05 2024-04-26T12:07:18.559 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.559 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.559 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:18.559 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579531+0000", 2024-04-26T12:07:18.559 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5053000000000001e-05 2024-04-26T12:07:18.559 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.559 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:18.560 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.560 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.560 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.560 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 432794~10523 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:18.560 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:18.560 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.985661107999999, 2024-04-26T12:07:18.560 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054314727, 2024-04-26T12:07:18.560 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:18.560 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.560 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:18.560 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.560 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:18.560 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:18.560 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.561 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.561 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.561 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:18.561 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:18.561 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.561 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.561 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.561 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:18.561 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525356+0000", 2024-04-26T12:07:18.561 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:18.561 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.561 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.561 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:18.561 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525414+0000", 2024-04-26T12:07:18.562 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8148e-05 2024-04-26T12:07:18.562 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.562 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.562 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:18.562 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525423+0000", 2024-04-26T12:07:18.562 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9749999999999996e-06 2024-04-26T12:07:18.562 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.562 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.562 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.562 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525428+0000", 2024-04-26T12:07:18.562 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0270000000000003e-06 2024-04-26T12:07:18.562 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.562 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.562 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:18.563 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574950+0000", 2024-04-26T12:07:18.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049521840999999997 2024-04-26T12:07:18.563 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.563 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.563 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:18.563 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575002+0000", 2024-04-26T12:07:18.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1586999999999999e-05 2024-04-26T12:07:18.563 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.563 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.563 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:18.563 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579543+0000", 2024-04-26T12:07:18.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045416340000000001 2024-04-26T12:07:18.563 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.563 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.563 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:18.564 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579587+0000", 2024-04-26T12:07:18.564 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3875999999999998e-05 2024-04-26T12:07:18.564 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.564 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.564 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:18.564 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579671+0000", 2024-04-26T12:07:18.564 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4351999999999995e-05 2024-04-26T12:07:18.564 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.564 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:18.564 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.564 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.564 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.564 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 443317~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:18.564 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:18.564 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.985585133000001, 2024-04-26T12:07:18.565 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054381889000000003, 2024-04-26T12:07:18.565 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:18.565 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.565 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:18.565 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.565 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:18.565 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:18.565 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.565 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.565 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.565 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:18.565 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:18.565 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.565 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.566 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.566 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:18.566 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525432+0000", 2024-04-26T12:07:18.566 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:18.566 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.566 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.566 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:18.566 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525435+0000", 2024-04-26T12:07:18.566 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3070000000000001e-06 2024-04-26T12:07:18.566 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.566 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.566 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:18.566 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525439+0000", 2024-04-26T12:07:18.566 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.104e-06 2024-04-26T12:07:18.566 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.567 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.567 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.567 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525442+0000", 2024-04-26T12:07:18.567 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0460000000000001e-06 2024-04-26T12:07:18.567 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.567 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.567 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:18.567 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575405+0000", 2024-04-26T12:07:18.567 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049963059999999997 2024-04-26T12:07:18.567 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.567 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.567 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:18.567 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575450+0000", 2024-04-26T12:07:18.567 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5034000000000003e-05 2024-04-26T12:07:18.568 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.568 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.568 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:18.568 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579680+0000", 2024-04-26T12:07:18.568 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042302260000000001 2024-04-26T12:07:18.568 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.568 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.568 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:18.568 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579737+0000", 2024-04-26T12:07:18.568 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7241000000000003e-05 2024-04-26T12:07:18.568 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.568 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.568 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:18.568 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579815+0000", 2024-04-26T12:07:18.569 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7278000000000001e-05 2024-04-26T12:07:18.569 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.569 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:18.569 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.569 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.569 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.569 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 445275~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:18.569 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:18.569 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.985157956999998, 2024-04-26T12:07:18.569 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054094668999999998, 2024-04-26T12:07:18.569 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:18.569 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.569 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:18.569 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.569 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:18.570 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:18.570 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.570 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.570 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.570 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:18.570 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:18.570 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.570 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.570 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.570 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:18.570 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525859+0000", 2024-04-26T12:07:18.570 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:18.570 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.570 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.570 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:18.571 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525864+0000", 2024-04-26T12:07:18.571 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:07:18.571 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.571 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.571 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:18.571 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525872+0000", 2024-04-26T12:07:18.571 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6790000000000005e-06 2024-04-26T12:07:18.571 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.571 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.571 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.571 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525877+0000", 2024-04-26T12:07:18.571 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0529999999999997e-06 2024-04-26T12:07:18.571 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.571 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.572 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:18.572 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575723+0000", 2024-04-26T12:07:18.572 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049846469999999997 2024-04-26T12:07:18.572 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.572 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.572 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:18.572 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575770+0000", 2024-04-26T12:07:18.572 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6387999999999997e-05 2024-04-26T12:07:18.572 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.572 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.572 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:18.572 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579823+0000", 2024-04-26T12:07:18.572 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0040534189999999999 2024-04-26T12:07:18.572 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.573 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.573 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:18.573 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579869+0000", 2024-04-26T12:07:18.573 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6218999999999999e-05 2024-04-26T12:07:18.573 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.573 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.573 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:18.573 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579954+0000", 2024-04-26T12:07:18.573 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5315999999999994e-05 2024-04-26T12:07:18.573 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.573 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:18.573 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.573 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.573 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.573 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:551 3.2 3:4272d415:::200.0000000b:head [write 448232~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:18.574 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:18.574 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.984710523, 2024-04-26T12:07:18.574 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053798273000000001, 2024-04-26T12:07:18.574 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:18.574 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.574 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:18.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.574 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:18.574 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:18.574 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.574 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.574 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:18.574 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:18.575 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.575 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.575 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.575 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:18.575 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:18.575 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:18.575 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.575 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.575 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:18.575 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526310+0000", 2024-04-26T12:07:18.575 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5279999999999999e-06 2024-04-26T12:07:18.575 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.575 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.575 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:18.575 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526317+0000", 2024-04-26T12:07:18.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8430000000000004e-06 2024-04-26T12:07:18.576 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.576 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.576 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.576 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526322+0000", 2024-04-26T12:07:18.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3340000000000001e-06 2024-04-26T12:07:18.576 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.576 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.576 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:18.576 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576135+0000", 2024-04-26T12:07:18.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049812113999999998 2024-04-26T12:07:18.576 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.576 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.576 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:18.576 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576186+0000", 2024-04-26T12:07:18.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1443999999999997e-05 2024-04-26T12:07:18.577 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.577 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.577 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:18.577 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579962+0000", 2024-04-26T12:07:18.577 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037763359999999999 2024-04-26T12:07:18.577 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.577 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.577 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:18.577 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580016+0000", 2024-04-26T12:07:18.577 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3421000000000002e-05 2024-04-26T12:07:18.577 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.577 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.577 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:18.577 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580106+0000", 2024-04-26T12:07:18.578 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9790000000000006e-05 2024-04-26T12:07:18.578 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.578 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:18.578 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.578 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.578 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.578 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 450189~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:18.578 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:18.578 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.984630394, 2024-04-26T12:07:18.578 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055070796999999998, 2024-04-26T12:07:18.578 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:18.578 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.578 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:18.578 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.579 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:18.579 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:18.579 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.579 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.579 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.579 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:18.579 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:18.579 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.579 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.579 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.579 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:18.579 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:18.579 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:18.579 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.579 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.580 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:18.580 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526390+0000", 2024-04-26T12:07:18.580 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8559999999999998e-06 2024-04-26T12:07:18.580 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.580 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.580 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:18.580 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526395+0000", 2024-04-26T12:07:18.580 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3319999999999999e-06 2024-04-26T12:07:18.580 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.580 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.580 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.580 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526399+0000", 2024-04-26T12:07:18.580 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.619e-06 2024-04-26T12:07:18.580 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.581 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.581 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:18.581 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576476+0000", 2024-04-26T12:07:18.581 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050077643999999998 2024-04-26T12:07:18.581 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.581 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.581 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:18.581 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576524+0000", 2024-04-26T12:07:18.581 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7184000000000001e-05 2024-04-26T12:07:18.581 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.581 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.581 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:18.581 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581347+0000", 2024-04-26T12:07:18.581 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0048231919999999996 2024-04-26T12:07:18.582 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.582 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.582 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:18.582 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581398+0000", 2024-04-26T12:07:18.582 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1345999999999999e-05 2024-04-26T12:07:18.582 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.582 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.582 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:18.582 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581458+0000", 2024-04-26T12:07:18.582 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0081000000000003e-05 2024-04-26T12:07:18.582 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.582 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:18.582 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.582 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.582 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.583 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 452113~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:18.583 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:18.583 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.984519177999999, 2024-04-26T12:07:18.583 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055041448, 2024-04-26T12:07:18.583 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:18.583 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.583 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:18.583 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.583 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:18.583 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:18.583 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.583 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.583 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.583 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:18.583 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:18.584 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.584 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.584 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.584 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:18.584 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526498+0000", 2024-04-26T12:07:18.584 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:18.584 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.584 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.584 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:18.584 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526540+0000", 2024-04-26T12:07:18.584 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2267e-05 2024-04-26T12:07:18.584 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.584 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.584 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:18.585 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526547+0000", 2024-04-26T12:07:18.585 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7000000000000002e-06 2024-04-26T12:07:18.585 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.585 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.585 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.585 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526550+0000", 2024-04-26T12:07:18.585 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0299999999999998e-06 2024-04-26T12:07:18.585 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.585 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.585 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:18.585 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577902+0000", 2024-04-26T12:07:18.585 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051351648999999999 2024-04-26T12:07:18.585 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.585 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.585 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:18.586 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577953+0000", 2024-04-26T12:07:18.586 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1289000000000003e-05 2024-04-26T12:07:18.586 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.586 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.586 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:18.586 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581464+0000", 2024-04-26T12:07:18.586 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035111259999999998 2024-04-26T12:07:18.586 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.586 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.586 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:18.586 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581490+0000", 2024-04-26T12:07:18.586 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5717000000000001e-05 2024-04-26T12:07:18.586 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.587 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.587 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:18.587 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581540+0000", 2024-04-26T12:07:18.587 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0287999999999997e-05 2024-04-26T12:07:18.587 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.587 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:18.587 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.587 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.587 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.587 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 454070~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:18.587 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:18.587 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.983962228999999, 2024-04-26T12:07:18.587 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054564161, 2024-04-26T12:07:18.587 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:18.587 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.588 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:18.588 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.588 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:18.588 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:18.588 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.588 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.588 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.588 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:18.588 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:18.588 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.589 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.589 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.589 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:18.589 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527055+0000", 2024-04-26T12:07:18.589 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:18.589 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.589 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.589 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:18.589 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527058+0000", 2024-04-26T12:07:18.589 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9890000000000001e-06 2024-04-26T12:07:18.589 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.589 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.589 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:18.589 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527066+0000", 2024-04-26T12:07:18.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4730000000000003e-06 2024-04-26T12:07:18.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.590 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527069+0000", 2024-04-26T12:07:18.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5810000000000001e-06 2024-04-26T12:07:18.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:18.590 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578308+0000", 2024-04-26T12:07:18.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051238911999999998 2024-04-26T12:07:18.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:18.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578391+0000", 2024-04-26T12:07:18.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2713999999999994e-05 2024-04-26T12:07:18.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:18.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581548+0000", 2024-04-26T12:07:18.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031577530000000001 2024-04-26T12:07:18.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:18.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581574+0000", 2024-04-26T12:07:18.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5350999999999998e-05 2024-04-26T12:07:18.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.592 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.592 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:18.592 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581620+0000", 2024-04-26T12:07:18.592 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5868999999999997e-05 2024-04-26T12:07:18.592 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.592 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:18.592 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.592 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.592 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.592 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 456028~3870 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:18.592 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:18.592 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.982205987, 2024-04-26T12:07:18.593 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055118997000000003, 2024-04-26T12:07:18.593 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:18.593 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.593 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:18.593 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.593 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:18.594 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:18.594 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.594 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.594 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.594 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:18.594 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:18.594 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.594 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.594 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.594 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:18.594 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528811+0000", 2024-04-26T12:07:18.594 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:18.594 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.595 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.595 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:18.595 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528887+0000", 2024-04-26T12:07:18.595 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5977999999999997e-05 2024-04-26T12:07:18.595 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.595 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.595 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:18.595 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528897+0000", 2024-04-26T12:07:18.595 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8730000000000002e-06 2024-04-26T12:07:18.595 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.595 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.595 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.595 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528901+0000", 2024-04-26T12:07:18.595 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4880000000000001e-06 2024-04-26T12:07:18.596 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.596 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.596 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:18.596 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580146+0000", 2024-04-26T12:07:18.596 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051244242000000002 2024-04-26T12:07:18.596 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.596 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.596 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:18.596 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580227+0000", 2024-04-26T12:07:18.596 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1044000000000005e-05 2024-04-26T12:07:18.596 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.596 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.596 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:18.596 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583864+0000", 2024-04-26T12:07:18.597 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036374419999999998 2024-04-26T12:07:18.597 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.597 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.597 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:18.597 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583894+0000", 2024-04-26T12:07:18.597 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9828999999999999e-05 2024-04-26T12:07:18.597 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.597 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.597 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:18.597 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583931+0000", 2024-04-26T12:07:18.597 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6908e-05 2024-04-26T12:07:18.597 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.597 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:18.597 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.597 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.598 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.598 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 459898~2037 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:18.598 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:18.598 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.981817996, 2024-04-26T12:07:18.598 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055925713000000002, 2024-04-26T12:07:18.598 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:18.598 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.598 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:18.598 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.598 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:18.598 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:18.598 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.598 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.599 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.599 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:18.599 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:18.599 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.599 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.599 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.599 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:18.599 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529199+0000", 2024-04-26T12:07:18.599 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:18.599 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.599 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.599 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:18.599 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529203+0000", 2024-04-26T12:07:18.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:07:18.600 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.600 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.600 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:18.600 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529209+0000", 2024-04-26T12:07:18.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7939999999999999e-06 2024-04-26T12:07:18.600 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.600 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.600 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.600 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529212+0000", 2024-04-26T12:07:18.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7290000000000002e-06 2024-04-26T12:07:18.600 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.600 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.600 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:18.600 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580784+0000", 2024-04-26T12:07:18.601 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051572073000000003 2024-04-26T12:07:18.601 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.601 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.601 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:18.601 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580883+0000", 2024-04-26T12:07:18.601 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8330000000000002e-05 2024-04-26T12:07:18.601 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.602 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.602 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:18.602 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585050+0000", 2024-04-26T12:07:18.602 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041670209999999999 2024-04-26T12:07:18.602 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.602 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.602 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:18.602 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585088+0000", 2024-04-26T12:07:18.602 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8559999999999997e-05 2024-04-26T12:07:18.603 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.603 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.603 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:18.603 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585125+0000", 2024-04-26T12:07:18.603 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7197999999999999e-05 2024-04-26T12:07:18.603 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.603 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:18.603 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.603 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.603 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.603 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 461935~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:18.603 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:18.603 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.981095541999998, 2024-04-26T12:07:18.603 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055266150999999999, 2024-04-26T12:07:18.603 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:18.604 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:18.604 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:18.604 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.604 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:18.604 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:18.604 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.604 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.604 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.604 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:18.604 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:18.604 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:18.604 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.604 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.604 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:18.604 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529921+0000", 2024-04-26T12:07:18.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:18.605 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.605 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.605 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:18.605 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529956+0000", 2024-04-26T12:07:18.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4687000000000002e-05 2024-04-26T12:07:18.605 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.605 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.605 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:18.605 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529966+0000", 2024-04-26T12:07:18.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0392e-05 2024-04-26T12:07:18.605 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.605 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.605 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:18.605 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529978+0000", 2024-04-26T12:07:18.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1348e-05 2024-04-26T12:07:18.606 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.606 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:18.606 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581659+0000", 2024-04-26T12:07:18.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051681454000000002 2024-04-26T12:07:18.606 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.606 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:18.606 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581746+0000", 2024-04-26T12:07:18.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6305999999999997e-05 2024-04-26T12:07:18.606 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.606 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:18.606 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585131+0000", 2024-04-26T12:07:18.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033853199999999998 2024-04-26T12:07:18.607 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.607 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.607 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:18.607 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585154+0000", 2024-04-26T12:07:18.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3258999999999999e-05 2024-04-26T12:07:18.607 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:18.607 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:18.607 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:18.607 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585188+0000", 2024-04-26T12:07:18.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4236000000000002e-05 2024-04-26T12:07:18.607 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.607 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:18.607 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.607 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:18.608 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:18.608 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:18.608 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:07:18.610 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:07:18.610 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:18.608+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:18.709 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:18.708+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:18.718 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:18.719 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:18.719 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:07:18.719 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:18.728 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:18.743 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:07:18.743 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:07:18.743 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:07:18.761 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:07:18.762 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:07:18.765 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:07:18.765 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:07:18.813 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:18.812+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:18.870 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:18.871 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:18.880 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:18.912 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:18.912+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:19.013 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:19.012+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:19.022 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:19.022 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:19.031 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:07:19.114 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:19.113+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:19.135 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:19.135 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:19.144 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:07:19.228 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:19.227+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:19.285 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:19.285 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:19.293 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:07:19.335 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:19.333+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:19.417 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:19.415+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:19.435 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:19.435 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:19.443 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:07:19.518 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:19.517+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:19.545 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:19.545 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:19.554 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:19.619 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:19.618+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:19.696 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:19.696 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:19.698 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:07:19.704 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:19.719 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:19.718+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:19.807 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:19.808 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:19.817 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:07:19.820 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:19.819+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:19.921 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:19.922 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:19.922 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:19.921+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:19.929 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:07:20.023 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:20.022+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:20.071 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:20.071 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:20.080 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:07:20.124 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:20.123+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:20.181 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:20.181 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:20.189 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:07:20.233 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:20.232+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:20.293 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:20.293 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:20.302 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:20.343 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:20.342+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:20.427 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:20.426+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:20.444 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:20.444 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:20.453 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:20.528 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:20.528+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:20.554 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:20.555 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:20.563 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:07:20.588 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-26T12:07:20.629 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:20.628+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:20.666 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:20.666 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:20.674 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:07:20.730 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:20.729+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:20.767 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:07:20.775 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-04-26T12:07:20.775 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:07:20.783 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:07:20.867 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:20.866+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:20.897 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T12:07:20.897 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:07:20.897 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:07:20.915 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T12:07:20.916 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:07:20.918 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:07:20.919 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:07:20.927 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:20.927 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:07:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:07:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:07:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:536 3.2 3:4272d415:::200.0000000b:head [write 405817~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.401415914000001, 2024-04-26T12:07:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053030282999999998, 2024-04-26T12:07:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:20.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:20.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524136+0000", 2024-04-26T12:07:20.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:20.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:20.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524139+0000", 2024-04-26T12:07:20.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2919999999999998e-06 2024-04-26T12:07:20.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524144+0000", 2024-04-26T12:07:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.502e-06 2024-04-26T12:07:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524149+0000", 2024-04-26T12:07:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7310000000000001e-06 2024-04-26T12:07:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:20.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570935+0000", 2024-04-26T12:07:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.046785603000000002 2024-04-26T12:07:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570981+0000", 2024-04-26T12:07:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6085999999999999e-05 2024-04-26T12:07:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577039+0000", 2024-04-26T12:07:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060582099999999996 2024-04-26T12:07:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:20.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577081+0000", 2024-04-26T12:07:20.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1927e-05 2024-04-26T12:07:20.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:20.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577167+0000", 2024-04-26T12:07:20.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6311999999999996e-05 2024-04-26T12:07:20.934 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.934 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:537 3.2 3:4272d415:::200.0000000b:head [write 407216~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.401399976, 2024-04-26T12:07:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053131411000000003, 2024-04-26T12:07:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:20.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524152+0000", 2024-04-26T12:07:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:20.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524157+0000", 2024-04-26T12:07:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3529999999999997e-06 2024-04-26T12:07:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524162+0000", 2024-04-26T12:07:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5910000000000003e-06 2024-04-26T12:07:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524170+0000", 2024-04-26T12:07:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:07:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:20.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571323+0000", 2024-04-26T12:07:20.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047153289000000001 2024-04-26T12:07:20.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:20.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571367+0000", 2024-04-26T12:07:20.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4205000000000001e-05 2024-04-26T12:07:20.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:20.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577174+0000", 2024-04-26T12:07:20.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058072250000000001 2024-04-26T12:07:20.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:20.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577218+0000", 2024-04-26T12:07:20.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3294999999999998e-05 2024-04-26T12:07:20.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:20.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577284+0000", 2024-04-26T12:07:20.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6483999999999996e-05 2024-04-26T12:07:20.940 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.941 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:20.941 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.941 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:538 3.2 3:4272d415:::200.0000000b:head [write 408629~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:20.941 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:20.941 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.401379276, 2024-04-26T12:07:20.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053241841999999998, 2024-04-26T12:07:20.941 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:20.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:20.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:20.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:20.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:20.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:20.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524178+0000", 2024-04-26T12:07:20.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1420000000000001e-06 2024-04-26T12:07:20.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:20.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524184+0000", 2024-04-26T12:07:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4240000000000001e-06 2024-04-26T12:07:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524188+0000", 2024-04-26T12:07:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2710000000000003e-06 2024-04-26T12:07:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571623+0000", 2024-04-26T12:07:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047435119999999997 2024-04-26T12:07:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571668+0000", 2024-04-26T12:07:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5377000000000003e-05 2024-04-26T12:07:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577292+0000", 2024-04-26T12:07:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0056232030000000002 2024-04-26T12:07:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577330+0000", 2024-04-26T12:07:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8748999999999998e-05 2024-04-26T12:07:20.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577415+0000", 2024-04-26T12:07:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4913000000000005e-05 2024-04-26T12:07:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:539 3.2 3:4272d415:::200.0000000b:head [write 410547~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.401361143999999, 2024-04-26T12:07:20.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053372670999999997, 2024-04-26T12:07:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524191+0000", 2024-04-26T12:07:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524199+0000", 2024-04-26T12:07:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6520000000000006e-06 2024-04-26T12:07:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524205+0000", 2024-04-26T12:07:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:07:20.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524209+0000", 2024-04-26T12:07:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.335e-06 2024-04-26T12:07:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572320+0000", 2024-04-26T12:07:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048110992999999998 2024-04-26T12:07:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572364+0000", 2024-04-26T12:07:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4577999999999999e-05 2024-04-26T12:07:20.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577426+0000", 2024-04-26T12:07:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050615139999999996 2024-04-26T12:07:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577480+0000", 2024-04-26T12:07:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3599e-05 2024-04-26T12:07:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577564+0000", 2024-04-26T12:07:20.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4699999999999999e-05 2024-04-26T12:07:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:540 3.2 3:4272d415:::200.0000000b:head [write 411948~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.401340126000001, 2024-04-26T12:07:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053497045999999999, 2024-04-26T12:07:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:20.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524212+0000", 2024-04-26T12:07:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524215+0000", 2024-04-26T12:07:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.559e-06 2024-04-26T12:07:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524220+0000", 2024-04-26T12:07:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2920000000000003e-06 2024-04-26T12:07:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524224+0000", 2024-04-26T12:07:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3680000000000004e-06 2024-04-26T12:07:20.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572619+0000", 2024-04-26T12:07:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048394549000000002 2024-04-26T12:07:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572669+0000", 2024-04-26T12:07:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0249e-05 2024-04-26T12:07:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577575+0000", 2024-04-26T12:07:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049053329999999996 2024-04-26T12:07:20.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577625+0000", 2024-04-26T12:07:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0274e-05 2024-04-26T12:07:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577710+0000", 2024-04-26T12:07:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4741999999999996e-05 2024-04-26T12:07:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.958 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:543 3.2 3:4272d415:::200.0000000b:head [write 413907~2485 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:20.958 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:20.958 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.401270432, 2024-04-26T12:07:20.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053578708000000003, 2024-04-26T12:07:20.958 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:20.958 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:20.958 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:20.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:20.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:20.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524287+0000", 2024-04-26T12:07:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2190000000000003e-06 2024-04-26T12:07:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524294+0000", 2024-04-26T12:07:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5660000000000003e-06 2024-04-26T12:07:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524298+0000", 2024-04-26T12:07:20.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3900000000000003e-06 2024-04-26T12:07:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572992+0000", 2024-04-26T12:07:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048693835999999997 2024-04-26T12:07:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573045+0000", 2024-04-26T12:07:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2793000000000001e-05 2024-04-26T12:07:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577721+0000", 2024-04-26T12:07:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046760550000000001 2024-04-26T12:07:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577777+0000", 2024-04-26T12:07:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5908000000000001e-05 2024-04-26T12:07:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:20.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577861+0000", 2024-04-26T12:07:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4337000000000002e-05 2024-04-26T12:07:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:544 3.2 3:4272d415:::200.0000000b:head [write 416392~3872 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.401250709999999, 2024-04-26T12:07:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054810527999999997, 2024-04-26T12:07:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:20.963 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:20.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524307+0000", 2024-04-26T12:07:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1580000000000004e-06 2024-04-26T12:07:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524312+0000", 2024-04-26T12:07:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6380000000000001e-06 2024-04-26T12:07:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524317+0000", 2024-04-26T12:07:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4000000000000002e-06 2024-04-26T12:07:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573348+0000", 2024-04-26T12:07:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049031433999999999 2024-04-26T12:07:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573393+0000", 2024-04-26T12:07:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4536999999999997e-05 2024-04-26T12:07:20.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578978+0000", 2024-04-26T12:07:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055848299999999998 2024-04-26T12:07:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579031+0000", 2024-04-26T12:07:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3708000000000001e-05 2024-04-26T12:07:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579113+0000", 2024-04-26T12:07:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1258e-05 2024-04-26T12:07:20.967 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:545 3.2 3:4272d415:::200.0000000b:head [write 420264~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.401232084, 2024-04-26T12:07:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054927386000000002, 2024-04-26T12:07:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:20.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524320+0000", 2024-04-26T12:07:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:20.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524325+0000", 2024-04-26T12:07:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5249999999999999e-06 2024-04-26T12:07:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524330+0000", 2024-04-26T12:07:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5629999999999999e-06 2024-04-26T12:07:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524335+0000", 2024-04-26T12:07:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.685e-06 2024-04-26T12:07:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573727+0000", 2024-04-26T12:07:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049392034000000001 2024-04-26T12:07:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573775+0000", 2024-04-26T12:07:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7435999999999998e-05 2024-04-26T12:07:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579120+0000", 2024-04-26T12:07:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0053452949999999999 2024-04-26T12:07:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579167+0000", 2024-04-26T12:07:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7240000000000002e-05 2024-04-26T12:07:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579248+0000", 2024-04-26T12:07:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0947999999999998e-05 2024-04-26T12:07:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 422222~8537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.401213767000002, 2024-04-26T12:07:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055065936000000003, 2024-04-26T12:07:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524347+0000", 2024-04-26T12:07:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7129999999999994e-06 2024-04-26T12:07:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524357+0000", 2024-04-26T12:07:20.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0232e-05 2024-04-26T12:07:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524362+0000", 2024-04-26T12:07:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:07:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574119+0000", 2024-04-26T12:07:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049756727000000001 2024-04-26T12:07:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:20.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574166+0000", 2024-04-26T12:07:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7086000000000003e-05 2024-04-26T12:07:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579261+0000", 2024-04-26T12:07:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050948310000000002 2024-04-26T12:07:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579316+0000", 2024-04-26T12:07:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5068000000000002e-05 2024-04-26T12:07:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579405+0000", 2024-04-26T12:07:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9251000000000003e-05 2024-04-26T12:07:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 430759~2035 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.401186776999999, 2024-04-26T12:07:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055164950999999997, 2024-04-26T12:07:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:20.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524368+0000", 2024-04-26T12:07:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.57e-06 2024-04-26T12:07:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524375+0000", 2024-04-26T12:07:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6170000000000003e-06 2024-04-26T12:07:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524380+0000", 2024-04-26T12:07:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2700000000000004e-06 2024-04-26T12:07:20.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574639+0000", 2024-04-26T12:07:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050259459999999999 2024-04-26T12:07:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574687+0000", 2024-04-26T12:07:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7608999999999998e-05 2024-04-26T12:07:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579414+0000", 2024-04-26T12:07:20.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047268750000000002 2024-04-26T12:07:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579456+0000", 2024-04-26T12:07:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1885000000000003e-05 2024-04-26T12:07:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579531+0000", 2024-04-26T12:07:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5053000000000001e-05 2024-04-26T12:07:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 432794~10523 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.400196052999998, 2024-04-26T12:07:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054314727, 2024-04-26T12:07:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525356+0000", 2024-04-26T12:07:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525414+0000", 2024-04-26T12:07:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8148e-05 2024-04-26T12:07:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525423+0000", 2024-04-26T12:07:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9749999999999996e-06 2024-04-26T12:07:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525428+0000", 2024-04-26T12:07:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0270000000000003e-06 2024-04-26T12:07:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574950+0000", 2024-04-26T12:07:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049521840999999997 2024-04-26T12:07:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575002+0000", 2024-04-26T12:07:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1586999999999999e-05 2024-04-26T12:07:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579543+0000", 2024-04-26T12:07:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045416340000000001 2024-04-26T12:07:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579587+0000", 2024-04-26T12:07:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3875999999999998e-05 2024-04-26T12:07:20.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:20.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579671+0000", 2024-04-26T12:07:20.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4351999999999995e-05 2024-04-26T12:07:20.986 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.986 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:20.986 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.986 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 443317~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:20.987 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:20.987 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.400120078, 2024-04-26T12:07:20.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054381889000000003, 2024-04-26T12:07:20.987 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:20.987 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:20.987 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:20.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:20.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:20.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:20.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:20.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:20.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525432+0000", 2024-04-26T12:07:20.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:20.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:20.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525435+0000", 2024-04-26T12:07:20.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3070000000000001e-06 2024-04-26T12:07:20.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:20.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525439+0000", 2024-04-26T12:07:20.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.104e-06 2024-04-26T12:07:20.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:20.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525442+0000", 2024-04-26T12:07:20.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0460000000000001e-06 2024-04-26T12:07:20.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:20.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575405+0000", 2024-04-26T12:07:20.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049963059999999997 2024-04-26T12:07:20.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:20.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575450+0000", 2024-04-26T12:07:20.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5034000000000003e-05 2024-04-26T12:07:20.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:20.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579680+0000", 2024-04-26T12:07:20.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042302260000000001 2024-04-26T12:07:20.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:20.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579737+0000", 2024-04-26T12:07:20.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7241000000000003e-05 2024-04-26T12:07:20.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:20.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579815+0000", 2024-04-26T12:07:20.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7278000000000001e-05 2024-04-26T12:07:20.991 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.991 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:20.991 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.991 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 445275~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:20.991 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:20.991 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.399692902000002, 2024-04-26T12:07:20.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054094668999999998, 2024-04-26T12:07:20.992 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:20.992 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:20.992 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:20.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.992 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:20.992 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:20.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.992 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:20.992 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:20.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:20.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525859+0000", 2024-04-26T12:07:20.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:20.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:20.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525864+0000", 2024-04-26T12:07:20.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:07:20.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:20.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525872+0000", 2024-04-26T12:07:20.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6790000000000005e-06 2024-04-26T12:07:20.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:20.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525877+0000", 2024-04-26T12:07:20.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0529999999999997e-06 2024-04-26T12:07:20.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:20.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575723+0000", 2024-04-26T12:07:20.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049846469999999997 2024-04-26T12:07:20.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:20.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575770+0000", 2024-04-26T12:07:20.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6387999999999997e-05 2024-04-26T12:07:20.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:20.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579823+0000", 2024-04-26T12:07:20.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0040534189999999999 2024-04-26T12:07:20.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:20.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579869+0000", 2024-04-26T12:07:20.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6218999999999999e-05 2024-04-26T12:07:20.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:20.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579954+0000", 2024-04-26T12:07:20.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5315999999999994e-05 2024-04-26T12:07:20.996 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.996 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:20.996 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:20.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.996 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:551 3.2 3:4272d415:::200.0000000b:head [write 448232~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:20.996 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:20.996 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.399245468, 2024-04-26T12:07:20.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053798273000000001, 2024-04-26T12:07:20.996 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:20.996 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:20.996 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:20.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:20.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:20.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.997 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.997 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:20.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:20.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:20.997 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.997 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:20.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:20.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:20.997 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:20.998 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526310+0000", 2024-04-26T12:07:20.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5279999999999999e-06 2024-04-26T12:07:20.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:20.998 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526317+0000", 2024-04-26T12:07:20.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8430000000000004e-06 2024-04-26T12:07:20.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:20.998 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526322+0000", 2024-04-26T12:07:20.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3340000000000001e-06 2024-04-26T12:07:20.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:20.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576135+0000", 2024-04-26T12:07:20.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049812113999999998 2024-04-26T12:07:20.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:20.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:20.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:20.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576186+0000", 2024-04-26T12:07:20.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1443999999999997e-05 2024-04-26T12:07:20.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:21.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579962+0000", 2024-04-26T12:07:21.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037763359999999999 2024-04-26T12:07:21.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:21.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580016+0000", 2024-04-26T12:07:21.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3421000000000002e-05 2024-04-26T12:07:21.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:21.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580106+0000", 2024-04-26T12:07:21.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9790000000000006e-05 2024-04-26T12:07:21.001 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.001 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.001 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.001 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.001 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 450189~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:21.001 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:21.001 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.399165339, 2024-04-26T12:07:21.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055070796999999998, 2024-04-26T12:07:21.001 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:21.001 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.001 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:21.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:21.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:21.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:21.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:21.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:21.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:21.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:21.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:21.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526390+0000", 2024-04-26T12:07:21.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8559999999999998e-06 2024-04-26T12:07:21.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:21.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526395+0000", 2024-04-26T12:07:21.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3319999999999999e-06 2024-04-26T12:07:21.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526399+0000", 2024-04-26T12:07:21.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.619e-06 2024-04-26T12:07:21.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:21.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576476+0000", 2024-04-26T12:07:21.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050077643999999998 2024-04-26T12:07:21.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:21.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576524+0000", 2024-04-26T12:07:21.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7184000000000001e-05 2024-04-26T12:07:21.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.005 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:21.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581347+0000", 2024-04-26T12:07:21.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0048231919999999996 2024-04-26T12:07:21.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.006 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:21.006 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581398+0000", 2024-04-26T12:07:21.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1345999999999999e-05 2024-04-26T12:07:21.006 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.006 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.006 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:21.006 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581458+0000", 2024-04-26T12:07:21.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0081000000000003e-05 2024-04-26T12:07:21.006 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.006 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.006 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.006 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.006 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.007 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 452113~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:21.007 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:21.007 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.399054122999999, 2024-04-26T12:07:21.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055041448, 2024-04-26T12:07:21.007 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:21.007 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.007 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:21.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:21.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:21.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:21.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:21.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.008 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:21.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526498+0000", 2024-04-26T12:07:21.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:21.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.008 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:21.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526540+0000", 2024-04-26T12:07:21.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2267e-05 2024-04-26T12:07:21.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:21.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526547+0000", 2024-04-26T12:07:21.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7000000000000002e-06 2024-04-26T12:07:21.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526550+0000", 2024-04-26T12:07:21.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0299999999999998e-06 2024-04-26T12:07:21.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:21.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577902+0000", 2024-04-26T12:07:21.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051351648999999999 2024-04-26T12:07:21.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.010 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:21.010 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577953+0000", 2024-04-26T12:07:21.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1289000000000003e-05 2024-04-26T12:07:21.010 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.010 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:21.010 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581464+0000", 2024-04-26T12:07:21.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035111259999999998 2024-04-26T12:07:21.010 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.010 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:21.010 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581490+0000", 2024-04-26T12:07:21.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5717000000000001e-05 2024-04-26T12:07:21.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.011 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:21.011 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581540+0000", 2024-04-26T12:07:21.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0287999999999997e-05 2024-04-26T12:07:21.011 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.011 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.011 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.011 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 454070~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:21.011 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:21.012 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.398497173999999, 2024-04-26T12:07:21.012 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054564161, 2024-04-26T12:07:21.012 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:21.012 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.012 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:21.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.012 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:21.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:21.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.013 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:21.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:21.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.013 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:21.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527055+0000", 2024-04-26T12:07:21.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:21.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:21.014 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527058+0000", 2024-04-26T12:07:21.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9890000000000001e-06 2024-04-26T12:07:21.014 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:21.014 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527066+0000", 2024-04-26T12:07:21.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4730000000000003e-06 2024-04-26T12:07:21.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527069+0000", 2024-04-26T12:07:21.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5810000000000001e-06 2024-04-26T12:07:21.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:21.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578308+0000", 2024-04-26T12:07:21.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051238911999999998 2024-04-26T12:07:21.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:21.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578391+0000", 2024-04-26T12:07:21.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2713999999999994e-05 2024-04-26T12:07:21.016 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:21.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581548+0000", 2024-04-26T12:07:21.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031577530000000001 2024-04-26T12:07:21.016 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:21.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581574+0000", 2024-04-26T12:07:21.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5350999999999998e-05 2024-04-26T12:07:21.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.017 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:21.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581620+0000", 2024-04-26T12:07:21.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5868999999999997e-05 2024-04-26T12:07:21.017 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.017 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.017 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.017 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 456028~3870 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:21.018 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:21.018 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.396740932, 2024-04-26T12:07:21.018 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055118997000000003, 2024-04-26T12:07:21.018 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:21.018 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.018 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:21.018 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.018 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:21.018 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:21.018 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.018 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.018 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.018 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:21.019 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:21.019 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.019 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.019 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.019 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:21.019 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528811+0000", 2024-04-26T12:07:21.019 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:21.019 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.019 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.019 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:21.019 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528887+0000", 2024-04-26T12:07:21.019 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5977999999999997e-05 2024-04-26T12:07:21.019 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.019 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.020 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:21.020 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528897+0000", 2024-04-26T12:07:21.020 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8730000000000002e-06 2024-04-26T12:07:21.020 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.020 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.020 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.020 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528901+0000", 2024-04-26T12:07:21.020 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4880000000000001e-06 2024-04-26T12:07:21.020 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.020 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.020 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:21.020 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580146+0000", 2024-04-26T12:07:21.020 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051244242000000002 2024-04-26T12:07:21.020 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.021 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.021 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:21.021 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580227+0000", 2024-04-26T12:07:21.021 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1044000000000005e-05 2024-04-26T12:07:21.021 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.021 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.021 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:21.021 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583864+0000", 2024-04-26T12:07:21.021 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036374419999999998 2024-04-26T12:07:21.021 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.021 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.021 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:21.022 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583894+0000", 2024-04-26T12:07:21.022 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9828999999999999e-05 2024-04-26T12:07:21.022 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.022 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.022 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:21.022 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583931+0000", 2024-04-26T12:07:21.022 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6908e-05 2024-04-26T12:07:21.022 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.023 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.023 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.023 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.023 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.023 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 459898~2037 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:21.023 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:21.024 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.396352941, 2024-04-26T12:07:21.024 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055925713000000002, 2024-04-26T12:07:21.024 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:21.024 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.024 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:21.024 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.025 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:21.025 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:21.025 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.025 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.025 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.025 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:21.025 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:21.026 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.026 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:21.026 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529199+0000", 2024-04-26T12:07:21.026 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:21.026 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.027 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:21.027 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529203+0000", 2024-04-26T12:07:21.027 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:07:21.027 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.027 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.027 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:21.027 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529209+0000", 2024-04-26T12:07:21.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7939999999999999e-06 2024-04-26T12:07:21.028 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.028 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.028 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.028 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529212+0000", 2024-04-26T12:07:21.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7290000000000002e-06 2024-04-26T12:07:21.028 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.028 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.028 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:21.028 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580784+0000", 2024-04-26T12:07:21.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051572073000000003 2024-04-26T12:07:21.028 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.028 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.029 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:21.029 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580883+0000", 2024-04-26T12:07:21.029 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8330000000000002e-05 2024-04-26T12:07:21.029 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.029 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.029 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:21.029 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585050+0000", 2024-04-26T12:07:21.029 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041670209999999999 2024-04-26T12:07:21.029 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.029 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.029 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:21.029 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585088+0000", 2024-04-26T12:07:21.029 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8559999999999997e-05 2024-04-26T12:07:21.029 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.030 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.030 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:21.030 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585125+0000", 2024-04-26T12:07:21.030 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7197999999999999e-05 2024-04-26T12:07:21.030 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.030 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.030 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.030 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.030 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.030 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 461935~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:21.030 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:21.030 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.395630486999998, 2024-04-26T12:07:21.030 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055266150999999999, 2024-04-26T12:07:21.031 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:21.031 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.031 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:21.031 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.031 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:21.031 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:21.031 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.031 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.031 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.031 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:21.031 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:21.031 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.031 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.031 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.031 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:21.032 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529921+0000", 2024-04-26T12:07:21.032 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:21.032 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.032 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.032 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:21.032 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529956+0000", 2024-04-26T12:07:21.032 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4687000000000002e-05 2024-04-26T12:07:21.032 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.032 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.032 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:21.032 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529966+0000", 2024-04-26T12:07:21.032 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0392e-05 2024-04-26T12:07:21.032 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.033 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.033 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.033 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529978+0000", 2024-04-26T12:07:21.033 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1348e-05 2024-04-26T12:07:21.033 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.033 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.033 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:21.033 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581659+0000", 2024-04-26T12:07:21.033 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051681454000000002 2024-04-26T12:07:21.033 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.033 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.033 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:21.033 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581746+0000", 2024-04-26T12:07:21.033 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6305999999999997e-05 2024-04-26T12:07:21.034 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.034 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.034 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:21.034 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585131+0000", 2024-04-26T12:07:21.034 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033853199999999998 2024-04-26T12:07:21.034 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.034 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.034 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:21.034 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585154+0000", 2024-04-26T12:07:21.034 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3258999999999999e-05 2024-04-26T12:07:21.034 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.034 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.034 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:21.034 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585188+0000", 2024-04-26T12:07:21.035 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4236000000000002e-05 2024-04-26T12:07:21.035 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.035 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.035 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.035 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.035 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.035 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:21.037 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:07:21.037 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:21.035+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:21.138 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:21.137+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:21.142 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:21.142 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:21.142 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:07:21.143 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:21.151 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:21.239 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:21.238+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:21.291 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:21.292 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:21.292 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:07:21.292 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:07:21.292 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:21.299 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:21.343 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:21.342+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:21.385 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-04-26T12:07:21.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:07:21.385 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T12:07:21.402 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:07:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:07:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:07:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2989 3.d 3:b02ffd62:::200.00000010:head [write 3767903~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 21.884421769999999, 2024-04-26T12:07:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057069768999999999, 2024-04-26T12:07:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.403 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516446+0000", 2024-04-26T12:07:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6469999999999997e-06 2024-04-26T12:07:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516449+0000", 2024-04-26T12:07:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.976e-06 2024-04-26T12:07:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516452+0000", 2024-04-26T12:07:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.509e-06 2024-04-26T12:07:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.568562+0000", 2024-04-26T12:07:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.052110030000000002 2024-04-26T12:07:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.568615+0000", 2024-04-26T12:07:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2809999999999998e-05 2024-04-26T12:07:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573425+0000", 2024-04-26T12:07:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048105149999999996 2024-04-26T12:07:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573452+0000", 2024-04-26T12:07:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6778e-05 2024-04-26T12:07:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573512+0000", 2024-04-26T12:07:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9710000000000003e-05 2024-04-26T12:07:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2990 3.d 3:b02ffd62:::200.00000010:head [write 3769302~4483 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 21.884409771000001, 2024-04-26T12:07:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057131345, 2024-04-26T12:07:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:21.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516459+0000", 2024-04-26T12:07:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2859999999999999e-06 2024-04-26T12:07:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:21.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516462+0000", 2024-04-26T12:07:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0790000000000001e-06 2024-04-26T12:07:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516465+0000", 2024-04-26T12:07:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.464e-06 2024-04-26T12:07:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569035+0000", 2024-04-26T12:07:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.052570328999999999 2024-04-26T12:07:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569113+0000", 2024-04-26T12:07:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8118e-05 2024-04-26T12:07:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573517+0000", 2024-04-26T12:07:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044039200000000004 2024-04-26T12:07:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573541+0000", 2024-04-26T12:07:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3805999999999999e-05 2024-04-26T12:07:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573585+0000", 2024-04-26T12:07:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4567000000000002e-05 2024-04-26T12:07:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2991 3.d 3:b02ffd62:::200.00000010:head [write 3773785~4213 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 21.884397082, 2024-04-26T12:07:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057230554000000003, 2024-04-26T12:07:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.412 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516466+0000", 2024-04-26T12:07:21.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516470+0000", 2024-04-26T12:07:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7960000000000002e-06 2024-04-26T12:07:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516478+0000", 2024-04-26T12:07:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:07:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516484+0000", 2024-04-26T12:07:21.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5300000000000002e-06 2024-04-26T12:07:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569662+0000", 2024-04-26T12:07:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053177896000000002 2024-04-26T12:07:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569749+0000", 2024-04-26T12:07:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7229000000000001e-05 2024-04-26T12:07:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573593+0000", 2024-04-26T12:07:21.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038433109999999999 2024-04-26T12:07:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573631+0000", 2024-04-26T12:07:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8615000000000002e-05 2024-04-26T12:07:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573697+0000", 2024-04-26T12:07:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5971999999999998e-05 2024-04-26T12:07:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:21.416 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2999 3.d 3:b02ffd62:::200.00000010:head [write 3797283~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 21.879882693999999, 2024-04-26T12:07:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057330949999999999, 2024-04-26T12:07:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520980+0000", 2024-04-26T12:07:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520991+0000", 2024-04-26T12:07:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1154e-05 2024-04-26T12:07:21.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521014+0000", 2024-04-26T12:07:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2288000000000001e-05 2024-04-26T12:07:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521019+0000", 2024-04-26T12:07:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0889999999999999e-06 2024-04-26T12:07:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.575399+0000", 2024-04-26T12:07:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054380392999999999 2024-04-26T12:07:21.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.575440+0000", 2024-04-26T12:07:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1146000000000002e-05 2024-04-26T12:07:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578237+0000", 2024-04-26T12:07:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002796761 2024-04-26T12:07:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578260+0000", 2024-04-26T12:07:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3538999999999999e-05 2024-04-26T12:07:21.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578312+0000", 2024-04-26T12:07:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1508999999999998e-05 2024-04-26T12:07:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3000 3.d 3:b02ffd62:::200.00000010:head [write 3801160~9028 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 21.879256728000001, 2024-04-26T12:07:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.059231688999999997, 2024-04-26T12:07:21.421 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521606+0000", 2024-04-26T12:07:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521627+0000", 2024-04-26T12:07:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1129e-05 2024-04-26T12:07:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521637+0000", 2024-04-26T12:07:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8789999999999998e-06 2024-04-26T12:07:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.423 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521644+0000", 2024-04-26T12:07:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:07:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576381+0000", 2024-04-26T12:07:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.05473629 2024-04-26T12:07:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576451+0000", 2024-04-26T12:07:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0525000000000007e-05 2024-04-26T12:07:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580734+0000", 2024-04-26T12:07:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042826699999999997 2024-04-26T12:07:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580780+0000", 2024-04-26T12:07:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6006e-05 2024-04-26T12:07:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580839+0000", 2024-04-26T12:07:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8783000000000003e-05 2024-04-26T12:07:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:21.425 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3001 3.d 3:b02ffd62:::200.00000010:head [write 3810188~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 21.878704396, 2024-04-26T12:07:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.060161213999999998, 2024-04-26T12:07:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522158+0000", 2024-04-26T12:07:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522165+0000", 2024-04-26T12:07:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.28e-06 2024-04-26T12:07:21.427 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522178+0000", 2024-04-26T12:07:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3738e-05 2024-04-26T12:07:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522186+0000", 2024-04-26T12:07:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.267e-06 2024-04-26T12:07:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576889+0000", 2024-04-26T12:07:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054703442999999997 2024-04-26T12:07:21.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576953+0000", 2024-04-26T12:07:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4213000000000003e-05 2024-04-26T12:07:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582185+0000", 2024-04-26T12:07:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052319209999999996 2024-04-26T12:07:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582243+0000", 2024-04-26T12:07:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7321999999999998e-05 2024-04-26T12:07:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582321+0000", 2024-04-26T12:07:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7911000000000007e-05 2024-04-26T12:07:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3002 3.d 3:b02ffd62:::200.00000010:head [write 3812103~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 21.878235632999999, 2024-04-26T12:07:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.059796961000000003, 2024-04-26T12:07:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.431 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522627+0000", 2024-04-26T12:07:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522633+0000", 2024-04-26T12:07:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6699999999999999e-06 2024-04-26T12:07:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522643+0000", 2024-04-26T12:07:21.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6649999999999998e-06 2024-04-26T12:07:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522649+0000", 2024-04-26T12:07:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4200000000000004e-06 2024-04-26T12:07:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577413+0000", 2024-04-26T12:07:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054763714999999998 2024-04-26T12:07:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:21.433 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577460+0000", 2024-04-26T12:07:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7095000000000002e-05 2024-04-26T12:07:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582331+0000", 2024-04-26T12:07:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048716419999999998 2024-04-26T12:07:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582375+0000", 2024-04-26T12:07:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3053999999999998e-05 2024-04-26T12:07:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.434 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582425+0000", 2024-04-26T12:07:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0525000000000002e-05 2024-04-26T12:07:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3003 3.d 3:b02ffd62:::200.00000010:head [write 3814061~4170 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 21.877180571, 2024-04-26T12:07:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058803394000000002, 2024-04-26T12:07:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.435 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523682+0000", 2024-04-26T12:07:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:21.436 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523690+0000", 2024-04-26T12:07:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0290000000000005e-06 2024-04-26T12:07:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523699+0000", 2024-04-26T12:07:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4589999999999998e-06 2024-04-26T12:07:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523703+0000", 2024-04-26T12:07:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6249999999999998e-06 2024-04-26T12:07:21.437 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577832+0000", 2024-04-26T12:07:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054128883000000003 2024-04-26T12:07:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577878+0000", 2024-04-26T12:07:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5841999999999999e-05 2024-04-26T12:07:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582430+0000", 2024-04-26T12:07:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045517270000000002 2024-04-26T12:07:21.438 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582453+0000", 2024-04-26T12:07:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3609999999999999e-05 2024-04-26T12:07:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582487+0000", 2024-04-26T12:07:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3080000000000002e-05 2024-04-26T12:07:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.439 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3004 3.d 3:b02ffd62:::200.00000010:head [write 3818231~3890 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 21.876331648000001, 2024-04-26T12:07:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058024342999999999, 2024-04-26T12:07:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:21.440 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:21.441 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.441 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.441 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.441 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:21.441 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524531+0000", 2024-04-26T12:07:21.441 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:21.441 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.441 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.441 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:21.441 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524539+0000", 2024-04-26T12:07:21.441 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9249999999999995e-06 2024-04-26T12:07:21.441 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.441 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.441 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:21.442 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524547+0000", 2024-04-26T12:07:21.442 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5220000000000007e-06 2024-04-26T12:07:21.442 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.442 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.442 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.442 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524553+0000", 2024-04-26T12:07:21.442 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6659999999999996e-06 2024-04-26T12:07:21.442 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.442 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.442 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:21.442 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578335+0000", 2024-04-26T12:07:21.442 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.05378235 2024-04-26T12:07:21.442 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.442 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.443 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:21.443 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578378+0000", 2024-04-26T12:07:21.443 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2429999999999999e-05 2024-04-26T12:07:21.443 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.443 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.443 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:21.443 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582494+0000", 2024-04-26T12:07:21.443 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004116059 2024-04-26T12:07:21.443 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.443 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.443 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:21.443 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582519+0000", 2024-04-26T12:07:21.443 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4961999999999999e-05 2024-04-26T12:07:21.443 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.443 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.444 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:21.444 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582556+0000", 2024-04-26T12:07:21.444 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7728999999999997e-05 2024-04-26T12:07:21.444 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.444 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:21.444 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.444 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.444 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.444 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3005 3.d 3:b02ffd62:::200.00000010:head [write 3822121~5207 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:21.444 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:21.444 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 21.875912392, 2024-04-26T12:07:21.444 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057662270000000002, 2024-04-26T12:07:21.444 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:21.444 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.445 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:21.445 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.445 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:21.445 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:21.445 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.445 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.445 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.445 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:21.445 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:21.445 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.445 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.445 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.445 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:21.445 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:21.445 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:21.446 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.446 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.446 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:21.446 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524961+0000", 2024-04-26T12:07:21.446 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0124e-05 2024-04-26T12:07:21.446 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.446 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.446 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:21.446 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524971+0000", 2024-04-26T12:07:21.446 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0200999999999999e-05 2024-04-26T12:07:21.446 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.446 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.446 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.446 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524979+0000", 2024-04-26T12:07:21.447 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5809999999999999e-06 2024-04-26T12:07:21.447 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.447 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.447 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:21.447 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578753+0000", 2024-04-26T12:07:21.447 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053774444999999997 2024-04-26T12:07:21.447 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.447 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.447 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:21.447 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578821+0000", 2024-04-26T12:07:21.447 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7640999999999998e-05 2024-04-26T12:07:21.447 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.447 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.447 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:21.447 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582561+0000", 2024-04-26T12:07:21.448 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037399870000000002 2024-04-26T12:07:21.448 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.448 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.448 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:21.448 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582582+0000", 2024-04-26T12:07:21.448 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0934999999999999e-05 2024-04-26T12:07:21.448 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.448 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.448 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:21.448 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582614+0000", 2024-04-26T12:07:21.448 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1948e-05 2024-04-26T12:07:21.448 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.448 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:21.448 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.449 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.449 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.449 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3006 3.d 3:b02ffd62:::200.00000010:head [write 3827328~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:21.449 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:21.449 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 21.875279053, 2024-04-26T12:07:21.449 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057085404999999999, 2024-04-26T12:07:21.449 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:21.449 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.449 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:21.449 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.449 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:21.449 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:21.449 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.449 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.449 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.450 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:21.450 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:21.450 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.450 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.450 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.450 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:21.450 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525583+0000", 2024-04-26T12:07:21.450 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:21.450 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.450 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.450 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:21.450 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525594+0000", 2024-04-26T12:07:21.450 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0497e-05 2024-04-26T12:07:21.450 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.451 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.451 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:21.451 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525610+0000", 2024-04-26T12:07:21.451 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6392000000000002e-05 2024-04-26T12:07:21.451 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.451 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.451 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.451 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525621+0000", 2024-04-26T12:07:21.451 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0679999999999999e-05 2024-04-26T12:07:21.451 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.451 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.451 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:21.451 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.579270+0000", 2024-04-26T12:07:21.451 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053648802000000002 2024-04-26T12:07:21.451 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.452 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.452 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:21.452 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.579312+0000", 2024-04-26T12:07:21.452 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2268000000000003e-05 2024-04-26T12:07:21.452 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.452 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.452 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:21.452 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582618+0000", 2024-04-26T12:07:21.452 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033057049999999999 2024-04-26T12:07:21.452 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.452 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.452 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:21.452 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582637+0000", 2024-04-26T12:07:21.452 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9417000000000001e-05 2024-04-26T12:07:21.452 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.453 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.453 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:21.453 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582670+0000", 2024-04-26T12:07:21.453 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2969999999999998e-05 2024-04-26T12:07:21.453 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.453 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:21.453 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.453 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.453 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.453 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3015 3.d 3:b02ffd62:::200.00000010:head [write 3855113~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:21.453 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:21.453 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 21.864823296000001, 2024-04-26T12:07:21.453 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057652729999999999, 2024-04-26T12:07:21.453 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:21.453 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.454 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:21.454 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.454 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:21.454 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:21.454 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.454 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.454 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.454 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:21.454 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:21.454 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.454 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.454 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.454 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:21.454 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:21.455 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:21.455 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.455 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.455 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:21.455 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536042+0000", 2024-04-26T12:07:21.455 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0849999999999999e-06 2024-04-26T12:07:21.455 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.455 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.455 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:21.455 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536046+0000", 2024-04-26T12:07:21.455 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:07:21.455 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.455 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.455 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.456 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536048+0000", 2024-04-26T12:07:21.456 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6019999999999998e-06 2024-04-26T12:07:21.456 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.456 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.456 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:21.456 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585409+0000", 2024-04-26T12:07:21.456 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.049360938 2024-04-26T12:07:21.456 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.456 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.456 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:21.456 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585506+0000", 2024-04-26T12:07:21.456 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6966999999999995e-05 2024-04-26T12:07:21.456 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.456 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.456 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:21.457 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593630+0000", 2024-04-26T12:07:21.457 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0081238160000000007 2024-04-26T12:07:21.457 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.457 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.457 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:21.457 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593656+0000", 2024-04-26T12:07:21.457 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6154000000000001e-05 2024-04-26T12:07:21.457 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.457 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.457 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:21.457 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593693+0000", 2024-04-26T12:07:21.457 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7185999999999999e-05 2024-04-26T12:07:21.457 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.457 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:21.457 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.458 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.458 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.458 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3016 3.d 3:b02ffd62:::200.00000010:head [write 3857020~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:21.458 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:21.458 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 21.864813348999999, 2024-04-26T12:07:21.458 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058678157000000002, 2024-04-26T12:07:21.458 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:21.458 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.458 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:21.458 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.458 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:21.458 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:21.458 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.458 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.459 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.459 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:21.459 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:21.459 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.459 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.459 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.459 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:21.459 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:21.459 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:21.459 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.459 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.459 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:21.459 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536055+0000", 2024-04-26T12:07:21.459 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3669999999999999e-06 2024-04-26T12:07:21.459 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.460 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.460 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:21.460 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536058+0000", 2024-04-26T12:07:21.460 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3220000000000001e-06 2024-04-26T12:07:21.460 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.460 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.460 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.460 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536062+0000", 2024-04-26T12:07:21.460 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1520000000000002e-06 2024-04-26T12:07:21.460 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.460 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.460 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:21.460 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585965+0000", 2024-04-26T12:07:21.460 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.049902769999999999 2024-04-26T12:07:21.460 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.461 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.461 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:21.461 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586046+0000", 2024-04-26T12:07:21.461 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1032999999999995e-05 2024-04-26T12:07:21.461 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.461 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.461 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:21.461 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594667+0000", 2024-04-26T12:07:21.461 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0086214599999999992 2024-04-26T12:07:21.461 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.461 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.461 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:21.461 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594692+0000", 2024-04-26T12:07:21.461 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5191999999999999e-05 2024-04-26T12:07:21.462 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.462 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.462 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:21.462 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594729+0000", 2024-04-26T12:07:21.462 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6069000000000003e-05 2024-04-26T12:07:21.462 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.462 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:21.462 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.462 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.462 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.462 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3017 3.d 3:b02ffd62:::200.00000010:head [write 3859438~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:21.462 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:21.462 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 21.864799264999998, 2024-04-26T12:07:21.462 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058723814999999999, 2024-04-26T12:07:21.463 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:21.463 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.463 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:21.463 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.463 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:21.463 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:21.463 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.463 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.463 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.463 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:21.463 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:21.463 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.463 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.463 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.464 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:21.464 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:21.464 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:21.464 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.464 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.464 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:21.464 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536066+0000", 2024-04-26T12:07:21.464 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8840000000000001e-06 2024-04-26T12:07:21.464 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.464 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.464 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:21.464 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536069+0000", 2024-04-26T12:07:21.464 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:07:21.464 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.464 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.465 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.465 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536072+0000", 2024-04-26T12:07:21.465 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4449999999999999e-06 2024-04-26T12:07:21.465 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.465 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.465 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:21.465 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586703+0000", 2024-04-26T12:07:21.465 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050631618000000003 2024-04-26T12:07:21.465 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.465 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.465 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:21.465 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586748+0000", 2024-04-26T12:07:21.465 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4682999999999999e-05 2024-04-26T12:07:21.465 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.465 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.466 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:21.466 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594734+0000", 2024-04-26T12:07:21.466 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079860369999999996 2024-04-26T12:07:21.466 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.466 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.466 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:21.466 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594756+0000", 2024-04-26T12:07:21.466 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1738000000000001e-05 2024-04-26T12:07:21.466 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.466 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.466 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:21.466 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594788+0000", 2024-04-26T12:07:21.466 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2604999999999997e-05 2024-04-26T12:07:21.466 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.467 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:21.467 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.467 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.467 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.467 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3018 3.d 3:b02ffd62:::200.00000010:head [write 3861345~3221 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:21.467 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:21.467 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 21.863966577999999, 2024-04-26T12:07:21.467 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057946174000000003, 2024-04-26T12:07:21.467 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:21.467 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.467 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:21.467 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.467 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:21.467 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:21.467 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.468 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.468 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.468 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:21.468 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:21.468 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.468 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.468 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.468 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:21.468 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536896+0000", 2024-04-26T12:07:21.468 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:21.468 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.468 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.468 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:21.468 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536905+0000", 2024-04-26T12:07:21.469 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7839999999999998e-06 2024-04-26T12:07:21.469 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.469 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.469 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:21.469 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536929+0000", 2024-04-26T12:07:21.469 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3561999999999999e-05 2024-04-26T12:07:21.469 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.469 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.469 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.469 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536940+0000", 2024-04-26T12:07:21.469 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0742e-05 2024-04-26T12:07:21.469 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.469 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.469 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:21.470 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.587238+0000", 2024-04-26T12:07:21.470 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050297962000000002 2024-04-26T12:07:21.470 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.470 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.470 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:21.470 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.587315+0000", 2024-04-26T12:07:21.470 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7848000000000004e-05 2024-04-26T12:07:21.470 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.470 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.470 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:21.470 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594792+0000", 2024-04-26T12:07:21.470 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074766240000000003 2024-04-26T12:07:21.470 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.470 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.470 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:21.471 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594813+0000", 2024-04-26T12:07:21.471 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0876000000000001e-05 2024-04-26T12:07:21.471 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.471 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.471 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:21.471 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594843+0000", 2024-04-26T12:07:21.471 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0434999999999999e-05 2024-04-26T12:07:21.471 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.471 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:21.471 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.471 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.471 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.471 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3019 3.d 3:b02ffd62:::200.00000010:head [write 3864566~3989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:21.471 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:21.472 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 21.862224218000001, 2024-04-26T12:07:21.472 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.061000094999999997, 2024-04-26T12:07:21.472 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:21.472 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.472 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:21.472 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.472 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:21.472 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:21.472 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.472 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.472 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.472 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:21.472 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:21.472 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.472 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.473 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.473 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:21.473 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538638+0000", 2024-04-26T12:07:21.473 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999981 2024-04-26T12:07:21.473 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.473 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.473 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:21.473 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538669+0000", 2024-04-26T12:07:21.473 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1689000000000001e-05 2024-04-26T12:07:21.473 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.473 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.473 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:21.473 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538703+0000", 2024-04-26T12:07:21.473 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3309000000000002e-05 2024-04-26T12:07:21.473 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.474 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.474 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.474 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538746+0000", 2024-04-26T12:07:21.474 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2803999999999999e-05 2024-04-26T12:07:21.474 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.474 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.474 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:21.474 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.589467+0000", 2024-04-26T12:07:21.474 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050721912000000001 2024-04-26T12:07:21.474 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.474 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.474 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:21.474 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.589517+0000", 2024-04-26T12:07:21.474 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9549999999999998e-05 2024-04-26T12:07:21.475 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.475 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.475 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:21.475 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599577+0000", 2024-04-26T12:07:21.475 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010059593 2024-04-26T12:07:21.475 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.475 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.475 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:21.475 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599603+0000", 2024-04-26T12:07:21.475 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6821e-05 2024-04-26T12:07:21.475 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.475 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.475 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:21.475 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599640+0000", 2024-04-26T12:07:21.475 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6177999999999998e-05 2024-04-26T12:07:21.476 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.476 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:21.476 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.476 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.476 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.476 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3020 3.d 3:b02ffd62:::200.00000010:head [write 3868555~7563 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:21.476 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:21.476 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 21.859611383000001, 2024-04-26T12:07:21.476 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058446867, 2024-04-26T12:07:21.476 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:21.476 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.476 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:21.476 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.476 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:21.477 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:21.477 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.477 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.477 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.477 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:21.477 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:21.477 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.477 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.477 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.477 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:21.477 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541251+0000", 2024-04-26T12:07:21.477 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:21.477 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.477 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.477 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:21.478 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541286+0000", 2024-04-26T12:07:21.478 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4845999999999998e-05 2024-04-26T12:07:21.478 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.478 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.478 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:21.478 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541300+0000", 2024-04-26T12:07:21.478 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4251e-05 2024-04-26T12:07:21.478 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.478 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.478 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.478 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541307+0000", 2024-04-26T12:07:21.478 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3819999999999998e-06 2024-04-26T12:07:21.478 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.478 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.479 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:21.479 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.592596+0000", 2024-04-26T12:07:21.479 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051288215999999998 2024-04-26T12:07:21.479 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.479 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.479 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:21.479 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.592675+0000", 2024-04-26T12:07:21.479 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9197999999999996e-05 2024-04-26T12:07:21.479 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.479 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.479 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:21.479 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599645+0000", 2024-04-26T12:07:21.479 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069701759999999998 2024-04-26T12:07:21.479 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.480 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.480 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:21.480 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599667+0000", 2024-04-26T12:07:21.480 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2118999999999999e-05 2024-04-26T12:07:21.480 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.480 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.480 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:21.480 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599699+0000", 2024-04-26T12:07:21.480 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2048999999999998e-05 2024-04-26T12:07:21.480 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.480 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:21.480 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.480 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.480 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.480 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3021 3.d 3:b02ffd62:::200.00000010:head [write 3876118~3791 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:21.481 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:21.481 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 21.859549646000001, 2024-04-26T12:07:21.481 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058441157000000001, 2024-04-26T12:07:21.481 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:21.481 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.481 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:21.481 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.481 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:21.481 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:21.481 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.481 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.481 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.481 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:21.481 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:21.482 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.482 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.482 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.482 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:21.482 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:21.482 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:21.482 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.482 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.482 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:21.482 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541323+0000", 2024-04-26T12:07:21.482 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5510000000000005e-06 2024-04-26T12:07:21.482 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.482 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.482 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:21.483 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541327+0000", 2024-04-26T12:07:21.483 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2520000000000001e-06 2024-04-26T12:07:21.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.483 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.483 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.483 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541330+0000", 2024-04-26T12:07:21.483 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:07:21.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.483 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.483 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:21.483 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593229+0000", 2024-04-26T12:07:21.483 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051898044999999997 2024-04-26T12:07:21.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.483 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.483 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:21.484 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593278+0000", 2024-04-26T12:07:21.484 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9506999999999999e-05 2024-04-26T12:07:21.484 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.484 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.484 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:21.484 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599704+0000", 2024-04-26T12:07:21.484 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064259570000000004 2024-04-26T12:07:21.484 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.484 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.484 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:21.484 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599725+0000", 2024-04-26T12:07:21.484 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0562999999999999e-05 2024-04-26T12:07:21.484 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.484 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.485 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:21.485 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599755+0000", 2024-04-26T12:07:21.485 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0710000000000002e-05 2024-04-26T12:07:21.485 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.485 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:21.485 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.485 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.485 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.485 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3022 3.d 3:b02ffd62:::200.00000010:head [write 3879909~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:21.485 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:21.485 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 21.858300577000001, 2024-04-26T12:07:21.485 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057246689000000003, 2024-04-26T12:07:21.485 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:21.485 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.485 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:21.486 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.486 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:21.486 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:21.486 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.486 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.486 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.486 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:21.486 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:21.486 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.486 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.486 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.486 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:21.486 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542561+0000", 2024-04-26T12:07:21.486 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999981 2024-04-26T12:07:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542570+0000", 2024-04-26T12:07:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9199999999999993e-06 2024-04-26T12:07:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542583+0000", 2024-04-26T12:07:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2227e-05 2024-04-26T12:07:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542598+0000", 2024-04-26T12:07:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5199e-05 2024-04-26T12:07:21.488 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.488 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.488 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:21.488 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593728+0000", 2024-04-26T12:07:21.488 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051129846 2024-04-26T12:07:21.488 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.488 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.488 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:21.488 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593806+0000", 2024-04-26T12:07:21.488 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8425999999999998e-05 2024-04-26T12:07:21.488 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.488 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.488 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:21.488 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599760+0000", 2024-04-26T12:07:21.488 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0059537399999999999 2024-04-26T12:07:21.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.489 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.489 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:21.489 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599779+0000", 2024-04-26T12:07:21.489 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9619e-05 2024-04-26T12:07:21.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.489 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.489 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:21.489 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599810+0000", 2024-04-26T12:07:21.489 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0508999999999999e-05 2024-04-26T12:07:21.489 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.489 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:21.489 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.489 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.490 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3023 3.d 3:b02ffd62:::200.00000010:head [write 3881868~5748 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:21.490 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:21.490 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 21.857828729000001, 2024-04-26T12:07:21.490 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.056829994000000002, 2024-04-26T12:07:21.490 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:21.490 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.490 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:21.490 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.490 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:21.490 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:21.490 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.490 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.490 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.490 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:21.491 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:21.491 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:21.491 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.491 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.491 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:21.491 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543034+0000", 2024-04-26T12:07:21.491 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:21.491 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.491 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.491 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:21.491 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543044+0000", 2024-04-26T12:07:21.491 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0444e-05 2024-04-26T12:07:21.491 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.491 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.491 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:21.492 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543055+0000", 2024-04-26T12:07:21.492 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.096e-05 2024-04-26T12:07:21.492 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.492 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.492 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.492 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543063+0000", 2024-04-26T12:07:21.492 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2689999999999999e-06 2024-04-26T12:07:21.492 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.492 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.492 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:21.492 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594265+0000", 2024-04-26T12:07:21.492 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051201325999999998 2024-04-26T12:07:21.492 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.492 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.492 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:21.493 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594311+0000", 2024-04-26T12:07:21.493 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5918000000000003e-05 2024-04-26T12:07:21.493 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.493 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.493 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:21.493 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599815+0000", 2024-04-26T12:07:21.493 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055038370000000001 2024-04-26T12:07:21.493 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.493 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.493 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:21.493 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599834+0000", 2024-04-26T12:07:21.493 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9942e-05 2024-04-26T12:07:21.493 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:21.493 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:21.493 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:21.493 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599865+0000", 2024-04-26T12:07:21.494 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0549000000000002e-05 2024-04-26T12:07:21.494 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.494 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:21.494 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.494 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:21.494 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:21.494 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:21.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:07:21.496 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-04-26T12:07:21.497 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T12:07:21.494+0000 7fdf43e82640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28707) UID: 0 2024-04-26T12:07:21.497 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:07:21.555 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T12:07:21.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:07:21.556 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T12:07:21.597 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:21.595+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:21.608 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:21.608 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:07:21.608 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-04-26T12:07:21.608 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:21.617 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:07:21.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:07:21.624 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2024-04-26T12:07:21.701 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-04-26T12:07:21.700+0000 7f3daa475640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28595) UID: 0 2024-04-26T12:07:21.722 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-26T12:07:21.733 INFO:tasks.thrashosds:joining thrashosds 2024-04-26T12:07:21.760 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:21.760 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-04-26T12:07:21.760 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-04-26T12:07:21.760 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-04-26T12:07:21.760 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:21.769 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:07:21.910 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-04-26T12:07:21.911 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-04-26T12:07:21.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-04-26T12:07:21.911 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-04-26T12:07:21.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.911 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:536 3.2 3:4272d415:::200.0000000b:head [write 405817~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:21.911 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:21.911 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 27.384514758999998, 2024-04-26T12:07:21.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053030282999999998, 2024-04-26T12:07:21.911 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:21.911 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.911 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:21.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:21.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:21.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:21.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524137+0000", 2024-04-26T12:07:21.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:21.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524136+0000", 2024-04-26T12:07:21.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:21.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:21.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524139+0000", 2024-04-26T12:07:21.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2919999999999998e-06 2024-04-26T12:07:21.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:21.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524144+0000", 2024-04-26T12:07:21.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.502e-06 2024-04-26T12:07:21.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524149+0000", 2024-04-26T12:07:21.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7310000000000001e-06 2024-04-26T12:07:21.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:21.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570935+0000", 2024-04-26T12:07:21.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.046785603000000002 2024-04-26T12:07:21.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:21.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.570981+0000", 2024-04-26T12:07:21.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6085999999999999e-05 2024-04-26T12:07:21.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:21.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577039+0000", 2024-04-26T12:07:21.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060582099999999996 2024-04-26T12:07:21.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:21.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577081+0000", 2024-04-26T12:07:21.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1927e-05 2024-04-26T12:07:21.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:21.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577167+0000", 2024-04-26T12:07:21.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6311999999999996e-05 2024-04-26T12:07:21.916 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.916 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.916 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.916 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:537 3.2 3:4272d415:::200.0000000b:head [write 407216~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:21.916 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:21.916 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 27.384498821000001, 2024-04-26T12:07:21.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053131411000000003, 2024-04-26T12:07:21.917 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:21.917 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.917 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:21.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:21.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:21.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:21.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524153+0000", 2024-04-26T12:07:21.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:21.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524152+0000", 2024-04-26T12:07:21.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:21.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:21.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524157+0000", 2024-04-26T12:07:21.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3529999999999997e-06 2024-04-26T12:07:21.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:21.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524162+0000", 2024-04-26T12:07:21.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5910000000000003e-06 2024-04-26T12:07:21.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524170+0000", 2024-04-26T12:07:21.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:07:21.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:21.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571323+0000", 2024-04-26T12:07:21.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047153289000000001 2024-04-26T12:07:21.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:21.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571367+0000", 2024-04-26T12:07:21.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4205000000000001e-05 2024-04-26T12:07:21.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:21.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577174+0000", 2024-04-26T12:07:21.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058072250000000001 2024-04-26T12:07:21.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:21.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577218+0000", 2024-04-26T12:07:21.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3294999999999998e-05 2024-04-26T12:07:21.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:21.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577284+0000", 2024-04-26T12:07:21.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6483999999999996e-05 2024-04-26T12:07:21.922 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.922 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.922 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.922 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:538 3.2 3:4272d415:::200.0000000b:head [write 408629~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:21.922 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:21.922 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 27.384478121000001, 2024-04-26T12:07:21.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053241841999999998, 2024-04-26T12:07:21.922 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:21.922 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.922 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:21.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:21.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:21.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:21.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:21.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:21.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524173+0000", 2024-04-26T12:07:21.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:21.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:21.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524178+0000", 2024-04-26T12:07:21.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1420000000000001e-06 2024-04-26T12:07:21.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:21.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524184+0000", 2024-04-26T12:07:21.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4240000000000001e-06 2024-04-26T12:07:21.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524188+0000", 2024-04-26T12:07:21.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2710000000000003e-06 2024-04-26T12:07:21.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:21.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571623+0000", 2024-04-26T12:07:21.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.047435119999999997 2024-04-26T12:07:21.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:21.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.571668+0000", 2024-04-26T12:07:21.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5377000000000003e-05 2024-04-26T12:07:21.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:21.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577292+0000", 2024-04-26T12:07:21.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0056232030000000002 2024-04-26T12:07:21.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:21.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577330+0000", 2024-04-26T12:07:21.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8748999999999998e-05 2024-04-26T12:07:21.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:21.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577415+0000", 2024-04-26T12:07:21.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4913000000000005e-05 2024-04-26T12:07:21.927 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.927 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.927 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.928 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:539 3.2 3:4272d415:::200.0000000b:head [write 410547~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:21.928 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:21.928 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 27.384459989, 2024-04-26T12:07:21.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053372670999999997, 2024-04-26T12:07:21.928 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:21.928 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.928 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:21.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:21.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:21.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:21.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524192+0000", 2024-04-26T12:07:21.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:21.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524191+0000", 2024-04-26T12:07:21.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:21.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:21.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524199+0000", 2024-04-26T12:07:21.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6520000000000006e-06 2024-04-26T12:07:21.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:21.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524205+0000", 2024-04-26T12:07:21.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:07:21.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524209+0000", 2024-04-26T12:07:21.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.335e-06 2024-04-26T12:07:21.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:21.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572320+0000", 2024-04-26T12:07:21.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048110992999999998 2024-04-26T12:07:21.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:21.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572364+0000", 2024-04-26T12:07:21.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4577999999999999e-05 2024-04-26T12:07:21.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:21.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577426+0000", 2024-04-26T12:07:21.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050615139999999996 2024-04-26T12:07:21.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:21.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577480+0000", 2024-04-26T12:07:21.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3599e-05 2024-04-26T12:07:21.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:21.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577564+0000", 2024-04-26T12:07:21.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4699999999999999e-05 2024-04-26T12:07:21.932 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.932 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.932 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.932 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:540 3.2 3:4272d415:::200.0000000b:head [write 411948~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:21.932 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:21.933 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 27.384438971000002, 2024-04-26T12:07:21.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053497045999999999, 2024-04-26T12:07:21.933 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:21.933 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.933 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:21.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:21.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:21.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:21.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524213+0000", 2024-04-26T12:07:21.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:21.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524212+0000", 2024-04-26T12:07:21.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:21.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:21.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524215+0000", 2024-04-26T12:07:21.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.559e-06 2024-04-26T12:07:21.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:21.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524220+0000", 2024-04-26T12:07:21.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2920000000000003e-06 2024-04-26T12:07:21.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524224+0000", 2024-04-26T12:07:21.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3680000000000004e-06 2024-04-26T12:07:21.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:21.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572619+0000", 2024-04-26T12:07:21.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048394549000000002 2024-04-26T12:07:21.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:21.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572669+0000", 2024-04-26T12:07:21.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0249e-05 2024-04-26T12:07:21.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:21.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577575+0000", 2024-04-26T12:07:21.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049053329999999996 2024-04-26T12:07:21.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:21.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577625+0000", 2024-04-26T12:07:21.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0274e-05 2024-04-26T12:07:21.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:21.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577710+0000", 2024-04-26T12:07:21.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4741999999999996e-05 2024-04-26T12:07:21.937 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.937 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.937 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.937 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:543 3.2 3:4272d415:::200.0000000b:head [write 413907~2485 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:21.937 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:21.937 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 27.384369277000001, 2024-04-26T12:07:21.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053578708000000003, 2024-04-26T12:07:21.937 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:21.938 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.938 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:21.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:21.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:21.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:21.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:21.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:21.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524282+0000", 2024-04-26T12:07:21.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:21.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:21.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524287+0000", 2024-04-26T12:07:21.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2190000000000003e-06 2024-04-26T12:07:21.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:21.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524294+0000", 2024-04-26T12:07:21.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5660000000000003e-06 2024-04-26T12:07:21.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524298+0000", 2024-04-26T12:07:21.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3900000000000003e-06 2024-04-26T12:07:21.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:21.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.572992+0000", 2024-04-26T12:07:21.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048693835999999997 2024-04-26T12:07:21.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:21.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573045+0000", 2024-04-26T12:07:21.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2793000000000001e-05 2024-04-26T12:07:21.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:21.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577721+0000", 2024-04-26T12:07:21.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046760550000000001 2024-04-26T12:07:21.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:21.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577777+0000", 2024-04-26T12:07:21.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5908000000000001e-05 2024-04-26T12:07:21.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:21.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577861+0000", 2024-04-26T12:07:21.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4337000000000002e-05 2024-04-26T12:07:21.942 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.942 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.942 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.942 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:544 3.2 3:4272d415:::200.0000000b:head [write 416392~3872 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:21.942 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:21.942 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 27.384349555, 2024-04-26T12:07:21.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054810527999999997, 2024-04-26T12:07:21.942 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:21.942 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.942 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:21.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:21.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:21.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:21.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:21.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:21.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524302+0000", 2024-04-26T12:07:21.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:21.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:21.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524307+0000", 2024-04-26T12:07:21.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1580000000000004e-06 2024-04-26T12:07:21.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:21.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524312+0000", 2024-04-26T12:07:21.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6380000000000001e-06 2024-04-26T12:07:21.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524317+0000", 2024-04-26T12:07:21.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4000000000000002e-06 2024-04-26T12:07:21.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:21.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573348+0000", 2024-04-26T12:07:21.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049031433999999999 2024-04-26T12:07:21.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:21.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573393+0000", 2024-04-26T12:07:21.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4536999999999997e-05 2024-04-26T12:07:21.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:21.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578978+0000", 2024-04-26T12:07:21.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055848299999999998 2024-04-26T12:07:21.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:21.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579031+0000", 2024-04-26T12:07:21.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3708000000000001e-05 2024-04-26T12:07:21.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:21.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579113+0000", 2024-04-26T12:07:21.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1258e-05 2024-04-26T12:07:21.946 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.946 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.946 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.947 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:545 3.2 3:4272d415:::200.0000000b:head [write 420264~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:21.947 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:21.947 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 27.384330929000001, 2024-04-26T12:07:21.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054927386000000002, 2024-04-26T12:07:21.947 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:21.947 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.947 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:21.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:21.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:21.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:21.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524321+0000", 2024-04-26T12:07:21.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:21.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524320+0000", 2024-04-26T12:07:21.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:21.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:21.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524325+0000", 2024-04-26T12:07:21.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5249999999999999e-06 2024-04-26T12:07:21.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:21.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524330+0000", 2024-04-26T12:07:21.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5629999999999999e-06 2024-04-26T12:07:21.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524335+0000", 2024-04-26T12:07:21.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.685e-06 2024-04-26T12:07:21.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:21.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573727+0000", 2024-04-26T12:07:21.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049392034000000001 2024-04-26T12:07:21.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:21.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.573775+0000", 2024-04-26T12:07:21.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7435999999999998e-05 2024-04-26T12:07:21.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:21.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579120+0000", 2024-04-26T12:07:21.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0053452949999999999 2024-04-26T12:07:21.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:21.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579167+0000", 2024-04-26T12:07:21.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7240000000000002e-05 2024-04-26T12:07:21.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:21.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579248+0000", 2024-04-26T12:07:21.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0947999999999998e-05 2024-04-26T12:07:21.951 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.951 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.951 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.951 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 422222~8537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:21.952 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:21.952 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 27.384312611999999, 2024-04-26T12:07:21.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055065936000000003, 2024-04-26T12:07:21.952 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:21.952 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.952 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:21.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:21.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:21.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:21.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:21.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:21.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524339+0000", 2024-04-26T12:07:21.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:21.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:21.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524347+0000", 2024-04-26T12:07:21.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7129999999999994e-06 2024-04-26T12:07:21.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:21.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524357+0000", 2024-04-26T12:07:21.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0232e-05 2024-04-26T12:07:21.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524362+0000", 2024-04-26T12:07:21.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:07:21.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:21.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574119+0000", 2024-04-26T12:07:21.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049756727000000001 2024-04-26T12:07:21.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:21.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574166+0000", 2024-04-26T12:07:21.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7086000000000003e-05 2024-04-26T12:07:21.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:21.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579261+0000", 2024-04-26T12:07:21.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050948310000000002 2024-04-26T12:07:21.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:21.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579316+0000", 2024-04-26T12:07:21.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5068000000000002e-05 2024-04-26T12:07:21.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:21.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579405+0000", 2024-04-26T12:07:21.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9251000000000003e-05 2024-04-26T12:07:21.956 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.956 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.956 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.956 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 430759~2035 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:21.956 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:21.956 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 27.384285622, 2024-04-26T12:07:21.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055164950999999997, 2024-04-26T12:07:21.956 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:21.956 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.956 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:21.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:21.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:21.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:21.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:21.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:21.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524366+0000", 2024-04-26T12:07:21.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:21.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:21.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524368+0000", 2024-04-26T12:07:21.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.57e-06 2024-04-26T12:07:21.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:21.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524375+0000", 2024-04-26T12:07:21.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6170000000000003e-06 2024-04-26T12:07:21.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.524380+0000", 2024-04-26T12:07:21.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2700000000000004e-06 2024-04-26T12:07:21.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:21.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574639+0000", 2024-04-26T12:07:21.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050259459999999999 2024-04-26T12:07:21.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:21.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574687+0000", 2024-04-26T12:07:21.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7608999999999998e-05 2024-04-26T12:07:21.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:21.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579414+0000", 2024-04-26T12:07:21.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047268750000000002 2024-04-26T12:07:21.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:21.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579456+0000", 2024-04-26T12:07:21.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1885000000000003e-05 2024-04-26T12:07:21.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:21.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579531+0000", 2024-04-26T12:07:21.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5053000000000001e-05 2024-04-26T12:07:21.960 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.960 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.960 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.961 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 432794~10523 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:21.961 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:21.961 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 27.383294897999999, 2024-04-26T12:07:21.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054314727, 2024-04-26T12:07:21.961 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:21.961 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.961 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:21.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:21.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:21.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:21.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525357+0000", 2024-04-26T12:07:21.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:21.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525356+0000", 2024-04-26T12:07:21.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:21.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:21.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525414+0000", 2024-04-26T12:07:21.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8148e-05 2024-04-26T12:07:21.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:21.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525423+0000", 2024-04-26T12:07:21.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9749999999999996e-06 2024-04-26T12:07:21.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525428+0000", 2024-04-26T12:07:21.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0270000000000003e-06 2024-04-26T12:07:21.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:21.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.574950+0000", 2024-04-26T12:07:21.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049521840999999997 2024-04-26T12:07:21.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:21.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575002+0000", 2024-04-26T12:07:21.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1586999999999999e-05 2024-04-26T12:07:21.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:21.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579543+0000", 2024-04-26T12:07:21.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045416340000000001 2024-04-26T12:07:21.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:21.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579587+0000", 2024-04-26T12:07:21.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3875999999999998e-05 2024-04-26T12:07:21.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:21.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579671+0000", 2024-04-26T12:07:21.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4351999999999995e-05 2024-04-26T12:07:21.965 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.965 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.965 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.965 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 443317~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:21.965 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:21.965 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 27.383218923000001, 2024-04-26T12:07:21.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054381889000000003, 2024-04-26T12:07:21.965 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:21.965 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.965 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:21.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:21.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:21.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:21.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525433+0000", 2024-04-26T12:07:21.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:21.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525432+0000", 2024-04-26T12:07:21.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:21.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:21.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525435+0000", 2024-04-26T12:07:21.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3070000000000001e-06 2024-04-26T12:07:21.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:21.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525439+0000", 2024-04-26T12:07:21.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.104e-06 2024-04-26T12:07:21.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525442+0000", 2024-04-26T12:07:21.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0460000000000001e-06 2024-04-26T12:07:21.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:21.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575405+0000", 2024-04-26T12:07:21.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049963059999999997 2024-04-26T12:07:21.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:21.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575450+0000", 2024-04-26T12:07:21.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5034000000000003e-05 2024-04-26T12:07:21.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:21.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579680+0000", 2024-04-26T12:07:21.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042302260000000001 2024-04-26T12:07:21.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:21.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579737+0000", 2024-04-26T12:07:21.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7241000000000003e-05 2024-04-26T12:07:21.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:21.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579815+0000", 2024-04-26T12:07:21.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7278000000000001e-05 2024-04-26T12:07:21.969 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.969 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.969 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.970 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 445275~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:21.970 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:21.970 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 27.382791746999999, 2024-04-26T12:07:21.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054094668999999998, 2024-04-26T12:07:21.970 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:21.970 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.970 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:21.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:21.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:21.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:21.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525860+0000", 2024-04-26T12:07:21.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:21.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525859+0000", 2024-04-26T12:07:21.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:21.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:21.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525864+0000", 2024-04-26T12:07:21.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:07:21.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:21.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525872+0000", 2024-04-26T12:07:21.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6790000000000005e-06 2024-04-26T12:07:21.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.525877+0000", 2024-04-26T12:07:21.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0529999999999997e-06 2024-04-26T12:07:21.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:21.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575723+0000", 2024-04-26T12:07:21.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049846469999999997 2024-04-26T12:07:21.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:21.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.575770+0000", 2024-04-26T12:07:21.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6387999999999997e-05 2024-04-26T12:07:21.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:21.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579823+0000", 2024-04-26T12:07:21.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0040534189999999999 2024-04-26T12:07:21.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:21.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579869+0000", 2024-04-26T12:07:21.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6218999999999999e-05 2024-04-26T12:07:21.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:21.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579954+0000", 2024-04-26T12:07:21.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5315999999999994e-05 2024-04-26T12:07:21.974 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.974 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.974 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.974 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:551 3.2 3:4272d415:::200.0000000b:head [write 448232~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:21.974 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:21.974 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 27.382344313000001, 2024-04-26T12:07:21.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053798273000000001, 2024-04-26T12:07:21.974 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:21.974 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.974 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:21.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:21.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:21.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:21.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:21.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:21.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526307+0000", 2024-04-26T12:07:21.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:21.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:21.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526310+0000", 2024-04-26T12:07:21.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5279999999999999e-06 2024-04-26T12:07:21.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:21.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526317+0000", 2024-04-26T12:07:21.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8430000000000004e-06 2024-04-26T12:07:21.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526322+0000", 2024-04-26T12:07:21.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3340000000000001e-06 2024-04-26T12:07:21.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:21.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576135+0000", 2024-04-26T12:07:21.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049812113999999998 2024-04-26T12:07:21.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:21.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576186+0000", 2024-04-26T12:07:21.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1443999999999997e-05 2024-04-26T12:07:21.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:21.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.579962+0000", 2024-04-26T12:07:21.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037763359999999999 2024-04-26T12:07:21.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:21.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580016+0000", 2024-04-26T12:07:21.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3421000000000002e-05 2024-04-26T12:07:21.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:21.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580106+0000", 2024-04-26T12:07:21.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9790000000000006e-05 2024-04-26T12:07:21.978 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.978 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.978 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.978 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 450189~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:21.979 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:21.979 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 27.382264184, 2024-04-26T12:07:21.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055070796999999998, 2024-04-26T12:07:21.979 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:21.979 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.979 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:21.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:21.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:21.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:21.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:21.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:21.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526387+0000", 2024-04-26T12:07:21.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:21.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:21.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526390+0000", 2024-04-26T12:07:21.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8559999999999998e-06 2024-04-26T12:07:21.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:21.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526395+0000", 2024-04-26T12:07:21.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3319999999999999e-06 2024-04-26T12:07:21.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526399+0000", 2024-04-26T12:07:21.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.619e-06 2024-04-26T12:07:21.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:21.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576476+0000", 2024-04-26T12:07:21.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050077643999999998 2024-04-26T12:07:21.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:21.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.576524+0000", 2024-04-26T12:07:21.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7184000000000001e-05 2024-04-26T12:07:21.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:21.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581347+0000", 2024-04-26T12:07:21.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0048231919999999996 2024-04-26T12:07:21.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:21.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581398+0000", 2024-04-26T12:07:21.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1345999999999999e-05 2024-04-26T12:07:21.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:21.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581458+0000", 2024-04-26T12:07:21.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0081000000000003e-05 2024-04-26T12:07:21.983 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.983 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.983 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.983 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 452113~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:21.983 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:21.983 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 27.382152968, 2024-04-26T12:07:21.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055041448, 2024-04-26T12:07:21.983 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:21.983 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.983 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:21.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:21.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:21.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:21.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526499+0000", 2024-04-26T12:07:21.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:21.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526498+0000", 2024-04-26T12:07:21.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:21.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:21.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526540+0000", 2024-04-26T12:07:21.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2267e-05 2024-04-26T12:07:21.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:21.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526547+0000", 2024-04-26T12:07:21.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7000000000000002e-06 2024-04-26T12:07:21.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.526550+0000", 2024-04-26T12:07:21.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0299999999999998e-06 2024-04-26T12:07:21.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:21.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577902+0000", 2024-04-26T12:07:21.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051351648999999999 2024-04-26T12:07:21.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:21.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.577953+0000", 2024-04-26T12:07:21.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1289000000000003e-05 2024-04-26T12:07:21.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:21.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581464+0000", 2024-04-26T12:07:21.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035111259999999998 2024-04-26T12:07:21.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:21.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581490+0000", 2024-04-26T12:07:21.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5717000000000001e-05 2024-04-26T12:07:21.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:21.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581540+0000", 2024-04-26T12:07:21.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0287999999999997e-05 2024-04-26T12:07:21.987 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.987 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.987 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.987 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 454070~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:21.988 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:21.988 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 27.381596019, 2024-04-26T12:07:21.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.054564161, 2024-04-26T12:07:21.988 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:21.988 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.988 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:21.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:21.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:21.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:21.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527056+0000", 2024-04-26T12:07:21.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:21.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527055+0000", 2024-04-26T12:07:21.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:21.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:21.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527058+0000", 2024-04-26T12:07:21.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9890000000000001e-06 2024-04-26T12:07:21.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:21.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527066+0000", 2024-04-26T12:07:21.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4730000000000003e-06 2024-04-26T12:07:21.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.527069+0000", 2024-04-26T12:07:21.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5810000000000001e-06 2024-04-26T12:07:21.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:21.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578308+0000", 2024-04-26T12:07:21.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051238911999999998 2024-04-26T12:07:21.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:21.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.578391+0000", 2024-04-26T12:07:21.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2713999999999994e-05 2024-04-26T12:07:21.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:21.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581548+0000", 2024-04-26T12:07:21.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031577530000000001 2024-04-26T12:07:21.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:21.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581574+0000", 2024-04-26T12:07:21.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5350999999999998e-05 2024-04-26T12:07:21.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:21.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581620+0000", 2024-04-26T12:07:21.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5868999999999997e-05 2024-04-26T12:07:21.991 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.992 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.992 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.992 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 456028~3870 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:21.992 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:21.992 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 27.379839777000001, 2024-04-26T12:07:21.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055118997000000003, 2024-04-26T12:07:21.992 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:21.992 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.993 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:21.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:21.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:21.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:21.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528812+0000", 2024-04-26T12:07:21.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:21.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528811+0000", 2024-04-26T12:07:21.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:21.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:21.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528887+0000", 2024-04-26T12:07:21.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5977999999999997e-05 2024-04-26T12:07:21.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:21.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528897+0000", 2024-04-26T12:07:21.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8730000000000002e-06 2024-04-26T12:07:21.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.528901+0000", 2024-04-26T12:07:21.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4880000000000001e-06 2024-04-26T12:07:21.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:21.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580146+0000", 2024-04-26T12:07:21.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051244242000000002 2024-04-26T12:07:21.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:21.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580227+0000", 2024-04-26T12:07:21.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1044000000000005e-05 2024-04-26T12:07:21.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:21.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583864+0000", 2024-04-26T12:07:21.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036374419999999998 2024-04-26T12:07:21.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:21.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583894+0000", 2024-04-26T12:07:21.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9828999999999999e-05 2024-04-26T12:07:21.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:21.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.583931+0000", 2024-04-26T12:07:21.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6908e-05 2024-04-26T12:07:21.996 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.996 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:21.996 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:21.997 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.997 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 459898~2037 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:21.997 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:21.997 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 27.379451786000001, 2024-04-26T12:07:21.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055925713000000002, 2024-04-26T12:07:21.997 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:21.997 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:21.997 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:21.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.997 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:21.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:21.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.997 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:21.998 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529200+0000", 2024-04-26T12:07:21.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:21.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:21.998 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529199+0000", 2024-04-26T12:07:21.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:21.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:21.998 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529203+0000", 2024-04-26T12:07:21.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:07:21.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:21.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529209+0000", 2024-04-26T12:07:21.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7939999999999999e-06 2024-04-26T12:07:21.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:21.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529212+0000", 2024-04-26T12:07:21.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7290000000000002e-06 2024-04-26T12:07:21.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:21.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:21.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580784+0000", 2024-04-26T12:07:21.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051572073000000003 2024-04-26T12:07:21.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:21.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:22.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:22.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.580883+0000", 2024-04-26T12:07:22.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8330000000000002e-05 2024-04-26T12:07:22.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:22.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:22.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:22.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585050+0000", 2024-04-26T12:07:22.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041670209999999999 2024-04-26T12:07:22.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:22.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:22.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:22.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585088+0000", 2024-04-26T12:07:22.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8559999999999997e-05 2024-04-26T12:07:22.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:22.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:22.001 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:22.001 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585125+0000", 2024-04-26T12:07:22.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7197999999999999e-05 2024-04-26T12:07:22.001 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:22.001 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:22.001 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:22.001 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:22.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:22.001 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 461935~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:07:22.001 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:22.001 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 27.378729331999999, 2024-04-26T12:07:22.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055266150999999999, 2024-04-26T12:07:22.001 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-04-26T12:07:22.001 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:22.001 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-04-26T12:07:22.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:22.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-04-26T12:07:22.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:22.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:22.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:22.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:22.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-04-26T12:07:22.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529922+0000", 2024-04-26T12:07:22.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-04-26T12:07:22.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:22.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:22.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-04-26T12:07:22.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529921+0000", 2024-04-26T12:07:22.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4294967295.999999 2024-04-26T12:07:22.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:22.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:22.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-04-26T12:07:22.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529956+0000", 2024-04-26T12:07:22.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4687000000000002e-05 2024-04-26T12:07:22.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:22.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:22.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-04-26T12:07:22.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529966+0000", 2024-04-26T12:07:22.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0392e-05 2024-04-26T12:07:22.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:22.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:22.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-04-26T12:07:22.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.529978+0000", 2024-04-26T12:07:22.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1348e-05 2024-04-26T12:07:22.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:22.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:22.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-04-26T12:07:22.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581659+0000", 2024-04-26T12:07:22.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051681454000000002 2024-04-26T12:07:22.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:22.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:22.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-04-26T12:07:22.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.581746+0000", 2024-04-26T12:07:22.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6305999999999997e-05 2024-04-26T12:07:22.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:22.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:22.005 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-04-26T12:07:22.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585131+0000", 2024-04-26T12:07:22.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033853199999999998 2024-04-26T12:07:22.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:22.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:22.005 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-04-26T12:07:22.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585154+0000", 2024-04-26T12:07:22.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3258999999999999e-05 2024-04-26T12:07:22.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-04-26T12:07:22.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-04-26T12:07:22.005 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-04-26T12:07:22.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-04-26T12:06:54.585188+0000", 2024-04-26T12:07:22.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4236000000000002e-05 2024-04-26T12:07:22.006 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:22.006 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:22.006 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:22.006 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-04-26T12:07:22.006 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-04-26T12:07:22.006 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-04-26T12:07:22.007 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:07:22.112 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:22.112 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:22.112 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T12:07:22.112 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:22.121 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:07:22.208 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~65s 2024-04-26T12:07:22.222 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:22.222 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T12:07:22.222 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T12:07:22.223 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T12:07:22.223 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:22.231 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:07:22.334 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T12:07:22.334 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T12:07:22.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T12:07:22.334 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T12:07:22.334 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.334 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2989 3.d 3:b02ffd62:::200.00000010:head [write 3767903~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:22.335 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:22.335 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.815556989000001, 2024-04-26T12:07:22.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057069768999999999, 2024-04-26T12:07:22.335 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:22.335 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:22.335 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:22.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:22.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:22.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:22.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:22.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:22.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516442+0000", 2024-04-26T12:07:22.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:22.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:22.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516446+0000", 2024-04-26T12:07:22.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6469999999999997e-06 2024-04-26T12:07:22.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:22.337 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516449+0000", 2024-04-26T12:07:22.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.976e-06 2024-04-26T12:07:22.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:22.337 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516452+0000", 2024-04-26T12:07:22.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.509e-06 2024-04-26T12:07:22.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:22.337 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.568562+0000", 2024-04-26T12:07:22.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.052110030000000002 2024-04-26T12:07:22.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:22.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.568615+0000", 2024-04-26T12:07:22.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2809999999999998e-05 2024-04-26T12:07:22.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:22.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573425+0000", 2024-04-26T12:07:22.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048105149999999996 2024-04-26T12:07:22.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:22.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573452+0000", 2024-04-26T12:07:22.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6778e-05 2024-04-26T12:07:22.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:22.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573512+0000", 2024-04-26T12:07:22.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9710000000000003e-05 2024-04-26T12:07:22.339 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.339 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:22.339 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.339 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2990 3.d 3:b02ffd62:::200.00000010:head [write 3769302~4483 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:22.339 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:22.339 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.815544989999999, 2024-04-26T12:07:22.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057131345, 2024-04-26T12:07:22.340 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:22.340 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:22.340 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:22.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.340 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:22.340 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:22.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.340 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:22.340 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:22.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.340 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:22.340 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516454+0000", 2024-04-26T12:07:22.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:22.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:22.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516459+0000", 2024-04-26T12:07:22.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2859999999999999e-06 2024-04-26T12:07:22.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:22.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516462+0000", 2024-04-26T12:07:22.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0790000000000001e-06 2024-04-26T12:07:22.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:22.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516465+0000", 2024-04-26T12:07:22.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.464e-06 2024-04-26T12:07:22.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:22.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569035+0000", 2024-04-26T12:07:22.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.052570328999999999 2024-04-26T12:07:22.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:22.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569113+0000", 2024-04-26T12:07:22.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8118e-05 2024-04-26T12:07:22.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:22.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573517+0000", 2024-04-26T12:07:22.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044039200000000004 2024-04-26T12:07:22.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:22.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573541+0000", 2024-04-26T12:07:22.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3805999999999999e-05 2024-04-26T12:07:22.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:22.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573585+0000", 2024-04-26T12:07:22.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4567000000000002e-05 2024-04-26T12:07:22.343 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.343 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:22.343 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.344 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2991 3.d 3:b02ffd62:::200.00000010:head [write 3773785~4213 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:22.344 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:22.344 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.815532301000001, 2024-04-26T12:07:22.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057230554000000003, 2024-04-26T12:07:22.344 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:22.344 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:22.344 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:22.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:22.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:22.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:22.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516467+0000", 2024-04-26T12:07:22.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:22.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516466+0000", 2024-04-26T12:07:22.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:22.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:22.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516470+0000", 2024-04-26T12:07:22.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7960000000000002e-06 2024-04-26T12:07:22.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.346 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:22.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516478+0000", 2024-04-26T12:07:22.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:07:22.346 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.346 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:22.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.516484+0000", 2024-04-26T12:07:22.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5300000000000002e-06 2024-04-26T12:07:22.346 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.346 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:22.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569662+0000", 2024-04-26T12:07:22.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053177896000000002 2024-04-26T12:07:22.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:22.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.569749+0000", 2024-04-26T12:07:22.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7229000000000001e-05 2024-04-26T12:07:22.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:22.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573593+0000", 2024-04-26T12:07:22.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038433109999999999 2024-04-26T12:07:22.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:22.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573631+0000", 2024-04-26T12:07:22.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8615000000000002e-05 2024-04-26T12:07:22.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.348 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:22.348 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.573697+0000", 2024-04-26T12:07:22.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5971999999999998e-05 2024-04-26T12:07:22.348 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.348 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:22.348 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.348 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2999 3.d 3:b02ffd62:::200.00000010:head [write 3797283~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:22.348 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:22.348 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.811017913000001, 2024-04-26T12:07:22.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057330949999999999, 2024-04-26T12:07:22.348 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:22.349 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:22.349 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:22.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:22.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:22.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:22.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520981+0000", 2024-04-26T12:07:22.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:22.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520980+0000", 2024-04-26T12:07:22.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:22.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:22.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.520991+0000", 2024-04-26T12:07:22.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1154e-05 2024-04-26T12:07:22.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:22.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521014+0000", 2024-04-26T12:07:22.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2288000000000001e-05 2024-04-26T12:07:22.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:22.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521019+0000", 2024-04-26T12:07:22.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0889999999999999e-06 2024-04-26T12:07:22.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:22.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.575399+0000", 2024-04-26T12:07:22.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054380392999999999 2024-04-26T12:07:22.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:22.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.575440+0000", 2024-04-26T12:07:22.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1146000000000002e-05 2024-04-26T12:07:22.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:22.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578237+0000", 2024-04-26T12:07:22.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002796761 2024-04-26T12:07:22.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:22.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578260+0000", 2024-04-26T12:07:22.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3538999999999999e-05 2024-04-26T12:07:22.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:22.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578312+0000", 2024-04-26T12:07:22.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1508999999999998e-05 2024-04-26T12:07:22.353 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.353 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:22.353 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.353 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.353 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3000 3.d 3:b02ffd62:::200.00000010:head [write 3801160~9028 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:22.353 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:22.353 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.810391946999999, 2024-04-26T12:07:22.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.059231688999999997, 2024-04-26T12:07:22.353 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:22.353 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:22.353 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:22.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.353 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:22.353 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:22.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:22.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521607+0000", 2024-04-26T12:07:22.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:22.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521606+0000", 2024-04-26T12:07:22.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:22.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:22.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521627+0000", 2024-04-26T12:07:22.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1129e-05 2024-04-26T12:07:22.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:22.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521637+0000", 2024-04-26T12:07:22.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8789999999999998e-06 2024-04-26T12:07:22.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:22.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.521644+0000", 2024-04-26T12:07:22.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:07:22.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:22.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576381+0000", 2024-04-26T12:07:22.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.05473629 2024-04-26T12:07:22.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:22.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576451+0000", 2024-04-26T12:07:22.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0525000000000007e-05 2024-04-26T12:07:22.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:22.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580734+0000", 2024-04-26T12:07:22.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042826699999999997 2024-04-26T12:07:22.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:22.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580780+0000", 2024-04-26T12:07:22.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6006e-05 2024-04-26T12:07:22.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.357 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:22.357 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.580839+0000", 2024-04-26T12:07:22.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8783000000000003e-05 2024-04-26T12:07:22.357 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.357 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:22.357 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.357 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3001 3.d 3:b02ffd62:::200.00000010:head [write 3810188~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:22.357 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:22.357 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.809839615000001, 2024-04-26T12:07:22.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.060161213999999998, 2024-04-26T12:07:22.357 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:22.357 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:22.358 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:22.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:22.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:22.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:22.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522159+0000", 2024-04-26T12:07:22.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:22.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522158+0000", 2024-04-26T12:07:22.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:22.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:22.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522165+0000", 2024-04-26T12:07:22.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.28e-06 2024-04-26T12:07:22.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:22.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522178+0000", 2024-04-26T12:07:22.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3738e-05 2024-04-26T12:07:22.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:22.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522186+0000", 2024-04-26T12:07:22.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.267e-06 2024-04-26T12:07:22.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:22.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576889+0000", 2024-04-26T12:07:22.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054703442999999997 2024-04-26T12:07:22.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:22.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.576953+0000", 2024-04-26T12:07:22.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4213000000000003e-05 2024-04-26T12:07:22.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:22.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582185+0000", 2024-04-26T12:07:22.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052319209999999996 2024-04-26T12:07:22.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:22.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582243+0000", 2024-04-26T12:07:22.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7321999999999998e-05 2024-04-26T12:07:22.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:22.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582321+0000", 2024-04-26T12:07:22.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7911000000000007e-05 2024-04-26T12:07:22.361 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.361 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:22.361 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.362 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3002 3.d 3:b02ffd62:::200.00000010:head [write 3812103~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:22.362 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:22.362 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.809370852000001, 2024-04-26T12:07:22.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.059796961000000003, 2024-04-26T12:07:22.362 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:22.362 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:22.362 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:22.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.362 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:22.362 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:22.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:22.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522628+0000", 2024-04-26T12:07:22.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:22.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522627+0000", 2024-04-26T12:07:22.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:22.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:22.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522633+0000", 2024-04-26T12:07:22.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6699999999999999e-06 2024-04-26T12:07:22.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:22.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522643+0000", 2024-04-26T12:07:22.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6649999999999998e-06 2024-04-26T12:07:22.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:22.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.522649+0000", 2024-04-26T12:07:22.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4200000000000004e-06 2024-04-26T12:07:22.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:22.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577413+0000", 2024-04-26T12:07:22.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054763714999999998 2024-04-26T12:07:22.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:22.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577460+0000", 2024-04-26T12:07:22.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7095000000000002e-05 2024-04-26T12:07:22.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:22.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582331+0000", 2024-04-26T12:07:22.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048716419999999998 2024-04-26T12:07:22.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:22.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582375+0000", 2024-04-26T12:07:22.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3053999999999998e-05 2024-04-26T12:07:22.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:22.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582425+0000", 2024-04-26T12:07:22.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0525000000000002e-05 2024-04-26T12:07:22.366 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.366 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:22.366 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.366 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3003 3.d 3:b02ffd62:::200.00000010:head [write 3814061~4170 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:22.366 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:22.366 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.808315790000002, 2024-04-26T12:07:22.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058803394000000002, 2024-04-26T12:07:22.366 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:22.366 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:22.367 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:22.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:22.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:22.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:22.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523683+0000", 2024-04-26T12:07:22.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:22.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523682+0000", 2024-04-26T12:07:22.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T12:07:22.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:22.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523690+0000", 2024-04-26T12:07:22.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0290000000000005e-06 2024-04-26T12:07:22.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:22.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523699+0000", 2024-04-26T12:07:22.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4589999999999998e-06 2024-04-26T12:07:22.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:22.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.523703+0000", 2024-04-26T12:07:22.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6249999999999998e-06 2024-04-26T12:07:22.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:22.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577832+0000", 2024-04-26T12:07:22.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.054128883000000003 2024-04-26T12:07:22.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:22.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.577878+0000", 2024-04-26T12:07:22.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5841999999999999e-05 2024-04-26T12:07:22.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:22.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582430+0000", 2024-04-26T12:07:22.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045517270000000002 2024-04-26T12:07:22.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:22.370 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582453+0000", 2024-04-26T12:07:22.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3609999999999999e-05 2024-04-26T12:07:22.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:22.370 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582487+0000", 2024-04-26T12:07:22.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3080000000000002e-05 2024-04-26T12:07:22.370 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.370 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:22.370 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.370 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3004 3.d 3:b02ffd62:::200.00000010:head [write 3818231~3890 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:22.371 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:22.371 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.807466866999999, 2024-04-26T12:07:22.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058024342999999999, 2024-04-26T12:07:22.371 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:22.371 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:22.371 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:22.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:22.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:22.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:22.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524532+0000", 2024-04-26T12:07:22.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:22.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524531+0000", 2024-04-26T12:07:22.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:22.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:22.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524539+0000", 2024-04-26T12:07:22.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9249999999999995e-06 2024-04-26T12:07:22.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:22.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524547+0000", 2024-04-26T12:07:22.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5220000000000007e-06 2024-04-26T12:07:22.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.373 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:22.373 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524553+0000", 2024-04-26T12:07:22.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6659999999999996e-06 2024-04-26T12:07:22.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.373 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:22.373 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578335+0000", 2024-04-26T12:07:22.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.05378235 2024-04-26T12:07:22.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.373 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:22.373 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578378+0000", 2024-04-26T12:07:22.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2429999999999999e-05 2024-04-26T12:07:22.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:22.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582494+0000", 2024-04-26T12:07:22.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004116059 2024-04-26T12:07:22.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:22.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582519+0000", 2024-04-26T12:07:22.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4961999999999999e-05 2024-04-26T12:07:22.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:22.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582556+0000", 2024-04-26T12:07:22.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7728999999999997e-05 2024-04-26T12:07:22.375 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.375 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:22.375 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.375 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.375 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.375 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3005 3.d 3:b02ffd62:::200.00000010:head [write 3822121~5207 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:22.375 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:22.375 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.807047611000002, 2024-04-26T12:07:22.375 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057662270000000002, 2024-04-26T12:07:22.375 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:22.375 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:22.375 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:22.375 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.375 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:22.375 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:22.375 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.376 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.376 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.376 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:22.376 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:22.376 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.376 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.376 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.376 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:22.376 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524951+0000", 2024-04-26T12:07:22.376 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:22.376 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.376 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.376 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:22.376 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524961+0000", 2024-04-26T12:07:22.376 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0124e-05 2024-04-26T12:07:22.376 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.377 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.377 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:22.377 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524971+0000", 2024-04-26T12:07:22.377 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0200999999999999e-05 2024-04-26T12:07:22.377 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.377 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.377 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:22.377 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.524979+0000", 2024-04-26T12:07:22.377 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5809999999999999e-06 2024-04-26T12:07:22.377 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.377 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.377 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:22.377 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578753+0000", 2024-04-26T12:07:22.377 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053774444999999997 2024-04-26T12:07:22.377 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.377 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.378 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:22.378 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.578821+0000", 2024-04-26T12:07:22.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7640999999999998e-05 2024-04-26T12:07:22.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.378 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.378 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:22.378 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582561+0000", 2024-04-26T12:07:22.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037399870000000002 2024-04-26T12:07:22.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.378 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.378 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:22.378 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582582+0000", 2024-04-26T12:07:22.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0934999999999999e-05 2024-04-26T12:07:22.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.378 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.379 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:22.379 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582614+0000", 2024-04-26T12:07:22.379 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1948e-05 2024-04-26T12:07:22.379 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.379 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:22.379 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.379 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.379 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3006 3.d 3:b02ffd62:::200.00000010:head [write 3827328~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T12:07:22.379 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:22.379 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.806414272000001, 2024-04-26T12:07:22.379 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057085404999999999, 2024-04-26T12:07:22.379 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:22.379 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:22.379 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:22.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.380 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:22.380 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:22.380 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.380 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.380 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:22.380 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525585+0000", 2024-04-26T12:07:22.380 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.380 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.380 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:22.380 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525583+0000", 2024-04-26T12:07:22.380 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:22.380 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.381 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:22.381 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525594+0000", 2024-04-26T12:07:22.381 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0497e-05 2024-04-26T12:07:22.381 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.381 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.381 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:22.381 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525610+0000", 2024-04-26T12:07:22.381 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6392000000000002e-05 2024-04-26T12:07:22.381 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.381 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.381 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:22.381 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.525621+0000", 2024-04-26T12:07:22.381 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0679999999999999e-05 2024-04-26T12:07:22.381 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.381 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.381 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:22.382 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.579270+0000", 2024-04-26T12:07:22.382 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.053648802000000002 2024-04-26T12:07:22.382 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.382 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.382 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:22.382 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.579312+0000", 2024-04-26T12:07:22.382 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2268000000000003e-05 2024-04-26T12:07:22.382 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.382 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.382 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:22.382 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582618+0000", 2024-04-26T12:07:22.382 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033057049999999999 2024-04-26T12:07:22.382 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.382 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.382 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:22.383 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582637+0000", 2024-04-26T12:07:22.383 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9417000000000001e-05 2024-04-26T12:07:22.383 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.383 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.383 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:22.383 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.582670+0000", 2024-04-26T12:07:22.383 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2969999999999998e-05 2024-04-26T12:07:22.383 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.383 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:22.383 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.383 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.383 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.383 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3015 3.d 3:b02ffd62:::200.00000010:head [write 3855113~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:22.383 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:22.383 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.795958514999999, 2024-04-26T12:07:22.383 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057652729999999999, 2024-04-26T12:07:22.384 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:22.384 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:22.384 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:22.384 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.384 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:22.384 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:22.384 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.384 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.384 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.384 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:22.384 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:22.384 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.384 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.384 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.384 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:22.385 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536040+0000", 2024-04-26T12:07:22.385 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:22.385 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.385 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.385 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:22.385 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536042+0000", 2024-04-26T12:07:22.385 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0849999999999999e-06 2024-04-26T12:07:22.385 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.385 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.385 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:22.385 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536046+0000", 2024-04-26T12:07:22.385 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:07:22.385 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.385 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.385 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:22.386 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536048+0000", 2024-04-26T12:07:22.386 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6019999999999998e-06 2024-04-26T12:07:22.386 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.386 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.386 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:22.386 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585409+0000", 2024-04-26T12:07:22.386 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.049360938 2024-04-26T12:07:22.386 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.386 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.386 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:22.386 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585506+0000", 2024-04-26T12:07:22.386 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6966999999999995e-05 2024-04-26T12:07:22.386 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.386 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.386 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:22.387 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593630+0000", 2024-04-26T12:07:22.387 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0081238160000000007 2024-04-26T12:07:22.387 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.387 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.387 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:22.387 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593656+0000", 2024-04-26T12:07:22.387 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6154000000000001e-05 2024-04-26T12:07:22.387 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.387 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.387 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:22.387 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593693+0000", 2024-04-26T12:07:22.387 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7185999999999999e-05 2024-04-26T12:07:22.387 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.387 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:22.387 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.388 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.388 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.388 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3016 3.d 3:b02ffd62:::200.00000010:head [write 3857020~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:22.388 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:22.388 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.795948568, 2024-04-26T12:07:22.388 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058678157000000002, 2024-04-26T12:07:22.388 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:22.388 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:22.388 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:22.388 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.388 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:22.388 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:22.388 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.388 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.388 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.389 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:22.389 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:22.389 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.389 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.389 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.389 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:22.389 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536050+0000", 2024-04-26T12:07:22.389 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:22.389 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.389 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.389 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:22.389 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536055+0000", 2024-04-26T12:07:22.389 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3669999999999999e-06 2024-04-26T12:07:22.389 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.389 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.390 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:22.390 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536058+0000", 2024-04-26T12:07:22.390 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3220000000000001e-06 2024-04-26T12:07:22.390 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.390 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.390 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:22.390 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536062+0000", 2024-04-26T12:07:22.390 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1520000000000002e-06 2024-04-26T12:07:22.390 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.390 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.390 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:22.390 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.585965+0000", 2024-04-26T12:07:22.390 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.049902769999999999 2024-04-26T12:07:22.390 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.390 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.391 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:22.391 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586046+0000", 2024-04-26T12:07:22.391 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1032999999999995e-05 2024-04-26T12:07:22.391 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.391 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.391 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:22.391 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594667+0000", 2024-04-26T12:07:22.391 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0086214599999999992 2024-04-26T12:07:22.391 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.391 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.391 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:22.391 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594692+0000", 2024-04-26T12:07:22.391 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5191999999999999e-05 2024-04-26T12:07:22.391 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.391 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.391 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:22.392 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594729+0000", 2024-04-26T12:07:22.392 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6069000000000003e-05 2024-04-26T12:07:22.392 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.392 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:22.392 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.392 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.392 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.392 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3017 3.d 3:b02ffd62:::200.00000010:head [write 3859438~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:22.392 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:22.392 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.795934484, 2024-04-26T12:07:22.392 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058723814999999999, 2024-04-26T12:07:22.392 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:22.392 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:22.392 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:22.392 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.393 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:22.393 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:22.393 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.393 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.393 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.393 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:22.393 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:22.393 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.393 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.393 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.393 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:22.393 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536064+0000", 2024-04-26T12:07:22.393 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967296 2024-04-26T12:07:22.393 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.393 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.394 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:22.394 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536066+0000", 2024-04-26T12:07:22.394 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8840000000000001e-06 2024-04-26T12:07:22.394 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.394 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.394 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:22.394 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536069+0000", 2024-04-26T12:07:22.394 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:07:22.394 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.394 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.394 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:22.394 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536072+0000", 2024-04-26T12:07:22.394 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4449999999999999e-06 2024-04-26T12:07:22.394 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.395 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.395 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:22.395 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586703+0000", 2024-04-26T12:07:22.395 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050631618000000003 2024-04-26T12:07:22.395 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.395 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.395 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:22.395 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.586748+0000", 2024-04-26T12:07:22.395 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4682999999999999e-05 2024-04-26T12:07:22.395 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.395 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.395 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:22.395 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594734+0000", 2024-04-26T12:07:22.395 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079860369999999996 2024-04-26T12:07:22.395 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.395 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.396 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:22.396 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594756+0000", 2024-04-26T12:07:22.396 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1738000000000001e-05 2024-04-26T12:07:22.396 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.396 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.396 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:22.396 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594788+0000", 2024-04-26T12:07:22.396 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2604999999999997e-05 2024-04-26T12:07:22.396 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.396 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:22.396 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.396 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.396 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.396 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3018 3.d 3:b02ffd62:::200.00000010:head [write 3861345~3221 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:22.396 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:22.397 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.795101797000001, 2024-04-26T12:07:22.397 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057946174000000003, 2024-04-26T12:07:22.397 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:22.397 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:22.397 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:22.397 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.397 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:22.397 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:22.397 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.397 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.397 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.397 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:22.397 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536897+0000", 2024-04-26T12:07:22.397 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.397 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.398 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.398 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:22.398 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536896+0000", 2024-04-26T12:07:22.398 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:22.398 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.398 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.398 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:22.398 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536905+0000", 2024-04-26T12:07:22.398 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7839999999999998e-06 2024-04-26T12:07:22.398 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.398 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.398 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:22.398 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536929+0000", 2024-04-26T12:07:22.398 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3561999999999999e-05 2024-04-26T12:07:22.398 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.399 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.399 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:22.399 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.536940+0000", 2024-04-26T12:07:22.399 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0742e-05 2024-04-26T12:07:22.399 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.399 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.399 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:22.399 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.587238+0000", 2024-04-26T12:07:22.399 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050297962000000002 2024-04-26T12:07:22.399 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.399 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.399 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:22.399 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.587315+0000", 2024-04-26T12:07:22.399 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7848000000000004e-05 2024-04-26T12:07:22.399 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.400 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.400 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:22.400 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594792+0000", 2024-04-26T12:07:22.400 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074766240000000003 2024-04-26T12:07:22.400 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.400 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.400 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:22.400 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594813+0000", 2024-04-26T12:07:22.400 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0876000000000001e-05 2024-04-26T12:07:22.400 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.400 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.400 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:22.400 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594843+0000", 2024-04-26T12:07:22.400 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0434999999999999e-05 2024-04-26T12:07:22.400 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.401 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:22.401 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.401 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.401 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.401 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3019 3.d 3:b02ffd62:::200.00000010:head [write 3864566~3989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:22.401 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:22.401 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.793359436999999, 2024-04-26T12:07:22.401 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.061000094999999997, 2024-04-26T12:07:22.401 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:22.401 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:22.401 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:22.401 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.401 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:22.401 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:22.401 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.402 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.402 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.402 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:22.402 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538640+0000", 2024-04-26T12:07:22.402 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.402 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.402 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.402 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:22.402 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538638+0000", 2024-04-26T12:07:22.402 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999981 2024-04-26T12:07:22.402 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.402 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.402 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:22.402 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538669+0000", 2024-04-26T12:07:22.402 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1689000000000001e-05 2024-04-26T12:07:22.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.403 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:22.403 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538703+0000", 2024-04-26T12:07:22.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3309000000000002e-05 2024-04-26T12:07:22.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.403 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:22.403 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.538746+0000", 2024-04-26T12:07:22.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2803999999999999e-05 2024-04-26T12:07:22.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.403 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:22.403 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.589467+0000", 2024-04-26T12:07:22.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.050721912000000001 2024-04-26T12:07:22.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:22.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.589517+0000", 2024-04-26T12:07:22.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9549999999999998e-05 2024-04-26T12:07:22.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:22.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599577+0000", 2024-04-26T12:07:22.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010059593 2024-04-26T12:07:22.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:22.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599603+0000", 2024-04-26T12:07:22.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6821e-05 2024-04-26T12:07:22.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.405 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:22.405 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599640+0000", 2024-04-26T12:07:22.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6177999999999998e-05 2024-04-26T12:07:22.405 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.405 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:22.405 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.405 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3020 3.d 3:b02ffd62:::200.00000010:head [write 3868555~7563 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:22.405 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:22.405 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.790746601999999, 2024-04-26T12:07:22.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058446867, 2024-04-26T12:07:22.405 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:22.406 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:22.406 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:22.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:22.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:22.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:22.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541252+0000", 2024-04-26T12:07:22.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:22.407 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541251+0000", 2024-04-26T12:07:22.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:22.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.407 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:22.407 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541286+0000", 2024-04-26T12:07:22.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4845999999999998e-05 2024-04-26T12:07:22.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.407 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:22.407 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541300+0000", 2024-04-26T12:07:22.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4251e-05 2024-04-26T12:07:22.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.407 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:22.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541307+0000", 2024-04-26T12:07:22.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3819999999999998e-06 2024-04-26T12:07:22.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:22.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.592596+0000", 2024-04-26T12:07:22.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051288215999999998 2024-04-26T12:07:22.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:22.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.592675+0000", 2024-04-26T12:07:22.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9197999999999996e-05 2024-04-26T12:07:22.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:22.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599645+0000", 2024-04-26T12:07:22.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069701759999999998 2024-04-26T12:07:22.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:22.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599667+0000", 2024-04-26T12:07:22.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2118999999999999e-05 2024-04-26T12:07:22.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:22.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599699+0000", 2024-04-26T12:07:22.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2048999999999998e-05 2024-04-26T12:07:22.409 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.409 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:22.409 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.410 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3021 3.d 3:b02ffd62:::200.00000010:head [write 3876118~3791 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:22.410 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:22.410 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.790684864999999, 2024-04-26T12:07:22.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.058441157000000001, 2024-04-26T12:07:22.410 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:22.410 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:22.410 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:22.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.410 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:22.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:22.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:22.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:22.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:22.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541314+0000", 2024-04-26T12:07:22.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T12:07:22.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:22.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541323+0000", 2024-04-26T12:07:22.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5510000000000005e-06 2024-04-26T12:07:22.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:22.412 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541327+0000", 2024-04-26T12:07:22.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2520000000000001e-06 2024-04-26T12:07:22.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:22.412 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.541330+0000", 2024-04-26T12:07:22.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0359999999999998e-06 2024-04-26T12:07:22.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:22.412 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593229+0000", 2024-04-26T12:07:22.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051898044999999997 2024-04-26T12:07:22.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:22.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593278+0000", 2024-04-26T12:07:22.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9506999999999999e-05 2024-04-26T12:07:22.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:22.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599704+0000", 2024-04-26T12:07:22.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064259570000000004 2024-04-26T12:07:22.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:22.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599725+0000", 2024-04-26T12:07:22.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0562999999999999e-05 2024-04-26T12:07:22.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.414 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:22.414 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599755+0000", 2024-04-26T12:07:22.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0710000000000002e-05 2024-04-26T12:07:22.414 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.414 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:22.414 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.414 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.414 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.414 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3022 3.d 3:b02ffd62:::200.00000010:head [write 3879909~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:22.414 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:22.414 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.789435795999999, 2024-04-26T12:07:22.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.057246689000000003, 2024-04-26T12:07:22.414 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:22.414 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:22.414 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:22.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:22.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:22.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:22.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542563+0000", 2024-04-26T12:07:22.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:22.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542561+0000", 2024-04-26T12:07:22.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999981 2024-04-26T12:07:22.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:22.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542570+0000", 2024-04-26T12:07:22.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9199999999999993e-06 2024-04-26T12:07:22.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:22.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542583+0000", 2024-04-26T12:07:22.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2227e-05 2024-04-26T12:07:22.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:22.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.542598+0000", 2024-04-26T12:07:22.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5199e-05 2024-04-26T12:07:22.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:22.417 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593728+0000", 2024-04-26T12:07:22.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051129846 2024-04-26T12:07:22.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:22.417 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.593806+0000", 2024-04-26T12:07:22.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8425999999999998e-05 2024-04-26T12:07:22.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:22.417 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599760+0000", 2024-04-26T12:07:22.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0059537399999999999 2024-04-26T12:07:22.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:22.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599779+0000", 2024-04-26T12:07:22.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9619e-05 2024-04-26T12:07:22.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:22.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599810+0000", 2024-04-26T12:07:22.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0508999999999999e-05 2024-04-26T12:07:22.418 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.418 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:22.418 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.419 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3023 3.d 3:b02ffd62:::200.00000010:head [write 3881868~5748 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:07:22.419 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:22.419 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.788963947999999, 2024-04-26T12:07:22.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.056829994000000002, 2024-04-26T12:07:22.419 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T12:07:22.419 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:07:22.419 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T12:07:22.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T12:07:22.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:22.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T12:07:22.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543035+0000", 2024-04-26T12:07:22.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T12:07:22.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T12:07:22.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543034+0000", 2024-04-26T12:07:22.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T12:07:22.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T12:07:22.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543044+0000", 2024-04-26T12:07:22.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0444e-05 2024-04-26T12:07:22.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T12:07:22.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543055+0000", 2024-04-26T12:07:22.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.096e-05 2024-04-26T12:07:22.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T12:07:22.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.543063+0000", 2024-04-26T12:07:22.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2689999999999999e-06 2024-04-26T12:07:22.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T12:07:22.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594265+0000", 2024-04-26T12:07:22.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.051201325999999998 2024-04-26T12:07:22.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T12:07:22.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.594311+0000", 2024-04-26T12:07:22.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5918000000000003e-05 2024-04-26T12:07:22.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T12:07:22.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599815+0000", 2024-04-26T12:07:22.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055038370000000001 2024-04-26T12:07:22.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T12:07:22.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599834+0000", 2024-04-26T12:07:22.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9942e-05 2024-04-26T12:07:22.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T12:07:22.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T12:07:22.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T12:07:22.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T12:06:59.599865+0000", 2024-04-26T12:07:22.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0549000000000002e-05 2024-04-26T12:07:22.423 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.423 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:22.423 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.423 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T12:07:22.423 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T12:07:22.423 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T12:07:22.604 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:07:23.595 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-26T12:07:23.611 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:07:24.600 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-26T12:07:28.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~70s 2024-04-26T12:07:33.822 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~76s 2024-04-26T12:07:39.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~82s 2024-04-26T12:07:45.437 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~88s 2024-04-26T12:07:51.245 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~94s 2024-04-26T12:07:57.051 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~99s 2024-04-26T12:08:02.857 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~105s 2024-04-26T12:08:08.664 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~111s 2024-04-26T12:08:14.470 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~117s 2024-04-26T12:08:20.278 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~123s 2024-04-26T12:08:26.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~128s 2024-04-26T12:08:26.551 DEBUG:teuthology.orchestra.console.smithi154:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  tel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 77 61 GUID: 00000000 0000 0000 0000 0CC47AD91A54 DHCP.|                    DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| CLIENT IP: 172.21.15.154 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:77:61)... Configuring (net0 0c:c4:7a:88:77:61).... Configuring (net0 0c:c4:7a:88:77:61)..... Configuring (net0 0c:c4:7a:88:77:61)...... ok [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-437.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9                The selected entry will be started automatically in 5s.   CentOS Stream (5.14.0-437.el9.x86_64) 9   CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9             Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 5s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h      [ 0.000000] Linux version 5.14.0-437.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.4.1 20231218 (Red Hat 11.4.1-3), GNU ld version 2.35.2-43.el9) #1 SMP PREEMPT_DYNAMIC Tue Apr 9 12:57:02 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3500.263 MHz processor [ 0.000408] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000412] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000414] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000743] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.006422] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.006431] Using GB pages for direct mapping [ 0.006539] RAMDISK: [mem 0x33f38000-0x35f93fff] [ 0.006543] ACPI: Early table checksum verification disabled [ 0.006545] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.006548] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.006553] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006557] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006560] ACPI: FACS 0x0000000079D43F80 000040 [ 0.006562] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006564] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006567] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006569] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006571] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006574] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006576] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006578] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006580] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006583] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006585] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006587] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006590] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006592] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006594] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006596] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006599] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006601] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006603] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.006604] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.006605] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.006605] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.006606] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.006606] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.006607] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.006608] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.006608] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.006609] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.006609] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.006610] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.006611] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.006611] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.006612] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.006612] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.006613] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.006614] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.006614] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.006615] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.006615] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.006662] No NUMA configuration found [ 0.006662] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006671] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.006868] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.006904] Zone ranges: [ 0.006904] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.006906] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.006907] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.006908] Device empty [ 0.006909] Movable zone start for each node [ 0.006911] Early memory node ranges [ 0.006911] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.006912] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.006913] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.006917] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.006921] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.006959] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.011915] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.012025] ACPI: PM-Timer IO Port: 0x408 [ 0.012033] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.012034] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.012035] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.012035] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.012036] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.012036] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.012037] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.012037] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.012046] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.012050] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.012052] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.012054] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.012057] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.012058] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.012063] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.012064] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.012073] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.012075] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.012075] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.012076] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.012077] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.012078] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.012078] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.012079] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.012079] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.012080] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.012080] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.012081] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.012082] Booting paravirtualized kernel on bare hardware [ 0.012085] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016421] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016641] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.016666] Fallback order for Node 0: 0 [ 0.016669] Built 1 zonelists, mobility grouping on. Total pages: 8228746 [ 0.016670] Policy zone: Normal [ 0.016671] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016728] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64", will be passed to user space. [ 0.016744] random: crng init done [ 0.018926] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.020068] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.020317] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020325] software IO TLB: area num 8. [ 0.048308] Memory: 1750180K/33438012K available (16384K kernel code, 5628K rwdata, 11788K rodata, 3928K init, 5908K bss, 989176K reserved, 0K cma-reserved) [ 0.048409] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.048417] Kernel/User page tables isolation: enabled [ 0.048441] ftrace: allocating 46993 entries in 184 pages [ 0.066732] ftrace: allocated 184 pages with 4 groups [ 0.067247] Dynamic Preempt: voluntary [ 0.067276] rcu: Preemptible hierarchical RCU implementation. [ 0.067277] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.067278] Trampoline variant of Tasks RCU enabled. [ 0.067278] Rude variant of Tasks RCU enabled. [ 0.067279] Tracing variant of Tasks RCU enabled. [ 0.067279] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.067280] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.070506] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.070667] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.070775] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.076022] Console: colour VGA+ 80x25 [ 1.112942] printk: console [ttyS1] enabled [ 1.117132] ACPI: Core revision 20230331 [ 1.121227] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.130355] APIC: Switch to symmetric I/O mode setup [ 1.135323] DMAR: Host address width 46 [ 1.139167] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.144481] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.152475] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.158742] DMAR: ATSR flags: 0x0 [ 1.162061] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.168326] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.174679] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.181030] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.186431] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.186432] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.201448] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.206756] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.212979] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.223347] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x3274496f08f, max_idle_ns: 440795257980 ns [ 1.233858] Calibrating delay loop (skipped), value calculated using timer frequency.. 7000.52 BogoMIPS (lpj=3500263) [ 1.234877] CPU0: Thermal monitoring enabled (TM1) [ 1.235913] process: using mwait in idle threads [ 1.236859] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.237857] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.238859] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.239858] Spectre V2 : Mitigation: Retpolines [ 1.240857] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.241857] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.242858] Speculative Store Bypass: Vulnerable [ 1.243863] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.244857] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.245858] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.246861] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.247857] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.248857] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.249858] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.250857] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.263371] Freeing SMP alternatives memory: 36K [ 1.263858] pid_max: default: 32768 minimum: 301 [ 1.264876] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.265863] Yama: becoming mindful. [ 1.266861] SELinux: Initializing. [ 1.267874] LSM support for eBPF active [ 1.269903] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.270896] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.374810] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.375954] cblist_init_generic: Setting adjustable number of callback queues. [ 1.376858] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.377869] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.378867] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.379866] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.380858] ... version: 3 [ 1.381857] ... bit width: 48 [ 1.382857] ... generic registers: 4 [ 1.383857] ... value mask: 0000ffffffffffff [ 1.384857] ... max period: 00007fffffffffff [ 1.385857] ... fixed-purpose events: 3 [ 1.386858] ... event mask: 000000070000000f [ 1.387941] signal: max sigframe size: 1776 [ 1.388868] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.389883] rcu: Hierarchical SRCU implementation. [ 1.389884] rcu: Max phase no-delay instances is 400. [ 1.389892] printk: console [ttyS1] printing thread started [ 1.394446] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.394513] smp: Bringing up secondary CPUs ... [ 1.394579] smpboot: x86: Booting SMP configuration: [ 1.394580] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.401119] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.401119] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.401119] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.401119] smp: Brought up 1 node, 8 CPUs [ 1.401119] smpboot: Max logical packages: 1 [ 1.401119] smpboot: Total of 8 processors activated (56004.20 BogoMIPS) [ 1.450040] node 0 deferred pages initialised in 40ms [ 1.451665] devtmpfs: initialized [ 1.451665] x86/mm: Memory block size: 128MB [ 1.453509] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.453509] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.453509] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.453509] pinctrl core: initialized pinctrl subsystem [ 1.463243] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.463330] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.463342] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.463351] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.463359] audit: initializing netlink subsys (disabled) [ 1.463364] audit: type=2000 audit(1714133275.249:1): state=initialized audit_enabled=0 res=1 [ 1.463364] thermal_sys: Registered thermal governor 'fair_share' [ 1.463364] thermal_sys: Registered thermal governor 'step_wise' [ 1.463364] thermal_sys: Registered thermal governor 'user_space' [ 1.470860] cpuidle: using governor menu [ 1.480897] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.480898] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.480953] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.480956] PCI: ECAM [mem 0x80000000-0x8fffffff] reserved as E820 entry [ 1.480964] PCI: Using configuration type 1 for base access [ 1.498886] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.498890] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.498890] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.498890] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.498890] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.506669] cryptd: max_cpu_qlen set to 1000 [ 1.522325] ACPI: Added _OSI(Module Device) [ 1.522326] ACPI: Added _OSI(Processor Device) [ 1.522327] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.522327] ACPI: Added _OSI(Processor Aggregator Device) [ 1.522328] ACPI: Added _OSI(Linux-Dell-Video) [ 1.522328] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.522329] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.546310] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.548477] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.550952] ACPI: Dynamic OEM Table Load: [ 1.563972] ACPI: _OSC evaluated successfully for all CPUs [ 1.564237] ACPI: Interpreter enabled [ 1.564245] ACPI: PM: (supports S0 S4 S5) [ 1.564246] ACPI: Using IOAPIC for interrupt routing [ 1.565729] HEST: Enabling Firmware First mode for corrected errors. [ 1.603522] HEST: Table parsing has been initialized. [ 1.603643] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.603645] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.603646] PCI: Using E820 reservations for host bridge windows [ 1.604093] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.624739] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.624743] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.625852] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.626378] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.626379] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.626405] PCI host bridge to bus 0000:ff [ 1.626407] pci_bus 0000:ff: root bus resource [bus ff] [ 1.626417] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.626460] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.626491] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.626521] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.626551] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.626581] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.626609] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.626637] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.626667] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.626696] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.626725] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.626755] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.626784] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.626813] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.626841] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.626873] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.626901] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.626928] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.626957] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.626977] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.627012] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627073] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627132] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627190] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627248] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627306] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627351] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.627382] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.627413] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627454] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627495] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627535] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627575] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.627605] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.627638] pci 0000:ff:14.6: [8086:6fbe] type 0class 0x088000 conventional PCI endpoint [ 1.627669] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.627702] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627744] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627785] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627826] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627870] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.627907] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.627938] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.627968] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.628002] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.628032] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.628063] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.628093] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.628127] pci 0000:ff:0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.628156] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.628185] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.628214] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.628236] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.628267] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.628297] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.630522] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.630525] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.630657] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.630905] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.630906] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.631317] PCI host bridge to bus 0000:00 [ 1.631318] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.631319] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.631320] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.631321] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.631322] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.631323] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.631324] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.631342] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.631443] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.631455] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.631490] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.631580] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.631591] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.631594] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.631627] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.631715] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.631726] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.631728] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.631729] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.631734] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.631763] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.631844] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.631852] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.631929] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.631936] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.632009] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.632017] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.632089] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.632097] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.632168] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.632176] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.632248] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.632255] pci 0000:00:04.5: BAR 0 [mem 0xfb418.632327] pci 000ss 0x088000 PCIe Root Complex Integrated Endpoint [ 1.632334] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.632407] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.632415] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.632486] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.632546] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.632629] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.632686] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.632691] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.632771] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex 1.633011] pci 00 class 0x0106 1.633030] pci 0000:00:11.4: BAR 0 [io 0xf110-0xf117] [ 1.633041] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.633053] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.633064] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.633075] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.633086] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.633146] pci 0000:00:11.4: PME# supported from D3hot [ 1.633224] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.633247] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.633333] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.633420] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.633443] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.633531] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.633594] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.633618] pci 0000:00:16.600f 64bit] [ 1.633707] pci 0000:00:16.1: PME# supported from D0 D3hot D3col633791] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 conventional PCI endpoint [ 1.633812] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.633929] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.634010] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.634046] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.634136] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.634233] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.634267] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ ci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.634277] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.634366] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.634464] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.634502] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.634506] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.634510] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.634596] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.634700] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.634722] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.634836] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.634916] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.635117] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.635135] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.635145] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.635156] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.635166] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.635177] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.635187] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.635240] pci 0000:00:1f.2: PME# supported from D3hot [ 1.635299] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.635321] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.635351] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.635510] acpiphp: Slot [1] registered [ 1.635521] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.635627] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.635636] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.635652] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.635656] pci 0000:02:00.0: enabling Extended Tags [ 1.635759] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.635869] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.635879] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.635884] pci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.635894] pci 0000:03:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.635898] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.635934] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.635951] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.635952] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.635961] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.635961] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.636111] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.636122] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.636126] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.636136] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.636140] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.636176] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.636190] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.636191] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.636199] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.636200] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.636337] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.636383] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.636476] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.636548] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.636561] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.636566] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.636620] pci 0000:05:00.0: enabling Extended Tags [ 1.636751] pci 0000:05:00.0: supports D1 D2 [ 1.636752] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.636929] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.637016] pci_bus 0000:06: extended config space not accessible [ 1.637047] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.637083] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.637103] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.637122] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.637221] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.637291] pci 0000:06:00.0: supports D1 D2 [ 1.637292] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.637441] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.637588] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.637622] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.637658] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.637676] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.637901] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.637963] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.637964] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.637997] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.637997] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.638325] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.638358] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.638395] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.638413] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.638624] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.638685] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.638686] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.638719] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.638720] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.639016] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.639027] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.639691] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.639720] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.639750] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.639780] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.639810] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.639811] ACPI: PCI: Interrupt link LNKE disabled [ 1.639840] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.639840] ACPI: PCI: Interrupt link LNKF disabled [ 1.639874] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.639875] ACPI: PCI: Interrupt link LNKG disabled [ 1.639904] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.639905] ACPI: PCI: Interrupt link LNKH disabled [ 1.640071] iommu: Default domain type: Translated [ 1.640071] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.640071] SCSI subsystem initialized [ 1.640071] ACPI: bus type USB registered [ 1.640071] usbcore: registered new interface driver usbfs [ 1.640071] usbcore: registered new interface driver hub [ 1.640071] usbcore: registered new device driver usb [ 1.640071] pps_core: LinuxPPS API ver. 1 registered [ 1.640071] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.640071] PTP clock support registered [ 1.640071] EDAC MC: Ver: 3.0.0 [ 1.640071] NetLabel: Initializing [ 1.640071] NetLabel: domain hash size = 128 [ 1.640071] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.640071] NetLabel: unlabeled traffic allowed by default [ 1.640071] PCI: Using ACPI for IRQ routing [ 1.651243] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.651243] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.651243] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.651243] vgaarb: loaded [ 1.651243] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.651243] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.657422] clocksource: Switched to clocksource tsc-early [ 1.657526] VFS: Disk quotas dquot_6.6.0 [ 1.657534] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.657571] pnp: PnP ACPI init [ 1.657819] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.657821] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.657822] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.657823] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.657824] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.657825] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.657826] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.657827] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.657828] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.657829] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.657830] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.657831] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.657832] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.657856] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.657856] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.657856] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.657856] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.657856] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.658046] pnp: PnP ACPI: found 5 devices [ 1.663574] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.663617] NET: Registered PF_INET protocol family [ 1.663794] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.666075] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.666105] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.666118] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.666339] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.666458] TCP: Hash tables configured (established 262144 bind 65536) [ 1.666578] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.666662] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.666720] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.666804] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.666808] NET: Registered PF_XDP protocol family [ 1.666838] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.666850] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.666853] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.666861] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.666863] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.666870] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.666872] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.666873] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.666874] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.666875] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.666876] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.666877] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.666878] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.666880] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.666880] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.666882] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.666882] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.666884] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.666884] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.666885] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.666886] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.666888] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.666889] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.666891] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.666892] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.666896] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.666909] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.666912] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.666920] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.666935] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.666937] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.666943] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.666952] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.666958] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.666965] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.666971] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.666977] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.666979] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.666985] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.666988] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.666994] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.666994] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.666996] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.666996] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.666997] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.666998] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.666999] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.667000] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.667001] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.667002] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.667003] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.667004] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.667004] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.667005] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.667006] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.667007] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.667007] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.667008] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.667186] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.683905] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 16156 usecs [ 1.696918] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 12692 usecs [ 1.696931] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.696966] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.696967] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.696973] ACPI: bus type thunderbolt registered [ 1.696986] Trying to unpack rootfs image as initramfs... [ 1.755844] Initialise system trusted keyrings [ 1.755855] Key type blacklist registered [ 1.755899] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.757746] zbud: loaded [ 1.839249] integrity: Platform Keyring initialized [ 1.839253] integrity: Machine keyring initialized [ 1.847009] NET: Registered PF_ALG protocol family [ 1.847012] xor: automatically using best checksumming function avx [ 1.847013] Key type asymmetric registered [ 1.847014] Asymmetric key parser 'x509' registered [ 1.847015] Running certificate verification selftests [ 1.848740] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 1.849549] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.849570] io scheduler mq-deadline registered [ 1.849571] io scheduler kyber registered [ 1.849613] io scheduler bfq registered [ 1.880501] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.880842] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.881017] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.881161] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.881294] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.881444] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.881587] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.881745] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.881981] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 1.889246] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.889265] ACPI: button: Power Button [PWRB] [ 1.889287] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 1.889366] ACPI: button: Power Button [PWRF] [ 1.922204] ERST: Error Record Serialization Table (ERST) support is initialized. [ 1.922206] pstore: Registered erst as persistent store backend [ 1.922307] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 1.922392] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 1.930096] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 1.938694] Non-volatile memory driver v1.3 [ 1.946842] rdac: device handler registered [ 1.946876] hp_sw: device handler registered [ 1.946877] emc: device handler registered [ 1.946896] alua: device handler registered [ 1.947225] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 1.947272] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 1.947286] ehci-pci 0000:00:1d.0: debug port 2 [ 1.951209] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 1.957892] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 1.957928] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.957930] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.957931] usb usb1: Product: EHCI Host Controller [ 1.957932] usb usb1: Manufacturer: Linux 5.14.0-437.el9.x86_64 ehci_hcd [ 1.957932] usb usb1: SerialNumber: 0000:00:1d.0 [ 1.958017] hub 1-0:1.0: USB hub found [ 1.958021] hub 1-0:1.0: 2 ports detected [ 1.958130] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.958168] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 1.959253] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 1.959447] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.959452] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 1.959476] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 1.959477] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 1.959489] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 4 [ 1.959501] ehci-pci 0000:00:1a.0: debug port 2 [ 1.959505] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.959507] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.959508] usb usb2: Product: xHCI Host Controller [ 1.959509] usb usb2: Manufacturer: Linux 5.14.0-437.el9.x86_64 xhci-hcd [ 1.959510] usb usb2: SerialNumber: 0000:00:14.0 [ 1.959604] hub 2-0:1.0: USB hub found [ 1.959634] hub 2-0:1.0: 15 ports detected [ 1.961365] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 1.961367] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.961368] usb usb3: Product: xHCI Host Controller [ 1.961369] usb usb3: Manufacturer: Linux 5.14.0-437.el9.x86_64 xhci-hcd [ 1.961369] usb usb3: SerialNumber: 0000:00:14.0 [ 1.961429] hub 3-0:1.0: USB hub found [ 1.961446] hub 3-0:1.0: 6 ports detected [ 1.962378] usbcore: registered new interface driver usbserial_generic [ 1.962382] usbserial: USB Serial support registered for generic [ 1.962414] i8042: PNP: No PS/2 controller found. [ 1.962439] mousedev: PS/2 mouse device common for all mice [ 1.962501] rtc_cmos 00:00: RTC can wake from S4 [ 1.962812] rtc_cmos 00:00: registered as rtc0 [ 1.962869] rtc_cmos 00:00: setting system clock to 2024-04-26T12:07:57 UTC (1714133277) [ 1.962895] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 1.963407] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 1.969891] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 1.969931] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.969933] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.969934] usb usb4: Product: EHCI Host Controller [ 1.969935] usb usb4: Manufacturer: Linux 5.14.0-437.el9.x86_64 ehci_hcd [ 1.969936] usb usb4: SerialNumber: 0000:00:1a.0 [ 1.970014] hub 4-0:1.0: USB hub found [ 1.970017] hub 4-0:1.0: 2 ports detected [ 1.972522] intel_pstate: Intel P-state driver initializing [ 2.022551] Freeing initrd memory: 33136K [ 2.027809] hid: raw HID events driver (C) Jiri Kosina [ 2.027853] usbcore: registered new interface driver usbhid [ 2.027854] usbhid: USB HID core driver [ 2.027925] drop_monitor: Initializing network drop monitor service [ 2.036689] Initializing XFRM netlink socket [ 2.036768] NET: Registered PF_INET6 protocol family [ 2.041284] Segment Routing with IPv6 [ 2.041300] NET: Registered PF_PACKET protocol family [ 2.041324] mpls_gso: MPLS GSO support [ 2.063512] microcode: Current revision: 0x0b00001b [ 2.081126] resctrl: L3 allocation detected [ 2.081127] resctrl: L3 monitoring detected [ 2.081138] IPI shorthand broadcast: enabled [ 2.081143] AVX2 version of gcm_enc/dec engaged. [ 2.143127] AES CTR mode by8 optimization enabled [ 2.143176] sched_clock: Marking stable (999695719, 1143161972)->(2544981211, -402123520) [ 2.159716] registered taskstats version 1 [ 2.176369] Loading compiled-in X.509 certificates [ 2.176842] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: ac928bd9444a4e48f0eddf90defda693df54cc67' [ 2.177126] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.177400] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.177541] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.177550] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.177732] zswap: loaded using pool lzo/zbud [ 2.200979] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.200991] page_owner is disabled [ 2.201168] pstore: Using crash dump compression: deflate [ 2.201177] Key type big_key registered [ 2.206880] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.210881] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 2.312677] Key type encrypted registered [ 2.312684] ima: No TPM chip found, activating TPM-bypass! [ 2.312686] Loading compiled-in module X.509 certificates [ 2.312974] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: ac928bd9444a4e48f0eddf90defda693df54cc67' [ 2.312976] ima: Allocated hash algorithm: sha256 [ 2.312984] ima: No architecture policies found [ 2.312997] evm: Initialising EVM extended attributes: [ 2.312997] evm: security.selinux [ 2.312997] evm: security.SMACK64 (disabled) [ 2.312998] evm: security.SMACK64EXEC (disabled) [ 2.312998] evm: security.SMACK64TRANSMUTE (disabled) [ 2.312999] evm: security.SMACK64MMAP (disabled) [ 2.312999] evm: security.apparmor (disabled) [ 2.312999] evm: security.ima [ 2.313000] evm: security.capability [ 2.313000] evm: HMAC attrs: 0x1 [ 2.334052] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.334055] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.334446] hub 2-12:1.0: USB hub found [ 2.334522] hub 2-12:1.0: 4 ports detected [ 2.341223] usb 4-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.341225] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.341384] hub 4-1:1.0: USB hub found [ 2.341471] hub 4-1:1.0: 6 ports detected [ 2.392668] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.392669] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.404533] hub 1-1:1.0: USB hub found [ 2.410586] hub 1-1:1.0: 8 ports detected [ 2.624884] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 2.716890] tsc: Refined TSC clocksource calibration: 3499.995 MHz [ 2.716894] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734c8180a, max_idle_ns: 440795326857 ns [ 2.723046] clocksource: Switched to clocksource tsc [ 2.729359] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 2.729362] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.734367] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 2.785974] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 2.788680] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 2.788726] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.182134] Freeing unused decrypted memory: 2028K [ 5.182571] Freeing unused kernel image (initmem) memory: 3928K [ 5.182610] Write protecting the kernel read-only data: 28672k [ 5.182782] Freeing unused kernel image (rodata/data gap) memory: 500K [ 5.221512] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.221514] x86/mm: Checking user space page tables [ 5.265310] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.265321] Run /init as init process [ 5.278763] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.278886] systemd[1]: Detected architecture x86-64. Welcome to [0[ 5.278888] systemd[1]: Running in initrd. ;31mCentOS Stream 9 dracut-057-53.git20240104.el9 (Initramfs)! [ 5.329970] systemd[1]: Hostname set to . [ OK [[ 5.386033] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.386139] systemd[1]: Reached target Initrd /usr File System. 0m] Reached target Initrd /usr File System. [ OK [[ 5.407992] systemd[1]: Reached target Local File Systems. 0m] Reached target Local File Systems. [ OK [[ 5.422009] systemd[1]: Reached target Slice Units. 0m] Reached target Slice Units. [ OK [[ 5.433937] systemd[1]: Reached target Swaps. 0m] Reached target Swaps. [ OK [[ 5.444945] systemd[1]: Reached target Timer Units. 0m] Reached target Timer Units. [ OK [[ 5.456989] systemd[1]: Listening on D-Bus System Message Bus Socket. 0m] Listening on D-Bus System Message Bus Socket. [ OK [[ 5.472169] systemd[1]: Listening on Journal Socket (/dev/log). 0m] Listening on Journal Socket (/dev/log). [ OK [[ 5.486041] systemd[1]: Listening on Journal Socket. 0m] Listening on Journal Socket. [ OK [[ 5.498000] systemd[1]: Listening on udev Control Socket. 0m] Listening on udev Control Socket. [ OK [[ 5.511975] systemd[1]: Listening on udev Kernel Socket. 0m] Listening on udev Kernel Socket. [ OK [[ 5.525983] systemd[1]: Reached target Socket Units. 0m] Reached target Socket Units. Startin[ 5.544544] systemd[1]: Starting Create List of Static Device Nodes... g Create List of Static Device Nodes... Startin[ 5.560085] systemd[1]: Starting Journal Service... g Journal Service... [ 5.572012] systemd[1]: Load Kernel Modules was skipped because no trigger condition checks were met. Startin[ 5.582991] systemd[1]: Starting Apply Kernel Variables... g Apply Kernel Variables... Startin[ 5.595448] systemd[1]: Starting Create System Users... g Create System Users... Startin[ 5.607669] systemd[1]: Starting Setup Virtual Console... g Setup Virtual Console... [ OK [[ 5.620768] systemd[1]: Started Journal Service. 0m] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut cmdline hook... [ OK ] Finished dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. Starting dracut initqueue hook... [ 6.013689] dca service started, version 1.12.1 Starting Show Plymouth Boot Screen... [ OK ] Started Show Plymouth Boot Screen. [ OK ] Started Forwa[ 6.061197] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver rd Password R…[ 6.061199] ixgbe: Copyright (c) 1999-2016 Intel Corporation. s to Plymouth Directory Watch[0[ 6.076124] igb: Intel(R) Gigabit Ethernet Network Driver m. [ O[ 6.076127] igb: Copyright (c) 2007-2014 Intel Corporation. K ] Reached[ 6.076377] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode target [0;1;39[ 6.076380] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst mPath Units.[ 6.097694] scsi host0: ahci [ OK ] Reached target B[ 6.097842] scsi host1: ahci [ 6.099003] scsi host2: ahci asic System.[ 6.099336] scsi host3: ahci [ 6.099381] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 34 lpm-pol 0 [ 6.099385] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 34 lpm-pol 0 [ 6.099387] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 34 lpm-pol 0 [ 6.099391] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 34 lpm-pol 0 [ 6.099676] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 6.099680] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.116364] scsi host4: ahci [ 6.116595] scsi host5: ahci [ 6.116719] scsi host6: ahci [ 6.116867] scsi host7: ahci [ 6.117060] scsi host8: ahci [ 6.117247] scsi host9: ahci [ 6.117302] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 44 lpm-pol 0 [ 6.117304] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 44 lpm-pol 0 [ 6.117306] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 44 lpm-pol 0 [ 6.117309] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 44 lpm-pol 0 [ 6.117312] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 44 lpm-pol 0 [ 6.117314] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 44 lpm-pol 0 [ 6.145197] ACPI: bus type drm_connector registered [ 6.156835] igb 0000:07:00.0: added PHC on eth0 [ 6.156867] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 6.156868] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:1a:54 [ 6.156944] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 6.156945] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.185049] nvme nvme0: pci function 0000:02:00.0 [ 6.187433] nvme nvme0: 8/0/0 default/read/poll queues [ 6.208088] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.217237] Console: switching to colour dummy device 80x25 [ 6.217419] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 6.217420] ast 0000:06:00.0: [drm] AST 2400 detected [ 6.217431] ast 0000:06:00.0: [drm] Using analog VGA [ 6.217439] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.217628] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.221366] igb 0000:07:00.1: added PHC on eth1 [ 6.221411] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.221412] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:1a:55 [ 6.221494] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.221495] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.224962] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.226839] fbcon: astdrmfb (fb0) is primary device [ 6.245419] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.251453] Console: switching to colour frame buffer device 128x48 [ 6.270641] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 6.410190] ata3: SATA link down (SStatus 0 SControl 300) [ 6.410222] ata4: SATA link down (SStatus 0 SControl 300) [ 6.410249] ata2: SATA link down (SStatus 0 SControl 300) [ 6.410276] ata1: SATA link down (SStatus 0 SControl 300) [ 6.426203] ata10: SATA link down (SStatus 0 SControl 300) [ 6.426230] ata7: SATA link down (SStatus 0 SControl 300) [ 6.426250] ata8: SATA link down (SStatus 0 SControl 300) [ 6.426274] ata9: SATA link down (SStatus 0 SControl 300) [ 6.426301] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.426321] ata6: SATA link down (SStatus 0 SControl 300) [ 6.427748] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.428334] ata5.00: NCQ Send/Recv Log not supported [ 6.428335] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.429671] ata5.00: NCQ Send/Recv Log not supported [ 6.429672] ata5.00: configured for UDMA/133 [ 6.429761] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.510658] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.571897] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.571913] sd 4:0:0:0: [sda] Write Protect is off [ 6.571937] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.571961] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.584097] sda: sda1 [ 6.584150] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.210294] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.210583] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.210665] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.210666] ixgbe 0000:03:00.0: 0c:c4:7a:88:77:60 [ 7.213718] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.371203] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.371491] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.371573] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.371574] ixgbe 0000:03:00.1: 0c:c4:7a:88:77:61 [ 7.374591] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.382704] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 7.415709] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check…6d2c-4093-809e-dd42758f0c27... [ OK ] Finished File System Check…5-6d2c-4093-809e-dd42758f0c27. Mounting /sysroot... [ 7.640367] EXT4-fs (sda1): mounted filesystem a494b625-6d2c-4093-809e-dd42758f0c27 ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manage…for Device Events and Files... [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. Starting Switch Ro[ 7.958125] systemd-journald[281]: Received SIGTERM from PID 1 (systemd). ot... [ 8.493759] SELinux: policy capability network_peer_controls=1 [ 8.493762] SELinux: policy capability open_perms=1 [ 8.493763] SELinux: policy capability extended_socket_class=1 [ 8.493763] SELinux: policy capability always_check_network=0 [ 8.493764] SELinux: policy capability cgroup_seclabel=1 [ 8.493764] SELinux: policy capability nnp_nosuid_transition=1 [ 8.493764] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.537796] audit: type=1403 audit(1714133284.073:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.540226] systemd[1]: Successfully loaded SELinux policy in 115.649ms. [ 8.613952] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 26.875ms. [ 8.622701] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.622818] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ 8.666322] systemd[1]: Hostname set to . [ OK [[ 9.587073] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ 9.587171] systemd[1]: Stopped Switch Root. 0m] Stopped [0;[ 9.587571] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.587912] systemd[1]: Created slice Slice /system/getty. 1;39mSwitch Root[ 9.616219] systemd[1]: Created slice Slice /system/modprobe. . [[ 9.616495] systemd[1]: Created slice Slice /system/serial-getty. OK ] Crea[ 9.616759] systemd[1]: Created slice Slice /system/sshd-keygen. [ 9.617048] systemd[1]: Created slice User and Session Slice. [ 9.630583] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.630708] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ 9.631079] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. ted slice [0;1;[ 9.675647] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ 9.675671] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.675688] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ 9.675704] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.675719] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.675735] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.675754] systemd[1]: Reached target Local Encrypted Volumes. [ 9.675778] systemd[1]: Stopped target Switch Root. 39mSlice /system[ 9.675800] systemd[1]: Stopped target Initrd File Systems. [ 9.675814] systemd[1]: Stopped target Initrd Root File System. [ 9.675843] systemd[1]: Reached target Local Integrity Protected Volumes. [ 9.675890] systemd[1]: Reached target Path Units. /getty. [[ 9.775240] systemd[1]: Reached target Slice Units. [ 9.775271] systemd[1]: Reached target Swaps. [ 9.775291] systemd[1]: Reached target Local Verity Protected Volumes. [ 9.775660] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ 9.779217] systemd[1]: Listening on LVM2 poll daemon socket. [0;32m OK ] Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/serial-getty[ 9.816328] systemd[1]: Listening on RPCbind Server Activation Socket. [ 9.816389] systemd[1]: Reached target RPC Port Mapper. [ 9.817967] systemd[1]: Listening on Process Core Dump Socket. . [ OK[ 9.834846] systemd[1]: Listening on initctl Compatibility Named Pipe. ] Created [ 9.840072] systemd[1]: Listening on udev Control Socket. [ 9.842887] systemd[1]: Listening on udev Kernel Socket. slice Slice /system/sshd-keygen. [ OK ] Created slice User and Session Slic[ 9.863121] systemd[1]: Mounting Huge Pages File System... [ 9.864168] systemd[1]: Mounting POSIX Message Queue File System... e. [ OK ] Sta[ 9.877039] systemd[1]: Mounting Kernel Debug File System... [ 9.877844] systemd[1]: Mounting Kernel Trace File System... [ 9.877949] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). rted Forward Password R[ 9.905105] systemd[1]: Starting Create List of Static Device Nodes... …uests to Wall[ 9.905904] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... [ 9.913665] systemd[1]: Starting Load Kernel Module configfs... Directory Watch. [[ 9.931113] systemd[1]: Starting Load Kernel Module drm... [ 9.931892] systemd[1]: Starting Load Kernel Module fuse... OK ] Set up automount Arbitrary\xe2[ 9.945950] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... \x80\xa6s File System [ 9.946023] systemd[1]: plymouth-switch-root.service: Deactivated successfully. [ 9.946068] systemd[1]: Stopped Plymouth switch root service. [ 9.946245] systemd[1]: Stopped Journal Service. Automount Point[ 9.976241] systemd[1]: Starting Journal Service... [ 9.978979] systemd[1]: Starting Load Kernel Modules... [0m. [ OK ] Reach[ 9.988037] systemd[1]: Starting Generate network units from Kernel command line... [ 9.988087] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). ed target [0;1;[ 9.988892] systemd[1]: Starting Remount Root and Kernel File Systems... 39mceph target\xe2\x80[ 9.997717] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. [ 9.998595] systemd[1]: Starting Coldplug All udev Devices... \xa6on@.service ins[ 10.025478] systemd[1]: Mounted Huge Pages File System. [ 10.031203] EXT4-fs (sda1): re-mounted a494b625-6d2c-4093-809e-dd42758f0c27 r/w. Quota mode: none. tances at once[[ 10.041318] systemd[1]: Mounted POSIX Message Queue File System. 0m. [ [ 10.063984] systemd[1]: Started Journal Service. OK ] Reache[ 10.070078] fuse: init (API version 7.36) d target ceph target…ds@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ OK ] Reached target ceph target…or@.service instances at once. [ 10.112464] systemd-journald[575]: Received client request to flush runtime journal. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Ac[ 10.193588] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.193606] device-mapper: uevent: version 1.0.3 [ 10.193696] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com tivation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM…meventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS …from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network …ts from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Journal Service. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Read and set NIS …e from /etc/sysconfig/network. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Reached target Preparation for Network. Mounting FUSE Control File System... Mounting Kernel Configuration File System... Starting Flush Journal to Persistent Storage... Starting Load/Save OS Random Seed... Starting Apply Kernel Variables... Starting Create Static Device Nodes in /dev... [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... [ OK ] Finished Load Kernel Module configfs. [ 10.653137] power_meter ACPI000D:00: Found ACPI power meter. [ 10.653156] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 10.653160] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). [ 10.722966] IPMI message handler: version 39.2 [ OK ] Finished Automatic Boot Loader Update. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ 11.311777] ipmi device interface [ 11.891193] ipmi_si: IPMI System Interface driver [ 11.891207] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 11.891209] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 11.891210] ipmi_si: Adding SMBIOS-specified kcs state machine [ 11.891275] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 11.891377] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 11.892031] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 11.892034] ipmi_si: Adding ACPI-specified kcs state machine [ 11.892110] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 11.965916] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 12.003393] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 12.051638] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 12.059630] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 12.060225] i2c i2c-3: 2/8 memory slots populated (from DMI) [ 12.060226] i2c i2c-3: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 12.095163] ipmi_ssif: IPMI SSIF Interface driver [ 12.170920] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 12.414098] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 12.421722] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 12.430445] igb 0000:07:00.0: DCA enabled [ 12.430461] igb 0000:07:00.1: DCA enabled [ 12.904158] iTCO_vendor_support: vendor-support=0 [ 13.011627] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 13.011902] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) [ 13.063086] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 13.063089] RAPL PMU: hw unit of domain package 2^-14 Joules [ 13.063090] RAPL PMU: hw unit of domain dram 2^-16 Joules [ OK ] Started /usr/sbin/lvm vgch…-autoactivation event vg_nvme. [ OK ] Finished Create Volatile Files and Directories. Mounting RPC Pipe File System... Starting Security Auditing Service... Starting RPC Bind... [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ 13.338023] RPC: Registered named UNIX socket transport module. [ OK [[ 13.338025] RPC: Registered udp transport module. 0m] Mounted [0;[ 13.338025] RPC: Registered tcp transport module. [ 13.338026] RPC: Registered tcp-with-tls transport module. [ 13.338026] RPC: Registered tcp NFSv4.1 backchannel transport module. 1;39mRPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ 13.558729] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [ 13.567172] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported after September 2030. [ OK [[ 13.567219] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) 0m] Mounted [0;[ 13.567221] EDAC sbridge: Ver: 1.1.2 1;39m/var/lib/ce[ 13.567288] XFS (dm-4): Mounting V4 Filesystem d8a72297-0016-4e4e-85b3-c1e761f31799 [ 13.571516] XFS (dm-4): Ending clean mount [ 13.571560] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) ph. [ 13.639647] intel_rapl_common: Found RAPL domain package [ 13.639652] intel_rapl_common: Found RAPL domain dram [ OK ] Started Security Auditing Service. Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activit…ounting tool every 10 minutes. [ OK ] Started Generate summary o…esterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos…ache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring a…g Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Started User Login Management. [ OK ] Finished Resets System Activity Logs. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started NTP client/server. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 15.631220] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 15.783419] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... [ 16.002983] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [ 16.196993] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 16.197102] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [* ] A start job is running for Network Manager Wait Online (8s / no limit) M [** ] A start job is running for Network Manager Wait Online (9s / no limit) M [*** ] A start job is running for Network Manager Wait Online (9s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ ***] A start job is running for Network …nager Wait Online (11s / no limit) M [ **] A start job is running for Network …nager Wait Online (11s / no limit) M [ *] A start job is running for Network …nager Wait Online (12s / no limit) M [ **] A start job is running for Network …nager Wait Online (12s / no limit) M [ ***] A start job is running for Network …nager Wait Online (13s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (13s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' + myips=172.21.15.154 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. [ 24.086571] block sda: the capability attribute has been deprecated. + '[' 172.21.15.154 '!=' '' ']' + set -e + '[' -n 172.21.15.154 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.154 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.154 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' Starting SETroubleshoot da…ing new SELinux denial logs... + newhostname=smithi154.front.sepia.ceph.com + '[' -n smithi154.front.sepia.ceph.com ']' + hostname smithi154.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi154 + echo smithi154 + grep -q front.sepia.ceph.com /etc/hosts + sed -i '1i172.21.15.154 smithi154.front.sepia.ceph.com smithi154\' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 9 Kernel 5.14.0-437.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T12:08:26.552 DEBUG:teuthology.orchestra.console.smithi154:expect after: smithi154 login: 2024-04-26T12:08:26.604 DEBUG:teuthology.orchestra.console.smithi154:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  tel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 77 61 GUID: 00000000 0000 0000 0000 0CC47AD91A54 DHCP.|                    DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| CLIENT IP: 172.21.15.154 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:77:61)... Configuring (net0 0c:c4:7a:88:77:61).... Configuring (net0 0c:c4:7a:88:77:61)..... Configuring (net0 0c:c4:7a:88:77:61)...... ok [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-437.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9                The selected entry will be started automatically in 5s.   CentOS Stream (5.14.0-437.el9.x86_64) 9   CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9             Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 5s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h      [ 0.000000] Linux version 5.14.0-437.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.4.1 20231218 (Red Hat 11.4.1-3), GNU ld version 2.35.2-43.el9) #1 SMP PREEMPT_DYNAMIC Tue Apr 9 12:57:02 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3500.263 MHz processor [ 0.000408] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000412] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000414] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000743] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.006422] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.006431] Using GB pages for direct mapping [ 0.006539] RAMDISK: [mem 0x33f38000-0x35f93fff] [ 0.006543] ACPI: Early table checksum verification disabled [ 0.006545] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.006548] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.006553] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006557] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006560] ACPI: FACS 0x0000000079D43F80 000040 [ 0.006562] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006564] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006567] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006569] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006571] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006574] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006576] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006578] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006580] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006583] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006585] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006587] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006590] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006592] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006594] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006596] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006599] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006601] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006603] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.006604] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.006605] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.006605] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.006606] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.006606] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.006607] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.006608] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.006608] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.006609] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.006609] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.006610] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.006611] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.006611] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.006612] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.006612] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.006613] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.006614] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.006614] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.006615] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.006615] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.006662] No NUMA configuration found [ 0.006662] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006671] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.006868] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.006904] Zone ranges: [ 0.006904] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.006906] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.006907] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.006908] Device empty [ 0.006909] Movable zone start for each node [ 0.006911] Early memory node ranges [ 0.006911] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.006912] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.006913] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.006917] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.006921] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.006959] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.011915] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.012025] ACPI: PM-Timer IO Port: 0x408 [ 0.012033] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.012034] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.012035] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.012035] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.012036] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.012036] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.012037] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.012037] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.012046] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.012050] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.012052] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.012054] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.012057] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.012058] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.012063] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.012064] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.012073] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.012075] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.012075] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.012076] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.012077] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.012078] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.012078] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.012079] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.012079] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.012080] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.012080] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.012081] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.012082] Booting paravirtualized kernel on bare hardware [ 0.012085] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016421] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016641] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.016666] Fallback order for Node 0: 0 [ 0.016669] Built 1 zonelists, mobility grouping on. Total pages: 8228746 [ 0.016670] Policy zone: Normal [ 0.016671] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016728] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64", will be passed to user space. [ 0.016744] random: crng init done [ 0.018926] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.020068] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.020317] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020325] software IO TLB: area num 8. [ 0.048308] Memory: 1750180K/33438012K available (16384K kernel code, 5628K rwdata, 11788K rodata, 3928K init, 5908K bss, 989176K reserved, 0K cma-reserved) [ 0.048409] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.048417] Kernel/User page tables isolation: enabled [ 0.048441] ftrace: allocating 46993 entries in 184 pages [ 0.066732] ftrace: allocated 184 pages with 4 groups [ 0.067247] Dynamic Preempt: voluntary [ 0.067276] rcu: Preemptible hierarchical RCU implementation. [ 0.067277] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.067278] Trampoline variant of Tasks RCU enabled. [ 0.067278] Rude variant of Tasks RCU enabled. [ 0.067279] Tracing variant of Tasks RCU enabled. [ 0.067279] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.067280] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.070506] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.070667] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.070775] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.076022] Console: colour VGA+ 80x25 [ 1.112942] printk: console [ttyS1] enabled [ 1.117132] ACPI: Core revision 20230331 [ 1.121227] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.130355] APIC: Switch to symmetric I/O mode setup [ 1.135323] DMAR: Host address width 46 [ 1.139167] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.144481] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.152475] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.158742] DMAR: ATSR flags: 0x0 [ 1.162061] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.168326] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.174679] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.181030] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.186431] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.186432] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.201448] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.206756] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.212979] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.223347] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x3274496f08f, max_idle_ns: 440795257980 ns [ 1.233858] Calibrating delay loop (skipped), value calculated using timer frequency.. 7000.52 BogoMIPS (lpj=3500263) [ 1.234877] CPU0: Thermal monitoring enabled (TM1) [ 1.235913] process: using mwait in idle threads [ 1.236859] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.237857] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.238859] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.239858] Spectre V2 : Mitigation: Retpolines [ 1.240857] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.241857] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.242858] Speculative Store Bypass: Vulnerable [ 1.243863] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.244857] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.245858] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.246861] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.247857] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.248857] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.249858] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.250857] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.263371] Freeing SMP alternatives memory: 36K [ 1.263858] pid_max: default: 32768 minimum: 301 [ 1.264876] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.265863] Yama: becoming mindful. [ 1.266861] SELinux: Initializing. [ 1.267874] LSM support for eBPF active [ 1.269903] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.270896] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.374810] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.375954] cblist_init_generic: Setting adjustable number of callback queues. [ 1.376858] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.377869] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.378867] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.379866] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.380858] ... version: 3 [ 1.381857] ... bit width: 48 [ 1.382857] ... generic registers: 4 [ 1.383857] ... value mask: 0000ffffffffffff [ 1.384857] ... max period: 00007fffffffffff [ 1.385857] ... fixed-purpose events: 3 [ 1.386858] ... event mask: 000000070000000f [ 1.387941] signal: max sigframe size: 1776 [ 1.388868] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.389883] rcu: Hierarchical SRCU implementation. [ 1.389884] rcu: Max phase no-delay instances is 400. [ 1.389892] printk: console [ttyS1] printing thread started [ 1.394446] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.394513] smp: Bringing up secondary CPUs ... [ 1.394579] smpboot: x86: Booting SMP configuration: [ 1.394580] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.401119] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.401119] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.401119] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.401119] smp: Brought up 1 node, 8 CPUs [ 1.401119] smpboot: Max logical packages: 1 [ 1.401119] smpboot: Total of 8 processors activated (56004.20 BogoMIPS) [ 1.450040] node 0 deferred pages initialised in 40ms [ 1.451665] devtmpfs: initialized [ 1.451665] x86/mm: Memory block size: 128MB [ 1.453509] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.453509] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.453509] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.453509] pinctrl core: initialized pinctrl subsystem [ 1.463243] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.463330] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.463342] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.463351] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.463359] audit: initializing netlink subsys (disabled) [ 1.463364] audit: type=2000 audit(1714133275.249:1): state=initialized audit_enabled=0 res=1 [ 1.463364] thermal_sys: Registered thermal governor 'fair_share' [ 1.463364] thermal_sys: Registered thermal governor 'step_wise' [ 1.463364] thermal_sys: Registered thermal governor 'user_space' [ 1.470860] cpuidle: using governor menu [ 1.480897] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.480898] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.480953] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.480956] PCI: ECAM [mem 0x80000000-0x8fffffff] reserved as E820 entry [ 1.480964] PCI: Using configuration type 1 for base access [ 1.498886] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.498890] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.498890] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.498890] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.498890] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.506669] cryptd: max_cpu_qlen set to 1000 [ 1.522325] ACPI: Added _OSI(Module Device) [ 1.522326] ACPI: Added _OSI(Processor Device) [ 1.522327] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.522327] ACPI: Added _OSI(Processor Aggregator Device) [ 1.522328] ACPI: Added _OSI(Linux-Dell-Video) [ 1.522328] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.522329] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.546310] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.548477] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.550952] ACPI: Dynamic OEM Table Load: [ 1.563972] ACPI: _OSC evaluated successfully for all CPUs [ 1.564237] ACPI: Interpreter enabled [ 1.564245] ACPI: PM: (supports S0 S4 S5) [ 1.564246] ACPI: Using IOAPIC for interrupt routing [ 1.565729] HEST: Enabling Firmware First mode for corrected errors. [ 1.603522] HEST: Table parsing has been initialized. [ 1.603643] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.603645] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.603646] PCI: Using E820 reservations for host bridge windows [ 1.604093] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.624739] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.624743] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.625852] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.626378] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.626379] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.626405] PCI host bridge to bus 0000:ff [ 1.626407] pci_bus 0000:ff: root bus resource [bus ff] [ 1.626417] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.626460] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.626491] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.626521] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.626551] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.626581] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.626609] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.626637] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.626667] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.626696] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.626725] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.626755] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.626784] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.626813] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.626841] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.626873] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.626901] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.626928] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.626957] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.626977] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.627012] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627073] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627132] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627190] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627248] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627306] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627351] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.627382] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.627413] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627454] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627495] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627535] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627575] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.627605] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.627638] pci 0000:ff:14.6: [8086:6fbe] type 0class 0x088000 conventional PCI endpoint [ 1.627669] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.627702] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627744] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627785] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627826] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627870] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.627907] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.627938] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.627968] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.628002] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.628032] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.628063] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.628093] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.628127] pci 0000:ff:0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.628156] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.628185] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.628214] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.628236] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.628267] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.628297] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.630522] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.630525] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.630657] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.630905] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.630906] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.631317] PCI host bridge to bus 0000:00 [ 1.631318] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.631319] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.631320] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.631321] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.631322] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.631323] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.631324] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.631342] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.631443] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.631455] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.631490] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.631580] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.631591] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.631594] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.631627] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.631715] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.631726] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.631728] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.631729] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.631734] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.631763] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.631844] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.631852] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.631929] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.631936] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.632009] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.632017] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.632089] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.632097] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.632168] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.632176] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.632248] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.632255] pci 0000:00:04.5: BAR 0 [mem 0xfb418.632327] pci 000ss 0x088000 PCIe Root Complex Integrated Endpoint [ 1.632334] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.632407] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.632415] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.632486] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.632546] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.632629] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.632686] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.632691] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.632771] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex 1.633011] pci 00 class 0x0106 1.633030] pci 0000:00:11.4: BAR 0 [io 0xf110-0xf117] [ 1.633041] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.633053] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.633064] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.633075] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.633086] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.633146] pci 0000:00:11.4: PME# supported from D3hot [ 1.633224] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.633247] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.633333] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.633420] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.633443] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.633531] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.633594] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.633618] pci 0000:00:16.600f 64bit] [ 1.633707] pci 0000:00:16.1: PME# supported from D0 D3hot D3col633791] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 conventional PCI endpoint [ 1.633812] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.633929] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.634010] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.634046] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.634136] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.634233] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.634267] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ ci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.634277] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.634366] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.634464] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.634502] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.634506] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.634510] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.634596] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.634700] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.634722] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.634836] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.634916] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.635117] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.635135] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.635145] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.635156] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.635166] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.635177] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.635187] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.635240] pci 0000:00:1f.2: PME# supported from D3hot [ 1.635299] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.635321] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.635351] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.635510] acpiphp: Slot [1] registered [ 1.635521] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.635627] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.635636] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.635652] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.635656] pci 0000:02:00.0: enabling Extended Tags [ 1.635759] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.635869] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.635879] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.635884] pci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.635894] pci 0000:03:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.635898] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.635934] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.635951] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.635952] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.635961] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.635961] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.636111] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.636122] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.636126] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.636136] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.636140] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.636176] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.636190] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.636191] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.636199] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.636200] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.636337] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.636383] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.636476] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.636548] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.636561] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.636566] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.636620] pci 0000:05:00.0: enabling Extended Tags [ 1.636751] pci 0000:05:00.0: supports D1 D2 [ 1.636752] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.636929] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.637016] pci_bus 0000:06: extended config space not accessible [ 1.637047] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.637083] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.637103] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.637122] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.637221] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.637291] pci 0000:06:00.0: supports D1 D2 [ 1.637292] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.637441] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.637588] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.637622] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.637658] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.637676] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.637901] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.637963] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.637964] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.637997] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.637997] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.638325] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.638358] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.638395] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.638413] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.638624] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.638685] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.638686] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.638719] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.638720] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.639016] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.639027] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.639691] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.639720] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.639750] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.639780] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.639810] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.639811] ACPI: PCI: Interrupt link LNKE disabled [ 1.639840] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.639840] ACPI: PCI: Interrupt link LNKF disabled [ 1.639874] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.639875] ACPI: PCI: Interrupt link LNKG disabled [ 1.639904] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.639905] ACPI: PCI: Interrupt link LNKH disabled [ 1.640071] iommu: Default domain type: Translated [ 1.640071] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.640071] SCSI subsystem initialized [ 1.640071] ACPI: bus type USB registered [ 1.640071] usbcore: registered new interface driver usbfs [ 1.640071] usbcore: registered new interface driver hub [ 1.640071] usbcore: registered new device driver usb [ 1.640071] pps_core: LinuxPPS API ver. 1 registered [ 1.640071] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.640071] PTP clock support registered [ 1.640071] EDAC MC: Ver: 3.0.0 [ 1.640071] NetLabel: Initializing [ 1.640071] NetLabel: domain hash size = 128 [ 1.640071] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.640071] NetLabel: unlabeled traffic allowed by default [ 1.640071] PCI: Using ACPI for IRQ routing [ 1.651243] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.651243] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.651243] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.651243] vgaarb: loaded [ 1.651243] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.651243] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.657422] clocksource: Switched to clocksource tsc-early [ 1.657526] VFS: Disk quotas dquot_6.6.0 [ 1.657534] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.657571] pnp: PnP ACPI init [ 1.657819] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.657821] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.657822] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.657823] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.657824] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.657825] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.657826] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.657827] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.657828] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.657829] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.657830] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.657831] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.657832] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.657856] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.657856] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.657856] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.657856] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.657856] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.658046] pnp: PnP ACPI: found 5 devices [ 1.663574] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.663617] NET: Registered PF_INET protocol family [ 1.663794] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.666075] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.666105] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.666118] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.666339] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.666458] TCP: Hash tables configured (established 262144 bind 65536) [ 1.666578] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.666662] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.666720] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.666804] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.666808] NET: Registered PF_XDP protocol family [ 1.666838] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.666850] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.666853] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.666861] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.666863] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.666870] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.666872] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.666873] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.666874] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.666875] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.666876] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.666877] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.666878] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.666880] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.666880] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.666882] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.666882] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.666884] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.666884] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.666885] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.666886] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.666888] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.666889] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.666891] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.666892] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.666896] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.666909] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.666912] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.666920] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.666935] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.666937] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.666943] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.666952] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.666958] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.666965] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.666971] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.666977] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.666979] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.666985] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.666988] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.666994] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.666994] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.666996] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.666996] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.666997] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.666998] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.666999] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.667000] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.667001] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.667002] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.667003] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.667004] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.667004] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.667005] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.667006] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.667007] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.667007] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.667008] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.667186] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.683905] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 16156 usecs [ 1.696918] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 12692 usecs [ 1.696931] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.696966] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.696967] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.696973] ACPI: bus type thunderbolt registered [ 1.696986] Trying to unpack rootfs image as initramfs... [ 1.755844] Initialise system trusted keyrings [ 1.755855] Key type blacklist registered [ 1.755899] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.757746] zbud: loaded [ 1.839249] integrity: Platform Keyring initialized [ 1.839253] integrity: Machine keyring initialized [ 1.847009] NET: Registered PF_ALG protocol family [ 1.847012] xor: automatically using best checksumming function avx [ 1.847013] Key type asymmetric registered [ 1.847014] Asymmetric key parser 'x509' registered [ 1.847015] Running certificate verification selftests [ 1.848740] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 1.849549] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.849570] io scheduler mq-deadline registered [ 1.849571] io scheduler kyber registered [ 1.849613] io scheduler bfq registered [ 1.880501] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.880842] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.881017] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.881161] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.881294] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.881444] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.881587] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.881745] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.881981] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 1.889246] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.889265] ACPI: button: Power Button [PWRB] [ 1.889287] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 1.889366] ACPI: button: Power Button [PWRF] [ 1.922204] ERST: Error Record Serialization Table (ERST) support is initialized. [ 1.922206] pstore: Registered erst as persistent store backend [ 1.922307] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 1.922392] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 1.930096] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 1.938694] Non-volatile memory driver v1.3 [ 1.946842] rdac: device handler registered [ 1.946876] hp_sw: device handler registered [ 1.946877] emc: device handler registered [ 1.946896] alua: device handler registered [ 1.947225] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 1.947272] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 1.947286] ehci-pci 0000:00:1d.0: debug port 2 [ 1.951209] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 1.957892] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 1.957928] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.957930] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.957931] usb usb1: Product: EHCI Host Controller [ 1.957932] usb usb1: Manufacturer: Linux 5.14.0-437.el9.x86_64 ehci_hcd [ 1.957932] usb usb1: SerialNumber: 0000:00:1d.0 [ 1.958017] hub 1-0:1.0: USB hub found [ 1.958021] hub 1-0:1.0: 2 ports detected [ 1.958130] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.958168] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 1.959253] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 1.959447] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.959452] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 1.959476] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 1.959477] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 1.959489] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 4 [ 1.959501] ehci-pci 0000:00:1a.0: debug port 2 [ 1.959505] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.959507] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.959508] usb usb2: Product: xHCI Host Controller [ 1.959509] usb usb2: Manufacturer: Linux 5.14.0-437.el9.x86_64 xhci-hcd [ 1.959510] usb usb2: SerialNumber: 0000:00:14.0 [ 1.959604] hub 2-0:1.0: USB hub found [ 1.959634] hub 2-0:1.0: 15 ports detected [ 1.961365] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 1.961367] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.961368] usb usb3: Product: xHCI Host Controller [ 1.961369] usb usb3: Manufacturer: Linux 5.14.0-437.el9.x86_64 xhci-hcd [ 1.961369] usb usb3: SerialNumber: 0000:00:14.0 [ 1.961429] hub 3-0:1.0: USB hub found [ 1.961446] hub 3-0:1.0: 6 ports detected [ 1.962378] usbcore: registered new interface driver usbserial_generic [ 1.962382] usbserial: USB Serial support registered for generic [ 1.962414] i8042: PNP: No PS/2 controller found. [ 1.962439] mousedev: PS/2 mouse device common for all mice [ 1.962501] rtc_cmos 00:00: RTC can wake from S4 [ 1.962812] rtc_cmos 00:00: registered as rtc0 [ 1.962869] rtc_cmos 00:00: setting system clock to 2024-04-26T12:07:57 UTC (1714133277) [ 1.962895] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 1.963407] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 1.969891] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 1.969931] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.969933] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.969934] usb usb4: Product: EHCI Host Controller [ 1.969935] usb usb4: Manufacturer: Linux 5.14.0-437.el9.x86_64 ehci_hcd [ 1.969936] usb usb4: SerialNumber: 0000:00:1a.0 [ 1.970014] hub 4-0:1.0: USB hub found [ 1.970017] hub 4-0:1.0: 2 ports detected [ 1.972522] intel_pstate: Intel P-state driver initializing [ 2.022551] Freeing initrd memory: 33136K [ 2.027809] hid: raw HID events driver (C) Jiri Kosina [ 2.027853] usbcore: registered new interface driver usbhid [ 2.027854] usbhid: USB HID core driver [ 2.027925] drop_monitor: Initializing network drop monitor service [ 2.036689] Initializing XFRM netlink socket [ 2.036768] NET: Registered PF_INET6 protocol family [ 2.041284] Segment Routing with IPv6 [ 2.041300] NET: Registered PF_PACKET protocol family [ 2.041324] mpls_gso: MPLS GSO support [ 2.063512] microcode: Current revision: 0x0b00001b [ 2.081126] resctrl: L3 allocation detected [ 2.081127] resctrl: L3 monitoring detected [ 2.081138] IPI shorthand broadcast: enabled [ 2.081143] AVX2 version of gcm_enc/dec engaged. [ 2.143127] AES CTR mode by8 optimization enabled [ 2.143176] sched_clock: Marking stable (999695719, 1143161972)->(2544981211, -402123520) [ 2.159716] registered taskstats version 1 [ 2.176369] Loading compiled-in X.509 certificates [ 2.176842] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: ac928bd9444a4e48f0eddf90defda693df54cc67' [ 2.177126] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.177400] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.177541] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.177550] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.177732] zswap: loaded using pool lzo/zbud [ 2.200979] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.200991] page_owner is disabled [ 2.201168] pstore: Using crash dump compression: deflate [ 2.201177] Key type big_key registered [ 2.206880] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.210881] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 2.312677] Key type encrypted registered [ 2.312684] ima: No TPM chip found, activating TPM-bypass! [ 2.312686] Loading compiled-in module X.509 certificates [ 2.312974] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: ac928bd9444a4e48f0eddf90defda693df54cc67' [ 2.312976] ima: Allocated hash algorithm: sha256 [ 2.312984] ima: No architecture policies found [ 2.312997] evm: Initialising EVM extended attributes: [ 2.312997] evm: security.selinux [ 2.312997] evm: security.SMACK64 (disabled) [ 2.312998] evm: security.SMACK64EXEC (disabled) [ 2.312998] evm: security.SMACK64TRANSMUTE (disabled) [ 2.312999] evm: security.SMACK64MMAP (disabled) [ 2.312999] evm: security.apparmor (disabled) [ 2.312999] evm: security.ima [ 2.313000] evm: security.capability [ 2.313000] evm: HMAC attrs: 0x1 [ 2.334052] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.334055] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.334446] hub 2-12:1.0: USB hub found [ 2.334522] hub 2-12:1.0: 4 ports detected [ 2.341223] usb 4-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.341225] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.341384] hub 4-1:1.0: USB hub found [ 2.341471] hub 4-1:1.0: 6 ports detected [ 2.392668] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.392669] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.404533] hub 1-1:1.0: USB hub found [ 2.410586] hub 1-1:1.0: 8 ports detected [ 2.624884] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 2.716890] tsc: Refined TSC clocksource calibration: 3499.995 MHz [ 2.716894] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734c8180a, max_idle_ns: 440795326857 ns [ 2.723046] clocksource: Switched to clocksource tsc [ 2.729359] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 2.729362] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.734367] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 2.785974] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 2.788680] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 2.788726] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.182134] Freeing unused decrypted memory: 2028K [ 5.182571] Freeing unused kernel image (initmem) memory: 3928K [ 5.182610] Write protecting the kernel read-only data: 28672k [ 5.182782] Freeing unused kernel image (rodata/data gap) memory: 500K [ 5.221512] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.221514] x86/mm: Checking user space page tables [ 5.265310] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.265321] Run /init as init process [ 5.278763] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.278886] systemd[1]: Detected architecture x86-64. Welcome to [0[ 5.278888] systemd[1]: Running in initrd. ;31mCentOS Stream 9 dracut-057-53.git20240104.el9 (Initramfs)! [ 5.329970] systemd[1]: Hostname set to . [ OK [[ 5.386033] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.386139] systemd[1]: Reached target Initrd /usr File System. 0m] Reached target Initrd /usr File System. [ OK [[ 5.407992] systemd[1]: Reached target Local File Systems. 0m] Reached target Local File Systems. [ OK [[ 5.422009] systemd[1]: Reached target Slice Units. 0m] Reached target Slice Units. [ OK [[ 5.433937] systemd[1]: Reached target Swaps. 0m] Reached target Swaps. [ OK [[ 5.444945] systemd[1]: Reached target Timer Units. 0m] Reached target Timer Units. [ OK [[ 5.456989] systemd[1]: Listening on D-Bus System Message Bus Socket. 0m] Listening on D-Bus System Message Bus Socket. [ OK [[ 5.472169] systemd[1]: Listening on Journal Socket (/dev/log). 0m] Listening on Journal Socket (/dev/log). [ OK [[ 5.486041] systemd[1]: Listening on Journal Socket. 0m] Listening on Journal Socket. [ OK [[ 5.498000] systemd[1]: Listening on udev Control Socket. 0m] Listening on udev Control Socket. [ OK [[ 5.511975] systemd[1]: Listening on udev Kernel Socket. 0m] Listening on udev Kernel Socket. [ OK [[ 5.525983] systemd[1]: Reached target Socket Units. 0m] Reached target Socket Units. Startin[ 5.544544] systemd[1]: Starting Create List of Static Device Nodes... g Create List of Static Device Nodes... Startin[ 5.560085] systemd[1]: Starting Journal Service... g Journal Service... [ 5.572012] systemd[1]: Load Kernel Modules was skipped because no trigger condition checks were met. Startin[ 5.582991] systemd[1]: Starting Apply Kernel Variables... g Apply Kernel Variables... Startin[ 5.595448] systemd[1]: Starting Create System Users... g Create System Users... Startin[ 5.607669] systemd[1]: Starting Setup Virtual Console... g Setup Virtual Console... [ OK [[ 5.620768] systemd[1]: Started Journal Service. 0m] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut cmdline hook... [ OK ] Finished dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. Starting dracut initqueue hook... [ 6.013689] dca service started, version 1.12.1 Starting Show Plymouth Boot Screen... [ OK ] Started Show Plymouth Boot Screen. [ OK ] Started Forwa[ 6.061197] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver rd Password R…[ 6.061199] ixgbe: Copyright (c) 1999-2016 Intel Corporation. s to Plymouth Directory Watch[0[ 6.076124] igb: Intel(R) Gigabit Ethernet Network Driver m. [ O[ 6.076127] igb: Copyright (c) 2007-2014 Intel Corporation. K ] Reached[ 6.076377] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode target [0;1;39[ 6.076380] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst mPath Units.[ 6.097694] scsi host0: ahci [ OK ] Reached target B[ 6.097842] scsi host1: ahci [ 6.099003] scsi host2: ahci asic System.[ 6.099336] scsi host3: ahci [ 6.099381] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 34 lpm-pol 0 [ 6.099385] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 34 lpm-pol 0 [ 6.099387] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 34 lpm-pol 0 [ 6.099391] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 34 lpm-pol 0 [ 6.099676] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 6.099680] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.116364] scsi host4: ahci [ 6.116595] scsi host5: ahci [ 6.116719] scsi host6: ahci [ 6.116867] scsi host7: ahci [ 6.117060] scsi host8: ahci [ 6.117247] scsi host9: ahci [ 6.117302] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 44 lpm-pol 0 [ 6.117304] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 44 lpm-pol 0 [ 6.117306] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 44 lpm-pol 0 [ 6.117309] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 44 lpm-pol 0 [ 6.117312] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 44 lpm-pol 0 [ 6.117314] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 44 lpm-pol 0 [ 6.145197] ACPI: bus type drm_connector registered [ 6.156835] igb 0000:07:00.0: added PHC on eth0 [ 6.156867] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 6.156868] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:1a:54 [ 6.156944] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 6.156945] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.185049] nvme nvme0: pci function 0000:02:00.0 [ 6.187433] nvme nvme0: 8/0/0 default/read/poll queues [ 6.208088] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.217237] Console: switching to colour dummy device 80x25 [ 6.217419] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 6.217420] ast 0000:06:00.0: [drm] AST 2400 detected [ 6.217431] ast 0000:06:00.0: [drm] Using analog VGA [ 6.217439] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.217628] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.221366] igb 0000:07:00.1: added PHC on eth1 [ 6.221411] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.221412] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:1a:55 [ 6.221494] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.221495] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.224962] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.226839] fbcon: astdrmfb (fb0) is primary device [ 6.245419] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.251453] Console: switching to colour frame buffer device 128x48 [ 6.270641] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 6.410190] ata3: SATA link down (SStatus 0 SControl 300) [ 6.410222] ata4: SATA link down (SStatus 0 SControl 300) [ 6.410249] ata2: SATA link down (SStatus 0 SControl 300) [ 6.410276] ata1: SATA link down (SStatus 0 SControl 300) [ 6.426203] ata10: SATA link down (SStatus 0 SControl 300) [ 6.426230] ata7: SATA link down (SStatus 0 SControl 300) [ 6.426250] ata8: SATA link down (SStatus 0 SControl 300) [ 6.426274] ata9: SATA link down (SStatus 0 SControl 300) [ 6.426301] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.426321] ata6: SATA link down (SStatus 0 SControl 300) [ 6.427748] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.428334] ata5.00: NCQ Send/Recv Log not supported [ 6.428335] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.429671] ata5.00: NCQ Send/Recv Log not supported [ 6.429672] ata5.00: configured for UDMA/133 [ 6.429761] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.510658] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.571897] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.571913] sd 4:0:0:0: [sda] Write Protect is off [ 6.571937] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.571961] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.584097] sda: sda1 [ 6.584150] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.210294] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.210583] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.210665] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.210666] ixgbe 0000:03:00.0: 0c:c4:7a:88:77:60 [ 7.213718] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.371203] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.371491] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.371573] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.371574] ixgbe 0000:03:00.1: 0c:c4:7a:88:77:61 [ 7.374591] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.382704] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 7.415709] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check…6d2c-4093-809e-dd42758f0c27... [ OK ] Finished File System Check…5-6d2c-4093-809e-dd42758f0c27. Mounting /sysroot... [ 7.640367] EXT4-fs (sda1): mounted filesystem a494b625-6d2c-4093-809e-dd42758f0c27 ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manage…for Device Events and Files... [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. Starting Switch Ro[ 7.958125] systemd-journald[281]: Received SIGTERM from PID 1 (systemd). ot... [ 8.493759] SELinux: policy capability network_peer_controls=1 [ 8.493762] SELinux: policy capability open_perms=1 [ 8.493763] SELinux: policy capability extended_socket_class=1 [ 8.493763] SELinux: policy capability always_check_network=0 [ 8.493764] SELinux: policy capability cgroup_seclabel=1 [ 8.493764] SELinux: policy capability nnp_nosuid_transition=1 [ 8.493764] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.537796] audit: type=1403 audit(1714133284.073:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.540226] systemd[1]: Successfully loaded SELinux policy in 115.649ms. [ 8.613952] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 26.875ms. [ 8.622701] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.622818] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ 8.666322] systemd[1]: Hostname set to . [ OK [[ 9.587073] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ 9.587171] systemd[1]: Stopped Switch Root. 0m] Stopped [0;[ 9.587571] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.587912] systemd[1]: Created slice Slice /system/getty. 1;39mSwitch Root[ 9.616219] systemd[1]: Created slice Slice /system/modprobe. . [[ 9.616495] systemd[1]: Created slice Slice /system/serial-getty. OK ] Crea[ 9.616759] systemd[1]: Created slice Slice /system/sshd-keygen. [ 9.617048] systemd[1]: Created slice User and Session Slice. [ 9.630583] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.630708] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ 9.631079] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. ted slice [0;1;[ 9.675647] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ 9.675671] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.675688] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ 9.675704] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.675719] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.675735] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.675754] systemd[1]: Reached target Local Encrypted Volumes. [ 9.675778] systemd[1]: Stopped target Switch Root. 39mSlice /system[ 9.675800] systemd[1]: Stopped target Initrd File Systems. [ 9.675814] systemd[1]: Stopped target Initrd Root File System. [ 9.675843] systemd[1]: Reached target Local Integrity Protected Volumes. [ 9.675890] systemd[1]: Reached target Path Units. /getty. [[ 9.775240] systemd[1]: Reached target Slice Units. [ 9.775271] systemd[1]: Reached target Swaps. [ 9.775291] systemd[1]: Reached target Local Verity Protected Volumes. [ 9.775660] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ 9.779217] systemd[1]: Listening on LVM2 poll daemon socket. [0;32m OK ] Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/serial-getty[ 9.816328] systemd[1]: Listening on RPCbind Server Activation Socket. [ 9.816389] systemd[1]: Reached target RPC Port Mapper. [ 9.817967] systemd[1]: Listening on Process Core Dump Socket. . [ OK[ 9.834846] systemd[1]: Listening on initctl Compatibility Named Pipe. ] Created [ 9.840072] systemd[1]: Listening on udev Control Socket. [ 9.842887] systemd[1]: Listening on udev Kernel Socket. slice Slice /system/sshd-keygen. [ OK ] Created slice User and Session Slic[ 9.863121] systemd[1]: Mounting Huge Pages File System... [ 9.864168] systemd[1]: Mounting POSIX Message Queue File System... e. [ OK ] Sta[ 9.877039] systemd[1]: Mounting Kernel Debug File System... [ 9.877844] systemd[1]: Mounting Kernel Trace File System... [ 9.877949] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). rted Forward Password R[ 9.905105] systemd[1]: Starting Create List of Static Device Nodes... …uests to Wall[ 9.905904] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... [ 9.913665] systemd[1]: Starting Load Kernel Module configfs... Directory Watch. [[ 9.931113] systemd[1]: Starting Load Kernel Module drm... [ 9.931892] systemd[1]: Starting Load Kernel Module fuse... OK ] Set up automount Arbitrary\xe2[ 9.945950] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... \x80\xa6s File System [ 9.946023] systemd[1]: plymouth-switch-root.service: Deactivated successfully. [ 9.946068] systemd[1]: Stopped Plymouth switch root service. [ 9.946245] systemd[1]: Stopped Journal Service. Automount Point[ 9.976241] systemd[1]: Starting Journal Service... [ 9.978979] systemd[1]: Starting Load Kernel Modules... [0m. [ OK ] Reach[ 9.988037] systemd[1]: Starting Generate network units from Kernel command line... [ 9.988087] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). ed target [0;1;[ 9.988892] systemd[1]: Starting Remount Root and Kernel File Systems... 39mceph target\xe2\x80[ 9.997717] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. [ 9.998595] systemd[1]: Starting Coldplug All udev Devices... \xa6on@.service ins[ 10.025478] systemd[1]: Mounted Huge Pages File System. [ 10.031203] EXT4-fs (sda1): re-mounted a494b625-6d2c-4093-809e-dd42758f0c27 r/w. Quota mode: none. tances at once[[ 10.041318] systemd[1]: Mounted POSIX Message Queue File System. 0m. [ [ 10.063984] systemd[1]: Started Journal Service. OK ] Reache[ 10.070078] fuse: init (API version 7.36) d target ceph target…ds@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ OK ] Reached target ceph target…or@.service instances at once. [ 10.112464] systemd-journald[575]: Received client request to flush runtime journal. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Ac[ 10.193588] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.193606] device-mapper: uevent: version 1.0.3 [ 10.193696] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com tivation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM…meventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS …from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network …ts from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Journal Service. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Read and set NIS …e from /etc/sysconfig/network. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Reached target Preparation for Network. Mounting FUSE Control File System... Mounting Kernel Configuration File System... Starting Flush Journal to Persistent Storage... Starting Load/Save OS Random Seed... Starting Apply Kernel Variables... Starting Create Static Device Nodes in /dev... [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... [ OK ] Finished Load Kernel Module configfs. [ 10.653137] power_meter ACPI000D:00: Found ACPI power meter. [ 10.653156] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 10.653160] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). [ 10.722966] IPMI message handler: version 39.2 [ OK ] Finished Automatic Boot Loader Update. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ 11.311777] ipmi device interface [ 11.891193] ipmi_si: IPMI System Interface driver [ 11.891207] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 11.891209] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 11.891210] ipmi_si: Adding SMBIOS-specified kcs state machine [ 11.891275] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 11.891377] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 11.892031] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 11.892034] ipmi_si: Adding ACPI-specified kcs state machine [ 11.892110] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 11.965916] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 12.003393] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 12.051638] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 12.059630] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 12.060225] i2c i2c-3: 2/8 memory slots populated (from DMI) [ 12.060226] i2c i2c-3: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 12.095163] ipmi_ssif: IPMI SSIF Interface driver [ 12.170920] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 12.414098] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 12.421722] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 12.430445] igb 0000:07:00.0: DCA enabled [ 12.430461] igb 0000:07:00.1: DCA enabled [ 12.904158] iTCO_vendor_support: vendor-support=0 [ 13.011627] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 13.011902] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) [ 13.063086] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 13.063089] RAPL PMU: hw unit of domain package 2^-14 Joules [ 13.063090] RAPL PMU: hw unit of domain dram 2^-16 Joules [ OK ] Started /usr/sbin/lvm vgch…-autoactivation event vg_nvme. [ OK ] Finished Create Volatile Files and Directories. Mounting RPC Pipe File System... Starting Security Auditing Service... Starting RPC Bind... [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ 13.338023] RPC: Registered named UNIX socket transport module. [ OK [[ 13.338025] RPC: Registered udp transport module. 0m] Mounted [0;[ 13.338025] RPC: Registered tcp transport module. [ 13.338026] RPC: Registered tcp-with-tls transport module. [ 13.338026] RPC: Registered tcp NFSv4.1 backchannel transport module. 1;39mRPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ 13.558729] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [ 13.567172] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported after September 2030. [ OK [[ 13.567219] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) 0m] Mounted [0;[ 13.567221] EDAC sbridge: Ver: 1.1.2 1;39m/var/lib/ce[ 13.567288] XFS (dm-4): Mounting V4 Filesystem d8a72297-0016-4e4e-85b3-c1e761f31799 [ 13.571516] XFS (dm-4): Ending clean mount [ 13.571560] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) ph. [ 13.639647] intel_rapl_common: Found RAPL domain package [ 13.639652] intel_rapl_common: Found RAPL domain dram [ OK ] Started Security Auditing Service. Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activit…ounting tool every 10 minutes. [ OK ] Started Generate summary o…esterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos…ache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring a…g Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Started User Login Management. [ OK ] Finished Resets System Activity Logs. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started NTP client/server. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 15.631220] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 15.783419] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... [ 16.002983] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [ 16.196993] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 16.197102] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [* ] A start job is running for Network Manager Wait Online (8s / no limit) M [** ] A start job is running for Network Manager Wait Online (9s / no limit) M [*** ] A start job is running for Network Manager Wait Online (9s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ ***] A start job is running for Network …nager Wait Online (11s / no limit) M [ **] A start job is running for Network …nager Wait Online (11s / no limit) M [ *] A start job is running for Network …nager Wait Online (12s / no limit) M [ **] A start job is running for Network …nager Wait Online (12s / no limit) M [ ***] A start job is running for Network …nager Wait Online (13s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (13s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' + myips=172.21.15.154 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. [ 24.086571] block sda: the capability attribute has been deprecated. + '[' 172.21.15.154 '!=' '' ']' + set -e + '[' -n 172.21.15.154 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.154 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.154 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' Starting SETroubleshoot da…ing new SELinux denial logs... + newhostname=smithi154.front.sepia.ceph.com + '[' -n smithi154.front.sepia.ceph.com ']' + hostname smithi154.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi154 + echo smithi154 + grep -q front.sepia.ceph.com /etc/hosts + sed -i '1i172.21.15.154 smithi154.front.sepia.ceph.com smithi154\' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 9 Kernel 5.14.0-437.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi154 login: [disconnect] 2024-04-26T12:08:26.706 INFO:teuthology.misc:Re-opening connections... 2024-04-26T12:08:26.706 INFO:teuthology.misc:trying to connect to ubuntu@smithi154.front.sepia.ceph.com 2024-04-26T12:08:26.707 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-04-26T12:08:26.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:08:27.452 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-04-26T12:08:27.939 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-04-26T12:08:27.939 DEBUG:teuthology.misc:waited 1.232762098312378 2024-04-26T12:08:28.940 DEBUG:tasks.ceph_manager:Mounting data for osd.1 on ubuntu@smithi154.front.sepia.ceph.com 2024-04-26T12:08:28.940 INFO:tasks.ceph_manager:Mounting osd.1: dev: ubuntu@smithi154.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-1, type: xfs, options: ['noatime'] 2024-04-26T12:08:28.940 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-26T12:08:29.053 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:08:29.110 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T12:08:29.110 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T12:08:29.112 INFO:tasks.ceph.osd.1:Started 2024-04-26T12:08:29.113 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:08:29.209 INFO:teuthology.orchestra.run.smithi154.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-26T12:08:29.211 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T12:08:29.212 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-04-26T12:08:30.050 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:08:30.049+0000 7f7ba671d640 -1 Falling back to public interface 2024-04-26T12:08:31.992 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-26T12:08:33.862 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:08:33.861+0000 7f7ba671d640 -1 osd.1 37 log_to_monitors true 2024-04-26T12:08:34.213 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:08:34.315 INFO:teuthology.orchestra.run.smithi154.stderr:no valid command found; 10 closest matches: 2024-04-26T12:08:34.315 INFO:teuthology.orchestra.run.smithi154.stderr:0 2024-04-26T12:08:34.315 INFO:teuthology.orchestra.run.smithi154.stderr:1 2024-04-26T12:08:34.315 INFO:teuthology.orchestra.run.smithi154.stderr:2 2024-04-26T12:08:34.315 INFO:teuthology.orchestra.run.smithi154.stderr:abort 2024-04-26T12:08:34.315 INFO:teuthology.orchestra.run.smithi154.stderr:assert 2024-04-26T12:08:34.315 INFO:teuthology.orchestra.run.smithi154.stderr:bluefs debug_inject_read_zeros 2024-04-26T12:08:34.315 INFO:teuthology.orchestra.run.smithi154.stderr:bluefs files list 2024-04-26T12:08:34.315 INFO:teuthology.orchestra.run.smithi154.stderr:bluefs stats 2024-04-26T12:08:34.315 INFO:teuthology.orchestra.run.smithi154.stderr:bluestore allocator dump block 2024-04-26T12:08:34.315 INFO:teuthology.orchestra.run.smithi154.stderr:bluestore allocator fragmentation block 2024-04-26T12:08:34.316 INFO:teuthology.orchestra.run.smithi154.stderr:admin_socket: invalid command 2024-04-26T12:08:34.317 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T12:08:34.317 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-04-26T12:08:34.733 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T12:08:34.731+0000 7f7b9a4cb640 -1 osd.1 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:08:39.319 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:08:39.426 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T12:08:39.426 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T12:08:39.426 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-04-26T12:08:39.426 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T12:08:44.437 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-26T12:08:44.565 INFO:teuthology.orchestra.run.smithi052.stdout:mon.a: {} 2024-04-26T12:08:44.566 INFO:teuthology.orchestra.run.smithi052.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:08:44.574 INFO:teuthology.orchestra.run.smithi052.stdout:mon.b: {} 2024-04-26T12:08:44.574 INFO:teuthology.orchestra.run.smithi052.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:08:44.583 INFO:teuthology.orchestra.run.smithi052.stdout:mon.c: {} 2024-04-26T12:08:44.583 INFO:teuthology.orchestra.run.smithi052.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:08:44.595 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T12:08:45.722 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T12:08:45.739 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-26T12:08:46.723 INFO:teuthology.orchestra.run.smithi052.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-26T12:08:46.741 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T12:08:47.728 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T12:08:47.746 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-26T12:08:48.737 INFO:teuthology.orchestra.run.smithi052.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-26T12:08:48.754 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T12:08:49.739 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T12:08:49.758 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-26T12:08:50.748 INFO:teuthology.orchestra.run.smithi052.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-26T12:08:50.764 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-26T12:08:50.764 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-26T12:08:50.765 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-26T12:08:50.765 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-26T12:08:50.765 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T12:08:50.765 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:08:51.065 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:08:51.065 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":81,"fsid":"5bc300ae-e948-4ce3-81bb-5abae8c06799","created":"2024-04-26T12:04:41.919527+0000","modified":"2024-04-26T12:08:50.739902+0000","last_up_change":"2024-04-26T12:08:35.679585+0000","last_in_change":"2024-04-26T12:04:43.540390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:04:52.376506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:04:57.775333+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:05:02.226064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:05:02.758806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.0800000429153442,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"638cfa85-e921-4403-9bcb-a7f4653cc3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":28597},{"type":"v1","addr":"172.21.15.143:6801","nonce":28597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":28597},{"type":"v1","addr":"172.21.15.143:6803","nonce":28597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":28597},{"type":"v1","addr":"172.21.15.143:6807","nonce":28597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":28597},{"type":"v1","addr":"172.21.15.143:6805","nonce":28597}]},"public_addr":"172.21.15.143:6801/28597","cluster_addr":"172.21.15.143:6803/28597","heartbeat_back_addr":"172.21.15.143:6807/28597","heartbeat_front_addr":"172.21.15.143:6805/28597","state":["exists","up"]},{"osd":1,"uuid":"2abc8d1e-ad72-4643-ad1e-3566e5113c44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":37,"up_from":66,"up_thru":79,"down_at":38,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":5362},{"type":"v1","addr":"172.21.15.154:6801","nonce":5362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":5362},{"type":"v1","addr":"172.21.15.154:6803","nonce":5362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":5362},{"type":"v1","addr":"172.21.15.154:6807","nonce":5362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":5362},{"type":"v1","addr":"172.21.15.154:6805","nonce":5362}]},"public_addr":"172.21.15.154:6801/5362","cluster_addr":"172.21.15.154:6803/5362","heartbeat_back_addr":"172.21.15.154:6807/5362","heartbeat_front_addr":"172.21.15.154:6805/5362","state":["exists","up"]},{"osd":2,"uuid":"d2ebc562-cb9b-4089-a19b-1788b70b57dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":28709},{"type":"v1","addr":"172.21.15.164:6801","nonce":28709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":28709},{"type":"v1","addr":"172.21.15.164:6803","nonce":28709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":28709},{"type":"v1","addr":"172.21.15.164:6807","nonce":28709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":28709},{"type":"v1","addr":"172.21.15.164:6805","nonce":28709}]},"public_addr":"172.21.15.164:6801/28709","cluster_addr":"172.21.15.164:6803/28709","heartbeat_back_addr":"172.21.15.164:6807/28709","heartbeat_front_addr":"172.21.15.164:6805/28709","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.573478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.624482+0000","dead_epoch":37},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.615449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.5","osds":[2]},{"pgid":"4.15","osds":[0]},{"pgid":"4.2d","osds":[0]},{"pgid":"4.2f","osds":[0]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:08:51.078 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T12:08:51.078 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:08:51.370 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:08:51.370 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":81,"fsid":"5bc300ae-e948-4ce3-81bb-5abae8c06799","created":"2024-04-26T12:04:41.919527+0000","modified":"2024-04-26T12:08:50.739902+0000","last_up_change":"2024-04-26T12:08:35.679585+0000","last_in_change":"2024-04-26T12:04:43.540390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:04:52.376506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:04:57.775333+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:05:02.226064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:05:02.758806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.0800000429153442,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"638cfa85-e921-4403-9bcb-a7f4653cc3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":28597},{"type":"v1","addr":"172.21.15.143:6801","nonce":28597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":28597},{"type":"v1","addr":"172.21.15.143:6803","nonce":28597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":28597},{"type":"v1","addr":"172.21.15.143:6807","nonce":28597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":28597},{"type":"v1","addr":"172.21.15.143:6805","nonce":28597}]},"public_addr":"172.21.15.143:6801/28597","cluster_addr":"172.21.15.143:6803/28597","heartbeat_back_addr":"172.21.15.143:6807/28597","heartbeat_front_addr":"172.21.15.143:6805/28597","state":["exists","up"]},{"osd":1,"uuid":"2abc8d1e-ad72-4643-ad1e-3566e5113c44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":37,"up_from":66,"up_thru":79,"down_at":38,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":5362},{"type":"v1","addr":"172.21.15.154:6801","nonce":5362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":5362},{"type":"v1","addr":"172.21.15.154:6803","nonce":5362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":5362},{"type":"v1","addr":"172.21.15.154:6807","nonce":5362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":5362},{"type":"v1","addr":"172.21.15.154:6805","nonce":5362}]},"public_addr":"172.21.15.154:6801/5362","cluster_addr":"172.21.15.154:6803/5362","heartbeat_back_addr":"172.21.15.154:6807/5362","heartbeat_front_addr":"172.21.15.154:6805/5362","state":["exists","up"]},{"osd":2,"uuid":"d2ebc562-cb9b-4089-a19b-1788b70b57dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":28709},{"type":"v1","addr":"172.21.15.164:6801","nonce":28709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":28709},{"type":"v1","addr":"172.21.15.164:6803","nonce":28709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":28709},{"type":"v1","addr":"172.21.15.164:6807","nonce":28709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":28709},{"type":"v1","addr":"172.21.15.164:6805","nonce":28709}]},"public_addr":"172.21.15.164:6801/28709","cluster_addr":"172.21.15.164:6803/28709","heartbeat_back_addr":"172.21.15.164:6807/28709","heartbeat_front_addr":"172.21.15.164:6805/28709","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.573478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.624482+0000","dead_epoch":37},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.615449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.5","osds":[2]},{"pgid":"4.15","osds":[0]},{"pgid":"4.2d","osds":[0]},{"pgid":"4.2f","osds":[0]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:08:51.383 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T12:08:51.384 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T12:08:51.384 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T12:08:51.529 INFO:teuthology.orchestra.run.smithi052.stdout:34359738421 2024-04-26T12:08:51.530 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:08:51.540 INFO:teuthology.orchestra.run.smithi052.stdout:283467841541 2024-04-26T12:08:51.541 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:08:51.546 INFO:teuthology.orchestra.run.smithi052.stdout:34359738421 2024-04-26T12:08:51.546 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:08:51.841 INFO:teuthology.orchestra.run.smithi052.stdout:34359738419 2024-04-26T12:08:51.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738421 got 34359738419 for osd.0 2024-04-26T12:08:51.889 INFO:teuthology.orchestra.run.smithi052.stdout:34359738419 2024-04-26T12:08:51.896 INFO:teuthology.orchestra.run.smithi052.stdout:283467841540 2024-04-26T12:08:51.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738421 got 34359738419 for osd.2 2024-04-26T12:08:51.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 283467841541 got 283467841540 for osd.1 2024-04-26T12:08:52.856 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:08:52.903 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:08:52.911 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:08:53.172 INFO:teuthology.orchestra.run.smithi052.stdout:34359738421 2024-04-26T12:08:53.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738421 got 34359738421 for osd.0 2024-04-26T12:08:53.190 DEBUG:teuthology.parallel:result is None 2024-04-26T12:08:53.223 INFO:teuthology.orchestra.run.smithi052.stdout:34359738421 2024-04-26T12:08:53.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738421 got 34359738421 for osd.2 2024-04-26T12:08:53.236 DEBUG:teuthology.parallel:result is None 2024-04-26T12:08:53.254 INFO:teuthology.orchestra.run.smithi052.stdout:283467841541 2024-04-26T12:08:53.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 283467841541 got 283467841541 for osd.1 2024-04-26T12:08:53.267 DEBUG:teuthology.parallel:result is None 2024-04-26T12:08:53.267 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T12:08:53.268 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:08:53.607 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:08:53.609 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:08:53.617 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-04-26T12:08:52.742604+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129196959,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2917,"num_read_kb":1488438,"num_write":30802,"num_write_kb":4620959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6958,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34707,"ondisk_log_size":34707,"up":210,"acting":206,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":337660,"kb_used_data":65100,"kb_used_omap":8,"kb_used_meta":272503,"kb_avail":282777860,"statfs":{"total":289910292480,"available":289564528640,"internally_reserved":0,"allocated":66662400,"data_stored":259394689,"data_compressed":19261499,"data_compressed_allocated":31768576,"data_compressed_original":225738752,"omap_allocated":9193,"internal_metadata":279043095},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-2895,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2844,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.007615"},"pg_stats":[{"pgid":"4.3f","version":"60'426","reported_seq":497,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T12:08:50.748180+0000","last_change":"2024-04-26T12:08:50.748180+0000","last_active":"2024-04-26T12:08:36.692153+0000","last_peered":"2024-04-26T12:08:34.684175+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"2024-04-26T12:06:12.960288+0000","last_became_peered":"2024-04-26T12:06:12.960288+0000","last_unstale":"2024-04-26T12:08:50.748180+0000","last_undegraded":"2024-04-26T12:08:50.748180+0000","last_fullsized":"2024-04-26T12:08:50.748180+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:04.823699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9964,"num_write":393,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"60'470","reported_seq":598,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738540+0000","last_change":"2024-04-26T12:08:43.719204+0000","last_active":"2024-04-26T12:08:49.738540+0000","last_peered":"2024-04-26T12:08:49.738540+0000","last_clean":"2024-04-26T12:08:49.738540+0000","last_became_active":"2024-04-26T12:08:43.717325+0000","last_became_peered":"2024-04-26T12:08:43.717325+0000","last_unstale":"2024-04-26T12:08:49.738540+0000","last_undegraded":"2024-04-26T12:08:49.738540+0000","last_fullsized":"2024-04-26T12:08:49.738540+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:57.396493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":34556,"num_write":444,"num_write_kb":129697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"60'370","reported_seq":799,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T12:08:50.753639+0000","last_change":"2024-04-26T12:08:50.753639+0000","last_active":"2024-04-26T12:08:50.753639+0000","last_peered":"2024-04-26T12:08:50.753639+0000","last_clean":"2024-04-26T12:08:50.753639+0000","last_became_active":"2024-04-26T12:08:50.752468+0000","last_became_peered":"2024-04-26T12:08:50.752468+0000","last_unstale":"2024-04-26T12:08:50.753639+0000","last_undegraded":"2024-04-26T12:08:50.753639+0000","last_fullsized":"2024-04-26T12:08:50.753639+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:54.514768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":349,"num_write_kb":51115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"60'377","reported_seq":482,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738688+0000","last_change":"2024-04-26T12:05:03.791234+0000","last_active":"2024-04-26T12:08:49.738688+0000","last_peered":"2024-04-26T12:08:49.738688+0000","last_clean":"2024-04-26T12:08:49.738688+0000","last_became_active":"2024-04-26T12:05:03.790717+0000","last_became_peered":"2024-04-26T12:05:03.790717+0000","last_unstale":"2024-04-26T12:08:49.738688+0000","last_undegraded":"2024-04-26T12:08:49.738688+0000","last_fullsized":"2024-04-26T12:08:49.738688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:52.358881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17376,"num_write":341,"num_write_kb":46680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'445","reported_seq":547,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738148+0000","last_change":"2024-04-26T12:08:39.705318+0000","last_active":"2024-04-26T12:08:49.738148+0000","last_peered":"2024-04-26T12:08:49.738148+0000","last_clean":"2024-04-26T12:08:49.738148+0000","last_became_active":"2024-04-26T12:08:39.702117+0000","last_became_peered":"2024-04-26T12:08:39.702117+0000","last_unstale":"2024-04-26T12:08:49.738148+0000","last_undegraded":"2024-04-26T12:08:49.738148+0000","last_fullsized":"2024-04-26T12:08:49.738148+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:39.986313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24197,"num_write":416,"num_write_kb":80466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"60'375","reported_seq":467,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738477+0000","last_change":"2024-04-26T12:05:03.791560+0000","last_active":"2024-04-26T12:08:49.738477+0000","last_peered":"2024-04-26T12:08:49.738477+0000","last_clean":"2024-04-26T12:08:49.738477+0000","last_became_active":"2024-04-26T12:05:03.790578+0000","last_became_peered":"2024-04-26T12:05:03.790578+0000","last_unstale":"2024-04-26T12:08:49.738477+0000","last_undegraded":"2024-04-26T12:08:49.738477+0000","last_fullsized":"2024-04-26T12:08:49.738477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6518,"num_write":348,"num_write_kb":38078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'428","reported_seq":521,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738770+0000","last_change":"2024-04-26T12:05:03.791215+0000","last_active":"2024-04-26T12:08:49.738770+0000","last_peered":"2024-04-26T12:08:49.738770+0000","last_clean":"2024-04-26T12:08:49.738770+0000","last_became_active":"2024-04-26T12:05:03.790615+0000","last_became_peered":"2024-04-26T12:05:03.790615+0000","last_unstale":"2024-04-26T12:08:49.738770+0000","last_undegraded":"2024-04-26T12:08:49.738770+0000","last_fullsized":"2024-04-26T12:08:49.738770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:55.388027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12560,"num_write":398,"num_write_kb":67332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"60'387","reported_seq":523,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738298+0000","last_change":"2024-04-26T12:05:03.785861+0000","last_active":"2024-04-26T12:08:49.738298+0000","last_peered":"2024-04-26T12:08:49.738298+0000","last_clean":"2024-04-26T12:08:49.738298+0000","last_became_active":"2024-04-26T12:05:03.785382+0000","last_became_peered":"2024-04-26T12:05:03.785382+0000","last_unstale":"2024-04-26T12:08:49.738298+0000","last_undegraded":"2024-04-26T12:08:49.738298+0000","last_fullsized":"2024-04-26T12:08:49.738298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:51.870183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":41160,"num_write":356,"num_write_kb":80219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"60'405","reported_seq":897,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738395+0000","last_change":"2024-04-26T12:08:46.730220+0000","last_active":"2024-04-26T12:08:49.738395+0000","last_peered":"2024-04-26T12:08:49.738395+0000","last_clean":"2024-04-26T12:08:49.738395+0000","last_became_active":"2024-04-26T12:08:46.729039+0000","last_became_peered":"2024-04-26T12:08:46.729039+0000","last_unstale":"2024-04-26T12:08:49.738395+0000","last_undegraded":"2024-04-26T12:08:49.738395+0000","last_fullsized":"2024-04-26T12:08:49.738395+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:00.707126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":11674,"num_write":372,"num_write_kb":34604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"60'425","reported_seq":574,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738357+0000","last_change":"2024-04-26T12:08:41.718786+0000","last_active":"2024-04-26T12:08:49.738357+0000","last_peered":"2024-04-26T12:08:49.738357+0000","last_clean":"2024-04-26T12:08:49.738357+0000","last_became_active":"2024-04-26T12:08:41.716014+0000","last_became_peered":"2024-04-26T12:08:41.716014+0000","last_unstale":"2024-04-26T12:08:49.738357+0000","last_undegraded":"2024-04-26T12:08:49.738357+0000","last_fullsized":"2024-04-26T12:08:49.738357+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:20.096806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":48419,"num_write":390,"num_write_kb":92286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"60'372","reported_seq":486,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.739173+0000","last_change":"2024-04-26T12:05:03.791046+0000","last_active":"2024-04-26T12:08:49.739173+0000","last_peered":"2024-04-26T12:08:49.739173+0000","last_clean":"2024-04-26T12:08:49.739173+0000","last_became_active":"2024-04-26T12:05:03.790662+0000","last_became_peered":"2024-04-26T12:05:03.790662+0000","last_unstale":"2024-04-26T12:08:49.739173+0000","last_undegraded":"2024-04-26T12:08:49.739173+0000","last_fullsized":"2024-04-26T12:08:49.739173+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:35.458663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25905,"num_write":353,"num_write_kb":75437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'351","reported_seq":423,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738232+0000","last_change":"2024-04-26T12:08:41.718349+0000","last_active":"2024-04-26T12:08:49.738232+0000","last_peered":"2024-04-26T12:08:49.738232+0000","last_clean":"2024-04-26T12:08:49.738232+0000","last_became_active":"2024-04-26T12:08:41.715726+0000","last_became_peered":"2024-04-26T12:08:41.715726+0000","last_unstale":"2024-04-26T12:08:49.738232+0000","last_undegraded":"2024-04-26T12:08:49.738232+0000","last_fullsized":"2024-04-26T12:08:49.738232+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:00.589164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8884,"num_write":327,"num_write_kb":58289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"60'405","reported_seq":482,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738094+0000","last_change":"2024-04-26T12:08:39.705153+0000","last_active":"2024-04-26T12:08:49.738094+0000","last_peered":"2024-04-26T12:08:49.738094+0000","last_clean":"2024-04-26T12:08:49.738094+0000","last_became_active":"2024-04-26T12:08:39.702141+0000","last_became_peered":"2024-04-26T12:08:39.702141+0000","last_unstale":"2024-04-26T12:08:49.738094+0000","last_undegraded":"2024-04-26T12:08:49.738094+0000","last_fullsized":"2024-04-26T12:08:49.738094+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:42.807520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6771,"num_write":372,"num_write_kb":54786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"60'431","reported_seq":934,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738502+0000","last_change":"2024-04-26T12:08:48.741419+0000","last_active":"2024-04-26T12:08:49.738502+0000","last_peered":"2024-04-26T12:08:49.738502+0000","last_clean":"2024-04-26T12:08:49.738502+0000","last_became_active":"2024-04-26T12:08:48.740170+0000","last_became_peered":"2024-04-26T12:08:48.740170+0000","last_unstale":"2024-04-26T12:08:49.738502+0000","last_undegraded":"2024-04-26T12:08:49.738502+0000","last_fullsized":"2024-04-26T12:08:49.738502+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:52.026016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26572,"num_write":398,"num_write_kb":83974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'394","reported_seq":893,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738664+0000","last_change":"2024-04-26T12:08:41.717703+0000","last_active":"2024-04-26T12:08:49.738664+0000","last_peered":"2024-04-26T12:08:49.738664+0000","last_clean":"2024-04-26T12:08:49.738664+0000","last_became_active":"2024-04-26T12:08:41.715956+0000","last_became_peered":"2024-04-26T12:08:41.715956+0000","last_unstale":"2024-04-26T12:08:49.738664+0000","last_undegraded":"2024-04-26T12:08:49.738664+0000","last_fullsized":"2024-04-26T12:08:49.738664+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:34.291197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":38136,"num_write":355,"num_write_kb":38484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'432","reported_seq":540,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738308+0000","last_change":"2024-04-26T12:05:03.786360+0000","last_active":"2024-04-26T12:08:49.738308+0000","last_peered":"2024-04-26T12:08:49.738308+0000","last_clean":"2024-04-26T12:08:49.738308+0000","last_became_active":"2024-04-26T12:05:03.785991+0000","last_became_peered":"2024-04-26T12:05:03.785991+0000","last_unstale":"2024-04-26T12:08:49.738308+0000","last_undegraded":"2024-04-26T12:08:49.738308+0000","last_fullsized":"2024-04-26T12:08:49.738308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:17.702068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18244,"num_write":400,"num_write_kb":59033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'381","reported_seq":827,"reported_epoch":81,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:08:51.469778+0000","last_change":"2024-04-26T12:08:51.470014+0000","last_active":"2024-04-26T12:08:51.469778+0000","last_peered":"2024-04-26T12:08:51.469778+0000","last_clean":"2024-04-26T12:06:11.463514+0000","last_became_active":"2024-04-26T12:08:37.784944+0000","last_became_peered":"2024-04-26T12:08:37.784944+0000","last_unstale":"2024-04-26T12:08:51.469778+0000","last_undegraded":"2024-04-26T12:08:51.469778+0000","last_fullsized":"2024-04-26T12:08:37.703236+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:11.231375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":350,"num_write_kb":21212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"60'424","reported_seq":511,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738345+0000","last_change":"2024-04-26T12:08:42.718639+0000","last_active":"2024-04-26T12:08:49.738345+0000","last_peered":"2024-04-26T12:08:49.738345+0000","last_clean":"2024-04-26T12:08:49.738345+0000","last_became_active":"2024-04-26T12:08:42.716846+0000","last_became_peered":"2024-04-26T12:08:42.716846+0000","last_unstale":"2024-04-26T12:08:49.738345+0000","last_undegraded":"2024-04-26T12:08:49.738345+0000","last_fullsized":"2024-04-26T12:08:49.738345+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:00.928679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13930,"num_write":388,"num_write_kb":116055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'426","reported_seq":538,"reported_epoch":80,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:08:49.738461+0000","last_change":"2024-04-26T12:08:37.787898+0000","last_active":"2024-04-26T12:08:49.738461+0000","last_peered":"2024-04-26T12:08:49.738461+0000","last_clean":"2024-04-26T12:06:11.463289+0000","last_became_active":"2024-04-26T12:08:37.786618+0000","last_became_peered":"2024-04-26T12:08:37.786618+0000","last_unstale":"2024-04-26T12:08:49.738461+0000","last_undegraded":"2024-04-26T12:08:37.694919+0000","last_fullsized":"2024-04-26T12:08:37.687574+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:07.116133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26908,"num_write":383,"num_write_kb":71324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"60'425","reported_seq":543,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738830+0000","last_change":"2024-04-26T12:05:03.792219+0000","last_active":"2024-04-26T12:08:49.738830+0000","last_peered":"2024-04-26T12:08:49.738830+0000","last_clean":"2024-04-26T12:08:49.738830+0000","last_became_active":"2024-04-26T12:05:03.791061+0000","last_became_peered":"2024-04-26T12:05:03.791061+0000","last_unstale":"2024-04-26T12:08:49.738830+0000","last_undegraded":"2024-04-26T12:08:49.738830+0000","last_fullsized":"2024-04-26T12:08:49.738830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19715,"num_write":398,"num_write_kb":30150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'450","reported_seq":635,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738773+0000","last_change":"2024-04-26T12:05:03.792073+0000","last_active":"2024-04-26T12:08:49.738773+0000","last_peered":"2024-04-26T12:08:49.738773+0000","last_clean":"2024-04-26T12:08:49.738773+0000","last_became_active":"2024-04-26T12:05:03.791693+0000","last_became_peered":"2024-04-26T12:05:03.791693+0000","last_unstale":"2024-04-26T12:08:49.738773+0000","last_undegraded":"2024-04-26T12:08:49.738773+0000","last_fullsized":"2024-04-26T12:08:49.738773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":65124,"num_write":423,"num_write_kb":142714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'434","reported_seq":535,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738057+0000","last_change":"2024-04-26T12:08:46.730582+0000","last_active":"2024-04-26T12:08:49.738057+0000","last_peered":"2024-04-26T12:08:49.738057+0000","last_clean":"2024-04-26T12:08:49.738057+0000","last_became_active":"2024-04-26T12:08:46.728804+0000","last_became_peered":"2024-04-26T12:08:46.728804+0000","last_unstale":"2024-04-26T12:08:49.738057+0000","last_undegraded":"2024-04-26T12:08:49.738057+0000","last_fullsized":"2024-04-26T12:08:49.738057+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:47.745435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":15350,"num_write":405,"num_write_kb":59295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"60'424","reported_seq":534,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737777+0000","last_change":"2024-04-26T12:05:03.788658+0000","last_active":"2024-04-26T12:08:49.737777+0000","last_peered":"2024-04-26T12:08:49.737777+0000","last_clean":"2024-04-26T12:08:49.737777+0000","last_became_active":"2024-04-26T12:05:03.788050+0000","last_became_peered":"2024-04-26T12:05:03.788050+0000","last_unstale":"2024-04-26T12:08:49.737777+0000","last_undegraded":"2024-04-26T12:08:49.737777+0000","last_fullsized":"2024-04-26T12:08:49.737777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23772,"num_write":390,"num_write_kb":67944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"60'447","reported_seq":523,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737641+0000","last_change":"2024-04-26T12:08:40.707153+0000","last_active":"2024-04-26T12:08:49.737641+0000","last_peered":"2024-04-26T12:08:49.737641+0000","last_clean":"2024-04-26T12:08:49.737641+0000","last_became_active":"2024-04-26T12:08:40.703880+0000","last_became_peered":"2024-04-26T12:08:40.703880+0000","last_unstale":"2024-04-26T12:08:49.737641+0000","last_undegraded":"2024-04-26T12:08:49.737641+0000","last_fullsized":"2024-04-26T12:08:49.737641+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:25.187022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9403,"num_write":417,"num_write_kb":67425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"60'417","reported_seq":504,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738394+0000","last_change":"2024-04-26T12:08:42.717934+0000","last_active":"2024-04-26T12:08:49.738394+0000","last_peered":"2024-04-26T12:08:49.738394+0000","last_clean":"2024-04-26T12:08:49.738394+0000","last_became_active":"2024-04-26T12:08:42.715812+0000","last_became_peered":"2024-04-26T12:08:42.715812+0000","last_unstale":"2024-04-26T12:08:49.738394+0000","last_undegraded":"2024-04-26T12:08:49.738394+0000","last_fullsized":"2024-04-26T12:08:49.738394+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:09.442852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20466,"num_write":400,"num_write_kb":42225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"60'475","reported_seq":601,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738500+0000","last_change":"2024-04-26T12:05:03.787909+0000","last_active":"2024-04-26T12:08:49.738500+0000","last_peered":"2024-04-26T12:08:49.738500+0000","last_clean":"2024-04-26T12:08:49.738500+0000","last_became_active":"2024-04-26T12:05:03.787562+0000","last_became_peered":"2024-04-26T12:05:03.787562+0000","last_unstale":"2024-04-26T12:08:49.738500+0000","last_undegraded":"2024-04-26T12:08:49.738500+0000","last_fullsized":"2024-04-26T12:08:49.738500+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25186,"num_write":431,"num_write_kb":48184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"60'409","reported_seq":894,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.742158+0000","last_change":"2024-04-26T12:08:49.741823+0000","last_active":"2024-04-26T12:08:49.742158+0000","last_peered":"2024-04-26T12:08:49.742158+0000","last_clean":"2024-04-26T12:08:49.742158+0000","last_became_active":"2024-04-26T12:08:49.740497+0000","last_became_peered":"2024-04-26T12:08:49.740497+0000","last_unstale":"2024-04-26T12:08:49.742158+0000","last_undegraded":"2024-04-26T12:08:49.742158+0000","last_fullsized":"2024-04-26T12:08:49.742158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:00.225872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":20137,"num_write":374,"num_write_kb":55441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'392","reported_seq":490,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738278+0000","last_change":"2024-04-26T12:08:47.737270+0000","last_active":"2024-04-26T12:08:49.738278+0000","last_peered":"2024-04-26T12:08:49.738278+0000","last_clean":"2024-04-26T12:08:49.738278+0000","last_became_active":"2024-04-26T12:08:47.735361+0000","last_became_peered":"2024-04-26T12:08:47.735361+0000","last_unstale":"2024-04-26T12:08:49.738278+0000","last_undegraded":"2024-04-26T12:08:49.738278+0000","last_fullsized":"2024-04-26T12:08:49.738278+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:09.838696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29179,"num_write":355,"num_write_kb":59011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'380","reported_seq":837,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738143+0000","last_change":"2024-04-26T12:08:41.717953+0000","last_active":"2024-04-26T12:08:49.738143+0000","last_peered":"2024-04-26T12:08:49.738143+0000","last_clean":"2024-04-26T12:08:49.738143+0000","last_became_active":"2024-04-26T12:08:41.716234+0000","last_became_peered":"2024-04-26T12:08:41.716234+0000","last_unstale":"2024-04-26T12:08:49.738143+0000","last_undegraded":"2024-04-26T12:08:49.738143+0000","last_fullsized":"2024-04-26T12:08:49.738143+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:37.480062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13036,"num_write":347,"num_write_kb":33880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"60'461","reported_seq":562,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737837+0000","last_change":"2024-04-26T12:08:46.732653+0000","last_active":"2024-04-26T12:08:49.737837+0000","last_peered":"2024-04-26T12:08:49.737837+0000","last_clean":"2024-04-26T12:08:49.737837+0000","last_became_active":"2024-04-26T12:08:46.730738+0000","last_became_peered":"2024-04-26T12:08:46.730738+0000","last_unstale":"2024-04-26T12:08:49.737837+0000","last_undegraded":"2024-04-26T12:08:49.737837+0000","last_fullsized":"2024-04-26T12:08:49.737837+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:46.177056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":32945,"num_write":426,"num_write_kb":63234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"60'411","reported_seq":898,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737807+0000","last_change":"2024-04-26T12:08:40.704958+0000","last_active":"2024-04-26T12:08:49.737807+0000","last_peered":"2024-04-26T12:08:49.737807+0000","last_clean":"2024-04-26T12:08:49.737807+0000","last_became_active":"2024-04-26T12:08:40.703845+0000","last_became_peered":"2024-04-26T12:08:40.703845+0000","last_unstale":"2024-04-26T12:08:49.737807+0000","last_undegraded":"2024-04-26T12:08:49.737807+0000","last_fullsized":"2024-04-26T12:08:49.737807+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:56.148477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11499,"num_write":377,"num_write_kb":34249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'430","reported_seq":535,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738409+0000","last_change":"2024-04-26T12:05:03.791605+0000","last_active":"2024-04-26T12:08:49.738409+0000","last_peered":"2024-04-26T12:08:49.738409+0000","last_clean":"2024-04-26T12:08:49.738409+0000","last_became_active":"2024-04-26T12:05:03.791251+0000","last_became_peered":"2024-04-26T12:05:03.791251+0000","last_unstale":"2024-04-26T12:08:49.738409+0000","last_undegraded":"2024-04-26T12:08:49.738409+0000","last_fullsized":"2024-04-26T12:08:49.738409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:27.239868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14660,"num_write":404,"num_write_kb":60840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"60'392","reported_seq":497,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737986+0000","last_change":"2024-04-26T12:08:44.723861+0000","last_active":"2024-04-26T12:08:49.737986+0000","last_peered":"2024-04-26T12:08:49.737986+0000","last_clean":"2024-04-26T12:08:49.737986+0000","last_became_active":"2024-04-26T12:08:44.722120+0000","last_became_peered":"2024-04-26T12:08:44.722120+0000","last_unstale":"2024-04-26T12:08:49.737986+0000","last_undegraded":"2024-04-26T12:08:49.737986+0000","last_fullsized":"2024-04-26T12:08:49.737986+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:12.810713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31703,"num_write":351,"num_write_kb":59324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"59'514","reported_seq":589,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738822+0000","last_change":"2024-04-26T12:05:03.430021+0000","last_active":"2024-04-26T12:08:49.738822+0000","last_peered":"2024-04-26T12:08:49.738822+0000","last_clean":"2024-04-26T12:08:49.738822+0000","last_became_active":"2024-04-26T12:05:03.429695+0000","last_became_peered":"2024-04-26T12:05:03.429695+0000","last_unstale":"2024-04-26T12:08:49.738822+0000","last_undegraded":"2024-04-26T12:08:49.738822+0000","last_fullsized":"2024-04-26T12:08:49.738822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":8377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'432","reported_seq":592,"reported_epoch":81,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-26T12:08:51.517969+0000","last_change":"2024-04-26T12:08:51.471546+0000","last_active":"2024-04-26T12:08:51.517969+0000","last_peered":"2024-04-26T12:08:51.517969+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"2024-04-26T12:08:37.786584+0000","last_became_peered":"2024-04-26T12:08:37.786584+0000","last_unstale":"2024-04-26T12:08:51.517969+0000","last_undegraded":"2024-04-26T12:08:51.517969+0000","last_fullsized":"2024-04-26T12:08:37.686907+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:26.544846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":30094,"num_write":388,"num_write_kb":83741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"59'55","reported_seq":130,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738169+0000","last_change":"2024-04-26T12:05:03.428605+0000","last_active":"2024-04-26T12:08:49.738169+0000","last_peered":"2024-04-26T12:08:49.738169+0000","last_clean":"2024-04-26T12:08:49.738169+0000","last_became_active":"2024-04-26T12:05:03.428098+0000","last_became_peered":"2024-04-26T12:05:03.428098+0000","last_unstale":"2024-04-26T12:08:49.738169+0000","last_undegraded":"2024-04-26T12:08:49.738169+0000","last_fullsized":"2024-04-26T12:08:49.738169+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"60'445","reported_seq":554,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738718+0000","last_change":"2024-04-26T12:05:03.788568+0000","last_active":"2024-04-26T12:08:49.738718+0000","last_peered":"2024-04-26T12:08:49.738718+0000","last_clean":"2024-04-26T12:08:49.738718+0000","last_became_active":"2024-04-26T12:05:03.788039+0000","last_became_peered":"2024-04-26T12:05:03.788039+0000","last_unstale":"2024-04-26T12:08:49.738718+0000","last_undegraded":"2024-04-26T12:08:49.738718+0000","last_fullsized":"2024-04-26T12:08:49.738718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":16079,"num_write":410,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"59'64","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737757+0000","last_change":"2024-04-26T12:08:36.696166+0000","last_active":"2024-04-26T12:08:49.737757+0000","last_peered":"2024-04-26T12:08:49.737757+0000","last_clean":"2024-04-26T12:08:49.737757+0000","last_became_active":"2024-04-26T12:08:36.694921+0000","last_became_peered":"2024-04-26T12:08:36.694921+0000","last_unstale":"2024-04-26T12:08:49.737757+0000","last_undegraded":"2024-04-26T12:08:49.737757+0000","last_fullsized":"2024-04-26T12:08:49.737757+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:57.438892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"60'420","reported_seq":534,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738508+0000","last_change":"2024-04-26T12:05:03.788505+0000","last_active":"2024-04-26T12:08:49.738508+0000","last_peered":"2024-04-26T12:08:49.738508+0000","last_clean":"2024-04-26T12:08:49.738508+0000","last_became_active":"2024-04-26T12:05:03.788184+0000","last_became_peered":"2024-04-26T12:05:03.788184+0000","last_unstale":"2024-04-26T12:08:49.738508+0000","last_undegraded":"2024-04-26T12:08:49.738508+0000","last_fullsized":"2024-04-26T12:08:49.738508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":14666,"num_write":383,"num_write_kb":83769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"60'63","reported_seq":152,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738422+0000","last_change":"2024-04-26T12:08:36.697126+0000","last_active":"2024-04-26T12:08:49.738422+0000","last_peered":"2024-04-26T12:08:49.738422+0000","last_clean":"2024-04-26T12:08:49.738422+0000","last_became_active":"2024-04-26T12:08:36.696792+0000","last_became_peered":"2024-04-26T12:08:36.696792+0000","last_unstale":"2024-04-26T12:08:49.738422+0000","last_undegraded":"2024-04-26T12:08:49.738422+0000","last_fullsized":"2024-04-26T12:08:49.738422+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:48.447882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"59'232","reported_seq":332,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.739348+0000","last_change":"2024-04-26T12:08:39.703810+0000","last_active":"2024-04-26T12:08:49.739348+0000","last_peered":"2024-04-26T12:08:49.739348+0000","last_clean":"2024-04-26T12:08:49.739348+0000","last_became_active":"2024-04-26T12:08:39.703455+0000","last_became_peered":"2024-04-26T12:08:39.703455+0000","last_unstale":"2024-04-26T12:08:49.739348+0000","last_undegraded":"2024-04-26T12:08:49.739348+0000","last_fullsized":"2024-04-26T12:08:49.739348+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:08.399237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'408","reported_seq":488,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737796+0000","last_change":"2024-04-26T12:08:40.710236+0000","last_active":"2024-04-26T12:08:49.737796+0000","last_peered":"2024-04-26T12:08:49.737796+0000","last_clean":"2024-04-26T12:08:49.737796+0000","last_became_active":"2024-04-26T12:08:40.707357+0000","last_became_peered":"2024-04-26T12:08:40.707357+0000","last_unstale":"2024-04-26T12:08:49.737796+0000","last_undegraded":"2024-04-26T12:08:49.737796+0000","last_fullsized":"2024-04-26T12:08:49.737796+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:17.928748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12418,"num_write":371,"num_write_kb":58378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"59'302","reported_seq":367,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738279+0000","last_change":"2024-04-26T12:08:39.703949+0000","last_active":"2024-04-26T12:08:49.738279+0000","last_peered":"2024-04-26T12:08:49.738279+0000","last_clean":"2024-04-26T12:08:49.738279+0000","last_became_active":"2024-04-26T12:08:39.703421+0000","last_became_peered":"2024-04-26T12:08:39.703421+0000","last_unstale":"2024-04-26T12:08:49.738279+0000","last_undegraded":"2024-04-26T12:08:49.738279+0000","last_fullsized":"2024-04-26T12:08:49.738279+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:10.222074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":4228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'439","reported_seq":495,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737587+0000","last_change":"2024-04-26T12:08:41.717923+0000","last_active":"2024-04-26T12:08:49.737587+0000","last_peered":"2024-04-26T12:08:49.737587+0000","last_clean":"2024-04-26T12:08:49.737587+0000","last_became_active":"2024-04-26T12:08:41.715708+0000","last_became_peered":"2024-04-26T12:08:41.715708+0000","last_unstale":"2024-04-26T12:08:49.737587+0000","last_undegraded":"2024-04-26T12:08:49.737587+0000","last_fullsized":"2024-04-26T12:08:49.737587+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:23.646558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":30851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"59'589","reported_seq":689,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.740000+0000","last_change":"2024-04-26T12:08:39.703966+0000","last_active":"2024-04-26T12:08:49.740000+0000","last_peered":"2024-04-26T12:08:49.740000+0000","last_clean":"2024-04-26T12:08:49.740000+0000","last_became_active":"2024-04-26T12:08:39.703487+0000","last_became_peered":"2024-04-26T12:08:39.703487+0000","last_unstale":"2024-04-26T12:08:49.740000+0000","last_undegraded":"2024-04-26T12:08:49.740000+0000","last_fullsized":"2024-04-26T12:08:49.740000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:06.112476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":534,"num_write_kb":4333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'461","reported_seq":611,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738575+0000","last_change":"2024-04-26T12:05:03.791809+0000","last_active":"2024-04-26T12:08:49.738575+0000","last_peered":"2024-04-26T12:08:49.738575+0000","last_clean":"2024-04-26T12:08:49.738575+0000","last_became_active":"2024-04-26T12:05:03.791272+0000","last_became_peered":"2024-04-26T12:05:03.791272+0000","last_unstale":"2024-04-26T12:08:49.738575+0000","last_undegraded":"2024-04-26T12:08:49.738575+0000","last_fullsized":"2024-04-26T12:08:49.738575+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":46123,"num_write":422,"num_write_kb":104552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'66","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.739078+0000","last_change":"2024-04-26T12:05:03.430224+0000","last_active":"2024-04-26T12:08:49.739078+0000","last_peered":"2024-04-26T12:08:49.739078+0000","last_clean":"2024-04-26T12:08:49.739078+0000","last_became_active":"2024-04-26T12:05:03.429291+0000","last_became_peered":"2024-04-26T12:05:03.429291+0000","last_unstale":"2024-04-26T12:08:49.739078+0000","last_undegraded":"2024-04-26T12:08:49.739078+0000","last_fullsized":"2024-04-26T12:08:49.739078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'428","reported_seq":538,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738096+0000","last_change":"2024-04-26T12:05:03.788174+0000","last_active":"2024-04-26T12:08:49.738096+0000","last_peered":"2024-04-26T12:08:49.738096+0000","last_clean":"2024-04-26T12:08:49.738096+0000","last_became_active":"2024-04-26T12:05:03.787772+0000","last_became_peered":"2024-04-26T12:05:03.787772+0000","last_unstale":"2024-04-26T12:08:49.738096+0000","last_undegraded":"2024-04-26T12:08:49.738096+0000","last_fullsized":"2024-04-26T12:08:49.738096+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15098,"num_write":394,"num_write_kb":42677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"59'195","reported_seq":270,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738225+0000","last_change":"2024-04-26T12:05:03.431162+0000","last_active":"2024-04-26T12:08:49.738225+0000","last_peered":"2024-04-26T12:08:49.738225+0000","last_clean":"2024-04-26T12:08:49.738225+0000","last_became_active":"2024-04-26T12:05:03.430855+0000","last_became_peered":"2024-04-26T12:05:03.430855+0000","last_unstale":"2024-04-26T12:08:49.738225+0000","last_undegraded":"2024-04-26T12:08:49.738225+0000","last_fullsized":"2024-04-26T12:08:49.738225+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:41.279426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"60'448","reported_seq":541,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738848+0000","last_change":"2024-04-26T12:05:03.792357+0000","last_active":"2024-04-26T12:08:49.738848+0000","last_peered":"2024-04-26T12:08:49.738848+0000","last_clean":"2024-04-26T12:08:49.738848+0000","last_became_active":"2024-04-26T12:05:03.792119+0000","last_became_peered":"2024-04-26T12:05:03.792119+0000","last_unstale":"2024-04-26T12:08:49.738848+0000","last_undegraded":"2024-04-26T12:08:49.738848+0000","last_fullsized":"2024-04-26T12:08:49.738848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":13281,"num_write":420,"num_write_kb":59540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"59'171","reported_seq":246,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738679+0000","last_change":"2024-04-26T12:05:03.429811+0000","last_active":"2024-04-26T12:08:49.738679+0000","last_peered":"2024-04-26T12:08:49.738679+0000","last_clean":"2024-04-26T12:08:49.738679+0000","last_became_active":"2024-04-26T12:05:03.429469+0000","last_became_peered":"2024-04-26T12:05:03.429469+0000","last_unstale":"2024-04-26T12:08:49.738679+0000","last_undegraded":"2024-04-26T12:08:49.738679+0000","last_fullsized":"2024-04-26T12:08:49.738679+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'412","reported_seq":913,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T12:08:50.747426+0000","last_change":"2024-04-26T12:08:50.747568+0000","last_active":"2024-04-26T12:08:50.747426+0000","last_peered":"2024-04-26T12:08:50.088420+0000","last_clean":"2024-04-26T12:06:10.951300+0000","last_became_active":"2024-04-26T12:08:37.788823+0000","last_became_peered":"2024-04-26T12:08:37.788823+0000","last_unstale":"2024-04-26T12:08:50.747426+0000","last_undegraded":"2024-04-26T12:08:50.747426+0000","last_fullsized":"2024-04-26T12:08:50.747426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:19.948638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26310,"num_write":380,"num_write_kb":38462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"59'55","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737572+0000","last_change":"2024-04-26T12:08:36.695355+0000","last_active":"2024-04-26T12:08:49.737572+0000","last_peered":"2024-04-26T12:08:49.737572+0000","last_clean":"2024-04-26T12:08:49.737572+0000","last_became_active":"2024-04-26T12:08:36.694346+0000","last_became_peered":"2024-04-26T12:08:36.694346+0000","last_unstale":"2024-04-26T12:08:49.737572+0000","last_undegraded":"2024-04-26T12:08:49.737572+0000","last_fullsized":"2024-04-26T12:08:49.737572+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:42.458073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"60'362","reported_seq":814,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.739189+0000","last_change":"2024-04-26T12:08:41.717048+0000","last_active":"2024-04-26T12:08:49.739189+0000","last_peered":"2024-04-26T12:08:49.739189+0000","last_clean":"2024-04-26T12:08:49.739189+0000","last_became_active":"2024-04-26T12:08:41.716102+0000","last_became_peered":"2024-04-26T12:08:41.716102+0000","last_unstale":"2024-04-26T12:08:49.739189+0000","last_undegraded":"2024-04-26T12:08:49.739189+0000","last_fullsized":"2024-04-26T12:08:49.739189+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:52.409548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21408,"num_write":333,"num_write_kb":66549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"59'378","reported_seq":436,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737689+0000","last_change":"2024-04-26T12:08:39.702797+0000","last_active":"2024-04-26T12:08:49.737689+0000","last_peered":"2024-04-26T12:08:49.737689+0000","last_clean":"2024-04-26T12:08:49.737689+0000","last_became_active":"2024-04-26T12:08:39.702438+0000","last_became_peered":"2024-04-26T12:08:39.702438+0000","last_unstale":"2024-04-26T12:08:49.737689+0000","last_undegraded":"2024-04-26T12:08:49.737689+0000","last_fullsized":"2024-04-26T12:08:49.737689+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:06.278304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"60'407","reported_seq":914,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738485+0000","last_change":"2024-04-26T12:08:45.724853+0000","last_active":"2024-04-26T12:08:49.738485+0000","last_peered":"2024-04-26T12:08:49.738485+0000","last_clean":"2024-04-26T12:08:49.738485+0000","last_became_active":"2024-04-26T12:08:45.723772+0000","last_became_peered":"2024-04-26T12:08:45.723772+0000","last_unstale":"2024-04-26T12:08:49.738485+0000","last_undegraded":"2024-04-26T12:08:49.738485+0000","last_fullsized":"2024-04-26T12:08:49.738485+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:41.814840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":40156,"num_write":373,"num_write_kb":91285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":290,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738618+0000","last_change":"2024-04-26T12:08:36.697892+0000","last_active":"2024-04-26T12:08:49.738618+0000","last_peered":"2024-04-26T12:08:49.738618+0000","last_clean":"2024-04-26T12:08:49.738618+0000","last_became_active":"2024-04-26T12:08:36.697508+0000","last_became_peered":"2024-04-26T12:08:36.697508+0000","last_unstale":"2024-04-26T12:08:49.738618+0000","last_undegraded":"2024-04-26T12:08:49.738618+0000","last_fullsized":"2024-04-26T12:08:49.738618+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_clean_scrub_stamp":"2024-04-26T12:04:52.376986+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:24.384180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738932+0000","last_change":"2024-04-26T12:04:59.403711+0000","last_active":"2024-04-26T12:08:49.738932+0000","last_peered":"2024-04-26T12:08:49.738932+0000","last_clean":"2024-04-26T12:08:49.738932+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:08:49.738932+0000","last_undegraded":"2024-04-26T12:08:49.738932+0000","last_fullsized":"2024-04-26T12:08:49.738932+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:45.779614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'793","reported_seq":894,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738468+0000","last_change":"2024-04-26T12:08:39.702225+0000","last_active":"2024-04-26T12:08:49.738468+0000","last_peered":"2024-04-26T12:08:49.738468+0000","last_clean":"2024-04-26T12:08:49.738468+0000","last_became_active":"2024-04-26T12:08:39.701760+0000","last_became_peered":"2024-04-26T12:08:39.701760+0000","last_unstale":"2024-04-26T12:08:49.738468+0000","last_undegraded":"2024-04-26T12:08:49.738468+0000","last_fullsized":"2024-04-26T12:08:49.738468+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:51.405891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":8533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"60'466","reported_seq":1001,"reported_epoch":81,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:08:51.035028+0000","last_change":"2024-04-26T12:08:51.035197+0000","last_active":"2024-04-26T12:08:51.035028+0000","last_peered":"2024-04-26T12:08:51.035028+0000","last_clean":"2024-04-26T12:06:10.951310+0000","last_became_active":"2024-04-26T12:08:37.789711+0000","last_became_peered":"2024-04-26T12:08:37.789711+0000","last_unstale":"2024-04-26T12:08:51.035028+0000","last_undegraded":"2024-04-26T12:08:51.035028+0000","last_fullsized":"2024-04-26T12:08:37.701265+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:51.630703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":37547,"num_write":422,"num_write_kb":96579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738535+0000","last_change":"2024-04-26T12:08:36.695759+0000","last_active":"2024-04-26T12:08:49.738535+0000","last_peered":"2024-04-26T12:08:49.738535+0000","last_clean":"2024-04-26T12:08:49.738535+0000","last_became_active":"2024-04-26T12:08:36.695444+0000","last_became_peered":"2024-04-26T12:08:36.695444+0000","last_unstale":"2024-04-26T12:08:49.738535+0000","last_undegraded":"2024-04-26T12:08:49.738535+0000","last_fullsized":"2024-04-26T12:08:49.738535+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:22.343369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"60'114","reported_seq":236,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737980+0000","last_change":"2024-04-26T12:05:03.428547+0000","last_active":"2024-04-26T12:08:49.737980+0000","last_peered":"2024-04-26T12:08:49.737980+0000","last_clean":"2024-04-26T12:08:49.737980+0000","last_became_active":"2024-04-26T12:05:03.427985+0000","last_became_peered":"2024-04-26T12:05:03.427985+0000","last_unstale":"2024-04-26T12:08:49.737980+0000","last_undegraded":"2024-04-26T12:08:49.737980+0000","last_fullsized":"2024-04-26T12:08:49.737980+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:19.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466015,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":47,"num_write_kb":1464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"60'492","reported_seq":652,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.742013+0000","last_change":"2024-04-26T12:08:49.741650+0000","last_active":"2024-04-26T12:08:49.742013+0000","last_peered":"2024-04-26T12:08:49.742013+0000","last_clean":"2024-04-26T12:08:49.742013+0000","last_became_active":"2024-04-26T12:08:49.739496+0000","last_became_peered":"2024-04-26T12:08:49.739496+0000","last_unstale":"2024-04-26T12:08:49.742013+0000","last_undegraded":"2024-04-26T12:08:49.742013+0000","last_fullsized":"2024-04-26T12:08:49.742013+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:55.361224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":63988,"num_write":466,"num_write_kb":154489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738153+0000","last_change":"2024-04-26T12:08:36.696858+0000","last_active":"2024-04-26T12:08:49.738153+0000","last_peered":"2024-04-26T12:08:49.738153+0000","last_clean":"2024-04-26T12:08:49.738153+0000","last_became_active":"2024-04-26T12:08:36.696619+0000","last_became_peered":"2024-04-26T12:08:36.696619+0000","last_unstale":"2024-04-26T12:08:49.738153+0000","last_undegraded":"2024-04-26T12:08:49.738153+0000","last_fullsized":"2024-04-26T12:08:49.738153+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:47.292926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"59'325","reported_seq":383,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737505+0000","last_change":"2024-04-26T12:08:39.704052+0000","last_active":"2024-04-26T12:08:49.737505+0000","last_peered":"2024-04-26T12:08:49.737505+0000","last_clean":"2024-04-26T12:08:49.737505+0000","last_became_active":"2024-04-26T12:08:39.703696+0000","last_became_peered":"2024-04-26T12:08:39.703696+0000","last_unstale":"2024-04-26T12:08:49.737505+0000","last_undegraded":"2024-04-26T12:08:49.737505+0000","last_fullsized":"2024-04-26T12:08:49.737505+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:21:44.069244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":8296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"60'359","reported_seq":782,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738580+0000","last_change":"2024-04-26T12:08:47.737443+0000","last_active":"2024-04-26T12:08:49.738580+0000","last_peered":"2024-04-26T12:08:49.738580+0000","last_clean":"2024-04-26T12:08:49.738580+0000","last_became_active":"2024-04-26T12:08:47.735729+0000","last_became_peered":"2024-04-26T12:08:47.735729+0000","last_unstale":"2024-04-26T12:08:49.738580+0000","last_undegraded":"2024-04-26T12:08:49.738580+0000","last_fullsized":"2024-04-26T12:08:49.738580+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:57:20.726677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9448,"num_write":336,"num_write_kb":74900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738785+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:08:49.738785+0000","last_peered":"2024-04-26T12:08:49.738785+0000","last_clean":"2024-04-26T12:08:49.738785+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:08:49.738785+0000","last_undegraded":"2024-04-26T12:08:49.738785+0000","last_fullsized":"2024-04-26T12:08:49.738785+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:12.939539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"59'67","reported_seq":142,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738883+0000","last_change":"2024-04-26T12:05:03.430140+0000","last_active":"2024-04-26T12:08:49.738883+0000","last_peered":"2024-04-26T12:08:49.738883+0000","last_clean":"2024-04-26T12:08:49.738883+0000","last_became_active":"2024-04-26T12:05:03.429838+0000","last_became_peered":"2024-04-26T12:05:03.429838+0000","last_unstale":"2024-04-26T12:08:49.738883+0000","last_undegraded":"2024-04-26T12:08:49.738883+0000","last_fullsized":"2024-04-26T12:08:49.738883+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"60'403","reported_seq":891,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T12:08:50.753437+0000","last_change":"2024-04-26T12:08:50.753437+0000","last_active":"2024-04-26T12:08:50.753437+0000","last_peered":"2024-04-26T12:08:50.753437+0000","last_clean":"2024-04-26T12:08:50.753437+0000","last_became_active":"2024-04-26T12:08:50.752366+0000","last_became_peered":"2024-04-26T12:08:50.752366+0000","last_unstale":"2024-04-26T12:08:50.753437+0000","last_undegraded":"2024-04-26T12:08:50.753437+0000","last_fullsized":"2024-04-26T12:08:50.753437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:02.999757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30094,"num_write":370,"num_write_kb":104181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"59'469","reported_seq":544,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.740057+0000","last_change":"2024-04-26T12:05:03.429673+0000","last_active":"2024-04-26T12:08:49.740057+0000","last_peered":"2024-04-26T12:08:49.740057+0000","last_clean":"2024-04-26T12:08:49.740057+0000","last_became_active":"2024-04-26T12:05:03.429146+0000","last_became_peered":"2024-04-26T12:05:03.429146+0000","last_unstale":"2024-04-26T12:08:49.740057+0000","last_undegraded":"2024-04-26T12:08:49.740057+0000","last_fullsized":"2024-04-26T12:08:49.740057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738857+0000","last_change":"2024-04-26T12:08:36.697900+0000","last_active":"2024-04-26T12:08:49.738857+0000","last_peered":"2024-04-26T12:08:49.738857+0000","last_clean":"2024-04-26T12:08:49.738857+0000","last_became_active":"2024-04-26T12:08:36.697618+0000","last_became_peered":"2024-04-26T12:08:36.697618+0000","last_unstale":"2024-04-26T12:08:49.738857+0000","last_undegraded":"2024-04-26T12:08:49.738857+0000","last_fullsized":"2024-04-26T12:08:49.738857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:16.620901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'354","reported_seq":410,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737930+0000","last_change":"2024-04-26T12:08:45.725751+0000","last_active":"2024-04-26T12:08:49.737930+0000","last_peered":"2024-04-26T12:08:49.737930+0000","last_clean":"2024-04-26T12:08:49.737930+0000","last_became_active":"2024-04-26T12:08:45.724153+0000","last_became_peered":"2024-04-26T12:08:45.724153+0000","last_unstale":"2024-04-26T12:08:49.737930+0000","last_undegraded":"2024-04-26T12:08:49.737930+0000","last_fullsized":"2024-04-26T12:08:49.737930+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:57.798803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":416,"num_write":319,"num_write_kb":17259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"59'53","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738780+0000","last_change":"2024-04-26T12:08:36.698122+0000","last_active":"2024-04-26T12:08:49.738780+0000","last_peered":"2024-04-26T12:08:49.738780+0000","last_clean":"2024-04-26T12:08:49.738780+0000","last_became_active":"2024-04-26T12:08:36.697832+0000","last_became_peered":"2024-04-26T12:08:36.697832+0000","last_unstale":"2024-04-26T12:08:49.738780+0000","last_undegraded":"2024-04-26T12:08:49.738780+0000","last_fullsized":"2024-04-26T12:08:49.738780+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:34.416168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738554+0000","last_change":"2024-04-26T12:08:36.698131+0000","last_active":"2024-04-26T12:08:49.738554+0000","last_peered":"2024-04-26T12:08:49.738554+0000","last_clean":"2024-04-26T12:08:49.738554+0000","last_became_active":"2024-04-26T12:08:36.697698+0000","last_became_peered":"2024-04-26T12:08:36.697698+0000","last_unstale":"2024-04-26T12:08:49.738554+0000","last_undegraded":"2024-04-26T12:08:49.738554+0000","last_fullsized":"2024-04-26T12:08:49.738554+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:15.476036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'399","reported_seq":474,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737756+0000","last_change":"2024-04-26T12:08:40.705752+0000","last_active":"2024-04-26T12:08:49.737756+0000","last_peered":"2024-04-26T12:08:49.737756+0000","last_clean":"2024-04-26T12:08:49.737756+0000","last_became_active":"2024-04-26T12:08:40.703906+0000","last_became_peered":"2024-04-26T12:08:40.703906+0000","last_unstale":"2024-04-26T12:08:49.737756+0000","last_undegraded":"2024-04-26T12:08:49.737756+0000","last_fullsized":"2024-04-26T12:08:49.737756+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:19.004074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11720,"num_write":363,"num_write_kb":66914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"59'65","reported_seq":154,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738897+0000","last_change":"2024-04-26T12:08:36.699388+0000","last_active":"2024-04-26T12:08:49.738897+0000","last_peered":"2024-04-26T12:08:49.738897+0000","last_clean":"2024-04-26T12:08:49.738897+0000","last_became_active":"2024-04-26T12:08:36.699058+0000","last_became_peered":"2024-04-26T12:08:36.699058+0000","last_unstale":"2024-04-26T12:08:49.738897+0000","last_undegraded":"2024-04-26T12:08:49.738897+0000","last_fullsized":"2024-04-26T12:08:49.738897+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:11.978288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738806+0000","last_change":"2024-04-26T12:08:36.697618+0000","last_active":"2024-04-26T12:08:49.738806+0000","last_peered":"2024-04-26T12:08:49.738806+0000","last_clean":"2024-04-26T12:08:49.738806+0000","last_became_active":"2024-04-26T12:08:36.697407+0000","last_became_peered":"2024-04-26T12:08:36.697407+0000","last_unstale":"2024-04-26T12:08:49.738806+0000","last_undegraded":"2024-04-26T12:08:49.738806+0000","last_fullsized":"2024-04-26T12:08:49.738806+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:02.301767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'424","reported_seq":538,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737865+0000","last_change":"2024-04-26T12:05:03.789623+0000","last_active":"2024-04-26T12:08:49.737865+0000","last_peered":"2024-04-26T12:08:49.737865+0000","last_clean":"2024-04-26T12:08:49.737865+0000","last_became_active":"2024-04-26T12:05:03.789390+0000","last_became_peered":"2024-04-26T12:05:03.789390+0000","last_unstale":"2024-04-26T12:08:49.737865+0000","last_undegraded":"2024-04-26T12:08:49.737865+0000","last_fullsized":"2024-04-26T12:08:49.737865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17027,"num_write":386,"num_write_kb":58797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"61'70","reported_seq":145,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738751+0000","last_change":"2024-04-26T12:05:03.429222+0000","last_active":"2024-04-26T12:08:49.738751+0000","last_peered":"2024-04-26T12:08:49.738751+0000","last_clean":"2024-04-26T12:08:49.738751+0000","last_became_active":"2024-04-26T12:05:03.428803+0000","last_became_peered":"2024-04-26T12:05:03.428803+0000","last_unstale":"2024-04-26T12:08:49.738751+0000","last_undegraded":"2024-04-26T12:08:49.738751+0000","last_fullsized":"2024-04-26T12:08:49.738751+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:31.305644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.739383+0000","last_change":"2024-04-26T12:08:36.698775+0000","last_active":"2024-04-26T12:08:49.739383+0000","last_peered":"2024-04-26T12:08:49.739383+0000","last_clean":"2024-04-26T12:08:49.739383+0000","last_became_active":"2024-04-26T12:08:36.698523+0000","last_became_peered":"2024-04-26T12:08:36.698523+0000","last_unstale":"2024-04-26T12:08:49.739383+0000","last_undegraded":"2024-04-26T12:08:49.739383+0000","last_fullsized":"2024-04-26T12:08:49.739383+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:16.620901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'393","reported_seq":469,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737827+0000","last_change":"2024-04-26T12:08:40.705662+0000","last_active":"2024-04-26T12:08:49.737827+0000","last_peered":"2024-04-26T12:08:49.737827+0000","last_clean":"2024-04-26T12:08:49.737827+0000","last_became_active":"2024-04-26T12:08:40.703873+0000","last_became_peered":"2024-04-26T12:08:40.703873+0000","last_unstale":"2024-04-26T12:08:49.737827+0000","last_undegraded":"2024-04-26T12:08:49.737827+0000","last_fullsized":"2024-04-26T12:08:49.737827+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:27.057123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":11991,"num_write":357,"num_write_kb":83226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'419","reported_seq":889,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738683+0000","last_change":"2024-04-26T12:08:44.723692+0000","last_active":"2024-04-26T12:08:49.738683+0000","last_peered":"2024-04-26T12:08:49.738683+0000","last_clean":"2024-04-26T12:08:49.738683+0000","last_became_active":"2024-04-26T12:08:44.722574+0000","last_became_peered":"2024-04-26T12:08:44.722574+0000","last_unstale":"2024-04-26T12:08:49.738683+0000","last_undegraded":"2024-04-26T12:08:49.738683+0000","last_fullsized":"2024-04-26T12:08:49.738683+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:01.256055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14983,"num_write":376,"num_write_kb":76749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"61'398","reported_seq":504,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738958+0000","last_change":"2024-04-26T12:08:39.703851+0000","last_active":"2024-04-26T12:08:49.738958+0000","last_peered":"2024-04-26T12:08:49.738958+0000","last_clean":"2024-04-26T12:08:49.738958+0000","last_became_active":"2024-04-26T12:08:39.703516+0000","last_became_peered":"2024-04-26T12:08:39.703516+0000","last_unstale":"2024-04-26T12:08:49.738958+0000","last_undegraded":"2024-04-26T12:08:49.738958+0000","last_fullsized":"2024-04-26T12:08:49.738958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:10.227718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699266,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":9692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9692849,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'428","reported_seq":937,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T12:08:50.753473+0000","last_change":"2024-04-26T12:08:50.753473+0000","last_active":"2024-04-26T12:08:50.753473+0000","last_peered":"2024-04-26T12:08:50.753473+0000","last_clean":"2024-04-26T12:08:50.753473+0000","last_became_active":"2024-04-26T12:08:50.752328+0000","last_became_peered":"2024-04-26T12:08:50.752328+0000","last_unstale":"2024-04-26T12:08:50.753473+0000","last_undegraded":"2024-04-26T12:08:50.753473+0000","last_fullsized":"2024-04-26T12:08:50.753473+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:08.396108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":26594,"num_write":396,"num_write_kb":67932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"60'91","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738182+0000","last_change":"2024-04-26T12:08:36.722607+0000","last_active":"2024-04-26T12:08:49.738182+0000","last_peered":"2024-04-26T12:08:49.738182+0000","last_clean":"2024-04-26T12:08:49.738182+0000","last_became_active":"2024-04-26T12:08:36.697650+0000","last_became_peered":"2024-04-26T12:08:36.697650+0000","last_unstale":"2024-04-26T12:08:49.738182+0000","last_undegraded":"2024-04-26T12:08:49.738182+0000","last_fullsized":"2024-04-26T12:08:49.738182+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:10.718101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"59'316","reported_seq":391,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.739311+0000","last_change":"2024-04-26T12:05:03.429257+0000","last_active":"2024-04-26T12:08:49.739311+0000","last_peered":"2024-04-26T12:08:49.739311+0000","last_clean":"2024-04-26T12:08:49.739311+0000","last_became_active":"2024-04-26T12:05:03.428921+0000","last_became_peered":"2024-04-26T12:05:03.428921+0000","last_unstale":"2024-04-26T12:08:49.739311+0000","last_undegraded":"2024-04-26T12:08:49.739311+0000","last_fullsized":"2024-04-26T12:08:49.739311+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:49.774845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'495","reported_seq":622,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737872+0000","last_change":"2024-04-26T12:05:03.788141+0000","last_active":"2024-04-26T12:08:49.737872+0000","last_peered":"2024-04-26T12:08:49.737872+0000","last_clean":"2024-04-26T12:08:49.737872+0000","last_became_active":"2024-04-26T12:05:03.787533+0000","last_became_peered":"2024-04-26T12:05:03.787533+0000","last_unstale":"2024-04-26T12:08:49.737872+0000","last_undegraded":"2024-04-26T12:08:49.737872+0000","last_fullsized":"2024-04-26T12:08:49.737872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37174,"num_write":458,"num_write_kb":125832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'51","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738747+0000","last_change":"2024-04-26T12:05:03.428971+0000","last_active":"2024-04-26T12:08:49.738747+0000","last_peered":"2024-04-26T12:08:49.738747+0000","last_clean":"2024-04-26T12:08:49.738747+0000","last_became_active":"2024-04-26T12:05:03.428445+0000","last_became_peered":"2024-04-26T12:05:03.428445+0000","last_unstale":"2024-04-26T12:08:49.738747+0000","last_undegraded":"2024-04-26T12:08:49.738747+0000","last_fullsized":"2024-04-26T12:08:49.738747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'482","reported_seq":1127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737865+0000","last_change":"2024-04-26T12:08:48.741589+0000","last_active":"2024-04-26T12:08:49.737865+0000","last_peered":"2024-04-26T12:08:49.737865+0000","last_clean":"2024-04-26T12:08:49.737865+0000","last_became_active":"2024-04-26T12:08:48.740055+0000","last_became_peered":"2024-04-26T12:08:48.740055+0000","last_unstale":"2024-04-26T12:08:49.737865+0000","last_undegraded":"2024-04-26T12:08:49.737865+0000","last_fullsized":"2024-04-26T12:08:49.737865+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:03.903516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":61972,"num_write":459,"num_write_kb":125797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"60'392","reported_seq":524,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738473+0000","last_change":"2024-04-26T12:08:43.718939+0000","last_active":"2024-04-26T12:08:49.738473+0000","last_peered":"2024-04-26T12:08:49.738473+0000","last_clean":"2024-04-26T12:08:49.738473+0000","last_became_active":"2024-04-26T12:08:43.717109+0000","last_became_peered":"2024-04-26T12:08:43.717109+0000","last_unstale":"2024-04-26T12:08:49.738473+0000","last_undegraded":"2024-04-26T12:08:49.738473+0000","last_fullsized":"2024-04-26T12:08:49.738473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:14.846653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":37910,"num_write":366,"num_write_kb":84111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"59'709","reported_seq":810,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738005+0000","last_change":"2024-04-26T12:08:39.701978+0000","last_active":"2024-04-26T12:08:49.738005+0000","last_peered":"2024-04-26T12:08:49.738005+0000","last_clean":"2024-04-26T12:08:49.738005+0000","last_became_active":"2024-04-26T12:08:39.700927+0000","last_became_peered":"2024-04-26T12:08:39.700927+0000","last_unstale":"2024-04-26T12:08:49.738005+0000","last_undegraded":"2024-04-26T12:08:49.738005+0000","last_fullsized":"2024-04-26T12:08:49.738005+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:10.815597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"60'435","reported_seq":569,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738412+0000","last_change":"2024-04-26T12:05:03.788754+0000","last_active":"2024-04-26T12:08:49.738412+0000","last_peered":"2024-04-26T12:08:49.738412+0000","last_clean":"2024-04-26T12:08:49.738412+0000","last_became_active":"2024-04-26T12:05:03.788311+0000","last_became_peered":"2024-04-26T12:05:03.788311+0000","last_unstale":"2024-04-26T12:08:49.738412+0000","last_undegraded":"2024-04-26T12:08:49.738412+0000","last_fullsized":"2024-04-26T12:08:49.738412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":28462,"num_write":403,"num_write_kb":93779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"59'262","reported_seq":337,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738118+0000","last_change":"2024-04-26T12:05:03.428810+0000","last_active":"2024-04-26T12:08:49.738118+0000","last_peered":"2024-04-26T12:08:49.738118+0000","last_clean":"2024-04-26T12:08:49.738118+0000","last_became_active":"2024-04-26T12:05:03.428191+0000","last_became_peered":"2024-04-26T12:05:03.428191+0000","last_unstale":"2024-04-26T12:08:49.738118+0000","last_undegraded":"2024-04-26T12:08:49.738118+0000","last_fullsized":"2024-04-26T12:08:49.738118+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"60'399","reported_seq":496,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.742814+0000","last_change":"2024-04-26T12:08:49.742459+0000","last_active":"2024-04-26T12:08:49.742814+0000","last_peered":"2024-04-26T12:08:49.742814+0000","last_clean":"2024-04-26T12:08:49.742814+0000","last_became_active":"2024-04-26T12:08:49.740536+0000","last_became_peered":"2024-04-26T12:08:49.740536+0000","last_unstale":"2024-04-26T12:08:49.742814+0000","last_undegraded":"2024-04-26T12:08:49.742814+0000","last_fullsized":"2024-04-26T12:08:49.742814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:24.169669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22216,"num_write":357,"num_write_kb":75245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"59'430","reported_seq":487,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737732+0000","last_change":"2024-04-26T12:08:39.703050+0000","last_active":"2024-04-26T12:08:49.737732+0000","last_peered":"2024-04-26T12:08:49.737732+0000","last_clean":"2024-04-26T12:08:49.737732+0000","last_became_active":"2024-04-26T12:08:39.702529+0000","last_became_peered":"2024-04-26T12:08:39.702529+0000","last_unstale":"2024-04-26T12:08:49.737732+0000","last_undegraded":"2024-04-26T12:08:49.737732+0000","last_fullsized":"2024-04-26T12:08:49.737732+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:28.249725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":12514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"60'387","reported_seq":473,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738153+0000","last_change":"2024-04-26T12:08:43.720098+0000","last_active":"2024-04-26T12:08:49.738153+0000","last_peered":"2024-04-26T12:08:49.738153+0000","last_clean":"2024-04-26T12:08:49.738153+0000","last_became_active":"2024-04-26T12:08:43.717442+0000","last_became_peered":"2024-04-26T12:08:43.717442+0000","last_unstale":"2024-04-26T12:08:49.738153+0000","last_undegraded":"2024-04-26T12:08:49.738153+0000","last_fullsized":"2024-04-26T12:08:49.738153+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:13.140334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20720,"num_write":352,"num_write_kb":87643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"59'58","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737866+0000","last_change":"2024-04-26T12:08:36.720540+0000","last_active":"2024-04-26T12:08:49.737866+0000","last_peered":"2024-04-26T12:08:49.737866+0000","last_clean":"2024-04-26T12:08:49.737866+0000","last_became_active":"2024-04-26T12:08:36.693399+0000","last_became_peered":"2024-04-26T12:08:36.693399+0000","last_unstale":"2024-04-26T12:08:49.737866+0000","last_undegraded":"2024-04-26T12:08:49.737866+0000","last_fullsized":"2024-04-26T12:08:49.737866+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:14.949002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"60'356","reported_seq":449,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738659+0000","last_change":"2024-04-26T12:05:03.791986+0000","last_active":"2024-04-26T12:08:49.738659+0000","last_peered":"2024-04-26T12:08:49.738659+0000","last_clean":"2024-04-26T12:08:49.738659+0000","last_became_active":"2024-04-26T12:05:03.790823+0000","last_became_peered":"2024-04-26T12:05:03.790823+0000","last_unstale":"2024-04-26T12:08:49.738659+0000","last_undegraded":"2024-04-26T12:08:49.738659+0000","last_fullsized":"2024-04-26T12:08:49.738659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9641,"num_write":326,"num_write_kb":29574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"59'309","reported_seq":384,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738960+0000","last_change":"2024-04-26T12:05:03.429469+0000","last_active":"2024-04-26T12:08:49.738960+0000","last_peered":"2024-04-26T12:08:49.738960+0000","last_clean":"2024-04-26T12:08:49.738960+0000","last_became_active":"2024-04-26T12:05:03.429015+0000","last_became_peered":"2024-04-26T12:05:03.429015+0000","last_unstale":"2024-04-26T12:08:49.738960+0000","last_undegraded":"2024-04-26T12:08:49.738960+0000","last_fullsized":"2024-04-26T12:08:49.738960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'433","reported_seq":572,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738662+0000","last_change":"2024-04-26T12:05:03.791929+0000","last_active":"2024-04-26T12:08:49.738662+0000","last_peered":"2024-04-26T12:08:49.738662+0000","last_clean":"2024-04-26T12:08:49.738662+0000","last_became_active":"2024-04-26T12:05:03.791540+0000","last_became_peered":"2024-04-26T12:05:03.791540+0000","last_unstale":"2024-04-26T12:08:49.738662+0000","last_undegraded":"2024-04-26T12:08:49.738662+0000","last_fullsized":"2024-04-26T12:08:49.738662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":47864,"num_write":399,"num_write_kb":92193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"59'382","reported_seq":446,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737989+0000","last_change":"2024-04-26T12:08:39.704680+0000","last_active":"2024-04-26T12:08:49.737989+0000","last_peered":"2024-04-26T12:08:49.737989+0000","last_clean":"2024-04-26T12:08:49.737989+0000","last_became_active":"2024-04-26T12:08:39.704404+0000","last_became_peered":"2024-04-26T12:08:39.704404+0000","last_unstale":"2024-04-26T12:08:49.737989+0000","last_undegraded":"2024-04-26T12:08:49.737989+0000","last_fullsized":"2024-04-26T12:08:49.737989+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:01.830043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":12467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'425","reported_seq":541,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737737+0000","last_change":"2024-04-26T12:08:47.737376+0000","last_active":"2024-04-26T12:08:49.737737+0000","last_peered":"2024-04-26T12:08:49.737737+0000","last_clean":"2024-04-26T12:08:49.737737+0000","last_became_active":"2024-04-26T12:08:47.735367+0000","last_became_peered":"2024-04-26T12:08:47.735367+0000","last_unstale":"2024-04-26T12:08:49.737737+0000","last_undegraded":"2024-04-26T12:08:49.737737+0000","last_fullsized":"2024-04-26T12:08:49.737737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:35.420647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":38065,"num_write":387,"num_write_kb":71445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"59'126","reported_seq":226,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738588+0000","last_change":"2024-04-26T12:08:39.702212+0000","last_active":"2024-04-26T12:08:49.738588+0000","last_peered":"2024-04-26T12:08:49.738588+0000","last_clean":"2024-04-26T12:08:49.738588+0000","last_became_active":"2024-04-26T12:08:39.701900+0000","last_became_peered":"2024-04-26T12:08:39.701900+0000","last_unstale":"2024-04-26T12:08:49.738588+0000","last_undegraded":"2024-04-26T12:08:49.738588+0000","last_fullsized":"2024-04-26T12:08:49.738588+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:28.460358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"60'448","reported_seq":545,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738608+0000","last_change":"2024-04-26T12:05:03.791827+0000","last_active":"2024-04-26T12:08:49.738608+0000","last_peered":"2024-04-26T12:08:49.738608+0000","last_clean":"2024-04-26T12:08:49.738608+0000","last_became_active":"2024-04-26T12:05:03.791442+0000","last_became_peered":"2024-04-26T12:05:03.791442+0000","last_unstale":"2024-04-26T12:08:49.738608+0000","last_undegraded":"2024-04-26T12:08:49.738608+0000","last_fullsized":"2024-04-26T12:08:49.738608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11191,"num_write":416,"num_write_kb":67272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"59'56","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738644+0000","last_change":"2024-04-26T12:05:03.430659+0000","last_active":"2024-04-26T12:08:49.738644+0000","last_peered":"2024-04-26T12:08:49.738644+0000","last_clean":"2024-04-26T12:08:49.738644+0000","last_became_active":"2024-04-26T12:05:03.430164+0000","last_became_peered":"2024-04-26T12:05:03.430164+0000","last_unstale":"2024-04-26T12:08:49.738644+0000","last_undegraded":"2024-04-26T12:08:49.738644+0000","last_fullsized":"2024-04-26T12:08:49.738644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2734,"num_read_kb":1486856,"num_write":24627,"num_write_kb":4487808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6935,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26722,"ondisk_log_size":26722,"up":128,"acting":124,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128606591,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":5972,"num_write_kb":129691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64376832,"data_stored":257213182,"data_compressed":19249503,"data_compressed_allocated":31694848,"data_compressed_original":224591872,"omap_allocated":4411,"internal_metadata":0},"log_size":7828,"ondisk_log_size":7828,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738421,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134400,"kb_used_data":27060,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94237440,"statfs":{"total":96636764160,"available":96499138560,"internally_reserved":0,"allocated":27709440,"data_stored":91780350,"data_compressed":6340284,"data_compressed_allocated":11272192,"data_compressed_original":75763712,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:08:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.40899999999999997,"15min":0.439},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.254},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.39900000000000002,"15min":0.42599999999999999},"min":{"1min":0.19,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.51700000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.26900000000000002}]},{"osd":1,"last update":"Fri Apr 26 12:05:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.32500000000000001}]}]},{"osd":1,"up_from":66,"seq":283467841541,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64396,"kb_used_data":10620,"kb_used_omap":5,"kb_used_meta":53754,"kb_avail":94307444,"statfs":{"total":96636764160,"available":96570822656,"internally_reserved":0,"allocated":10874880,"data_stored":86123805,"data_compressed":7182940,"data_compressed_allocated":10076160,"data_compressed_original":85745664,"omap_allocated":6005,"internal_metadata":55044235},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738421,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138864,"kb_used_data":27420,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232976,"statfs":{"total":96636764160,"available":96494567424,"internally_reserved":0,"allocated":28078080,"data_stored":81490534,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:05:55 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.254},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.23699999999999999}]},{"osd":2,"last update":"Fri Apr 26 12:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42399999999999999,"15min":0.435},"min":{"1min":0.16200000000000001,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.433,"15min":0.433},"min":{"1min":0.20599999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.32900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27357184,"data_stored":81158407,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10088448,"data_stored":85196920,"data_compressed":7176942,"data_compressed_allocated":10039296,"data_compressed_original":85172224,"omap_allocated":4411,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26931200,"data_stored":90857855,"data_compressed":6334286,"data_compressed_allocated":11235328,"data_compressed_original":75190272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:08:53.622 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:08:53.955 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:08:53.956 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:08:53.966 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-04-26T12:08:53.743597+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129196959,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2917,"num_read_kb":1488438,"num_write":30802,"num_write_kb":4620959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6958,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34707,"ondisk_log_size":34707,"up":210,"acting":206,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":337660,"kb_used_data":65100,"kb_used_omap":8,"kb_used_meta":272503,"kb_avail":282777860,"statfs":{"total":289910292480,"available":289564528640,"internally_reserved":0,"allocated":66662400,"data_stored":259394689,"data_compressed":19261499,"data_compressed_allocated":31768576,"data_compressed_original":225738752,"omap_allocated":9193,"internal_metadata":279043095},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1981,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2018,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.007115"},"pg_stats":[{"pgid":"4.3f","version":"60'426","reported_seq":497,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T12:08:50.748180+0000","last_change":"2024-04-26T12:08:50.748180+0000","last_active":"2024-04-26T12:08:36.692153+0000","last_peered":"2024-04-26T12:08:34.684175+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"2024-04-26T12:06:12.960288+0000","last_became_peered":"2024-04-26T12:06:12.960288+0000","last_unstale":"2024-04-26T12:08:50.748180+0000","last_undegraded":"2024-04-26T12:08:50.748180+0000","last_fullsized":"2024-04-26T12:08:50.748180+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:04.823699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9964,"num_write":393,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"60'470","reported_seq":598,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738540+0000","last_change":"2024-04-26T12:08:43.719204+0000","last_active":"2024-04-26T12:08:49.738540+0000","last_peered":"2024-04-26T12:08:49.738540+0000","last_clean":"2024-04-26T12:08:49.738540+0000","last_became_active":"2024-04-26T12:08:43.717325+0000","last_became_peered":"2024-04-26T12:08:43.717325+0000","last_unstale":"2024-04-26T12:08:49.738540+0000","last_undegraded":"2024-04-26T12:08:49.738540+0000","last_fullsized":"2024-04-26T12:08:49.738540+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:57.396493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":34556,"num_write":444,"num_write_kb":129697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"60'370","reported_seq":799,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T12:08:50.753639+0000","last_change":"2024-04-26T12:08:50.753639+0000","last_active":"2024-04-26T12:08:50.753639+0000","last_peered":"2024-04-26T12:08:50.753639+0000","last_clean":"2024-04-26T12:08:50.753639+0000","last_became_active":"2024-04-26T12:08:50.752468+0000","last_became_peered":"2024-04-26T12:08:50.752468+0000","last_unstale":"2024-04-26T12:08:50.753639+0000","last_undegraded":"2024-04-26T12:08:50.753639+0000","last_fullsized":"2024-04-26T12:08:50.753639+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:54.514768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":349,"num_write_kb":51115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"60'377","reported_seq":482,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738688+0000","last_change":"2024-04-26T12:05:03.791234+0000","last_active":"2024-04-26T12:08:49.738688+0000","last_peered":"2024-04-26T12:08:49.738688+0000","last_clean":"2024-04-26T12:08:49.738688+0000","last_became_active":"2024-04-26T12:05:03.790717+0000","last_became_peered":"2024-04-26T12:05:03.790717+0000","last_unstale":"2024-04-26T12:08:49.738688+0000","last_undegraded":"2024-04-26T12:08:49.738688+0000","last_fullsized":"2024-04-26T12:08:49.738688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:52.358881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17376,"num_write":341,"num_write_kb":46680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'445","reported_seq":547,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738148+0000","last_change":"2024-04-26T12:08:39.705318+0000","last_active":"2024-04-26T12:08:49.738148+0000","last_peered":"2024-04-26T12:08:49.738148+0000","last_clean":"2024-04-26T12:08:49.738148+0000","last_became_active":"2024-04-26T12:08:39.702117+0000","last_became_peered":"2024-04-26T12:08:39.702117+0000","last_unstale":"2024-04-26T12:08:49.738148+0000","last_undegraded":"2024-04-26T12:08:49.738148+0000","last_fullsized":"2024-04-26T12:08:49.738148+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:39.986313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24197,"num_write":416,"num_write_kb":80466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"60'375","reported_seq":467,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738477+0000","last_change":"2024-04-26T12:05:03.791560+0000","last_active":"2024-04-26T12:08:49.738477+0000","last_peered":"2024-04-26T12:08:49.738477+0000","last_clean":"2024-04-26T12:08:49.738477+0000","last_became_active":"2024-04-26T12:05:03.790578+0000","last_became_peered":"2024-04-26T12:05:03.790578+0000","last_unstale":"2024-04-26T12:08:49.738477+0000","last_undegraded":"2024-04-26T12:08:49.738477+0000","last_fullsized":"2024-04-26T12:08:49.738477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6518,"num_write":348,"num_write_kb":38078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'428","reported_seq":521,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738770+0000","last_change":"2024-04-26T12:05:03.791215+0000","last_active":"2024-04-26T12:08:49.738770+0000","last_peered":"2024-04-26T12:08:49.738770+0000","last_clean":"2024-04-26T12:08:49.738770+0000","last_became_active":"2024-04-26T12:05:03.790615+0000","last_became_peered":"2024-04-26T12:05:03.790615+0000","last_unstale":"2024-04-26T12:08:49.738770+0000","last_undegraded":"2024-04-26T12:08:49.738770+0000","last_fullsized":"2024-04-26T12:08:49.738770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:55.388027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12560,"num_write":398,"num_write_kb":67332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"60'387","reported_seq":523,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738298+0000","last_change":"2024-04-26T12:05:03.785861+0000","last_active":"2024-04-26T12:08:49.738298+0000","last_peered":"2024-04-26T12:08:49.738298+0000","last_clean":"2024-04-26T12:08:49.738298+0000","last_became_active":"2024-04-26T12:05:03.785382+0000","last_became_peered":"2024-04-26T12:05:03.785382+0000","last_unstale":"2024-04-26T12:08:49.738298+0000","last_undegraded":"2024-04-26T12:08:49.738298+0000","last_fullsized":"2024-04-26T12:08:49.738298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:51.870183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":41160,"num_write":356,"num_write_kb":80219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"60'405","reported_seq":897,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738395+0000","last_change":"2024-04-26T12:08:46.730220+0000","last_active":"2024-04-26T12:08:49.738395+0000","last_peered":"2024-04-26T12:08:49.738395+0000","last_clean":"2024-04-26T12:08:49.738395+0000","last_became_active":"2024-04-26T12:08:46.729039+0000","last_became_peered":"2024-04-26T12:08:46.729039+0000","last_unstale":"2024-04-26T12:08:49.738395+0000","last_undegraded":"2024-04-26T12:08:49.738395+0000","last_fullsized":"2024-04-26T12:08:49.738395+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:00.707126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":11674,"num_write":372,"num_write_kb":34604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"60'425","reported_seq":574,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738357+0000","last_change":"2024-04-26T12:08:41.718786+0000","last_active":"2024-04-26T12:08:49.738357+0000","last_peered":"2024-04-26T12:08:49.738357+0000","last_clean":"2024-04-26T12:08:49.738357+0000","last_became_active":"2024-04-26T12:08:41.716014+0000","last_became_peered":"2024-04-26T12:08:41.716014+0000","last_unstale":"2024-04-26T12:08:49.738357+0000","last_undegraded":"2024-04-26T12:08:49.738357+0000","last_fullsized":"2024-04-26T12:08:49.738357+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:20.096806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":48419,"num_write":390,"num_write_kb":92286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"60'372","reported_seq":486,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.739173+0000","last_change":"2024-04-26T12:05:03.791046+0000","last_active":"2024-04-26T12:08:49.739173+0000","last_peered":"2024-04-26T12:08:49.739173+0000","last_clean":"2024-04-26T12:08:49.739173+0000","last_became_active":"2024-04-26T12:05:03.790662+0000","last_became_peered":"2024-04-26T12:05:03.790662+0000","last_unstale":"2024-04-26T12:08:49.739173+0000","last_undegraded":"2024-04-26T12:08:49.739173+0000","last_fullsized":"2024-04-26T12:08:49.739173+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:35.458663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25905,"num_write":353,"num_write_kb":75437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'351","reported_seq":423,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738232+0000","last_change":"2024-04-26T12:08:41.718349+0000","last_active":"2024-04-26T12:08:49.738232+0000","last_peered":"2024-04-26T12:08:49.738232+0000","last_clean":"2024-04-26T12:08:49.738232+0000","last_became_active":"2024-04-26T12:08:41.715726+0000","last_became_peered":"2024-04-26T12:08:41.715726+0000","last_unstale":"2024-04-26T12:08:49.738232+0000","last_undegraded":"2024-04-26T12:08:49.738232+0000","last_fullsized":"2024-04-26T12:08:49.738232+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:00.589164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8884,"num_write":327,"num_write_kb":58289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"60'405","reported_seq":482,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738094+0000","last_change":"2024-04-26T12:08:39.705153+0000","last_active":"2024-04-26T12:08:49.738094+0000","last_peered":"2024-04-26T12:08:49.738094+0000","last_clean":"2024-04-26T12:08:49.738094+0000","last_became_active":"2024-04-26T12:08:39.702141+0000","last_became_peered":"2024-04-26T12:08:39.702141+0000","last_unstale":"2024-04-26T12:08:49.738094+0000","last_undegraded":"2024-04-26T12:08:49.738094+0000","last_fullsized":"2024-04-26T12:08:49.738094+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:42.807520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6771,"num_write":372,"num_write_kb":54786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"60'431","reported_seq":934,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738502+0000","last_change":"2024-04-26T12:08:48.741419+0000","last_active":"2024-04-26T12:08:49.738502+0000","last_peered":"2024-04-26T12:08:49.738502+0000","last_clean":"2024-04-26T12:08:49.738502+0000","last_became_active":"2024-04-26T12:08:48.740170+0000","last_became_peered":"2024-04-26T12:08:48.740170+0000","last_unstale":"2024-04-26T12:08:49.738502+0000","last_undegraded":"2024-04-26T12:08:49.738502+0000","last_fullsized":"2024-04-26T12:08:49.738502+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:52.026016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26572,"num_write":398,"num_write_kb":83974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'394","reported_seq":893,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738664+0000","last_change":"2024-04-26T12:08:41.717703+0000","last_active":"2024-04-26T12:08:49.738664+0000","last_peered":"2024-04-26T12:08:49.738664+0000","last_clean":"2024-04-26T12:08:49.738664+0000","last_became_active":"2024-04-26T12:08:41.715956+0000","last_became_peered":"2024-04-26T12:08:41.715956+0000","last_unstale":"2024-04-26T12:08:49.738664+0000","last_undegraded":"2024-04-26T12:08:49.738664+0000","last_fullsized":"2024-04-26T12:08:49.738664+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:34.291197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":38136,"num_write":355,"num_write_kb":38484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'432","reported_seq":540,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738308+0000","last_change":"2024-04-26T12:05:03.786360+0000","last_active":"2024-04-26T12:08:49.738308+0000","last_peered":"2024-04-26T12:08:49.738308+0000","last_clean":"2024-04-26T12:08:49.738308+0000","last_became_active":"2024-04-26T12:05:03.785991+0000","last_became_peered":"2024-04-26T12:05:03.785991+0000","last_unstale":"2024-04-26T12:08:49.738308+0000","last_undegraded":"2024-04-26T12:08:49.738308+0000","last_fullsized":"2024-04-26T12:08:49.738308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:17.702068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18244,"num_write":400,"num_write_kb":59033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'381","reported_seq":827,"reported_epoch":81,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:08:51.469778+0000","last_change":"2024-04-26T12:08:51.470014+0000","last_active":"2024-04-26T12:08:51.469778+0000","last_peered":"2024-04-26T12:08:51.469778+0000","last_clean":"2024-04-26T12:06:11.463514+0000","last_became_active":"2024-04-26T12:08:37.784944+0000","last_became_peered":"2024-04-26T12:08:37.784944+0000","last_unstale":"2024-04-26T12:08:51.469778+0000","last_undegraded":"2024-04-26T12:08:51.469778+0000","last_fullsized":"2024-04-26T12:08:37.703236+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:11.231375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":350,"num_write_kb":21212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"60'424","reported_seq":511,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738345+0000","last_change":"2024-04-26T12:08:42.718639+0000","last_active":"2024-04-26T12:08:49.738345+0000","last_peered":"2024-04-26T12:08:49.738345+0000","last_clean":"2024-04-26T12:08:49.738345+0000","last_became_active":"2024-04-26T12:08:42.716846+0000","last_became_peered":"2024-04-26T12:08:42.716846+0000","last_unstale":"2024-04-26T12:08:49.738345+0000","last_undegraded":"2024-04-26T12:08:49.738345+0000","last_fullsized":"2024-04-26T12:08:49.738345+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:00.928679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13930,"num_write":388,"num_write_kb":116055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'426","reported_seq":538,"reported_epoch":80,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:08:49.738461+0000","last_change":"2024-04-26T12:08:37.787898+0000","last_active":"2024-04-26T12:08:49.738461+0000","last_peered":"2024-04-26T12:08:49.738461+0000","last_clean":"2024-04-26T12:06:11.463289+0000","last_became_active":"2024-04-26T12:08:37.786618+0000","last_became_peered":"2024-04-26T12:08:37.786618+0000","last_unstale":"2024-04-26T12:08:49.738461+0000","last_undegraded":"2024-04-26T12:08:37.694919+0000","last_fullsized":"2024-04-26T12:08:37.687574+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:07.116133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26908,"num_write":383,"num_write_kb":71324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"60'425","reported_seq":543,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738830+0000","last_change":"2024-04-26T12:05:03.792219+0000","last_active":"2024-04-26T12:08:49.738830+0000","last_peered":"2024-04-26T12:08:49.738830+0000","last_clean":"2024-04-26T12:08:49.738830+0000","last_became_active":"2024-04-26T12:05:03.791061+0000","last_became_peered":"2024-04-26T12:05:03.791061+0000","last_unstale":"2024-04-26T12:08:49.738830+0000","last_undegraded":"2024-04-26T12:08:49.738830+0000","last_fullsized":"2024-04-26T12:08:49.738830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19715,"num_write":398,"num_write_kb":30150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'450","reported_seq":635,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738773+0000","last_change":"2024-04-26T12:05:03.792073+0000","last_active":"2024-04-26T12:08:49.738773+0000","last_peered":"2024-04-26T12:08:49.738773+0000","last_clean":"2024-04-26T12:08:49.738773+0000","last_became_active":"2024-04-26T12:05:03.791693+0000","last_became_peered":"2024-04-26T12:05:03.791693+0000","last_unstale":"2024-04-26T12:08:49.738773+0000","last_undegraded":"2024-04-26T12:08:49.738773+0000","last_fullsized":"2024-04-26T12:08:49.738773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":65124,"num_write":423,"num_write_kb":142714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'434","reported_seq":535,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738057+0000","last_change":"2024-04-26T12:08:46.730582+0000","last_active":"2024-04-26T12:08:49.738057+0000","last_peered":"2024-04-26T12:08:49.738057+0000","last_clean":"2024-04-26T12:08:49.738057+0000","last_became_active":"2024-04-26T12:08:46.728804+0000","last_became_peered":"2024-04-26T12:08:46.728804+0000","last_unstale":"2024-04-26T12:08:49.738057+0000","last_undegraded":"2024-04-26T12:08:49.738057+0000","last_fullsized":"2024-04-26T12:08:49.738057+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:47.745435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":15350,"num_write":405,"num_write_kb":59295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"60'424","reported_seq":534,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737777+0000","last_change":"2024-04-26T12:05:03.788658+0000","last_active":"2024-04-26T12:08:49.737777+0000","last_peered":"2024-04-26T12:08:49.737777+0000","last_clean":"2024-04-26T12:08:49.737777+0000","last_became_active":"2024-04-26T12:05:03.788050+0000","last_became_peered":"2024-04-26T12:05:03.788050+0000","last_unstale":"2024-04-26T12:08:49.737777+0000","last_undegraded":"2024-04-26T12:08:49.737777+0000","last_fullsized":"2024-04-26T12:08:49.737777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23772,"num_write":390,"num_write_kb":67944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"60'447","reported_seq":523,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737641+0000","last_change":"2024-04-26T12:08:40.707153+0000","last_active":"2024-04-26T12:08:49.737641+0000","last_peered":"2024-04-26T12:08:49.737641+0000","last_clean":"2024-04-26T12:08:49.737641+0000","last_became_active":"2024-04-26T12:08:40.703880+0000","last_became_peered":"2024-04-26T12:08:40.703880+0000","last_unstale":"2024-04-26T12:08:49.737641+0000","last_undegraded":"2024-04-26T12:08:49.737641+0000","last_fullsized":"2024-04-26T12:08:49.737641+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:25.187022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9403,"num_write":417,"num_write_kb":67425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"60'417","reported_seq":504,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738394+0000","last_change":"2024-04-26T12:08:42.717934+0000","last_active":"2024-04-26T12:08:49.738394+0000","last_peered":"2024-04-26T12:08:49.738394+0000","last_clean":"2024-04-26T12:08:49.738394+0000","last_became_active":"2024-04-26T12:08:42.715812+0000","last_became_peered":"2024-04-26T12:08:42.715812+0000","last_unstale":"2024-04-26T12:08:49.738394+0000","last_undegraded":"2024-04-26T12:08:49.738394+0000","last_fullsized":"2024-04-26T12:08:49.738394+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:09.442852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20466,"num_write":400,"num_write_kb":42225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"60'475","reported_seq":601,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738500+0000","last_change":"2024-04-26T12:05:03.787909+0000","last_active":"2024-04-26T12:08:49.738500+0000","last_peered":"2024-04-26T12:08:49.738500+0000","last_clean":"2024-04-26T12:08:49.738500+0000","last_became_active":"2024-04-26T12:05:03.787562+0000","last_became_peered":"2024-04-26T12:05:03.787562+0000","last_unstale":"2024-04-26T12:08:49.738500+0000","last_undegraded":"2024-04-26T12:08:49.738500+0000","last_fullsized":"2024-04-26T12:08:49.738500+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25186,"num_write":431,"num_write_kb":48184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"60'409","reported_seq":894,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.742158+0000","last_change":"2024-04-26T12:08:49.741823+0000","last_active":"2024-04-26T12:08:49.742158+0000","last_peered":"2024-04-26T12:08:49.742158+0000","last_clean":"2024-04-26T12:08:49.742158+0000","last_became_active":"2024-04-26T12:08:49.740497+0000","last_became_peered":"2024-04-26T12:08:49.740497+0000","last_unstale":"2024-04-26T12:08:49.742158+0000","last_undegraded":"2024-04-26T12:08:49.742158+0000","last_fullsized":"2024-04-26T12:08:49.742158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:00.225872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":20137,"num_write":374,"num_write_kb":55441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'392","reported_seq":490,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738278+0000","last_change":"2024-04-26T12:08:47.737270+0000","last_active":"2024-04-26T12:08:49.738278+0000","last_peered":"2024-04-26T12:08:49.738278+0000","last_clean":"2024-04-26T12:08:49.738278+0000","last_became_active":"2024-04-26T12:08:47.735361+0000","last_became_peered":"2024-04-26T12:08:47.735361+0000","last_unstale":"2024-04-26T12:08:49.738278+0000","last_undegraded":"2024-04-26T12:08:49.738278+0000","last_fullsized":"2024-04-26T12:08:49.738278+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:09.838696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29179,"num_write":355,"num_write_kb":59011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'380","reported_seq":837,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738143+0000","last_change":"2024-04-26T12:08:41.717953+0000","last_active":"2024-04-26T12:08:49.738143+0000","last_peered":"2024-04-26T12:08:49.738143+0000","last_clean":"2024-04-26T12:08:49.738143+0000","last_became_active":"2024-04-26T12:08:41.716234+0000","last_became_peered":"2024-04-26T12:08:41.716234+0000","last_unstale":"2024-04-26T12:08:49.738143+0000","last_undegraded":"2024-04-26T12:08:49.738143+0000","last_fullsized":"2024-04-26T12:08:49.738143+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:37.480062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13036,"num_write":347,"num_write_kb":33880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"60'461","reported_seq":562,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737837+0000","last_change":"2024-04-26T12:08:46.732653+0000","last_active":"2024-04-26T12:08:49.737837+0000","last_peered":"2024-04-26T12:08:49.737837+0000","last_clean":"2024-04-26T12:08:49.737837+0000","last_became_active":"2024-04-26T12:08:46.730738+0000","last_became_peered":"2024-04-26T12:08:46.730738+0000","last_unstale":"2024-04-26T12:08:49.737837+0000","last_undegraded":"2024-04-26T12:08:49.737837+0000","last_fullsized":"2024-04-26T12:08:49.737837+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:46.177056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":32945,"num_write":426,"num_write_kb":63234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"60'411","reported_seq":898,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737807+0000","last_change":"2024-04-26T12:08:40.704958+0000","last_active":"2024-04-26T12:08:49.737807+0000","last_peered":"2024-04-26T12:08:49.737807+0000","last_clean":"2024-04-26T12:08:49.737807+0000","last_became_active":"2024-04-26T12:08:40.703845+0000","last_became_peered":"2024-04-26T12:08:40.703845+0000","last_unstale":"2024-04-26T12:08:49.737807+0000","last_undegraded":"2024-04-26T12:08:49.737807+0000","last_fullsized":"2024-04-26T12:08:49.737807+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:56.148477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11499,"num_write":377,"num_write_kb":34249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'430","reported_seq":535,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738409+0000","last_change":"2024-04-26T12:05:03.791605+0000","last_active":"2024-04-26T12:08:49.738409+0000","last_peered":"2024-04-26T12:08:49.738409+0000","last_clean":"2024-04-26T12:08:49.738409+0000","last_became_active":"2024-04-26T12:05:03.791251+0000","last_became_peered":"2024-04-26T12:05:03.791251+0000","last_unstale":"2024-04-26T12:08:49.738409+0000","last_undegraded":"2024-04-26T12:08:49.738409+0000","last_fullsized":"2024-04-26T12:08:49.738409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:27.239868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14660,"num_write":404,"num_write_kb":60840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"60'392","reported_seq":497,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737986+0000","last_change":"2024-04-26T12:08:44.723861+0000","last_active":"2024-04-26T12:08:49.737986+0000","last_peered":"2024-04-26T12:08:49.737986+0000","last_clean":"2024-04-26T12:08:49.737986+0000","last_became_active":"2024-04-26T12:08:44.722120+0000","last_became_peered":"2024-04-26T12:08:44.722120+0000","last_unstale":"2024-04-26T12:08:49.737986+0000","last_undegraded":"2024-04-26T12:08:49.737986+0000","last_fullsized":"2024-04-26T12:08:49.737986+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:12.810713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31703,"num_write":351,"num_write_kb":59324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"59'514","reported_seq":589,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738822+0000","last_change":"2024-04-26T12:05:03.430021+0000","last_active":"2024-04-26T12:08:49.738822+0000","last_peered":"2024-04-26T12:08:49.738822+0000","last_clean":"2024-04-26T12:08:49.738822+0000","last_became_active":"2024-04-26T12:05:03.429695+0000","last_became_peered":"2024-04-26T12:05:03.429695+0000","last_unstale":"2024-04-26T12:08:49.738822+0000","last_undegraded":"2024-04-26T12:08:49.738822+0000","last_fullsized":"2024-04-26T12:08:49.738822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":8377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'432","reported_seq":592,"reported_epoch":81,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-26T12:08:51.517969+0000","last_change":"2024-04-26T12:08:51.471546+0000","last_active":"2024-04-26T12:08:51.517969+0000","last_peered":"2024-04-26T12:08:51.517969+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"2024-04-26T12:08:37.786584+0000","last_became_peered":"2024-04-26T12:08:37.786584+0000","last_unstale":"2024-04-26T12:08:51.517969+0000","last_undegraded":"2024-04-26T12:08:51.517969+0000","last_fullsized":"2024-04-26T12:08:37.686907+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:26.544846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":30094,"num_write":388,"num_write_kb":83741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"59'55","reported_seq":130,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738169+0000","last_change":"2024-04-26T12:05:03.428605+0000","last_active":"2024-04-26T12:08:49.738169+0000","last_peered":"2024-04-26T12:08:49.738169+0000","last_clean":"2024-04-26T12:08:49.738169+0000","last_became_active":"2024-04-26T12:05:03.428098+0000","last_became_peered":"2024-04-26T12:05:03.428098+0000","last_unstale":"2024-04-26T12:08:49.738169+0000","last_undegraded":"2024-04-26T12:08:49.738169+0000","last_fullsized":"2024-04-26T12:08:49.738169+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"60'445","reported_seq":554,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738718+0000","last_change":"2024-04-26T12:05:03.788568+0000","last_active":"2024-04-26T12:08:49.738718+0000","last_peered":"2024-04-26T12:08:49.738718+0000","last_clean":"2024-04-26T12:08:49.738718+0000","last_became_active":"2024-04-26T12:05:03.788039+0000","last_became_peered":"2024-04-26T12:05:03.788039+0000","last_unstale":"2024-04-26T12:08:49.738718+0000","last_undegraded":"2024-04-26T12:08:49.738718+0000","last_fullsized":"2024-04-26T12:08:49.738718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":16079,"num_write":410,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"59'64","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737757+0000","last_change":"2024-04-26T12:08:36.696166+0000","last_active":"2024-04-26T12:08:49.737757+0000","last_peered":"2024-04-26T12:08:49.737757+0000","last_clean":"2024-04-26T12:08:49.737757+0000","last_became_active":"2024-04-26T12:08:36.694921+0000","last_became_peered":"2024-04-26T12:08:36.694921+0000","last_unstale":"2024-04-26T12:08:49.737757+0000","last_undegraded":"2024-04-26T12:08:49.737757+0000","last_fullsized":"2024-04-26T12:08:49.737757+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:57.438892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"60'420","reported_seq":534,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738508+0000","last_change":"2024-04-26T12:05:03.788505+0000","last_active":"2024-04-26T12:08:49.738508+0000","last_peered":"2024-04-26T12:08:49.738508+0000","last_clean":"2024-04-26T12:08:49.738508+0000","last_became_active":"2024-04-26T12:05:03.788184+0000","last_became_peered":"2024-04-26T12:05:03.788184+0000","last_unstale":"2024-04-26T12:08:49.738508+0000","last_undegraded":"2024-04-26T12:08:49.738508+0000","last_fullsized":"2024-04-26T12:08:49.738508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":14666,"num_write":383,"num_write_kb":83769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"60'63","reported_seq":152,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738422+0000","last_change":"2024-04-26T12:08:36.697126+0000","last_active":"2024-04-26T12:08:49.738422+0000","last_peered":"2024-04-26T12:08:49.738422+0000","last_clean":"2024-04-26T12:08:49.738422+0000","last_became_active":"2024-04-26T12:08:36.696792+0000","last_became_peered":"2024-04-26T12:08:36.696792+0000","last_unstale":"2024-04-26T12:08:49.738422+0000","last_undegraded":"2024-04-26T12:08:49.738422+0000","last_fullsized":"2024-04-26T12:08:49.738422+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:48.447882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"59'232","reported_seq":332,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.739348+0000","last_change":"2024-04-26T12:08:39.703810+0000","last_active":"2024-04-26T12:08:49.739348+0000","last_peered":"2024-04-26T12:08:49.739348+0000","last_clean":"2024-04-26T12:08:49.739348+0000","last_became_active":"2024-04-26T12:08:39.703455+0000","last_became_peered":"2024-04-26T12:08:39.703455+0000","last_unstale":"2024-04-26T12:08:49.739348+0000","last_undegraded":"2024-04-26T12:08:49.739348+0000","last_fullsized":"2024-04-26T12:08:49.739348+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:08.399237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'408","reported_seq":488,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737796+0000","last_change":"2024-04-26T12:08:40.710236+0000","last_active":"2024-04-26T12:08:49.737796+0000","last_peered":"2024-04-26T12:08:49.737796+0000","last_clean":"2024-04-26T12:08:49.737796+0000","last_became_active":"2024-04-26T12:08:40.707357+0000","last_became_peered":"2024-04-26T12:08:40.707357+0000","last_unstale":"2024-04-26T12:08:49.737796+0000","last_undegraded":"2024-04-26T12:08:49.737796+0000","last_fullsized":"2024-04-26T12:08:49.737796+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:17.928748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12418,"num_write":371,"num_write_kb":58378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"59'302","reported_seq":367,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738279+0000","last_change":"2024-04-26T12:08:39.703949+0000","last_active":"2024-04-26T12:08:49.738279+0000","last_peered":"2024-04-26T12:08:49.738279+0000","last_clean":"2024-04-26T12:08:49.738279+0000","last_became_active":"2024-04-26T12:08:39.703421+0000","last_became_peered":"2024-04-26T12:08:39.703421+0000","last_unstale":"2024-04-26T12:08:49.738279+0000","last_undegraded":"2024-04-26T12:08:49.738279+0000","last_fullsized":"2024-04-26T12:08:49.738279+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:10.222074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":4228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'439","reported_seq":495,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737587+0000","last_change":"2024-04-26T12:08:41.717923+0000","last_active":"2024-04-26T12:08:49.737587+0000","last_peered":"2024-04-26T12:08:49.737587+0000","last_clean":"2024-04-26T12:08:49.737587+0000","last_became_active":"2024-04-26T12:08:41.715708+0000","last_became_peered":"2024-04-26T12:08:41.715708+0000","last_unstale":"2024-04-26T12:08:49.737587+0000","last_undegraded":"2024-04-26T12:08:49.737587+0000","last_fullsized":"2024-04-26T12:08:49.737587+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:23.646558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":30851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"59'589","reported_seq":689,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.740000+0000","last_change":"2024-04-26T12:08:39.703966+0000","last_active":"2024-04-26T12:08:49.740000+0000","last_peered":"2024-04-26T12:08:49.740000+0000","last_clean":"2024-04-26T12:08:49.740000+0000","last_became_active":"2024-04-26T12:08:39.703487+0000","last_became_peered":"2024-04-26T12:08:39.703487+0000","last_unstale":"2024-04-26T12:08:49.740000+0000","last_undegraded":"2024-04-26T12:08:49.740000+0000","last_fullsized":"2024-04-26T12:08:49.740000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:06.112476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":534,"num_write_kb":4333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'461","reported_seq":611,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738575+0000","last_change":"2024-04-26T12:05:03.791809+0000","last_active":"2024-04-26T12:08:49.738575+0000","last_peered":"2024-04-26T12:08:49.738575+0000","last_clean":"2024-04-26T12:08:49.738575+0000","last_became_active":"2024-04-26T12:05:03.791272+0000","last_became_peered":"2024-04-26T12:05:03.791272+0000","last_unstale":"2024-04-26T12:08:49.738575+0000","last_undegraded":"2024-04-26T12:08:49.738575+0000","last_fullsized":"2024-04-26T12:08:49.738575+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":46123,"num_write":422,"num_write_kb":104552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'66","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.739078+0000","last_change":"2024-04-26T12:05:03.430224+0000","last_active":"2024-04-26T12:08:49.739078+0000","last_peered":"2024-04-26T12:08:49.739078+0000","last_clean":"2024-04-26T12:08:49.739078+0000","last_became_active":"2024-04-26T12:05:03.429291+0000","last_became_peered":"2024-04-26T12:05:03.429291+0000","last_unstale":"2024-04-26T12:08:49.739078+0000","last_undegraded":"2024-04-26T12:08:49.739078+0000","last_fullsized":"2024-04-26T12:08:49.739078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'428","reported_seq":538,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738096+0000","last_change":"2024-04-26T12:05:03.788174+0000","last_active":"2024-04-26T12:08:49.738096+0000","last_peered":"2024-04-26T12:08:49.738096+0000","last_clean":"2024-04-26T12:08:49.738096+0000","last_became_active":"2024-04-26T12:05:03.787772+0000","last_became_peered":"2024-04-26T12:05:03.787772+0000","last_unstale":"2024-04-26T12:08:49.738096+0000","last_undegraded":"2024-04-26T12:08:49.738096+0000","last_fullsized":"2024-04-26T12:08:49.738096+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15098,"num_write":394,"num_write_kb":42677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"59'195","reported_seq":270,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738225+0000","last_change":"2024-04-26T12:05:03.431162+0000","last_active":"2024-04-26T12:08:49.738225+0000","last_peered":"2024-04-26T12:08:49.738225+0000","last_clean":"2024-04-26T12:08:49.738225+0000","last_became_active":"2024-04-26T12:05:03.430855+0000","last_became_peered":"2024-04-26T12:05:03.430855+0000","last_unstale":"2024-04-26T12:08:49.738225+0000","last_undegraded":"2024-04-26T12:08:49.738225+0000","last_fullsized":"2024-04-26T12:08:49.738225+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:41.279426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"60'448","reported_seq":541,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738848+0000","last_change":"2024-04-26T12:05:03.792357+0000","last_active":"2024-04-26T12:08:49.738848+0000","last_peered":"2024-04-26T12:08:49.738848+0000","last_clean":"2024-04-26T12:08:49.738848+0000","last_became_active":"2024-04-26T12:05:03.792119+0000","last_became_peered":"2024-04-26T12:05:03.792119+0000","last_unstale":"2024-04-26T12:08:49.738848+0000","last_undegraded":"2024-04-26T12:08:49.738848+0000","last_fullsized":"2024-04-26T12:08:49.738848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":13281,"num_write":420,"num_write_kb":59540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"59'171","reported_seq":246,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738679+0000","last_change":"2024-04-26T12:05:03.429811+0000","last_active":"2024-04-26T12:08:49.738679+0000","last_peered":"2024-04-26T12:08:49.738679+0000","last_clean":"2024-04-26T12:08:49.738679+0000","last_became_active":"2024-04-26T12:05:03.429469+0000","last_became_peered":"2024-04-26T12:05:03.429469+0000","last_unstale":"2024-04-26T12:08:49.738679+0000","last_undegraded":"2024-04-26T12:08:49.738679+0000","last_fullsized":"2024-04-26T12:08:49.738679+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'412","reported_seq":913,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T12:08:50.747426+0000","last_change":"2024-04-26T12:08:50.747568+0000","last_active":"2024-04-26T12:08:50.747426+0000","last_peered":"2024-04-26T12:08:50.088420+0000","last_clean":"2024-04-26T12:06:10.951300+0000","last_became_active":"2024-04-26T12:08:37.788823+0000","last_became_peered":"2024-04-26T12:08:37.788823+0000","last_unstale":"2024-04-26T12:08:50.747426+0000","last_undegraded":"2024-04-26T12:08:50.747426+0000","last_fullsized":"2024-04-26T12:08:50.747426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:19.948638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26310,"num_write":380,"num_write_kb":38462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"59'55","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737572+0000","last_change":"2024-04-26T12:08:36.695355+0000","last_active":"2024-04-26T12:08:49.737572+0000","last_peered":"2024-04-26T12:08:49.737572+0000","last_clean":"2024-04-26T12:08:49.737572+0000","last_became_active":"2024-04-26T12:08:36.694346+0000","last_became_peered":"2024-04-26T12:08:36.694346+0000","last_unstale":"2024-04-26T12:08:49.737572+0000","last_undegraded":"2024-04-26T12:08:49.737572+0000","last_fullsized":"2024-04-26T12:08:49.737572+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:42.458073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"60'362","reported_seq":814,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.739189+0000","last_change":"2024-04-26T12:08:41.717048+0000","last_active":"2024-04-26T12:08:49.739189+0000","last_peered":"2024-04-26T12:08:49.739189+0000","last_clean":"2024-04-26T12:08:49.739189+0000","last_became_active":"2024-04-26T12:08:41.716102+0000","last_became_peered":"2024-04-26T12:08:41.716102+0000","last_unstale":"2024-04-26T12:08:49.739189+0000","last_undegraded":"2024-04-26T12:08:49.739189+0000","last_fullsized":"2024-04-26T12:08:49.739189+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:52.409548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21408,"num_write":333,"num_write_kb":66549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"59'378","reported_seq":436,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737689+0000","last_change":"2024-04-26T12:08:39.702797+0000","last_active":"2024-04-26T12:08:49.737689+0000","last_peered":"2024-04-26T12:08:49.737689+0000","last_clean":"2024-04-26T12:08:49.737689+0000","last_became_active":"2024-04-26T12:08:39.702438+0000","last_became_peered":"2024-04-26T12:08:39.702438+0000","last_unstale":"2024-04-26T12:08:49.737689+0000","last_undegraded":"2024-04-26T12:08:49.737689+0000","last_fullsized":"2024-04-26T12:08:49.737689+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:06.278304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"60'407","reported_seq":914,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738485+0000","last_change":"2024-04-26T12:08:45.724853+0000","last_active":"2024-04-26T12:08:49.738485+0000","last_peered":"2024-04-26T12:08:49.738485+0000","last_clean":"2024-04-26T12:08:49.738485+0000","last_became_active":"2024-04-26T12:08:45.723772+0000","last_became_peered":"2024-04-26T12:08:45.723772+0000","last_unstale":"2024-04-26T12:08:49.738485+0000","last_undegraded":"2024-04-26T12:08:49.738485+0000","last_fullsized":"2024-04-26T12:08:49.738485+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:41.814840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":40156,"num_write":373,"num_write_kb":91285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":290,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738618+0000","last_change":"2024-04-26T12:08:36.697892+0000","last_active":"2024-04-26T12:08:49.738618+0000","last_peered":"2024-04-26T12:08:49.738618+0000","last_clean":"2024-04-26T12:08:49.738618+0000","last_became_active":"2024-04-26T12:08:36.697508+0000","last_became_peered":"2024-04-26T12:08:36.697508+0000","last_unstale":"2024-04-26T12:08:49.738618+0000","last_undegraded":"2024-04-26T12:08:49.738618+0000","last_fullsized":"2024-04-26T12:08:49.738618+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_clean_scrub_stamp":"2024-04-26T12:04:52.376986+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:24.384180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738932+0000","last_change":"2024-04-26T12:04:59.403711+0000","last_active":"2024-04-26T12:08:49.738932+0000","last_peered":"2024-04-26T12:08:49.738932+0000","last_clean":"2024-04-26T12:08:49.738932+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:08:49.738932+0000","last_undegraded":"2024-04-26T12:08:49.738932+0000","last_fullsized":"2024-04-26T12:08:49.738932+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:45.779614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'793","reported_seq":894,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738468+0000","last_change":"2024-04-26T12:08:39.702225+0000","last_active":"2024-04-26T12:08:49.738468+0000","last_peered":"2024-04-26T12:08:49.738468+0000","last_clean":"2024-04-26T12:08:49.738468+0000","last_became_active":"2024-04-26T12:08:39.701760+0000","last_became_peered":"2024-04-26T12:08:39.701760+0000","last_unstale":"2024-04-26T12:08:49.738468+0000","last_undegraded":"2024-04-26T12:08:49.738468+0000","last_fullsized":"2024-04-26T12:08:49.738468+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:51.405891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":8533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"60'466","reported_seq":1001,"reported_epoch":81,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:08:51.035028+0000","last_change":"2024-04-26T12:08:51.035197+0000","last_active":"2024-04-26T12:08:51.035028+0000","last_peered":"2024-04-26T12:08:51.035028+0000","last_clean":"2024-04-26T12:06:10.951310+0000","last_became_active":"2024-04-26T12:08:37.789711+0000","last_became_peered":"2024-04-26T12:08:37.789711+0000","last_unstale":"2024-04-26T12:08:51.035028+0000","last_undegraded":"2024-04-26T12:08:51.035028+0000","last_fullsized":"2024-04-26T12:08:37.701265+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:51.630703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":37547,"num_write":422,"num_write_kb":96579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738535+0000","last_change":"2024-04-26T12:08:36.695759+0000","last_active":"2024-04-26T12:08:49.738535+0000","last_peered":"2024-04-26T12:08:49.738535+0000","last_clean":"2024-04-26T12:08:49.738535+0000","last_became_active":"2024-04-26T12:08:36.695444+0000","last_became_peered":"2024-04-26T12:08:36.695444+0000","last_unstale":"2024-04-26T12:08:49.738535+0000","last_undegraded":"2024-04-26T12:08:49.738535+0000","last_fullsized":"2024-04-26T12:08:49.738535+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:22.343369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"60'114","reported_seq":236,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737980+0000","last_change":"2024-04-26T12:05:03.428547+0000","last_active":"2024-04-26T12:08:49.737980+0000","last_peered":"2024-04-26T12:08:49.737980+0000","last_clean":"2024-04-26T12:08:49.737980+0000","last_became_active":"2024-04-26T12:05:03.427985+0000","last_became_peered":"2024-04-26T12:05:03.427985+0000","last_unstale":"2024-04-26T12:08:49.737980+0000","last_undegraded":"2024-04-26T12:08:49.737980+0000","last_fullsized":"2024-04-26T12:08:49.737980+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:19.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466015,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":47,"num_write_kb":1464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"60'492","reported_seq":652,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.742013+0000","last_change":"2024-04-26T12:08:49.741650+0000","last_active":"2024-04-26T12:08:49.742013+0000","last_peered":"2024-04-26T12:08:49.742013+0000","last_clean":"2024-04-26T12:08:49.742013+0000","last_became_active":"2024-04-26T12:08:49.739496+0000","last_became_peered":"2024-04-26T12:08:49.739496+0000","last_unstale":"2024-04-26T12:08:49.742013+0000","last_undegraded":"2024-04-26T12:08:49.742013+0000","last_fullsized":"2024-04-26T12:08:49.742013+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:55.361224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":63988,"num_write":466,"num_write_kb":154489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738153+0000","last_change":"2024-04-26T12:08:36.696858+0000","last_active":"2024-04-26T12:08:49.738153+0000","last_peered":"2024-04-26T12:08:49.738153+0000","last_clean":"2024-04-26T12:08:49.738153+0000","last_became_active":"2024-04-26T12:08:36.696619+0000","last_became_peered":"2024-04-26T12:08:36.696619+0000","last_unstale":"2024-04-26T12:08:49.738153+0000","last_undegraded":"2024-04-26T12:08:49.738153+0000","last_fullsized":"2024-04-26T12:08:49.738153+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:47.292926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"59'325","reported_seq":383,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737505+0000","last_change":"2024-04-26T12:08:39.704052+0000","last_active":"2024-04-26T12:08:49.737505+0000","last_peered":"2024-04-26T12:08:49.737505+0000","last_clean":"2024-04-26T12:08:49.737505+0000","last_became_active":"2024-04-26T12:08:39.703696+0000","last_became_peered":"2024-04-26T12:08:39.703696+0000","last_unstale":"2024-04-26T12:08:49.737505+0000","last_undegraded":"2024-04-26T12:08:49.737505+0000","last_fullsized":"2024-04-26T12:08:49.737505+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:21:44.069244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":8296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"60'359","reported_seq":782,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738580+0000","last_change":"2024-04-26T12:08:47.737443+0000","last_active":"2024-04-26T12:08:49.738580+0000","last_peered":"2024-04-26T12:08:49.738580+0000","last_clean":"2024-04-26T12:08:49.738580+0000","last_became_active":"2024-04-26T12:08:47.735729+0000","last_became_peered":"2024-04-26T12:08:47.735729+0000","last_unstale":"2024-04-26T12:08:49.738580+0000","last_undegraded":"2024-04-26T12:08:49.738580+0000","last_fullsized":"2024-04-26T12:08:49.738580+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:57:20.726677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9448,"num_write":336,"num_write_kb":74900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738785+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:08:49.738785+0000","last_peered":"2024-04-26T12:08:49.738785+0000","last_clean":"2024-04-26T12:08:49.738785+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:08:49.738785+0000","last_undegraded":"2024-04-26T12:08:49.738785+0000","last_fullsized":"2024-04-26T12:08:49.738785+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:12.939539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"59'67","reported_seq":142,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738883+0000","last_change":"2024-04-26T12:05:03.430140+0000","last_active":"2024-04-26T12:08:49.738883+0000","last_peered":"2024-04-26T12:08:49.738883+0000","last_clean":"2024-04-26T12:08:49.738883+0000","last_became_active":"2024-04-26T12:05:03.429838+0000","last_became_peered":"2024-04-26T12:05:03.429838+0000","last_unstale":"2024-04-26T12:08:49.738883+0000","last_undegraded":"2024-04-26T12:08:49.738883+0000","last_fullsized":"2024-04-26T12:08:49.738883+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"60'403","reported_seq":891,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T12:08:50.753437+0000","last_change":"2024-04-26T12:08:50.753437+0000","last_active":"2024-04-26T12:08:50.753437+0000","last_peered":"2024-04-26T12:08:50.753437+0000","last_clean":"2024-04-26T12:08:50.753437+0000","last_became_active":"2024-04-26T12:08:50.752366+0000","last_became_peered":"2024-04-26T12:08:50.752366+0000","last_unstale":"2024-04-26T12:08:50.753437+0000","last_undegraded":"2024-04-26T12:08:50.753437+0000","last_fullsized":"2024-04-26T12:08:50.753437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:02.999757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30094,"num_write":370,"num_write_kb":104181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"59'469","reported_seq":544,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.740057+0000","last_change":"2024-04-26T12:05:03.429673+0000","last_active":"2024-04-26T12:08:49.740057+0000","last_peered":"2024-04-26T12:08:49.740057+0000","last_clean":"2024-04-26T12:08:49.740057+0000","last_became_active":"2024-04-26T12:05:03.429146+0000","last_became_peered":"2024-04-26T12:05:03.429146+0000","last_unstale":"2024-04-26T12:08:49.740057+0000","last_undegraded":"2024-04-26T12:08:49.740057+0000","last_fullsized":"2024-04-26T12:08:49.740057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738857+0000","last_change":"2024-04-26T12:08:36.697900+0000","last_active":"2024-04-26T12:08:49.738857+0000","last_peered":"2024-04-26T12:08:49.738857+0000","last_clean":"2024-04-26T12:08:49.738857+0000","last_became_active":"2024-04-26T12:08:36.697618+0000","last_became_peered":"2024-04-26T12:08:36.697618+0000","last_unstale":"2024-04-26T12:08:49.738857+0000","last_undegraded":"2024-04-26T12:08:49.738857+0000","last_fullsized":"2024-04-26T12:08:49.738857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:16.620901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'354","reported_seq":410,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737930+0000","last_change":"2024-04-26T12:08:45.725751+0000","last_active":"2024-04-26T12:08:49.737930+0000","last_peered":"2024-04-26T12:08:49.737930+0000","last_clean":"2024-04-26T12:08:49.737930+0000","last_became_active":"2024-04-26T12:08:45.724153+0000","last_became_peered":"2024-04-26T12:08:45.724153+0000","last_unstale":"2024-04-26T12:08:49.737930+0000","last_undegraded":"2024-04-26T12:08:49.737930+0000","last_fullsized":"2024-04-26T12:08:49.737930+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:57.798803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":416,"num_write":319,"num_write_kb":17259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"59'53","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738780+0000","last_change":"2024-04-26T12:08:36.698122+0000","last_active":"2024-04-26T12:08:49.738780+0000","last_peered":"2024-04-26T12:08:49.738780+0000","last_clean":"2024-04-26T12:08:49.738780+0000","last_became_active":"2024-04-26T12:08:36.697832+0000","last_became_peered":"2024-04-26T12:08:36.697832+0000","last_unstale":"2024-04-26T12:08:49.738780+0000","last_undegraded":"2024-04-26T12:08:49.738780+0000","last_fullsized":"2024-04-26T12:08:49.738780+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:34.416168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738554+0000","last_change":"2024-04-26T12:08:36.698131+0000","last_active":"2024-04-26T12:08:49.738554+0000","last_peered":"2024-04-26T12:08:49.738554+0000","last_clean":"2024-04-26T12:08:49.738554+0000","last_became_active":"2024-04-26T12:08:36.697698+0000","last_became_peered":"2024-04-26T12:08:36.697698+0000","last_unstale":"2024-04-26T12:08:49.738554+0000","last_undegraded":"2024-04-26T12:08:49.738554+0000","last_fullsized":"2024-04-26T12:08:49.738554+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:15.476036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'399","reported_seq":474,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737756+0000","last_change":"2024-04-26T12:08:40.705752+0000","last_active":"2024-04-26T12:08:49.737756+0000","last_peered":"2024-04-26T12:08:49.737756+0000","last_clean":"2024-04-26T12:08:49.737756+0000","last_became_active":"2024-04-26T12:08:40.703906+0000","last_became_peered":"2024-04-26T12:08:40.703906+0000","last_unstale":"2024-04-26T12:08:49.737756+0000","last_undegraded":"2024-04-26T12:08:49.737756+0000","last_fullsized":"2024-04-26T12:08:49.737756+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:19.004074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11720,"num_write":363,"num_write_kb":66914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"59'65","reported_seq":154,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738897+0000","last_change":"2024-04-26T12:08:36.699388+0000","last_active":"2024-04-26T12:08:49.738897+0000","last_peered":"2024-04-26T12:08:49.738897+0000","last_clean":"2024-04-26T12:08:49.738897+0000","last_became_active":"2024-04-26T12:08:36.699058+0000","last_became_peered":"2024-04-26T12:08:36.699058+0000","last_unstale":"2024-04-26T12:08:49.738897+0000","last_undegraded":"2024-04-26T12:08:49.738897+0000","last_fullsized":"2024-04-26T12:08:49.738897+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:11.978288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738806+0000","last_change":"2024-04-26T12:08:36.697618+0000","last_active":"2024-04-26T12:08:49.738806+0000","last_peered":"2024-04-26T12:08:49.738806+0000","last_clean":"2024-04-26T12:08:49.738806+0000","last_became_active":"2024-04-26T12:08:36.697407+0000","last_became_peered":"2024-04-26T12:08:36.697407+0000","last_unstale":"2024-04-26T12:08:49.738806+0000","last_undegraded":"2024-04-26T12:08:49.738806+0000","last_fullsized":"2024-04-26T12:08:49.738806+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:02.301767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'424","reported_seq":538,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737865+0000","last_change":"2024-04-26T12:05:03.789623+0000","last_active":"2024-04-26T12:08:49.737865+0000","last_peered":"2024-04-26T12:08:49.737865+0000","last_clean":"2024-04-26T12:08:49.737865+0000","last_became_active":"2024-04-26T12:05:03.789390+0000","last_became_peered":"2024-04-26T12:05:03.789390+0000","last_unstale":"2024-04-26T12:08:49.737865+0000","last_undegraded":"2024-04-26T12:08:49.737865+0000","last_fullsized":"2024-04-26T12:08:49.737865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17027,"num_write":386,"num_write_kb":58797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"61'70","reported_seq":145,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738751+0000","last_change":"2024-04-26T12:05:03.429222+0000","last_active":"2024-04-26T12:08:49.738751+0000","last_peered":"2024-04-26T12:08:49.738751+0000","last_clean":"2024-04-26T12:08:49.738751+0000","last_became_active":"2024-04-26T12:05:03.428803+0000","last_became_peered":"2024-04-26T12:05:03.428803+0000","last_unstale":"2024-04-26T12:08:49.738751+0000","last_undegraded":"2024-04-26T12:08:49.738751+0000","last_fullsized":"2024-04-26T12:08:49.738751+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:31.305644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.739383+0000","last_change":"2024-04-26T12:08:36.698775+0000","last_active":"2024-04-26T12:08:49.739383+0000","last_peered":"2024-04-26T12:08:49.739383+0000","last_clean":"2024-04-26T12:08:49.739383+0000","last_became_active":"2024-04-26T12:08:36.698523+0000","last_became_peered":"2024-04-26T12:08:36.698523+0000","last_unstale":"2024-04-26T12:08:49.739383+0000","last_undegraded":"2024-04-26T12:08:49.739383+0000","last_fullsized":"2024-04-26T12:08:49.739383+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:16.620901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'393","reported_seq":469,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737827+0000","last_change":"2024-04-26T12:08:40.705662+0000","last_active":"2024-04-26T12:08:49.737827+0000","last_peered":"2024-04-26T12:08:49.737827+0000","last_clean":"2024-04-26T12:08:49.737827+0000","last_became_active":"2024-04-26T12:08:40.703873+0000","last_became_peered":"2024-04-26T12:08:40.703873+0000","last_unstale":"2024-04-26T12:08:49.737827+0000","last_undegraded":"2024-04-26T12:08:49.737827+0000","last_fullsized":"2024-04-26T12:08:49.737827+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:27.057123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":11991,"num_write":357,"num_write_kb":83226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'419","reported_seq":889,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738683+0000","last_change":"2024-04-26T12:08:44.723692+0000","last_active":"2024-04-26T12:08:49.738683+0000","last_peered":"2024-04-26T12:08:49.738683+0000","last_clean":"2024-04-26T12:08:49.738683+0000","last_became_active":"2024-04-26T12:08:44.722574+0000","last_became_peered":"2024-04-26T12:08:44.722574+0000","last_unstale":"2024-04-26T12:08:49.738683+0000","last_undegraded":"2024-04-26T12:08:49.738683+0000","last_fullsized":"2024-04-26T12:08:49.738683+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:01.256055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14983,"num_write":376,"num_write_kb":76749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"61'398","reported_seq":504,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738958+0000","last_change":"2024-04-26T12:08:39.703851+0000","last_active":"2024-04-26T12:08:49.738958+0000","last_peered":"2024-04-26T12:08:49.738958+0000","last_clean":"2024-04-26T12:08:49.738958+0000","last_became_active":"2024-04-26T12:08:39.703516+0000","last_became_peered":"2024-04-26T12:08:39.703516+0000","last_unstale":"2024-04-26T12:08:49.738958+0000","last_undegraded":"2024-04-26T12:08:49.738958+0000","last_fullsized":"2024-04-26T12:08:49.738958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:10.227718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699266,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":9692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9692849,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'428","reported_seq":937,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T12:08:50.753473+0000","last_change":"2024-04-26T12:08:50.753473+0000","last_active":"2024-04-26T12:08:50.753473+0000","last_peered":"2024-04-26T12:08:50.753473+0000","last_clean":"2024-04-26T12:08:50.753473+0000","last_became_active":"2024-04-26T12:08:50.752328+0000","last_became_peered":"2024-04-26T12:08:50.752328+0000","last_unstale":"2024-04-26T12:08:50.753473+0000","last_undegraded":"2024-04-26T12:08:50.753473+0000","last_fullsized":"2024-04-26T12:08:50.753473+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:08.396108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":26594,"num_write":396,"num_write_kb":67932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"60'91","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738182+0000","last_change":"2024-04-26T12:08:36.722607+0000","last_active":"2024-04-26T12:08:49.738182+0000","last_peered":"2024-04-26T12:08:49.738182+0000","last_clean":"2024-04-26T12:08:49.738182+0000","last_became_active":"2024-04-26T12:08:36.697650+0000","last_became_peered":"2024-04-26T12:08:36.697650+0000","last_unstale":"2024-04-26T12:08:49.738182+0000","last_undegraded":"2024-04-26T12:08:49.738182+0000","last_fullsized":"2024-04-26T12:08:49.738182+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:10.718101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"59'316","reported_seq":391,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.739311+0000","last_change":"2024-04-26T12:05:03.429257+0000","last_active":"2024-04-26T12:08:49.739311+0000","last_peered":"2024-04-26T12:08:49.739311+0000","last_clean":"2024-04-26T12:08:49.739311+0000","last_became_active":"2024-04-26T12:05:03.428921+0000","last_became_peered":"2024-04-26T12:05:03.428921+0000","last_unstale":"2024-04-26T12:08:49.739311+0000","last_undegraded":"2024-04-26T12:08:49.739311+0000","last_fullsized":"2024-04-26T12:08:49.739311+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:49.774845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'495","reported_seq":622,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737872+0000","last_change":"2024-04-26T12:05:03.788141+0000","last_active":"2024-04-26T12:08:49.737872+0000","last_peered":"2024-04-26T12:08:49.737872+0000","last_clean":"2024-04-26T12:08:49.737872+0000","last_became_active":"2024-04-26T12:05:03.787533+0000","last_became_peered":"2024-04-26T12:05:03.787533+0000","last_unstale":"2024-04-26T12:08:49.737872+0000","last_undegraded":"2024-04-26T12:08:49.737872+0000","last_fullsized":"2024-04-26T12:08:49.737872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37174,"num_write":458,"num_write_kb":125832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'51","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738747+0000","last_change":"2024-04-26T12:05:03.428971+0000","last_active":"2024-04-26T12:08:49.738747+0000","last_peered":"2024-04-26T12:08:49.738747+0000","last_clean":"2024-04-26T12:08:49.738747+0000","last_became_active":"2024-04-26T12:05:03.428445+0000","last_became_peered":"2024-04-26T12:05:03.428445+0000","last_unstale":"2024-04-26T12:08:49.738747+0000","last_undegraded":"2024-04-26T12:08:49.738747+0000","last_fullsized":"2024-04-26T12:08:49.738747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'482","reported_seq":1127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737865+0000","last_change":"2024-04-26T12:08:48.741589+0000","last_active":"2024-04-26T12:08:49.737865+0000","last_peered":"2024-04-26T12:08:49.737865+0000","last_clean":"2024-04-26T12:08:49.737865+0000","last_became_active":"2024-04-26T12:08:48.740055+0000","last_became_peered":"2024-04-26T12:08:48.740055+0000","last_unstale":"2024-04-26T12:08:49.737865+0000","last_undegraded":"2024-04-26T12:08:49.737865+0000","last_fullsized":"2024-04-26T12:08:49.737865+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:03.903516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":61972,"num_write":459,"num_write_kb":125797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"60'392","reported_seq":524,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738473+0000","last_change":"2024-04-26T12:08:43.718939+0000","last_active":"2024-04-26T12:08:49.738473+0000","last_peered":"2024-04-26T12:08:49.738473+0000","last_clean":"2024-04-26T12:08:49.738473+0000","last_became_active":"2024-04-26T12:08:43.717109+0000","last_became_peered":"2024-04-26T12:08:43.717109+0000","last_unstale":"2024-04-26T12:08:49.738473+0000","last_undegraded":"2024-04-26T12:08:49.738473+0000","last_fullsized":"2024-04-26T12:08:49.738473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:14.846653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":37910,"num_write":366,"num_write_kb":84111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"59'709","reported_seq":810,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738005+0000","last_change":"2024-04-26T12:08:39.701978+0000","last_active":"2024-04-26T12:08:49.738005+0000","last_peered":"2024-04-26T12:08:49.738005+0000","last_clean":"2024-04-26T12:08:49.738005+0000","last_became_active":"2024-04-26T12:08:39.700927+0000","last_became_peered":"2024-04-26T12:08:39.700927+0000","last_unstale":"2024-04-26T12:08:49.738005+0000","last_undegraded":"2024-04-26T12:08:49.738005+0000","last_fullsized":"2024-04-26T12:08:49.738005+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:10.815597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"60'435","reported_seq":569,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738412+0000","last_change":"2024-04-26T12:05:03.788754+0000","last_active":"2024-04-26T12:08:49.738412+0000","last_peered":"2024-04-26T12:08:49.738412+0000","last_clean":"2024-04-26T12:08:49.738412+0000","last_became_active":"2024-04-26T12:05:03.788311+0000","last_became_peered":"2024-04-26T12:05:03.788311+0000","last_unstale":"2024-04-26T12:08:49.738412+0000","last_undegraded":"2024-04-26T12:08:49.738412+0000","last_fullsized":"2024-04-26T12:08:49.738412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":28462,"num_write":403,"num_write_kb":93779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"59'262","reported_seq":337,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738118+0000","last_change":"2024-04-26T12:05:03.428810+0000","last_active":"2024-04-26T12:08:49.738118+0000","last_peered":"2024-04-26T12:08:49.738118+0000","last_clean":"2024-04-26T12:08:49.738118+0000","last_became_active":"2024-04-26T12:05:03.428191+0000","last_became_peered":"2024-04-26T12:05:03.428191+0000","last_unstale":"2024-04-26T12:08:49.738118+0000","last_undegraded":"2024-04-26T12:08:49.738118+0000","last_fullsized":"2024-04-26T12:08:49.738118+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"60'399","reported_seq":496,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.742814+0000","last_change":"2024-04-26T12:08:49.742459+0000","last_active":"2024-04-26T12:08:49.742814+0000","last_peered":"2024-04-26T12:08:49.742814+0000","last_clean":"2024-04-26T12:08:49.742814+0000","last_became_active":"2024-04-26T12:08:49.740536+0000","last_became_peered":"2024-04-26T12:08:49.740536+0000","last_unstale":"2024-04-26T12:08:49.742814+0000","last_undegraded":"2024-04-26T12:08:49.742814+0000","last_fullsized":"2024-04-26T12:08:49.742814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:24.169669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22216,"num_write":357,"num_write_kb":75245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"59'430","reported_seq":487,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737732+0000","last_change":"2024-04-26T12:08:39.703050+0000","last_active":"2024-04-26T12:08:49.737732+0000","last_peered":"2024-04-26T12:08:49.737732+0000","last_clean":"2024-04-26T12:08:49.737732+0000","last_became_active":"2024-04-26T12:08:39.702529+0000","last_became_peered":"2024-04-26T12:08:39.702529+0000","last_unstale":"2024-04-26T12:08:49.737732+0000","last_undegraded":"2024-04-26T12:08:49.737732+0000","last_fullsized":"2024-04-26T12:08:49.737732+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:28.249725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":12514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"60'387","reported_seq":473,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738153+0000","last_change":"2024-04-26T12:08:43.720098+0000","last_active":"2024-04-26T12:08:49.738153+0000","last_peered":"2024-04-26T12:08:49.738153+0000","last_clean":"2024-04-26T12:08:49.738153+0000","last_became_active":"2024-04-26T12:08:43.717442+0000","last_became_peered":"2024-04-26T12:08:43.717442+0000","last_unstale":"2024-04-26T12:08:49.738153+0000","last_undegraded":"2024-04-26T12:08:49.738153+0000","last_fullsized":"2024-04-26T12:08:49.738153+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:13.140334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20720,"num_write":352,"num_write_kb":87643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"59'58","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737866+0000","last_change":"2024-04-26T12:08:36.720540+0000","last_active":"2024-04-26T12:08:49.737866+0000","last_peered":"2024-04-26T12:08:49.737866+0000","last_clean":"2024-04-26T12:08:49.737866+0000","last_became_active":"2024-04-26T12:08:36.693399+0000","last_became_peered":"2024-04-26T12:08:36.693399+0000","last_unstale":"2024-04-26T12:08:49.737866+0000","last_undegraded":"2024-04-26T12:08:49.737866+0000","last_fullsized":"2024-04-26T12:08:49.737866+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:14.949002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"60'356","reported_seq":449,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738659+0000","last_change":"2024-04-26T12:05:03.791986+0000","last_active":"2024-04-26T12:08:49.738659+0000","last_peered":"2024-04-26T12:08:49.738659+0000","last_clean":"2024-04-26T12:08:49.738659+0000","last_became_active":"2024-04-26T12:05:03.790823+0000","last_became_peered":"2024-04-26T12:05:03.790823+0000","last_unstale":"2024-04-26T12:08:49.738659+0000","last_undegraded":"2024-04-26T12:08:49.738659+0000","last_fullsized":"2024-04-26T12:08:49.738659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9641,"num_write":326,"num_write_kb":29574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"59'309","reported_seq":384,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738960+0000","last_change":"2024-04-26T12:05:03.429469+0000","last_active":"2024-04-26T12:08:49.738960+0000","last_peered":"2024-04-26T12:08:49.738960+0000","last_clean":"2024-04-26T12:08:49.738960+0000","last_became_active":"2024-04-26T12:05:03.429015+0000","last_became_peered":"2024-04-26T12:05:03.429015+0000","last_unstale":"2024-04-26T12:08:49.738960+0000","last_undegraded":"2024-04-26T12:08:49.738960+0000","last_fullsized":"2024-04-26T12:08:49.738960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'433","reported_seq":572,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738662+0000","last_change":"2024-04-26T12:05:03.791929+0000","last_active":"2024-04-26T12:08:49.738662+0000","last_peered":"2024-04-26T12:08:49.738662+0000","last_clean":"2024-04-26T12:08:49.738662+0000","last_became_active":"2024-04-26T12:05:03.791540+0000","last_became_peered":"2024-04-26T12:05:03.791540+0000","last_unstale":"2024-04-26T12:08:49.738662+0000","last_undegraded":"2024-04-26T12:08:49.738662+0000","last_fullsized":"2024-04-26T12:08:49.738662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":47864,"num_write":399,"num_write_kb":92193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"59'382","reported_seq":446,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737989+0000","last_change":"2024-04-26T12:08:39.704680+0000","last_active":"2024-04-26T12:08:49.737989+0000","last_peered":"2024-04-26T12:08:49.737989+0000","last_clean":"2024-04-26T12:08:49.737989+0000","last_became_active":"2024-04-26T12:08:39.704404+0000","last_became_peered":"2024-04-26T12:08:39.704404+0000","last_unstale":"2024-04-26T12:08:49.737989+0000","last_undegraded":"2024-04-26T12:08:49.737989+0000","last_fullsized":"2024-04-26T12:08:49.737989+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:01.830043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":12467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'425","reported_seq":541,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737737+0000","last_change":"2024-04-26T12:08:47.737376+0000","last_active":"2024-04-26T12:08:49.737737+0000","last_peered":"2024-04-26T12:08:49.737737+0000","last_clean":"2024-04-26T12:08:49.737737+0000","last_became_active":"2024-04-26T12:08:47.735367+0000","last_became_peered":"2024-04-26T12:08:47.735367+0000","last_unstale":"2024-04-26T12:08:49.737737+0000","last_undegraded":"2024-04-26T12:08:49.737737+0000","last_fullsized":"2024-04-26T12:08:49.737737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:35.420647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":38065,"num_write":387,"num_write_kb":71445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"59'126","reported_seq":226,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738588+0000","last_change":"2024-04-26T12:08:39.702212+0000","last_active":"2024-04-26T12:08:49.738588+0000","last_peered":"2024-04-26T12:08:49.738588+0000","last_clean":"2024-04-26T12:08:49.738588+0000","last_became_active":"2024-04-26T12:08:39.701900+0000","last_became_peered":"2024-04-26T12:08:39.701900+0000","last_unstale":"2024-04-26T12:08:49.738588+0000","last_undegraded":"2024-04-26T12:08:49.738588+0000","last_fullsized":"2024-04-26T12:08:49.738588+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:28.460358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"60'448","reported_seq":545,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738608+0000","last_change":"2024-04-26T12:05:03.791827+0000","last_active":"2024-04-26T12:08:49.738608+0000","last_peered":"2024-04-26T12:08:49.738608+0000","last_clean":"2024-04-26T12:08:49.738608+0000","last_became_active":"2024-04-26T12:05:03.791442+0000","last_became_peered":"2024-04-26T12:05:03.791442+0000","last_unstale":"2024-04-26T12:08:49.738608+0000","last_undegraded":"2024-04-26T12:08:49.738608+0000","last_fullsized":"2024-04-26T12:08:49.738608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11191,"num_write":416,"num_write_kb":67272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"59'56","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738644+0000","last_change":"2024-04-26T12:05:03.430659+0000","last_active":"2024-04-26T12:08:49.738644+0000","last_peered":"2024-04-26T12:08:49.738644+0000","last_clean":"2024-04-26T12:08:49.738644+0000","last_became_active":"2024-04-26T12:05:03.430164+0000","last_became_peered":"2024-04-26T12:05:03.430164+0000","last_unstale":"2024-04-26T12:08:49.738644+0000","last_undegraded":"2024-04-26T12:08:49.738644+0000","last_fullsized":"2024-04-26T12:08:49.738644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2734,"num_read_kb":1486856,"num_write":24627,"num_write_kb":4487808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6935,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26722,"ondisk_log_size":26722,"up":128,"acting":124,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128606591,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":5972,"num_write_kb":129691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64376832,"data_stored":257213182,"data_compressed":19249503,"data_compressed_allocated":31694848,"data_compressed_original":224591872,"omap_allocated":4411,"internal_metadata":0},"log_size":7828,"ondisk_log_size":7828,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738421,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134400,"kb_used_data":27060,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94237440,"statfs":{"total":96636764160,"available":96499138560,"internally_reserved":0,"allocated":27709440,"data_stored":91780350,"data_compressed":6340284,"data_compressed_allocated":11272192,"data_compressed_original":75763712,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:08:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.40899999999999997,"15min":0.439},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.254},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.39900000000000002,"15min":0.42599999999999999},"min":{"1min":0.19,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.51700000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.26900000000000002}]},{"osd":1,"last update":"Fri Apr 26 12:05:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.32500000000000001}]}]},{"osd":1,"up_from":66,"seq":283467841541,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64396,"kb_used_data":10620,"kb_used_omap":5,"kb_used_meta":53754,"kb_avail":94307444,"statfs":{"total":96636764160,"available":96570822656,"internally_reserved":0,"allocated":10874880,"data_stored":86123805,"data_compressed":7182940,"data_compressed_allocated":10076160,"data_compressed_original":85745664,"omap_allocated":6005,"internal_metadata":55044235},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738421,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138864,"kb_used_data":27420,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232976,"statfs":{"total":96636764160,"available":96494567424,"internally_reserved":0,"allocated":28078080,"data_stored":81490534,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:05:55 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.254},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.23699999999999999}]},{"osd":2,"last update":"Fri Apr 26 12:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42399999999999999,"15min":0.435},"min":{"1min":0.16200000000000001,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.433,"15min":0.433},"min":{"1min":0.20599999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.32900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27357184,"data_stored":81158407,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10088448,"data_stored":85196920,"data_compressed":7176942,"data_compressed_allocated":10039296,"data_compressed_original":85172224,"omap_allocated":4411,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26931200,"data_stored":90857855,"data_compressed":6334286,"data_compressed_allocated":11235328,"data_compressed_original":75190272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:08:53.971 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T12:08:54.368 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:08:54.368 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"5bc300ae-e948-4ce3-81bb-5abae8c06799","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 177/110 objects degraded (160.909%), 1 pg degraded","count":1},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":251,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":84,"num_osds":3,"num_up_osds":3,"osd_up_since":1714133315,"num_in_osds":3,"osd_in_since":1714133083,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":99},{"state_name":"peering","count":2},{"state_name":"active+undersized+remapped","count":2},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":1},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":55,"data_bytes":129196959,"bytes_used":345763840,"bytes_avail":289564528640,"bytes_total":289910292480,"inactive_pgs_ratio":0.01904761977493763,"degraded_objects":177,"degraded_total":110,"degraded_ratio":1.6090909090909091,"recovering_objects_per_sec":710,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":2844,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":14144}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-26T12:06:10.344416+0000","services":{}},"progress_events":{}} 2024-04-26T12:08:54.381 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-26T12:08:54.381 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:08:54.683 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:08:54.684 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:08:54.694 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2024-04-26T12:08:54.392131+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129196959,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2917,"num_read_kb":1488438,"num_write":30802,"num_write_kb":4620959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6958,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34707,"ondisk_log_size":34707,"up":210,"acting":206,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":337660,"kb_used_data":65100,"kb_used_omap":8,"kb_used_meta":272503,"kb_avail":282777860,"statfs":{"total":289910292480,"available":289564528640,"internally_reserved":0,"allocated":66662400,"data_stored":259394689,"data_compressed":19261499,"data_compressed_allocated":31768576,"data_compressed_original":225738752,"omap_allocated":9193,"internal_metadata":279043095},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1981,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2018,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000878"},"pg_stats":[{"pgid":"4.3f","version":"60'426","reported_seq":497,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T12:08:50.748180+0000","last_change":"2024-04-26T12:08:50.748180+0000","last_active":"2024-04-26T12:08:36.692153+0000","last_peered":"2024-04-26T12:08:34.684175+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"2024-04-26T12:06:12.960288+0000","last_became_peered":"2024-04-26T12:06:12.960288+0000","last_unstale":"2024-04-26T12:08:50.748180+0000","last_undegraded":"2024-04-26T12:08:50.748180+0000","last_fullsized":"2024-04-26T12:08:50.748180+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:04.823699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9964,"num_write":393,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"60'470","reported_seq":598,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738540+0000","last_change":"2024-04-26T12:08:43.719204+0000","last_active":"2024-04-26T12:08:49.738540+0000","last_peered":"2024-04-26T12:08:49.738540+0000","last_clean":"2024-04-26T12:08:49.738540+0000","last_became_active":"2024-04-26T12:08:43.717325+0000","last_became_peered":"2024-04-26T12:08:43.717325+0000","last_unstale":"2024-04-26T12:08:49.738540+0000","last_undegraded":"2024-04-26T12:08:49.738540+0000","last_fullsized":"2024-04-26T12:08:49.738540+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:57.396493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":34556,"num_write":444,"num_write_kb":129697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"60'370","reported_seq":799,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T12:08:50.753639+0000","last_change":"2024-04-26T12:08:50.753639+0000","last_active":"2024-04-26T12:08:50.753639+0000","last_peered":"2024-04-26T12:08:50.753639+0000","last_clean":"2024-04-26T12:08:50.753639+0000","last_became_active":"2024-04-26T12:08:50.752468+0000","last_became_peered":"2024-04-26T12:08:50.752468+0000","last_unstale":"2024-04-26T12:08:50.753639+0000","last_undegraded":"2024-04-26T12:08:50.753639+0000","last_fullsized":"2024-04-26T12:08:50.753639+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:54.514768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":349,"num_write_kb":51115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"60'377","reported_seq":482,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738688+0000","last_change":"2024-04-26T12:05:03.791234+0000","last_active":"2024-04-26T12:08:49.738688+0000","last_peered":"2024-04-26T12:08:49.738688+0000","last_clean":"2024-04-26T12:08:49.738688+0000","last_became_active":"2024-04-26T12:05:03.790717+0000","last_became_peered":"2024-04-26T12:05:03.790717+0000","last_unstale":"2024-04-26T12:08:49.738688+0000","last_undegraded":"2024-04-26T12:08:49.738688+0000","last_fullsized":"2024-04-26T12:08:49.738688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:52.358881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17376,"num_write":341,"num_write_kb":46680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'445","reported_seq":547,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738148+0000","last_change":"2024-04-26T12:08:39.705318+0000","last_active":"2024-04-26T12:08:49.738148+0000","last_peered":"2024-04-26T12:08:49.738148+0000","last_clean":"2024-04-26T12:08:49.738148+0000","last_became_active":"2024-04-26T12:08:39.702117+0000","last_became_peered":"2024-04-26T12:08:39.702117+0000","last_unstale":"2024-04-26T12:08:49.738148+0000","last_undegraded":"2024-04-26T12:08:49.738148+0000","last_fullsized":"2024-04-26T12:08:49.738148+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:39.986313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24197,"num_write":416,"num_write_kb":80466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"60'375","reported_seq":467,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738477+0000","last_change":"2024-04-26T12:05:03.791560+0000","last_active":"2024-04-26T12:08:49.738477+0000","last_peered":"2024-04-26T12:08:49.738477+0000","last_clean":"2024-04-26T12:08:49.738477+0000","last_became_active":"2024-04-26T12:05:03.790578+0000","last_became_peered":"2024-04-26T12:05:03.790578+0000","last_unstale":"2024-04-26T12:08:49.738477+0000","last_undegraded":"2024-04-26T12:08:49.738477+0000","last_fullsized":"2024-04-26T12:08:49.738477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6518,"num_write":348,"num_write_kb":38078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'428","reported_seq":521,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738770+0000","last_change":"2024-04-26T12:05:03.791215+0000","last_active":"2024-04-26T12:08:49.738770+0000","last_peered":"2024-04-26T12:08:49.738770+0000","last_clean":"2024-04-26T12:08:49.738770+0000","last_became_active":"2024-04-26T12:05:03.790615+0000","last_became_peered":"2024-04-26T12:05:03.790615+0000","last_unstale":"2024-04-26T12:08:49.738770+0000","last_undegraded":"2024-04-26T12:08:49.738770+0000","last_fullsized":"2024-04-26T12:08:49.738770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:55.388027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12560,"num_write":398,"num_write_kb":67332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"60'387","reported_seq":523,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738298+0000","last_change":"2024-04-26T12:05:03.785861+0000","last_active":"2024-04-26T12:08:49.738298+0000","last_peered":"2024-04-26T12:08:49.738298+0000","last_clean":"2024-04-26T12:08:49.738298+0000","last_became_active":"2024-04-26T12:05:03.785382+0000","last_became_peered":"2024-04-26T12:05:03.785382+0000","last_unstale":"2024-04-26T12:08:49.738298+0000","last_undegraded":"2024-04-26T12:08:49.738298+0000","last_fullsized":"2024-04-26T12:08:49.738298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:51.870183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":41160,"num_write":356,"num_write_kb":80219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"60'405","reported_seq":897,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738395+0000","last_change":"2024-04-26T12:08:46.730220+0000","last_active":"2024-04-26T12:08:49.738395+0000","last_peered":"2024-04-26T12:08:49.738395+0000","last_clean":"2024-04-26T12:08:49.738395+0000","last_became_active":"2024-04-26T12:08:46.729039+0000","last_became_peered":"2024-04-26T12:08:46.729039+0000","last_unstale":"2024-04-26T12:08:49.738395+0000","last_undegraded":"2024-04-26T12:08:49.738395+0000","last_fullsized":"2024-04-26T12:08:49.738395+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:00.707126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":11674,"num_write":372,"num_write_kb":34604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"60'425","reported_seq":574,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738357+0000","last_change":"2024-04-26T12:08:41.718786+0000","last_active":"2024-04-26T12:08:49.738357+0000","last_peered":"2024-04-26T12:08:49.738357+0000","last_clean":"2024-04-26T12:08:49.738357+0000","last_became_active":"2024-04-26T12:08:41.716014+0000","last_became_peered":"2024-04-26T12:08:41.716014+0000","last_unstale":"2024-04-26T12:08:49.738357+0000","last_undegraded":"2024-04-26T12:08:49.738357+0000","last_fullsized":"2024-04-26T12:08:49.738357+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:20.096806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":48419,"num_write":390,"num_write_kb":92286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"60'372","reported_seq":486,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.739173+0000","last_change":"2024-04-26T12:05:03.791046+0000","last_active":"2024-04-26T12:08:49.739173+0000","last_peered":"2024-04-26T12:08:49.739173+0000","last_clean":"2024-04-26T12:08:49.739173+0000","last_became_active":"2024-04-26T12:05:03.790662+0000","last_became_peered":"2024-04-26T12:05:03.790662+0000","last_unstale":"2024-04-26T12:08:49.739173+0000","last_undegraded":"2024-04-26T12:08:49.739173+0000","last_fullsized":"2024-04-26T12:08:49.739173+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:35.458663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25905,"num_write":353,"num_write_kb":75437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'351","reported_seq":423,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738232+0000","last_change":"2024-04-26T12:08:41.718349+0000","last_active":"2024-04-26T12:08:49.738232+0000","last_peered":"2024-04-26T12:08:49.738232+0000","last_clean":"2024-04-26T12:08:49.738232+0000","last_became_active":"2024-04-26T12:08:41.715726+0000","last_became_peered":"2024-04-26T12:08:41.715726+0000","last_unstale":"2024-04-26T12:08:49.738232+0000","last_undegraded":"2024-04-26T12:08:49.738232+0000","last_fullsized":"2024-04-26T12:08:49.738232+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:00.589164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8884,"num_write":327,"num_write_kb":58289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"60'405","reported_seq":482,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738094+0000","last_change":"2024-04-26T12:08:39.705153+0000","last_active":"2024-04-26T12:08:49.738094+0000","last_peered":"2024-04-26T12:08:49.738094+0000","last_clean":"2024-04-26T12:08:49.738094+0000","last_became_active":"2024-04-26T12:08:39.702141+0000","last_became_peered":"2024-04-26T12:08:39.702141+0000","last_unstale":"2024-04-26T12:08:49.738094+0000","last_undegraded":"2024-04-26T12:08:49.738094+0000","last_fullsized":"2024-04-26T12:08:49.738094+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:42.807520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6771,"num_write":372,"num_write_kb":54786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"60'431","reported_seq":934,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738502+0000","last_change":"2024-04-26T12:08:48.741419+0000","last_active":"2024-04-26T12:08:49.738502+0000","last_peered":"2024-04-26T12:08:49.738502+0000","last_clean":"2024-04-26T12:08:49.738502+0000","last_became_active":"2024-04-26T12:08:48.740170+0000","last_became_peered":"2024-04-26T12:08:48.740170+0000","last_unstale":"2024-04-26T12:08:49.738502+0000","last_undegraded":"2024-04-26T12:08:49.738502+0000","last_fullsized":"2024-04-26T12:08:49.738502+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:52.026016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26572,"num_write":398,"num_write_kb":83974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'394","reported_seq":893,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738664+0000","last_change":"2024-04-26T12:08:41.717703+0000","last_active":"2024-04-26T12:08:49.738664+0000","last_peered":"2024-04-26T12:08:49.738664+0000","last_clean":"2024-04-26T12:08:49.738664+0000","last_became_active":"2024-04-26T12:08:41.715956+0000","last_became_peered":"2024-04-26T12:08:41.715956+0000","last_unstale":"2024-04-26T12:08:49.738664+0000","last_undegraded":"2024-04-26T12:08:49.738664+0000","last_fullsized":"2024-04-26T12:08:49.738664+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:34.291197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":38136,"num_write":355,"num_write_kb":38484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'432","reported_seq":540,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738308+0000","last_change":"2024-04-26T12:05:03.786360+0000","last_active":"2024-04-26T12:08:49.738308+0000","last_peered":"2024-04-26T12:08:49.738308+0000","last_clean":"2024-04-26T12:08:49.738308+0000","last_became_active":"2024-04-26T12:05:03.785991+0000","last_became_peered":"2024-04-26T12:05:03.785991+0000","last_unstale":"2024-04-26T12:08:49.738308+0000","last_undegraded":"2024-04-26T12:08:49.738308+0000","last_fullsized":"2024-04-26T12:08:49.738308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:17.702068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18244,"num_write":400,"num_write_kb":59033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'381","reported_seq":827,"reported_epoch":81,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:08:51.469778+0000","last_change":"2024-04-26T12:08:51.470014+0000","last_active":"2024-04-26T12:08:51.469778+0000","last_peered":"2024-04-26T12:08:51.469778+0000","last_clean":"2024-04-26T12:06:11.463514+0000","last_became_active":"2024-04-26T12:08:37.784944+0000","last_became_peered":"2024-04-26T12:08:37.784944+0000","last_unstale":"2024-04-26T12:08:51.469778+0000","last_undegraded":"2024-04-26T12:08:51.469778+0000","last_fullsized":"2024-04-26T12:08:37.703236+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:11.231375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":350,"num_write_kb":21212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"60'424","reported_seq":511,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738345+0000","last_change":"2024-04-26T12:08:42.718639+0000","last_active":"2024-04-26T12:08:49.738345+0000","last_peered":"2024-04-26T12:08:49.738345+0000","last_clean":"2024-04-26T12:08:49.738345+0000","last_became_active":"2024-04-26T12:08:42.716846+0000","last_became_peered":"2024-04-26T12:08:42.716846+0000","last_unstale":"2024-04-26T12:08:49.738345+0000","last_undegraded":"2024-04-26T12:08:49.738345+0000","last_fullsized":"2024-04-26T12:08:49.738345+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:00.928679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13930,"num_write":388,"num_write_kb":116055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'426","reported_seq":538,"reported_epoch":80,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:08:49.738461+0000","last_change":"2024-04-26T12:08:37.787898+0000","last_active":"2024-04-26T12:08:49.738461+0000","last_peered":"2024-04-26T12:08:49.738461+0000","last_clean":"2024-04-26T12:06:11.463289+0000","last_became_active":"2024-04-26T12:08:37.786618+0000","last_became_peered":"2024-04-26T12:08:37.786618+0000","last_unstale":"2024-04-26T12:08:49.738461+0000","last_undegraded":"2024-04-26T12:08:37.694919+0000","last_fullsized":"2024-04-26T12:08:37.687574+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:07.116133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26908,"num_write":383,"num_write_kb":71324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"60'425","reported_seq":543,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738830+0000","last_change":"2024-04-26T12:05:03.792219+0000","last_active":"2024-04-26T12:08:49.738830+0000","last_peered":"2024-04-26T12:08:49.738830+0000","last_clean":"2024-04-26T12:08:49.738830+0000","last_became_active":"2024-04-26T12:05:03.791061+0000","last_became_peered":"2024-04-26T12:05:03.791061+0000","last_unstale":"2024-04-26T12:08:49.738830+0000","last_undegraded":"2024-04-26T12:08:49.738830+0000","last_fullsized":"2024-04-26T12:08:49.738830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19715,"num_write":398,"num_write_kb":30150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'450","reported_seq":635,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738773+0000","last_change":"2024-04-26T12:05:03.792073+0000","last_active":"2024-04-26T12:08:49.738773+0000","last_peered":"2024-04-26T12:08:49.738773+0000","last_clean":"2024-04-26T12:08:49.738773+0000","last_became_active":"2024-04-26T12:05:03.791693+0000","last_became_peered":"2024-04-26T12:05:03.791693+0000","last_unstale":"2024-04-26T12:08:49.738773+0000","last_undegraded":"2024-04-26T12:08:49.738773+0000","last_fullsized":"2024-04-26T12:08:49.738773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":65124,"num_write":423,"num_write_kb":142714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'434","reported_seq":535,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738057+0000","last_change":"2024-04-26T12:08:46.730582+0000","last_active":"2024-04-26T12:08:49.738057+0000","last_peered":"2024-04-26T12:08:49.738057+0000","last_clean":"2024-04-26T12:08:49.738057+0000","last_became_active":"2024-04-26T12:08:46.728804+0000","last_became_peered":"2024-04-26T12:08:46.728804+0000","last_unstale":"2024-04-26T12:08:49.738057+0000","last_undegraded":"2024-04-26T12:08:49.738057+0000","last_fullsized":"2024-04-26T12:08:49.738057+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:47.745435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":15350,"num_write":405,"num_write_kb":59295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"60'424","reported_seq":534,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737777+0000","last_change":"2024-04-26T12:05:03.788658+0000","last_active":"2024-04-26T12:08:49.737777+0000","last_peered":"2024-04-26T12:08:49.737777+0000","last_clean":"2024-04-26T12:08:49.737777+0000","last_became_active":"2024-04-26T12:05:03.788050+0000","last_became_peered":"2024-04-26T12:05:03.788050+0000","last_unstale":"2024-04-26T12:08:49.737777+0000","last_undegraded":"2024-04-26T12:08:49.737777+0000","last_fullsized":"2024-04-26T12:08:49.737777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23772,"num_write":390,"num_write_kb":67944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"60'447","reported_seq":523,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737641+0000","last_change":"2024-04-26T12:08:40.707153+0000","last_active":"2024-04-26T12:08:49.737641+0000","last_peered":"2024-04-26T12:08:49.737641+0000","last_clean":"2024-04-26T12:08:49.737641+0000","last_became_active":"2024-04-26T12:08:40.703880+0000","last_became_peered":"2024-04-26T12:08:40.703880+0000","last_unstale":"2024-04-26T12:08:49.737641+0000","last_undegraded":"2024-04-26T12:08:49.737641+0000","last_fullsized":"2024-04-26T12:08:49.737641+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:25.187022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9403,"num_write":417,"num_write_kb":67425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"60'417","reported_seq":504,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738394+0000","last_change":"2024-04-26T12:08:42.717934+0000","last_active":"2024-04-26T12:08:49.738394+0000","last_peered":"2024-04-26T12:08:49.738394+0000","last_clean":"2024-04-26T12:08:49.738394+0000","last_became_active":"2024-04-26T12:08:42.715812+0000","last_became_peered":"2024-04-26T12:08:42.715812+0000","last_unstale":"2024-04-26T12:08:49.738394+0000","last_undegraded":"2024-04-26T12:08:49.738394+0000","last_fullsized":"2024-04-26T12:08:49.738394+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:09.442852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20466,"num_write":400,"num_write_kb":42225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"60'475","reported_seq":601,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738500+0000","last_change":"2024-04-26T12:05:03.787909+0000","last_active":"2024-04-26T12:08:49.738500+0000","last_peered":"2024-04-26T12:08:49.738500+0000","last_clean":"2024-04-26T12:08:49.738500+0000","last_became_active":"2024-04-26T12:05:03.787562+0000","last_became_peered":"2024-04-26T12:05:03.787562+0000","last_unstale":"2024-04-26T12:08:49.738500+0000","last_undegraded":"2024-04-26T12:08:49.738500+0000","last_fullsized":"2024-04-26T12:08:49.738500+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25186,"num_write":431,"num_write_kb":48184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"60'409","reported_seq":894,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.742158+0000","last_change":"2024-04-26T12:08:49.741823+0000","last_active":"2024-04-26T12:08:49.742158+0000","last_peered":"2024-04-26T12:08:49.742158+0000","last_clean":"2024-04-26T12:08:49.742158+0000","last_became_active":"2024-04-26T12:08:49.740497+0000","last_became_peered":"2024-04-26T12:08:49.740497+0000","last_unstale":"2024-04-26T12:08:49.742158+0000","last_undegraded":"2024-04-26T12:08:49.742158+0000","last_fullsized":"2024-04-26T12:08:49.742158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:00.225872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":20137,"num_write":374,"num_write_kb":55441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'392","reported_seq":490,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738278+0000","last_change":"2024-04-26T12:08:47.737270+0000","last_active":"2024-04-26T12:08:49.738278+0000","last_peered":"2024-04-26T12:08:49.738278+0000","last_clean":"2024-04-26T12:08:49.738278+0000","last_became_active":"2024-04-26T12:08:47.735361+0000","last_became_peered":"2024-04-26T12:08:47.735361+0000","last_unstale":"2024-04-26T12:08:49.738278+0000","last_undegraded":"2024-04-26T12:08:49.738278+0000","last_fullsized":"2024-04-26T12:08:49.738278+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:09.838696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29179,"num_write":355,"num_write_kb":59011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'380","reported_seq":837,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738143+0000","last_change":"2024-04-26T12:08:41.717953+0000","last_active":"2024-04-26T12:08:49.738143+0000","last_peered":"2024-04-26T12:08:49.738143+0000","last_clean":"2024-04-26T12:08:49.738143+0000","last_became_active":"2024-04-26T12:08:41.716234+0000","last_became_peered":"2024-04-26T12:08:41.716234+0000","last_unstale":"2024-04-26T12:08:49.738143+0000","last_undegraded":"2024-04-26T12:08:49.738143+0000","last_fullsized":"2024-04-26T12:08:49.738143+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:37.480062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13036,"num_write":347,"num_write_kb":33880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"60'461","reported_seq":562,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737837+0000","last_change":"2024-04-26T12:08:46.732653+0000","last_active":"2024-04-26T12:08:49.737837+0000","last_peered":"2024-04-26T12:08:49.737837+0000","last_clean":"2024-04-26T12:08:49.737837+0000","last_became_active":"2024-04-26T12:08:46.730738+0000","last_became_peered":"2024-04-26T12:08:46.730738+0000","last_unstale":"2024-04-26T12:08:49.737837+0000","last_undegraded":"2024-04-26T12:08:49.737837+0000","last_fullsized":"2024-04-26T12:08:49.737837+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:46.177056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":32945,"num_write":426,"num_write_kb":63234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"60'411","reported_seq":898,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737807+0000","last_change":"2024-04-26T12:08:40.704958+0000","last_active":"2024-04-26T12:08:49.737807+0000","last_peered":"2024-04-26T12:08:49.737807+0000","last_clean":"2024-04-26T12:08:49.737807+0000","last_became_active":"2024-04-26T12:08:40.703845+0000","last_became_peered":"2024-04-26T12:08:40.703845+0000","last_unstale":"2024-04-26T12:08:49.737807+0000","last_undegraded":"2024-04-26T12:08:49.737807+0000","last_fullsized":"2024-04-26T12:08:49.737807+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:56.148477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11499,"num_write":377,"num_write_kb":34249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'430","reported_seq":535,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738409+0000","last_change":"2024-04-26T12:05:03.791605+0000","last_active":"2024-04-26T12:08:49.738409+0000","last_peered":"2024-04-26T12:08:49.738409+0000","last_clean":"2024-04-26T12:08:49.738409+0000","last_became_active":"2024-04-26T12:05:03.791251+0000","last_became_peered":"2024-04-26T12:05:03.791251+0000","last_unstale":"2024-04-26T12:08:49.738409+0000","last_undegraded":"2024-04-26T12:08:49.738409+0000","last_fullsized":"2024-04-26T12:08:49.738409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:27.239868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14660,"num_write":404,"num_write_kb":60840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"60'392","reported_seq":497,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737986+0000","last_change":"2024-04-26T12:08:44.723861+0000","last_active":"2024-04-26T12:08:49.737986+0000","last_peered":"2024-04-26T12:08:49.737986+0000","last_clean":"2024-04-26T12:08:49.737986+0000","last_became_active":"2024-04-26T12:08:44.722120+0000","last_became_peered":"2024-04-26T12:08:44.722120+0000","last_unstale":"2024-04-26T12:08:49.737986+0000","last_undegraded":"2024-04-26T12:08:49.737986+0000","last_fullsized":"2024-04-26T12:08:49.737986+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:12.810713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31703,"num_write":351,"num_write_kb":59324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"59'514","reported_seq":589,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738822+0000","last_change":"2024-04-26T12:05:03.430021+0000","last_active":"2024-04-26T12:08:49.738822+0000","last_peered":"2024-04-26T12:08:49.738822+0000","last_clean":"2024-04-26T12:08:49.738822+0000","last_became_active":"2024-04-26T12:05:03.429695+0000","last_became_peered":"2024-04-26T12:05:03.429695+0000","last_unstale":"2024-04-26T12:08:49.738822+0000","last_undegraded":"2024-04-26T12:08:49.738822+0000","last_fullsized":"2024-04-26T12:08:49.738822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":8377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'432","reported_seq":592,"reported_epoch":81,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-26T12:08:51.517969+0000","last_change":"2024-04-26T12:08:51.471546+0000","last_active":"2024-04-26T12:08:51.517969+0000","last_peered":"2024-04-26T12:08:51.517969+0000","last_clean":"2024-04-26T12:05:03.412630+0000","last_became_active":"2024-04-26T12:08:37.786584+0000","last_became_peered":"2024-04-26T12:08:37.786584+0000","last_unstale":"2024-04-26T12:08:51.517969+0000","last_undegraded":"2024-04-26T12:08:51.517969+0000","last_fullsized":"2024-04-26T12:08:37.686907+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:26.544846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":30094,"num_write":388,"num_write_kb":83741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"59'55","reported_seq":130,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738169+0000","last_change":"2024-04-26T12:05:03.428605+0000","last_active":"2024-04-26T12:08:49.738169+0000","last_peered":"2024-04-26T12:08:49.738169+0000","last_clean":"2024-04-26T12:08:49.738169+0000","last_became_active":"2024-04-26T12:05:03.428098+0000","last_became_peered":"2024-04-26T12:05:03.428098+0000","last_unstale":"2024-04-26T12:08:49.738169+0000","last_undegraded":"2024-04-26T12:08:49.738169+0000","last_fullsized":"2024-04-26T12:08:49.738169+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"60'445","reported_seq":554,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738718+0000","last_change":"2024-04-26T12:05:03.788568+0000","last_active":"2024-04-26T12:08:49.738718+0000","last_peered":"2024-04-26T12:08:49.738718+0000","last_clean":"2024-04-26T12:08:49.738718+0000","last_became_active":"2024-04-26T12:05:03.788039+0000","last_became_peered":"2024-04-26T12:05:03.788039+0000","last_unstale":"2024-04-26T12:08:49.738718+0000","last_undegraded":"2024-04-26T12:08:49.738718+0000","last_fullsized":"2024-04-26T12:08:49.738718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":16079,"num_write":410,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"59'64","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737757+0000","last_change":"2024-04-26T12:08:36.696166+0000","last_active":"2024-04-26T12:08:49.737757+0000","last_peered":"2024-04-26T12:08:49.737757+0000","last_clean":"2024-04-26T12:08:49.737757+0000","last_became_active":"2024-04-26T12:08:36.694921+0000","last_became_peered":"2024-04-26T12:08:36.694921+0000","last_unstale":"2024-04-26T12:08:49.737757+0000","last_undegraded":"2024-04-26T12:08:49.737757+0000","last_fullsized":"2024-04-26T12:08:49.737757+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:57.438892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"60'420","reported_seq":534,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738508+0000","last_change":"2024-04-26T12:05:03.788505+0000","last_active":"2024-04-26T12:08:49.738508+0000","last_peered":"2024-04-26T12:08:49.738508+0000","last_clean":"2024-04-26T12:08:49.738508+0000","last_became_active":"2024-04-26T12:05:03.788184+0000","last_became_peered":"2024-04-26T12:05:03.788184+0000","last_unstale":"2024-04-26T12:08:49.738508+0000","last_undegraded":"2024-04-26T12:08:49.738508+0000","last_fullsized":"2024-04-26T12:08:49.738508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":14666,"num_write":383,"num_write_kb":83769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"60'63","reported_seq":152,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738422+0000","last_change":"2024-04-26T12:08:36.697126+0000","last_active":"2024-04-26T12:08:49.738422+0000","last_peered":"2024-04-26T12:08:49.738422+0000","last_clean":"2024-04-26T12:08:49.738422+0000","last_became_active":"2024-04-26T12:08:36.696792+0000","last_became_peered":"2024-04-26T12:08:36.696792+0000","last_unstale":"2024-04-26T12:08:49.738422+0000","last_undegraded":"2024-04-26T12:08:49.738422+0000","last_fullsized":"2024-04-26T12:08:49.738422+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:48.447882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"59'232","reported_seq":332,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.739348+0000","last_change":"2024-04-26T12:08:39.703810+0000","last_active":"2024-04-26T12:08:49.739348+0000","last_peered":"2024-04-26T12:08:49.739348+0000","last_clean":"2024-04-26T12:08:49.739348+0000","last_became_active":"2024-04-26T12:08:39.703455+0000","last_became_peered":"2024-04-26T12:08:39.703455+0000","last_unstale":"2024-04-26T12:08:49.739348+0000","last_undegraded":"2024-04-26T12:08:49.739348+0000","last_fullsized":"2024-04-26T12:08:49.739348+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:08.399237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'408","reported_seq":488,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737796+0000","last_change":"2024-04-26T12:08:40.710236+0000","last_active":"2024-04-26T12:08:49.737796+0000","last_peered":"2024-04-26T12:08:49.737796+0000","last_clean":"2024-04-26T12:08:49.737796+0000","last_became_active":"2024-04-26T12:08:40.707357+0000","last_became_peered":"2024-04-26T12:08:40.707357+0000","last_unstale":"2024-04-26T12:08:49.737796+0000","last_undegraded":"2024-04-26T12:08:49.737796+0000","last_fullsized":"2024-04-26T12:08:49.737796+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:17.928748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12418,"num_write":371,"num_write_kb":58378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"59'302","reported_seq":367,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738279+0000","last_change":"2024-04-26T12:08:39.703949+0000","last_active":"2024-04-26T12:08:49.738279+0000","last_peered":"2024-04-26T12:08:49.738279+0000","last_clean":"2024-04-26T12:08:49.738279+0000","last_became_active":"2024-04-26T12:08:39.703421+0000","last_became_peered":"2024-04-26T12:08:39.703421+0000","last_unstale":"2024-04-26T12:08:49.738279+0000","last_undegraded":"2024-04-26T12:08:49.738279+0000","last_fullsized":"2024-04-26T12:08:49.738279+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:10.222074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":4228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'439","reported_seq":495,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737587+0000","last_change":"2024-04-26T12:08:41.717923+0000","last_active":"2024-04-26T12:08:49.737587+0000","last_peered":"2024-04-26T12:08:49.737587+0000","last_clean":"2024-04-26T12:08:49.737587+0000","last_became_active":"2024-04-26T12:08:41.715708+0000","last_became_peered":"2024-04-26T12:08:41.715708+0000","last_unstale":"2024-04-26T12:08:49.737587+0000","last_undegraded":"2024-04-26T12:08:49.737587+0000","last_fullsized":"2024-04-26T12:08:49.737587+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:23.646558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":30851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"59'589","reported_seq":689,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.740000+0000","last_change":"2024-04-26T12:08:39.703966+0000","last_active":"2024-04-26T12:08:49.740000+0000","last_peered":"2024-04-26T12:08:49.740000+0000","last_clean":"2024-04-26T12:08:49.740000+0000","last_became_active":"2024-04-26T12:08:39.703487+0000","last_became_peered":"2024-04-26T12:08:39.703487+0000","last_unstale":"2024-04-26T12:08:49.740000+0000","last_undegraded":"2024-04-26T12:08:49.740000+0000","last_fullsized":"2024-04-26T12:08:49.740000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:06.112476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":534,"num_write_kb":4333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'461","reported_seq":611,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738575+0000","last_change":"2024-04-26T12:05:03.791809+0000","last_active":"2024-04-26T12:08:49.738575+0000","last_peered":"2024-04-26T12:08:49.738575+0000","last_clean":"2024-04-26T12:08:49.738575+0000","last_became_active":"2024-04-26T12:05:03.791272+0000","last_became_peered":"2024-04-26T12:05:03.791272+0000","last_unstale":"2024-04-26T12:08:49.738575+0000","last_undegraded":"2024-04-26T12:08:49.738575+0000","last_fullsized":"2024-04-26T12:08:49.738575+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":46123,"num_write":422,"num_write_kb":104552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'66","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.739078+0000","last_change":"2024-04-26T12:05:03.430224+0000","last_active":"2024-04-26T12:08:49.739078+0000","last_peered":"2024-04-26T12:08:49.739078+0000","last_clean":"2024-04-26T12:08:49.739078+0000","last_became_active":"2024-04-26T12:05:03.429291+0000","last_became_peered":"2024-04-26T12:05:03.429291+0000","last_unstale":"2024-04-26T12:08:49.739078+0000","last_undegraded":"2024-04-26T12:08:49.739078+0000","last_fullsized":"2024-04-26T12:08:49.739078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'428","reported_seq":538,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738096+0000","last_change":"2024-04-26T12:05:03.788174+0000","last_active":"2024-04-26T12:08:49.738096+0000","last_peered":"2024-04-26T12:08:49.738096+0000","last_clean":"2024-04-26T12:08:49.738096+0000","last_became_active":"2024-04-26T12:05:03.787772+0000","last_became_peered":"2024-04-26T12:05:03.787772+0000","last_unstale":"2024-04-26T12:08:49.738096+0000","last_undegraded":"2024-04-26T12:08:49.738096+0000","last_fullsized":"2024-04-26T12:08:49.738096+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15098,"num_write":394,"num_write_kb":42677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"59'195","reported_seq":270,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738225+0000","last_change":"2024-04-26T12:05:03.431162+0000","last_active":"2024-04-26T12:08:49.738225+0000","last_peered":"2024-04-26T12:08:49.738225+0000","last_clean":"2024-04-26T12:08:49.738225+0000","last_became_active":"2024-04-26T12:05:03.430855+0000","last_became_peered":"2024-04-26T12:05:03.430855+0000","last_unstale":"2024-04-26T12:08:49.738225+0000","last_undegraded":"2024-04-26T12:08:49.738225+0000","last_fullsized":"2024-04-26T12:08:49.738225+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:41.279426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"60'448","reported_seq":541,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738848+0000","last_change":"2024-04-26T12:05:03.792357+0000","last_active":"2024-04-26T12:08:49.738848+0000","last_peered":"2024-04-26T12:08:49.738848+0000","last_clean":"2024-04-26T12:08:49.738848+0000","last_became_active":"2024-04-26T12:05:03.792119+0000","last_became_peered":"2024-04-26T12:05:03.792119+0000","last_unstale":"2024-04-26T12:08:49.738848+0000","last_undegraded":"2024-04-26T12:08:49.738848+0000","last_fullsized":"2024-04-26T12:08:49.738848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":13281,"num_write":420,"num_write_kb":59540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"59'171","reported_seq":246,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738679+0000","last_change":"2024-04-26T12:05:03.429811+0000","last_active":"2024-04-26T12:08:49.738679+0000","last_peered":"2024-04-26T12:08:49.738679+0000","last_clean":"2024-04-26T12:08:49.738679+0000","last_became_active":"2024-04-26T12:05:03.429469+0000","last_became_peered":"2024-04-26T12:05:03.429469+0000","last_unstale":"2024-04-26T12:08:49.738679+0000","last_undegraded":"2024-04-26T12:08:49.738679+0000","last_fullsized":"2024-04-26T12:08:49.738679+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'412","reported_seq":913,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T12:08:50.747426+0000","last_change":"2024-04-26T12:08:50.747568+0000","last_active":"2024-04-26T12:08:50.747426+0000","last_peered":"2024-04-26T12:08:50.088420+0000","last_clean":"2024-04-26T12:06:10.951300+0000","last_became_active":"2024-04-26T12:08:37.788823+0000","last_became_peered":"2024-04-26T12:08:37.788823+0000","last_unstale":"2024-04-26T12:08:50.747426+0000","last_undegraded":"2024-04-26T12:08:50.747426+0000","last_fullsized":"2024-04-26T12:08:50.747426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:19.948638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26310,"num_write":380,"num_write_kb":38462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"59'55","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737572+0000","last_change":"2024-04-26T12:08:36.695355+0000","last_active":"2024-04-26T12:08:49.737572+0000","last_peered":"2024-04-26T12:08:49.737572+0000","last_clean":"2024-04-26T12:08:49.737572+0000","last_became_active":"2024-04-26T12:08:36.694346+0000","last_became_peered":"2024-04-26T12:08:36.694346+0000","last_unstale":"2024-04-26T12:08:49.737572+0000","last_undegraded":"2024-04-26T12:08:49.737572+0000","last_fullsized":"2024-04-26T12:08:49.737572+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:42.458073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"60'362","reported_seq":814,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.739189+0000","last_change":"2024-04-26T12:08:41.717048+0000","last_active":"2024-04-26T12:08:49.739189+0000","last_peered":"2024-04-26T12:08:49.739189+0000","last_clean":"2024-04-26T12:08:49.739189+0000","last_became_active":"2024-04-26T12:08:41.716102+0000","last_became_peered":"2024-04-26T12:08:41.716102+0000","last_unstale":"2024-04-26T12:08:49.739189+0000","last_undegraded":"2024-04-26T12:08:49.739189+0000","last_fullsized":"2024-04-26T12:08:49.739189+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:52.409548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21408,"num_write":333,"num_write_kb":66549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"59'378","reported_seq":436,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737689+0000","last_change":"2024-04-26T12:08:39.702797+0000","last_active":"2024-04-26T12:08:49.737689+0000","last_peered":"2024-04-26T12:08:49.737689+0000","last_clean":"2024-04-26T12:08:49.737689+0000","last_became_active":"2024-04-26T12:08:39.702438+0000","last_became_peered":"2024-04-26T12:08:39.702438+0000","last_unstale":"2024-04-26T12:08:49.737689+0000","last_undegraded":"2024-04-26T12:08:49.737689+0000","last_fullsized":"2024-04-26T12:08:49.737689+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:06.278304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"60'407","reported_seq":914,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738485+0000","last_change":"2024-04-26T12:08:45.724853+0000","last_active":"2024-04-26T12:08:49.738485+0000","last_peered":"2024-04-26T12:08:49.738485+0000","last_clean":"2024-04-26T12:08:49.738485+0000","last_became_active":"2024-04-26T12:08:45.723772+0000","last_became_peered":"2024-04-26T12:08:45.723772+0000","last_unstale":"2024-04-26T12:08:49.738485+0000","last_undegraded":"2024-04-26T12:08:49.738485+0000","last_fullsized":"2024-04-26T12:08:49.738485+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:41.814840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":40156,"num_write":373,"num_write_kb":91285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":290,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738618+0000","last_change":"2024-04-26T12:08:36.697892+0000","last_active":"2024-04-26T12:08:49.738618+0000","last_peered":"2024-04-26T12:08:49.738618+0000","last_clean":"2024-04-26T12:08:49.738618+0000","last_became_active":"2024-04-26T12:08:36.697508+0000","last_became_peered":"2024-04-26T12:08:36.697508+0000","last_unstale":"2024-04-26T12:08:49.738618+0000","last_undegraded":"2024-04-26T12:08:49.738618+0000","last_fullsized":"2024-04-26T12:08:49.738618+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_clean_scrub_stamp":"2024-04-26T12:04:52.376986+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:24.384180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738932+0000","last_change":"2024-04-26T12:04:59.403711+0000","last_active":"2024-04-26T12:08:49.738932+0000","last_peered":"2024-04-26T12:08:49.738932+0000","last_clean":"2024-04-26T12:08:49.738932+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:08:49.738932+0000","last_undegraded":"2024-04-26T12:08:49.738932+0000","last_fullsized":"2024-04-26T12:08:49.738932+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:45.779614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'793","reported_seq":894,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738468+0000","last_change":"2024-04-26T12:08:39.702225+0000","last_active":"2024-04-26T12:08:49.738468+0000","last_peered":"2024-04-26T12:08:49.738468+0000","last_clean":"2024-04-26T12:08:49.738468+0000","last_became_active":"2024-04-26T12:08:39.701760+0000","last_became_peered":"2024-04-26T12:08:39.701760+0000","last_unstale":"2024-04-26T12:08:49.738468+0000","last_undegraded":"2024-04-26T12:08:49.738468+0000","last_fullsized":"2024-04-26T12:08:49.738468+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:51.405891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":8533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"60'466","reported_seq":1001,"reported_epoch":81,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:08:51.035028+0000","last_change":"2024-04-26T12:08:51.035197+0000","last_active":"2024-04-26T12:08:51.035028+0000","last_peered":"2024-04-26T12:08:51.035028+0000","last_clean":"2024-04-26T12:06:10.951310+0000","last_became_active":"2024-04-26T12:08:37.789711+0000","last_became_peered":"2024-04-26T12:08:37.789711+0000","last_unstale":"2024-04-26T12:08:51.035028+0000","last_undegraded":"2024-04-26T12:08:51.035028+0000","last_fullsized":"2024-04-26T12:08:37.701265+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:51.630703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":37547,"num_write":422,"num_write_kb":96579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738535+0000","last_change":"2024-04-26T12:08:36.695759+0000","last_active":"2024-04-26T12:08:49.738535+0000","last_peered":"2024-04-26T12:08:49.738535+0000","last_clean":"2024-04-26T12:08:49.738535+0000","last_became_active":"2024-04-26T12:08:36.695444+0000","last_became_peered":"2024-04-26T12:08:36.695444+0000","last_unstale":"2024-04-26T12:08:49.738535+0000","last_undegraded":"2024-04-26T12:08:49.738535+0000","last_fullsized":"2024-04-26T12:08:49.738535+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:22.343369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"60'114","reported_seq":236,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737980+0000","last_change":"2024-04-26T12:05:03.428547+0000","last_active":"2024-04-26T12:08:49.737980+0000","last_peered":"2024-04-26T12:08:49.737980+0000","last_clean":"2024-04-26T12:08:49.737980+0000","last_became_active":"2024-04-26T12:05:03.427985+0000","last_became_peered":"2024-04-26T12:05:03.427985+0000","last_unstale":"2024-04-26T12:08:49.737980+0000","last_undegraded":"2024-04-26T12:08:49.737980+0000","last_fullsized":"2024-04-26T12:08:49.737980+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:19.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466015,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":47,"num_write_kb":1464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"60'492","reported_seq":652,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.742013+0000","last_change":"2024-04-26T12:08:49.741650+0000","last_active":"2024-04-26T12:08:49.742013+0000","last_peered":"2024-04-26T12:08:49.742013+0000","last_clean":"2024-04-26T12:08:49.742013+0000","last_became_active":"2024-04-26T12:08:49.739496+0000","last_became_peered":"2024-04-26T12:08:49.739496+0000","last_unstale":"2024-04-26T12:08:49.742013+0000","last_undegraded":"2024-04-26T12:08:49.742013+0000","last_fullsized":"2024-04-26T12:08:49.742013+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:55.361224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":63988,"num_write":466,"num_write_kb":154489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738153+0000","last_change":"2024-04-26T12:08:36.696858+0000","last_active":"2024-04-26T12:08:49.738153+0000","last_peered":"2024-04-26T12:08:49.738153+0000","last_clean":"2024-04-26T12:08:49.738153+0000","last_became_active":"2024-04-26T12:08:36.696619+0000","last_became_peered":"2024-04-26T12:08:36.696619+0000","last_unstale":"2024-04-26T12:08:49.738153+0000","last_undegraded":"2024-04-26T12:08:49.738153+0000","last_fullsized":"2024-04-26T12:08:49.738153+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:47.292926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"59'325","reported_seq":383,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737505+0000","last_change":"2024-04-26T12:08:39.704052+0000","last_active":"2024-04-26T12:08:49.737505+0000","last_peered":"2024-04-26T12:08:49.737505+0000","last_clean":"2024-04-26T12:08:49.737505+0000","last_became_active":"2024-04-26T12:08:39.703696+0000","last_became_peered":"2024-04-26T12:08:39.703696+0000","last_unstale":"2024-04-26T12:08:49.737505+0000","last_undegraded":"2024-04-26T12:08:49.737505+0000","last_fullsized":"2024-04-26T12:08:49.737505+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:21:44.069244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":8296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"60'359","reported_seq":782,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738580+0000","last_change":"2024-04-26T12:08:47.737443+0000","last_active":"2024-04-26T12:08:49.738580+0000","last_peered":"2024-04-26T12:08:49.738580+0000","last_clean":"2024-04-26T12:08:49.738580+0000","last_became_active":"2024-04-26T12:08:47.735729+0000","last_became_peered":"2024-04-26T12:08:47.735729+0000","last_unstale":"2024-04-26T12:08:49.738580+0000","last_undegraded":"2024-04-26T12:08:49.738580+0000","last_fullsized":"2024-04-26T12:08:49.738580+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:57:20.726677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9448,"num_write":336,"num_write_kb":74900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738785+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:08:49.738785+0000","last_peered":"2024-04-26T12:08:49.738785+0000","last_clean":"2024-04-26T12:08:49.738785+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:08:49.738785+0000","last_undegraded":"2024-04-26T12:08:49.738785+0000","last_fullsized":"2024-04-26T12:08:49.738785+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:12.939539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"59'67","reported_seq":142,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738883+0000","last_change":"2024-04-26T12:05:03.430140+0000","last_active":"2024-04-26T12:08:49.738883+0000","last_peered":"2024-04-26T12:08:49.738883+0000","last_clean":"2024-04-26T12:08:49.738883+0000","last_became_active":"2024-04-26T12:05:03.429838+0000","last_became_peered":"2024-04-26T12:05:03.429838+0000","last_unstale":"2024-04-26T12:08:49.738883+0000","last_undegraded":"2024-04-26T12:08:49.738883+0000","last_fullsized":"2024-04-26T12:08:49.738883+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"60'403","reported_seq":891,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T12:08:50.753437+0000","last_change":"2024-04-26T12:08:50.753437+0000","last_active":"2024-04-26T12:08:50.753437+0000","last_peered":"2024-04-26T12:08:50.753437+0000","last_clean":"2024-04-26T12:08:50.753437+0000","last_became_active":"2024-04-26T12:08:50.752366+0000","last_became_peered":"2024-04-26T12:08:50.752366+0000","last_unstale":"2024-04-26T12:08:50.753437+0000","last_undegraded":"2024-04-26T12:08:50.753437+0000","last_fullsized":"2024-04-26T12:08:50.753437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:02.999757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30094,"num_write":370,"num_write_kb":104181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"59'469","reported_seq":544,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.740057+0000","last_change":"2024-04-26T12:05:03.429673+0000","last_active":"2024-04-26T12:08:49.740057+0000","last_peered":"2024-04-26T12:08:49.740057+0000","last_clean":"2024-04-26T12:08:49.740057+0000","last_became_active":"2024-04-26T12:05:03.429146+0000","last_became_peered":"2024-04-26T12:05:03.429146+0000","last_unstale":"2024-04-26T12:08:49.740057+0000","last_undegraded":"2024-04-26T12:08:49.740057+0000","last_fullsized":"2024-04-26T12:08:49.740057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738857+0000","last_change":"2024-04-26T12:08:36.697900+0000","last_active":"2024-04-26T12:08:49.738857+0000","last_peered":"2024-04-26T12:08:49.738857+0000","last_clean":"2024-04-26T12:08:49.738857+0000","last_became_active":"2024-04-26T12:08:36.697618+0000","last_became_peered":"2024-04-26T12:08:36.697618+0000","last_unstale":"2024-04-26T12:08:49.738857+0000","last_undegraded":"2024-04-26T12:08:49.738857+0000","last_fullsized":"2024-04-26T12:08:49.738857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:16.620901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'354","reported_seq":410,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737930+0000","last_change":"2024-04-26T12:08:45.725751+0000","last_active":"2024-04-26T12:08:49.737930+0000","last_peered":"2024-04-26T12:08:49.737930+0000","last_clean":"2024-04-26T12:08:49.737930+0000","last_became_active":"2024-04-26T12:08:45.724153+0000","last_became_peered":"2024-04-26T12:08:45.724153+0000","last_unstale":"2024-04-26T12:08:49.737930+0000","last_undegraded":"2024-04-26T12:08:49.737930+0000","last_fullsized":"2024-04-26T12:08:49.737930+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:57.798803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":416,"num_write":319,"num_write_kb":17259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"59'53","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738780+0000","last_change":"2024-04-26T12:08:36.698122+0000","last_active":"2024-04-26T12:08:49.738780+0000","last_peered":"2024-04-26T12:08:49.738780+0000","last_clean":"2024-04-26T12:08:49.738780+0000","last_became_active":"2024-04-26T12:08:36.697832+0000","last_became_peered":"2024-04-26T12:08:36.697832+0000","last_unstale":"2024-04-26T12:08:49.738780+0000","last_undegraded":"2024-04-26T12:08:49.738780+0000","last_fullsized":"2024-04-26T12:08:49.738780+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:34.416168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738554+0000","last_change":"2024-04-26T12:08:36.698131+0000","last_active":"2024-04-26T12:08:49.738554+0000","last_peered":"2024-04-26T12:08:49.738554+0000","last_clean":"2024-04-26T12:08:49.738554+0000","last_became_active":"2024-04-26T12:08:36.697698+0000","last_became_peered":"2024-04-26T12:08:36.697698+0000","last_unstale":"2024-04-26T12:08:49.738554+0000","last_undegraded":"2024-04-26T12:08:49.738554+0000","last_fullsized":"2024-04-26T12:08:49.738554+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:15.476036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'399","reported_seq":474,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737756+0000","last_change":"2024-04-26T12:08:40.705752+0000","last_active":"2024-04-26T12:08:49.737756+0000","last_peered":"2024-04-26T12:08:49.737756+0000","last_clean":"2024-04-26T12:08:49.737756+0000","last_became_active":"2024-04-26T12:08:40.703906+0000","last_became_peered":"2024-04-26T12:08:40.703906+0000","last_unstale":"2024-04-26T12:08:49.737756+0000","last_undegraded":"2024-04-26T12:08:49.737756+0000","last_fullsized":"2024-04-26T12:08:49.737756+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:19.004074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11720,"num_write":363,"num_write_kb":66914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"59'65","reported_seq":154,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738897+0000","last_change":"2024-04-26T12:08:36.699388+0000","last_active":"2024-04-26T12:08:49.738897+0000","last_peered":"2024-04-26T12:08:49.738897+0000","last_clean":"2024-04-26T12:08:49.738897+0000","last_became_active":"2024-04-26T12:08:36.699058+0000","last_became_peered":"2024-04-26T12:08:36.699058+0000","last_unstale":"2024-04-26T12:08:49.738897+0000","last_undegraded":"2024-04-26T12:08:49.738897+0000","last_fullsized":"2024-04-26T12:08:49.738897+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:11.978288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738806+0000","last_change":"2024-04-26T12:08:36.697618+0000","last_active":"2024-04-26T12:08:49.738806+0000","last_peered":"2024-04-26T12:08:49.738806+0000","last_clean":"2024-04-26T12:08:49.738806+0000","last_became_active":"2024-04-26T12:08:36.697407+0000","last_became_peered":"2024-04-26T12:08:36.697407+0000","last_unstale":"2024-04-26T12:08:49.738806+0000","last_undegraded":"2024-04-26T12:08:49.738806+0000","last_fullsized":"2024-04-26T12:08:49.738806+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:02.301767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'424","reported_seq":538,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737865+0000","last_change":"2024-04-26T12:05:03.789623+0000","last_active":"2024-04-26T12:08:49.737865+0000","last_peered":"2024-04-26T12:08:49.737865+0000","last_clean":"2024-04-26T12:08:49.737865+0000","last_became_active":"2024-04-26T12:05:03.789390+0000","last_became_peered":"2024-04-26T12:05:03.789390+0000","last_unstale":"2024-04-26T12:08:49.737865+0000","last_undegraded":"2024-04-26T12:08:49.737865+0000","last_fullsized":"2024-04-26T12:08:49.737865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17027,"num_write":386,"num_write_kb":58797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"61'70","reported_seq":145,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738751+0000","last_change":"2024-04-26T12:05:03.429222+0000","last_active":"2024-04-26T12:08:49.738751+0000","last_peered":"2024-04-26T12:08:49.738751+0000","last_clean":"2024-04-26T12:08:49.738751+0000","last_became_active":"2024-04-26T12:05:03.428803+0000","last_became_peered":"2024-04-26T12:05:03.428803+0000","last_unstale":"2024-04-26T12:08:49.738751+0000","last_undegraded":"2024-04-26T12:08:49.738751+0000","last_fullsized":"2024-04-26T12:08:49.738751+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:31.305644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.739383+0000","last_change":"2024-04-26T12:08:36.698775+0000","last_active":"2024-04-26T12:08:49.739383+0000","last_peered":"2024-04-26T12:08:49.739383+0000","last_clean":"2024-04-26T12:08:49.739383+0000","last_became_active":"2024-04-26T12:08:36.698523+0000","last_became_peered":"2024-04-26T12:08:36.698523+0000","last_unstale":"2024-04-26T12:08:49.739383+0000","last_undegraded":"2024-04-26T12:08:49.739383+0000","last_fullsized":"2024-04-26T12:08:49.739383+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:16.620901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'393","reported_seq":469,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737827+0000","last_change":"2024-04-26T12:08:40.705662+0000","last_active":"2024-04-26T12:08:49.737827+0000","last_peered":"2024-04-26T12:08:49.737827+0000","last_clean":"2024-04-26T12:08:49.737827+0000","last_became_active":"2024-04-26T12:08:40.703873+0000","last_became_peered":"2024-04-26T12:08:40.703873+0000","last_unstale":"2024-04-26T12:08:49.737827+0000","last_undegraded":"2024-04-26T12:08:49.737827+0000","last_fullsized":"2024-04-26T12:08:49.737827+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:27.057123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":11991,"num_write":357,"num_write_kb":83226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'419","reported_seq":889,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738683+0000","last_change":"2024-04-26T12:08:44.723692+0000","last_active":"2024-04-26T12:08:49.738683+0000","last_peered":"2024-04-26T12:08:49.738683+0000","last_clean":"2024-04-26T12:08:49.738683+0000","last_became_active":"2024-04-26T12:08:44.722574+0000","last_became_peered":"2024-04-26T12:08:44.722574+0000","last_unstale":"2024-04-26T12:08:49.738683+0000","last_undegraded":"2024-04-26T12:08:49.738683+0000","last_fullsized":"2024-04-26T12:08:49.738683+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:01.256055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14983,"num_write":376,"num_write_kb":76749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"61'398","reported_seq":504,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738958+0000","last_change":"2024-04-26T12:08:39.703851+0000","last_active":"2024-04-26T12:08:49.738958+0000","last_peered":"2024-04-26T12:08:49.738958+0000","last_clean":"2024-04-26T12:08:49.738958+0000","last_became_active":"2024-04-26T12:08:39.703516+0000","last_became_peered":"2024-04-26T12:08:39.703516+0000","last_unstale":"2024-04-26T12:08:49.738958+0000","last_undegraded":"2024-04-26T12:08:49.738958+0000","last_fullsized":"2024-04-26T12:08:49.738958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:10.227718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699266,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":9692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9692849,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'428","reported_seq":937,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T12:08:50.753473+0000","last_change":"2024-04-26T12:08:50.753473+0000","last_active":"2024-04-26T12:08:50.753473+0000","last_peered":"2024-04-26T12:08:50.753473+0000","last_clean":"2024-04-26T12:08:50.753473+0000","last_became_active":"2024-04-26T12:08:50.752328+0000","last_became_peered":"2024-04-26T12:08:50.752328+0000","last_unstale":"2024-04-26T12:08:50.753473+0000","last_undegraded":"2024-04-26T12:08:50.753473+0000","last_fullsized":"2024-04-26T12:08:50.753473+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:08.396108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":26594,"num_write":396,"num_write_kb":67932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"60'91","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738182+0000","last_change":"2024-04-26T12:08:36.722607+0000","last_active":"2024-04-26T12:08:49.738182+0000","last_peered":"2024-04-26T12:08:49.738182+0000","last_clean":"2024-04-26T12:08:49.738182+0000","last_became_active":"2024-04-26T12:08:36.697650+0000","last_became_peered":"2024-04-26T12:08:36.697650+0000","last_unstale":"2024-04-26T12:08:49.738182+0000","last_undegraded":"2024-04-26T12:08:49.738182+0000","last_fullsized":"2024-04-26T12:08:49.738182+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:10.718101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"59'316","reported_seq":391,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.739311+0000","last_change":"2024-04-26T12:05:03.429257+0000","last_active":"2024-04-26T12:08:49.739311+0000","last_peered":"2024-04-26T12:08:49.739311+0000","last_clean":"2024-04-26T12:08:49.739311+0000","last_became_active":"2024-04-26T12:05:03.428921+0000","last_became_peered":"2024-04-26T12:05:03.428921+0000","last_unstale":"2024-04-26T12:08:49.739311+0000","last_undegraded":"2024-04-26T12:08:49.739311+0000","last_fullsized":"2024-04-26T12:08:49.739311+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:49.774845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'495","reported_seq":622,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737872+0000","last_change":"2024-04-26T12:05:03.788141+0000","last_active":"2024-04-26T12:08:49.737872+0000","last_peered":"2024-04-26T12:08:49.737872+0000","last_clean":"2024-04-26T12:08:49.737872+0000","last_became_active":"2024-04-26T12:05:03.787533+0000","last_became_peered":"2024-04-26T12:05:03.787533+0000","last_unstale":"2024-04-26T12:08:49.737872+0000","last_undegraded":"2024-04-26T12:08:49.737872+0000","last_fullsized":"2024-04-26T12:08:49.737872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37174,"num_write":458,"num_write_kb":125832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'51","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738747+0000","last_change":"2024-04-26T12:05:03.428971+0000","last_active":"2024-04-26T12:08:49.738747+0000","last_peered":"2024-04-26T12:08:49.738747+0000","last_clean":"2024-04-26T12:08:49.738747+0000","last_became_active":"2024-04-26T12:05:03.428445+0000","last_became_peered":"2024-04-26T12:05:03.428445+0000","last_unstale":"2024-04-26T12:08:49.738747+0000","last_undegraded":"2024-04-26T12:08:49.738747+0000","last_fullsized":"2024-04-26T12:08:49.738747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'482","reported_seq":1127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737865+0000","last_change":"2024-04-26T12:08:48.741589+0000","last_active":"2024-04-26T12:08:49.737865+0000","last_peered":"2024-04-26T12:08:49.737865+0000","last_clean":"2024-04-26T12:08:49.737865+0000","last_became_active":"2024-04-26T12:08:48.740055+0000","last_became_peered":"2024-04-26T12:08:48.740055+0000","last_unstale":"2024-04-26T12:08:49.737865+0000","last_undegraded":"2024-04-26T12:08:49.737865+0000","last_fullsized":"2024-04-26T12:08:49.737865+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:03.903516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":61972,"num_write":459,"num_write_kb":125797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"60'392","reported_seq":524,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738473+0000","last_change":"2024-04-26T12:08:43.718939+0000","last_active":"2024-04-26T12:08:49.738473+0000","last_peered":"2024-04-26T12:08:49.738473+0000","last_clean":"2024-04-26T12:08:49.738473+0000","last_became_active":"2024-04-26T12:08:43.717109+0000","last_became_peered":"2024-04-26T12:08:43.717109+0000","last_unstale":"2024-04-26T12:08:49.738473+0000","last_undegraded":"2024-04-26T12:08:49.738473+0000","last_fullsized":"2024-04-26T12:08:49.738473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:14.846653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":37910,"num_write":366,"num_write_kb":84111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"59'709","reported_seq":810,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738005+0000","last_change":"2024-04-26T12:08:39.701978+0000","last_active":"2024-04-26T12:08:49.738005+0000","last_peered":"2024-04-26T12:08:49.738005+0000","last_clean":"2024-04-26T12:08:49.738005+0000","last_became_active":"2024-04-26T12:08:39.700927+0000","last_became_peered":"2024-04-26T12:08:39.700927+0000","last_unstale":"2024-04-26T12:08:49.738005+0000","last_undegraded":"2024-04-26T12:08:49.738005+0000","last_fullsized":"2024-04-26T12:08:49.738005+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:10.815597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"60'435","reported_seq":569,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738412+0000","last_change":"2024-04-26T12:05:03.788754+0000","last_active":"2024-04-26T12:08:49.738412+0000","last_peered":"2024-04-26T12:08:49.738412+0000","last_clean":"2024-04-26T12:08:49.738412+0000","last_became_active":"2024-04-26T12:05:03.788311+0000","last_became_peered":"2024-04-26T12:05:03.788311+0000","last_unstale":"2024-04-26T12:08:49.738412+0000","last_undegraded":"2024-04-26T12:08:49.738412+0000","last_fullsized":"2024-04-26T12:08:49.738412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":28462,"num_write":403,"num_write_kb":93779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"59'262","reported_seq":337,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738118+0000","last_change":"2024-04-26T12:05:03.428810+0000","last_active":"2024-04-26T12:08:49.738118+0000","last_peered":"2024-04-26T12:08:49.738118+0000","last_clean":"2024-04-26T12:08:49.738118+0000","last_became_active":"2024-04-26T12:05:03.428191+0000","last_became_peered":"2024-04-26T12:05:03.428191+0000","last_unstale":"2024-04-26T12:08:49.738118+0000","last_undegraded":"2024-04-26T12:08:49.738118+0000","last_fullsized":"2024-04-26T12:08:49.738118+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"60'399","reported_seq":496,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.742814+0000","last_change":"2024-04-26T12:08:49.742459+0000","last_active":"2024-04-26T12:08:49.742814+0000","last_peered":"2024-04-26T12:08:49.742814+0000","last_clean":"2024-04-26T12:08:49.742814+0000","last_became_active":"2024-04-26T12:08:49.740536+0000","last_became_peered":"2024-04-26T12:08:49.740536+0000","last_unstale":"2024-04-26T12:08:49.742814+0000","last_undegraded":"2024-04-26T12:08:49.742814+0000","last_fullsized":"2024-04-26T12:08:49.742814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:24.169669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22216,"num_write":357,"num_write_kb":75245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"59'430","reported_seq":487,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737732+0000","last_change":"2024-04-26T12:08:39.703050+0000","last_active":"2024-04-26T12:08:49.737732+0000","last_peered":"2024-04-26T12:08:49.737732+0000","last_clean":"2024-04-26T12:08:49.737732+0000","last_became_active":"2024-04-26T12:08:39.702529+0000","last_became_peered":"2024-04-26T12:08:39.702529+0000","last_unstale":"2024-04-26T12:08:49.737732+0000","last_undegraded":"2024-04-26T12:08:49.737732+0000","last_fullsized":"2024-04-26T12:08:49.737732+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:28.249725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":12514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"60'387","reported_seq":473,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738153+0000","last_change":"2024-04-26T12:08:43.720098+0000","last_active":"2024-04-26T12:08:49.738153+0000","last_peered":"2024-04-26T12:08:49.738153+0000","last_clean":"2024-04-26T12:08:49.738153+0000","last_became_active":"2024-04-26T12:08:43.717442+0000","last_became_peered":"2024-04-26T12:08:43.717442+0000","last_unstale":"2024-04-26T12:08:49.738153+0000","last_undegraded":"2024-04-26T12:08:49.738153+0000","last_fullsized":"2024-04-26T12:08:49.738153+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:13.140334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20720,"num_write":352,"num_write_kb":87643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"59'58","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737866+0000","last_change":"2024-04-26T12:08:36.720540+0000","last_active":"2024-04-26T12:08:49.737866+0000","last_peered":"2024-04-26T12:08:49.737866+0000","last_clean":"2024-04-26T12:08:49.737866+0000","last_became_active":"2024-04-26T12:08:36.693399+0000","last_became_peered":"2024-04-26T12:08:36.693399+0000","last_unstale":"2024-04-26T12:08:49.737866+0000","last_undegraded":"2024-04-26T12:08:49.737866+0000","last_fullsized":"2024-04-26T12:08:49.737866+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:14.949002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"60'356","reported_seq":449,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738659+0000","last_change":"2024-04-26T12:05:03.791986+0000","last_active":"2024-04-26T12:08:49.738659+0000","last_peered":"2024-04-26T12:08:49.738659+0000","last_clean":"2024-04-26T12:08:49.738659+0000","last_became_active":"2024-04-26T12:05:03.790823+0000","last_became_peered":"2024-04-26T12:05:03.790823+0000","last_unstale":"2024-04-26T12:08:49.738659+0000","last_undegraded":"2024-04-26T12:08:49.738659+0000","last_fullsized":"2024-04-26T12:08:49.738659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9641,"num_write":326,"num_write_kb":29574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"59'309","reported_seq":384,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738960+0000","last_change":"2024-04-26T12:05:03.429469+0000","last_active":"2024-04-26T12:08:49.738960+0000","last_peered":"2024-04-26T12:08:49.738960+0000","last_clean":"2024-04-26T12:08:49.738960+0000","last_became_active":"2024-04-26T12:05:03.429015+0000","last_became_peered":"2024-04-26T12:05:03.429015+0000","last_unstale":"2024-04-26T12:08:49.738960+0000","last_undegraded":"2024-04-26T12:08:49.738960+0000","last_fullsized":"2024-04-26T12:08:49.738960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'433","reported_seq":572,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738662+0000","last_change":"2024-04-26T12:05:03.791929+0000","last_active":"2024-04-26T12:08:49.738662+0000","last_peered":"2024-04-26T12:08:49.738662+0000","last_clean":"2024-04-26T12:08:49.738662+0000","last_became_active":"2024-04-26T12:05:03.791540+0000","last_became_peered":"2024-04-26T12:05:03.791540+0000","last_unstale":"2024-04-26T12:08:49.738662+0000","last_undegraded":"2024-04-26T12:08:49.738662+0000","last_fullsized":"2024-04-26T12:08:49.738662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":47864,"num_write":399,"num_write_kb":92193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"59'382","reported_seq":446,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737989+0000","last_change":"2024-04-26T12:08:39.704680+0000","last_active":"2024-04-26T12:08:49.737989+0000","last_peered":"2024-04-26T12:08:49.737989+0000","last_clean":"2024-04-26T12:08:49.737989+0000","last_became_active":"2024-04-26T12:08:39.704404+0000","last_became_peered":"2024-04-26T12:08:39.704404+0000","last_unstale":"2024-04-26T12:08:49.737989+0000","last_undegraded":"2024-04-26T12:08:49.737989+0000","last_fullsized":"2024-04-26T12:08:49.737989+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:01.830043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":12467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'425","reported_seq":541,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.737737+0000","last_change":"2024-04-26T12:08:47.737376+0000","last_active":"2024-04-26T12:08:49.737737+0000","last_peered":"2024-04-26T12:08:49.737737+0000","last_clean":"2024-04-26T12:08:49.737737+0000","last_became_active":"2024-04-26T12:08:47.735367+0000","last_became_peered":"2024-04-26T12:08:47.735367+0000","last_unstale":"2024-04-26T12:08:49.737737+0000","last_undegraded":"2024-04-26T12:08:49.737737+0000","last_fullsized":"2024-04-26T12:08:49.737737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:35.420647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":38065,"num_write":387,"num_write_kb":71445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"59'126","reported_seq":226,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738588+0000","last_change":"2024-04-26T12:08:39.702212+0000","last_active":"2024-04-26T12:08:49.738588+0000","last_peered":"2024-04-26T12:08:49.738588+0000","last_clean":"2024-04-26T12:08:49.738588+0000","last_became_active":"2024-04-26T12:08:39.701900+0000","last_became_peered":"2024-04-26T12:08:39.701900+0000","last_unstale":"2024-04-26T12:08:49.738588+0000","last_undegraded":"2024-04-26T12:08:49.738588+0000","last_fullsized":"2024-04-26T12:08:49.738588+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:28.460358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"60'448","reported_seq":545,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738608+0000","last_change":"2024-04-26T12:05:03.791827+0000","last_active":"2024-04-26T12:08:49.738608+0000","last_peered":"2024-04-26T12:08:49.738608+0000","last_clean":"2024-04-26T12:08:49.738608+0000","last_became_active":"2024-04-26T12:05:03.791442+0000","last_became_peered":"2024-04-26T12:05:03.791442+0000","last_unstale":"2024-04-26T12:08:49.738608+0000","last_undegraded":"2024-04-26T12:08:49.738608+0000","last_fullsized":"2024-04-26T12:08:49.738608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11191,"num_write":416,"num_write_kb":67272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"59'56","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738644+0000","last_change":"2024-04-26T12:05:03.430659+0000","last_active":"2024-04-26T12:08:49.738644+0000","last_peered":"2024-04-26T12:08:49.738644+0000","last_clean":"2024-04-26T12:08:49.738644+0000","last_became_active":"2024-04-26T12:05:03.430164+0000","last_became_peered":"2024-04-26T12:05:03.430164+0000","last_unstale":"2024-04-26T12:08:49.738644+0000","last_undegraded":"2024-04-26T12:08:49.738644+0000","last_fullsized":"2024-04-26T12:08:49.738644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2734,"num_read_kb":1486856,"num_write":24627,"num_write_kb":4487808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6935,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26722,"ondisk_log_size":26722,"up":128,"acting":124,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128606591,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":5972,"num_write_kb":129691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64376832,"data_stored":257213182,"data_compressed":19249503,"data_compressed_allocated":31694848,"data_compressed_original":224591872,"omap_allocated":4411,"internal_metadata":0},"log_size":7828,"ondisk_log_size":7828,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738421,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134400,"kb_used_data":27060,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94237440,"statfs":{"total":96636764160,"available":96499138560,"internally_reserved":0,"allocated":27709440,"data_stored":91780350,"data_compressed":6340284,"data_compressed_allocated":11272192,"data_compressed_original":75763712,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:08:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.40899999999999997,"15min":0.439},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.254},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.39900000000000002,"15min":0.42599999999999999},"min":{"1min":0.19,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.51700000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.26900000000000002}]},{"osd":1,"last update":"Fri Apr 26 12:05:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.32500000000000001}]}]},{"osd":1,"up_from":66,"seq":283467841541,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64396,"kb_used_data":10620,"kb_used_omap":5,"kb_used_meta":53754,"kb_avail":94307444,"statfs":{"total":96636764160,"available":96570822656,"internally_reserved":0,"allocated":10874880,"data_stored":86123805,"data_compressed":7182940,"data_compressed_allocated":10076160,"data_compressed_original":85745664,"omap_allocated":6005,"internal_metadata":55044235},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738421,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138864,"kb_used_data":27420,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232976,"statfs":{"total":96636764160,"available":96494567424,"internally_reserved":0,"allocated":28078080,"data_stored":81490534,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:05:55 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.254},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.23699999999999999}]},{"osd":2,"last update":"Fri Apr 26 12:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42399999999999999,"15min":0.435},"min":{"1min":0.16200000000000001,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.433,"15min":0.433},"min":{"1min":0.20599999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.32900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27357184,"data_stored":81158407,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10088448,"data_stored":85196920,"data_compressed":7176942,"data_compressed_allocated":10039296,"data_compressed_original":85172224,"omap_allocated":4411,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26931200,"data_stored":90857855,"data_compressed":6334286,"data_compressed_allocated":11235328,"data_compressed_original":75190272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:08:57.699 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:08:58.013 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:08:58.015 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:08:58.024 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-04-26T12:08:56.392516+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129196959,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2917,"num_read_kb":1488438,"num_write":30802,"num_write_kb":4620959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7463,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34707,"ondisk_log_size":34707,"up":210,"acting":209,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":341804,"kb_used_data":65156,"kb_used_omap":8,"kb_used_meta":276599,"kb_avail":282773716,"statfs":{"total":289910292480,"available":289560285184,"internally_reserved":0,"allocated":66719744,"data_stored":259424803,"data_compressed":19261499,"data_compressed_allocated":31768576,"data_compressed_original":225738752,"omap_allocated":9193,"internal_metadata":283237399},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-2158,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2523,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.647856"},"pg_stats":[{"pgid":"4.3f","version":"60'426","reported_seq":507,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744715+0000","last_change":"2024-04-26T12:08:51.753936+0000","last_active":"2024-04-26T12:08:52.744715+0000","last_peered":"2024-04-26T12:08:52.744715+0000","last_clean":"2024-04-26T12:08:52.744715+0000","last_became_active":"2024-04-26T12:08:51.750917+0000","last_became_peered":"2024-04-26T12:08:51.750917+0000","last_unstale":"2024-04-26T12:08:52.744715+0000","last_undegraded":"2024-04-26T12:08:52.744715+0000","last_fullsized":"2024-04-26T12:08:52.744715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:21.716324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9964,"num_write":393,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"60'470","reported_seq":601,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744464+0000","last_change":"2024-04-26T12:08:43.719204+0000","last_active":"2024-04-26T12:08:52.744464+0000","last_peered":"2024-04-26T12:08:52.744464+0000","last_clean":"2024-04-26T12:08:52.744464+0000","last_became_active":"2024-04-26T12:08:43.717325+0000","last_became_peered":"2024-04-26T12:08:43.717325+0000","last_unstale":"2024-04-26T12:08:52.744464+0000","last_undegraded":"2024-04-26T12:08:52.744464+0000","last_fullsized":"2024-04-26T12:08:52.744464+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:57.396493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":34556,"num_write":444,"num_write_kb":129697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"60'370","reported_seq":799,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T12:08:50.753639+0000","last_change":"2024-04-26T12:08:50.753639+0000","last_active":"2024-04-26T12:08:50.753639+0000","last_peered":"2024-04-26T12:08:50.753639+0000","last_clean":"2024-04-26T12:08:50.753639+0000","last_became_active":"2024-04-26T12:08:50.752468+0000","last_became_peered":"2024-04-26T12:08:50.752468+0000","last_unstale":"2024-04-26T12:08:50.753639+0000","last_undegraded":"2024-04-26T12:08:50.753639+0000","last_fullsized":"2024-04-26T12:08:50.753639+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:54.514768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":349,"num_write_kb":51115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"60'377","reported_seq":482,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738688+0000","last_change":"2024-04-26T12:05:03.791234+0000","last_active":"2024-04-26T12:08:49.738688+0000","last_peered":"2024-04-26T12:08:49.738688+0000","last_clean":"2024-04-26T12:08:49.738688+0000","last_became_active":"2024-04-26T12:05:03.790717+0000","last_became_peered":"2024-04-26T12:05:03.790717+0000","last_unstale":"2024-04-26T12:08:49.738688+0000","last_undegraded":"2024-04-26T12:08:49.738688+0000","last_fullsized":"2024-04-26T12:08:49.738688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:52.358881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17376,"num_write":341,"num_write_kb":46680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'445","reported_seq":550,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743965+0000","last_change":"2024-04-26T12:08:39.705318+0000","last_active":"2024-04-26T12:08:52.743965+0000","last_peered":"2024-04-26T12:08:52.743965+0000","last_clean":"2024-04-26T12:08:52.743965+0000","last_became_active":"2024-04-26T12:08:39.702117+0000","last_became_peered":"2024-04-26T12:08:39.702117+0000","last_unstale":"2024-04-26T12:08:52.743965+0000","last_undegraded":"2024-04-26T12:08:52.743965+0000","last_fullsized":"2024-04-26T12:08:52.743965+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:39.986313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24197,"num_write":416,"num_write_kb":80466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"60'375","reported_seq":467,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738477+0000","last_change":"2024-04-26T12:05:03.791560+0000","last_active":"2024-04-26T12:08:49.738477+0000","last_peered":"2024-04-26T12:08:49.738477+0000","last_clean":"2024-04-26T12:08:49.738477+0000","last_became_active":"2024-04-26T12:05:03.790578+0000","last_became_peered":"2024-04-26T12:05:03.790578+0000","last_unstale":"2024-04-26T12:08:49.738477+0000","last_undegraded":"2024-04-26T12:08:49.738477+0000","last_fullsized":"2024-04-26T12:08:49.738477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6518,"num_write":348,"num_write_kb":38078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'428","reported_seq":521,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738770+0000","last_change":"2024-04-26T12:05:03.791215+0000","last_active":"2024-04-26T12:08:49.738770+0000","last_peered":"2024-04-26T12:08:49.738770+0000","last_clean":"2024-04-26T12:08:49.738770+0000","last_became_active":"2024-04-26T12:05:03.790615+0000","last_became_peered":"2024-04-26T12:05:03.790615+0000","last_unstale":"2024-04-26T12:08:49.738770+0000","last_undegraded":"2024-04-26T12:08:49.738770+0000","last_fullsized":"2024-04-26T12:08:49.738770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:55.388027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12560,"num_write":398,"num_write_kb":67332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"60'387","reported_seq":523,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738298+0000","last_change":"2024-04-26T12:05:03.785861+0000","last_active":"2024-04-26T12:08:49.738298+0000","last_peered":"2024-04-26T12:08:49.738298+0000","last_clean":"2024-04-26T12:08:49.738298+0000","last_became_active":"2024-04-26T12:05:03.785382+0000","last_became_peered":"2024-04-26T12:05:03.785382+0000","last_unstale":"2024-04-26T12:08:49.738298+0000","last_undegraded":"2024-04-26T12:08:49.738298+0000","last_fullsized":"2024-04-26T12:08:49.738298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:51.870183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":41160,"num_write":356,"num_write_kb":80219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"60'405","reported_seq":900,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744722+0000","last_change":"2024-04-26T12:08:46.730220+0000","last_active":"2024-04-26T12:08:52.744722+0000","last_peered":"2024-04-26T12:08:52.744722+0000","last_clean":"2024-04-26T12:08:52.744722+0000","last_became_active":"2024-04-26T12:08:46.729039+0000","last_became_peered":"2024-04-26T12:08:46.729039+0000","last_unstale":"2024-04-26T12:08:52.744722+0000","last_undegraded":"2024-04-26T12:08:52.744722+0000","last_fullsized":"2024-04-26T12:08:52.744722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:00.707126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":11674,"num_write":372,"num_write_kb":34604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"60'425","reported_seq":577,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744378+0000","last_change":"2024-04-26T12:08:41.718786+0000","last_active":"2024-04-26T12:08:52.744378+0000","last_peered":"2024-04-26T12:08:52.744378+0000","last_clean":"2024-04-26T12:08:52.744378+0000","last_became_active":"2024-04-26T12:08:41.716014+0000","last_became_peered":"2024-04-26T12:08:41.716014+0000","last_unstale":"2024-04-26T12:08:52.744378+0000","last_undegraded":"2024-04-26T12:08:52.744378+0000","last_fullsized":"2024-04-26T12:08:52.744378+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:20.096806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":48419,"num_write":390,"num_write_kb":92286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"60'372","reported_seq":486,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.739173+0000","last_change":"2024-04-26T12:05:03.791046+0000","last_active":"2024-04-26T12:08:49.739173+0000","last_peered":"2024-04-26T12:08:49.739173+0000","last_clean":"2024-04-26T12:08:49.739173+0000","last_became_active":"2024-04-26T12:05:03.790662+0000","last_became_peered":"2024-04-26T12:05:03.790662+0000","last_unstale":"2024-04-26T12:08:49.739173+0000","last_undegraded":"2024-04-26T12:08:49.739173+0000","last_fullsized":"2024-04-26T12:08:49.739173+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:35.458663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25905,"num_write":353,"num_write_kb":75437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'351","reported_seq":426,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744359+0000","last_change":"2024-04-26T12:08:41.718349+0000","last_active":"2024-04-26T12:08:52.744359+0000","last_peered":"2024-04-26T12:08:52.744359+0000","last_clean":"2024-04-26T12:08:52.744359+0000","last_became_active":"2024-04-26T12:08:41.715726+0000","last_became_peered":"2024-04-26T12:08:41.715726+0000","last_unstale":"2024-04-26T12:08:52.744359+0000","last_undegraded":"2024-04-26T12:08:52.744359+0000","last_fullsized":"2024-04-26T12:08:52.744359+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:00.589164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8884,"num_write":327,"num_write_kb":58289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"60'405","reported_seq":485,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744109+0000","last_change":"2024-04-26T12:08:39.705153+0000","last_active":"2024-04-26T12:08:52.744109+0000","last_peered":"2024-04-26T12:08:52.744109+0000","last_clean":"2024-04-26T12:08:52.744109+0000","last_became_active":"2024-04-26T12:08:39.702141+0000","last_became_peered":"2024-04-26T12:08:39.702141+0000","last_unstale":"2024-04-26T12:08:52.744109+0000","last_undegraded":"2024-04-26T12:08:52.744109+0000","last_fullsized":"2024-04-26T12:08:52.744109+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:42.807520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6771,"num_write":372,"num_write_kb":54786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"60'431","reported_seq":934,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738502+0000","last_change":"2024-04-26T12:08:48.741419+0000","last_active":"2024-04-26T12:08:49.738502+0000","last_peered":"2024-04-26T12:08:49.738502+0000","last_clean":"2024-04-26T12:08:49.738502+0000","last_became_active":"2024-04-26T12:08:48.740170+0000","last_became_peered":"2024-04-26T12:08:48.740170+0000","last_unstale":"2024-04-26T12:08:49.738502+0000","last_undegraded":"2024-04-26T12:08:49.738502+0000","last_fullsized":"2024-04-26T12:08:49.738502+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:52.026016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26572,"num_write":398,"num_write_kb":83974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'394","reported_seq":893,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738664+0000","last_change":"2024-04-26T12:08:41.717703+0000","last_active":"2024-04-26T12:08:49.738664+0000","last_peered":"2024-04-26T12:08:49.738664+0000","last_clean":"2024-04-26T12:08:49.738664+0000","last_became_active":"2024-04-26T12:08:41.715956+0000","last_became_peered":"2024-04-26T12:08:41.715956+0000","last_unstale":"2024-04-26T12:08:49.738664+0000","last_undegraded":"2024-04-26T12:08:49.738664+0000","last_fullsized":"2024-04-26T12:08:49.738664+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:34.291197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":38136,"num_write":355,"num_write_kb":38484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'432","reported_seq":540,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738308+0000","last_change":"2024-04-26T12:05:03.786360+0000","last_active":"2024-04-26T12:08:49.738308+0000","last_peered":"2024-04-26T12:08:49.738308+0000","last_clean":"2024-04-26T12:08:49.738308+0000","last_became_active":"2024-04-26T12:05:03.785991+0000","last_became_peered":"2024-04-26T12:05:03.785991+0000","last_unstale":"2024-04-26T12:08:49.738308+0000","last_undegraded":"2024-04-26T12:08:49.738308+0000","last_fullsized":"2024-04-26T12:08:49.738308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:17.702068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18244,"num_write":400,"num_write_kb":59033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'381","reported_seq":838,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.747343+0000","last_change":"2024-04-26T12:08:52.747060+0000","last_active":"2024-04-26T12:08:52.747343+0000","last_peered":"2024-04-26T12:08:52.747343+0000","last_clean":"2024-04-26T12:08:52.747343+0000","last_became_active":"2024-04-26T12:08:52.745913+0000","last_became_peered":"2024-04-26T12:08:52.745913+0000","last_unstale":"2024-04-26T12:08:52.747343+0000","last_undegraded":"2024-04-26T12:08:52.747343+0000","last_fullsized":"2024-04-26T12:08:52.747343+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:30.065406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":350,"num_write_kb":21212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"60'424","reported_seq":514,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744398+0000","last_change":"2024-04-26T12:08:42.718639+0000","last_active":"2024-04-26T12:08:52.744398+0000","last_peered":"2024-04-26T12:08:52.744398+0000","last_clean":"2024-04-26T12:08:52.744398+0000","last_became_active":"2024-04-26T12:08:42.716846+0000","last_became_peered":"2024-04-26T12:08:42.716846+0000","last_unstale":"2024-04-26T12:08:52.744398+0000","last_undegraded":"2024-04-26T12:08:52.744398+0000","last_fullsized":"2024-04-26T12:08:52.744398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:00.928679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13930,"num_write":388,"num_write_kb":116055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'426","reported_seq":905,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.748530+0000","last_change":"2024-04-26T12:08:53.748530+0000","last_active":"2024-04-26T12:08:53.748530+0000","last_peered":"2024-04-26T12:08:53.748530+0000","last_clean":"2024-04-26T12:08:53.748530+0000","last_became_active":"2024-04-26T12:08:53.747215+0000","last_became_peered":"2024-04-26T12:08:53.747215+0000","last_unstale":"2024-04-26T12:08:53.748530+0000","last_undegraded":"2024-04-26T12:08:53.748530+0000","last_fullsized":"2024-04-26T12:08:53.748530+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:14.637610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26908,"num_write":383,"num_write_kb":71324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"60'425","reported_seq":543,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738830+0000","last_change":"2024-04-26T12:05:03.792219+0000","last_active":"2024-04-26T12:08:49.738830+0000","last_peered":"2024-04-26T12:08:49.738830+0000","last_clean":"2024-04-26T12:08:49.738830+0000","last_became_active":"2024-04-26T12:05:03.791061+0000","last_became_peered":"2024-04-26T12:05:03.791061+0000","last_unstale":"2024-04-26T12:08:49.738830+0000","last_undegraded":"2024-04-26T12:08:49.738830+0000","last_fullsized":"2024-04-26T12:08:49.738830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19715,"num_write":398,"num_write_kb":30150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'450","reported_seq":635,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738773+0000","last_change":"2024-04-26T12:05:03.792073+0000","last_active":"2024-04-26T12:08:49.738773+0000","last_peered":"2024-04-26T12:08:49.738773+0000","last_clean":"2024-04-26T12:08:49.738773+0000","last_became_active":"2024-04-26T12:05:03.791693+0000","last_became_peered":"2024-04-26T12:05:03.791693+0000","last_unstale":"2024-04-26T12:08:49.738773+0000","last_undegraded":"2024-04-26T12:08:49.738773+0000","last_fullsized":"2024-04-26T12:08:49.738773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":65124,"num_write":423,"num_write_kb":142714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'434","reported_seq":538,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744125+0000","last_change":"2024-04-26T12:08:46.730582+0000","last_active":"2024-04-26T12:08:52.744125+0000","last_peered":"2024-04-26T12:08:52.744125+0000","last_clean":"2024-04-26T12:08:52.744125+0000","last_became_active":"2024-04-26T12:08:46.728804+0000","last_became_peered":"2024-04-26T12:08:46.728804+0000","last_unstale":"2024-04-26T12:08:52.744125+0000","last_undegraded":"2024-04-26T12:08:52.744125+0000","last_fullsized":"2024-04-26T12:08:52.744125+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:47.745435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":15350,"num_write":405,"num_write_kb":59295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"60'424","reported_seq":537,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743999+0000","last_change":"2024-04-26T12:05:03.788658+0000","last_active":"2024-04-26T12:08:52.743999+0000","last_peered":"2024-04-26T12:08:52.743999+0000","last_clean":"2024-04-26T12:08:52.743999+0000","last_became_active":"2024-04-26T12:05:03.788050+0000","last_became_peered":"2024-04-26T12:05:03.788050+0000","last_unstale":"2024-04-26T12:08:52.743999+0000","last_undegraded":"2024-04-26T12:08:52.743999+0000","last_fullsized":"2024-04-26T12:08:52.743999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23772,"num_write":390,"num_write_kb":67944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"60'447","reported_seq":526,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743819+0000","last_change":"2024-04-26T12:08:40.707153+0000","last_active":"2024-04-26T12:08:52.743819+0000","last_peered":"2024-04-26T12:08:52.743819+0000","last_clean":"2024-04-26T12:08:52.743819+0000","last_became_active":"2024-04-26T12:08:40.703880+0000","last_became_peered":"2024-04-26T12:08:40.703880+0000","last_unstale":"2024-04-26T12:08:52.743819+0000","last_undegraded":"2024-04-26T12:08:52.743819+0000","last_fullsized":"2024-04-26T12:08:52.743819+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:25.187022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9403,"num_write":417,"num_write_kb":67425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"60'417","reported_seq":507,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744515+0000","last_change":"2024-04-26T12:08:42.717934+0000","last_active":"2024-04-26T12:08:52.744515+0000","last_peered":"2024-04-26T12:08:52.744515+0000","last_clean":"2024-04-26T12:08:52.744515+0000","last_became_active":"2024-04-26T12:08:42.715812+0000","last_became_peered":"2024-04-26T12:08:42.715812+0000","last_unstale":"2024-04-26T12:08:52.744515+0000","last_undegraded":"2024-04-26T12:08:52.744515+0000","last_fullsized":"2024-04-26T12:08:52.744515+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:09.442852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20466,"num_write":400,"num_write_kb":42225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"60'475","reported_seq":604,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744858+0000","last_change":"2024-04-26T12:05:03.787909+0000","last_active":"2024-04-26T12:08:52.744858+0000","last_peered":"2024-04-26T12:08:52.744858+0000","last_clean":"2024-04-26T12:08:52.744858+0000","last_became_active":"2024-04-26T12:05:03.787562+0000","last_became_peered":"2024-04-26T12:05:03.787562+0000","last_unstale":"2024-04-26T12:08:52.744858+0000","last_undegraded":"2024-04-26T12:08:52.744858+0000","last_fullsized":"2024-04-26T12:08:52.744858+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25186,"num_write":431,"num_write_kb":48184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"60'409","reported_seq":894,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.742158+0000","last_change":"2024-04-26T12:08:49.741823+0000","last_active":"2024-04-26T12:08:49.742158+0000","last_peered":"2024-04-26T12:08:49.742158+0000","last_clean":"2024-04-26T12:08:49.742158+0000","last_became_active":"2024-04-26T12:08:49.740497+0000","last_became_peered":"2024-04-26T12:08:49.740497+0000","last_unstale":"2024-04-26T12:08:49.742158+0000","last_undegraded":"2024-04-26T12:08:49.742158+0000","last_fullsized":"2024-04-26T12:08:49.742158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:00.225872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":20137,"num_write":374,"num_write_kb":55441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'392","reported_seq":493,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744357+0000","last_change":"2024-04-26T12:08:47.737270+0000","last_active":"2024-04-26T12:08:52.744357+0000","last_peered":"2024-04-26T12:08:52.744357+0000","last_clean":"2024-04-26T12:08:52.744357+0000","last_became_active":"2024-04-26T12:08:47.735361+0000","last_became_peered":"2024-04-26T12:08:47.735361+0000","last_unstale":"2024-04-26T12:08:52.744357+0000","last_undegraded":"2024-04-26T12:08:52.744357+0000","last_fullsized":"2024-04-26T12:08:52.744357+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:09.838696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29179,"num_write":355,"num_write_kb":59011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'380","reported_seq":840,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744489+0000","last_change":"2024-04-26T12:08:41.717953+0000","last_active":"2024-04-26T12:08:52.744489+0000","last_peered":"2024-04-26T12:08:52.744489+0000","last_clean":"2024-04-26T12:08:52.744489+0000","last_became_active":"2024-04-26T12:08:41.716234+0000","last_became_peered":"2024-04-26T12:08:41.716234+0000","last_unstale":"2024-04-26T12:08:52.744489+0000","last_undegraded":"2024-04-26T12:08:52.744489+0000","last_fullsized":"2024-04-26T12:08:52.744489+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:37.480062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13036,"num_write":347,"num_write_kb":33880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"60'461","reported_seq":565,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744026+0000","last_change":"2024-04-26T12:08:46.732653+0000","last_active":"2024-04-26T12:08:52.744026+0000","last_peered":"2024-04-26T12:08:52.744026+0000","last_clean":"2024-04-26T12:08:52.744026+0000","last_became_active":"2024-04-26T12:08:46.730738+0000","last_became_peered":"2024-04-26T12:08:46.730738+0000","last_unstale":"2024-04-26T12:08:52.744026+0000","last_undegraded":"2024-04-26T12:08:52.744026+0000","last_fullsized":"2024-04-26T12:08:52.744026+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:46.177056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":32945,"num_write":426,"num_write_kb":63234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"60'411","reported_seq":901,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744088+0000","last_change":"2024-04-26T12:08:40.704958+0000","last_active":"2024-04-26T12:08:52.744088+0000","last_peered":"2024-04-26T12:08:52.744088+0000","last_clean":"2024-04-26T12:08:52.744088+0000","last_became_active":"2024-04-26T12:08:40.703845+0000","last_became_peered":"2024-04-26T12:08:40.703845+0000","last_unstale":"2024-04-26T12:08:52.744088+0000","last_undegraded":"2024-04-26T12:08:52.744088+0000","last_fullsized":"2024-04-26T12:08:52.744088+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:56.148477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11499,"num_write":377,"num_write_kb":34249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'430","reported_seq":535,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738409+0000","last_change":"2024-04-26T12:05:03.791605+0000","last_active":"2024-04-26T12:08:49.738409+0000","last_peered":"2024-04-26T12:08:49.738409+0000","last_clean":"2024-04-26T12:08:49.738409+0000","last_became_active":"2024-04-26T12:05:03.791251+0000","last_became_peered":"2024-04-26T12:05:03.791251+0000","last_unstale":"2024-04-26T12:08:49.738409+0000","last_undegraded":"2024-04-26T12:08:49.738409+0000","last_fullsized":"2024-04-26T12:08:49.738409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:27.239868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14660,"num_write":404,"num_write_kb":60840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"60'392","reported_seq":500,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744114+0000","last_change":"2024-04-26T12:08:44.723861+0000","last_active":"2024-04-26T12:08:52.744114+0000","last_peered":"2024-04-26T12:08:52.744114+0000","last_clean":"2024-04-26T12:08:52.744114+0000","last_became_active":"2024-04-26T12:08:44.722120+0000","last_became_peered":"2024-04-26T12:08:44.722120+0000","last_unstale":"2024-04-26T12:08:52.744114+0000","last_undegraded":"2024-04-26T12:08:52.744114+0000","last_fullsized":"2024-04-26T12:08:52.744114+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:12.810713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31703,"num_write":351,"num_write_kb":59324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"59'514","reported_seq":589,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738822+0000","last_change":"2024-04-26T12:05:03.430021+0000","last_active":"2024-04-26T12:08:49.738822+0000","last_peered":"2024-04-26T12:08:49.738822+0000","last_clean":"2024-04-26T12:08:49.738822+0000","last_became_active":"2024-04-26T12:05:03.429695+0000","last_became_peered":"2024-04-26T12:05:03.429695+0000","last_unstale":"2024-04-26T12:08:49.738822+0000","last_undegraded":"2024-04-26T12:08:49.738822+0000","last_fullsized":"2024-04-26T12:08:49.738822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":8377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'432","reported_seq":522,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.751086+0000","last_change":"2024-04-26T12:08:53.751086+0000","last_active":"2024-04-26T12:08:53.751086+0000","last_peered":"2024-04-26T12:08:53.751086+0000","last_clean":"2024-04-26T12:08:53.751086+0000","last_became_active":"2024-04-26T12:08:53.748972+0000","last_became_peered":"2024-04-26T12:08:53.748972+0000","last_unstale":"2024-04-26T12:08:53.751086+0000","last_undegraded":"2024-04-26T12:08:53.751086+0000","last_fullsized":"2024-04-26T12:08:53.751086+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:34.448806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":30094,"num_write":388,"num_write_kb":83741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"59'55","reported_seq":133,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744325+0000","last_change":"2024-04-26T12:05:03.428605+0000","last_active":"2024-04-26T12:08:52.744325+0000","last_peered":"2024-04-26T12:08:52.744325+0000","last_clean":"2024-04-26T12:08:52.744325+0000","last_became_active":"2024-04-26T12:05:03.428098+0000","last_became_peered":"2024-04-26T12:05:03.428098+0000","last_unstale":"2024-04-26T12:08:52.744325+0000","last_undegraded":"2024-04-26T12:08:52.744325+0000","last_fullsized":"2024-04-26T12:08:52.744325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"60'445","reported_seq":557,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744955+0000","last_change":"2024-04-26T12:05:03.788568+0000","last_active":"2024-04-26T12:08:52.744955+0000","last_peered":"2024-04-26T12:08:52.744955+0000","last_clean":"2024-04-26T12:08:52.744955+0000","last_became_active":"2024-04-26T12:05:03.788039+0000","last_became_peered":"2024-04-26T12:05:03.788039+0000","last_unstale":"2024-04-26T12:08:52.744955+0000","last_undegraded":"2024-04-26T12:08:52.744955+0000","last_fullsized":"2024-04-26T12:08:52.744955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":16079,"num_write":410,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"59'64","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743891+0000","last_change":"2024-04-26T12:08:36.696166+0000","last_active":"2024-04-26T12:08:52.743891+0000","last_peered":"2024-04-26T12:08:52.743891+0000","last_clean":"2024-04-26T12:08:52.743891+0000","last_became_active":"2024-04-26T12:08:36.694921+0000","last_became_peered":"2024-04-26T12:08:36.694921+0000","last_unstale":"2024-04-26T12:08:52.743891+0000","last_undegraded":"2024-04-26T12:08:52.743891+0000","last_fullsized":"2024-04-26T12:08:52.743891+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:57.438892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"60'420","reported_seq":537,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744759+0000","last_change":"2024-04-26T12:05:03.788505+0000","last_active":"2024-04-26T12:08:52.744759+0000","last_peered":"2024-04-26T12:08:52.744759+0000","last_clean":"2024-04-26T12:08:52.744759+0000","last_became_active":"2024-04-26T12:05:03.788184+0000","last_became_peered":"2024-04-26T12:05:03.788184+0000","last_unstale":"2024-04-26T12:08:52.744759+0000","last_undegraded":"2024-04-26T12:08:52.744759+0000","last_fullsized":"2024-04-26T12:08:52.744759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":14666,"num_write":383,"num_write_kb":83769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"60'63","reported_seq":152,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738422+0000","last_change":"2024-04-26T12:08:36.697126+0000","last_active":"2024-04-26T12:08:49.738422+0000","last_peered":"2024-04-26T12:08:49.738422+0000","last_clean":"2024-04-26T12:08:49.738422+0000","last_became_active":"2024-04-26T12:08:36.696792+0000","last_became_peered":"2024-04-26T12:08:36.696792+0000","last_unstale":"2024-04-26T12:08:49.738422+0000","last_undegraded":"2024-04-26T12:08:49.738422+0000","last_fullsized":"2024-04-26T12:08:49.738422+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:48.447882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"59'232","reported_seq":332,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.739348+0000","last_change":"2024-04-26T12:08:39.703810+0000","last_active":"2024-04-26T12:08:49.739348+0000","last_peered":"2024-04-26T12:08:49.739348+0000","last_clean":"2024-04-26T12:08:49.739348+0000","last_became_active":"2024-04-26T12:08:39.703455+0000","last_became_peered":"2024-04-26T12:08:39.703455+0000","last_unstale":"2024-04-26T12:08:49.739348+0000","last_undegraded":"2024-04-26T12:08:49.739348+0000","last_fullsized":"2024-04-26T12:08:49.739348+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:08.399237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'408","reported_seq":491,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743999+0000","last_change":"2024-04-26T12:08:40.710236+0000","last_active":"2024-04-26T12:08:52.743999+0000","last_peered":"2024-04-26T12:08:52.743999+0000","last_clean":"2024-04-26T12:08:52.743999+0000","last_became_active":"2024-04-26T12:08:40.707357+0000","last_became_peered":"2024-04-26T12:08:40.707357+0000","last_unstale":"2024-04-26T12:08:52.743999+0000","last_undegraded":"2024-04-26T12:08:52.743999+0000","last_fullsized":"2024-04-26T12:08:52.743999+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:17.928748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12418,"num_write":371,"num_write_kb":58378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"59'302","reported_seq":370,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744280+0000","last_change":"2024-04-26T12:08:39.703949+0000","last_active":"2024-04-26T12:08:52.744280+0000","last_peered":"2024-04-26T12:08:52.744280+0000","last_clean":"2024-04-26T12:08:52.744280+0000","last_became_active":"2024-04-26T12:08:39.703421+0000","last_became_peered":"2024-04-26T12:08:39.703421+0000","last_unstale":"2024-04-26T12:08:52.744280+0000","last_undegraded":"2024-04-26T12:08:52.744280+0000","last_fullsized":"2024-04-26T12:08:52.744280+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:10.222074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":4228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'439","reported_seq":498,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743713+0000","last_change":"2024-04-26T12:08:41.717923+0000","last_active":"2024-04-26T12:08:52.743713+0000","last_peered":"2024-04-26T12:08:52.743713+0000","last_clean":"2024-04-26T12:08:52.743713+0000","last_became_active":"2024-04-26T12:08:41.715708+0000","last_became_peered":"2024-04-26T12:08:41.715708+0000","last_unstale":"2024-04-26T12:08:52.743713+0000","last_undegraded":"2024-04-26T12:08:52.743713+0000","last_fullsized":"2024-04-26T12:08:52.743713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:23.646558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":30851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"59'589","reported_seq":689,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.740000+0000","last_change":"2024-04-26T12:08:39.703966+0000","last_active":"2024-04-26T12:08:49.740000+0000","last_peered":"2024-04-26T12:08:49.740000+0000","last_clean":"2024-04-26T12:08:49.740000+0000","last_became_active":"2024-04-26T12:08:39.703487+0000","last_became_peered":"2024-04-26T12:08:39.703487+0000","last_unstale":"2024-04-26T12:08:49.740000+0000","last_undegraded":"2024-04-26T12:08:49.740000+0000","last_fullsized":"2024-04-26T12:08:49.740000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:06.112476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":534,"num_write_kb":4333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'461","reported_seq":611,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738575+0000","last_change":"2024-04-26T12:05:03.791809+0000","last_active":"2024-04-26T12:08:49.738575+0000","last_peered":"2024-04-26T12:08:49.738575+0000","last_clean":"2024-04-26T12:08:49.738575+0000","last_became_active":"2024-04-26T12:05:03.791272+0000","last_became_peered":"2024-04-26T12:05:03.791272+0000","last_unstale":"2024-04-26T12:08:49.738575+0000","last_undegraded":"2024-04-26T12:08:49.738575+0000","last_fullsized":"2024-04-26T12:08:49.738575+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":46123,"num_write":422,"num_write_kb":104552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'66","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.739078+0000","last_change":"2024-04-26T12:05:03.430224+0000","last_active":"2024-04-26T12:08:49.739078+0000","last_peered":"2024-04-26T12:08:49.739078+0000","last_clean":"2024-04-26T12:08:49.739078+0000","last_became_active":"2024-04-26T12:05:03.429291+0000","last_became_peered":"2024-04-26T12:05:03.429291+0000","last_unstale":"2024-04-26T12:08:49.739078+0000","last_undegraded":"2024-04-26T12:08:49.739078+0000","last_fullsized":"2024-04-26T12:08:49.739078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'428","reported_seq":541,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744404+0000","last_change":"2024-04-26T12:05:03.788174+0000","last_active":"2024-04-26T12:08:52.744404+0000","last_peered":"2024-04-26T12:08:52.744404+0000","last_clean":"2024-04-26T12:08:52.744404+0000","last_became_active":"2024-04-26T12:05:03.787772+0000","last_became_peered":"2024-04-26T12:05:03.787772+0000","last_unstale":"2024-04-26T12:08:52.744404+0000","last_undegraded":"2024-04-26T12:08:52.744404+0000","last_fullsized":"2024-04-26T12:08:52.744404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15098,"num_write":394,"num_write_kb":42677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"59'195","reported_seq":273,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744598+0000","last_change":"2024-04-26T12:05:03.431162+0000","last_active":"2024-04-26T12:08:52.744598+0000","last_peered":"2024-04-26T12:08:52.744598+0000","last_clean":"2024-04-26T12:08:52.744598+0000","last_became_active":"2024-04-26T12:05:03.430855+0000","last_became_peered":"2024-04-26T12:05:03.430855+0000","last_unstale":"2024-04-26T12:08:52.744598+0000","last_undegraded":"2024-04-26T12:08:52.744598+0000","last_fullsized":"2024-04-26T12:08:52.744598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:41.279426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"60'448","reported_seq":541,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738848+0000","last_change":"2024-04-26T12:05:03.792357+0000","last_active":"2024-04-26T12:08:49.738848+0000","last_peered":"2024-04-26T12:08:49.738848+0000","last_clean":"2024-04-26T12:08:49.738848+0000","last_became_active":"2024-04-26T12:05:03.792119+0000","last_became_peered":"2024-04-26T12:05:03.792119+0000","last_unstale":"2024-04-26T12:08:49.738848+0000","last_undegraded":"2024-04-26T12:08:49.738848+0000","last_fullsized":"2024-04-26T12:08:49.738848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":13281,"num_write":420,"num_write_kb":59540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"59'171","reported_seq":246,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738679+0000","last_change":"2024-04-26T12:05:03.429811+0000","last_active":"2024-04-26T12:08:49.738679+0000","last_peered":"2024-04-26T12:08:49.738679+0000","last_clean":"2024-04-26T12:08:49.738679+0000","last_became_active":"2024-04-26T12:05:03.429469+0000","last_became_peered":"2024-04-26T12:05:03.429469+0000","last_unstale":"2024-04-26T12:08:49.738679+0000","last_undegraded":"2024-04-26T12:08:49.738679+0000","last_fullsized":"2024-04-26T12:08:49.738679+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'412","reported_seq":913,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T12:08:50.747426+0000","last_change":"2024-04-26T12:08:50.747568+0000","last_active":"2024-04-26T12:08:50.747426+0000","last_peered":"2024-04-26T12:08:50.088420+0000","last_clean":"2024-04-26T12:06:10.951300+0000","last_became_active":"2024-04-26T12:08:37.788823+0000","last_became_peered":"2024-04-26T12:08:37.788823+0000","last_unstale":"2024-04-26T12:08:50.747426+0000","last_undegraded":"2024-04-26T12:08:50.747426+0000","last_fullsized":"2024-04-26T12:08:50.747426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:19.948638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26310,"num_write":380,"num_write_kb":38462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"59'55","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743708+0000","last_change":"2024-04-26T12:08:36.695355+0000","last_active":"2024-04-26T12:08:52.743708+0000","last_peered":"2024-04-26T12:08:52.743708+0000","last_clean":"2024-04-26T12:08:52.743708+0000","last_became_active":"2024-04-26T12:08:36.694346+0000","last_became_peered":"2024-04-26T12:08:36.694346+0000","last_unstale":"2024-04-26T12:08:52.743708+0000","last_undegraded":"2024-04-26T12:08:52.743708+0000","last_fullsized":"2024-04-26T12:08:52.743708+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:42.458073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"60'362","reported_seq":814,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.739189+0000","last_change":"2024-04-26T12:08:41.717048+0000","last_active":"2024-04-26T12:08:49.739189+0000","last_peered":"2024-04-26T12:08:49.739189+0000","last_clean":"2024-04-26T12:08:49.739189+0000","last_became_active":"2024-04-26T12:08:41.716102+0000","last_became_peered":"2024-04-26T12:08:41.716102+0000","last_unstale":"2024-04-26T12:08:49.739189+0000","last_undegraded":"2024-04-26T12:08:49.739189+0000","last_fullsized":"2024-04-26T12:08:49.739189+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:52.409548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21408,"num_write":333,"num_write_kb":66549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"59'378","reported_seq":439,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743919+0000","last_change":"2024-04-26T12:08:39.702797+0000","last_active":"2024-04-26T12:08:52.743919+0000","last_peered":"2024-04-26T12:08:52.743919+0000","last_clean":"2024-04-26T12:08:52.743919+0000","last_became_active":"2024-04-26T12:08:39.702438+0000","last_became_peered":"2024-04-26T12:08:39.702438+0000","last_unstale":"2024-04-26T12:08:52.743919+0000","last_undegraded":"2024-04-26T12:08:52.743919+0000","last_fullsized":"2024-04-26T12:08:52.743919+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:06.278304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"60'407","reported_seq":917,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744823+0000","last_change":"2024-04-26T12:08:45.724853+0000","last_active":"2024-04-26T12:08:52.744823+0000","last_peered":"2024-04-26T12:08:52.744823+0000","last_clean":"2024-04-26T12:08:52.744823+0000","last_became_active":"2024-04-26T12:08:45.723772+0000","last_became_peered":"2024-04-26T12:08:45.723772+0000","last_unstale":"2024-04-26T12:08:52.744823+0000","last_undegraded":"2024-04-26T12:08:52.744823+0000","last_fullsized":"2024-04-26T12:08:52.744823+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:41.814840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":40156,"num_write":373,"num_write_kb":91285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":290,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738618+0000","last_change":"2024-04-26T12:08:36.697892+0000","last_active":"2024-04-26T12:08:49.738618+0000","last_peered":"2024-04-26T12:08:49.738618+0000","last_clean":"2024-04-26T12:08:49.738618+0000","last_became_active":"2024-04-26T12:08:36.697508+0000","last_became_peered":"2024-04-26T12:08:36.697508+0000","last_unstale":"2024-04-26T12:08:49.738618+0000","last_undegraded":"2024-04-26T12:08:49.738618+0000","last_fullsized":"2024-04-26T12:08:49.738618+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_clean_scrub_stamp":"2024-04-26T12:04:52.376986+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:24.384180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738932+0000","last_change":"2024-04-26T12:04:59.403711+0000","last_active":"2024-04-26T12:08:49.738932+0000","last_peered":"2024-04-26T12:08:49.738932+0000","last_clean":"2024-04-26T12:08:49.738932+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:08:49.738932+0000","last_undegraded":"2024-04-26T12:08:49.738932+0000","last_fullsized":"2024-04-26T12:08:49.738932+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:45.779614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'793","reported_seq":897,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744445+0000","last_change":"2024-04-26T12:08:39.702225+0000","last_active":"2024-04-26T12:08:52.744445+0000","last_peered":"2024-04-26T12:08:52.744445+0000","last_clean":"2024-04-26T12:08:52.744445+0000","last_became_active":"2024-04-26T12:08:39.701760+0000","last_became_peered":"2024-04-26T12:08:39.701760+0000","last_unstale":"2024-04-26T12:08:52.744445+0000","last_undegraded":"2024-04-26T12:08:52.744445+0000","last_fullsized":"2024-04-26T12:08:52.744445+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:51.405891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":8533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"60'466","reported_seq":1001,"reported_epoch":81,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:08:51.035028+0000","last_change":"2024-04-26T12:08:51.035197+0000","last_active":"2024-04-26T12:08:51.035028+0000","last_peered":"2024-04-26T12:08:51.035028+0000","last_clean":"2024-04-26T12:06:10.951310+0000","last_became_active":"2024-04-26T12:08:37.789711+0000","last_became_peered":"2024-04-26T12:08:37.789711+0000","last_unstale":"2024-04-26T12:08:51.035028+0000","last_undegraded":"2024-04-26T12:08:51.035028+0000","last_fullsized":"2024-04-26T12:08:37.701265+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:51.630703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":37547,"num_write":422,"num_write_kb":96579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738535+0000","last_change":"2024-04-26T12:08:36.695759+0000","last_active":"2024-04-26T12:08:49.738535+0000","last_peered":"2024-04-26T12:08:49.738535+0000","last_clean":"2024-04-26T12:08:49.738535+0000","last_became_active":"2024-04-26T12:08:36.695444+0000","last_became_peered":"2024-04-26T12:08:36.695444+0000","last_unstale":"2024-04-26T12:08:49.738535+0000","last_undegraded":"2024-04-26T12:08:49.738535+0000","last_fullsized":"2024-04-26T12:08:49.738535+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:22.343369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"60'114","reported_seq":239,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744279+0000","last_change":"2024-04-26T12:05:03.428547+0000","last_active":"2024-04-26T12:08:52.744279+0000","last_peered":"2024-04-26T12:08:52.744279+0000","last_clean":"2024-04-26T12:08:52.744279+0000","last_became_active":"2024-04-26T12:05:03.427985+0000","last_became_peered":"2024-04-26T12:05:03.427985+0000","last_unstale":"2024-04-26T12:08:52.744279+0000","last_undegraded":"2024-04-26T12:08:52.744279+0000","last_fullsized":"2024-04-26T12:08:52.744279+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:19.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466015,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":47,"num_write_kb":1464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"60'492","reported_seq":655,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744496+0000","last_change":"2024-04-26T12:08:49.741650+0000","last_active":"2024-04-26T12:08:52.744496+0000","last_peered":"2024-04-26T12:08:52.744496+0000","last_clean":"2024-04-26T12:08:52.744496+0000","last_became_active":"2024-04-26T12:08:49.739496+0000","last_became_peered":"2024-04-26T12:08:49.739496+0000","last_unstale":"2024-04-26T12:08:52.744496+0000","last_undegraded":"2024-04-26T12:08:52.744496+0000","last_fullsized":"2024-04-26T12:08:52.744496+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:55.361224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":63988,"num_write":466,"num_write_kb":154489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744369+0000","last_change":"2024-04-26T12:08:36.696858+0000","last_active":"2024-04-26T12:08:52.744369+0000","last_peered":"2024-04-26T12:08:52.744369+0000","last_clean":"2024-04-26T12:08:52.744369+0000","last_became_active":"2024-04-26T12:08:36.696619+0000","last_became_peered":"2024-04-26T12:08:36.696619+0000","last_unstale":"2024-04-26T12:08:52.744369+0000","last_undegraded":"2024-04-26T12:08:52.744369+0000","last_fullsized":"2024-04-26T12:08:52.744369+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:47.292926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"59'325","reported_seq":386,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743649+0000","last_change":"2024-04-26T12:08:39.704052+0000","last_active":"2024-04-26T12:08:52.743649+0000","last_peered":"2024-04-26T12:08:52.743649+0000","last_clean":"2024-04-26T12:08:52.743649+0000","last_became_active":"2024-04-26T12:08:39.703696+0000","last_became_peered":"2024-04-26T12:08:39.703696+0000","last_unstale":"2024-04-26T12:08:52.743649+0000","last_undegraded":"2024-04-26T12:08:52.743649+0000","last_fullsized":"2024-04-26T12:08:52.743649+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:21:44.069244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":8296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"60'359","reported_seq":785,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744857+0000","last_change":"2024-04-26T12:08:47.737443+0000","last_active":"2024-04-26T12:08:52.744857+0000","last_peered":"2024-04-26T12:08:52.744857+0000","last_clean":"2024-04-26T12:08:52.744857+0000","last_became_active":"2024-04-26T12:08:47.735729+0000","last_became_peered":"2024-04-26T12:08:47.735729+0000","last_unstale":"2024-04-26T12:08:52.744857+0000","last_undegraded":"2024-04-26T12:08:52.744857+0000","last_fullsized":"2024-04-26T12:08:52.744857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:57:20.726677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9448,"num_write":336,"num_write_kb":74900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738785+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:08:49.738785+0000","last_peered":"2024-04-26T12:08:49.738785+0000","last_clean":"2024-04-26T12:08:49.738785+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:08:49.738785+0000","last_undegraded":"2024-04-26T12:08:49.738785+0000","last_fullsized":"2024-04-26T12:08:49.738785+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:12.939539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"59'67","reported_seq":142,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738883+0000","last_change":"2024-04-26T12:05:03.430140+0000","last_active":"2024-04-26T12:08:49.738883+0000","last_peered":"2024-04-26T12:08:49.738883+0000","last_clean":"2024-04-26T12:08:49.738883+0000","last_became_active":"2024-04-26T12:05:03.429838+0000","last_became_peered":"2024-04-26T12:05:03.429838+0000","last_unstale":"2024-04-26T12:08:49.738883+0000","last_undegraded":"2024-04-26T12:08:49.738883+0000","last_fullsized":"2024-04-26T12:08:49.738883+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"60'403","reported_seq":894,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744652+0000","last_change":"2024-04-26T12:08:50.753437+0000","last_active":"2024-04-26T12:08:52.744652+0000","last_peered":"2024-04-26T12:08:52.744652+0000","last_clean":"2024-04-26T12:08:52.744652+0000","last_became_active":"2024-04-26T12:08:50.752366+0000","last_became_peered":"2024-04-26T12:08:50.752366+0000","last_unstale":"2024-04-26T12:08:52.744652+0000","last_undegraded":"2024-04-26T12:08:52.744652+0000","last_fullsized":"2024-04-26T12:08:52.744652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:02.999757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30094,"num_write":370,"num_write_kb":104181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"59'469","reported_seq":544,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.740057+0000","last_change":"2024-04-26T12:05:03.429673+0000","last_active":"2024-04-26T12:08:49.740057+0000","last_peered":"2024-04-26T12:08:49.740057+0000","last_clean":"2024-04-26T12:08:49.740057+0000","last_became_active":"2024-04-26T12:05:03.429146+0000","last_became_peered":"2024-04-26T12:05:03.429146+0000","last_unstale":"2024-04-26T12:08:49.740057+0000","last_undegraded":"2024-04-26T12:08:49.740057+0000","last_fullsized":"2024-04-26T12:08:49.740057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744743+0000","last_change":"2024-04-26T12:08:36.697900+0000","last_active":"2024-04-26T12:08:52.744743+0000","last_peered":"2024-04-26T12:08:52.744743+0000","last_clean":"2024-04-26T12:08:52.744743+0000","last_became_active":"2024-04-26T12:08:36.697618+0000","last_became_peered":"2024-04-26T12:08:36.697618+0000","last_unstale":"2024-04-26T12:08:52.744743+0000","last_undegraded":"2024-04-26T12:08:52.744743+0000","last_fullsized":"2024-04-26T12:08:52.744743+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:16.620901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'354","reported_seq":413,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744055+0000","last_change":"2024-04-26T12:08:45.725751+0000","last_active":"2024-04-26T12:08:52.744055+0000","last_peered":"2024-04-26T12:08:52.744055+0000","last_clean":"2024-04-26T12:08:52.744055+0000","last_became_active":"2024-04-26T12:08:45.724153+0000","last_became_peered":"2024-04-26T12:08:45.724153+0000","last_unstale":"2024-04-26T12:08:52.744055+0000","last_undegraded":"2024-04-26T12:08:52.744055+0000","last_fullsized":"2024-04-26T12:08:52.744055+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:57.798803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":416,"num_write":319,"num_write_kb":17259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"59'53","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744703+0000","last_change":"2024-04-26T12:08:36.698122+0000","last_active":"2024-04-26T12:08:52.744703+0000","last_peered":"2024-04-26T12:08:52.744703+0000","last_clean":"2024-04-26T12:08:52.744703+0000","last_became_active":"2024-04-26T12:08:36.697832+0000","last_became_peered":"2024-04-26T12:08:36.697832+0000","last_unstale":"2024-04-26T12:08:52.744703+0000","last_undegraded":"2024-04-26T12:08:52.744703+0000","last_fullsized":"2024-04-26T12:08:52.744703+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:34.416168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744650+0000","last_change":"2024-04-26T12:08:36.698131+0000","last_active":"2024-04-26T12:08:52.744650+0000","last_peered":"2024-04-26T12:08:52.744650+0000","last_clean":"2024-04-26T12:08:52.744650+0000","last_became_active":"2024-04-26T12:08:36.697698+0000","last_became_peered":"2024-04-26T12:08:36.697698+0000","last_unstale":"2024-04-26T12:08:52.744650+0000","last_undegraded":"2024-04-26T12:08:52.744650+0000","last_fullsized":"2024-04-26T12:08:52.744650+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:15.476036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'399","reported_seq":477,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743860+0000","last_change":"2024-04-26T12:08:40.705752+0000","last_active":"2024-04-26T12:08:52.743860+0000","last_peered":"2024-04-26T12:08:52.743860+0000","last_clean":"2024-04-26T12:08:52.743860+0000","last_became_active":"2024-04-26T12:08:40.703906+0000","last_became_peered":"2024-04-26T12:08:40.703906+0000","last_unstale":"2024-04-26T12:08:52.743860+0000","last_undegraded":"2024-04-26T12:08:52.743860+0000","last_fullsized":"2024-04-26T12:08:52.743860+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:19.004074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11720,"num_write":363,"num_write_kb":66914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"59'65","reported_seq":157,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745130+0000","last_change":"2024-04-26T12:08:36.699388+0000","last_active":"2024-04-26T12:08:52.745130+0000","last_peered":"2024-04-26T12:08:52.745130+0000","last_clean":"2024-04-26T12:08:52.745130+0000","last_became_active":"2024-04-26T12:08:36.699058+0000","last_became_peered":"2024-04-26T12:08:36.699058+0000","last_unstale":"2024-04-26T12:08:52.745130+0000","last_undegraded":"2024-04-26T12:08:52.745130+0000","last_fullsized":"2024-04-26T12:08:52.745130+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:11.978288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745047+0000","last_change":"2024-04-26T12:08:36.697618+0000","last_active":"2024-04-26T12:08:52.745047+0000","last_peered":"2024-04-26T12:08:52.745047+0000","last_clean":"2024-04-26T12:08:52.745047+0000","last_became_active":"2024-04-26T12:08:36.697407+0000","last_became_peered":"2024-04-26T12:08:36.697407+0000","last_unstale":"2024-04-26T12:08:52.745047+0000","last_undegraded":"2024-04-26T12:08:52.745047+0000","last_fullsized":"2024-04-26T12:08:52.745047+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:02.301767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'424","reported_seq":541,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744097+0000","last_change":"2024-04-26T12:05:03.789623+0000","last_active":"2024-04-26T12:08:52.744097+0000","last_peered":"2024-04-26T12:08:52.744097+0000","last_clean":"2024-04-26T12:08:52.744097+0000","last_became_active":"2024-04-26T12:05:03.789390+0000","last_became_peered":"2024-04-26T12:05:03.789390+0000","last_unstale":"2024-04-26T12:08:52.744097+0000","last_undegraded":"2024-04-26T12:08:52.744097+0000","last_fullsized":"2024-04-26T12:08:52.744097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17027,"num_write":386,"num_write_kb":58797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"61'70","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745116+0000","last_change":"2024-04-26T12:05:03.429222+0000","last_active":"2024-04-26T12:08:52.745116+0000","last_peered":"2024-04-26T12:08:52.745116+0000","last_clean":"2024-04-26T12:08:52.745116+0000","last_became_active":"2024-04-26T12:05:03.428803+0000","last_became_peered":"2024-04-26T12:05:03.428803+0000","last_unstale":"2024-04-26T12:08:52.745116+0000","last_undegraded":"2024-04-26T12:08:52.745116+0000","last_fullsized":"2024-04-26T12:08:52.745116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:31.305644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.739383+0000","last_change":"2024-04-26T12:08:36.698775+0000","last_active":"2024-04-26T12:08:49.739383+0000","last_peered":"2024-04-26T12:08:49.739383+0000","last_clean":"2024-04-26T12:08:49.739383+0000","last_became_active":"2024-04-26T12:08:36.698523+0000","last_became_peered":"2024-04-26T12:08:36.698523+0000","last_unstale":"2024-04-26T12:08:49.739383+0000","last_undegraded":"2024-04-26T12:08:49.739383+0000","last_fullsized":"2024-04-26T12:08:49.739383+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:16.620901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'393","reported_seq":472,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744009+0000","last_change":"2024-04-26T12:08:40.705662+0000","last_active":"2024-04-26T12:08:52.744009+0000","last_peered":"2024-04-26T12:08:52.744009+0000","last_clean":"2024-04-26T12:08:52.744009+0000","last_became_active":"2024-04-26T12:08:40.703873+0000","last_became_peered":"2024-04-26T12:08:40.703873+0000","last_unstale":"2024-04-26T12:08:52.744009+0000","last_undegraded":"2024-04-26T12:08:52.744009+0000","last_fullsized":"2024-04-26T12:08:52.744009+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:27.057123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":11991,"num_write":357,"num_write_kb":83226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'419","reported_seq":889,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738683+0000","last_change":"2024-04-26T12:08:44.723692+0000","last_active":"2024-04-26T12:08:49.738683+0000","last_peered":"2024-04-26T12:08:49.738683+0000","last_clean":"2024-04-26T12:08:49.738683+0000","last_became_active":"2024-04-26T12:08:44.722574+0000","last_became_peered":"2024-04-26T12:08:44.722574+0000","last_unstale":"2024-04-26T12:08:49.738683+0000","last_undegraded":"2024-04-26T12:08:49.738683+0000","last_fullsized":"2024-04-26T12:08:49.738683+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:01.256055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14983,"num_write":376,"num_write_kb":76749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"61'398","reported_seq":504,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738958+0000","last_change":"2024-04-26T12:08:39.703851+0000","last_active":"2024-04-26T12:08:49.738958+0000","last_peered":"2024-04-26T12:08:49.738958+0000","last_clean":"2024-04-26T12:08:49.738958+0000","last_became_active":"2024-04-26T12:08:39.703516+0000","last_became_peered":"2024-04-26T12:08:39.703516+0000","last_unstale":"2024-04-26T12:08:49.738958+0000","last_undegraded":"2024-04-26T12:08:49.738958+0000","last_fullsized":"2024-04-26T12:08:49.738958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:10.227718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699266,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":9692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9692849,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'428","reported_seq":940,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744179+0000","last_change":"2024-04-26T12:08:50.753473+0000","last_active":"2024-04-26T12:08:52.744179+0000","last_peered":"2024-04-26T12:08:52.744179+0000","last_clean":"2024-04-26T12:08:52.744179+0000","last_became_active":"2024-04-26T12:08:50.752328+0000","last_became_peered":"2024-04-26T12:08:50.752328+0000","last_unstale":"2024-04-26T12:08:52.744179+0000","last_undegraded":"2024-04-26T12:08:52.744179+0000","last_fullsized":"2024-04-26T12:08:52.744179+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:08.396108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":26594,"num_write":396,"num_write_kb":67932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"60'91","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744409+0000","last_change":"2024-04-26T12:08:36.722607+0000","last_active":"2024-04-26T12:08:52.744409+0000","last_peered":"2024-04-26T12:08:52.744409+0000","last_clean":"2024-04-26T12:08:52.744409+0000","last_became_active":"2024-04-26T12:08:36.697650+0000","last_became_peered":"2024-04-26T12:08:36.697650+0000","last_unstale":"2024-04-26T12:08:52.744409+0000","last_undegraded":"2024-04-26T12:08:52.744409+0000","last_fullsized":"2024-04-26T12:08:52.744409+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:10.718101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"59'316","reported_seq":391,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.739311+0000","last_change":"2024-04-26T12:05:03.429257+0000","last_active":"2024-04-26T12:08:49.739311+0000","last_peered":"2024-04-26T12:08:49.739311+0000","last_clean":"2024-04-26T12:08:49.739311+0000","last_became_active":"2024-04-26T12:05:03.428921+0000","last_became_peered":"2024-04-26T12:05:03.428921+0000","last_unstale":"2024-04-26T12:08:49.739311+0000","last_undegraded":"2024-04-26T12:08:49.739311+0000","last_fullsized":"2024-04-26T12:08:49.739311+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:49.774845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'495","reported_seq":625,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744089+0000","last_change":"2024-04-26T12:05:03.788141+0000","last_active":"2024-04-26T12:08:52.744089+0000","last_peered":"2024-04-26T12:08:52.744089+0000","last_clean":"2024-04-26T12:08:52.744089+0000","last_became_active":"2024-04-26T12:05:03.787533+0000","last_became_peered":"2024-04-26T12:05:03.787533+0000","last_unstale":"2024-04-26T12:08:52.744089+0000","last_undegraded":"2024-04-26T12:08:52.744089+0000","last_fullsized":"2024-04-26T12:08:52.744089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37174,"num_write":458,"num_write_kb":125832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'51","reported_seq":129,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745033+0000","last_change":"2024-04-26T12:05:03.428971+0000","last_active":"2024-04-26T12:08:52.745033+0000","last_peered":"2024-04-26T12:08:52.745033+0000","last_clean":"2024-04-26T12:08:52.745033+0000","last_became_active":"2024-04-26T12:05:03.428445+0000","last_became_peered":"2024-04-26T12:05:03.428445+0000","last_unstale":"2024-04-26T12:08:52.745033+0000","last_undegraded":"2024-04-26T12:08:52.745033+0000","last_fullsized":"2024-04-26T12:08:52.745033+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'482","reported_seq":1130,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744097+0000","last_change":"2024-04-26T12:08:48.741589+0000","last_active":"2024-04-26T12:08:52.744097+0000","last_peered":"2024-04-26T12:08:52.744097+0000","last_clean":"2024-04-26T12:08:52.744097+0000","last_became_active":"2024-04-26T12:08:48.740055+0000","last_became_peered":"2024-04-26T12:08:48.740055+0000","last_unstale":"2024-04-26T12:08:52.744097+0000","last_undegraded":"2024-04-26T12:08:52.744097+0000","last_fullsized":"2024-04-26T12:08:52.744097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:03.903516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":61972,"num_write":459,"num_write_kb":125797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"60'392","reported_seq":527,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744471+0000","last_change":"2024-04-26T12:08:43.718939+0000","last_active":"2024-04-26T12:08:52.744471+0000","last_peered":"2024-04-26T12:08:52.744471+0000","last_clean":"2024-04-26T12:08:52.744471+0000","last_became_active":"2024-04-26T12:08:43.717109+0000","last_became_peered":"2024-04-26T12:08:43.717109+0000","last_unstale":"2024-04-26T12:08:52.744471+0000","last_undegraded":"2024-04-26T12:08:52.744471+0000","last_fullsized":"2024-04-26T12:08:52.744471+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:14.846653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":37910,"num_write":366,"num_write_kb":84111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"59'709","reported_seq":813,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744368+0000","last_change":"2024-04-26T12:08:39.701978+0000","last_active":"2024-04-26T12:08:52.744368+0000","last_peered":"2024-04-26T12:08:52.744368+0000","last_clean":"2024-04-26T12:08:52.744368+0000","last_became_active":"2024-04-26T12:08:39.700927+0000","last_became_peered":"2024-04-26T12:08:39.700927+0000","last_unstale":"2024-04-26T12:08:52.744368+0000","last_undegraded":"2024-04-26T12:08:52.744368+0000","last_fullsized":"2024-04-26T12:08:52.744368+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:10.815597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"60'435","reported_seq":572,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744787+0000","last_change":"2024-04-26T12:05:03.788754+0000","last_active":"2024-04-26T12:08:52.744787+0000","last_peered":"2024-04-26T12:08:52.744787+0000","last_clean":"2024-04-26T12:08:52.744787+0000","last_became_active":"2024-04-26T12:05:03.788311+0000","last_became_peered":"2024-04-26T12:05:03.788311+0000","last_unstale":"2024-04-26T12:08:52.744787+0000","last_undegraded":"2024-04-26T12:08:52.744787+0000","last_fullsized":"2024-04-26T12:08:52.744787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":28462,"num_write":403,"num_write_kb":93779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"59'262","reported_seq":340,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744211+0000","last_change":"2024-04-26T12:05:03.428810+0000","last_active":"2024-04-26T12:08:52.744211+0000","last_peered":"2024-04-26T12:08:52.744211+0000","last_clean":"2024-04-26T12:08:52.744211+0000","last_became_active":"2024-04-26T12:05:03.428191+0000","last_became_peered":"2024-04-26T12:05:03.428191+0000","last_unstale":"2024-04-26T12:08:52.744211+0000","last_undegraded":"2024-04-26T12:08:52.744211+0000","last_fullsized":"2024-04-26T12:08:52.744211+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"60'399","reported_seq":499,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744294+0000","last_change":"2024-04-26T12:08:49.742459+0000","last_active":"2024-04-26T12:08:52.744294+0000","last_peered":"2024-04-26T12:08:52.744294+0000","last_clean":"2024-04-26T12:08:52.744294+0000","last_became_active":"2024-04-26T12:08:49.740536+0000","last_became_peered":"2024-04-26T12:08:49.740536+0000","last_unstale":"2024-04-26T12:08:52.744294+0000","last_undegraded":"2024-04-26T12:08:52.744294+0000","last_fullsized":"2024-04-26T12:08:52.744294+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:24.169669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22216,"num_write":357,"num_write_kb":75245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"59'430","reported_seq":490,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743876+0000","last_change":"2024-04-26T12:08:39.703050+0000","last_active":"2024-04-26T12:08:52.743876+0000","last_peered":"2024-04-26T12:08:52.743876+0000","last_clean":"2024-04-26T12:08:52.743876+0000","last_became_active":"2024-04-26T12:08:39.702529+0000","last_became_peered":"2024-04-26T12:08:39.702529+0000","last_unstale":"2024-04-26T12:08:52.743876+0000","last_undegraded":"2024-04-26T12:08:52.743876+0000","last_fullsized":"2024-04-26T12:08:52.743876+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:28.249725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":12514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"60'387","reported_seq":476,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744228+0000","last_change":"2024-04-26T12:08:43.720098+0000","last_active":"2024-04-26T12:08:52.744228+0000","last_peered":"2024-04-26T12:08:52.744228+0000","last_clean":"2024-04-26T12:08:52.744228+0000","last_became_active":"2024-04-26T12:08:43.717442+0000","last_became_peered":"2024-04-26T12:08:43.717442+0000","last_unstale":"2024-04-26T12:08:52.744228+0000","last_undegraded":"2024-04-26T12:08:52.744228+0000","last_fullsized":"2024-04-26T12:08:52.744228+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:13.140334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20720,"num_write":352,"num_write_kb":87643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"59'58","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743900+0000","last_change":"2024-04-26T12:08:36.720540+0000","last_active":"2024-04-26T12:08:52.743900+0000","last_peered":"2024-04-26T12:08:52.743900+0000","last_clean":"2024-04-26T12:08:52.743900+0000","last_became_active":"2024-04-26T12:08:36.693399+0000","last_became_peered":"2024-04-26T12:08:36.693399+0000","last_unstale":"2024-04-26T12:08:52.743900+0000","last_undegraded":"2024-04-26T12:08:52.743900+0000","last_fullsized":"2024-04-26T12:08:52.743900+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:14.949002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"60'356","reported_seq":449,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738659+0000","last_change":"2024-04-26T12:05:03.791986+0000","last_active":"2024-04-26T12:08:49.738659+0000","last_peered":"2024-04-26T12:08:49.738659+0000","last_clean":"2024-04-26T12:08:49.738659+0000","last_became_active":"2024-04-26T12:05:03.790823+0000","last_became_peered":"2024-04-26T12:05:03.790823+0000","last_unstale":"2024-04-26T12:08:49.738659+0000","last_undegraded":"2024-04-26T12:08:49.738659+0000","last_fullsized":"2024-04-26T12:08:49.738659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9641,"num_write":326,"num_write_kb":29574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"59'309","reported_seq":384,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738960+0000","last_change":"2024-04-26T12:05:03.429469+0000","last_active":"2024-04-26T12:08:49.738960+0000","last_peered":"2024-04-26T12:08:49.738960+0000","last_clean":"2024-04-26T12:08:49.738960+0000","last_became_active":"2024-04-26T12:05:03.429015+0000","last_became_peered":"2024-04-26T12:05:03.429015+0000","last_unstale":"2024-04-26T12:08:49.738960+0000","last_undegraded":"2024-04-26T12:08:49.738960+0000","last_fullsized":"2024-04-26T12:08:49.738960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'433","reported_seq":572,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738662+0000","last_change":"2024-04-26T12:05:03.791929+0000","last_active":"2024-04-26T12:08:49.738662+0000","last_peered":"2024-04-26T12:08:49.738662+0000","last_clean":"2024-04-26T12:08:49.738662+0000","last_became_active":"2024-04-26T12:05:03.791540+0000","last_became_peered":"2024-04-26T12:05:03.791540+0000","last_unstale":"2024-04-26T12:08:49.738662+0000","last_undegraded":"2024-04-26T12:08:49.738662+0000","last_fullsized":"2024-04-26T12:08:49.738662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":47864,"num_write":399,"num_write_kb":92193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"59'382","reported_seq":449,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744180+0000","last_change":"2024-04-26T12:08:39.704680+0000","last_active":"2024-04-26T12:08:52.744180+0000","last_peered":"2024-04-26T12:08:52.744180+0000","last_clean":"2024-04-26T12:08:52.744180+0000","last_became_active":"2024-04-26T12:08:39.704404+0000","last_became_peered":"2024-04-26T12:08:39.704404+0000","last_unstale":"2024-04-26T12:08:52.744180+0000","last_undegraded":"2024-04-26T12:08:52.744180+0000","last_fullsized":"2024-04-26T12:08:52.744180+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:01.830043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":12467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'425","reported_seq":544,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743855+0000","last_change":"2024-04-26T12:08:47.737376+0000","last_active":"2024-04-26T12:08:52.743855+0000","last_peered":"2024-04-26T12:08:52.743855+0000","last_clean":"2024-04-26T12:08:52.743855+0000","last_became_active":"2024-04-26T12:08:47.735367+0000","last_became_peered":"2024-04-26T12:08:47.735367+0000","last_unstale":"2024-04-26T12:08:52.743855+0000","last_undegraded":"2024-04-26T12:08:52.743855+0000","last_fullsized":"2024-04-26T12:08:52.743855+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:35.420647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":38065,"num_write":387,"num_write_kb":71445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"59'126","reported_seq":229,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744930+0000","last_change":"2024-04-26T12:08:39.702212+0000","last_active":"2024-04-26T12:08:52.744930+0000","last_peered":"2024-04-26T12:08:52.744930+0000","last_clean":"2024-04-26T12:08:52.744930+0000","last_became_active":"2024-04-26T12:08:39.701900+0000","last_became_peered":"2024-04-26T12:08:39.701900+0000","last_unstale":"2024-04-26T12:08:52.744930+0000","last_undegraded":"2024-04-26T12:08:52.744930+0000","last_fullsized":"2024-04-26T12:08:52.744930+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:28.460358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"60'448","reported_seq":545,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:08:49.738608+0000","last_change":"2024-04-26T12:05:03.791827+0000","last_active":"2024-04-26T12:08:49.738608+0000","last_peered":"2024-04-26T12:08:49.738608+0000","last_clean":"2024-04-26T12:08:49.738608+0000","last_became_active":"2024-04-26T12:05:03.791442+0000","last_became_peered":"2024-04-26T12:05:03.791442+0000","last_unstale":"2024-04-26T12:08:49.738608+0000","last_undegraded":"2024-04-26T12:08:49.738608+0000","last_fullsized":"2024-04-26T12:08:49.738608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11191,"num_write":416,"num_write_kb":67272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"59'56","reported_seq":134,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744927+0000","last_change":"2024-04-26T12:05:03.430659+0000","last_active":"2024-04-26T12:08:52.744927+0000","last_peered":"2024-04-26T12:08:52.744927+0000","last_clean":"2024-04-26T12:08:52.744927+0000","last_became_active":"2024-04-26T12:05:03.430164+0000","last_became_peered":"2024-04-26T12:05:03.430164+0000","last_unstale":"2024-04-26T12:08:52.744927+0000","last_undegraded":"2024-04-26T12:08:52.744927+0000","last_fullsized":"2024-04-26T12:08:52.744927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2734,"num_read_kb":1486856,"num_write":24627,"num_write_kb":4487808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7440,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26722,"ondisk_log_size":26722,"up":128,"acting":127,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128606591,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":5972,"num_write_kb":129691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64376832,"data_stored":257213182,"data_compressed":19249503,"data_compressed_allocated":31694848,"data_compressed_original":224591872,"omap_allocated":4411,"internal_metadata":0},"log_size":7828,"ondisk_log_size":7828,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738421,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134400,"kb_used_data":27060,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94237440,"statfs":{"total":96636764160,"available":96499138560,"internally_reserved":0,"allocated":27709440,"data_stored":91780350,"data_compressed":6340284,"data_compressed_allocated":11272192,"data_compressed_original":75763712,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:08:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.40899999999999997,"15min":0.439},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.254},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.39900000000000002,"15min":0.42599999999999999},"min":{"1min":0.19,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.51700000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.26900000000000002}]},{"osd":1,"last update":"Fri Apr 26 12:05:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.32500000000000001}]}]},{"osd":1,"up_from":66,"seq":283467841542,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68516,"kb_used_data":10644,"kb_used_omap":5,"kb_used_meta":57850,"kb_avail":94303324,"statfs":{"total":96636764160,"available":96566603776,"internally_reserved":0,"allocated":10899456,"data_stored":86136667,"data_compressed":7182940,"data_compressed_allocated":10076160,"data_compressed_original":85745664,"omap_allocated":6005,"internal_metadata":59238539},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138888,"kb_used_data":27452,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232952,"statfs":{"total":96636764160,"available":96494542848,"internally_reserved":0,"allocated":28110848,"data_stored":81507786,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:05:55 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Apr 26 12:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42399999999999999,"15min":0.435},"min":{"1min":0.16200000000000001,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.433,"15min":0.433},"min":{"1min":0.20599999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.48299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27357184,"data_stored":81158407,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10088448,"data_stored":85196920,"data_compressed":7176942,"data_compressed_allocated":10039296,"data_compressed_original":85172224,"omap_allocated":4411,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26931200,"data_stored":90857855,"data_compressed":6334286,"data_compressed_allocated":11235328,"data_compressed_original":75190272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:08:58.029 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T12:08:58.429 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:08:58.430 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"5bc300ae-e948-4ce3-81bb-5abae8c06799","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":255,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":84,"num_osds":3,"num_up_osds":3,"osd_up_since":1714133315,"num_in_osds":3,"osd_in_since":1714133083,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":103},{"state_name":"peering","count":1},{"state_name":"active+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":55,"data_bytes":129196959,"bytes_used":350007296,"bytes_avail":289560285184,"bytes_total":289910292480,"inactive_pgs_ratio":0.0095238098874688148,"recovering_objects_per_sec":446,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":2523,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":14144}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-26T12:06:10.344416+0000","services":{}},"progress_events":{}} 2024-04-26T12:08:58.443 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-26T12:08:58.443 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:08:58.739 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:08:58.741 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:08:58.751 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2024-04-26T12:08:58.393028+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129196959,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2917,"num_read_kb":1488438,"num_write":30802,"num_write_kb":4620959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7463,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34707,"ondisk_log_size":34707,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":341840,"kb_used_data":65188,"kb_used_omap":8,"kb_used_meta":276599,"kb_avail":282773680,"statfs":{"total":289910292480,"available":289560248320,"internally_reserved":0,"allocated":66752512,"data_stored":259442055,"data_compressed":19261499,"data_compressed_allocated":31768576,"data_compressed_original":225738752,"omap_allocated":9193,"internal_metadata":283237399},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":505,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.651895"},"pg_stats":[{"pgid":"4.3f","version":"60'426","reported_seq":507,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744715+0000","last_change":"2024-04-26T12:08:51.753936+0000","last_active":"2024-04-26T12:08:52.744715+0000","last_peered":"2024-04-26T12:08:52.744715+0000","last_clean":"2024-04-26T12:08:52.744715+0000","last_became_active":"2024-04-26T12:08:51.750917+0000","last_became_peered":"2024-04-26T12:08:51.750917+0000","last_unstale":"2024-04-26T12:08:52.744715+0000","last_undegraded":"2024-04-26T12:08:52.744715+0000","last_fullsized":"2024-04-26T12:08:52.744715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:21.716324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9964,"num_write":393,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"60'470","reported_seq":601,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744464+0000","last_change":"2024-04-26T12:08:43.719204+0000","last_active":"2024-04-26T12:08:52.744464+0000","last_peered":"2024-04-26T12:08:52.744464+0000","last_clean":"2024-04-26T12:08:52.744464+0000","last_became_active":"2024-04-26T12:08:43.717325+0000","last_became_peered":"2024-04-26T12:08:43.717325+0000","last_unstale":"2024-04-26T12:08:52.744464+0000","last_undegraded":"2024-04-26T12:08:52.744464+0000","last_fullsized":"2024-04-26T12:08:52.744464+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:57.396493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":34556,"num_write":444,"num_write_kb":129697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"60'370","reported_seq":802,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745315+0000","last_change":"2024-04-26T12:08:50.753639+0000","last_active":"2024-04-26T12:08:52.745315+0000","last_peered":"2024-04-26T12:08:52.745315+0000","last_clean":"2024-04-26T12:08:52.745315+0000","last_became_active":"2024-04-26T12:08:50.752468+0000","last_became_peered":"2024-04-26T12:08:50.752468+0000","last_unstale":"2024-04-26T12:08:52.745315+0000","last_undegraded":"2024-04-26T12:08:52.745315+0000","last_fullsized":"2024-04-26T12:08:52.745315+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:54.514768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":349,"num_write_kb":51115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"60'377","reported_seq":485,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745318+0000","last_change":"2024-04-26T12:05:03.791234+0000","last_active":"2024-04-26T12:08:52.745318+0000","last_peered":"2024-04-26T12:08:52.745318+0000","last_clean":"2024-04-26T12:08:52.745318+0000","last_became_active":"2024-04-26T12:05:03.790717+0000","last_became_peered":"2024-04-26T12:05:03.790717+0000","last_unstale":"2024-04-26T12:08:52.745318+0000","last_undegraded":"2024-04-26T12:08:52.745318+0000","last_fullsized":"2024-04-26T12:08:52.745318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:52.358881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17376,"num_write":341,"num_write_kb":46680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'445","reported_seq":550,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743965+0000","last_change":"2024-04-26T12:08:39.705318+0000","last_active":"2024-04-26T12:08:52.743965+0000","last_peered":"2024-04-26T12:08:52.743965+0000","last_clean":"2024-04-26T12:08:52.743965+0000","last_became_active":"2024-04-26T12:08:39.702117+0000","last_became_peered":"2024-04-26T12:08:39.702117+0000","last_unstale":"2024-04-26T12:08:52.743965+0000","last_undegraded":"2024-04-26T12:08:52.743965+0000","last_fullsized":"2024-04-26T12:08:52.743965+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:39.986313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24197,"num_write":416,"num_write_kb":80466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"60'375","reported_seq":470,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744643+0000","last_change":"2024-04-26T12:05:03.791560+0000","last_active":"2024-04-26T12:08:52.744643+0000","last_peered":"2024-04-26T12:08:52.744643+0000","last_clean":"2024-04-26T12:08:52.744643+0000","last_became_active":"2024-04-26T12:05:03.790578+0000","last_became_peered":"2024-04-26T12:05:03.790578+0000","last_unstale":"2024-04-26T12:08:52.744643+0000","last_undegraded":"2024-04-26T12:08:52.744643+0000","last_fullsized":"2024-04-26T12:08:52.744643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6518,"num_write":348,"num_write_kb":38078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'428","reported_seq":524,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744809+0000","last_change":"2024-04-26T12:05:03.791215+0000","last_active":"2024-04-26T12:08:52.744809+0000","last_peered":"2024-04-26T12:08:52.744809+0000","last_clean":"2024-04-26T12:08:52.744809+0000","last_became_active":"2024-04-26T12:05:03.790615+0000","last_became_peered":"2024-04-26T12:05:03.790615+0000","last_unstale":"2024-04-26T12:08:52.744809+0000","last_undegraded":"2024-04-26T12:08:52.744809+0000","last_fullsized":"2024-04-26T12:08:52.744809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:55.388027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12560,"num_write":398,"num_write_kb":67332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"60'387","reported_seq":526,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744454+0000","last_change":"2024-04-26T12:05:03.785861+0000","last_active":"2024-04-26T12:08:52.744454+0000","last_peered":"2024-04-26T12:08:52.744454+0000","last_clean":"2024-04-26T12:08:52.744454+0000","last_became_active":"2024-04-26T12:05:03.785382+0000","last_became_peered":"2024-04-26T12:05:03.785382+0000","last_unstale":"2024-04-26T12:08:52.744454+0000","last_undegraded":"2024-04-26T12:08:52.744454+0000","last_fullsized":"2024-04-26T12:08:52.744454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:51.870183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":41160,"num_write":356,"num_write_kb":80219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"60'405","reported_seq":900,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744722+0000","last_change":"2024-04-26T12:08:46.730220+0000","last_active":"2024-04-26T12:08:52.744722+0000","last_peered":"2024-04-26T12:08:52.744722+0000","last_clean":"2024-04-26T12:08:52.744722+0000","last_became_active":"2024-04-26T12:08:46.729039+0000","last_became_peered":"2024-04-26T12:08:46.729039+0000","last_unstale":"2024-04-26T12:08:52.744722+0000","last_undegraded":"2024-04-26T12:08:52.744722+0000","last_fullsized":"2024-04-26T12:08:52.744722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:00.707126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":11674,"num_write":372,"num_write_kb":34604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"60'425","reported_seq":577,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744378+0000","last_change":"2024-04-26T12:08:41.718786+0000","last_active":"2024-04-26T12:08:52.744378+0000","last_peered":"2024-04-26T12:08:52.744378+0000","last_clean":"2024-04-26T12:08:52.744378+0000","last_became_active":"2024-04-26T12:08:41.716014+0000","last_became_peered":"2024-04-26T12:08:41.716014+0000","last_unstale":"2024-04-26T12:08:52.744378+0000","last_undegraded":"2024-04-26T12:08:52.744378+0000","last_fullsized":"2024-04-26T12:08:52.744378+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:20.096806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":48419,"num_write":390,"num_write_kb":92286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"60'372","reported_seq":489,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745403+0000","last_change":"2024-04-26T12:05:03.791046+0000","last_active":"2024-04-26T12:08:52.745403+0000","last_peered":"2024-04-26T12:08:52.745403+0000","last_clean":"2024-04-26T12:08:52.745403+0000","last_became_active":"2024-04-26T12:05:03.790662+0000","last_became_peered":"2024-04-26T12:05:03.790662+0000","last_unstale":"2024-04-26T12:08:52.745403+0000","last_undegraded":"2024-04-26T12:08:52.745403+0000","last_fullsized":"2024-04-26T12:08:52.745403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:35.458663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25905,"num_write":353,"num_write_kb":75437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'351","reported_seq":426,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744359+0000","last_change":"2024-04-26T12:08:41.718349+0000","last_active":"2024-04-26T12:08:52.744359+0000","last_peered":"2024-04-26T12:08:52.744359+0000","last_clean":"2024-04-26T12:08:52.744359+0000","last_became_active":"2024-04-26T12:08:41.715726+0000","last_became_peered":"2024-04-26T12:08:41.715726+0000","last_unstale":"2024-04-26T12:08:52.744359+0000","last_undegraded":"2024-04-26T12:08:52.744359+0000","last_fullsized":"2024-04-26T12:08:52.744359+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:00.589164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8884,"num_write":327,"num_write_kb":58289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"60'405","reported_seq":485,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744109+0000","last_change":"2024-04-26T12:08:39.705153+0000","last_active":"2024-04-26T12:08:52.744109+0000","last_peered":"2024-04-26T12:08:52.744109+0000","last_clean":"2024-04-26T12:08:52.744109+0000","last_became_active":"2024-04-26T12:08:39.702141+0000","last_became_peered":"2024-04-26T12:08:39.702141+0000","last_unstale":"2024-04-26T12:08:52.744109+0000","last_undegraded":"2024-04-26T12:08:52.744109+0000","last_fullsized":"2024-04-26T12:08:52.744109+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:42.807520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6771,"num_write":372,"num_write_kb":54786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"60'431","reported_seq":937,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745087+0000","last_change":"2024-04-26T12:08:48.741419+0000","last_active":"2024-04-26T12:08:52.745087+0000","last_peered":"2024-04-26T12:08:52.745087+0000","last_clean":"2024-04-26T12:08:52.745087+0000","last_became_active":"2024-04-26T12:08:48.740170+0000","last_became_peered":"2024-04-26T12:08:48.740170+0000","last_unstale":"2024-04-26T12:08:52.745087+0000","last_undegraded":"2024-04-26T12:08:52.745087+0000","last_fullsized":"2024-04-26T12:08:52.745087+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:52.026016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26572,"num_write":398,"num_write_kb":83974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'394","reported_seq":896,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744941+0000","last_change":"2024-04-26T12:08:41.717703+0000","last_active":"2024-04-26T12:08:52.744941+0000","last_peered":"2024-04-26T12:08:52.744941+0000","last_clean":"2024-04-26T12:08:52.744941+0000","last_became_active":"2024-04-26T12:08:41.715956+0000","last_became_peered":"2024-04-26T12:08:41.715956+0000","last_unstale":"2024-04-26T12:08:52.744941+0000","last_undegraded":"2024-04-26T12:08:52.744941+0000","last_fullsized":"2024-04-26T12:08:52.744941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:34.291197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":38136,"num_write":355,"num_write_kb":38484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'432","reported_seq":543,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744458+0000","last_change":"2024-04-26T12:05:03.786360+0000","last_active":"2024-04-26T12:08:52.744458+0000","last_peered":"2024-04-26T12:08:52.744458+0000","last_clean":"2024-04-26T12:08:52.744458+0000","last_became_active":"2024-04-26T12:05:03.785991+0000","last_became_peered":"2024-04-26T12:05:03.785991+0000","last_unstale":"2024-04-26T12:08:52.744458+0000","last_undegraded":"2024-04-26T12:08:52.744458+0000","last_fullsized":"2024-04-26T12:08:52.744458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:17.702068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18244,"num_write":400,"num_write_kb":59033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'381","reported_seq":838,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.747343+0000","last_change":"2024-04-26T12:08:52.747060+0000","last_active":"2024-04-26T12:08:52.747343+0000","last_peered":"2024-04-26T12:08:52.747343+0000","last_clean":"2024-04-26T12:08:52.747343+0000","last_became_active":"2024-04-26T12:08:52.745913+0000","last_became_peered":"2024-04-26T12:08:52.745913+0000","last_unstale":"2024-04-26T12:08:52.747343+0000","last_undegraded":"2024-04-26T12:08:52.747343+0000","last_fullsized":"2024-04-26T12:08:52.747343+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:30.065406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":350,"num_write_kb":21212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"60'424","reported_seq":514,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744398+0000","last_change":"2024-04-26T12:08:42.718639+0000","last_active":"2024-04-26T12:08:52.744398+0000","last_peered":"2024-04-26T12:08:52.744398+0000","last_clean":"2024-04-26T12:08:52.744398+0000","last_became_active":"2024-04-26T12:08:42.716846+0000","last_became_peered":"2024-04-26T12:08:42.716846+0000","last_unstale":"2024-04-26T12:08:52.744398+0000","last_undegraded":"2024-04-26T12:08:52.744398+0000","last_fullsized":"2024-04-26T12:08:52.744398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:00.928679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13930,"num_write":388,"num_write_kb":116055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'426","reported_seq":905,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.748530+0000","last_change":"2024-04-26T12:08:53.748530+0000","last_active":"2024-04-26T12:08:53.748530+0000","last_peered":"2024-04-26T12:08:53.748530+0000","last_clean":"2024-04-26T12:08:53.748530+0000","last_became_active":"2024-04-26T12:08:53.747215+0000","last_became_peered":"2024-04-26T12:08:53.747215+0000","last_unstale":"2024-04-26T12:08:53.748530+0000","last_undegraded":"2024-04-26T12:08:53.748530+0000","last_fullsized":"2024-04-26T12:08:53.748530+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:14.637610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26908,"num_write":383,"num_write_kb":71324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"60'425","reported_seq":546,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745178+0000","last_change":"2024-04-26T12:05:03.792219+0000","last_active":"2024-04-26T12:08:52.745178+0000","last_peered":"2024-04-26T12:08:52.745178+0000","last_clean":"2024-04-26T12:08:52.745178+0000","last_became_active":"2024-04-26T12:05:03.791061+0000","last_became_peered":"2024-04-26T12:05:03.791061+0000","last_unstale":"2024-04-26T12:08:52.745178+0000","last_undegraded":"2024-04-26T12:08:52.745178+0000","last_fullsized":"2024-04-26T12:08:52.745178+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19715,"num_write":398,"num_write_kb":30150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'450","reported_seq":638,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745086+0000","last_change":"2024-04-26T12:05:03.792073+0000","last_active":"2024-04-26T12:08:52.745086+0000","last_peered":"2024-04-26T12:08:52.745086+0000","last_clean":"2024-04-26T12:08:52.745086+0000","last_became_active":"2024-04-26T12:05:03.791693+0000","last_became_peered":"2024-04-26T12:05:03.791693+0000","last_unstale":"2024-04-26T12:08:52.745086+0000","last_undegraded":"2024-04-26T12:08:52.745086+0000","last_fullsized":"2024-04-26T12:08:52.745086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":65124,"num_write":423,"num_write_kb":142714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'434","reported_seq":538,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744125+0000","last_change":"2024-04-26T12:08:46.730582+0000","last_active":"2024-04-26T12:08:52.744125+0000","last_peered":"2024-04-26T12:08:52.744125+0000","last_clean":"2024-04-26T12:08:52.744125+0000","last_became_active":"2024-04-26T12:08:46.728804+0000","last_became_peered":"2024-04-26T12:08:46.728804+0000","last_unstale":"2024-04-26T12:08:52.744125+0000","last_undegraded":"2024-04-26T12:08:52.744125+0000","last_fullsized":"2024-04-26T12:08:52.744125+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:47.745435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":15350,"num_write":405,"num_write_kb":59295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"60'424","reported_seq":537,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743999+0000","last_change":"2024-04-26T12:05:03.788658+0000","last_active":"2024-04-26T12:08:52.743999+0000","last_peered":"2024-04-26T12:08:52.743999+0000","last_clean":"2024-04-26T12:08:52.743999+0000","last_became_active":"2024-04-26T12:05:03.788050+0000","last_became_peered":"2024-04-26T12:05:03.788050+0000","last_unstale":"2024-04-26T12:08:52.743999+0000","last_undegraded":"2024-04-26T12:08:52.743999+0000","last_fullsized":"2024-04-26T12:08:52.743999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23772,"num_write":390,"num_write_kb":67944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"60'447","reported_seq":526,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743819+0000","last_change":"2024-04-26T12:08:40.707153+0000","last_active":"2024-04-26T12:08:52.743819+0000","last_peered":"2024-04-26T12:08:52.743819+0000","last_clean":"2024-04-26T12:08:52.743819+0000","last_became_active":"2024-04-26T12:08:40.703880+0000","last_became_peered":"2024-04-26T12:08:40.703880+0000","last_unstale":"2024-04-26T12:08:52.743819+0000","last_undegraded":"2024-04-26T12:08:52.743819+0000","last_fullsized":"2024-04-26T12:08:52.743819+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:25.187022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9403,"num_write":417,"num_write_kb":67425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"60'417","reported_seq":507,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744515+0000","last_change":"2024-04-26T12:08:42.717934+0000","last_active":"2024-04-26T12:08:52.744515+0000","last_peered":"2024-04-26T12:08:52.744515+0000","last_clean":"2024-04-26T12:08:52.744515+0000","last_became_active":"2024-04-26T12:08:42.715812+0000","last_became_peered":"2024-04-26T12:08:42.715812+0000","last_unstale":"2024-04-26T12:08:52.744515+0000","last_undegraded":"2024-04-26T12:08:52.744515+0000","last_fullsized":"2024-04-26T12:08:52.744515+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:09.442852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20466,"num_write":400,"num_write_kb":42225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"60'475","reported_seq":604,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744858+0000","last_change":"2024-04-26T12:05:03.787909+0000","last_active":"2024-04-26T12:08:52.744858+0000","last_peered":"2024-04-26T12:08:52.744858+0000","last_clean":"2024-04-26T12:08:52.744858+0000","last_became_active":"2024-04-26T12:05:03.787562+0000","last_became_peered":"2024-04-26T12:05:03.787562+0000","last_unstale":"2024-04-26T12:08:52.744858+0000","last_undegraded":"2024-04-26T12:08:52.744858+0000","last_fullsized":"2024-04-26T12:08:52.744858+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25186,"num_write":431,"num_write_kb":48184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"60'409","reported_seq":897,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745514+0000","last_change":"2024-04-26T12:08:49.741823+0000","last_active":"2024-04-26T12:08:52.745514+0000","last_peered":"2024-04-26T12:08:52.745514+0000","last_clean":"2024-04-26T12:08:52.745514+0000","last_became_active":"2024-04-26T12:08:49.740497+0000","last_became_peered":"2024-04-26T12:08:49.740497+0000","last_unstale":"2024-04-26T12:08:52.745514+0000","last_undegraded":"2024-04-26T12:08:52.745514+0000","last_fullsized":"2024-04-26T12:08:52.745514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:00.225872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":20137,"num_write":374,"num_write_kb":55441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'392","reported_seq":493,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744357+0000","last_change":"2024-04-26T12:08:47.737270+0000","last_active":"2024-04-26T12:08:52.744357+0000","last_peered":"2024-04-26T12:08:52.744357+0000","last_clean":"2024-04-26T12:08:52.744357+0000","last_became_active":"2024-04-26T12:08:47.735361+0000","last_became_peered":"2024-04-26T12:08:47.735361+0000","last_unstale":"2024-04-26T12:08:52.744357+0000","last_undegraded":"2024-04-26T12:08:52.744357+0000","last_fullsized":"2024-04-26T12:08:52.744357+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:09.838696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29179,"num_write":355,"num_write_kb":59011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'380","reported_seq":840,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744489+0000","last_change":"2024-04-26T12:08:41.717953+0000","last_active":"2024-04-26T12:08:52.744489+0000","last_peered":"2024-04-26T12:08:52.744489+0000","last_clean":"2024-04-26T12:08:52.744489+0000","last_became_active":"2024-04-26T12:08:41.716234+0000","last_became_peered":"2024-04-26T12:08:41.716234+0000","last_unstale":"2024-04-26T12:08:52.744489+0000","last_undegraded":"2024-04-26T12:08:52.744489+0000","last_fullsized":"2024-04-26T12:08:52.744489+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:37.480062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13036,"num_write":347,"num_write_kb":33880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"60'461","reported_seq":565,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744026+0000","last_change":"2024-04-26T12:08:46.732653+0000","last_active":"2024-04-26T12:08:52.744026+0000","last_peered":"2024-04-26T12:08:52.744026+0000","last_clean":"2024-04-26T12:08:52.744026+0000","last_became_active":"2024-04-26T12:08:46.730738+0000","last_became_peered":"2024-04-26T12:08:46.730738+0000","last_unstale":"2024-04-26T12:08:52.744026+0000","last_undegraded":"2024-04-26T12:08:52.744026+0000","last_fullsized":"2024-04-26T12:08:52.744026+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:46.177056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":32945,"num_write":426,"num_write_kb":63234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"60'411","reported_seq":901,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744088+0000","last_change":"2024-04-26T12:08:40.704958+0000","last_active":"2024-04-26T12:08:52.744088+0000","last_peered":"2024-04-26T12:08:52.744088+0000","last_clean":"2024-04-26T12:08:52.744088+0000","last_became_active":"2024-04-26T12:08:40.703845+0000","last_became_peered":"2024-04-26T12:08:40.703845+0000","last_unstale":"2024-04-26T12:08:52.744088+0000","last_undegraded":"2024-04-26T12:08:52.744088+0000","last_fullsized":"2024-04-26T12:08:52.744088+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:56.148477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11499,"num_write":377,"num_write_kb":34249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'430","reported_seq":538,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744573+0000","last_change":"2024-04-26T12:05:03.791605+0000","last_active":"2024-04-26T12:08:52.744573+0000","last_peered":"2024-04-26T12:08:52.744573+0000","last_clean":"2024-04-26T12:08:52.744573+0000","last_became_active":"2024-04-26T12:05:03.791251+0000","last_became_peered":"2024-04-26T12:05:03.791251+0000","last_unstale":"2024-04-26T12:08:52.744573+0000","last_undegraded":"2024-04-26T12:08:52.744573+0000","last_fullsized":"2024-04-26T12:08:52.744573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:27.239868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14660,"num_write":404,"num_write_kb":60840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"60'392","reported_seq":500,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744114+0000","last_change":"2024-04-26T12:08:44.723861+0000","last_active":"2024-04-26T12:08:52.744114+0000","last_peered":"2024-04-26T12:08:52.744114+0000","last_clean":"2024-04-26T12:08:52.744114+0000","last_became_active":"2024-04-26T12:08:44.722120+0000","last_became_peered":"2024-04-26T12:08:44.722120+0000","last_unstale":"2024-04-26T12:08:52.744114+0000","last_undegraded":"2024-04-26T12:08:52.744114+0000","last_fullsized":"2024-04-26T12:08:52.744114+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:12.810713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31703,"num_write":351,"num_write_kb":59324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"59'514","reported_seq":592,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745155+0000","last_change":"2024-04-26T12:05:03.430021+0000","last_active":"2024-04-26T12:08:52.745155+0000","last_peered":"2024-04-26T12:08:52.745155+0000","last_clean":"2024-04-26T12:08:52.745155+0000","last_became_active":"2024-04-26T12:05:03.429695+0000","last_became_peered":"2024-04-26T12:05:03.429695+0000","last_unstale":"2024-04-26T12:08:52.745155+0000","last_undegraded":"2024-04-26T12:08:52.745155+0000","last_fullsized":"2024-04-26T12:08:52.745155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":8377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'432","reported_seq":522,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.751086+0000","last_change":"2024-04-26T12:08:53.751086+0000","last_active":"2024-04-26T12:08:53.751086+0000","last_peered":"2024-04-26T12:08:53.751086+0000","last_clean":"2024-04-26T12:08:53.751086+0000","last_became_active":"2024-04-26T12:08:53.748972+0000","last_became_peered":"2024-04-26T12:08:53.748972+0000","last_unstale":"2024-04-26T12:08:53.751086+0000","last_undegraded":"2024-04-26T12:08:53.751086+0000","last_fullsized":"2024-04-26T12:08:53.751086+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:34.448806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":30094,"num_write":388,"num_write_kb":83741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"59'55","reported_seq":133,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744325+0000","last_change":"2024-04-26T12:05:03.428605+0000","last_active":"2024-04-26T12:08:52.744325+0000","last_peered":"2024-04-26T12:08:52.744325+0000","last_clean":"2024-04-26T12:08:52.744325+0000","last_became_active":"2024-04-26T12:05:03.428098+0000","last_became_peered":"2024-04-26T12:05:03.428098+0000","last_unstale":"2024-04-26T12:08:52.744325+0000","last_undegraded":"2024-04-26T12:08:52.744325+0000","last_fullsized":"2024-04-26T12:08:52.744325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"60'445","reported_seq":557,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744955+0000","last_change":"2024-04-26T12:05:03.788568+0000","last_active":"2024-04-26T12:08:52.744955+0000","last_peered":"2024-04-26T12:08:52.744955+0000","last_clean":"2024-04-26T12:08:52.744955+0000","last_became_active":"2024-04-26T12:05:03.788039+0000","last_became_peered":"2024-04-26T12:05:03.788039+0000","last_unstale":"2024-04-26T12:08:52.744955+0000","last_undegraded":"2024-04-26T12:08:52.744955+0000","last_fullsized":"2024-04-26T12:08:52.744955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":16079,"num_write":410,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"59'64","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743891+0000","last_change":"2024-04-26T12:08:36.696166+0000","last_active":"2024-04-26T12:08:52.743891+0000","last_peered":"2024-04-26T12:08:52.743891+0000","last_clean":"2024-04-26T12:08:52.743891+0000","last_became_active":"2024-04-26T12:08:36.694921+0000","last_became_peered":"2024-04-26T12:08:36.694921+0000","last_unstale":"2024-04-26T12:08:52.743891+0000","last_undegraded":"2024-04-26T12:08:52.743891+0000","last_fullsized":"2024-04-26T12:08:52.743891+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:57.438892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"60'420","reported_seq":537,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744759+0000","last_change":"2024-04-26T12:05:03.788505+0000","last_active":"2024-04-26T12:08:52.744759+0000","last_peered":"2024-04-26T12:08:52.744759+0000","last_clean":"2024-04-26T12:08:52.744759+0000","last_became_active":"2024-04-26T12:05:03.788184+0000","last_became_peered":"2024-04-26T12:05:03.788184+0000","last_unstale":"2024-04-26T12:08:52.744759+0000","last_undegraded":"2024-04-26T12:08:52.744759+0000","last_fullsized":"2024-04-26T12:08:52.744759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":14666,"num_write":383,"num_write_kb":83769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"60'63","reported_seq":155,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744615+0000","last_change":"2024-04-26T12:08:36.697126+0000","last_active":"2024-04-26T12:08:52.744615+0000","last_peered":"2024-04-26T12:08:52.744615+0000","last_clean":"2024-04-26T12:08:52.744615+0000","last_became_active":"2024-04-26T12:08:36.696792+0000","last_became_peered":"2024-04-26T12:08:36.696792+0000","last_unstale":"2024-04-26T12:08:52.744615+0000","last_undegraded":"2024-04-26T12:08:52.744615+0000","last_fullsized":"2024-04-26T12:08:52.744615+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:48.447882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"59'232","reported_seq":335,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745720+0000","last_change":"2024-04-26T12:08:39.703810+0000","last_active":"2024-04-26T12:08:52.745720+0000","last_peered":"2024-04-26T12:08:52.745720+0000","last_clean":"2024-04-26T12:08:52.745720+0000","last_became_active":"2024-04-26T12:08:39.703455+0000","last_became_peered":"2024-04-26T12:08:39.703455+0000","last_unstale":"2024-04-26T12:08:52.745720+0000","last_undegraded":"2024-04-26T12:08:52.745720+0000","last_fullsized":"2024-04-26T12:08:52.745720+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:08.399237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'408","reported_seq":491,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743999+0000","last_change":"2024-04-26T12:08:40.710236+0000","last_active":"2024-04-26T12:08:52.743999+0000","last_peered":"2024-04-26T12:08:52.743999+0000","last_clean":"2024-04-26T12:08:52.743999+0000","last_became_active":"2024-04-26T12:08:40.707357+0000","last_became_peered":"2024-04-26T12:08:40.707357+0000","last_unstale":"2024-04-26T12:08:52.743999+0000","last_undegraded":"2024-04-26T12:08:52.743999+0000","last_fullsized":"2024-04-26T12:08:52.743999+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:17.928748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12418,"num_write":371,"num_write_kb":58378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"59'302","reported_seq":370,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744280+0000","last_change":"2024-04-26T12:08:39.703949+0000","last_active":"2024-04-26T12:08:52.744280+0000","last_peered":"2024-04-26T12:08:52.744280+0000","last_clean":"2024-04-26T12:08:52.744280+0000","last_became_active":"2024-04-26T12:08:39.703421+0000","last_became_peered":"2024-04-26T12:08:39.703421+0000","last_unstale":"2024-04-26T12:08:52.744280+0000","last_undegraded":"2024-04-26T12:08:52.744280+0000","last_fullsized":"2024-04-26T12:08:52.744280+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:10.222074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":4228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'439","reported_seq":498,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743713+0000","last_change":"2024-04-26T12:08:41.717923+0000","last_active":"2024-04-26T12:08:52.743713+0000","last_peered":"2024-04-26T12:08:52.743713+0000","last_clean":"2024-04-26T12:08:52.743713+0000","last_became_active":"2024-04-26T12:08:41.715708+0000","last_became_peered":"2024-04-26T12:08:41.715708+0000","last_unstale":"2024-04-26T12:08:52.743713+0000","last_undegraded":"2024-04-26T12:08:52.743713+0000","last_fullsized":"2024-04-26T12:08:52.743713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:23.646558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":30851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"59'589","reported_seq":692,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745816+0000","last_change":"2024-04-26T12:08:39.703966+0000","last_active":"2024-04-26T12:08:52.745816+0000","last_peered":"2024-04-26T12:08:52.745816+0000","last_clean":"2024-04-26T12:08:52.745816+0000","last_became_active":"2024-04-26T12:08:39.703487+0000","last_became_peered":"2024-04-26T12:08:39.703487+0000","last_unstale":"2024-04-26T12:08:52.745816+0000","last_undegraded":"2024-04-26T12:08:52.745816+0000","last_fullsized":"2024-04-26T12:08:52.745816+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:06.112476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":534,"num_write_kb":4333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'461","reported_seq":614,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744817+0000","last_change":"2024-04-26T12:05:03.791809+0000","last_active":"2024-04-26T12:08:52.744817+0000","last_peered":"2024-04-26T12:08:52.744817+0000","last_clean":"2024-04-26T12:08:52.744817+0000","last_became_active":"2024-04-26T12:05:03.791272+0000","last_became_peered":"2024-04-26T12:05:03.791272+0000","last_unstale":"2024-04-26T12:08:52.744817+0000","last_undegraded":"2024-04-26T12:08:52.744817+0000","last_fullsized":"2024-04-26T12:08:52.744817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":46123,"num_write":422,"num_write_kb":104552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'66","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745499+0000","last_change":"2024-04-26T12:05:03.430224+0000","last_active":"2024-04-26T12:08:52.745499+0000","last_peered":"2024-04-26T12:08:52.745499+0000","last_clean":"2024-04-26T12:08:52.745499+0000","last_became_active":"2024-04-26T12:05:03.429291+0000","last_became_peered":"2024-04-26T12:05:03.429291+0000","last_unstale":"2024-04-26T12:08:52.745499+0000","last_undegraded":"2024-04-26T12:08:52.745499+0000","last_fullsized":"2024-04-26T12:08:52.745499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'428","reported_seq":541,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744404+0000","last_change":"2024-04-26T12:05:03.788174+0000","last_active":"2024-04-26T12:08:52.744404+0000","last_peered":"2024-04-26T12:08:52.744404+0000","last_clean":"2024-04-26T12:08:52.744404+0000","last_became_active":"2024-04-26T12:05:03.787772+0000","last_became_peered":"2024-04-26T12:05:03.787772+0000","last_unstale":"2024-04-26T12:08:52.744404+0000","last_undegraded":"2024-04-26T12:08:52.744404+0000","last_fullsized":"2024-04-26T12:08:52.744404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15098,"num_write":394,"num_write_kb":42677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"59'195","reported_seq":273,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744598+0000","last_change":"2024-04-26T12:05:03.431162+0000","last_active":"2024-04-26T12:08:52.744598+0000","last_peered":"2024-04-26T12:08:52.744598+0000","last_clean":"2024-04-26T12:08:52.744598+0000","last_became_active":"2024-04-26T12:05:03.430855+0000","last_became_peered":"2024-04-26T12:05:03.430855+0000","last_unstale":"2024-04-26T12:08:52.744598+0000","last_undegraded":"2024-04-26T12:08:52.744598+0000","last_fullsized":"2024-04-26T12:08:52.744598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:41.279426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"60'448","reported_seq":544,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745298+0000","last_change":"2024-04-26T12:05:03.792357+0000","last_active":"2024-04-26T12:08:52.745298+0000","last_peered":"2024-04-26T12:08:52.745298+0000","last_clean":"2024-04-26T12:08:52.745298+0000","last_became_active":"2024-04-26T12:05:03.792119+0000","last_became_peered":"2024-04-26T12:05:03.792119+0000","last_unstale":"2024-04-26T12:08:52.745298+0000","last_undegraded":"2024-04-26T12:08:52.745298+0000","last_fullsized":"2024-04-26T12:08:52.745298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":13281,"num_write":420,"num_write_kb":59540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"59'171","reported_seq":249,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745146+0000","last_change":"2024-04-26T12:05:03.429811+0000","last_active":"2024-04-26T12:08:52.745146+0000","last_peered":"2024-04-26T12:08:52.745146+0000","last_clean":"2024-04-26T12:08:52.745146+0000","last_became_active":"2024-04-26T12:05:03.429469+0000","last_became_peered":"2024-04-26T12:05:03.429469+0000","last_unstale":"2024-04-26T12:08:52.745146+0000","last_undegraded":"2024-04-26T12:08:52.745146+0000","last_fullsized":"2024-04-26T12:08:52.745146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'412","reported_seq":923,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745698+0000","last_change":"2024-04-26T12:08:51.752350+0000","last_active":"2024-04-26T12:08:52.745698+0000","last_peered":"2024-04-26T12:08:52.745698+0000","last_clean":"2024-04-26T12:08:52.745698+0000","last_became_active":"2024-04-26T12:08:51.751044+0000","last_became_peered":"2024-04-26T12:08:51.751044+0000","last_unstale":"2024-04-26T12:08:52.745698+0000","last_undegraded":"2024-04-26T12:08:52.745698+0000","last_fullsized":"2024-04-26T12:08:52.745698+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:40.008727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26310,"num_write":380,"num_write_kb":38462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"59'55","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743708+0000","last_change":"2024-04-26T12:08:36.695355+0000","last_active":"2024-04-26T12:08:52.743708+0000","last_peered":"2024-04-26T12:08:52.743708+0000","last_clean":"2024-04-26T12:08:52.743708+0000","last_became_active":"2024-04-26T12:08:36.694346+0000","last_became_peered":"2024-04-26T12:08:36.694346+0000","last_unstale":"2024-04-26T12:08:52.743708+0000","last_undegraded":"2024-04-26T12:08:52.743708+0000","last_fullsized":"2024-04-26T12:08:52.743708+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:42.458073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"60'362","reported_seq":817,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745440+0000","last_change":"2024-04-26T12:08:41.717048+0000","last_active":"2024-04-26T12:08:52.745440+0000","last_peered":"2024-04-26T12:08:52.745440+0000","last_clean":"2024-04-26T12:08:52.745440+0000","last_became_active":"2024-04-26T12:08:41.716102+0000","last_became_peered":"2024-04-26T12:08:41.716102+0000","last_unstale":"2024-04-26T12:08:52.745440+0000","last_undegraded":"2024-04-26T12:08:52.745440+0000","last_fullsized":"2024-04-26T12:08:52.745440+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:52.409548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21408,"num_write":333,"num_write_kb":66549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"59'378","reported_seq":439,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743919+0000","last_change":"2024-04-26T12:08:39.702797+0000","last_active":"2024-04-26T12:08:52.743919+0000","last_peered":"2024-04-26T12:08:52.743919+0000","last_clean":"2024-04-26T12:08:52.743919+0000","last_became_active":"2024-04-26T12:08:39.702438+0000","last_became_peered":"2024-04-26T12:08:39.702438+0000","last_unstale":"2024-04-26T12:08:52.743919+0000","last_undegraded":"2024-04-26T12:08:52.743919+0000","last_fullsized":"2024-04-26T12:08:52.743919+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:06.278304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"60'407","reported_seq":917,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744823+0000","last_change":"2024-04-26T12:08:45.724853+0000","last_active":"2024-04-26T12:08:52.744823+0000","last_peered":"2024-04-26T12:08:52.744823+0000","last_clean":"2024-04-26T12:08:52.744823+0000","last_became_active":"2024-04-26T12:08:45.723772+0000","last_became_peered":"2024-04-26T12:08:45.723772+0000","last_unstale":"2024-04-26T12:08:52.744823+0000","last_undegraded":"2024-04-26T12:08:52.744823+0000","last_fullsized":"2024-04-26T12:08:52.744823+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:41.814840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":40156,"num_write":373,"num_write_kb":91285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":294,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745711+0000","last_change":"2024-04-26T12:08:36.697892+0000","last_active":"2024-04-26T12:08:53.745711+0000","last_peered":"2024-04-26T12:08:53.745711+0000","last_clean":"2024-04-26T12:08:53.745711+0000","last_became_active":"2024-04-26T12:08:36.697508+0000","last_became_peered":"2024-04-26T12:08:36.697508+0000","last_unstale":"2024-04-26T12:08:53.745711+0000","last_undegraded":"2024-04-26T12:08:53.745711+0000","last_fullsized":"2024-04-26T12:08:53.745711+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_clean_scrub_stamp":"2024-04-26T12:04:52.376986+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:24.384180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745283+0000","last_change":"2024-04-26T12:04:59.403711+0000","last_active":"2024-04-26T12:08:52.745283+0000","last_peered":"2024-04-26T12:08:52.745283+0000","last_clean":"2024-04-26T12:08:52.745283+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:08:52.745283+0000","last_undegraded":"2024-04-26T12:08:52.745283+0000","last_fullsized":"2024-04-26T12:08:52.745283+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:45.779614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'793","reported_seq":897,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744445+0000","last_change":"2024-04-26T12:08:39.702225+0000","last_active":"2024-04-26T12:08:52.744445+0000","last_peered":"2024-04-26T12:08:52.744445+0000","last_clean":"2024-04-26T12:08:52.744445+0000","last_became_active":"2024-04-26T12:08:39.701760+0000","last_became_peered":"2024-04-26T12:08:39.701760+0000","last_unstale":"2024-04-26T12:08:52.744445+0000","last_undegraded":"2024-04-26T12:08:52.744445+0000","last_fullsized":"2024-04-26T12:08:52.744445+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:51.405891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":8533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"60'466","reported_seq":1012,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.747878+0000","last_change":"2024-04-26T12:08:52.747463+0000","last_active":"2024-04-26T12:08:52.747878+0000","last_peered":"2024-04-26T12:08:52.747878+0000","last_clean":"2024-04-26T12:08:52.747878+0000","last_became_active":"2024-04-26T12:08:52.746147+0000","last_became_peered":"2024-04-26T12:08:52.746147+0000","last_unstale":"2024-04-26T12:08:52.747878+0000","last_undegraded":"2024-04-26T12:08:52.747878+0000","last_fullsized":"2024-04-26T12:08:52.747878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:21.517395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":37547,"num_write":422,"num_write_kb":96579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744702+0000","last_change":"2024-04-26T12:08:36.695759+0000","last_active":"2024-04-26T12:08:52.744702+0000","last_peered":"2024-04-26T12:08:52.744702+0000","last_clean":"2024-04-26T12:08:52.744702+0000","last_became_active":"2024-04-26T12:08:36.695444+0000","last_became_peered":"2024-04-26T12:08:36.695444+0000","last_unstale":"2024-04-26T12:08:52.744702+0000","last_undegraded":"2024-04-26T12:08:52.744702+0000","last_fullsized":"2024-04-26T12:08:52.744702+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:22.343369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"60'114","reported_seq":239,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744279+0000","last_change":"2024-04-26T12:05:03.428547+0000","last_active":"2024-04-26T12:08:52.744279+0000","last_peered":"2024-04-26T12:08:52.744279+0000","last_clean":"2024-04-26T12:08:52.744279+0000","last_became_active":"2024-04-26T12:05:03.427985+0000","last_became_peered":"2024-04-26T12:05:03.427985+0000","last_unstale":"2024-04-26T12:08:52.744279+0000","last_undegraded":"2024-04-26T12:08:52.744279+0000","last_fullsized":"2024-04-26T12:08:52.744279+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:19.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466015,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":47,"num_write_kb":1464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"60'492","reported_seq":655,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744496+0000","last_change":"2024-04-26T12:08:49.741650+0000","last_active":"2024-04-26T12:08:52.744496+0000","last_peered":"2024-04-26T12:08:52.744496+0000","last_clean":"2024-04-26T12:08:52.744496+0000","last_became_active":"2024-04-26T12:08:49.739496+0000","last_became_peered":"2024-04-26T12:08:49.739496+0000","last_unstale":"2024-04-26T12:08:52.744496+0000","last_undegraded":"2024-04-26T12:08:52.744496+0000","last_fullsized":"2024-04-26T12:08:52.744496+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:55.361224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":63988,"num_write":466,"num_write_kb":154489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744369+0000","last_change":"2024-04-26T12:08:36.696858+0000","last_active":"2024-04-26T12:08:52.744369+0000","last_peered":"2024-04-26T12:08:52.744369+0000","last_clean":"2024-04-26T12:08:52.744369+0000","last_became_active":"2024-04-26T12:08:36.696619+0000","last_became_peered":"2024-04-26T12:08:36.696619+0000","last_unstale":"2024-04-26T12:08:52.744369+0000","last_undegraded":"2024-04-26T12:08:52.744369+0000","last_fullsized":"2024-04-26T12:08:52.744369+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:47.292926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"59'325","reported_seq":386,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743649+0000","last_change":"2024-04-26T12:08:39.704052+0000","last_active":"2024-04-26T12:08:52.743649+0000","last_peered":"2024-04-26T12:08:52.743649+0000","last_clean":"2024-04-26T12:08:52.743649+0000","last_became_active":"2024-04-26T12:08:39.703696+0000","last_became_peered":"2024-04-26T12:08:39.703696+0000","last_unstale":"2024-04-26T12:08:52.743649+0000","last_undegraded":"2024-04-26T12:08:52.743649+0000","last_fullsized":"2024-04-26T12:08:52.743649+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:21:44.069244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":8296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"60'359","reported_seq":785,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744857+0000","last_change":"2024-04-26T12:08:47.737443+0000","last_active":"2024-04-26T12:08:52.744857+0000","last_peered":"2024-04-26T12:08:52.744857+0000","last_clean":"2024-04-26T12:08:52.744857+0000","last_became_active":"2024-04-26T12:08:47.735729+0000","last_became_peered":"2024-04-26T12:08:47.735729+0000","last_unstale":"2024-04-26T12:08:52.744857+0000","last_undegraded":"2024-04-26T12:08:52.744857+0000","last_fullsized":"2024-04-26T12:08:52.744857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:57:20.726677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9448,"num_write":336,"num_write_kb":74900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745246+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:08:52.745246+0000","last_peered":"2024-04-26T12:08:52.745246+0000","last_clean":"2024-04-26T12:08:52.745246+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:08:52.745246+0000","last_undegraded":"2024-04-26T12:08:52.745246+0000","last_fullsized":"2024-04-26T12:08:52.745246+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:12.939539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"59'67","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745292+0000","last_change":"2024-04-26T12:05:03.430140+0000","last_active":"2024-04-26T12:08:52.745292+0000","last_peered":"2024-04-26T12:08:52.745292+0000","last_clean":"2024-04-26T12:08:52.745292+0000","last_became_active":"2024-04-26T12:05:03.429838+0000","last_became_peered":"2024-04-26T12:05:03.429838+0000","last_unstale":"2024-04-26T12:08:52.745292+0000","last_undegraded":"2024-04-26T12:08:52.745292+0000","last_fullsized":"2024-04-26T12:08:52.745292+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"60'403","reported_seq":894,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744652+0000","last_change":"2024-04-26T12:08:50.753437+0000","last_active":"2024-04-26T12:08:52.744652+0000","last_peered":"2024-04-26T12:08:52.744652+0000","last_clean":"2024-04-26T12:08:52.744652+0000","last_became_active":"2024-04-26T12:08:50.752366+0000","last_became_peered":"2024-04-26T12:08:50.752366+0000","last_unstale":"2024-04-26T12:08:52.744652+0000","last_undegraded":"2024-04-26T12:08:52.744652+0000","last_fullsized":"2024-04-26T12:08:52.744652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:02.999757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30094,"num_write":370,"num_write_kb":104181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"59'469","reported_seq":547,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745818+0000","last_change":"2024-04-26T12:05:03.429673+0000","last_active":"2024-04-26T12:08:52.745818+0000","last_peered":"2024-04-26T12:08:52.745818+0000","last_clean":"2024-04-26T12:08:52.745818+0000","last_became_active":"2024-04-26T12:05:03.429146+0000","last_became_peered":"2024-04-26T12:05:03.429146+0000","last_unstale":"2024-04-26T12:08:52.745818+0000","last_undegraded":"2024-04-26T12:08:52.745818+0000","last_fullsized":"2024-04-26T12:08:52.745818+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744743+0000","last_change":"2024-04-26T12:08:36.697900+0000","last_active":"2024-04-26T12:08:52.744743+0000","last_peered":"2024-04-26T12:08:52.744743+0000","last_clean":"2024-04-26T12:08:52.744743+0000","last_became_active":"2024-04-26T12:08:36.697618+0000","last_became_peered":"2024-04-26T12:08:36.697618+0000","last_unstale":"2024-04-26T12:08:52.744743+0000","last_undegraded":"2024-04-26T12:08:52.744743+0000","last_fullsized":"2024-04-26T12:08:52.744743+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:16.620901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'354","reported_seq":413,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744055+0000","last_change":"2024-04-26T12:08:45.725751+0000","last_active":"2024-04-26T12:08:52.744055+0000","last_peered":"2024-04-26T12:08:52.744055+0000","last_clean":"2024-04-26T12:08:52.744055+0000","last_became_active":"2024-04-26T12:08:45.724153+0000","last_became_peered":"2024-04-26T12:08:45.724153+0000","last_unstale":"2024-04-26T12:08:52.744055+0000","last_undegraded":"2024-04-26T12:08:52.744055+0000","last_fullsized":"2024-04-26T12:08:52.744055+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:57.798803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":416,"num_write":319,"num_write_kb":17259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"59'53","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744703+0000","last_change":"2024-04-26T12:08:36.698122+0000","last_active":"2024-04-26T12:08:52.744703+0000","last_peered":"2024-04-26T12:08:52.744703+0000","last_clean":"2024-04-26T12:08:52.744703+0000","last_became_active":"2024-04-26T12:08:36.697832+0000","last_became_peered":"2024-04-26T12:08:36.697832+0000","last_unstale":"2024-04-26T12:08:52.744703+0000","last_undegraded":"2024-04-26T12:08:52.744703+0000","last_fullsized":"2024-04-26T12:08:52.744703+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:34.416168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744650+0000","last_change":"2024-04-26T12:08:36.698131+0000","last_active":"2024-04-26T12:08:52.744650+0000","last_peered":"2024-04-26T12:08:52.744650+0000","last_clean":"2024-04-26T12:08:52.744650+0000","last_became_active":"2024-04-26T12:08:36.697698+0000","last_became_peered":"2024-04-26T12:08:36.697698+0000","last_unstale":"2024-04-26T12:08:52.744650+0000","last_undegraded":"2024-04-26T12:08:52.744650+0000","last_fullsized":"2024-04-26T12:08:52.744650+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:15.476036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'399","reported_seq":477,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743860+0000","last_change":"2024-04-26T12:08:40.705752+0000","last_active":"2024-04-26T12:08:52.743860+0000","last_peered":"2024-04-26T12:08:52.743860+0000","last_clean":"2024-04-26T12:08:52.743860+0000","last_became_active":"2024-04-26T12:08:40.703906+0000","last_became_peered":"2024-04-26T12:08:40.703906+0000","last_unstale":"2024-04-26T12:08:52.743860+0000","last_undegraded":"2024-04-26T12:08:52.743860+0000","last_fullsized":"2024-04-26T12:08:52.743860+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:19.004074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11720,"num_write":363,"num_write_kb":66914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"59'65","reported_seq":157,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745130+0000","last_change":"2024-04-26T12:08:36.699388+0000","last_active":"2024-04-26T12:08:52.745130+0000","last_peered":"2024-04-26T12:08:52.745130+0000","last_clean":"2024-04-26T12:08:52.745130+0000","last_became_active":"2024-04-26T12:08:36.699058+0000","last_became_peered":"2024-04-26T12:08:36.699058+0000","last_unstale":"2024-04-26T12:08:52.745130+0000","last_undegraded":"2024-04-26T12:08:52.745130+0000","last_fullsized":"2024-04-26T12:08:52.745130+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:11.978288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745047+0000","last_change":"2024-04-26T12:08:36.697618+0000","last_active":"2024-04-26T12:08:52.745047+0000","last_peered":"2024-04-26T12:08:52.745047+0000","last_clean":"2024-04-26T12:08:52.745047+0000","last_became_active":"2024-04-26T12:08:36.697407+0000","last_became_peered":"2024-04-26T12:08:36.697407+0000","last_unstale":"2024-04-26T12:08:52.745047+0000","last_undegraded":"2024-04-26T12:08:52.745047+0000","last_fullsized":"2024-04-26T12:08:52.745047+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:02.301767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'424","reported_seq":541,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744097+0000","last_change":"2024-04-26T12:05:03.789623+0000","last_active":"2024-04-26T12:08:52.744097+0000","last_peered":"2024-04-26T12:08:52.744097+0000","last_clean":"2024-04-26T12:08:52.744097+0000","last_became_active":"2024-04-26T12:05:03.789390+0000","last_became_peered":"2024-04-26T12:05:03.789390+0000","last_unstale":"2024-04-26T12:08:52.744097+0000","last_undegraded":"2024-04-26T12:08:52.744097+0000","last_fullsized":"2024-04-26T12:08:52.744097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17027,"num_write":386,"num_write_kb":58797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"61'70","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745116+0000","last_change":"2024-04-26T12:05:03.429222+0000","last_active":"2024-04-26T12:08:52.745116+0000","last_peered":"2024-04-26T12:08:52.745116+0000","last_clean":"2024-04-26T12:08:52.745116+0000","last_became_active":"2024-04-26T12:05:03.428803+0000","last_became_peered":"2024-04-26T12:05:03.428803+0000","last_unstale":"2024-04-26T12:08:52.745116+0000","last_undegraded":"2024-04-26T12:08:52.745116+0000","last_fullsized":"2024-04-26T12:08:52.745116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:31.305644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745750+0000","last_change":"2024-04-26T12:08:36.698775+0000","last_active":"2024-04-26T12:08:52.745750+0000","last_peered":"2024-04-26T12:08:52.745750+0000","last_clean":"2024-04-26T12:08:52.745750+0000","last_became_active":"2024-04-26T12:08:36.698523+0000","last_became_peered":"2024-04-26T12:08:36.698523+0000","last_unstale":"2024-04-26T12:08:52.745750+0000","last_undegraded":"2024-04-26T12:08:52.745750+0000","last_fullsized":"2024-04-26T12:08:52.745750+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:16.620901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'393","reported_seq":472,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744009+0000","last_change":"2024-04-26T12:08:40.705662+0000","last_active":"2024-04-26T12:08:52.744009+0000","last_peered":"2024-04-26T12:08:52.744009+0000","last_clean":"2024-04-26T12:08:52.744009+0000","last_became_active":"2024-04-26T12:08:40.703873+0000","last_became_peered":"2024-04-26T12:08:40.703873+0000","last_unstale":"2024-04-26T12:08:52.744009+0000","last_undegraded":"2024-04-26T12:08:52.744009+0000","last_fullsized":"2024-04-26T12:08:52.744009+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:27.057123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":11991,"num_write":357,"num_write_kb":83226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'419","reported_seq":892,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744937+0000","last_change":"2024-04-26T12:08:44.723692+0000","last_active":"2024-04-26T12:08:52.744937+0000","last_peered":"2024-04-26T12:08:52.744937+0000","last_clean":"2024-04-26T12:08:52.744937+0000","last_became_active":"2024-04-26T12:08:44.722574+0000","last_became_peered":"2024-04-26T12:08:44.722574+0000","last_unstale":"2024-04-26T12:08:52.744937+0000","last_undegraded":"2024-04-26T12:08:52.744937+0000","last_fullsized":"2024-04-26T12:08:52.744937+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:01.256055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14983,"num_write":376,"num_write_kb":76749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"61'398","reported_seq":507,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745436+0000","last_change":"2024-04-26T12:08:39.703851+0000","last_active":"2024-04-26T12:08:52.745436+0000","last_peered":"2024-04-26T12:08:52.745436+0000","last_clean":"2024-04-26T12:08:52.745436+0000","last_became_active":"2024-04-26T12:08:39.703516+0000","last_became_peered":"2024-04-26T12:08:39.703516+0000","last_unstale":"2024-04-26T12:08:52.745436+0000","last_undegraded":"2024-04-26T12:08:52.745436+0000","last_fullsized":"2024-04-26T12:08:52.745436+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:10.227718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699266,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":9692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9692849,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'428","reported_seq":940,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744179+0000","last_change":"2024-04-26T12:08:50.753473+0000","last_active":"2024-04-26T12:08:52.744179+0000","last_peered":"2024-04-26T12:08:52.744179+0000","last_clean":"2024-04-26T12:08:52.744179+0000","last_became_active":"2024-04-26T12:08:50.752328+0000","last_became_peered":"2024-04-26T12:08:50.752328+0000","last_unstale":"2024-04-26T12:08:52.744179+0000","last_undegraded":"2024-04-26T12:08:52.744179+0000","last_fullsized":"2024-04-26T12:08:52.744179+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:08.396108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":26594,"num_write":396,"num_write_kb":67932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"60'91","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744409+0000","last_change":"2024-04-26T12:08:36.722607+0000","last_active":"2024-04-26T12:08:52.744409+0000","last_peered":"2024-04-26T12:08:52.744409+0000","last_clean":"2024-04-26T12:08:52.744409+0000","last_became_active":"2024-04-26T12:08:36.697650+0000","last_became_peered":"2024-04-26T12:08:36.697650+0000","last_unstale":"2024-04-26T12:08:52.744409+0000","last_undegraded":"2024-04-26T12:08:52.744409+0000","last_fullsized":"2024-04-26T12:08:52.744409+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:10.718101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"59'316","reported_seq":394,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745553+0000","last_change":"2024-04-26T12:05:03.429257+0000","last_active":"2024-04-26T12:08:52.745553+0000","last_peered":"2024-04-26T12:08:52.745553+0000","last_clean":"2024-04-26T12:08:52.745553+0000","last_became_active":"2024-04-26T12:05:03.428921+0000","last_became_peered":"2024-04-26T12:05:03.428921+0000","last_unstale":"2024-04-26T12:08:52.745553+0000","last_undegraded":"2024-04-26T12:08:52.745553+0000","last_fullsized":"2024-04-26T12:08:52.745553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:49.774845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'495","reported_seq":625,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744089+0000","last_change":"2024-04-26T12:05:03.788141+0000","last_active":"2024-04-26T12:08:52.744089+0000","last_peered":"2024-04-26T12:08:52.744089+0000","last_clean":"2024-04-26T12:08:52.744089+0000","last_became_active":"2024-04-26T12:05:03.787533+0000","last_became_peered":"2024-04-26T12:05:03.787533+0000","last_unstale":"2024-04-26T12:08:52.744089+0000","last_undegraded":"2024-04-26T12:08:52.744089+0000","last_fullsized":"2024-04-26T12:08:52.744089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37174,"num_write":458,"num_write_kb":125832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'51","reported_seq":129,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745033+0000","last_change":"2024-04-26T12:05:03.428971+0000","last_active":"2024-04-26T12:08:52.745033+0000","last_peered":"2024-04-26T12:08:52.745033+0000","last_clean":"2024-04-26T12:08:52.745033+0000","last_became_active":"2024-04-26T12:05:03.428445+0000","last_became_peered":"2024-04-26T12:05:03.428445+0000","last_unstale":"2024-04-26T12:08:52.745033+0000","last_undegraded":"2024-04-26T12:08:52.745033+0000","last_fullsized":"2024-04-26T12:08:52.745033+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'482","reported_seq":1130,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744097+0000","last_change":"2024-04-26T12:08:48.741589+0000","last_active":"2024-04-26T12:08:52.744097+0000","last_peered":"2024-04-26T12:08:52.744097+0000","last_clean":"2024-04-26T12:08:52.744097+0000","last_became_active":"2024-04-26T12:08:48.740055+0000","last_became_peered":"2024-04-26T12:08:48.740055+0000","last_unstale":"2024-04-26T12:08:52.744097+0000","last_undegraded":"2024-04-26T12:08:52.744097+0000","last_fullsized":"2024-04-26T12:08:52.744097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:03.903516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":61972,"num_write":459,"num_write_kb":125797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"60'392","reported_seq":527,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744471+0000","last_change":"2024-04-26T12:08:43.718939+0000","last_active":"2024-04-26T12:08:52.744471+0000","last_peered":"2024-04-26T12:08:52.744471+0000","last_clean":"2024-04-26T12:08:52.744471+0000","last_became_active":"2024-04-26T12:08:43.717109+0000","last_became_peered":"2024-04-26T12:08:43.717109+0000","last_unstale":"2024-04-26T12:08:52.744471+0000","last_undegraded":"2024-04-26T12:08:52.744471+0000","last_fullsized":"2024-04-26T12:08:52.744471+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:14.846653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":37910,"num_write":366,"num_write_kb":84111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"59'709","reported_seq":813,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744368+0000","last_change":"2024-04-26T12:08:39.701978+0000","last_active":"2024-04-26T12:08:52.744368+0000","last_peered":"2024-04-26T12:08:52.744368+0000","last_clean":"2024-04-26T12:08:52.744368+0000","last_became_active":"2024-04-26T12:08:39.700927+0000","last_became_peered":"2024-04-26T12:08:39.700927+0000","last_unstale":"2024-04-26T12:08:52.744368+0000","last_undegraded":"2024-04-26T12:08:52.744368+0000","last_fullsized":"2024-04-26T12:08:52.744368+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:10.815597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"60'435","reported_seq":572,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744787+0000","last_change":"2024-04-26T12:05:03.788754+0000","last_active":"2024-04-26T12:08:52.744787+0000","last_peered":"2024-04-26T12:08:52.744787+0000","last_clean":"2024-04-26T12:08:52.744787+0000","last_became_active":"2024-04-26T12:05:03.788311+0000","last_became_peered":"2024-04-26T12:05:03.788311+0000","last_unstale":"2024-04-26T12:08:52.744787+0000","last_undegraded":"2024-04-26T12:08:52.744787+0000","last_fullsized":"2024-04-26T12:08:52.744787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":28462,"num_write":403,"num_write_kb":93779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"59'262","reported_seq":340,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744211+0000","last_change":"2024-04-26T12:05:03.428810+0000","last_active":"2024-04-26T12:08:52.744211+0000","last_peered":"2024-04-26T12:08:52.744211+0000","last_clean":"2024-04-26T12:08:52.744211+0000","last_became_active":"2024-04-26T12:05:03.428191+0000","last_became_peered":"2024-04-26T12:05:03.428191+0000","last_unstale":"2024-04-26T12:08:52.744211+0000","last_undegraded":"2024-04-26T12:08:52.744211+0000","last_fullsized":"2024-04-26T12:08:52.744211+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"60'399","reported_seq":499,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744294+0000","last_change":"2024-04-26T12:08:49.742459+0000","last_active":"2024-04-26T12:08:52.744294+0000","last_peered":"2024-04-26T12:08:52.744294+0000","last_clean":"2024-04-26T12:08:52.744294+0000","last_became_active":"2024-04-26T12:08:49.740536+0000","last_became_peered":"2024-04-26T12:08:49.740536+0000","last_unstale":"2024-04-26T12:08:52.744294+0000","last_undegraded":"2024-04-26T12:08:52.744294+0000","last_fullsized":"2024-04-26T12:08:52.744294+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:24.169669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22216,"num_write":357,"num_write_kb":75245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"59'430","reported_seq":490,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743876+0000","last_change":"2024-04-26T12:08:39.703050+0000","last_active":"2024-04-26T12:08:52.743876+0000","last_peered":"2024-04-26T12:08:52.743876+0000","last_clean":"2024-04-26T12:08:52.743876+0000","last_became_active":"2024-04-26T12:08:39.702529+0000","last_became_peered":"2024-04-26T12:08:39.702529+0000","last_unstale":"2024-04-26T12:08:52.743876+0000","last_undegraded":"2024-04-26T12:08:52.743876+0000","last_fullsized":"2024-04-26T12:08:52.743876+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:28.249725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":12514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"60'387","reported_seq":476,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744228+0000","last_change":"2024-04-26T12:08:43.720098+0000","last_active":"2024-04-26T12:08:52.744228+0000","last_peered":"2024-04-26T12:08:52.744228+0000","last_clean":"2024-04-26T12:08:52.744228+0000","last_became_active":"2024-04-26T12:08:43.717442+0000","last_became_peered":"2024-04-26T12:08:43.717442+0000","last_unstale":"2024-04-26T12:08:52.744228+0000","last_undegraded":"2024-04-26T12:08:52.744228+0000","last_fullsized":"2024-04-26T12:08:52.744228+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:13.140334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20720,"num_write":352,"num_write_kb":87643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"59'58","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743900+0000","last_change":"2024-04-26T12:08:36.720540+0000","last_active":"2024-04-26T12:08:52.743900+0000","last_peered":"2024-04-26T12:08:52.743900+0000","last_clean":"2024-04-26T12:08:52.743900+0000","last_became_active":"2024-04-26T12:08:36.693399+0000","last_became_peered":"2024-04-26T12:08:36.693399+0000","last_unstale":"2024-04-26T12:08:52.743900+0000","last_undegraded":"2024-04-26T12:08:52.743900+0000","last_fullsized":"2024-04-26T12:08:52.743900+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:14.949002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"60'356","reported_seq":452,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744945+0000","last_change":"2024-04-26T12:05:03.791986+0000","last_active":"2024-04-26T12:08:52.744945+0000","last_peered":"2024-04-26T12:08:52.744945+0000","last_clean":"2024-04-26T12:08:52.744945+0000","last_became_active":"2024-04-26T12:05:03.790823+0000","last_became_peered":"2024-04-26T12:05:03.790823+0000","last_unstale":"2024-04-26T12:08:52.744945+0000","last_undegraded":"2024-04-26T12:08:52.744945+0000","last_fullsized":"2024-04-26T12:08:52.744945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9641,"num_write":326,"num_write_kb":29574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"59'309","reported_seq":387,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745394+0000","last_change":"2024-04-26T12:05:03.429469+0000","last_active":"2024-04-26T12:08:52.745394+0000","last_peered":"2024-04-26T12:08:52.745394+0000","last_clean":"2024-04-26T12:08:52.745394+0000","last_became_active":"2024-04-26T12:05:03.429015+0000","last_became_peered":"2024-04-26T12:05:03.429015+0000","last_unstale":"2024-04-26T12:08:52.745394+0000","last_undegraded":"2024-04-26T12:08:52.745394+0000","last_fullsized":"2024-04-26T12:08:52.745394+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'433","reported_seq":575,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745025+0000","last_change":"2024-04-26T12:05:03.791929+0000","last_active":"2024-04-26T12:08:52.745025+0000","last_peered":"2024-04-26T12:08:52.745025+0000","last_clean":"2024-04-26T12:08:52.745025+0000","last_became_active":"2024-04-26T12:05:03.791540+0000","last_became_peered":"2024-04-26T12:05:03.791540+0000","last_unstale":"2024-04-26T12:08:52.745025+0000","last_undegraded":"2024-04-26T12:08:52.745025+0000","last_fullsized":"2024-04-26T12:08:52.745025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":47864,"num_write":399,"num_write_kb":92193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"59'382","reported_seq":449,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744180+0000","last_change":"2024-04-26T12:08:39.704680+0000","last_active":"2024-04-26T12:08:52.744180+0000","last_peered":"2024-04-26T12:08:52.744180+0000","last_clean":"2024-04-26T12:08:52.744180+0000","last_became_active":"2024-04-26T12:08:39.704404+0000","last_became_peered":"2024-04-26T12:08:39.704404+0000","last_unstale":"2024-04-26T12:08:52.744180+0000","last_undegraded":"2024-04-26T12:08:52.744180+0000","last_fullsized":"2024-04-26T12:08:52.744180+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:01.830043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":12467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'425","reported_seq":544,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743855+0000","last_change":"2024-04-26T12:08:47.737376+0000","last_active":"2024-04-26T12:08:52.743855+0000","last_peered":"2024-04-26T12:08:52.743855+0000","last_clean":"2024-04-26T12:08:52.743855+0000","last_became_active":"2024-04-26T12:08:47.735367+0000","last_became_peered":"2024-04-26T12:08:47.735367+0000","last_unstale":"2024-04-26T12:08:52.743855+0000","last_undegraded":"2024-04-26T12:08:52.743855+0000","last_fullsized":"2024-04-26T12:08:52.743855+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:35.420647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":38065,"num_write":387,"num_write_kb":71445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"59'126","reported_seq":229,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744930+0000","last_change":"2024-04-26T12:08:39.702212+0000","last_active":"2024-04-26T12:08:52.744930+0000","last_peered":"2024-04-26T12:08:52.744930+0000","last_clean":"2024-04-26T12:08:52.744930+0000","last_became_active":"2024-04-26T12:08:39.701900+0000","last_became_peered":"2024-04-26T12:08:39.701900+0000","last_unstale":"2024-04-26T12:08:52.744930+0000","last_undegraded":"2024-04-26T12:08:52.744930+0000","last_fullsized":"2024-04-26T12:08:52.744930+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:28.460358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"60'448","reported_seq":548,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744703+0000","last_change":"2024-04-26T12:05:03.791827+0000","last_active":"2024-04-26T12:08:52.744703+0000","last_peered":"2024-04-26T12:08:52.744703+0000","last_clean":"2024-04-26T12:08:52.744703+0000","last_became_active":"2024-04-26T12:05:03.791442+0000","last_became_peered":"2024-04-26T12:05:03.791442+0000","last_unstale":"2024-04-26T12:08:52.744703+0000","last_undegraded":"2024-04-26T12:08:52.744703+0000","last_fullsized":"2024-04-26T12:08:52.744703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11191,"num_write":416,"num_write_kb":67272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"59'56","reported_seq":134,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744927+0000","last_change":"2024-04-26T12:05:03.430659+0000","last_active":"2024-04-26T12:08:52.744927+0000","last_peered":"2024-04-26T12:08:52.744927+0000","last_clean":"2024-04-26T12:08:52.744927+0000","last_became_active":"2024-04-26T12:05:03.430164+0000","last_became_peered":"2024-04-26T12:05:03.430164+0000","last_unstale":"2024-04-26T12:08:52.744927+0000","last_undegraded":"2024-04-26T12:08:52.744927+0000","last_fullsized":"2024-04-26T12:08:52.744927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2734,"num_read_kb":1486856,"num_write":24627,"num_write_kb":4487808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7440,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26722,"ondisk_log_size":26722,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128606591,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":5972,"num_write_kb":129691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64376832,"data_stored":257213182,"data_compressed":19249503,"data_compressed_allocated":31694848,"data_compressed_original":224591872,"omap_allocated":4411,"internal_metadata":0},"log_size":7828,"ondisk_log_size":7828,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738422,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134436,"kb_used_data":27092,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94237404,"statfs":{"total":96636764160,"available":96499101696,"internally_reserved":0,"allocated":27742208,"data_stored":91797602,"data_compressed":6340284,"data_compressed_allocated":11272192,"data_compressed_original":75763712,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:08:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.40899999999999997,"15min":0.439},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.39900000000000002,"15min":0.42599999999999999},"min":{"1min":0.19,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.51700000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Apr 26 12:05:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.436},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.41699999999999998}]}]},{"osd":1,"up_from":66,"seq":283467841542,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68516,"kb_used_data":10644,"kb_used_omap":5,"kb_used_meta":57850,"kb_avail":94303324,"statfs":{"total":96636764160,"available":96566603776,"internally_reserved":0,"allocated":10899456,"data_stored":86136667,"data_compressed":7182940,"data_compressed_allocated":10076160,"data_compressed_original":85745664,"omap_allocated":6005,"internal_metadata":59238539},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138888,"kb_used_data":27452,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232952,"statfs":{"total":96636764160,"available":96494542848,"internally_reserved":0,"allocated":28110848,"data_stored":81507786,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:05:55 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Apr 26 12:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42399999999999999,"15min":0.435},"min":{"1min":0.16200000000000001,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.433,"15min":0.433},"min":{"1min":0.20599999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.48299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27357184,"data_stored":81158407,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10088448,"data_stored":85196920,"data_compressed":7176942,"data_compressed_allocated":10039296,"data_compressed_original":85172224,"omap_allocated":4411,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26931200,"data_stored":90857855,"data_compressed":6334286,"data_compressed_allocated":11235328,"data_compressed_original":75190272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:09:01.756 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:09:02.067 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:09:02.069 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:09:02.079 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":207,"stamp":"2024-04-26T12:09:00.393467+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129196959,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2917,"num_read_kb":1488438,"num_write":30802,"num_write_kb":4620959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7463,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34707,"ondisk_log_size":34707,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":341840,"kb_used_data":65188,"kb_used_omap":8,"kb_used_meta":276599,"kb_avail":282773680,"statfs":{"total":289910292480,"available":289560248320,"internally_reserved":0,"allocated":66752512,"data_stored":259442055,"data_compressed":19261499,"data_compressed_allocated":31768576,"data_compressed_original":225738752,"omap_allocated":9193,"internal_metadata":283237399},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":505,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001767"},"pg_stats":[{"pgid":"4.3f","version":"60'426","reported_seq":507,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744715+0000","last_change":"2024-04-26T12:08:51.753936+0000","last_active":"2024-04-26T12:08:52.744715+0000","last_peered":"2024-04-26T12:08:52.744715+0000","last_clean":"2024-04-26T12:08:52.744715+0000","last_became_active":"2024-04-26T12:08:51.750917+0000","last_became_peered":"2024-04-26T12:08:51.750917+0000","last_unstale":"2024-04-26T12:08:52.744715+0000","last_undegraded":"2024-04-26T12:08:52.744715+0000","last_fullsized":"2024-04-26T12:08:52.744715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:21.716324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9964,"num_write":393,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"60'470","reported_seq":601,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744464+0000","last_change":"2024-04-26T12:08:43.719204+0000","last_active":"2024-04-26T12:08:52.744464+0000","last_peered":"2024-04-26T12:08:52.744464+0000","last_clean":"2024-04-26T12:08:52.744464+0000","last_became_active":"2024-04-26T12:08:43.717325+0000","last_became_peered":"2024-04-26T12:08:43.717325+0000","last_unstale":"2024-04-26T12:08:52.744464+0000","last_undegraded":"2024-04-26T12:08:52.744464+0000","last_fullsized":"2024-04-26T12:08:52.744464+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:57.396493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":34556,"num_write":444,"num_write_kb":129697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"60'370","reported_seq":802,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745315+0000","last_change":"2024-04-26T12:08:50.753639+0000","last_active":"2024-04-26T12:08:52.745315+0000","last_peered":"2024-04-26T12:08:52.745315+0000","last_clean":"2024-04-26T12:08:52.745315+0000","last_became_active":"2024-04-26T12:08:50.752468+0000","last_became_peered":"2024-04-26T12:08:50.752468+0000","last_unstale":"2024-04-26T12:08:52.745315+0000","last_undegraded":"2024-04-26T12:08:52.745315+0000","last_fullsized":"2024-04-26T12:08:52.745315+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:54.514768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":349,"num_write_kb":51115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"60'377","reported_seq":485,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745318+0000","last_change":"2024-04-26T12:05:03.791234+0000","last_active":"2024-04-26T12:08:52.745318+0000","last_peered":"2024-04-26T12:08:52.745318+0000","last_clean":"2024-04-26T12:08:52.745318+0000","last_became_active":"2024-04-26T12:05:03.790717+0000","last_became_peered":"2024-04-26T12:05:03.790717+0000","last_unstale":"2024-04-26T12:08:52.745318+0000","last_undegraded":"2024-04-26T12:08:52.745318+0000","last_fullsized":"2024-04-26T12:08:52.745318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:52.358881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17376,"num_write":341,"num_write_kb":46680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'445","reported_seq":550,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743965+0000","last_change":"2024-04-26T12:08:39.705318+0000","last_active":"2024-04-26T12:08:52.743965+0000","last_peered":"2024-04-26T12:08:52.743965+0000","last_clean":"2024-04-26T12:08:52.743965+0000","last_became_active":"2024-04-26T12:08:39.702117+0000","last_became_peered":"2024-04-26T12:08:39.702117+0000","last_unstale":"2024-04-26T12:08:52.743965+0000","last_undegraded":"2024-04-26T12:08:52.743965+0000","last_fullsized":"2024-04-26T12:08:52.743965+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:39.986313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24197,"num_write":416,"num_write_kb":80466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"60'375","reported_seq":470,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744643+0000","last_change":"2024-04-26T12:05:03.791560+0000","last_active":"2024-04-26T12:08:52.744643+0000","last_peered":"2024-04-26T12:08:52.744643+0000","last_clean":"2024-04-26T12:08:52.744643+0000","last_became_active":"2024-04-26T12:05:03.790578+0000","last_became_peered":"2024-04-26T12:05:03.790578+0000","last_unstale":"2024-04-26T12:08:52.744643+0000","last_undegraded":"2024-04-26T12:08:52.744643+0000","last_fullsized":"2024-04-26T12:08:52.744643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6518,"num_write":348,"num_write_kb":38078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'428","reported_seq":524,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744809+0000","last_change":"2024-04-26T12:05:03.791215+0000","last_active":"2024-04-26T12:08:52.744809+0000","last_peered":"2024-04-26T12:08:52.744809+0000","last_clean":"2024-04-26T12:08:52.744809+0000","last_became_active":"2024-04-26T12:05:03.790615+0000","last_became_peered":"2024-04-26T12:05:03.790615+0000","last_unstale":"2024-04-26T12:08:52.744809+0000","last_undegraded":"2024-04-26T12:08:52.744809+0000","last_fullsized":"2024-04-26T12:08:52.744809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:55.388027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12560,"num_write":398,"num_write_kb":67332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"60'387","reported_seq":526,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744454+0000","last_change":"2024-04-26T12:05:03.785861+0000","last_active":"2024-04-26T12:08:52.744454+0000","last_peered":"2024-04-26T12:08:52.744454+0000","last_clean":"2024-04-26T12:08:52.744454+0000","last_became_active":"2024-04-26T12:05:03.785382+0000","last_became_peered":"2024-04-26T12:05:03.785382+0000","last_unstale":"2024-04-26T12:08:52.744454+0000","last_undegraded":"2024-04-26T12:08:52.744454+0000","last_fullsized":"2024-04-26T12:08:52.744454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:51.870183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":41160,"num_write":356,"num_write_kb":80219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"60'405","reported_seq":900,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744722+0000","last_change":"2024-04-26T12:08:46.730220+0000","last_active":"2024-04-26T12:08:52.744722+0000","last_peered":"2024-04-26T12:08:52.744722+0000","last_clean":"2024-04-26T12:08:52.744722+0000","last_became_active":"2024-04-26T12:08:46.729039+0000","last_became_peered":"2024-04-26T12:08:46.729039+0000","last_unstale":"2024-04-26T12:08:52.744722+0000","last_undegraded":"2024-04-26T12:08:52.744722+0000","last_fullsized":"2024-04-26T12:08:52.744722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:00.707126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":11674,"num_write":372,"num_write_kb":34604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"60'425","reported_seq":577,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744378+0000","last_change":"2024-04-26T12:08:41.718786+0000","last_active":"2024-04-26T12:08:52.744378+0000","last_peered":"2024-04-26T12:08:52.744378+0000","last_clean":"2024-04-26T12:08:52.744378+0000","last_became_active":"2024-04-26T12:08:41.716014+0000","last_became_peered":"2024-04-26T12:08:41.716014+0000","last_unstale":"2024-04-26T12:08:52.744378+0000","last_undegraded":"2024-04-26T12:08:52.744378+0000","last_fullsized":"2024-04-26T12:08:52.744378+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:20.096806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":48419,"num_write":390,"num_write_kb":92286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"60'372","reported_seq":489,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745403+0000","last_change":"2024-04-26T12:05:03.791046+0000","last_active":"2024-04-26T12:08:52.745403+0000","last_peered":"2024-04-26T12:08:52.745403+0000","last_clean":"2024-04-26T12:08:52.745403+0000","last_became_active":"2024-04-26T12:05:03.790662+0000","last_became_peered":"2024-04-26T12:05:03.790662+0000","last_unstale":"2024-04-26T12:08:52.745403+0000","last_undegraded":"2024-04-26T12:08:52.745403+0000","last_fullsized":"2024-04-26T12:08:52.745403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:35.458663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25905,"num_write":353,"num_write_kb":75437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'351","reported_seq":426,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744359+0000","last_change":"2024-04-26T12:08:41.718349+0000","last_active":"2024-04-26T12:08:52.744359+0000","last_peered":"2024-04-26T12:08:52.744359+0000","last_clean":"2024-04-26T12:08:52.744359+0000","last_became_active":"2024-04-26T12:08:41.715726+0000","last_became_peered":"2024-04-26T12:08:41.715726+0000","last_unstale":"2024-04-26T12:08:52.744359+0000","last_undegraded":"2024-04-26T12:08:52.744359+0000","last_fullsized":"2024-04-26T12:08:52.744359+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:00.589164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8884,"num_write":327,"num_write_kb":58289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"60'405","reported_seq":485,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744109+0000","last_change":"2024-04-26T12:08:39.705153+0000","last_active":"2024-04-26T12:08:52.744109+0000","last_peered":"2024-04-26T12:08:52.744109+0000","last_clean":"2024-04-26T12:08:52.744109+0000","last_became_active":"2024-04-26T12:08:39.702141+0000","last_became_peered":"2024-04-26T12:08:39.702141+0000","last_unstale":"2024-04-26T12:08:52.744109+0000","last_undegraded":"2024-04-26T12:08:52.744109+0000","last_fullsized":"2024-04-26T12:08:52.744109+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:42.807520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6771,"num_write":372,"num_write_kb":54786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"60'431","reported_seq":937,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745087+0000","last_change":"2024-04-26T12:08:48.741419+0000","last_active":"2024-04-26T12:08:52.745087+0000","last_peered":"2024-04-26T12:08:52.745087+0000","last_clean":"2024-04-26T12:08:52.745087+0000","last_became_active":"2024-04-26T12:08:48.740170+0000","last_became_peered":"2024-04-26T12:08:48.740170+0000","last_unstale":"2024-04-26T12:08:52.745087+0000","last_undegraded":"2024-04-26T12:08:52.745087+0000","last_fullsized":"2024-04-26T12:08:52.745087+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:52.026016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26572,"num_write":398,"num_write_kb":83974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'394","reported_seq":896,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744941+0000","last_change":"2024-04-26T12:08:41.717703+0000","last_active":"2024-04-26T12:08:52.744941+0000","last_peered":"2024-04-26T12:08:52.744941+0000","last_clean":"2024-04-26T12:08:52.744941+0000","last_became_active":"2024-04-26T12:08:41.715956+0000","last_became_peered":"2024-04-26T12:08:41.715956+0000","last_unstale":"2024-04-26T12:08:52.744941+0000","last_undegraded":"2024-04-26T12:08:52.744941+0000","last_fullsized":"2024-04-26T12:08:52.744941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:34.291197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":38136,"num_write":355,"num_write_kb":38484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'432","reported_seq":543,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744458+0000","last_change":"2024-04-26T12:05:03.786360+0000","last_active":"2024-04-26T12:08:52.744458+0000","last_peered":"2024-04-26T12:08:52.744458+0000","last_clean":"2024-04-26T12:08:52.744458+0000","last_became_active":"2024-04-26T12:05:03.785991+0000","last_became_peered":"2024-04-26T12:05:03.785991+0000","last_unstale":"2024-04-26T12:08:52.744458+0000","last_undegraded":"2024-04-26T12:08:52.744458+0000","last_fullsized":"2024-04-26T12:08:52.744458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:17.702068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18244,"num_write":400,"num_write_kb":59033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'381","reported_seq":838,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.747343+0000","last_change":"2024-04-26T12:08:52.747060+0000","last_active":"2024-04-26T12:08:52.747343+0000","last_peered":"2024-04-26T12:08:52.747343+0000","last_clean":"2024-04-26T12:08:52.747343+0000","last_became_active":"2024-04-26T12:08:52.745913+0000","last_became_peered":"2024-04-26T12:08:52.745913+0000","last_unstale":"2024-04-26T12:08:52.747343+0000","last_undegraded":"2024-04-26T12:08:52.747343+0000","last_fullsized":"2024-04-26T12:08:52.747343+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:30.065406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":350,"num_write_kb":21212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"60'424","reported_seq":514,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744398+0000","last_change":"2024-04-26T12:08:42.718639+0000","last_active":"2024-04-26T12:08:52.744398+0000","last_peered":"2024-04-26T12:08:52.744398+0000","last_clean":"2024-04-26T12:08:52.744398+0000","last_became_active":"2024-04-26T12:08:42.716846+0000","last_became_peered":"2024-04-26T12:08:42.716846+0000","last_unstale":"2024-04-26T12:08:52.744398+0000","last_undegraded":"2024-04-26T12:08:52.744398+0000","last_fullsized":"2024-04-26T12:08:52.744398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:00.928679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13930,"num_write":388,"num_write_kb":116055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'426","reported_seq":905,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.748530+0000","last_change":"2024-04-26T12:08:53.748530+0000","last_active":"2024-04-26T12:08:53.748530+0000","last_peered":"2024-04-26T12:08:53.748530+0000","last_clean":"2024-04-26T12:08:53.748530+0000","last_became_active":"2024-04-26T12:08:53.747215+0000","last_became_peered":"2024-04-26T12:08:53.747215+0000","last_unstale":"2024-04-26T12:08:53.748530+0000","last_undegraded":"2024-04-26T12:08:53.748530+0000","last_fullsized":"2024-04-26T12:08:53.748530+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:14.637610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26908,"num_write":383,"num_write_kb":71324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"60'425","reported_seq":546,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745178+0000","last_change":"2024-04-26T12:05:03.792219+0000","last_active":"2024-04-26T12:08:52.745178+0000","last_peered":"2024-04-26T12:08:52.745178+0000","last_clean":"2024-04-26T12:08:52.745178+0000","last_became_active":"2024-04-26T12:05:03.791061+0000","last_became_peered":"2024-04-26T12:05:03.791061+0000","last_unstale":"2024-04-26T12:08:52.745178+0000","last_undegraded":"2024-04-26T12:08:52.745178+0000","last_fullsized":"2024-04-26T12:08:52.745178+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19715,"num_write":398,"num_write_kb":30150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'450","reported_seq":638,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745086+0000","last_change":"2024-04-26T12:05:03.792073+0000","last_active":"2024-04-26T12:08:52.745086+0000","last_peered":"2024-04-26T12:08:52.745086+0000","last_clean":"2024-04-26T12:08:52.745086+0000","last_became_active":"2024-04-26T12:05:03.791693+0000","last_became_peered":"2024-04-26T12:05:03.791693+0000","last_unstale":"2024-04-26T12:08:52.745086+0000","last_undegraded":"2024-04-26T12:08:52.745086+0000","last_fullsized":"2024-04-26T12:08:52.745086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":65124,"num_write":423,"num_write_kb":142714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'434","reported_seq":538,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744125+0000","last_change":"2024-04-26T12:08:46.730582+0000","last_active":"2024-04-26T12:08:52.744125+0000","last_peered":"2024-04-26T12:08:52.744125+0000","last_clean":"2024-04-26T12:08:52.744125+0000","last_became_active":"2024-04-26T12:08:46.728804+0000","last_became_peered":"2024-04-26T12:08:46.728804+0000","last_unstale":"2024-04-26T12:08:52.744125+0000","last_undegraded":"2024-04-26T12:08:52.744125+0000","last_fullsized":"2024-04-26T12:08:52.744125+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:47.745435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":15350,"num_write":405,"num_write_kb":59295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"60'424","reported_seq":537,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743999+0000","last_change":"2024-04-26T12:05:03.788658+0000","last_active":"2024-04-26T12:08:52.743999+0000","last_peered":"2024-04-26T12:08:52.743999+0000","last_clean":"2024-04-26T12:08:52.743999+0000","last_became_active":"2024-04-26T12:05:03.788050+0000","last_became_peered":"2024-04-26T12:05:03.788050+0000","last_unstale":"2024-04-26T12:08:52.743999+0000","last_undegraded":"2024-04-26T12:08:52.743999+0000","last_fullsized":"2024-04-26T12:08:52.743999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23772,"num_write":390,"num_write_kb":67944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"60'447","reported_seq":526,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743819+0000","last_change":"2024-04-26T12:08:40.707153+0000","last_active":"2024-04-26T12:08:52.743819+0000","last_peered":"2024-04-26T12:08:52.743819+0000","last_clean":"2024-04-26T12:08:52.743819+0000","last_became_active":"2024-04-26T12:08:40.703880+0000","last_became_peered":"2024-04-26T12:08:40.703880+0000","last_unstale":"2024-04-26T12:08:52.743819+0000","last_undegraded":"2024-04-26T12:08:52.743819+0000","last_fullsized":"2024-04-26T12:08:52.743819+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:25.187022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9403,"num_write":417,"num_write_kb":67425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"60'417","reported_seq":507,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744515+0000","last_change":"2024-04-26T12:08:42.717934+0000","last_active":"2024-04-26T12:08:52.744515+0000","last_peered":"2024-04-26T12:08:52.744515+0000","last_clean":"2024-04-26T12:08:52.744515+0000","last_became_active":"2024-04-26T12:08:42.715812+0000","last_became_peered":"2024-04-26T12:08:42.715812+0000","last_unstale":"2024-04-26T12:08:52.744515+0000","last_undegraded":"2024-04-26T12:08:52.744515+0000","last_fullsized":"2024-04-26T12:08:52.744515+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:09.442852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20466,"num_write":400,"num_write_kb":42225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"60'475","reported_seq":604,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744858+0000","last_change":"2024-04-26T12:05:03.787909+0000","last_active":"2024-04-26T12:08:52.744858+0000","last_peered":"2024-04-26T12:08:52.744858+0000","last_clean":"2024-04-26T12:08:52.744858+0000","last_became_active":"2024-04-26T12:05:03.787562+0000","last_became_peered":"2024-04-26T12:05:03.787562+0000","last_unstale":"2024-04-26T12:08:52.744858+0000","last_undegraded":"2024-04-26T12:08:52.744858+0000","last_fullsized":"2024-04-26T12:08:52.744858+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25186,"num_write":431,"num_write_kb":48184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"60'409","reported_seq":897,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745514+0000","last_change":"2024-04-26T12:08:49.741823+0000","last_active":"2024-04-26T12:08:52.745514+0000","last_peered":"2024-04-26T12:08:52.745514+0000","last_clean":"2024-04-26T12:08:52.745514+0000","last_became_active":"2024-04-26T12:08:49.740497+0000","last_became_peered":"2024-04-26T12:08:49.740497+0000","last_unstale":"2024-04-26T12:08:52.745514+0000","last_undegraded":"2024-04-26T12:08:52.745514+0000","last_fullsized":"2024-04-26T12:08:52.745514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:00.225872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":20137,"num_write":374,"num_write_kb":55441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'392","reported_seq":493,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744357+0000","last_change":"2024-04-26T12:08:47.737270+0000","last_active":"2024-04-26T12:08:52.744357+0000","last_peered":"2024-04-26T12:08:52.744357+0000","last_clean":"2024-04-26T12:08:52.744357+0000","last_became_active":"2024-04-26T12:08:47.735361+0000","last_became_peered":"2024-04-26T12:08:47.735361+0000","last_unstale":"2024-04-26T12:08:52.744357+0000","last_undegraded":"2024-04-26T12:08:52.744357+0000","last_fullsized":"2024-04-26T12:08:52.744357+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:09.838696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29179,"num_write":355,"num_write_kb":59011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'380","reported_seq":840,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744489+0000","last_change":"2024-04-26T12:08:41.717953+0000","last_active":"2024-04-26T12:08:52.744489+0000","last_peered":"2024-04-26T12:08:52.744489+0000","last_clean":"2024-04-26T12:08:52.744489+0000","last_became_active":"2024-04-26T12:08:41.716234+0000","last_became_peered":"2024-04-26T12:08:41.716234+0000","last_unstale":"2024-04-26T12:08:52.744489+0000","last_undegraded":"2024-04-26T12:08:52.744489+0000","last_fullsized":"2024-04-26T12:08:52.744489+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:37.480062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13036,"num_write":347,"num_write_kb":33880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"60'461","reported_seq":565,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744026+0000","last_change":"2024-04-26T12:08:46.732653+0000","last_active":"2024-04-26T12:08:52.744026+0000","last_peered":"2024-04-26T12:08:52.744026+0000","last_clean":"2024-04-26T12:08:52.744026+0000","last_became_active":"2024-04-26T12:08:46.730738+0000","last_became_peered":"2024-04-26T12:08:46.730738+0000","last_unstale":"2024-04-26T12:08:52.744026+0000","last_undegraded":"2024-04-26T12:08:52.744026+0000","last_fullsized":"2024-04-26T12:08:52.744026+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:46.177056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":32945,"num_write":426,"num_write_kb":63234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"60'411","reported_seq":901,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744088+0000","last_change":"2024-04-26T12:08:40.704958+0000","last_active":"2024-04-26T12:08:52.744088+0000","last_peered":"2024-04-26T12:08:52.744088+0000","last_clean":"2024-04-26T12:08:52.744088+0000","last_became_active":"2024-04-26T12:08:40.703845+0000","last_became_peered":"2024-04-26T12:08:40.703845+0000","last_unstale":"2024-04-26T12:08:52.744088+0000","last_undegraded":"2024-04-26T12:08:52.744088+0000","last_fullsized":"2024-04-26T12:08:52.744088+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:56.148477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11499,"num_write":377,"num_write_kb":34249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'430","reported_seq":538,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744573+0000","last_change":"2024-04-26T12:05:03.791605+0000","last_active":"2024-04-26T12:08:52.744573+0000","last_peered":"2024-04-26T12:08:52.744573+0000","last_clean":"2024-04-26T12:08:52.744573+0000","last_became_active":"2024-04-26T12:05:03.791251+0000","last_became_peered":"2024-04-26T12:05:03.791251+0000","last_unstale":"2024-04-26T12:08:52.744573+0000","last_undegraded":"2024-04-26T12:08:52.744573+0000","last_fullsized":"2024-04-26T12:08:52.744573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:27.239868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14660,"num_write":404,"num_write_kb":60840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"60'392","reported_seq":500,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744114+0000","last_change":"2024-04-26T12:08:44.723861+0000","last_active":"2024-04-26T12:08:52.744114+0000","last_peered":"2024-04-26T12:08:52.744114+0000","last_clean":"2024-04-26T12:08:52.744114+0000","last_became_active":"2024-04-26T12:08:44.722120+0000","last_became_peered":"2024-04-26T12:08:44.722120+0000","last_unstale":"2024-04-26T12:08:52.744114+0000","last_undegraded":"2024-04-26T12:08:52.744114+0000","last_fullsized":"2024-04-26T12:08:52.744114+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:12.810713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31703,"num_write":351,"num_write_kb":59324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"59'514","reported_seq":592,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745155+0000","last_change":"2024-04-26T12:05:03.430021+0000","last_active":"2024-04-26T12:08:52.745155+0000","last_peered":"2024-04-26T12:08:52.745155+0000","last_clean":"2024-04-26T12:08:52.745155+0000","last_became_active":"2024-04-26T12:05:03.429695+0000","last_became_peered":"2024-04-26T12:05:03.429695+0000","last_unstale":"2024-04-26T12:08:52.745155+0000","last_undegraded":"2024-04-26T12:08:52.745155+0000","last_fullsized":"2024-04-26T12:08:52.745155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":8377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'432","reported_seq":522,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.751086+0000","last_change":"2024-04-26T12:08:53.751086+0000","last_active":"2024-04-26T12:08:53.751086+0000","last_peered":"2024-04-26T12:08:53.751086+0000","last_clean":"2024-04-26T12:08:53.751086+0000","last_became_active":"2024-04-26T12:08:53.748972+0000","last_became_peered":"2024-04-26T12:08:53.748972+0000","last_unstale":"2024-04-26T12:08:53.751086+0000","last_undegraded":"2024-04-26T12:08:53.751086+0000","last_fullsized":"2024-04-26T12:08:53.751086+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:34.448806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":30094,"num_write":388,"num_write_kb":83741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"59'55","reported_seq":133,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744325+0000","last_change":"2024-04-26T12:05:03.428605+0000","last_active":"2024-04-26T12:08:52.744325+0000","last_peered":"2024-04-26T12:08:52.744325+0000","last_clean":"2024-04-26T12:08:52.744325+0000","last_became_active":"2024-04-26T12:05:03.428098+0000","last_became_peered":"2024-04-26T12:05:03.428098+0000","last_unstale":"2024-04-26T12:08:52.744325+0000","last_undegraded":"2024-04-26T12:08:52.744325+0000","last_fullsized":"2024-04-26T12:08:52.744325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"60'445","reported_seq":557,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744955+0000","last_change":"2024-04-26T12:05:03.788568+0000","last_active":"2024-04-26T12:08:52.744955+0000","last_peered":"2024-04-26T12:08:52.744955+0000","last_clean":"2024-04-26T12:08:52.744955+0000","last_became_active":"2024-04-26T12:05:03.788039+0000","last_became_peered":"2024-04-26T12:05:03.788039+0000","last_unstale":"2024-04-26T12:08:52.744955+0000","last_undegraded":"2024-04-26T12:08:52.744955+0000","last_fullsized":"2024-04-26T12:08:52.744955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":16079,"num_write":410,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"59'64","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743891+0000","last_change":"2024-04-26T12:08:36.696166+0000","last_active":"2024-04-26T12:08:52.743891+0000","last_peered":"2024-04-26T12:08:52.743891+0000","last_clean":"2024-04-26T12:08:52.743891+0000","last_became_active":"2024-04-26T12:08:36.694921+0000","last_became_peered":"2024-04-26T12:08:36.694921+0000","last_unstale":"2024-04-26T12:08:52.743891+0000","last_undegraded":"2024-04-26T12:08:52.743891+0000","last_fullsized":"2024-04-26T12:08:52.743891+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:57.438892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"60'420","reported_seq":537,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744759+0000","last_change":"2024-04-26T12:05:03.788505+0000","last_active":"2024-04-26T12:08:52.744759+0000","last_peered":"2024-04-26T12:08:52.744759+0000","last_clean":"2024-04-26T12:08:52.744759+0000","last_became_active":"2024-04-26T12:05:03.788184+0000","last_became_peered":"2024-04-26T12:05:03.788184+0000","last_unstale":"2024-04-26T12:08:52.744759+0000","last_undegraded":"2024-04-26T12:08:52.744759+0000","last_fullsized":"2024-04-26T12:08:52.744759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":14666,"num_write":383,"num_write_kb":83769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"60'63","reported_seq":155,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744615+0000","last_change":"2024-04-26T12:08:36.697126+0000","last_active":"2024-04-26T12:08:52.744615+0000","last_peered":"2024-04-26T12:08:52.744615+0000","last_clean":"2024-04-26T12:08:52.744615+0000","last_became_active":"2024-04-26T12:08:36.696792+0000","last_became_peered":"2024-04-26T12:08:36.696792+0000","last_unstale":"2024-04-26T12:08:52.744615+0000","last_undegraded":"2024-04-26T12:08:52.744615+0000","last_fullsized":"2024-04-26T12:08:52.744615+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:48.447882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"59'232","reported_seq":335,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745720+0000","last_change":"2024-04-26T12:08:39.703810+0000","last_active":"2024-04-26T12:08:52.745720+0000","last_peered":"2024-04-26T12:08:52.745720+0000","last_clean":"2024-04-26T12:08:52.745720+0000","last_became_active":"2024-04-26T12:08:39.703455+0000","last_became_peered":"2024-04-26T12:08:39.703455+0000","last_unstale":"2024-04-26T12:08:52.745720+0000","last_undegraded":"2024-04-26T12:08:52.745720+0000","last_fullsized":"2024-04-26T12:08:52.745720+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:08.399237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'408","reported_seq":491,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743999+0000","last_change":"2024-04-26T12:08:40.710236+0000","last_active":"2024-04-26T12:08:52.743999+0000","last_peered":"2024-04-26T12:08:52.743999+0000","last_clean":"2024-04-26T12:08:52.743999+0000","last_became_active":"2024-04-26T12:08:40.707357+0000","last_became_peered":"2024-04-26T12:08:40.707357+0000","last_unstale":"2024-04-26T12:08:52.743999+0000","last_undegraded":"2024-04-26T12:08:52.743999+0000","last_fullsized":"2024-04-26T12:08:52.743999+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:17.928748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12418,"num_write":371,"num_write_kb":58378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"59'302","reported_seq":370,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744280+0000","last_change":"2024-04-26T12:08:39.703949+0000","last_active":"2024-04-26T12:08:52.744280+0000","last_peered":"2024-04-26T12:08:52.744280+0000","last_clean":"2024-04-26T12:08:52.744280+0000","last_became_active":"2024-04-26T12:08:39.703421+0000","last_became_peered":"2024-04-26T12:08:39.703421+0000","last_unstale":"2024-04-26T12:08:52.744280+0000","last_undegraded":"2024-04-26T12:08:52.744280+0000","last_fullsized":"2024-04-26T12:08:52.744280+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:10.222074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":4228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'439","reported_seq":498,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743713+0000","last_change":"2024-04-26T12:08:41.717923+0000","last_active":"2024-04-26T12:08:52.743713+0000","last_peered":"2024-04-26T12:08:52.743713+0000","last_clean":"2024-04-26T12:08:52.743713+0000","last_became_active":"2024-04-26T12:08:41.715708+0000","last_became_peered":"2024-04-26T12:08:41.715708+0000","last_unstale":"2024-04-26T12:08:52.743713+0000","last_undegraded":"2024-04-26T12:08:52.743713+0000","last_fullsized":"2024-04-26T12:08:52.743713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:23.646558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":30851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"59'589","reported_seq":692,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745816+0000","last_change":"2024-04-26T12:08:39.703966+0000","last_active":"2024-04-26T12:08:52.745816+0000","last_peered":"2024-04-26T12:08:52.745816+0000","last_clean":"2024-04-26T12:08:52.745816+0000","last_became_active":"2024-04-26T12:08:39.703487+0000","last_became_peered":"2024-04-26T12:08:39.703487+0000","last_unstale":"2024-04-26T12:08:52.745816+0000","last_undegraded":"2024-04-26T12:08:52.745816+0000","last_fullsized":"2024-04-26T12:08:52.745816+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:06.112476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":534,"num_write_kb":4333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'461","reported_seq":614,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744817+0000","last_change":"2024-04-26T12:05:03.791809+0000","last_active":"2024-04-26T12:08:52.744817+0000","last_peered":"2024-04-26T12:08:52.744817+0000","last_clean":"2024-04-26T12:08:52.744817+0000","last_became_active":"2024-04-26T12:05:03.791272+0000","last_became_peered":"2024-04-26T12:05:03.791272+0000","last_unstale":"2024-04-26T12:08:52.744817+0000","last_undegraded":"2024-04-26T12:08:52.744817+0000","last_fullsized":"2024-04-26T12:08:52.744817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":46123,"num_write":422,"num_write_kb":104552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'66","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745499+0000","last_change":"2024-04-26T12:05:03.430224+0000","last_active":"2024-04-26T12:08:52.745499+0000","last_peered":"2024-04-26T12:08:52.745499+0000","last_clean":"2024-04-26T12:08:52.745499+0000","last_became_active":"2024-04-26T12:05:03.429291+0000","last_became_peered":"2024-04-26T12:05:03.429291+0000","last_unstale":"2024-04-26T12:08:52.745499+0000","last_undegraded":"2024-04-26T12:08:52.745499+0000","last_fullsized":"2024-04-26T12:08:52.745499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'428","reported_seq":541,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744404+0000","last_change":"2024-04-26T12:05:03.788174+0000","last_active":"2024-04-26T12:08:52.744404+0000","last_peered":"2024-04-26T12:08:52.744404+0000","last_clean":"2024-04-26T12:08:52.744404+0000","last_became_active":"2024-04-26T12:05:03.787772+0000","last_became_peered":"2024-04-26T12:05:03.787772+0000","last_unstale":"2024-04-26T12:08:52.744404+0000","last_undegraded":"2024-04-26T12:08:52.744404+0000","last_fullsized":"2024-04-26T12:08:52.744404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15098,"num_write":394,"num_write_kb":42677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"59'195","reported_seq":273,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744598+0000","last_change":"2024-04-26T12:05:03.431162+0000","last_active":"2024-04-26T12:08:52.744598+0000","last_peered":"2024-04-26T12:08:52.744598+0000","last_clean":"2024-04-26T12:08:52.744598+0000","last_became_active":"2024-04-26T12:05:03.430855+0000","last_became_peered":"2024-04-26T12:05:03.430855+0000","last_unstale":"2024-04-26T12:08:52.744598+0000","last_undegraded":"2024-04-26T12:08:52.744598+0000","last_fullsized":"2024-04-26T12:08:52.744598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:41.279426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"60'448","reported_seq":544,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745298+0000","last_change":"2024-04-26T12:05:03.792357+0000","last_active":"2024-04-26T12:08:52.745298+0000","last_peered":"2024-04-26T12:08:52.745298+0000","last_clean":"2024-04-26T12:08:52.745298+0000","last_became_active":"2024-04-26T12:05:03.792119+0000","last_became_peered":"2024-04-26T12:05:03.792119+0000","last_unstale":"2024-04-26T12:08:52.745298+0000","last_undegraded":"2024-04-26T12:08:52.745298+0000","last_fullsized":"2024-04-26T12:08:52.745298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":13281,"num_write":420,"num_write_kb":59540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"59'171","reported_seq":249,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745146+0000","last_change":"2024-04-26T12:05:03.429811+0000","last_active":"2024-04-26T12:08:52.745146+0000","last_peered":"2024-04-26T12:08:52.745146+0000","last_clean":"2024-04-26T12:08:52.745146+0000","last_became_active":"2024-04-26T12:05:03.429469+0000","last_became_peered":"2024-04-26T12:05:03.429469+0000","last_unstale":"2024-04-26T12:08:52.745146+0000","last_undegraded":"2024-04-26T12:08:52.745146+0000","last_fullsized":"2024-04-26T12:08:52.745146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'412","reported_seq":923,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745698+0000","last_change":"2024-04-26T12:08:51.752350+0000","last_active":"2024-04-26T12:08:52.745698+0000","last_peered":"2024-04-26T12:08:52.745698+0000","last_clean":"2024-04-26T12:08:52.745698+0000","last_became_active":"2024-04-26T12:08:51.751044+0000","last_became_peered":"2024-04-26T12:08:51.751044+0000","last_unstale":"2024-04-26T12:08:52.745698+0000","last_undegraded":"2024-04-26T12:08:52.745698+0000","last_fullsized":"2024-04-26T12:08:52.745698+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:40.008727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26310,"num_write":380,"num_write_kb":38462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"59'55","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743708+0000","last_change":"2024-04-26T12:08:36.695355+0000","last_active":"2024-04-26T12:08:52.743708+0000","last_peered":"2024-04-26T12:08:52.743708+0000","last_clean":"2024-04-26T12:08:52.743708+0000","last_became_active":"2024-04-26T12:08:36.694346+0000","last_became_peered":"2024-04-26T12:08:36.694346+0000","last_unstale":"2024-04-26T12:08:52.743708+0000","last_undegraded":"2024-04-26T12:08:52.743708+0000","last_fullsized":"2024-04-26T12:08:52.743708+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:42.458073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"60'362","reported_seq":817,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745440+0000","last_change":"2024-04-26T12:08:41.717048+0000","last_active":"2024-04-26T12:08:52.745440+0000","last_peered":"2024-04-26T12:08:52.745440+0000","last_clean":"2024-04-26T12:08:52.745440+0000","last_became_active":"2024-04-26T12:08:41.716102+0000","last_became_peered":"2024-04-26T12:08:41.716102+0000","last_unstale":"2024-04-26T12:08:52.745440+0000","last_undegraded":"2024-04-26T12:08:52.745440+0000","last_fullsized":"2024-04-26T12:08:52.745440+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:52.409548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21408,"num_write":333,"num_write_kb":66549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"59'378","reported_seq":439,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743919+0000","last_change":"2024-04-26T12:08:39.702797+0000","last_active":"2024-04-26T12:08:52.743919+0000","last_peered":"2024-04-26T12:08:52.743919+0000","last_clean":"2024-04-26T12:08:52.743919+0000","last_became_active":"2024-04-26T12:08:39.702438+0000","last_became_peered":"2024-04-26T12:08:39.702438+0000","last_unstale":"2024-04-26T12:08:52.743919+0000","last_undegraded":"2024-04-26T12:08:52.743919+0000","last_fullsized":"2024-04-26T12:08:52.743919+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:06.278304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"60'407","reported_seq":917,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744823+0000","last_change":"2024-04-26T12:08:45.724853+0000","last_active":"2024-04-26T12:08:52.744823+0000","last_peered":"2024-04-26T12:08:52.744823+0000","last_clean":"2024-04-26T12:08:52.744823+0000","last_became_active":"2024-04-26T12:08:45.723772+0000","last_became_peered":"2024-04-26T12:08:45.723772+0000","last_unstale":"2024-04-26T12:08:52.744823+0000","last_undegraded":"2024-04-26T12:08:52.744823+0000","last_fullsized":"2024-04-26T12:08:52.744823+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:41.814840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":40156,"num_write":373,"num_write_kb":91285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":294,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745711+0000","last_change":"2024-04-26T12:08:36.697892+0000","last_active":"2024-04-26T12:08:53.745711+0000","last_peered":"2024-04-26T12:08:53.745711+0000","last_clean":"2024-04-26T12:08:53.745711+0000","last_became_active":"2024-04-26T12:08:36.697508+0000","last_became_peered":"2024-04-26T12:08:36.697508+0000","last_unstale":"2024-04-26T12:08:53.745711+0000","last_undegraded":"2024-04-26T12:08:53.745711+0000","last_fullsized":"2024-04-26T12:08:53.745711+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_clean_scrub_stamp":"2024-04-26T12:04:52.376986+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:24.384180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745283+0000","last_change":"2024-04-26T12:04:59.403711+0000","last_active":"2024-04-26T12:08:52.745283+0000","last_peered":"2024-04-26T12:08:52.745283+0000","last_clean":"2024-04-26T12:08:52.745283+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:08:52.745283+0000","last_undegraded":"2024-04-26T12:08:52.745283+0000","last_fullsized":"2024-04-26T12:08:52.745283+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:45.779614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'793","reported_seq":897,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744445+0000","last_change":"2024-04-26T12:08:39.702225+0000","last_active":"2024-04-26T12:08:52.744445+0000","last_peered":"2024-04-26T12:08:52.744445+0000","last_clean":"2024-04-26T12:08:52.744445+0000","last_became_active":"2024-04-26T12:08:39.701760+0000","last_became_peered":"2024-04-26T12:08:39.701760+0000","last_unstale":"2024-04-26T12:08:52.744445+0000","last_undegraded":"2024-04-26T12:08:52.744445+0000","last_fullsized":"2024-04-26T12:08:52.744445+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:51.405891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":8533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"60'466","reported_seq":1012,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.747878+0000","last_change":"2024-04-26T12:08:52.747463+0000","last_active":"2024-04-26T12:08:52.747878+0000","last_peered":"2024-04-26T12:08:52.747878+0000","last_clean":"2024-04-26T12:08:52.747878+0000","last_became_active":"2024-04-26T12:08:52.746147+0000","last_became_peered":"2024-04-26T12:08:52.746147+0000","last_unstale":"2024-04-26T12:08:52.747878+0000","last_undegraded":"2024-04-26T12:08:52.747878+0000","last_fullsized":"2024-04-26T12:08:52.747878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:21.517395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":37547,"num_write":422,"num_write_kb":96579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744702+0000","last_change":"2024-04-26T12:08:36.695759+0000","last_active":"2024-04-26T12:08:52.744702+0000","last_peered":"2024-04-26T12:08:52.744702+0000","last_clean":"2024-04-26T12:08:52.744702+0000","last_became_active":"2024-04-26T12:08:36.695444+0000","last_became_peered":"2024-04-26T12:08:36.695444+0000","last_unstale":"2024-04-26T12:08:52.744702+0000","last_undegraded":"2024-04-26T12:08:52.744702+0000","last_fullsized":"2024-04-26T12:08:52.744702+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:22.343369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"60'114","reported_seq":239,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744279+0000","last_change":"2024-04-26T12:05:03.428547+0000","last_active":"2024-04-26T12:08:52.744279+0000","last_peered":"2024-04-26T12:08:52.744279+0000","last_clean":"2024-04-26T12:08:52.744279+0000","last_became_active":"2024-04-26T12:05:03.427985+0000","last_became_peered":"2024-04-26T12:05:03.427985+0000","last_unstale":"2024-04-26T12:08:52.744279+0000","last_undegraded":"2024-04-26T12:08:52.744279+0000","last_fullsized":"2024-04-26T12:08:52.744279+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:19.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466015,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":47,"num_write_kb":1464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"60'492","reported_seq":655,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744496+0000","last_change":"2024-04-26T12:08:49.741650+0000","last_active":"2024-04-26T12:08:52.744496+0000","last_peered":"2024-04-26T12:08:52.744496+0000","last_clean":"2024-04-26T12:08:52.744496+0000","last_became_active":"2024-04-26T12:08:49.739496+0000","last_became_peered":"2024-04-26T12:08:49.739496+0000","last_unstale":"2024-04-26T12:08:52.744496+0000","last_undegraded":"2024-04-26T12:08:52.744496+0000","last_fullsized":"2024-04-26T12:08:52.744496+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:55.361224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":63988,"num_write":466,"num_write_kb":154489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744369+0000","last_change":"2024-04-26T12:08:36.696858+0000","last_active":"2024-04-26T12:08:52.744369+0000","last_peered":"2024-04-26T12:08:52.744369+0000","last_clean":"2024-04-26T12:08:52.744369+0000","last_became_active":"2024-04-26T12:08:36.696619+0000","last_became_peered":"2024-04-26T12:08:36.696619+0000","last_unstale":"2024-04-26T12:08:52.744369+0000","last_undegraded":"2024-04-26T12:08:52.744369+0000","last_fullsized":"2024-04-26T12:08:52.744369+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:47.292926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"59'325","reported_seq":386,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743649+0000","last_change":"2024-04-26T12:08:39.704052+0000","last_active":"2024-04-26T12:08:52.743649+0000","last_peered":"2024-04-26T12:08:52.743649+0000","last_clean":"2024-04-26T12:08:52.743649+0000","last_became_active":"2024-04-26T12:08:39.703696+0000","last_became_peered":"2024-04-26T12:08:39.703696+0000","last_unstale":"2024-04-26T12:08:52.743649+0000","last_undegraded":"2024-04-26T12:08:52.743649+0000","last_fullsized":"2024-04-26T12:08:52.743649+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:21:44.069244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":8296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"60'359","reported_seq":785,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744857+0000","last_change":"2024-04-26T12:08:47.737443+0000","last_active":"2024-04-26T12:08:52.744857+0000","last_peered":"2024-04-26T12:08:52.744857+0000","last_clean":"2024-04-26T12:08:52.744857+0000","last_became_active":"2024-04-26T12:08:47.735729+0000","last_became_peered":"2024-04-26T12:08:47.735729+0000","last_unstale":"2024-04-26T12:08:52.744857+0000","last_undegraded":"2024-04-26T12:08:52.744857+0000","last_fullsized":"2024-04-26T12:08:52.744857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:57:20.726677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9448,"num_write":336,"num_write_kb":74900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745246+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:08:52.745246+0000","last_peered":"2024-04-26T12:08:52.745246+0000","last_clean":"2024-04-26T12:08:52.745246+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:08:52.745246+0000","last_undegraded":"2024-04-26T12:08:52.745246+0000","last_fullsized":"2024-04-26T12:08:52.745246+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:12.939539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"59'67","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745292+0000","last_change":"2024-04-26T12:05:03.430140+0000","last_active":"2024-04-26T12:08:52.745292+0000","last_peered":"2024-04-26T12:08:52.745292+0000","last_clean":"2024-04-26T12:08:52.745292+0000","last_became_active":"2024-04-26T12:05:03.429838+0000","last_became_peered":"2024-04-26T12:05:03.429838+0000","last_unstale":"2024-04-26T12:08:52.745292+0000","last_undegraded":"2024-04-26T12:08:52.745292+0000","last_fullsized":"2024-04-26T12:08:52.745292+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"60'403","reported_seq":894,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744652+0000","last_change":"2024-04-26T12:08:50.753437+0000","last_active":"2024-04-26T12:08:52.744652+0000","last_peered":"2024-04-26T12:08:52.744652+0000","last_clean":"2024-04-26T12:08:52.744652+0000","last_became_active":"2024-04-26T12:08:50.752366+0000","last_became_peered":"2024-04-26T12:08:50.752366+0000","last_unstale":"2024-04-26T12:08:52.744652+0000","last_undegraded":"2024-04-26T12:08:52.744652+0000","last_fullsized":"2024-04-26T12:08:52.744652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:02.999757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30094,"num_write":370,"num_write_kb":104181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"59'469","reported_seq":547,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745818+0000","last_change":"2024-04-26T12:05:03.429673+0000","last_active":"2024-04-26T12:08:52.745818+0000","last_peered":"2024-04-26T12:08:52.745818+0000","last_clean":"2024-04-26T12:08:52.745818+0000","last_became_active":"2024-04-26T12:05:03.429146+0000","last_became_peered":"2024-04-26T12:05:03.429146+0000","last_unstale":"2024-04-26T12:08:52.745818+0000","last_undegraded":"2024-04-26T12:08:52.745818+0000","last_fullsized":"2024-04-26T12:08:52.745818+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744743+0000","last_change":"2024-04-26T12:08:36.697900+0000","last_active":"2024-04-26T12:08:52.744743+0000","last_peered":"2024-04-26T12:08:52.744743+0000","last_clean":"2024-04-26T12:08:52.744743+0000","last_became_active":"2024-04-26T12:08:36.697618+0000","last_became_peered":"2024-04-26T12:08:36.697618+0000","last_unstale":"2024-04-26T12:08:52.744743+0000","last_undegraded":"2024-04-26T12:08:52.744743+0000","last_fullsized":"2024-04-26T12:08:52.744743+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:16.620901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'354","reported_seq":413,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744055+0000","last_change":"2024-04-26T12:08:45.725751+0000","last_active":"2024-04-26T12:08:52.744055+0000","last_peered":"2024-04-26T12:08:52.744055+0000","last_clean":"2024-04-26T12:08:52.744055+0000","last_became_active":"2024-04-26T12:08:45.724153+0000","last_became_peered":"2024-04-26T12:08:45.724153+0000","last_unstale":"2024-04-26T12:08:52.744055+0000","last_undegraded":"2024-04-26T12:08:52.744055+0000","last_fullsized":"2024-04-26T12:08:52.744055+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:57.798803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":416,"num_write":319,"num_write_kb":17259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"59'53","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744703+0000","last_change":"2024-04-26T12:08:36.698122+0000","last_active":"2024-04-26T12:08:52.744703+0000","last_peered":"2024-04-26T12:08:52.744703+0000","last_clean":"2024-04-26T12:08:52.744703+0000","last_became_active":"2024-04-26T12:08:36.697832+0000","last_became_peered":"2024-04-26T12:08:36.697832+0000","last_unstale":"2024-04-26T12:08:52.744703+0000","last_undegraded":"2024-04-26T12:08:52.744703+0000","last_fullsized":"2024-04-26T12:08:52.744703+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:34.416168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744650+0000","last_change":"2024-04-26T12:08:36.698131+0000","last_active":"2024-04-26T12:08:52.744650+0000","last_peered":"2024-04-26T12:08:52.744650+0000","last_clean":"2024-04-26T12:08:52.744650+0000","last_became_active":"2024-04-26T12:08:36.697698+0000","last_became_peered":"2024-04-26T12:08:36.697698+0000","last_unstale":"2024-04-26T12:08:52.744650+0000","last_undegraded":"2024-04-26T12:08:52.744650+0000","last_fullsized":"2024-04-26T12:08:52.744650+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:15.476036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'399","reported_seq":477,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743860+0000","last_change":"2024-04-26T12:08:40.705752+0000","last_active":"2024-04-26T12:08:52.743860+0000","last_peered":"2024-04-26T12:08:52.743860+0000","last_clean":"2024-04-26T12:08:52.743860+0000","last_became_active":"2024-04-26T12:08:40.703906+0000","last_became_peered":"2024-04-26T12:08:40.703906+0000","last_unstale":"2024-04-26T12:08:52.743860+0000","last_undegraded":"2024-04-26T12:08:52.743860+0000","last_fullsized":"2024-04-26T12:08:52.743860+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:19.004074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11720,"num_write":363,"num_write_kb":66914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"59'65","reported_seq":157,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745130+0000","last_change":"2024-04-26T12:08:36.699388+0000","last_active":"2024-04-26T12:08:52.745130+0000","last_peered":"2024-04-26T12:08:52.745130+0000","last_clean":"2024-04-26T12:08:52.745130+0000","last_became_active":"2024-04-26T12:08:36.699058+0000","last_became_peered":"2024-04-26T12:08:36.699058+0000","last_unstale":"2024-04-26T12:08:52.745130+0000","last_undegraded":"2024-04-26T12:08:52.745130+0000","last_fullsized":"2024-04-26T12:08:52.745130+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:11.978288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745047+0000","last_change":"2024-04-26T12:08:36.697618+0000","last_active":"2024-04-26T12:08:52.745047+0000","last_peered":"2024-04-26T12:08:52.745047+0000","last_clean":"2024-04-26T12:08:52.745047+0000","last_became_active":"2024-04-26T12:08:36.697407+0000","last_became_peered":"2024-04-26T12:08:36.697407+0000","last_unstale":"2024-04-26T12:08:52.745047+0000","last_undegraded":"2024-04-26T12:08:52.745047+0000","last_fullsized":"2024-04-26T12:08:52.745047+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:02.301767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'424","reported_seq":541,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744097+0000","last_change":"2024-04-26T12:05:03.789623+0000","last_active":"2024-04-26T12:08:52.744097+0000","last_peered":"2024-04-26T12:08:52.744097+0000","last_clean":"2024-04-26T12:08:52.744097+0000","last_became_active":"2024-04-26T12:05:03.789390+0000","last_became_peered":"2024-04-26T12:05:03.789390+0000","last_unstale":"2024-04-26T12:08:52.744097+0000","last_undegraded":"2024-04-26T12:08:52.744097+0000","last_fullsized":"2024-04-26T12:08:52.744097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17027,"num_write":386,"num_write_kb":58797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"61'70","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745116+0000","last_change":"2024-04-26T12:05:03.429222+0000","last_active":"2024-04-26T12:08:52.745116+0000","last_peered":"2024-04-26T12:08:52.745116+0000","last_clean":"2024-04-26T12:08:52.745116+0000","last_became_active":"2024-04-26T12:05:03.428803+0000","last_became_peered":"2024-04-26T12:05:03.428803+0000","last_unstale":"2024-04-26T12:08:52.745116+0000","last_undegraded":"2024-04-26T12:08:52.745116+0000","last_fullsized":"2024-04-26T12:08:52.745116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:31.305644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745750+0000","last_change":"2024-04-26T12:08:36.698775+0000","last_active":"2024-04-26T12:08:52.745750+0000","last_peered":"2024-04-26T12:08:52.745750+0000","last_clean":"2024-04-26T12:08:52.745750+0000","last_became_active":"2024-04-26T12:08:36.698523+0000","last_became_peered":"2024-04-26T12:08:36.698523+0000","last_unstale":"2024-04-26T12:08:52.745750+0000","last_undegraded":"2024-04-26T12:08:52.745750+0000","last_fullsized":"2024-04-26T12:08:52.745750+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:16.620901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'393","reported_seq":472,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744009+0000","last_change":"2024-04-26T12:08:40.705662+0000","last_active":"2024-04-26T12:08:52.744009+0000","last_peered":"2024-04-26T12:08:52.744009+0000","last_clean":"2024-04-26T12:08:52.744009+0000","last_became_active":"2024-04-26T12:08:40.703873+0000","last_became_peered":"2024-04-26T12:08:40.703873+0000","last_unstale":"2024-04-26T12:08:52.744009+0000","last_undegraded":"2024-04-26T12:08:52.744009+0000","last_fullsized":"2024-04-26T12:08:52.744009+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:27.057123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":11991,"num_write":357,"num_write_kb":83226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'419","reported_seq":892,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744937+0000","last_change":"2024-04-26T12:08:44.723692+0000","last_active":"2024-04-26T12:08:52.744937+0000","last_peered":"2024-04-26T12:08:52.744937+0000","last_clean":"2024-04-26T12:08:52.744937+0000","last_became_active":"2024-04-26T12:08:44.722574+0000","last_became_peered":"2024-04-26T12:08:44.722574+0000","last_unstale":"2024-04-26T12:08:52.744937+0000","last_undegraded":"2024-04-26T12:08:52.744937+0000","last_fullsized":"2024-04-26T12:08:52.744937+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:01.256055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14983,"num_write":376,"num_write_kb":76749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"61'398","reported_seq":507,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745436+0000","last_change":"2024-04-26T12:08:39.703851+0000","last_active":"2024-04-26T12:08:52.745436+0000","last_peered":"2024-04-26T12:08:52.745436+0000","last_clean":"2024-04-26T12:08:52.745436+0000","last_became_active":"2024-04-26T12:08:39.703516+0000","last_became_peered":"2024-04-26T12:08:39.703516+0000","last_unstale":"2024-04-26T12:08:52.745436+0000","last_undegraded":"2024-04-26T12:08:52.745436+0000","last_fullsized":"2024-04-26T12:08:52.745436+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:10.227718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699266,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":9692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9692849,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'428","reported_seq":940,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744179+0000","last_change":"2024-04-26T12:08:50.753473+0000","last_active":"2024-04-26T12:08:52.744179+0000","last_peered":"2024-04-26T12:08:52.744179+0000","last_clean":"2024-04-26T12:08:52.744179+0000","last_became_active":"2024-04-26T12:08:50.752328+0000","last_became_peered":"2024-04-26T12:08:50.752328+0000","last_unstale":"2024-04-26T12:08:52.744179+0000","last_undegraded":"2024-04-26T12:08:52.744179+0000","last_fullsized":"2024-04-26T12:08:52.744179+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:08.396108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":26594,"num_write":396,"num_write_kb":67932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"60'91","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744409+0000","last_change":"2024-04-26T12:08:36.722607+0000","last_active":"2024-04-26T12:08:52.744409+0000","last_peered":"2024-04-26T12:08:52.744409+0000","last_clean":"2024-04-26T12:08:52.744409+0000","last_became_active":"2024-04-26T12:08:36.697650+0000","last_became_peered":"2024-04-26T12:08:36.697650+0000","last_unstale":"2024-04-26T12:08:52.744409+0000","last_undegraded":"2024-04-26T12:08:52.744409+0000","last_fullsized":"2024-04-26T12:08:52.744409+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:10.718101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"59'316","reported_seq":394,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745553+0000","last_change":"2024-04-26T12:05:03.429257+0000","last_active":"2024-04-26T12:08:52.745553+0000","last_peered":"2024-04-26T12:08:52.745553+0000","last_clean":"2024-04-26T12:08:52.745553+0000","last_became_active":"2024-04-26T12:05:03.428921+0000","last_became_peered":"2024-04-26T12:05:03.428921+0000","last_unstale":"2024-04-26T12:08:52.745553+0000","last_undegraded":"2024-04-26T12:08:52.745553+0000","last_fullsized":"2024-04-26T12:08:52.745553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:49.774845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'495","reported_seq":625,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744089+0000","last_change":"2024-04-26T12:05:03.788141+0000","last_active":"2024-04-26T12:08:52.744089+0000","last_peered":"2024-04-26T12:08:52.744089+0000","last_clean":"2024-04-26T12:08:52.744089+0000","last_became_active":"2024-04-26T12:05:03.787533+0000","last_became_peered":"2024-04-26T12:05:03.787533+0000","last_unstale":"2024-04-26T12:08:52.744089+0000","last_undegraded":"2024-04-26T12:08:52.744089+0000","last_fullsized":"2024-04-26T12:08:52.744089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37174,"num_write":458,"num_write_kb":125832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'51","reported_seq":129,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745033+0000","last_change":"2024-04-26T12:05:03.428971+0000","last_active":"2024-04-26T12:08:52.745033+0000","last_peered":"2024-04-26T12:08:52.745033+0000","last_clean":"2024-04-26T12:08:52.745033+0000","last_became_active":"2024-04-26T12:05:03.428445+0000","last_became_peered":"2024-04-26T12:05:03.428445+0000","last_unstale":"2024-04-26T12:08:52.745033+0000","last_undegraded":"2024-04-26T12:08:52.745033+0000","last_fullsized":"2024-04-26T12:08:52.745033+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'482","reported_seq":1130,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744097+0000","last_change":"2024-04-26T12:08:48.741589+0000","last_active":"2024-04-26T12:08:52.744097+0000","last_peered":"2024-04-26T12:08:52.744097+0000","last_clean":"2024-04-26T12:08:52.744097+0000","last_became_active":"2024-04-26T12:08:48.740055+0000","last_became_peered":"2024-04-26T12:08:48.740055+0000","last_unstale":"2024-04-26T12:08:52.744097+0000","last_undegraded":"2024-04-26T12:08:52.744097+0000","last_fullsized":"2024-04-26T12:08:52.744097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:03.903516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":61972,"num_write":459,"num_write_kb":125797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"60'392","reported_seq":527,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744471+0000","last_change":"2024-04-26T12:08:43.718939+0000","last_active":"2024-04-26T12:08:52.744471+0000","last_peered":"2024-04-26T12:08:52.744471+0000","last_clean":"2024-04-26T12:08:52.744471+0000","last_became_active":"2024-04-26T12:08:43.717109+0000","last_became_peered":"2024-04-26T12:08:43.717109+0000","last_unstale":"2024-04-26T12:08:52.744471+0000","last_undegraded":"2024-04-26T12:08:52.744471+0000","last_fullsized":"2024-04-26T12:08:52.744471+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:14.846653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":37910,"num_write":366,"num_write_kb":84111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"59'709","reported_seq":813,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744368+0000","last_change":"2024-04-26T12:08:39.701978+0000","last_active":"2024-04-26T12:08:52.744368+0000","last_peered":"2024-04-26T12:08:52.744368+0000","last_clean":"2024-04-26T12:08:52.744368+0000","last_became_active":"2024-04-26T12:08:39.700927+0000","last_became_peered":"2024-04-26T12:08:39.700927+0000","last_unstale":"2024-04-26T12:08:52.744368+0000","last_undegraded":"2024-04-26T12:08:52.744368+0000","last_fullsized":"2024-04-26T12:08:52.744368+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:10.815597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"60'435","reported_seq":572,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744787+0000","last_change":"2024-04-26T12:05:03.788754+0000","last_active":"2024-04-26T12:08:52.744787+0000","last_peered":"2024-04-26T12:08:52.744787+0000","last_clean":"2024-04-26T12:08:52.744787+0000","last_became_active":"2024-04-26T12:05:03.788311+0000","last_became_peered":"2024-04-26T12:05:03.788311+0000","last_unstale":"2024-04-26T12:08:52.744787+0000","last_undegraded":"2024-04-26T12:08:52.744787+0000","last_fullsized":"2024-04-26T12:08:52.744787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":28462,"num_write":403,"num_write_kb":93779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"59'262","reported_seq":340,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744211+0000","last_change":"2024-04-26T12:05:03.428810+0000","last_active":"2024-04-26T12:08:52.744211+0000","last_peered":"2024-04-26T12:08:52.744211+0000","last_clean":"2024-04-26T12:08:52.744211+0000","last_became_active":"2024-04-26T12:05:03.428191+0000","last_became_peered":"2024-04-26T12:05:03.428191+0000","last_unstale":"2024-04-26T12:08:52.744211+0000","last_undegraded":"2024-04-26T12:08:52.744211+0000","last_fullsized":"2024-04-26T12:08:52.744211+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"60'399","reported_seq":499,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744294+0000","last_change":"2024-04-26T12:08:49.742459+0000","last_active":"2024-04-26T12:08:52.744294+0000","last_peered":"2024-04-26T12:08:52.744294+0000","last_clean":"2024-04-26T12:08:52.744294+0000","last_became_active":"2024-04-26T12:08:49.740536+0000","last_became_peered":"2024-04-26T12:08:49.740536+0000","last_unstale":"2024-04-26T12:08:52.744294+0000","last_undegraded":"2024-04-26T12:08:52.744294+0000","last_fullsized":"2024-04-26T12:08:52.744294+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:24.169669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22216,"num_write":357,"num_write_kb":75245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"59'430","reported_seq":490,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743876+0000","last_change":"2024-04-26T12:08:39.703050+0000","last_active":"2024-04-26T12:08:52.743876+0000","last_peered":"2024-04-26T12:08:52.743876+0000","last_clean":"2024-04-26T12:08:52.743876+0000","last_became_active":"2024-04-26T12:08:39.702529+0000","last_became_peered":"2024-04-26T12:08:39.702529+0000","last_unstale":"2024-04-26T12:08:52.743876+0000","last_undegraded":"2024-04-26T12:08:52.743876+0000","last_fullsized":"2024-04-26T12:08:52.743876+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:28.249725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":12514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"60'387","reported_seq":476,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744228+0000","last_change":"2024-04-26T12:08:43.720098+0000","last_active":"2024-04-26T12:08:52.744228+0000","last_peered":"2024-04-26T12:08:52.744228+0000","last_clean":"2024-04-26T12:08:52.744228+0000","last_became_active":"2024-04-26T12:08:43.717442+0000","last_became_peered":"2024-04-26T12:08:43.717442+0000","last_unstale":"2024-04-26T12:08:52.744228+0000","last_undegraded":"2024-04-26T12:08:52.744228+0000","last_fullsized":"2024-04-26T12:08:52.744228+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:13.140334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20720,"num_write":352,"num_write_kb":87643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"59'58","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743900+0000","last_change":"2024-04-26T12:08:36.720540+0000","last_active":"2024-04-26T12:08:52.743900+0000","last_peered":"2024-04-26T12:08:52.743900+0000","last_clean":"2024-04-26T12:08:52.743900+0000","last_became_active":"2024-04-26T12:08:36.693399+0000","last_became_peered":"2024-04-26T12:08:36.693399+0000","last_unstale":"2024-04-26T12:08:52.743900+0000","last_undegraded":"2024-04-26T12:08:52.743900+0000","last_fullsized":"2024-04-26T12:08:52.743900+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:14.949002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"60'356","reported_seq":452,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744945+0000","last_change":"2024-04-26T12:05:03.791986+0000","last_active":"2024-04-26T12:08:52.744945+0000","last_peered":"2024-04-26T12:08:52.744945+0000","last_clean":"2024-04-26T12:08:52.744945+0000","last_became_active":"2024-04-26T12:05:03.790823+0000","last_became_peered":"2024-04-26T12:05:03.790823+0000","last_unstale":"2024-04-26T12:08:52.744945+0000","last_undegraded":"2024-04-26T12:08:52.744945+0000","last_fullsized":"2024-04-26T12:08:52.744945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9641,"num_write":326,"num_write_kb":29574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"59'309","reported_seq":387,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745394+0000","last_change":"2024-04-26T12:05:03.429469+0000","last_active":"2024-04-26T12:08:52.745394+0000","last_peered":"2024-04-26T12:08:52.745394+0000","last_clean":"2024-04-26T12:08:52.745394+0000","last_became_active":"2024-04-26T12:05:03.429015+0000","last_became_peered":"2024-04-26T12:05:03.429015+0000","last_unstale":"2024-04-26T12:08:52.745394+0000","last_undegraded":"2024-04-26T12:08:52.745394+0000","last_fullsized":"2024-04-26T12:08:52.745394+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'433","reported_seq":575,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745025+0000","last_change":"2024-04-26T12:05:03.791929+0000","last_active":"2024-04-26T12:08:52.745025+0000","last_peered":"2024-04-26T12:08:52.745025+0000","last_clean":"2024-04-26T12:08:52.745025+0000","last_became_active":"2024-04-26T12:05:03.791540+0000","last_became_peered":"2024-04-26T12:05:03.791540+0000","last_unstale":"2024-04-26T12:08:52.745025+0000","last_undegraded":"2024-04-26T12:08:52.745025+0000","last_fullsized":"2024-04-26T12:08:52.745025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":47864,"num_write":399,"num_write_kb":92193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"59'382","reported_seq":449,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744180+0000","last_change":"2024-04-26T12:08:39.704680+0000","last_active":"2024-04-26T12:08:52.744180+0000","last_peered":"2024-04-26T12:08:52.744180+0000","last_clean":"2024-04-26T12:08:52.744180+0000","last_became_active":"2024-04-26T12:08:39.704404+0000","last_became_peered":"2024-04-26T12:08:39.704404+0000","last_unstale":"2024-04-26T12:08:52.744180+0000","last_undegraded":"2024-04-26T12:08:52.744180+0000","last_fullsized":"2024-04-26T12:08:52.744180+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:01.830043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":12467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'425","reported_seq":544,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743855+0000","last_change":"2024-04-26T12:08:47.737376+0000","last_active":"2024-04-26T12:08:52.743855+0000","last_peered":"2024-04-26T12:08:52.743855+0000","last_clean":"2024-04-26T12:08:52.743855+0000","last_became_active":"2024-04-26T12:08:47.735367+0000","last_became_peered":"2024-04-26T12:08:47.735367+0000","last_unstale":"2024-04-26T12:08:52.743855+0000","last_undegraded":"2024-04-26T12:08:52.743855+0000","last_fullsized":"2024-04-26T12:08:52.743855+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:35.420647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":38065,"num_write":387,"num_write_kb":71445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"59'126","reported_seq":229,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744930+0000","last_change":"2024-04-26T12:08:39.702212+0000","last_active":"2024-04-26T12:08:52.744930+0000","last_peered":"2024-04-26T12:08:52.744930+0000","last_clean":"2024-04-26T12:08:52.744930+0000","last_became_active":"2024-04-26T12:08:39.701900+0000","last_became_peered":"2024-04-26T12:08:39.701900+0000","last_unstale":"2024-04-26T12:08:52.744930+0000","last_undegraded":"2024-04-26T12:08:52.744930+0000","last_fullsized":"2024-04-26T12:08:52.744930+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:28.460358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"60'448","reported_seq":548,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744703+0000","last_change":"2024-04-26T12:05:03.791827+0000","last_active":"2024-04-26T12:08:52.744703+0000","last_peered":"2024-04-26T12:08:52.744703+0000","last_clean":"2024-04-26T12:08:52.744703+0000","last_became_active":"2024-04-26T12:05:03.791442+0000","last_became_peered":"2024-04-26T12:05:03.791442+0000","last_unstale":"2024-04-26T12:08:52.744703+0000","last_undegraded":"2024-04-26T12:08:52.744703+0000","last_fullsized":"2024-04-26T12:08:52.744703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11191,"num_write":416,"num_write_kb":67272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"59'56","reported_seq":134,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744927+0000","last_change":"2024-04-26T12:05:03.430659+0000","last_active":"2024-04-26T12:08:52.744927+0000","last_peered":"2024-04-26T12:08:52.744927+0000","last_clean":"2024-04-26T12:08:52.744927+0000","last_became_active":"2024-04-26T12:05:03.430164+0000","last_became_peered":"2024-04-26T12:05:03.430164+0000","last_unstale":"2024-04-26T12:08:52.744927+0000","last_undegraded":"2024-04-26T12:08:52.744927+0000","last_fullsized":"2024-04-26T12:08:52.744927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2734,"num_read_kb":1486856,"num_write":24627,"num_write_kb":4487808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7440,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26722,"ondisk_log_size":26722,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128606591,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":5972,"num_write_kb":129691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64376832,"data_stored":257213182,"data_compressed":19249503,"data_compressed_allocated":31694848,"data_compressed_original":224591872,"omap_allocated":4411,"internal_metadata":0},"log_size":7828,"ondisk_log_size":7828,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738422,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134436,"kb_used_data":27092,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94237404,"statfs":{"total":96636764160,"available":96499101696,"internally_reserved":0,"allocated":27742208,"data_stored":91797602,"data_compressed":6340284,"data_compressed_allocated":11272192,"data_compressed_original":75763712,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:08:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.40899999999999997,"15min":0.439},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.39900000000000002,"15min":0.42599999999999999},"min":{"1min":0.19,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.51700000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Apr 26 12:05:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.436},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.41699999999999998}]}]},{"osd":1,"up_from":66,"seq":283467841543,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68516,"kb_used_data":10644,"kb_used_omap":5,"kb_used_meta":57850,"kb_avail":94303324,"statfs":{"total":96636764160,"available":96566603776,"internally_reserved":0,"allocated":10899456,"data_stored":86136667,"data_compressed":7182940,"data_compressed_allocated":10076160,"data_compressed_original":85745664,"omap_allocated":6005,"internal_metadata":59238539},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138888,"kb_used_data":27452,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232952,"statfs":{"total":96636764160,"available":96494542848,"internally_reserved":0,"allocated":28110848,"data_stored":81507786,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:05:55 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Apr 26 12:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42399999999999999,"15min":0.435},"min":{"1min":0.16200000000000001,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.433,"15min":0.433},"min":{"1min":0.20599999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.48299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27357184,"data_stored":81158407,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10088448,"data_stored":85196920,"data_compressed":7176942,"data_compressed_allocated":10039296,"data_compressed_original":85172224,"omap_allocated":4411,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26931200,"data_stored":90857855,"data_compressed":6334286,"data_compressed_allocated":11235328,"data_compressed_original":75190272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:09:02.085 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T12:09:02.085 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-26T12:09:02.433 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T12:09:02.443 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T12:09:02.443 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:09:02.745 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:09:02.746 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:09:02.756 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-04-26T12:09:02.393909+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129196959,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2917,"num_read_kb":1488438,"num_write":30802,"num_write_kb":4620959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7463,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34707,"ondisk_log_size":34707,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":341840,"kb_used_data":65188,"kb_used_omap":8,"kb_used_meta":276599,"kb_avail":282773680,"statfs":{"total":289910292480,"available":289560248320,"internally_reserved":0,"allocated":66752512,"data_stored":259442055,"data_compressed":19261499,"data_compressed_allocated":31768576,"data_compressed_original":225738752,"omap_allocated":9193,"internal_metadata":283237399},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":505,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.651305"},"pg_stats":[{"pgid":"4.3f","version":"60'426","reported_seq":507,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744715+0000","last_change":"2024-04-26T12:08:51.753936+0000","last_active":"2024-04-26T12:08:52.744715+0000","last_peered":"2024-04-26T12:08:52.744715+0000","last_clean":"2024-04-26T12:08:52.744715+0000","last_became_active":"2024-04-26T12:08:51.750917+0000","last_became_peered":"2024-04-26T12:08:51.750917+0000","last_unstale":"2024-04-26T12:08:52.744715+0000","last_undegraded":"2024-04-26T12:08:52.744715+0000","last_fullsized":"2024-04-26T12:08:52.744715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:21.716324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9964,"num_write":393,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"60'470","reported_seq":601,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744464+0000","last_change":"2024-04-26T12:08:43.719204+0000","last_active":"2024-04-26T12:08:52.744464+0000","last_peered":"2024-04-26T12:08:52.744464+0000","last_clean":"2024-04-26T12:08:52.744464+0000","last_became_active":"2024-04-26T12:08:43.717325+0000","last_became_peered":"2024-04-26T12:08:43.717325+0000","last_unstale":"2024-04-26T12:08:52.744464+0000","last_undegraded":"2024-04-26T12:08:52.744464+0000","last_fullsized":"2024-04-26T12:08:52.744464+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:57.396493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":34556,"num_write":444,"num_write_kb":129697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"60'370","reported_seq":802,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745315+0000","last_change":"2024-04-26T12:08:50.753639+0000","last_active":"2024-04-26T12:08:52.745315+0000","last_peered":"2024-04-26T12:08:52.745315+0000","last_clean":"2024-04-26T12:08:52.745315+0000","last_became_active":"2024-04-26T12:08:50.752468+0000","last_became_peered":"2024-04-26T12:08:50.752468+0000","last_unstale":"2024-04-26T12:08:52.745315+0000","last_undegraded":"2024-04-26T12:08:52.745315+0000","last_fullsized":"2024-04-26T12:08:52.745315+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:54.514768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":349,"num_write_kb":51115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"60'377","reported_seq":485,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745318+0000","last_change":"2024-04-26T12:05:03.791234+0000","last_active":"2024-04-26T12:08:52.745318+0000","last_peered":"2024-04-26T12:08:52.745318+0000","last_clean":"2024-04-26T12:08:52.745318+0000","last_became_active":"2024-04-26T12:05:03.790717+0000","last_became_peered":"2024-04-26T12:05:03.790717+0000","last_unstale":"2024-04-26T12:08:52.745318+0000","last_undegraded":"2024-04-26T12:08:52.745318+0000","last_fullsized":"2024-04-26T12:08:52.745318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:52.358881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17376,"num_write":341,"num_write_kb":46680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'445","reported_seq":550,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743965+0000","last_change":"2024-04-26T12:08:39.705318+0000","last_active":"2024-04-26T12:08:52.743965+0000","last_peered":"2024-04-26T12:08:52.743965+0000","last_clean":"2024-04-26T12:08:52.743965+0000","last_became_active":"2024-04-26T12:08:39.702117+0000","last_became_peered":"2024-04-26T12:08:39.702117+0000","last_unstale":"2024-04-26T12:08:52.743965+0000","last_undegraded":"2024-04-26T12:08:52.743965+0000","last_fullsized":"2024-04-26T12:08:52.743965+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:39.986313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24197,"num_write":416,"num_write_kb":80466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"60'375","reported_seq":470,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744643+0000","last_change":"2024-04-26T12:05:03.791560+0000","last_active":"2024-04-26T12:08:52.744643+0000","last_peered":"2024-04-26T12:08:52.744643+0000","last_clean":"2024-04-26T12:08:52.744643+0000","last_became_active":"2024-04-26T12:05:03.790578+0000","last_became_peered":"2024-04-26T12:05:03.790578+0000","last_unstale":"2024-04-26T12:08:52.744643+0000","last_undegraded":"2024-04-26T12:08:52.744643+0000","last_fullsized":"2024-04-26T12:08:52.744643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6518,"num_write":348,"num_write_kb":38078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'428","reported_seq":524,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744809+0000","last_change":"2024-04-26T12:05:03.791215+0000","last_active":"2024-04-26T12:08:52.744809+0000","last_peered":"2024-04-26T12:08:52.744809+0000","last_clean":"2024-04-26T12:08:52.744809+0000","last_became_active":"2024-04-26T12:05:03.790615+0000","last_became_peered":"2024-04-26T12:05:03.790615+0000","last_unstale":"2024-04-26T12:08:52.744809+0000","last_undegraded":"2024-04-26T12:08:52.744809+0000","last_fullsized":"2024-04-26T12:08:52.744809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:55.388027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12560,"num_write":398,"num_write_kb":67332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"60'387","reported_seq":526,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744454+0000","last_change":"2024-04-26T12:05:03.785861+0000","last_active":"2024-04-26T12:08:52.744454+0000","last_peered":"2024-04-26T12:08:52.744454+0000","last_clean":"2024-04-26T12:08:52.744454+0000","last_became_active":"2024-04-26T12:05:03.785382+0000","last_became_peered":"2024-04-26T12:05:03.785382+0000","last_unstale":"2024-04-26T12:08:52.744454+0000","last_undegraded":"2024-04-26T12:08:52.744454+0000","last_fullsized":"2024-04-26T12:08:52.744454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:51.870183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":41160,"num_write":356,"num_write_kb":80219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"60'405","reported_seq":900,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744722+0000","last_change":"2024-04-26T12:08:46.730220+0000","last_active":"2024-04-26T12:08:52.744722+0000","last_peered":"2024-04-26T12:08:52.744722+0000","last_clean":"2024-04-26T12:08:52.744722+0000","last_became_active":"2024-04-26T12:08:46.729039+0000","last_became_peered":"2024-04-26T12:08:46.729039+0000","last_unstale":"2024-04-26T12:08:52.744722+0000","last_undegraded":"2024-04-26T12:08:52.744722+0000","last_fullsized":"2024-04-26T12:08:52.744722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:00.707126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":11674,"num_write":372,"num_write_kb":34604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"60'425","reported_seq":577,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744378+0000","last_change":"2024-04-26T12:08:41.718786+0000","last_active":"2024-04-26T12:08:52.744378+0000","last_peered":"2024-04-26T12:08:52.744378+0000","last_clean":"2024-04-26T12:08:52.744378+0000","last_became_active":"2024-04-26T12:08:41.716014+0000","last_became_peered":"2024-04-26T12:08:41.716014+0000","last_unstale":"2024-04-26T12:08:52.744378+0000","last_undegraded":"2024-04-26T12:08:52.744378+0000","last_fullsized":"2024-04-26T12:08:52.744378+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:20.096806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":48419,"num_write":390,"num_write_kb":92286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"60'372","reported_seq":489,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745403+0000","last_change":"2024-04-26T12:05:03.791046+0000","last_active":"2024-04-26T12:08:52.745403+0000","last_peered":"2024-04-26T12:08:52.745403+0000","last_clean":"2024-04-26T12:08:52.745403+0000","last_became_active":"2024-04-26T12:05:03.790662+0000","last_became_peered":"2024-04-26T12:05:03.790662+0000","last_unstale":"2024-04-26T12:08:52.745403+0000","last_undegraded":"2024-04-26T12:08:52.745403+0000","last_fullsized":"2024-04-26T12:08:52.745403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:35.458663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25905,"num_write":353,"num_write_kb":75437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'351","reported_seq":426,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744359+0000","last_change":"2024-04-26T12:08:41.718349+0000","last_active":"2024-04-26T12:08:52.744359+0000","last_peered":"2024-04-26T12:08:52.744359+0000","last_clean":"2024-04-26T12:08:52.744359+0000","last_became_active":"2024-04-26T12:08:41.715726+0000","last_became_peered":"2024-04-26T12:08:41.715726+0000","last_unstale":"2024-04-26T12:08:52.744359+0000","last_undegraded":"2024-04-26T12:08:52.744359+0000","last_fullsized":"2024-04-26T12:08:52.744359+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:00.589164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8884,"num_write":327,"num_write_kb":58289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"60'405","reported_seq":485,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744109+0000","last_change":"2024-04-26T12:08:39.705153+0000","last_active":"2024-04-26T12:08:52.744109+0000","last_peered":"2024-04-26T12:08:52.744109+0000","last_clean":"2024-04-26T12:08:52.744109+0000","last_became_active":"2024-04-26T12:08:39.702141+0000","last_became_peered":"2024-04-26T12:08:39.702141+0000","last_unstale":"2024-04-26T12:08:52.744109+0000","last_undegraded":"2024-04-26T12:08:52.744109+0000","last_fullsized":"2024-04-26T12:08:52.744109+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:42.807520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6771,"num_write":372,"num_write_kb":54786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"60'431","reported_seq":937,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745087+0000","last_change":"2024-04-26T12:08:48.741419+0000","last_active":"2024-04-26T12:08:52.745087+0000","last_peered":"2024-04-26T12:08:52.745087+0000","last_clean":"2024-04-26T12:08:52.745087+0000","last_became_active":"2024-04-26T12:08:48.740170+0000","last_became_peered":"2024-04-26T12:08:48.740170+0000","last_unstale":"2024-04-26T12:08:52.745087+0000","last_undegraded":"2024-04-26T12:08:52.745087+0000","last_fullsized":"2024-04-26T12:08:52.745087+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:52.026016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26572,"num_write":398,"num_write_kb":83974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'394","reported_seq":896,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744941+0000","last_change":"2024-04-26T12:08:41.717703+0000","last_active":"2024-04-26T12:08:52.744941+0000","last_peered":"2024-04-26T12:08:52.744941+0000","last_clean":"2024-04-26T12:08:52.744941+0000","last_became_active":"2024-04-26T12:08:41.715956+0000","last_became_peered":"2024-04-26T12:08:41.715956+0000","last_unstale":"2024-04-26T12:08:52.744941+0000","last_undegraded":"2024-04-26T12:08:52.744941+0000","last_fullsized":"2024-04-26T12:08:52.744941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:34.291197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":38136,"num_write":355,"num_write_kb":38484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'432","reported_seq":543,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744458+0000","last_change":"2024-04-26T12:05:03.786360+0000","last_active":"2024-04-26T12:08:52.744458+0000","last_peered":"2024-04-26T12:08:52.744458+0000","last_clean":"2024-04-26T12:08:52.744458+0000","last_became_active":"2024-04-26T12:05:03.785991+0000","last_became_peered":"2024-04-26T12:05:03.785991+0000","last_unstale":"2024-04-26T12:08:52.744458+0000","last_undegraded":"2024-04-26T12:08:52.744458+0000","last_fullsized":"2024-04-26T12:08:52.744458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:17.702068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18244,"num_write":400,"num_write_kb":59033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'381","reported_seq":838,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.747343+0000","last_change":"2024-04-26T12:08:52.747060+0000","last_active":"2024-04-26T12:08:52.747343+0000","last_peered":"2024-04-26T12:08:52.747343+0000","last_clean":"2024-04-26T12:08:52.747343+0000","last_became_active":"2024-04-26T12:08:52.745913+0000","last_became_peered":"2024-04-26T12:08:52.745913+0000","last_unstale":"2024-04-26T12:08:52.747343+0000","last_undegraded":"2024-04-26T12:08:52.747343+0000","last_fullsized":"2024-04-26T12:08:52.747343+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:30.065406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":350,"num_write_kb":21212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"60'424","reported_seq":514,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744398+0000","last_change":"2024-04-26T12:08:42.718639+0000","last_active":"2024-04-26T12:08:52.744398+0000","last_peered":"2024-04-26T12:08:52.744398+0000","last_clean":"2024-04-26T12:08:52.744398+0000","last_became_active":"2024-04-26T12:08:42.716846+0000","last_became_peered":"2024-04-26T12:08:42.716846+0000","last_unstale":"2024-04-26T12:08:52.744398+0000","last_undegraded":"2024-04-26T12:08:52.744398+0000","last_fullsized":"2024-04-26T12:08:52.744398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:00.928679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13930,"num_write":388,"num_write_kb":116055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'426","reported_seq":905,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.748530+0000","last_change":"2024-04-26T12:08:53.748530+0000","last_active":"2024-04-26T12:08:53.748530+0000","last_peered":"2024-04-26T12:08:53.748530+0000","last_clean":"2024-04-26T12:08:53.748530+0000","last_became_active":"2024-04-26T12:08:53.747215+0000","last_became_peered":"2024-04-26T12:08:53.747215+0000","last_unstale":"2024-04-26T12:08:53.748530+0000","last_undegraded":"2024-04-26T12:08:53.748530+0000","last_fullsized":"2024-04-26T12:08:53.748530+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:14.637610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26908,"num_write":383,"num_write_kb":71324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"60'425","reported_seq":546,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745178+0000","last_change":"2024-04-26T12:05:03.792219+0000","last_active":"2024-04-26T12:08:52.745178+0000","last_peered":"2024-04-26T12:08:52.745178+0000","last_clean":"2024-04-26T12:08:52.745178+0000","last_became_active":"2024-04-26T12:05:03.791061+0000","last_became_peered":"2024-04-26T12:05:03.791061+0000","last_unstale":"2024-04-26T12:08:52.745178+0000","last_undegraded":"2024-04-26T12:08:52.745178+0000","last_fullsized":"2024-04-26T12:08:52.745178+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19715,"num_write":398,"num_write_kb":30150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'450","reported_seq":638,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745086+0000","last_change":"2024-04-26T12:05:03.792073+0000","last_active":"2024-04-26T12:08:52.745086+0000","last_peered":"2024-04-26T12:08:52.745086+0000","last_clean":"2024-04-26T12:08:52.745086+0000","last_became_active":"2024-04-26T12:05:03.791693+0000","last_became_peered":"2024-04-26T12:05:03.791693+0000","last_unstale":"2024-04-26T12:08:52.745086+0000","last_undegraded":"2024-04-26T12:08:52.745086+0000","last_fullsized":"2024-04-26T12:08:52.745086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":65124,"num_write":423,"num_write_kb":142714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'434","reported_seq":538,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744125+0000","last_change":"2024-04-26T12:08:46.730582+0000","last_active":"2024-04-26T12:08:52.744125+0000","last_peered":"2024-04-26T12:08:52.744125+0000","last_clean":"2024-04-26T12:08:52.744125+0000","last_became_active":"2024-04-26T12:08:46.728804+0000","last_became_peered":"2024-04-26T12:08:46.728804+0000","last_unstale":"2024-04-26T12:08:52.744125+0000","last_undegraded":"2024-04-26T12:08:52.744125+0000","last_fullsized":"2024-04-26T12:08:52.744125+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:47.745435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":15350,"num_write":405,"num_write_kb":59295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"60'424","reported_seq":537,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743999+0000","last_change":"2024-04-26T12:05:03.788658+0000","last_active":"2024-04-26T12:08:52.743999+0000","last_peered":"2024-04-26T12:08:52.743999+0000","last_clean":"2024-04-26T12:08:52.743999+0000","last_became_active":"2024-04-26T12:05:03.788050+0000","last_became_peered":"2024-04-26T12:05:03.788050+0000","last_unstale":"2024-04-26T12:08:52.743999+0000","last_undegraded":"2024-04-26T12:08:52.743999+0000","last_fullsized":"2024-04-26T12:08:52.743999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23772,"num_write":390,"num_write_kb":67944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"60'447","reported_seq":526,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743819+0000","last_change":"2024-04-26T12:08:40.707153+0000","last_active":"2024-04-26T12:08:52.743819+0000","last_peered":"2024-04-26T12:08:52.743819+0000","last_clean":"2024-04-26T12:08:52.743819+0000","last_became_active":"2024-04-26T12:08:40.703880+0000","last_became_peered":"2024-04-26T12:08:40.703880+0000","last_unstale":"2024-04-26T12:08:52.743819+0000","last_undegraded":"2024-04-26T12:08:52.743819+0000","last_fullsized":"2024-04-26T12:08:52.743819+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:25.187022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9403,"num_write":417,"num_write_kb":67425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"60'417","reported_seq":507,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744515+0000","last_change":"2024-04-26T12:08:42.717934+0000","last_active":"2024-04-26T12:08:52.744515+0000","last_peered":"2024-04-26T12:08:52.744515+0000","last_clean":"2024-04-26T12:08:52.744515+0000","last_became_active":"2024-04-26T12:08:42.715812+0000","last_became_peered":"2024-04-26T12:08:42.715812+0000","last_unstale":"2024-04-26T12:08:52.744515+0000","last_undegraded":"2024-04-26T12:08:52.744515+0000","last_fullsized":"2024-04-26T12:08:52.744515+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:09.442852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20466,"num_write":400,"num_write_kb":42225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"60'475","reported_seq":604,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744858+0000","last_change":"2024-04-26T12:05:03.787909+0000","last_active":"2024-04-26T12:08:52.744858+0000","last_peered":"2024-04-26T12:08:52.744858+0000","last_clean":"2024-04-26T12:08:52.744858+0000","last_became_active":"2024-04-26T12:05:03.787562+0000","last_became_peered":"2024-04-26T12:05:03.787562+0000","last_unstale":"2024-04-26T12:08:52.744858+0000","last_undegraded":"2024-04-26T12:08:52.744858+0000","last_fullsized":"2024-04-26T12:08:52.744858+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25186,"num_write":431,"num_write_kb":48184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"60'409","reported_seq":897,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745514+0000","last_change":"2024-04-26T12:08:49.741823+0000","last_active":"2024-04-26T12:08:52.745514+0000","last_peered":"2024-04-26T12:08:52.745514+0000","last_clean":"2024-04-26T12:08:52.745514+0000","last_became_active":"2024-04-26T12:08:49.740497+0000","last_became_peered":"2024-04-26T12:08:49.740497+0000","last_unstale":"2024-04-26T12:08:52.745514+0000","last_undegraded":"2024-04-26T12:08:52.745514+0000","last_fullsized":"2024-04-26T12:08:52.745514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:00.225872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":20137,"num_write":374,"num_write_kb":55441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'392","reported_seq":493,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744357+0000","last_change":"2024-04-26T12:08:47.737270+0000","last_active":"2024-04-26T12:08:52.744357+0000","last_peered":"2024-04-26T12:08:52.744357+0000","last_clean":"2024-04-26T12:08:52.744357+0000","last_became_active":"2024-04-26T12:08:47.735361+0000","last_became_peered":"2024-04-26T12:08:47.735361+0000","last_unstale":"2024-04-26T12:08:52.744357+0000","last_undegraded":"2024-04-26T12:08:52.744357+0000","last_fullsized":"2024-04-26T12:08:52.744357+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:09.838696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29179,"num_write":355,"num_write_kb":59011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'380","reported_seq":840,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744489+0000","last_change":"2024-04-26T12:08:41.717953+0000","last_active":"2024-04-26T12:08:52.744489+0000","last_peered":"2024-04-26T12:08:52.744489+0000","last_clean":"2024-04-26T12:08:52.744489+0000","last_became_active":"2024-04-26T12:08:41.716234+0000","last_became_peered":"2024-04-26T12:08:41.716234+0000","last_unstale":"2024-04-26T12:08:52.744489+0000","last_undegraded":"2024-04-26T12:08:52.744489+0000","last_fullsized":"2024-04-26T12:08:52.744489+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:37.480062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13036,"num_write":347,"num_write_kb":33880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"60'461","reported_seq":565,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744026+0000","last_change":"2024-04-26T12:08:46.732653+0000","last_active":"2024-04-26T12:08:52.744026+0000","last_peered":"2024-04-26T12:08:52.744026+0000","last_clean":"2024-04-26T12:08:52.744026+0000","last_became_active":"2024-04-26T12:08:46.730738+0000","last_became_peered":"2024-04-26T12:08:46.730738+0000","last_unstale":"2024-04-26T12:08:52.744026+0000","last_undegraded":"2024-04-26T12:08:52.744026+0000","last_fullsized":"2024-04-26T12:08:52.744026+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:46.177056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":32945,"num_write":426,"num_write_kb":63234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"60'411","reported_seq":901,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744088+0000","last_change":"2024-04-26T12:08:40.704958+0000","last_active":"2024-04-26T12:08:52.744088+0000","last_peered":"2024-04-26T12:08:52.744088+0000","last_clean":"2024-04-26T12:08:52.744088+0000","last_became_active":"2024-04-26T12:08:40.703845+0000","last_became_peered":"2024-04-26T12:08:40.703845+0000","last_unstale":"2024-04-26T12:08:52.744088+0000","last_undegraded":"2024-04-26T12:08:52.744088+0000","last_fullsized":"2024-04-26T12:08:52.744088+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:56.148477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11499,"num_write":377,"num_write_kb":34249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'430","reported_seq":538,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744573+0000","last_change":"2024-04-26T12:05:03.791605+0000","last_active":"2024-04-26T12:08:52.744573+0000","last_peered":"2024-04-26T12:08:52.744573+0000","last_clean":"2024-04-26T12:08:52.744573+0000","last_became_active":"2024-04-26T12:05:03.791251+0000","last_became_peered":"2024-04-26T12:05:03.791251+0000","last_unstale":"2024-04-26T12:08:52.744573+0000","last_undegraded":"2024-04-26T12:08:52.744573+0000","last_fullsized":"2024-04-26T12:08:52.744573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:27.239868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14660,"num_write":404,"num_write_kb":60840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"60'392","reported_seq":500,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744114+0000","last_change":"2024-04-26T12:08:44.723861+0000","last_active":"2024-04-26T12:08:52.744114+0000","last_peered":"2024-04-26T12:08:52.744114+0000","last_clean":"2024-04-26T12:08:52.744114+0000","last_became_active":"2024-04-26T12:08:44.722120+0000","last_became_peered":"2024-04-26T12:08:44.722120+0000","last_unstale":"2024-04-26T12:08:52.744114+0000","last_undegraded":"2024-04-26T12:08:52.744114+0000","last_fullsized":"2024-04-26T12:08:52.744114+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:12.810713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31703,"num_write":351,"num_write_kb":59324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"59'514","reported_seq":592,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745155+0000","last_change":"2024-04-26T12:05:03.430021+0000","last_active":"2024-04-26T12:08:52.745155+0000","last_peered":"2024-04-26T12:08:52.745155+0000","last_clean":"2024-04-26T12:08:52.745155+0000","last_became_active":"2024-04-26T12:05:03.429695+0000","last_became_peered":"2024-04-26T12:05:03.429695+0000","last_unstale":"2024-04-26T12:08:52.745155+0000","last_undegraded":"2024-04-26T12:08:52.745155+0000","last_fullsized":"2024-04-26T12:08:52.745155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":8377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'432","reported_seq":522,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.751086+0000","last_change":"2024-04-26T12:08:53.751086+0000","last_active":"2024-04-26T12:08:53.751086+0000","last_peered":"2024-04-26T12:08:53.751086+0000","last_clean":"2024-04-26T12:08:53.751086+0000","last_became_active":"2024-04-26T12:08:53.748972+0000","last_became_peered":"2024-04-26T12:08:53.748972+0000","last_unstale":"2024-04-26T12:08:53.751086+0000","last_undegraded":"2024-04-26T12:08:53.751086+0000","last_fullsized":"2024-04-26T12:08:53.751086+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:34.448806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":30094,"num_write":388,"num_write_kb":83741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"59'55","reported_seq":133,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744325+0000","last_change":"2024-04-26T12:05:03.428605+0000","last_active":"2024-04-26T12:08:52.744325+0000","last_peered":"2024-04-26T12:08:52.744325+0000","last_clean":"2024-04-26T12:08:52.744325+0000","last_became_active":"2024-04-26T12:05:03.428098+0000","last_became_peered":"2024-04-26T12:05:03.428098+0000","last_unstale":"2024-04-26T12:08:52.744325+0000","last_undegraded":"2024-04-26T12:08:52.744325+0000","last_fullsized":"2024-04-26T12:08:52.744325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"60'445","reported_seq":557,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744955+0000","last_change":"2024-04-26T12:05:03.788568+0000","last_active":"2024-04-26T12:08:52.744955+0000","last_peered":"2024-04-26T12:08:52.744955+0000","last_clean":"2024-04-26T12:08:52.744955+0000","last_became_active":"2024-04-26T12:05:03.788039+0000","last_became_peered":"2024-04-26T12:05:03.788039+0000","last_unstale":"2024-04-26T12:08:52.744955+0000","last_undegraded":"2024-04-26T12:08:52.744955+0000","last_fullsized":"2024-04-26T12:08:52.744955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":16079,"num_write":410,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"59'64","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743891+0000","last_change":"2024-04-26T12:08:36.696166+0000","last_active":"2024-04-26T12:08:52.743891+0000","last_peered":"2024-04-26T12:08:52.743891+0000","last_clean":"2024-04-26T12:08:52.743891+0000","last_became_active":"2024-04-26T12:08:36.694921+0000","last_became_peered":"2024-04-26T12:08:36.694921+0000","last_unstale":"2024-04-26T12:08:52.743891+0000","last_undegraded":"2024-04-26T12:08:52.743891+0000","last_fullsized":"2024-04-26T12:08:52.743891+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:57.438892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"60'420","reported_seq":537,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744759+0000","last_change":"2024-04-26T12:05:03.788505+0000","last_active":"2024-04-26T12:08:52.744759+0000","last_peered":"2024-04-26T12:08:52.744759+0000","last_clean":"2024-04-26T12:08:52.744759+0000","last_became_active":"2024-04-26T12:05:03.788184+0000","last_became_peered":"2024-04-26T12:05:03.788184+0000","last_unstale":"2024-04-26T12:08:52.744759+0000","last_undegraded":"2024-04-26T12:08:52.744759+0000","last_fullsized":"2024-04-26T12:08:52.744759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":14666,"num_write":383,"num_write_kb":83769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"60'63","reported_seq":155,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744615+0000","last_change":"2024-04-26T12:08:36.697126+0000","last_active":"2024-04-26T12:08:52.744615+0000","last_peered":"2024-04-26T12:08:52.744615+0000","last_clean":"2024-04-26T12:08:52.744615+0000","last_became_active":"2024-04-26T12:08:36.696792+0000","last_became_peered":"2024-04-26T12:08:36.696792+0000","last_unstale":"2024-04-26T12:08:52.744615+0000","last_undegraded":"2024-04-26T12:08:52.744615+0000","last_fullsized":"2024-04-26T12:08:52.744615+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:48.447882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"59'232","reported_seq":335,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745720+0000","last_change":"2024-04-26T12:08:39.703810+0000","last_active":"2024-04-26T12:08:52.745720+0000","last_peered":"2024-04-26T12:08:52.745720+0000","last_clean":"2024-04-26T12:08:52.745720+0000","last_became_active":"2024-04-26T12:08:39.703455+0000","last_became_peered":"2024-04-26T12:08:39.703455+0000","last_unstale":"2024-04-26T12:08:52.745720+0000","last_undegraded":"2024-04-26T12:08:52.745720+0000","last_fullsized":"2024-04-26T12:08:52.745720+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:08.399237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'408","reported_seq":491,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743999+0000","last_change":"2024-04-26T12:08:40.710236+0000","last_active":"2024-04-26T12:08:52.743999+0000","last_peered":"2024-04-26T12:08:52.743999+0000","last_clean":"2024-04-26T12:08:52.743999+0000","last_became_active":"2024-04-26T12:08:40.707357+0000","last_became_peered":"2024-04-26T12:08:40.707357+0000","last_unstale":"2024-04-26T12:08:52.743999+0000","last_undegraded":"2024-04-26T12:08:52.743999+0000","last_fullsized":"2024-04-26T12:08:52.743999+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:17.928748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12418,"num_write":371,"num_write_kb":58378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"59'302","reported_seq":370,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744280+0000","last_change":"2024-04-26T12:08:39.703949+0000","last_active":"2024-04-26T12:08:52.744280+0000","last_peered":"2024-04-26T12:08:52.744280+0000","last_clean":"2024-04-26T12:08:52.744280+0000","last_became_active":"2024-04-26T12:08:39.703421+0000","last_became_peered":"2024-04-26T12:08:39.703421+0000","last_unstale":"2024-04-26T12:08:52.744280+0000","last_undegraded":"2024-04-26T12:08:52.744280+0000","last_fullsized":"2024-04-26T12:08:52.744280+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:10.222074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":4228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'439","reported_seq":498,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743713+0000","last_change":"2024-04-26T12:08:41.717923+0000","last_active":"2024-04-26T12:08:52.743713+0000","last_peered":"2024-04-26T12:08:52.743713+0000","last_clean":"2024-04-26T12:08:52.743713+0000","last_became_active":"2024-04-26T12:08:41.715708+0000","last_became_peered":"2024-04-26T12:08:41.715708+0000","last_unstale":"2024-04-26T12:08:52.743713+0000","last_undegraded":"2024-04-26T12:08:52.743713+0000","last_fullsized":"2024-04-26T12:08:52.743713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:23.646558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":30851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"59'589","reported_seq":692,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745816+0000","last_change":"2024-04-26T12:08:39.703966+0000","last_active":"2024-04-26T12:08:52.745816+0000","last_peered":"2024-04-26T12:08:52.745816+0000","last_clean":"2024-04-26T12:08:52.745816+0000","last_became_active":"2024-04-26T12:08:39.703487+0000","last_became_peered":"2024-04-26T12:08:39.703487+0000","last_unstale":"2024-04-26T12:08:52.745816+0000","last_undegraded":"2024-04-26T12:08:52.745816+0000","last_fullsized":"2024-04-26T12:08:52.745816+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:06.112476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":534,"num_write_kb":4333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'461","reported_seq":614,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744817+0000","last_change":"2024-04-26T12:05:03.791809+0000","last_active":"2024-04-26T12:08:52.744817+0000","last_peered":"2024-04-26T12:08:52.744817+0000","last_clean":"2024-04-26T12:08:52.744817+0000","last_became_active":"2024-04-26T12:05:03.791272+0000","last_became_peered":"2024-04-26T12:05:03.791272+0000","last_unstale":"2024-04-26T12:08:52.744817+0000","last_undegraded":"2024-04-26T12:08:52.744817+0000","last_fullsized":"2024-04-26T12:08:52.744817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":46123,"num_write":422,"num_write_kb":104552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'66","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745499+0000","last_change":"2024-04-26T12:05:03.430224+0000","last_active":"2024-04-26T12:08:52.745499+0000","last_peered":"2024-04-26T12:08:52.745499+0000","last_clean":"2024-04-26T12:08:52.745499+0000","last_became_active":"2024-04-26T12:05:03.429291+0000","last_became_peered":"2024-04-26T12:05:03.429291+0000","last_unstale":"2024-04-26T12:08:52.745499+0000","last_undegraded":"2024-04-26T12:08:52.745499+0000","last_fullsized":"2024-04-26T12:08:52.745499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'428","reported_seq":541,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744404+0000","last_change":"2024-04-26T12:05:03.788174+0000","last_active":"2024-04-26T12:08:52.744404+0000","last_peered":"2024-04-26T12:08:52.744404+0000","last_clean":"2024-04-26T12:08:52.744404+0000","last_became_active":"2024-04-26T12:05:03.787772+0000","last_became_peered":"2024-04-26T12:05:03.787772+0000","last_unstale":"2024-04-26T12:08:52.744404+0000","last_undegraded":"2024-04-26T12:08:52.744404+0000","last_fullsized":"2024-04-26T12:08:52.744404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15098,"num_write":394,"num_write_kb":42677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"59'195","reported_seq":273,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744598+0000","last_change":"2024-04-26T12:05:03.431162+0000","last_active":"2024-04-26T12:08:52.744598+0000","last_peered":"2024-04-26T12:08:52.744598+0000","last_clean":"2024-04-26T12:08:52.744598+0000","last_became_active":"2024-04-26T12:05:03.430855+0000","last_became_peered":"2024-04-26T12:05:03.430855+0000","last_unstale":"2024-04-26T12:08:52.744598+0000","last_undegraded":"2024-04-26T12:08:52.744598+0000","last_fullsized":"2024-04-26T12:08:52.744598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:41.279426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"60'448","reported_seq":544,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745298+0000","last_change":"2024-04-26T12:05:03.792357+0000","last_active":"2024-04-26T12:08:52.745298+0000","last_peered":"2024-04-26T12:08:52.745298+0000","last_clean":"2024-04-26T12:08:52.745298+0000","last_became_active":"2024-04-26T12:05:03.792119+0000","last_became_peered":"2024-04-26T12:05:03.792119+0000","last_unstale":"2024-04-26T12:08:52.745298+0000","last_undegraded":"2024-04-26T12:08:52.745298+0000","last_fullsized":"2024-04-26T12:08:52.745298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":13281,"num_write":420,"num_write_kb":59540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"59'171","reported_seq":249,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745146+0000","last_change":"2024-04-26T12:05:03.429811+0000","last_active":"2024-04-26T12:08:52.745146+0000","last_peered":"2024-04-26T12:08:52.745146+0000","last_clean":"2024-04-26T12:08:52.745146+0000","last_became_active":"2024-04-26T12:05:03.429469+0000","last_became_peered":"2024-04-26T12:05:03.429469+0000","last_unstale":"2024-04-26T12:08:52.745146+0000","last_undegraded":"2024-04-26T12:08:52.745146+0000","last_fullsized":"2024-04-26T12:08:52.745146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'412","reported_seq":923,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745698+0000","last_change":"2024-04-26T12:08:51.752350+0000","last_active":"2024-04-26T12:08:52.745698+0000","last_peered":"2024-04-26T12:08:52.745698+0000","last_clean":"2024-04-26T12:08:52.745698+0000","last_became_active":"2024-04-26T12:08:51.751044+0000","last_became_peered":"2024-04-26T12:08:51.751044+0000","last_unstale":"2024-04-26T12:08:52.745698+0000","last_undegraded":"2024-04-26T12:08:52.745698+0000","last_fullsized":"2024-04-26T12:08:52.745698+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:40.008727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26310,"num_write":380,"num_write_kb":38462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"59'55","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743708+0000","last_change":"2024-04-26T12:08:36.695355+0000","last_active":"2024-04-26T12:08:52.743708+0000","last_peered":"2024-04-26T12:08:52.743708+0000","last_clean":"2024-04-26T12:08:52.743708+0000","last_became_active":"2024-04-26T12:08:36.694346+0000","last_became_peered":"2024-04-26T12:08:36.694346+0000","last_unstale":"2024-04-26T12:08:52.743708+0000","last_undegraded":"2024-04-26T12:08:52.743708+0000","last_fullsized":"2024-04-26T12:08:52.743708+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:42.458073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"60'362","reported_seq":817,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745440+0000","last_change":"2024-04-26T12:08:41.717048+0000","last_active":"2024-04-26T12:08:52.745440+0000","last_peered":"2024-04-26T12:08:52.745440+0000","last_clean":"2024-04-26T12:08:52.745440+0000","last_became_active":"2024-04-26T12:08:41.716102+0000","last_became_peered":"2024-04-26T12:08:41.716102+0000","last_unstale":"2024-04-26T12:08:52.745440+0000","last_undegraded":"2024-04-26T12:08:52.745440+0000","last_fullsized":"2024-04-26T12:08:52.745440+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:52.409548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21408,"num_write":333,"num_write_kb":66549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"59'378","reported_seq":439,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743919+0000","last_change":"2024-04-26T12:08:39.702797+0000","last_active":"2024-04-26T12:08:52.743919+0000","last_peered":"2024-04-26T12:08:52.743919+0000","last_clean":"2024-04-26T12:08:52.743919+0000","last_became_active":"2024-04-26T12:08:39.702438+0000","last_became_peered":"2024-04-26T12:08:39.702438+0000","last_unstale":"2024-04-26T12:08:52.743919+0000","last_undegraded":"2024-04-26T12:08:52.743919+0000","last_fullsized":"2024-04-26T12:08:52.743919+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:06.278304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"60'407","reported_seq":917,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744823+0000","last_change":"2024-04-26T12:08:45.724853+0000","last_active":"2024-04-26T12:08:52.744823+0000","last_peered":"2024-04-26T12:08:52.744823+0000","last_clean":"2024-04-26T12:08:52.744823+0000","last_became_active":"2024-04-26T12:08:45.723772+0000","last_became_peered":"2024-04-26T12:08:45.723772+0000","last_unstale":"2024-04-26T12:08:52.744823+0000","last_undegraded":"2024-04-26T12:08:52.744823+0000","last_fullsized":"2024-04-26T12:08:52.744823+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:41.814840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":40156,"num_write":373,"num_write_kb":91285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":294,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745711+0000","last_change":"2024-04-26T12:08:36.697892+0000","last_active":"2024-04-26T12:08:53.745711+0000","last_peered":"2024-04-26T12:08:53.745711+0000","last_clean":"2024-04-26T12:08:53.745711+0000","last_became_active":"2024-04-26T12:08:36.697508+0000","last_became_peered":"2024-04-26T12:08:36.697508+0000","last_unstale":"2024-04-26T12:08:53.745711+0000","last_undegraded":"2024-04-26T12:08:53.745711+0000","last_fullsized":"2024-04-26T12:08:53.745711+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_clean_scrub_stamp":"2024-04-26T12:04:52.376986+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:24.384180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745283+0000","last_change":"2024-04-26T12:04:59.403711+0000","last_active":"2024-04-26T12:08:52.745283+0000","last_peered":"2024-04-26T12:08:52.745283+0000","last_clean":"2024-04-26T12:08:52.745283+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:08:52.745283+0000","last_undegraded":"2024-04-26T12:08:52.745283+0000","last_fullsized":"2024-04-26T12:08:52.745283+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:45.779614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'793","reported_seq":897,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744445+0000","last_change":"2024-04-26T12:08:39.702225+0000","last_active":"2024-04-26T12:08:52.744445+0000","last_peered":"2024-04-26T12:08:52.744445+0000","last_clean":"2024-04-26T12:08:52.744445+0000","last_became_active":"2024-04-26T12:08:39.701760+0000","last_became_peered":"2024-04-26T12:08:39.701760+0000","last_unstale":"2024-04-26T12:08:52.744445+0000","last_undegraded":"2024-04-26T12:08:52.744445+0000","last_fullsized":"2024-04-26T12:08:52.744445+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:51.405891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":8533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"60'466","reported_seq":1012,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.747878+0000","last_change":"2024-04-26T12:08:52.747463+0000","last_active":"2024-04-26T12:08:52.747878+0000","last_peered":"2024-04-26T12:08:52.747878+0000","last_clean":"2024-04-26T12:08:52.747878+0000","last_became_active":"2024-04-26T12:08:52.746147+0000","last_became_peered":"2024-04-26T12:08:52.746147+0000","last_unstale":"2024-04-26T12:08:52.747878+0000","last_undegraded":"2024-04-26T12:08:52.747878+0000","last_fullsized":"2024-04-26T12:08:52.747878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:21.517395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":37547,"num_write":422,"num_write_kb":96579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":95,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745616+0000","last_change":"2024-04-26T12:08:36.695759+0000","last_active":"2024-04-26T12:08:53.745616+0000","last_peered":"2024-04-26T12:08:53.745616+0000","last_clean":"2024-04-26T12:08:53.745616+0000","last_became_active":"2024-04-26T12:08:36.695444+0000","last_became_peered":"2024-04-26T12:08:36.695444+0000","last_unstale":"2024-04-26T12:08:53.745616+0000","last_undegraded":"2024-04-26T12:08:53.745616+0000","last_fullsized":"2024-04-26T12:08:53.745616+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:22.343369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"60'114","reported_seq":239,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744279+0000","last_change":"2024-04-26T12:05:03.428547+0000","last_active":"2024-04-26T12:08:52.744279+0000","last_peered":"2024-04-26T12:08:52.744279+0000","last_clean":"2024-04-26T12:08:52.744279+0000","last_became_active":"2024-04-26T12:05:03.427985+0000","last_became_peered":"2024-04-26T12:05:03.427985+0000","last_unstale":"2024-04-26T12:08:52.744279+0000","last_undegraded":"2024-04-26T12:08:52.744279+0000","last_fullsized":"2024-04-26T12:08:52.744279+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:19.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466015,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":47,"num_write_kb":1464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"60'492","reported_seq":655,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744496+0000","last_change":"2024-04-26T12:08:49.741650+0000","last_active":"2024-04-26T12:08:52.744496+0000","last_peered":"2024-04-26T12:08:52.744496+0000","last_clean":"2024-04-26T12:08:52.744496+0000","last_became_active":"2024-04-26T12:08:49.739496+0000","last_became_peered":"2024-04-26T12:08:49.739496+0000","last_unstale":"2024-04-26T12:08:52.744496+0000","last_undegraded":"2024-04-26T12:08:52.744496+0000","last_fullsized":"2024-04-26T12:08:52.744496+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:55.361224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":63988,"num_write":466,"num_write_kb":154489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744369+0000","last_change":"2024-04-26T12:08:36.696858+0000","last_active":"2024-04-26T12:08:52.744369+0000","last_peered":"2024-04-26T12:08:52.744369+0000","last_clean":"2024-04-26T12:08:52.744369+0000","last_became_active":"2024-04-26T12:08:36.696619+0000","last_became_peered":"2024-04-26T12:08:36.696619+0000","last_unstale":"2024-04-26T12:08:52.744369+0000","last_undegraded":"2024-04-26T12:08:52.744369+0000","last_fullsized":"2024-04-26T12:08:52.744369+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:47.292926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"59'325","reported_seq":386,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743649+0000","last_change":"2024-04-26T12:08:39.704052+0000","last_active":"2024-04-26T12:08:52.743649+0000","last_peered":"2024-04-26T12:08:52.743649+0000","last_clean":"2024-04-26T12:08:52.743649+0000","last_became_active":"2024-04-26T12:08:39.703696+0000","last_became_peered":"2024-04-26T12:08:39.703696+0000","last_unstale":"2024-04-26T12:08:52.743649+0000","last_undegraded":"2024-04-26T12:08:52.743649+0000","last_fullsized":"2024-04-26T12:08:52.743649+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:21:44.069244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":8296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"60'359","reported_seq":785,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744857+0000","last_change":"2024-04-26T12:08:47.737443+0000","last_active":"2024-04-26T12:08:52.744857+0000","last_peered":"2024-04-26T12:08:52.744857+0000","last_clean":"2024-04-26T12:08:52.744857+0000","last_became_active":"2024-04-26T12:08:47.735729+0000","last_became_peered":"2024-04-26T12:08:47.735729+0000","last_unstale":"2024-04-26T12:08:52.744857+0000","last_undegraded":"2024-04-26T12:08:52.744857+0000","last_fullsized":"2024-04-26T12:08:52.744857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:57:20.726677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9448,"num_write":336,"num_write_kb":74900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745246+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:08:52.745246+0000","last_peered":"2024-04-26T12:08:52.745246+0000","last_clean":"2024-04-26T12:08:52.745246+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:08:52.745246+0000","last_undegraded":"2024-04-26T12:08:52.745246+0000","last_fullsized":"2024-04-26T12:08:52.745246+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:12.939539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"59'67","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745292+0000","last_change":"2024-04-26T12:05:03.430140+0000","last_active":"2024-04-26T12:08:52.745292+0000","last_peered":"2024-04-26T12:08:52.745292+0000","last_clean":"2024-04-26T12:08:52.745292+0000","last_became_active":"2024-04-26T12:05:03.429838+0000","last_became_peered":"2024-04-26T12:05:03.429838+0000","last_unstale":"2024-04-26T12:08:52.745292+0000","last_undegraded":"2024-04-26T12:08:52.745292+0000","last_fullsized":"2024-04-26T12:08:52.745292+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"60'403","reported_seq":894,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744652+0000","last_change":"2024-04-26T12:08:50.753437+0000","last_active":"2024-04-26T12:08:52.744652+0000","last_peered":"2024-04-26T12:08:52.744652+0000","last_clean":"2024-04-26T12:08:52.744652+0000","last_became_active":"2024-04-26T12:08:50.752366+0000","last_became_peered":"2024-04-26T12:08:50.752366+0000","last_unstale":"2024-04-26T12:08:52.744652+0000","last_undegraded":"2024-04-26T12:08:52.744652+0000","last_fullsized":"2024-04-26T12:08:52.744652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:02.999757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30094,"num_write":370,"num_write_kb":104181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"59'469","reported_seq":547,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745818+0000","last_change":"2024-04-26T12:05:03.429673+0000","last_active":"2024-04-26T12:08:52.745818+0000","last_peered":"2024-04-26T12:08:52.745818+0000","last_clean":"2024-04-26T12:08:52.745818+0000","last_became_active":"2024-04-26T12:05:03.429146+0000","last_became_peered":"2024-04-26T12:05:03.429146+0000","last_unstale":"2024-04-26T12:08:52.745818+0000","last_undegraded":"2024-04-26T12:08:52.745818+0000","last_fullsized":"2024-04-26T12:08:52.745818+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744743+0000","last_change":"2024-04-26T12:08:36.697900+0000","last_active":"2024-04-26T12:08:52.744743+0000","last_peered":"2024-04-26T12:08:52.744743+0000","last_clean":"2024-04-26T12:08:52.744743+0000","last_became_active":"2024-04-26T12:08:36.697618+0000","last_became_peered":"2024-04-26T12:08:36.697618+0000","last_unstale":"2024-04-26T12:08:52.744743+0000","last_undegraded":"2024-04-26T12:08:52.744743+0000","last_fullsized":"2024-04-26T12:08:52.744743+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:16.620901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'354","reported_seq":413,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744055+0000","last_change":"2024-04-26T12:08:45.725751+0000","last_active":"2024-04-26T12:08:52.744055+0000","last_peered":"2024-04-26T12:08:52.744055+0000","last_clean":"2024-04-26T12:08:52.744055+0000","last_became_active":"2024-04-26T12:08:45.724153+0000","last_became_peered":"2024-04-26T12:08:45.724153+0000","last_unstale":"2024-04-26T12:08:52.744055+0000","last_undegraded":"2024-04-26T12:08:52.744055+0000","last_fullsized":"2024-04-26T12:08:52.744055+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:57.798803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":416,"num_write":319,"num_write_kb":17259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"59'53","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744703+0000","last_change":"2024-04-26T12:08:36.698122+0000","last_active":"2024-04-26T12:08:52.744703+0000","last_peered":"2024-04-26T12:08:52.744703+0000","last_clean":"2024-04-26T12:08:52.744703+0000","last_became_active":"2024-04-26T12:08:36.697832+0000","last_became_peered":"2024-04-26T12:08:36.697832+0000","last_unstale":"2024-04-26T12:08:52.744703+0000","last_undegraded":"2024-04-26T12:08:52.744703+0000","last_fullsized":"2024-04-26T12:08:52.744703+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:34.416168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744650+0000","last_change":"2024-04-26T12:08:36.698131+0000","last_active":"2024-04-26T12:08:52.744650+0000","last_peered":"2024-04-26T12:08:52.744650+0000","last_clean":"2024-04-26T12:08:52.744650+0000","last_became_active":"2024-04-26T12:08:36.697698+0000","last_became_peered":"2024-04-26T12:08:36.697698+0000","last_unstale":"2024-04-26T12:08:52.744650+0000","last_undegraded":"2024-04-26T12:08:52.744650+0000","last_fullsized":"2024-04-26T12:08:52.744650+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:15.476036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'399","reported_seq":477,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743860+0000","last_change":"2024-04-26T12:08:40.705752+0000","last_active":"2024-04-26T12:08:52.743860+0000","last_peered":"2024-04-26T12:08:52.743860+0000","last_clean":"2024-04-26T12:08:52.743860+0000","last_became_active":"2024-04-26T12:08:40.703906+0000","last_became_peered":"2024-04-26T12:08:40.703906+0000","last_unstale":"2024-04-26T12:08:52.743860+0000","last_undegraded":"2024-04-26T12:08:52.743860+0000","last_fullsized":"2024-04-26T12:08:52.743860+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:19.004074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11720,"num_write":363,"num_write_kb":66914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"59'65","reported_seq":157,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745130+0000","last_change":"2024-04-26T12:08:36.699388+0000","last_active":"2024-04-26T12:08:52.745130+0000","last_peered":"2024-04-26T12:08:52.745130+0000","last_clean":"2024-04-26T12:08:52.745130+0000","last_became_active":"2024-04-26T12:08:36.699058+0000","last_became_peered":"2024-04-26T12:08:36.699058+0000","last_unstale":"2024-04-26T12:08:52.745130+0000","last_undegraded":"2024-04-26T12:08:52.745130+0000","last_fullsized":"2024-04-26T12:08:52.745130+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:11.978288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745047+0000","last_change":"2024-04-26T12:08:36.697618+0000","last_active":"2024-04-26T12:08:52.745047+0000","last_peered":"2024-04-26T12:08:52.745047+0000","last_clean":"2024-04-26T12:08:52.745047+0000","last_became_active":"2024-04-26T12:08:36.697407+0000","last_became_peered":"2024-04-26T12:08:36.697407+0000","last_unstale":"2024-04-26T12:08:52.745047+0000","last_undegraded":"2024-04-26T12:08:52.745047+0000","last_fullsized":"2024-04-26T12:08:52.745047+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:02.301767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'424","reported_seq":541,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744097+0000","last_change":"2024-04-26T12:05:03.789623+0000","last_active":"2024-04-26T12:08:52.744097+0000","last_peered":"2024-04-26T12:08:52.744097+0000","last_clean":"2024-04-26T12:08:52.744097+0000","last_became_active":"2024-04-26T12:05:03.789390+0000","last_became_peered":"2024-04-26T12:05:03.789390+0000","last_unstale":"2024-04-26T12:08:52.744097+0000","last_undegraded":"2024-04-26T12:08:52.744097+0000","last_fullsized":"2024-04-26T12:08:52.744097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17027,"num_write":386,"num_write_kb":58797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"61'70","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745116+0000","last_change":"2024-04-26T12:05:03.429222+0000","last_active":"2024-04-26T12:08:52.745116+0000","last_peered":"2024-04-26T12:08:52.745116+0000","last_clean":"2024-04-26T12:08:52.745116+0000","last_became_active":"2024-04-26T12:05:03.428803+0000","last_became_peered":"2024-04-26T12:05:03.428803+0000","last_unstale":"2024-04-26T12:08:52.745116+0000","last_undegraded":"2024-04-26T12:08:52.745116+0000","last_fullsized":"2024-04-26T12:08:52.745116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:31.305644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745750+0000","last_change":"2024-04-26T12:08:36.698775+0000","last_active":"2024-04-26T12:08:52.745750+0000","last_peered":"2024-04-26T12:08:52.745750+0000","last_clean":"2024-04-26T12:08:52.745750+0000","last_became_active":"2024-04-26T12:08:36.698523+0000","last_became_peered":"2024-04-26T12:08:36.698523+0000","last_unstale":"2024-04-26T12:08:52.745750+0000","last_undegraded":"2024-04-26T12:08:52.745750+0000","last_fullsized":"2024-04-26T12:08:52.745750+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:16.620901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'393","reported_seq":472,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744009+0000","last_change":"2024-04-26T12:08:40.705662+0000","last_active":"2024-04-26T12:08:52.744009+0000","last_peered":"2024-04-26T12:08:52.744009+0000","last_clean":"2024-04-26T12:08:52.744009+0000","last_became_active":"2024-04-26T12:08:40.703873+0000","last_became_peered":"2024-04-26T12:08:40.703873+0000","last_unstale":"2024-04-26T12:08:52.744009+0000","last_undegraded":"2024-04-26T12:08:52.744009+0000","last_fullsized":"2024-04-26T12:08:52.744009+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:27.057123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":11991,"num_write":357,"num_write_kb":83226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'419","reported_seq":892,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744937+0000","last_change":"2024-04-26T12:08:44.723692+0000","last_active":"2024-04-26T12:08:52.744937+0000","last_peered":"2024-04-26T12:08:52.744937+0000","last_clean":"2024-04-26T12:08:52.744937+0000","last_became_active":"2024-04-26T12:08:44.722574+0000","last_became_peered":"2024-04-26T12:08:44.722574+0000","last_unstale":"2024-04-26T12:08:52.744937+0000","last_undegraded":"2024-04-26T12:08:52.744937+0000","last_fullsized":"2024-04-26T12:08:52.744937+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:01.256055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14983,"num_write":376,"num_write_kb":76749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"61'398","reported_seq":507,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745436+0000","last_change":"2024-04-26T12:08:39.703851+0000","last_active":"2024-04-26T12:08:52.745436+0000","last_peered":"2024-04-26T12:08:52.745436+0000","last_clean":"2024-04-26T12:08:52.745436+0000","last_became_active":"2024-04-26T12:08:39.703516+0000","last_became_peered":"2024-04-26T12:08:39.703516+0000","last_unstale":"2024-04-26T12:08:52.745436+0000","last_undegraded":"2024-04-26T12:08:52.745436+0000","last_fullsized":"2024-04-26T12:08:52.745436+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:10.227718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699266,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":9692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9692849,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'428","reported_seq":940,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744179+0000","last_change":"2024-04-26T12:08:50.753473+0000","last_active":"2024-04-26T12:08:52.744179+0000","last_peered":"2024-04-26T12:08:52.744179+0000","last_clean":"2024-04-26T12:08:52.744179+0000","last_became_active":"2024-04-26T12:08:50.752328+0000","last_became_peered":"2024-04-26T12:08:50.752328+0000","last_unstale":"2024-04-26T12:08:52.744179+0000","last_undegraded":"2024-04-26T12:08:52.744179+0000","last_fullsized":"2024-04-26T12:08:52.744179+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:08.396108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":26594,"num_write":396,"num_write_kb":67932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"60'91","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744409+0000","last_change":"2024-04-26T12:08:36.722607+0000","last_active":"2024-04-26T12:08:52.744409+0000","last_peered":"2024-04-26T12:08:52.744409+0000","last_clean":"2024-04-26T12:08:52.744409+0000","last_became_active":"2024-04-26T12:08:36.697650+0000","last_became_peered":"2024-04-26T12:08:36.697650+0000","last_unstale":"2024-04-26T12:08:52.744409+0000","last_undegraded":"2024-04-26T12:08:52.744409+0000","last_fullsized":"2024-04-26T12:08:52.744409+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:10.718101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"59'316","reported_seq":394,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745553+0000","last_change":"2024-04-26T12:05:03.429257+0000","last_active":"2024-04-26T12:08:52.745553+0000","last_peered":"2024-04-26T12:08:52.745553+0000","last_clean":"2024-04-26T12:08:52.745553+0000","last_became_active":"2024-04-26T12:05:03.428921+0000","last_became_peered":"2024-04-26T12:05:03.428921+0000","last_unstale":"2024-04-26T12:08:52.745553+0000","last_undegraded":"2024-04-26T12:08:52.745553+0000","last_fullsized":"2024-04-26T12:08:52.745553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:49.774845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'495","reported_seq":625,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744089+0000","last_change":"2024-04-26T12:05:03.788141+0000","last_active":"2024-04-26T12:08:52.744089+0000","last_peered":"2024-04-26T12:08:52.744089+0000","last_clean":"2024-04-26T12:08:52.744089+0000","last_became_active":"2024-04-26T12:05:03.787533+0000","last_became_peered":"2024-04-26T12:05:03.787533+0000","last_unstale":"2024-04-26T12:08:52.744089+0000","last_undegraded":"2024-04-26T12:08:52.744089+0000","last_fullsized":"2024-04-26T12:08:52.744089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37174,"num_write":458,"num_write_kb":125832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'51","reported_seq":129,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745033+0000","last_change":"2024-04-26T12:05:03.428971+0000","last_active":"2024-04-26T12:08:52.745033+0000","last_peered":"2024-04-26T12:08:52.745033+0000","last_clean":"2024-04-26T12:08:52.745033+0000","last_became_active":"2024-04-26T12:05:03.428445+0000","last_became_peered":"2024-04-26T12:05:03.428445+0000","last_unstale":"2024-04-26T12:08:52.745033+0000","last_undegraded":"2024-04-26T12:08:52.745033+0000","last_fullsized":"2024-04-26T12:08:52.745033+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'482","reported_seq":1130,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744097+0000","last_change":"2024-04-26T12:08:48.741589+0000","last_active":"2024-04-26T12:08:52.744097+0000","last_peered":"2024-04-26T12:08:52.744097+0000","last_clean":"2024-04-26T12:08:52.744097+0000","last_became_active":"2024-04-26T12:08:48.740055+0000","last_became_peered":"2024-04-26T12:08:48.740055+0000","last_unstale":"2024-04-26T12:08:52.744097+0000","last_undegraded":"2024-04-26T12:08:52.744097+0000","last_fullsized":"2024-04-26T12:08:52.744097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:03.903516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":61972,"num_write":459,"num_write_kb":125797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"60'392","reported_seq":527,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744471+0000","last_change":"2024-04-26T12:08:43.718939+0000","last_active":"2024-04-26T12:08:52.744471+0000","last_peered":"2024-04-26T12:08:52.744471+0000","last_clean":"2024-04-26T12:08:52.744471+0000","last_became_active":"2024-04-26T12:08:43.717109+0000","last_became_peered":"2024-04-26T12:08:43.717109+0000","last_unstale":"2024-04-26T12:08:52.744471+0000","last_undegraded":"2024-04-26T12:08:52.744471+0000","last_fullsized":"2024-04-26T12:08:52.744471+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:14.846653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":37910,"num_write":366,"num_write_kb":84111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"59'709","reported_seq":813,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744368+0000","last_change":"2024-04-26T12:08:39.701978+0000","last_active":"2024-04-26T12:08:52.744368+0000","last_peered":"2024-04-26T12:08:52.744368+0000","last_clean":"2024-04-26T12:08:52.744368+0000","last_became_active":"2024-04-26T12:08:39.700927+0000","last_became_peered":"2024-04-26T12:08:39.700927+0000","last_unstale":"2024-04-26T12:08:52.744368+0000","last_undegraded":"2024-04-26T12:08:52.744368+0000","last_fullsized":"2024-04-26T12:08:52.744368+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:10.815597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"60'435","reported_seq":572,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744787+0000","last_change":"2024-04-26T12:05:03.788754+0000","last_active":"2024-04-26T12:08:52.744787+0000","last_peered":"2024-04-26T12:08:52.744787+0000","last_clean":"2024-04-26T12:08:52.744787+0000","last_became_active":"2024-04-26T12:05:03.788311+0000","last_became_peered":"2024-04-26T12:05:03.788311+0000","last_unstale":"2024-04-26T12:08:52.744787+0000","last_undegraded":"2024-04-26T12:08:52.744787+0000","last_fullsized":"2024-04-26T12:08:52.744787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":28462,"num_write":403,"num_write_kb":93779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"59'262","reported_seq":340,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744211+0000","last_change":"2024-04-26T12:05:03.428810+0000","last_active":"2024-04-26T12:08:52.744211+0000","last_peered":"2024-04-26T12:08:52.744211+0000","last_clean":"2024-04-26T12:08:52.744211+0000","last_became_active":"2024-04-26T12:05:03.428191+0000","last_became_peered":"2024-04-26T12:05:03.428191+0000","last_unstale":"2024-04-26T12:08:52.744211+0000","last_undegraded":"2024-04-26T12:08:52.744211+0000","last_fullsized":"2024-04-26T12:08:52.744211+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"60'399","reported_seq":499,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744294+0000","last_change":"2024-04-26T12:08:49.742459+0000","last_active":"2024-04-26T12:08:52.744294+0000","last_peered":"2024-04-26T12:08:52.744294+0000","last_clean":"2024-04-26T12:08:52.744294+0000","last_became_active":"2024-04-26T12:08:49.740536+0000","last_became_peered":"2024-04-26T12:08:49.740536+0000","last_unstale":"2024-04-26T12:08:52.744294+0000","last_undegraded":"2024-04-26T12:08:52.744294+0000","last_fullsized":"2024-04-26T12:08:52.744294+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:24.169669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22216,"num_write":357,"num_write_kb":75245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"59'430","reported_seq":490,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743876+0000","last_change":"2024-04-26T12:08:39.703050+0000","last_active":"2024-04-26T12:08:52.743876+0000","last_peered":"2024-04-26T12:08:52.743876+0000","last_clean":"2024-04-26T12:08:52.743876+0000","last_became_active":"2024-04-26T12:08:39.702529+0000","last_became_peered":"2024-04-26T12:08:39.702529+0000","last_unstale":"2024-04-26T12:08:52.743876+0000","last_undegraded":"2024-04-26T12:08:52.743876+0000","last_fullsized":"2024-04-26T12:08:52.743876+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:28.249725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":12514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"60'387","reported_seq":476,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744228+0000","last_change":"2024-04-26T12:08:43.720098+0000","last_active":"2024-04-26T12:08:52.744228+0000","last_peered":"2024-04-26T12:08:52.744228+0000","last_clean":"2024-04-26T12:08:52.744228+0000","last_became_active":"2024-04-26T12:08:43.717442+0000","last_became_peered":"2024-04-26T12:08:43.717442+0000","last_unstale":"2024-04-26T12:08:52.744228+0000","last_undegraded":"2024-04-26T12:08:52.744228+0000","last_fullsized":"2024-04-26T12:08:52.744228+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:13.140334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20720,"num_write":352,"num_write_kb":87643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"59'58","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743900+0000","last_change":"2024-04-26T12:08:36.720540+0000","last_active":"2024-04-26T12:08:52.743900+0000","last_peered":"2024-04-26T12:08:52.743900+0000","last_clean":"2024-04-26T12:08:52.743900+0000","last_became_active":"2024-04-26T12:08:36.693399+0000","last_became_peered":"2024-04-26T12:08:36.693399+0000","last_unstale":"2024-04-26T12:08:52.743900+0000","last_undegraded":"2024-04-26T12:08:52.743900+0000","last_fullsized":"2024-04-26T12:08:52.743900+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:14.949002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"60'356","reported_seq":452,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744945+0000","last_change":"2024-04-26T12:05:03.791986+0000","last_active":"2024-04-26T12:08:52.744945+0000","last_peered":"2024-04-26T12:08:52.744945+0000","last_clean":"2024-04-26T12:08:52.744945+0000","last_became_active":"2024-04-26T12:05:03.790823+0000","last_became_peered":"2024-04-26T12:05:03.790823+0000","last_unstale":"2024-04-26T12:08:52.744945+0000","last_undegraded":"2024-04-26T12:08:52.744945+0000","last_fullsized":"2024-04-26T12:08:52.744945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9641,"num_write":326,"num_write_kb":29574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"59'309","reported_seq":387,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745394+0000","last_change":"2024-04-26T12:05:03.429469+0000","last_active":"2024-04-26T12:08:52.745394+0000","last_peered":"2024-04-26T12:08:52.745394+0000","last_clean":"2024-04-26T12:08:52.745394+0000","last_became_active":"2024-04-26T12:05:03.429015+0000","last_became_peered":"2024-04-26T12:05:03.429015+0000","last_unstale":"2024-04-26T12:08:52.745394+0000","last_undegraded":"2024-04-26T12:08:52.745394+0000","last_fullsized":"2024-04-26T12:08:52.745394+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'433","reported_seq":575,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745025+0000","last_change":"2024-04-26T12:05:03.791929+0000","last_active":"2024-04-26T12:08:52.745025+0000","last_peered":"2024-04-26T12:08:52.745025+0000","last_clean":"2024-04-26T12:08:52.745025+0000","last_became_active":"2024-04-26T12:05:03.791540+0000","last_became_peered":"2024-04-26T12:05:03.791540+0000","last_unstale":"2024-04-26T12:08:52.745025+0000","last_undegraded":"2024-04-26T12:08:52.745025+0000","last_fullsized":"2024-04-26T12:08:52.745025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":47864,"num_write":399,"num_write_kb":92193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"59'382","reported_seq":449,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744180+0000","last_change":"2024-04-26T12:08:39.704680+0000","last_active":"2024-04-26T12:08:52.744180+0000","last_peered":"2024-04-26T12:08:52.744180+0000","last_clean":"2024-04-26T12:08:52.744180+0000","last_became_active":"2024-04-26T12:08:39.704404+0000","last_became_peered":"2024-04-26T12:08:39.704404+0000","last_unstale":"2024-04-26T12:08:52.744180+0000","last_undegraded":"2024-04-26T12:08:52.744180+0000","last_fullsized":"2024-04-26T12:08:52.744180+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:01.830043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":12467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'425","reported_seq":544,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743855+0000","last_change":"2024-04-26T12:08:47.737376+0000","last_active":"2024-04-26T12:08:52.743855+0000","last_peered":"2024-04-26T12:08:52.743855+0000","last_clean":"2024-04-26T12:08:52.743855+0000","last_became_active":"2024-04-26T12:08:47.735367+0000","last_became_peered":"2024-04-26T12:08:47.735367+0000","last_unstale":"2024-04-26T12:08:52.743855+0000","last_undegraded":"2024-04-26T12:08:52.743855+0000","last_fullsized":"2024-04-26T12:08:52.743855+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:35.420647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":38065,"num_write":387,"num_write_kb":71445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"59'126","reported_seq":229,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744930+0000","last_change":"2024-04-26T12:08:39.702212+0000","last_active":"2024-04-26T12:08:52.744930+0000","last_peered":"2024-04-26T12:08:52.744930+0000","last_clean":"2024-04-26T12:08:52.744930+0000","last_became_active":"2024-04-26T12:08:39.701900+0000","last_became_peered":"2024-04-26T12:08:39.701900+0000","last_unstale":"2024-04-26T12:08:52.744930+0000","last_undegraded":"2024-04-26T12:08:52.744930+0000","last_fullsized":"2024-04-26T12:08:52.744930+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:28.460358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"60'448","reported_seq":548,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744703+0000","last_change":"2024-04-26T12:05:03.791827+0000","last_active":"2024-04-26T12:08:52.744703+0000","last_peered":"2024-04-26T12:08:52.744703+0000","last_clean":"2024-04-26T12:08:52.744703+0000","last_became_active":"2024-04-26T12:05:03.791442+0000","last_became_peered":"2024-04-26T12:05:03.791442+0000","last_unstale":"2024-04-26T12:08:52.744703+0000","last_undegraded":"2024-04-26T12:08:52.744703+0000","last_fullsized":"2024-04-26T12:08:52.744703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11191,"num_write":416,"num_write_kb":67272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"59'56","reported_seq":134,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744927+0000","last_change":"2024-04-26T12:05:03.430659+0000","last_active":"2024-04-26T12:08:52.744927+0000","last_peered":"2024-04-26T12:08:52.744927+0000","last_clean":"2024-04-26T12:08:52.744927+0000","last_became_active":"2024-04-26T12:05:03.430164+0000","last_became_peered":"2024-04-26T12:05:03.430164+0000","last_unstale":"2024-04-26T12:08:52.744927+0000","last_undegraded":"2024-04-26T12:08:52.744927+0000","last_fullsized":"2024-04-26T12:08:52.744927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2734,"num_read_kb":1486856,"num_write":24627,"num_write_kb":4487808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7440,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26722,"ondisk_log_size":26722,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128606591,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":5972,"num_write_kb":129691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64376832,"data_stored":257213182,"data_compressed":19249503,"data_compressed_allocated":31694848,"data_compressed_original":224591872,"omap_allocated":4411,"internal_metadata":0},"log_size":7828,"ondisk_log_size":7828,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738423,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134436,"kb_used_data":27092,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94237404,"statfs":{"total":96636764160,"available":96499101696,"internally_reserved":0,"allocated":27742208,"data_stored":91797602,"data_compressed":6340284,"data_compressed_allocated":11272192,"data_compressed_original":75763712,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:08:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.40899999999999997,"15min":0.439},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.39900000000000002,"15min":0.42599999999999999},"min":{"1min":0.19,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.51700000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Apr 26 12:05:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.436},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.41699999999999998}]}]},{"osd":1,"up_from":66,"seq":283467841543,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68516,"kb_used_data":10644,"kb_used_omap":5,"kb_used_meta":57850,"kb_avail":94303324,"statfs":{"total":96636764160,"available":96566603776,"internally_reserved":0,"allocated":10899456,"data_stored":86136667,"data_compressed":7182940,"data_compressed_allocated":10076160,"data_compressed_original":85745664,"omap_allocated":6005,"internal_metadata":59238539},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738423,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138888,"kb_used_data":27452,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232952,"statfs":{"total":96636764160,"available":96494542848,"internally_reserved":0,"allocated":28110848,"data_stored":81507786,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:05:55 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.443}]},{"osd":2,"last update":"Fri Apr 26 12:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42399999999999999,"15min":0.435},"min":{"1min":0.16200000000000001,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.433,"15min":0.433},"min":{"1min":0.20599999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.34999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27357184,"data_stored":81158407,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10088448,"data_stored":85196920,"data_compressed":7176942,"data_compressed_allocated":10039296,"data_compressed_original":85172224,"omap_allocated":4411,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26931200,"data_stored":90857855,"data_compressed":6334286,"data_compressed_allocated":11235328,"data_compressed_original":75190272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:09:02.760 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:09:03.095 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:09:03.097 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:09:03.107 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-04-26T12:09:02.393909+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129196959,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2917,"num_read_kb":1488438,"num_write":30802,"num_write_kb":4620959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7463,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34707,"ondisk_log_size":34707,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":341840,"kb_used_data":65188,"kb_used_omap":8,"kb_used_meta":276599,"kb_avail":282773680,"statfs":{"total":289910292480,"available":289560248320,"internally_reserved":0,"allocated":66752512,"data_stored":259442055,"data_compressed":19261499,"data_compressed_allocated":31768576,"data_compressed_original":225738752,"omap_allocated":9193,"internal_metadata":283237399},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":505,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.651305"},"pg_stats":[{"pgid":"4.3f","version":"60'426","reported_seq":507,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744715+0000","last_change":"2024-04-26T12:08:51.753936+0000","last_active":"2024-04-26T12:08:52.744715+0000","last_peered":"2024-04-26T12:08:52.744715+0000","last_clean":"2024-04-26T12:08:52.744715+0000","last_became_active":"2024-04-26T12:08:51.750917+0000","last_became_peered":"2024-04-26T12:08:51.750917+0000","last_unstale":"2024-04-26T12:08:52.744715+0000","last_undegraded":"2024-04-26T12:08:52.744715+0000","last_fullsized":"2024-04-26T12:08:52.744715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:21.716324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9964,"num_write":393,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"60'470","reported_seq":601,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744464+0000","last_change":"2024-04-26T12:08:43.719204+0000","last_active":"2024-04-26T12:08:52.744464+0000","last_peered":"2024-04-26T12:08:52.744464+0000","last_clean":"2024-04-26T12:08:52.744464+0000","last_became_active":"2024-04-26T12:08:43.717325+0000","last_became_peered":"2024-04-26T12:08:43.717325+0000","last_unstale":"2024-04-26T12:08:52.744464+0000","last_undegraded":"2024-04-26T12:08:52.744464+0000","last_fullsized":"2024-04-26T12:08:52.744464+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:57.396493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":34556,"num_write":444,"num_write_kb":129697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"60'370","reported_seq":802,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745315+0000","last_change":"2024-04-26T12:08:50.753639+0000","last_active":"2024-04-26T12:08:52.745315+0000","last_peered":"2024-04-26T12:08:52.745315+0000","last_clean":"2024-04-26T12:08:52.745315+0000","last_became_active":"2024-04-26T12:08:50.752468+0000","last_became_peered":"2024-04-26T12:08:50.752468+0000","last_unstale":"2024-04-26T12:08:52.745315+0000","last_undegraded":"2024-04-26T12:08:52.745315+0000","last_fullsized":"2024-04-26T12:08:52.745315+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:54.514768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":349,"num_write_kb":51115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"60'377","reported_seq":485,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745318+0000","last_change":"2024-04-26T12:05:03.791234+0000","last_active":"2024-04-26T12:08:52.745318+0000","last_peered":"2024-04-26T12:08:52.745318+0000","last_clean":"2024-04-26T12:08:52.745318+0000","last_became_active":"2024-04-26T12:05:03.790717+0000","last_became_peered":"2024-04-26T12:05:03.790717+0000","last_unstale":"2024-04-26T12:08:52.745318+0000","last_undegraded":"2024-04-26T12:08:52.745318+0000","last_fullsized":"2024-04-26T12:08:52.745318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:52.358881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17376,"num_write":341,"num_write_kb":46680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'445","reported_seq":550,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743965+0000","last_change":"2024-04-26T12:08:39.705318+0000","last_active":"2024-04-26T12:08:52.743965+0000","last_peered":"2024-04-26T12:08:52.743965+0000","last_clean":"2024-04-26T12:08:52.743965+0000","last_became_active":"2024-04-26T12:08:39.702117+0000","last_became_peered":"2024-04-26T12:08:39.702117+0000","last_unstale":"2024-04-26T12:08:52.743965+0000","last_undegraded":"2024-04-26T12:08:52.743965+0000","last_fullsized":"2024-04-26T12:08:52.743965+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:39.986313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24197,"num_write":416,"num_write_kb":80466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"60'375","reported_seq":470,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744643+0000","last_change":"2024-04-26T12:05:03.791560+0000","last_active":"2024-04-26T12:08:52.744643+0000","last_peered":"2024-04-26T12:08:52.744643+0000","last_clean":"2024-04-26T12:08:52.744643+0000","last_became_active":"2024-04-26T12:05:03.790578+0000","last_became_peered":"2024-04-26T12:05:03.790578+0000","last_unstale":"2024-04-26T12:08:52.744643+0000","last_undegraded":"2024-04-26T12:08:52.744643+0000","last_fullsized":"2024-04-26T12:08:52.744643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6518,"num_write":348,"num_write_kb":38078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'428","reported_seq":524,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744809+0000","last_change":"2024-04-26T12:05:03.791215+0000","last_active":"2024-04-26T12:08:52.744809+0000","last_peered":"2024-04-26T12:08:52.744809+0000","last_clean":"2024-04-26T12:08:52.744809+0000","last_became_active":"2024-04-26T12:05:03.790615+0000","last_became_peered":"2024-04-26T12:05:03.790615+0000","last_unstale":"2024-04-26T12:08:52.744809+0000","last_undegraded":"2024-04-26T12:08:52.744809+0000","last_fullsized":"2024-04-26T12:08:52.744809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:55.388027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12560,"num_write":398,"num_write_kb":67332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"60'387","reported_seq":526,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744454+0000","last_change":"2024-04-26T12:05:03.785861+0000","last_active":"2024-04-26T12:08:52.744454+0000","last_peered":"2024-04-26T12:08:52.744454+0000","last_clean":"2024-04-26T12:08:52.744454+0000","last_became_active":"2024-04-26T12:05:03.785382+0000","last_became_peered":"2024-04-26T12:05:03.785382+0000","last_unstale":"2024-04-26T12:08:52.744454+0000","last_undegraded":"2024-04-26T12:08:52.744454+0000","last_fullsized":"2024-04-26T12:08:52.744454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:51.870183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":41160,"num_write":356,"num_write_kb":80219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"60'405","reported_seq":900,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744722+0000","last_change":"2024-04-26T12:08:46.730220+0000","last_active":"2024-04-26T12:08:52.744722+0000","last_peered":"2024-04-26T12:08:52.744722+0000","last_clean":"2024-04-26T12:08:52.744722+0000","last_became_active":"2024-04-26T12:08:46.729039+0000","last_became_peered":"2024-04-26T12:08:46.729039+0000","last_unstale":"2024-04-26T12:08:52.744722+0000","last_undegraded":"2024-04-26T12:08:52.744722+0000","last_fullsized":"2024-04-26T12:08:52.744722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:00.707126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":11674,"num_write":372,"num_write_kb":34604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"60'425","reported_seq":577,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744378+0000","last_change":"2024-04-26T12:08:41.718786+0000","last_active":"2024-04-26T12:08:52.744378+0000","last_peered":"2024-04-26T12:08:52.744378+0000","last_clean":"2024-04-26T12:08:52.744378+0000","last_became_active":"2024-04-26T12:08:41.716014+0000","last_became_peered":"2024-04-26T12:08:41.716014+0000","last_unstale":"2024-04-26T12:08:52.744378+0000","last_undegraded":"2024-04-26T12:08:52.744378+0000","last_fullsized":"2024-04-26T12:08:52.744378+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:20.096806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":48419,"num_write":390,"num_write_kb":92286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"60'372","reported_seq":489,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745403+0000","last_change":"2024-04-26T12:05:03.791046+0000","last_active":"2024-04-26T12:08:52.745403+0000","last_peered":"2024-04-26T12:08:52.745403+0000","last_clean":"2024-04-26T12:08:52.745403+0000","last_became_active":"2024-04-26T12:05:03.790662+0000","last_became_peered":"2024-04-26T12:05:03.790662+0000","last_unstale":"2024-04-26T12:08:52.745403+0000","last_undegraded":"2024-04-26T12:08:52.745403+0000","last_fullsized":"2024-04-26T12:08:52.745403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:35.458663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25905,"num_write":353,"num_write_kb":75437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'351","reported_seq":426,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744359+0000","last_change":"2024-04-26T12:08:41.718349+0000","last_active":"2024-04-26T12:08:52.744359+0000","last_peered":"2024-04-26T12:08:52.744359+0000","last_clean":"2024-04-26T12:08:52.744359+0000","last_became_active":"2024-04-26T12:08:41.715726+0000","last_became_peered":"2024-04-26T12:08:41.715726+0000","last_unstale":"2024-04-26T12:08:52.744359+0000","last_undegraded":"2024-04-26T12:08:52.744359+0000","last_fullsized":"2024-04-26T12:08:52.744359+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:00.589164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8884,"num_write":327,"num_write_kb":58289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"60'405","reported_seq":485,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744109+0000","last_change":"2024-04-26T12:08:39.705153+0000","last_active":"2024-04-26T12:08:52.744109+0000","last_peered":"2024-04-26T12:08:52.744109+0000","last_clean":"2024-04-26T12:08:52.744109+0000","last_became_active":"2024-04-26T12:08:39.702141+0000","last_became_peered":"2024-04-26T12:08:39.702141+0000","last_unstale":"2024-04-26T12:08:52.744109+0000","last_undegraded":"2024-04-26T12:08:52.744109+0000","last_fullsized":"2024-04-26T12:08:52.744109+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:42.807520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6771,"num_write":372,"num_write_kb":54786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"60'431","reported_seq":937,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745087+0000","last_change":"2024-04-26T12:08:48.741419+0000","last_active":"2024-04-26T12:08:52.745087+0000","last_peered":"2024-04-26T12:08:52.745087+0000","last_clean":"2024-04-26T12:08:52.745087+0000","last_became_active":"2024-04-26T12:08:48.740170+0000","last_became_peered":"2024-04-26T12:08:48.740170+0000","last_unstale":"2024-04-26T12:08:52.745087+0000","last_undegraded":"2024-04-26T12:08:52.745087+0000","last_fullsized":"2024-04-26T12:08:52.745087+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:52.026016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26572,"num_write":398,"num_write_kb":83974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'394","reported_seq":896,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744941+0000","last_change":"2024-04-26T12:08:41.717703+0000","last_active":"2024-04-26T12:08:52.744941+0000","last_peered":"2024-04-26T12:08:52.744941+0000","last_clean":"2024-04-26T12:08:52.744941+0000","last_became_active":"2024-04-26T12:08:41.715956+0000","last_became_peered":"2024-04-26T12:08:41.715956+0000","last_unstale":"2024-04-26T12:08:52.744941+0000","last_undegraded":"2024-04-26T12:08:52.744941+0000","last_fullsized":"2024-04-26T12:08:52.744941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:34.291197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":38136,"num_write":355,"num_write_kb":38484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'432","reported_seq":543,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744458+0000","last_change":"2024-04-26T12:05:03.786360+0000","last_active":"2024-04-26T12:08:52.744458+0000","last_peered":"2024-04-26T12:08:52.744458+0000","last_clean":"2024-04-26T12:08:52.744458+0000","last_became_active":"2024-04-26T12:05:03.785991+0000","last_became_peered":"2024-04-26T12:05:03.785991+0000","last_unstale":"2024-04-26T12:08:52.744458+0000","last_undegraded":"2024-04-26T12:08:52.744458+0000","last_fullsized":"2024-04-26T12:08:52.744458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:17.702068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18244,"num_write":400,"num_write_kb":59033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'381","reported_seq":838,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.747343+0000","last_change":"2024-04-26T12:08:52.747060+0000","last_active":"2024-04-26T12:08:52.747343+0000","last_peered":"2024-04-26T12:08:52.747343+0000","last_clean":"2024-04-26T12:08:52.747343+0000","last_became_active":"2024-04-26T12:08:52.745913+0000","last_became_peered":"2024-04-26T12:08:52.745913+0000","last_unstale":"2024-04-26T12:08:52.747343+0000","last_undegraded":"2024-04-26T12:08:52.747343+0000","last_fullsized":"2024-04-26T12:08:52.747343+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:30.065406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":350,"num_write_kb":21212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"60'424","reported_seq":514,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744398+0000","last_change":"2024-04-26T12:08:42.718639+0000","last_active":"2024-04-26T12:08:52.744398+0000","last_peered":"2024-04-26T12:08:52.744398+0000","last_clean":"2024-04-26T12:08:52.744398+0000","last_became_active":"2024-04-26T12:08:42.716846+0000","last_became_peered":"2024-04-26T12:08:42.716846+0000","last_unstale":"2024-04-26T12:08:52.744398+0000","last_undegraded":"2024-04-26T12:08:52.744398+0000","last_fullsized":"2024-04-26T12:08:52.744398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:00.928679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13930,"num_write":388,"num_write_kb":116055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'426","reported_seq":905,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.748530+0000","last_change":"2024-04-26T12:08:53.748530+0000","last_active":"2024-04-26T12:08:53.748530+0000","last_peered":"2024-04-26T12:08:53.748530+0000","last_clean":"2024-04-26T12:08:53.748530+0000","last_became_active":"2024-04-26T12:08:53.747215+0000","last_became_peered":"2024-04-26T12:08:53.747215+0000","last_unstale":"2024-04-26T12:08:53.748530+0000","last_undegraded":"2024-04-26T12:08:53.748530+0000","last_fullsized":"2024-04-26T12:08:53.748530+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:14.637610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26908,"num_write":383,"num_write_kb":71324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"60'425","reported_seq":546,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745178+0000","last_change":"2024-04-26T12:05:03.792219+0000","last_active":"2024-04-26T12:08:52.745178+0000","last_peered":"2024-04-26T12:08:52.745178+0000","last_clean":"2024-04-26T12:08:52.745178+0000","last_became_active":"2024-04-26T12:05:03.791061+0000","last_became_peered":"2024-04-26T12:05:03.791061+0000","last_unstale":"2024-04-26T12:08:52.745178+0000","last_undegraded":"2024-04-26T12:08:52.745178+0000","last_fullsized":"2024-04-26T12:08:52.745178+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19715,"num_write":398,"num_write_kb":30150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'450","reported_seq":638,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745086+0000","last_change":"2024-04-26T12:05:03.792073+0000","last_active":"2024-04-26T12:08:52.745086+0000","last_peered":"2024-04-26T12:08:52.745086+0000","last_clean":"2024-04-26T12:08:52.745086+0000","last_became_active":"2024-04-26T12:05:03.791693+0000","last_became_peered":"2024-04-26T12:05:03.791693+0000","last_unstale":"2024-04-26T12:08:52.745086+0000","last_undegraded":"2024-04-26T12:08:52.745086+0000","last_fullsized":"2024-04-26T12:08:52.745086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":65124,"num_write":423,"num_write_kb":142714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'434","reported_seq":538,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744125+0000","last_change":"2024-04-26T12:08:46.730582+0000","last_active":"2024-04-26T12:08:52.744125+0000","last_peered":"2024-04-26T12:08:52.744125+0000","last_clean":"2024-04-26T12:08:52.744125+0000","last_became_active":"2024-04-26T12:08:46.728804+0000","last_became_peered":"2024-04-26T12:08:46.728804+0000","last_unstale":"2024-04-26T12:08:52.744125+0000","last_undegraded":"2024-04-26T12:08:52.744125+0000","last_fullsized":"2024-04-26T12:08:52.744125+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:47.745435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":15350,"num_write":405,"num_write_kb":59295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"60'424","reported_seq":537,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743999+0000","last_change":"2024-04-26T12:05:03.788658+0000","last_active":"2024-04-26T12:08:52.743999+0000","last_peered":"2024-04-26T12:08:52.743999+0000","last_clean":"2024-04-26T12:08:52.743999+0000","last_became_active":"2024-04-26T12:05:03.788050+0000","last_became_peered":"2024-04-26T12:05:03.788050+0000","last_unstale":"2024-04-26T12:08:52.743999+0000","last_undegraded":"2024-04-26T12:08:52.743999+0000","last_fullsized":"2024-04-26T12:08:52.743999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23772,"num_write":390,"num_write_kb":67944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"60'447","reported_seq":526,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743819+0000","last_change":"2024-04-26T12:08:40.707153+0000","last_active":"2024-04-26T12:08:52.743819+0000","last_peered":"2024-04-26T12:08:52.743819+0000","last_clean":"2024-04-26T12:08:52.743819+0000","last_became_active":"2024-04-26T12:08:40.703880+0000","last_became_peered":"2024-04-26T12:08:40.703880+0000","last_unstale":"2024-04-26T12:08:52.743819+0000","last_undegraded":"2024-04-26T12:08:52.743819+0000","last_fullsized":"2024-04-26T12:08:52.743819+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:25.187022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9403,"num_write":417,"num_write_kb":67425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"60'417","reported_seq":507,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744515+0000","last_change":"2024-04-26T12:08:42.717934+0000","last_active":"2024-04-26T12:08:52.744515+0000","last_peered":"2024-04-26T12:08:52.744515+0000","last_clean":"2024-04-26T12:08:52.744515+0000","last_became_active":"2024-04-26T12:08:42.715812+0000","last_became_peered":"2024-04-26T12:08:42.715812+0000","last_unstale":"2024-04-26T12:08:52.744515+0000","last_undegraded":"2024-04-26T12:08:52.744515+0000","last_fullsized":"2024-04-26T12:08:52.744515+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:09.442852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20466,"num_write":400,"num_write_kb":42225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"60'475","reported_seq":604,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744858+0000","last_change":"2024-04-26T12:05:03.787909+0000","last_active":"2024-04-26T12:08:52.744858+0000","last_peered":"2024-04-26T12:08:52.744858+0000","last_clean":"2024-04-26T12:08:52.744858+0000","last_became_active":"2024-04-26T12:05:03.787562+0000","last_became_peered":"2024-04-26T12:05:03.787562+0000","last_unstale":"2024-04-26T12:08:52.744858+0000","last_undegraded":"2024-04-26T12:08:52.744858+0000","last_fullsized":"2024-04-26T12:08:52.744858+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25186,"num_write":431,"num_write_kb":48184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"60'409","reported_seq":897,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745514+0000","last_change":"2024-04-26T12:08:49.741823+0000","last_active":"2024-04-26T12:08:52.745514+0000","last_peered":"2024-04-26T12:08:52.745514+0000","last_clean":"2024-04-26T12:08:52.745514+0000","last_became_active":"2024-04-26T12:08:49.740497+0000","last_became_peered":"2024-04-26T12:08:49.740497+0000","last_unstale":"2024-04-26T12:08:52.745514+0000","last_undegraded":"2024-04-26T12:08:52.745514+0000","last_fullsized":"2024-04-26T12:08:52.745514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:00.225872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":20137,"num_write":374,"num_write_kb":55441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'392","reported_seq":493,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744357+0000","last_change":"2024-04-26T12:08:47.737270+0000","last_active":"2024-04-26T12:08:52.744357+0000","last_peered":"2024-04-26T12:08:52.744357+0000","last_clean":"2024-04-26T12:08:52.744357+0000","last_became_active":"2024-04-26T12:08:47.735361+0000","last_became_peered":"2024-04-26T12:08:47.735361+0000","last_unstale":"2024-04-26T12:08:52.744357+0000","last_undegraded":"2024-04-26T12:08:52.744357+0000","last_fullsized":"2024-04-26T12:08:52.744357+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:09.838696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29179,"num_write":355,"num_write_kb":59011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'380","reported_seq":840,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744489+0000","last_change":"2024-04-26T12:08:41.717953+0000","last_active":"2024-04-26T12:08:52.744489+0000","last_peered":"2024-04-26T12:08:52.744489+0000","last_clean":"2024-04-26T12:08:52.744489+0000","last_became_active":"2024-04-26T12:08:41.716234+0000","last_became_peered":"2024-04-26T12:08:41.716234+0000","last_unstale":"2024-04-26T12:08:52.744489+0000","last_undegraded":"2024-04-26T12:08:52.744489+0000","last_fullsized":"2024-04-26T12:08:52.744489+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:37.480062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13036,"num_write":347,"num_write_kb":33880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"60'461","reported_seq":565,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744026+0000","last_change":"2024-04-26T12:08:46.732653+0000","last_active":"2024-04-26T12:08:52.744026+0000","last_peered":"2024-04-26T12:08:52.744026+0000","last_clean":"2024-04-26T12:08:52.744026+0000","last_became_active":"2024-04-26T12:08:46.730738+0000","last_became_peered":"2024-04-26T12:08:46.730738+0000","last_unstale":"2024-04-26T12:08:52.744026+0000","last_undegraded":"2024-04-26T12:08:52.744026+0000","last_fullsized":"2024-04-26T12:08:52.744026+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:46.177056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":32945,"num_write":426,"num_write_kb":63234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"60'411","reported_seq":901,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744088+0000","last_change":"2024-04-26T12:08:40.704958+0000","last_active":"2024-04-26T12:08:52.744088+0000","last_peered":"2024-04-26T12:08:52.744088+0000","last_clean":"2024-04-26T12:08:52.744088+0000","last_became_active":"2024-04-26T12:08:40.703845+0000","last_became_peered":"2024-04-26T12:08:40.703845+0000","last_unstale":"2024-04-26T12:08:52.744088+0000","last_undegraded":"2024-04-26T12:08:52.744088+0000","last_fullsized":"2024-04-26T12:08:52.744088+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:56.148477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11499,"num_write":377,"num_write_kb":34249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'430","reported_seq":538,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744573+0000","last_change":"2024-04-26T12:05:03.791605+0000","last_active":"2024-04-26T12:08:52.744573+0000","last_peered":"2024-04-26T12:08:52.744573+0000","last_clean":"2024-04-26T12:08:52.744573+0000","last_became_active":"2024-04-26T12:05:03.791251+0000","last_became_peered":"2024-04-26T12:05:03.791251+0000","last_unstale":"2024-04-26T12:08:52.744573+0000","last_undegraded":"2024-04-26T12:08:52.744573+0000","last_fullsized":"2024-04-26T12:08:52.744573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:27.239868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14660,"num_write":404,"num_write_kb":60840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"60'392","reported_seq":500,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744114+0000","last_change":"2024-04-26T12:08:44.723861+0000","last_active":"2024-04-26T12:08:52.744114+0000","last_peered":"2024-04-26T12:08:52.744114+0000","last_clean":"2024-04-26T12:08:52.744114+0000","last_became_active":"2024-04-26T12:08:44.722120+0000","last_became_peered":"2024-04-26T12:08:44.722120+0000","last_unstale":"2024-04-26T12:08:52.744114+0000","last_undegraded":"2024-04-26T12:08:52.744114+0000","last_fullsized":"2024-04-26T12:08:52.744114+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:12.810713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31703,"num_write":351,"num_write_kb":59324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"59'514","reported_seq":592,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745155+0000","last_change":"2024-04-26T12:05:03.430021+0000","last_active":"2024-04-26T12:08:52.745155+0000","last_peered":"2024-04-26T12:08:52.745155+0000","last_clean":"2024-04-26T12:08:52.745155+0000","last_became_active":"2024-04-26T12:05:03.429695+0000","last_became_peered":"2024-04-26T12:05:03.429695+0000","last_unstale":"2024-04-26T12:08:52.745155+0000","last_undegraded":"2024-04-26T12:08:52.745155+0000","last_fullsized":"2024-04-26T12:08:52.745155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":8377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'432","reported_seq":522,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.751086+0000","last_change":"2024-04-26T12:08:53.751086+0000","last_active":"2024-04-26T12:08:53.751086+0000","last_peered":"2024-04-26T12:08:53.751086+0000","last_clean":"2024-04-26T12:08:53.751086+0000","last_became_active":"2024-04-26T12:08:53.748972+0000","last_became_peered":"2024-04-26T12:08:53.748972+0000","last_unstale":"2024-04-26T12:08:53.751086+0000","last_undegraded":"2024-04-26T12:08:53.751086+0000","last_fullsized":"2024-04-26T12:08:53.751086+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:34.448806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":30094,"num_write":388,"num_write_kb":83741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"59'55","reported_seq":133,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744325+0000","last_change":"2024-04-26T12:05:03.428605+0000","last_active":"2024-04-26T12:08:52.744325+0000","last_peered":"2024-04-26T12:08:52.744325+0000","last_clean":"2024-04-26T12:08:52.744325+0000","last_became_active":"2024-04-26T12:05:03.428098+0000","last_became_peered":"2024-04-26T12:05:03.428098+0000","last_unstale":"2024-04-26T12:08:52.744325+0000","last_undegraded":"2024-04-26T12:08:52.744325+0000","last_fullsized":"2024-04-26T12:08:52.744325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"60'445","reported_seq":557,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744955+0000","last_change":"2024-04-26T12:05:03.788568+0000","last_active":"2024-04-26T12:08:52.744955+0000","last_peered":"2024-04-26T12:08:52.744955+0000","last_clean":"2024-04-26T12:08:52.744955+0000","last_became_active":"2024-04-26T12:05:03.788039+0000","last_became_peered":"2024-04-26T12:05:03.788039+0000","last_unstale":"2024-04-26T12:08:52.744955+0000","last_undegraded":"2024-04-26T12:08:52.744955+0000","last_fullsized":"2024-04-26T12:08:52.744955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":16079,"num_write":410,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"59'64","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743891+0000","last_change":"2024-04-26T12:08:36.696166+0000","last_active":"2024-04-26T12:08:52.743891+0000","last_peered":"2024-04-26T12:08:52.743891+0000","last_clean":"2024-04-26T12:08:52.743891+0000","last_became_active":"2024-04-26T12:08:36.694921+0000","last_became_peered":"2024-04-26T12:08:36.694921+0000","last_unstale":"2024-04-26T12:08:52.743891+0000","last_undegraded":"2024-04-26T12:08:52.743891+0000","last_fullsized":"2024-04-26T12:08:52.743891+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:57.438892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"60'420","reported_seq":537,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744759+0000","last_change":"2024-04-26T12:05:03.788505+0000","last_active":"2024-04-26T12:08:52.744759+0000","last_peered":"2024-04-26T12:08:52.744759+0000","last_clean":"2024-04-26T12:08:52.744759+0000","last_became_active":"2024-04-26T12:05:03.788184+0000","last_became_peered":"2024-04-26T12:05:03.788184+0000","last_unstale":"2024-04-26T12:08:52.744759+0000","last_undegraded":"2024-04-26T12:08:52.744759+0000","last_fullsized":"2024-04-26T12:08:52.744759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":14666,"num_write":383,"num_write_kb":83769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"60'63","reported_seq":155,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744615+0000","last_change":"2024-04-26T12:08:36.697126+0000","last_active":"2024-04-26T12:08:52.744615+0000","last_peered":"2024-04-26T12:08:52.744615+0000","last_clean":"2024-04-26T12:08:52.744615+0000","last_became_active":"2024-04-26T12:08:36.696792+0000","last_became_peered":"2024-04-26T12:08:36.696792+0000","last_unstale":"2024-04-26T12:08:52.744615+0000","last_undegraded":"2024-04-26T12:08:52.744615+0000","last_fullsized":"2024-04-26T12:08:52.744615+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:48.447882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"59'232","reported_seq":335,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745720+0000","last_change":"2024-04-26T12:08:39.703810+0000","last_active":"2024-04-26T12:08:52.745720+0000","last_peered":"2024-04-26T12:08:52.745720+0000","last_clean":"2024-04-26T12:08:52.745720+0000","last_became_active":"2024-04-26T12:08:39.703455+0000","last_became_peered":"2024-04-26T12:08:39.703455+0000","last_unstale":"2024-04-26T12:08:52.745720+0000","last_undegraded":"2024-04-26T12:08:52.745720+0000","last_fullsized":"2024-04-26T12:08:52.745720+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:08.399237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'408","reported_seq":491,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743999+0000","last_change":"2024-04-26T12:08:40.710236+0000","last_active":"2024-04-26T12:08:52.743999+0000","last_peered":"2024-04-26T12:08:52.743999+0000","last_clean":"2024-04-26T12:08:52.743999+0000","last_became_active":"2024-04-26T12:08:40.707357+0000","last_became_peered":"2024-04-26T12:08:40.707357+0000","last_unstale":"2024-04-26T12:08:52.743999+0000","last_undegraded":"2024-04-26T12:08:52.743999+0000","last_fullsized":"2024-04-26T12:08:52.743999+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:17.928748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12418,"num_write":371,"num_write_kb":58378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"59'302","reported_seq":370,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744280+0000","last_change":"2024-04-26T12:08:39.703949+0000","last_active":"2024-04-26T12:08:52.744280+0000","last_peered":"2024-04-26T12:08:52.744280+0000","last_clean":"2024-04-26T12:08:52.744280+0000","last_became_active":"2024-04-26T12:08:39.703421+0000","last_became_peered":"2024-04-26T12:08:39.703421+0000","last_unstale":"2024-04-26T12:08:52.744280+0000","last_undegraded":"2024-04-26T12:08:52.744280+0000","last_fullsized":"2024-04-26T12:08:52.744280+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:10.222074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":4228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'439","reported_seq":498,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743713+0000","last_change":"2024-04-26T12:08:41.717923+0000","last_active":"2024-04-26T12:08:52.743713+0000","last_peered":"2024-04-26T12:08:52.743713+0000","last_clean":"2024-04-26T12:08:52.743713+0000","last_became_active":"2024-04-26T12:08:41.715708+0000","last_became_peered":"2024-04-26T12:08:41.715708+0000","last_unstale":"2024-04-26T12:08:52.743713+0000","last_undegraded":"2024-04-26T12:08:52.743713+0000","last_fullsized":"2024-04-26T12:08:52.743713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:23.646558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":30851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"59'589","reported_seq":692,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745816+0000","last_change":"2024-04-26T12:08:39.703966+0000","last_active":"2024-04-26T12:08:52.745816+0000","last_peered":"2024-04-26T12:08:52.745816+0000","last_clean":"2024-04-26T12:08:52.745816+0000","last_became_active":"2024-04-26T12:08:39.703487+0000","last_became_peered":"2024-04-26T12:08:39.703487+0000","last_unstale":"2024-04-26T12:08:52.745816+0000","last_undegraded":"2024-04-26T12:08:52.745816+0000","last_fullsized":"2024-04-26T12:08:52.745816+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:06.112476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":534,"num_write_kb":4333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'461","reported_seq":614,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744817+0000","last_change":"2024-04-26T12:05:03.791809+0000","last_active":"2024-04-26T12:08:52.744817+0000","last_peered":"2024-04-26T12:08:52.744817+0000","last_clean":"2024-04-26T12:08:52.744817+0000","last_became_active":"2024-04-26T12:05:03.791272+0000","last_became_peered":"2024-04-26T12:05:03.791272+0000","last_unstale":"2024-04-26T12:08:52.744817+0000","last_undegraded":"2024-04-26T12:08:52.744817+0000","last_fullsized":"2024-04-26T12:08:52.744817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":46123,"num_write":422,"num_write_kb":104552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'66","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745499+0000","last_change":"2024-04-26T12:05:03.430224+0000","last_active":"2024-04-26T12:08:52.745499+0000","last_peered":"2024-04-26T12:08:52.745499+0000","last_clean":"2024-04-26T12:08:52.745499+0000","last_became_active":"2024-04-26T12:05:03.429291+0000","last_became_peered":"2024-04-26T12:05:03.429291+0000","last_unstale":"2024-04-26T12:08:52.745499+0000","last_undegraded":"2024-04-26T12:08:52.745499+0000","last_fullsized":"2024-04-26T12:08:52.745499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'428","reported_seq":541,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744404+0000","last_change":"2024-04-26T12:05:03.788174+0000","last_active":"2024-04-26T12:08:52.744404+0000","last_peered":"2024-04-26T12:08:52.744404+0000","last_clean":"2024-04-26T12:08:52.744404+0000","last_became_active":"2024-04-26T12:05:03.787772+0000","last_became_peered":"2024-04-26T12:05:03.787772+0000","last_unstale":"2024-04-26T12:08:52.744404+0000","last_undegraded":"2024-04-26T12:08:52.744404+0000","last_fullsized":"2024-04-26T12:08:52.744404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15098,"num_write":394,"num_write_kb":42677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"59'195","reported_seq":273,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744598+0000","last_change":"2024-04-26T12:05:03.431162+0000","last_active":"2024-04-26T12:08:52.744598+0000","last_peered":"2024-04-26T12:08:52.744598+0000","last_clean":"2024-04-26T12:08:52.744598+0000","last_became_active":"2024-04-26T12:05:03.430855+0000","last_became_peered":"2024-04-26T12:05:03.430855+0000","last_unstale":"2024-04-26T12:08:52.744598+0000","last_undegraded":"2024-04-26T12:08:52.744598+0000","last_fullsized":"2024-04-26T12:08:52.744598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:41.279426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"60'448","reported_seq":544,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745298+0000","last_change":"2024-04-26T12:05:03.792357+0000","last_active":"2024-04-26T12:08:52.745298+0000","last_peered":"2024-04-26T12:08:52.745298+0000","last_clean":"2024-04-26T12:08:52.745298+0000","last_became_active":"2024-04-26T12:05:03.792119+0000","last_became_peered":"2024-04-26T12:05:03.792119+0000","last_unstale":"2024-04-26T12:08:52.745298+0000","last_undegraded":"2024-04-26T12:08:52.745298+0000","last_fullsized":"2024-04-26T12:08:52.745298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":13281,"num_write":420,"num_write_kb":59540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"59'171","reported_seq":249,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745146+0000","last_change":"2024-04-26T12:05:03.429811+0000","last_active":"2024-04-26T12:08:52.745146+0000","last_peered":"2024-04-26T12:08:52.745146+0000","last_clean":"2024-04-26T12:08:52.745146+0000","last_became_active":"2024-04-26T12:05:03.429469+0000","last_became_peered":"2024-04-26T12:05:03.429469+0000","last_unstale":"2024-04-26T12:08:52.745146+0000","last_undegraded":"2024-04-26T12:08:52.745146+0000","last_fullsized":"2024-04-26T12:08:52.745146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'412","reported_seq":923,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745698+0000","last_change":"2024-04-26T12:08:51.752350+0000","last_active":"2024-04-26T12:08:52.745698+0000","last_peered":"2024-04-26T12:08:52.745698+0000","last_clean":"2024-04-26T12:08:52.745698+0000","last_became_active":"2024-04-26T12:08:51.751044+0000","last_became_peered":"2024-04-26T12:08:51.751044+0000","last_unstale":"2024-04-26T12:08:52.745698+0000","last_undegraded":"2024-04-26T12:08:52.745698+0000","last_fullsized":"2024-04-26T12:08:52.745698+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:40.008727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26310,"num_write":380,"num_write_kb":38462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"59'55","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743708+0000","last_change":"2024-04-26T12:08:36.695355+0000","last_active":"2024-04-26T12:08:52.743708+0000","last_peered":"2024-04-26T12:08:52.743708+0000","last_clean":"2024-04-26T12:08:52.743708+0000","last_became_active":"2024-04-26T12:08:36.694346+0000","last_became_peered":"2024-04-26T12:08:36.694346+0000","last_unstale":"2024-04-26T12:08:52.743708+0000","last_undegraded":"2024-04-26T12:08:52.743708+0000","last_fullsized":"2024-04-26T12:08:52.743708+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:42.458073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"60'362","reported_seq":817,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745440+0000","last_change":"2024-04-26T12:08:41.717048+0000","last_active":"2024-04-26T12:08:52.745440+0000","last_peered":"2024-04-26T12:08:52.745440+0000","last_clean":"2024-04-26T12:08:52.745440+0000","last_became_active":"2024-04-26T12:08:41.716102+0000","last_became_peered":"2024-04-26T12:08:41.716102+0000","last_unstale":"2024-04-26T12:08:52.745440+0000","last_undegraded":"2024-04-26T12:08:52.745440+0000","last_fullsized":"2024-04-26T12:08:52.745440+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:52.409548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21408,"num_write":333,"num_write_kb":66549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"59'378","reported_seq":439,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743919+0000","last_change":"2024-04-26T12:08:39.702797+0000","last_active":"2024-04-26T12:08:52.743919+0000","last_peered":"2024-04-26T12:08:52.743919+0000","last_clean":"2024-04-26T12:08:52.743919+0000","last_became_active":"2024-04-26T12:08:39.702438+0000","last_became_peered":"2024-04-26T12:08:39.702438+0000","last_unstale":"2024-04-26T12:08:52.743919+0000","last_undegraded":"2024-04-26T12:08:52.743919+0000","last_fullsized":"2024-04-26T12:08:52.743919+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:06.278304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"60'407","reported_seq":917,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744823+0000","last_change":"2024-04-26T12:08:45.724853+0000","last_active":"2024-04-26T12:08:52.744823+0000","last_peered":"2024-04-26T12:08:52.744823+0000","last_clean":"2024-04-26T12:08:52.744823+0000","last_became_active":"2024-04-26T12:08:45.723772+0000","last_became_peered":"2024-04-26T12:08:45.723772+0000","last_unstale":"2024-04-26T12:08:52.744823+0000","last_undegraded":"2024-04-26T12:08:52.744823+0000","last_fullsized":"2024-04-26T12:08:52.744823+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:41.814840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":40156,"num_write":373,"num_write_kb":91285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":294,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745711+0000","last_change":"2024-04-26T12:08:36.697892+0000","last_active":"2024-04-26T12:08:53.745711+0000","last_peered":"2024-04-26T12:08:53.745711+0000","last_clean":"2024-04-26T12:08:53.745711+0000","last_became_active":"2024-04-26T12:08:36.697508+0000","last_became_peered":"2024-04-26T12:08:36.697508+0000","last_unstale":"2024-04-26T12:08:53.745711+0000","last_undegraded":"2024-04-26T12:08:53.745711+0000","last_fullsized":"2024-04-26T12:08:53.745711+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_clean_scrub_stamp":"2024-04-26T12:04:52.376986+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:24.384180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745283+0000","last_change":"2024-04-26T12:04:59.403711+0000","last_active":"2024-04-26T12:08:52.745283+0000","last_peered":"2024-04-26T12:08:52.745283+0000","last_clean":"2024-04-26T12:08:52.745283+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:08:52.745283+0000","last_undegraded":"2024-04-26T12:08:52.745283+0000","last_fullsized":"2024-04-26T12:08:52.745283+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:45.779614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'793","reported_seq":897,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744445+0000","last_change":"2024-04-26T12:08:39.702225+0000","last_active":"2024-04-26T12:08:52.744445+0000","last_peered":"2024-04-26T12:08:52.744445+0000","last_clean":"2024-04-26T12:08:52.744445+0000","last_became_active":"2024-04-26T12:08:39.701760+0000","last_became_peered":"2024-04-26T12:08:39.701760+0000","last_unstale":"2024-04-26T12:08:52.744445+0000","last_undegraded":"2024-04-26T12:08:52.744445+0000","last_fullsized":"2024-04-26T12:08:52.744445+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:51.405891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":8533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"60'466","reported_seq":1012,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.747878+0000","last_change":"2024-04-26T12:08:52.747463+0000","last_active":"2024-04-26T12:08:52.747878+0000","last_peered":"2024-04-26T12:08:52.747878+0000","last_clean":"2024-04-26T12:08:52.747878+0000","last_became_active":"2024-04-26T12:08:52.746147+0000","last_became_peered":"2024-04-26T12:08:52.746147+0000","last_unstale":"2024-04-26T12:08:52.747878+0000","last_undegraded":"2024-04-26T12:08:52.747878+0000","last_fullsized":"2024-04-26T12:08:52.747878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:21.517395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":37547,"num_write":422,"num_write_kb":96579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":95,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745616+0000","last_change":"2024-04-26T12:08:36.695759+0000","last_active":"2024-04-26T12:08:53.745616+0000","last_peered":"2024-04-26T12:08:53.745616+0000","last_clean":"2024-04-26T12:08:53.745616+0000","last_became_active":"2024-04-26T12:08:36.695444+0000","last_became_peered":"2024-04-26T12:08:36.695444+0000","last_unstale":"2024-04-26T12:08:53.745616+0000","last_undegraded":"2024-04-26T12:08:53.745616+0000","last_fullsized":"2024-04-26T12:08:53.745616+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:22.343369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"60'114","reported_seq":239,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744279+0000","last_change":"2024-04-26T12:05:03.428547+0000","last_active":"2024-04-26T12:08:52.744279+0000","last_peered":"2024-04-26T12:08:52.744279+0000","last_clean":"2024-04-26T12:08:52.744279+0000","last_became_active":"2024-04-26T12:05:03.427985+0000","last_became_peered":"2024-04-26T12:05:03.427985+0000","last_unstale":"2024-04-26T12:08:52.744279+0000","last_undegraded":"2024-04-26T12:08:52.744279+0000","last_fullsized":"2024-04-26T12:08:52.744279+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:19.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466015,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":47,"num_write_kb":1464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"60'492","reported_seq":655,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744496+0000","last_change":"2024-04-26T12:08:49.741650+0000","last_active":"2024-04-26T12:08:52.744496+0000","last_peered":"2024-04-26T12:08:52.744496+0000","last_clean":"2024-04-26T12:08:52.744496+0000","last_became_active":"2024-04-26T12:08:49.739496+0000","last_became_peered":"2024-04-26T12:08:49.739496+0000","last_unstale":"2024-04-26T12:08:52.744496+0000","last_undegraded":"2024-04-26T12:08:52.744496+0000","last_fullsized":"2024-04-26T12:08:52.744496+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:55.361224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":63988,"num_write":466,"num_write_kb":154489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744369+0000","last_change":"2024-04-26T12:08:36.696858+0000","last_active":"2024-04-26T12:08:52.744369+0000","last_peered":"2024-04-26T12:08:52.744369+0000","last_clean":"2024-04-26T12:08:52.744369+0000","last_became_active":"2024-04-26T12:08:36.696619+0000","last_became_peered":"2024-04-26T12:08:36.696619+0000","last_unstale":"2024-04-26T12:08:52.744369+0000","last_undegraded":"2024-04-26T12:08:52.744369+0000","last_fullsized":"2024-04-26T12:08:52.744369+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:47.292926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"59'325","reported_seq":386,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743649+0000","last_change":"2024-04-26T12:08:39.704052+0000","last_active":"2024-04-26T12:08:52.743649+0000","last_peered":"2024-04-26T12:08:52.743649+0000","last_clean":"2024-04-26T12:08:52.743649+0000","last_became_active":"2024-04-26T12:08:39.703696+0000","last_became_peered":"2024-04-26T12:08:39.703696+0000","last_unstale":"2024-04-26T12:08:52.743649+0000","last_undegraded":"2024-04-26T12:08:52.743649+0000","last_fullsized":"2024-04-26T12:08:52.743649+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:21:44.069244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":8296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"60'359","reported_seq":785,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744857+0000","last_change":"2024-04-26T12:08:47.737443+0000","last_active":"2024-04-26T12:08:52.744857+0000","last_peered":"2024-04-26T12:08:52.744857+0000","last_clean":"2024-04-26T12:08:52.744857+0000","last_became_active":"2024-04-26T12:08:47.735729+0000","last_became_peered":"2024-04-26T12:08:47.735729+0000","last_unstale":"2024-04-26T12:08:52.744857+0000","last_undegraded":"2024-04-26T12:08:52.744857+0000","last_fullsized":"2024-04-26T12:08:52.744857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:57:20.726677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9448,"num_write":336,"num_write_kb":74900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745246+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:08:52.745246+0000","last_peered":"2024-04-26T12:08:52.745246+0000","last_clean":"2024-04-26T12:08:52.745246+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:08:52.745246+0000","last_undegraded":"2024-04-26T12:08:52.745246+0000","last_fullsized":"2024-04-26T12:08:52.745246+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:12.939539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"59'67","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745292+0000","last_change":"2024-04-26T12:05:03.430140+0000","last_active":"2024-04-26T12:08:52.745292+0000","last_peered":"2024-04-26T12:08:52.745292+0000","last_clean":"2024-04-26T12:08:52.745292+0000","last_became_active":"2024-04-26T12:05:03.429838+0000","last_became_peered":"2024-04-26T12:05:03.429838+0000","last_unstale":"2024-04-26T12:08:52.745292+0000","last_undegraded":"2024-04-26T12:08:52.745292+0000","last_fullsized":"2024-04-26T12:08:52.745292+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"60'403","reported_seq":894,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744652+0000","last_change":"2024-04-26T12:08:50.753437+0000","last_active":"2024-04-26T12:08:52.744652+0000","last_peered":"2024-04-26T12:08:52.744652+0000","last_clean":"2024-04-26T12:08:52.744652+0000","last_became_active":"2024-04-26T12:08:50.752366+0000","last_became_peered":"2024-04-26T12:08:50.752366+0000","last_unstale":"2024-04-26T12:08:52.744652+0000","last_undegraded":"2024-04-26T12:08:52.744652+0000","last_fullsized":"2024-04-26T12:08:52.744652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:02.999757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30094,"num_write":370,"num_write_kb":104181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"59'469","reported_seq":547,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745818+0000","last_change":"2024-04-26T12:05:03.429673+0000","last_active":"2024-04-26T12:08:52.745818+0000","last_peered":"2024-04-26T12:08:52.745818+0000","last_clean":"2024-04-26T12:08:52.745818+0000","last_became_active":"2024-04-26T12:05:03.429146+0000","last_became_peered":"2024-04-26T12:05:03.429146+0000","last_unstale":"2024-04-26T12:08:52.745818+0000","last_undegraded":"2024-04-26T12:08:52.745818+0000","last_fullsized":"2024-04-26T12:08:52.745818+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744743+0000","last_change":"2024-04-26T12:08:36.697900+0000","last_active":"2024-04-26T12:08:52.744743+0000","last_peered":"2024-04-26T12:08:52.744743+0000","last_clean":"2024-04-26T12:08:52.744743+0000","last_became_active":"2024-04-26T12:08:36.697618+0000","last_became_peered":"2024-04-26T12:08:36.697618+0000","last_unstale":"2024-04-26T12:08:52.744743+0000","last_undegraded":"2024-04-26T12:08:52.744743+0000","last_fullsized":"2024-04-26T12:08:52.744743+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:16.620901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'354","reported_seq":413,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744055+0000","last_change":"2024-04-26T12:08:45.725751+0000","last_active":"2024-04-26T12:08:52.744055+0000","last_peered":"2024-04-26T12:08:52.744055+0000","last_clean":"2024-04-26T12:08:52.744055+0000","last_became_active":"2024-04-26T12:08:45.724153+0000","last_became_peered":"2024-04-26T12:08:45.724153+0000","last_unstale":"2024-04-26T12:08:52.744055+0000","last_undegraded":"2024-04-26T12:08:52.744055+0000","last_fullsized":"2024-04-26T12:08:52.744055+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:57.798803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":416,"num_write":319,"num_write_kb":17259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"59'53","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744703+0000","last_change":"2024-04-26T12:08:36.698122+0000","last_active":"2024-04-26T12:08:52.744703+0000","last_peered":"2024-04-26T12:08:52.744703+0000","last_clean":"2024-04-26T12:08:52.744703+0000","last_became_active":"2024-04-26T12:08:36.697832+0000","last_became_peered":"2024-04-26T12:08:36.697832+0000","last_unstale":"2024-04-26T12:08:52.744703+0000","last_undegraded":"2024-04-26T12:08:52.744703+0000","last_fullsized":"2024-04-26T12:08:52.744703+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:34.416168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744650+0000","last_change":"2024-04-26T12:08:36.698131+0000","last_active":"2024-04-26T12:08:52.744650+0000","last_peered":"2024-04-26T12:08:52.744650+0000","last_clean":"2024-04-26T12:08:52.744650+0000","last_became_active":"2024-04-26T12:08:36.697698+0000","last_became_peered":"2024-04-26T12:08:36.697698+0000","last_unstale":"2024-04-26T12:08:52.744650+0000","last_undegraded":"2024-04-26T12:08:52.744650+0000","last_fullsized":"2024-04-26T12:08:52.744650+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:15.476036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'399","reported_seq":477,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743860+0000","last_change":"2024-04-26T12:08:40.705752+0000","last_active":"2024-04-26T12:08:52.743860+0000","last_peered":"2024-04-26T12:08:52.743860+0000","last_clean":"2024-04-26T12:08:52.743860+0000","last_became_active":"2024-04-26T12:08:40.703906+0000","last_became_peered":"2024-04-26T12:08:40.703906+0000","last_unstale":"2024-04-26T12:08:52.743860+0000","last_undegraded":"2024-04-26T12:08:52.743860+0000","last_fullsized":"2024-04-26T12:08:52.743860+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:19.004074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11720,"num_write":363,"num_write_kb":66914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"59'65","reported_seq":157,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745130+0000","last_change":"2024-04-26T12:08:36.699388+0000","last_active":"2024-04-26T12:08:52.745130+0000","last_peered":"2024-04-26T12:08:52.745130+0000","last_clean":"2024-04-26T12:08:52.745130+0000","last_became_active":"2024-04-26T12:08:36.699058+0000","last_became_peered":"2024-04-26T12:08:36.699058+0000","last_unstale":"2024-04-26T12:08:52.745130+0000","last_undegraded":"2024-04-26T12:08:52.745130+0000","last_fullsized":"2024-04-26T12:08:52.745130+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:11.978288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745047+0000","last_change":"2024-04-26T12:08:36.697618+0000","last_active":"2024-04-26T12:08:52.745047+0000","last_peered":"2024-04-26T12:08:52.745047+0000","last_clean":"2024-04-26T12:08:52.745047+0000","last_became_active":"2024-04-26T12:08:36.697407+0000","last_became_peered":"2024-04-26T12:08:36.697407+0000","last_unstale":"2024-04-26T12:08:52.745047+0000","last_undegraded":"2024-04-26T12:08:52.745047+0000","last_fullsized":"2024-04-26T12:08:52.745047+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:02.301767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'424","reported_seq":541,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744097+0000","last_change":"2024-04-26T12:05:03.789623+0000","last_active":"2024-04-26T12:08:52.744097+0000","last_peered":"2024-04-26T12:08:52.744097+0000","last_clean":"2024-04-26T12:08:52.744097+0000","last_became_active":"2024-04-26T12:05:03.789390+0000","last_became_peered":"2024-04-26T12:05:03.789390+0000","last_unstale":"2024-04-26T12:08:52.744097+0000","last_undegraded":"2024-04-26T12:08:52.744097+0000","last_fullsized":"2024-04-26T12:08:52.744097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17027,"num_write":386,"num_write_kb":58797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"61'70","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745116+0000","last_change":"2024-04-26T12:05:03.429222+0000","last_active":"2024-04-26T12:08:52.745116+0000","last_peered":"2024-04-26T12:08:52.745116+0000","last_clean":"2024-04-26T12:08:52.745116+0000","last_became_active":"2024-04-26T12:05:03.428803+0000","last_became_peered":"2024-04-26T12:05:03.428803+0000","last_unstale":"2024-04-26T12:08:52.745116+0000","last_undegraded":"2024-04-26T12:08:52.745116+0000","last_fullsized":"2024-04-26T12:08:52.745116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:31.305644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745750+0000","last_change":"2024-04-26T12:08:36.698775+0000","last_active":"2024-04-26T12:08:52.745750+0000","last_peered":"2024-04-26T12:08:52.745750+0000","last_clean":"2024-04-26T12:08:52.745750+0000","last_became_active":"2024-04-26T12:08:36.698523+0000","last_became_peered":"2024-04-26T12:08:36.698523+0000","last_unstale":"2024-04-26T12:08:52.745750+0000","last_undegraded":"2024-04-26T12:08:52.745750+0000","last_fullsized":"2024-04-26T12:08:52.745750+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:16.620901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'393","reported_seq":472,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744009+0000","last_change":"2024-04-26T12:08:40.705662+0000","last_active":"2024-04-26T12:08:52.744009+0000","last_peered":"2024-04-26T12:08:52.744009+0000","last_clean":"2024-04-26T12:08:52.744009+0000","last_became_active":"2024-04-26T12:08:40.703873+0000","last_became_peered":"2024-04-26T12:08:40.703873+0000","last_unstale":"2024-04-26T12:08:52.744009+0000","last_undegraded":"2024-04-26T12:08:52.744009+0000","last_fullsized":"2024-04-26T12:08:52.744009+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:27.057123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":11991,"num_write":357,"num_write_kb":83226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'419","reported_seq":892,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744937+0000","last_change":"2024-04-26T12:08:44.723692+0000","last_active":"2024-04-26T12:08:52.744937+0000","last_peered":"2024-04-26T12:08:52.744937+0000","last_clean":"2024-04-26T12:08:52.744937+0000","last_became_active":"2024-04-26T12:08:44.722574+0000","last_became_peered":"2024-04-26T12:08:44.722574+0000","last_unstale":"2024-04-26T12:08:52.744937+0000","last_undegraded":"2024-04-26T12:08:52.744937+0000","last_fullsized":"2024-04-26T12:08:52.744937+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:01.256055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14983,"num_write":376,"num_write_kb":76749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"61'398","reported_seq":507,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745436+0000","last_change":"2024-04-26T12:08:39.703851+0000","last_active":"2024-04-26T12:08:52.745436+0000","last_peered":"2024-04-26T12:08:52.745436+0000","last_clean":"2024-04-26T12:08:52.745436+0000","last_became_active":"2024-04-26T12:08:39.703516+0000","last_became_peered":"2024-04-26T12:08:39.703516+0000","last_unstale":"2024-04-26T12:08:52.745436+0000","last_undegraded":"2024-04-26T12:08:52.745436+0000","last_fullsized":"2024-04-26T12:08:52.745436+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:10.227718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699266,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":9692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9692849,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'428","reported_seq":940,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744179+0000","last_change":"2024-04-26T12:08:50.753473+0000","last_active":"2024-04-26T12:08:52.744179+0000","last_peered":"2024-04-26T12:08:52.744179+0000","last_clean":"2024-04-26T12:08:52.744179+0000","last_became_active":"2024-04-26T12:08:50.752328+0000","last_became_peered":"2024-04-26T12:08:50.752328+0000","last_unstale":"2024-04-26T12:08:52.744179+0000","last_undegraded":"2024-04-26T12:08:52.744179+0000","last_fullsized":"2024-04-26T12:08:52.744179+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:08.396108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":26594,"num_write":396,"num_write_kb":67932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"60'91","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744409+0000","last_change":"2024-04-26T12:08:36.722607+0000","last_active":"2024-04-26T12:08:52.744409+0000","last_peered":"2024-04-26T12:08:52.744409+0000","last_clean":"2024-04-26T12:08:52.744409+0000","last_became_active":"2024-04-26T12:08:36.697650+0000","last_became_peered":"2024-04-26T12:08:36.697650+0000","last_unstale":"2024-04-26T12:08:52.744409+0000","last_undegraded":"2024-04-26T12:08:52.744409+0000","last_fullsized":"2024-04-26T12:08:52.744409+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:10.718101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"59'316","reported_seq":394,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745553+0000","last_change":"2024-04-26T12:05:03.429257+0000","last_active":"2024-04-26T12:08:52.745553+0000","last_peered":"2024-04-26T12:08:52.745553+0000","last_clean":"2024-04-26T12:08:52.745553+0000","last_became_active":"2024-04-26T12:05:03.428921+0000","last_became_peered":"2024-04-26T12:05:03.428921+0000","last_unstale":"2024-04-26T12:08:52.745553+0000","last_undegraded":"2024-04-26T12:08:52.745553+0000","last_fullsized":"2024-04-26T12:08:52.745553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:49.774845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'495","reported_seq":625,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744089+0000","last_change":"2024-04-26T12:05:03.788141+0000","last_active":"2024-04-26T12:08:52.744089+0000","last_peered":"2024-04-26T12:08:52.744089+0000","last_clean":"2024-04-26T12:08:52.744089+0000","last_became_active":"2024-04-26T12:05:03.787533+0000","last_became_peered":"2024-04-26T12:05:03.787533+0000","last_unstale":"2024-04-26T12:08:52.744089+0000","last_undegraded":"2024-04-26T12:08:52.744089+0000","last_fullsized":"2024-04-26T12:08:52.744089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37174,"num_write":458,"num_write_kb":125832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'51","reported_seq":129,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745033+0000","last_change":"2024-04-26T12:05:03.428971+0000","last_active":"2024-04-26T12:08:52.745033+0000","last_peered":"2024-04-26T12:08:52.745033+0000","last_clean":"2024-04-26T12:08:52.745033+0000","last_became_active":"2024-04-26T12:05:03.428445+0000","last_became_peered":"2024-04-26T12:05:03.428445+0000","last_unstale":"2024-04-26T12:08:52.745033+0000","last_undegraded":"2024-04-26T12:08:52.745033+0000","last_fullsized":"2024-04-26T12:08:52.745033+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'482","reported_seq":1130,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744097+0000","last_change":"2024-04-26T12:08:48.741589+0000","last_active":"2024-04-26T12:08:52.744097+0000","last_peered":"2024-04-26T12:08:52.744097+0000","last_clean":"2024-04-26T12:08:52.744097+0000","last_became_active":"2024-04-26T12:08:48.740055+0000","last_became_peered":"2024-04-26T12:08:48.740055+0000","last_unstale":"2024-04-26T12:08:52.744097+0000","last_undegraded":"2024-04-26T12:08:52.744097+0000","last_fullsized":"2024-04-26T12:08:52.744097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:03.903516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":61972,"num_write":459,"num_write_kb":125797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"60'392","reported_seq":527,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744471+0000","last_change":"2024-04-26T12:08:43.718939+0000","last_active":"2024-04-26T12:08:52.744471+0000","last_peered":"2024-04-26T12:08:52.744471+0000","last_clean":"2024-04-26T12:08:52.744471+0000","last_became_active":"2024-04-26T12:08:43.717109+0000","last_became_peered":"2024-04-26T12:08:43.717109+0000","last_unstale":"2024-04-26T12:08:52.744471+0000","last_undegraded":"2024-04-26T12:08:52.744471+0000","last_fullsized":"2024-04-26T12:08:52.744471+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:14.846653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":37910,"num_write":366,"num_write_kb":84111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"59'709","reported_seq":813,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744368+0000","last_change":"2024-04-26T12:08:39.701978+0000","last_active":"2024-04-26T12:08:52.744368+0000","last_peered":"2024-04-26T12:08:52.744368+0000","last_clean":"2024-04-26T12:08:52.744368+0000","last_became_active":"2024-04-26T12:08:39.700927+0000","last_became_peered":"2024-04-26T12:08:39.700927+0000","last_unstale":"2024-04-26T12:08:52.744368+0000","last_undegraded":"2024-04-26T12:08:52.744368+0000","last_fullsized":"2024-04-26T12:08:52.744368+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:10.815597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"60'435","reported_seq":572,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744787+0000","last_change":"2024-04-26T12:05:03.788754+0000","last_active":"2024-04-26T12:08:52.744787+0000","last_peered":"2024-04-26T12:08:52.744787+0000","last_clean":"2024-04-26T12:08:52.744787+0000","last_became_active":"2024-04-26T12:05:03.788311+0000","last_became_peered":"2024-04-26T12:05:03.788311+0000","last_unstale":"2024-04-26T12:08:52.744787+0000","last_undegraded":"2024-04-26T12:08:52.744787+0000","last_fullsized":"2024-04-26T12:08:52.744787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":28462,"num_write":403,"num_write_kb":93779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"59'262","reported_seq":340,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744211+0000","last_change":"2024-04-26T12:05:03.428810+0000","last_active":"2024-04-26T12:08:52.744211+0000","last_peered":"2024-04-26T12:08:52.744211+0000","last_clean":"2024-04-26T12:08:52.744211+0000","last_became_active":"2024-04-26T12:05:03.428191+0000","last_became_peered":"2024-04-26T12:05:03.428191+0000","last_unstale":"2024-04-26T12:08:52.744211+0000","last_undegraded":"2024-04-26T12:08:52.744211+0000","last_fullsized":"2024-04-26T12:08:52.744211+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"60'399","reported_seq":499,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744294+0000","last_change":"2024-04-26T12:08:49.742459+0000","last_active":"2024-04-26T12:08:52.744294+0000","last_peered":"2024-04-26T12:08:52.744294+0000","last_clean":"2024-04-26T12:08:52.744294+0000","last_became_active":"2024-04-26T12:08:49.740536+0000","last_became_peered":"2024-04-26T12:08:49.740536+0000","last_unstale":"2024-04-26T12:08:52.744294+0000","last_undegraded":"2024-04-26T12:08:52.744294+0000","last_fullsized":"2024-04-26T12:08:52.744294+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:24.169669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22216,"num_write":357,"num_write_kb":75245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"59'430","reported_seq":490,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743876+0000","last_change":"2024-04-26T12:08:39.703050+0000","last_active":"2024-04-26T12:08:52.743876+0000","last_peered":"2024-04-26T12:08:52.743876+0000","last_clean":"2024-04-26T12:08:52.743876+0000","last_became_active":"2024-04-26T12:08:39.702529+0000","last_became_peered":"2024-04-26T12:08:39.702529+0000","last_unstale":"2024-04-26T12:08:52.743876+0000","last_undegraded":"2024-04-26T12:08:52.743876+0000","last_fullsized":"2024-04-26T12:08:52.743876+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:28.249725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":12514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"60'387","reported_seq":476,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744228+0000","last_change":"2024-04-26T12:08:43.720098+0000","last_active":"2024-04-26T12:08:52.744228+0000","last_peered":"2024-04-26T12:08:52.744228+0000","last_clean":"2024-04-26T12:08:52.744228+0000","last_became_active":"2024-04-26T12:08:43.717442+0000","last_became_peered":"2024-04-26T12:08:43.717442+0000","last_unstale":"2024-04-26T12:08:52.744228+0000","last_undegraded":"2024-04-26T12:08:52.744228+0000","last_fullsized":"2024-04-26T12:08:52.744228+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:13.140334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20720,"num_write":352,"num_write_kb":87643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"59'58","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743900+0000","last_change":"2024-04-26T12:08:36.720540+0000","last_active":"2024-04-26T12:08:52.743900+0000","last_peered":"2024-04-26T12:08:52.743900+0000","last_clean":"2024-04-26T12:08:52.743900+0000","last_became_active":"2024-04-26T12:08:36.693399+0000","last_became_peered":"2024-04-26T12:08:36.693399+0000","last_unstale":"2024-04-26T12:08:52.743900+0000","last_undegraded":"2024-04-26T12:08:52.743900+0000","last_fullsized":"2024-04-26T12:08:52.743900+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:14.949002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"60'356","reported_seq":452,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744945+0000","last_change":"2024-04-26T12:05:03.791986+0000","last_active":"2024-04-26T12:08:52.744945+0000","last_peered":"2024-04-26T12:08:52.744945+0000","last_clean":"2024-04-26T12:08:52.744945+0000","last_became_active":"2024-04-26T12:05:03.790823+0000","last_became_peered":"2024-04-26T12:05:03.790823+0000","last_unstale":"2024-04-26T12:08:52.744945+0000","last_undegraded":"2024-04-26T12:08:52.744945+0000","last_fullsized":"2024-04-26T12:08:52.744945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9641,"num_write":326,"num_write_kb":29574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"59'309","reported_seq":387,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745394+0000","last_change":"2024-04-26T12:05:03.429469+0000","last_active":"2024-04-26T12:08:52.745394+0000","last_peered":"2024-04-26T12:08:52.745394+0000","last_clean":"2024-04-26T12:08:52.745394+0000","last_became_active":"2024-04-26T12:05:03.429015+0000","last_became_peered":"2024-04-26T12:05:03.429015+0000","last_unstale":"2024-04-26T12:08:52.745394+0000","last_undegraded":"2024-04-26T12:08:52.745394+0000","last_fullsized":"2024-04-26T12:08:52.745394+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'433","reported_seq":575,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745025+0000","last_change":"2024-04-26T12:05:03.791929+0000","last_active":"2024-04-26T12:08:52.745025+0000","last_peered":"2024-04-26T12:08:52.745025+0000","last_clean":"2024-04-26T12:08:52.745025+0000","last_became_active":"2024-04-26T12:05:03.791540+0000","last_became_peered":"2024-04-26T12:05:03.791540+0000","last_unstale":"2024-04-26T12:08:52.745025+0000","last_undegraded":"2024-04-26T12:08:52.745025+0000","last_fullsized":"2024-04-26T12:08:52.745025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":47864,"num_write":399,"num_write_kb":92193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"59'382","reported_seq":449,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744180+0000","last_change":"2024-04-26T12:08:39.704680+0000","last_active":"2024-04-26T12:08:52.744180+0000","last_peered":"2024-04-26T12:08:52.744180+0000","last_clean":"2024-04-26T12:08:52.744180+0000","last_became_active":"2024-04-26T12:08:39.704404+0000","last_became_peered":"2024-04-26T12:08:39.704404+0000","last_unstale":"2024-04-26T12:08:52.744180+0000","last_undegraded":"2024-04-26T12:08:52.744180+0000","last_fullsized":"2024-04-26T12:08:52.744180+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:01.830043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":12467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'425","reported_seq":544,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743855+0000","last_change":"2024-04-26T12:08:47.737376+0000","last_active":"2024-04-26T12:08:52.743855+0000","last_peered":"2024-04-26T12:08:52.743855+0000","last_clean":"2024-04-26T12:08:52.743855+0000","last_became_active":"2024-04-26T12:08:47.735367+0000","last_became_peered":"2024-04-26T12:08:47.735367+0000","last_unstale":"2024-04-26T12:08:52.743855+0000","last_undegraded":"2024-04-26T12:08:52.743855+0000","last_fullsized":"2024-04-26T12:08:52.743855+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:35.420647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":38065,"num_write":387,"num_write_kb":71445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"59'126","reported_seq":229,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744930+0000","last_change":"2024-04-26T12:08:39.702212+0000","last_active":"2024-04-26T12:08:52.744930+0000","last_peered":"2024-04-26T12:08:52.744930+0000","last_clean":"2024-04-26T12:08:52.744930+0000","last_became_active":"2024-04-26T12:08:39.701900+0000","last_became_peered":"2024-04-26T12:08:39.701900+0000","last_unstale":"2024-04-26T12:08:52.744930+0000","last_undegraded":"2024-04-26T12:08:52.744930+0000","last_fullsized":"2024-04-26T12:08:52.744930+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:28.460358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"60'448","reported_seq":548,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744703+0000","last_change":"2024-04-26T12:05:03.791827+0000","last_active":"2024-04-26T12:08:52.744703+0000","last_peered":"2024-04-26T12:08:52.744703+0000","last_clean":"2024-04-26T12:08:52.744703+0000","last_became_active":"2024-04-26T12:05:03.791442+0000","last_became_peered":"2024-04-26T12:05:03.791442+0000","last_unstale":"2024-04-26T12:08:52.744703+0000","last_undegraded":"2024-04-26T12:08:52.744703+0000","last_fullsized":"2024-04-26T12:08:52.744703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11191,"num_write":416,"num_write_kb":67272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"59'56","reported_seq":134,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744927+0000","last_change":"2024-04-26T12:05:03.430659+0000","last_active":"2024-04-26T12:08:52.744927+0000","last_peered":"2024-04-26T12:08:52.744927+0000","last_clean":"2024-04-26T12:08:52.744927+0000","last_became_active":"2024-04-26T12:05:03.430164+0000","last_became_peered":"2024-04-26T12:05:03.430164+0000","last_unstale":"2024-04-26T12:08:52.744927+0000","last_undegraded":"2024-04-26T12:08:52.744927+0000","last_fullsized":"2024-04-26T12:08:52.744927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2734,"num_read_kb":1486856,"num_write":24627,"num_write_kb":4487808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7440,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26722,"ondisk_log_size":26722,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128606591,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":5972,"num_write_kb":129691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64376832,"data_stored":257213182,"data_compressed":19249503,"data_compressed_allocated":31694848,"data_compressed_original":224591872,"omap_allocated":4411,"internal_metadata":0},"log_size":7828,"ondisk_log_size":7828,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738423,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134436,"kb_used_data":27092,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94237404,"statfs":{"total":96636764160,"available":96499101696,"internally_reserved":0,"allocated":27742208,"data_stored":91797602,"data_compressed":6340284,"data_compressed_allocated":11272192,"data_compressed_original":75763712,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:08:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.40899999999999997,"15min":0.439},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.39900000000000002,"15min":0.42599999999999999},"min":{"1min":0.19,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.51700000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Apr 26 12:05:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.436},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.41699999999999998}]}]},{"osd":1,"up_from":66,"seq":283467841543,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68516,"kb_used_data":10644,"kb_used_omap":5,"kb_used_meta":57850,"kb_avail":94303324,"statfs":{"total":96636764160,"available":96566603776,"internally_reserved":0,"allocated":10899456,"data_stored":86136667,"data_compressed":7182940,"data_compressed_allocated":10076160,"data_compressed_original":85745664,"omap_allocated":6005,"internal_metadata":59238539},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738423,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138888,"kb_used_data":27452,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232952,"statfs":{"total":96636764160,"available":96494542848,"internally_reserved":0,"allocated":28110848,"data_stored":81507786,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:05:55 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.443}]},{"osd":2,"last update":"Fri Apr 26 12:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42399999999999999,"15min":0.435},"min":{"1min":0.16200000000000001,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.433,"15min":0.433},"min":{"1min":0.20599999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.34999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27357184,"data_stored":81158407,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10088448,"data_stored":85196920,"data_compressed":7176942,"data_compressed_allocated":10039296,"data_compressed_original":85172224,"omap_allocated":4411,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26931200,"data_stored":90857855,"data_compressed":6334286,"data_compressed_allocated":11235328,"data_compressed_original":75190272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:09:03.111 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T12:09:03.111 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:09:03.444 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:09:03.445 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:09:03.455 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-04-26T12:09:02.393909+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129196959,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2917,"num_read_kb":1488438,"num_write":30802,"num_write_kb":4620959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7463,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34707,"ondisk_log_size":34707,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":341840,"kb_used_data":65188,"kb_used_omap":8,"kb_used_meta":276599,"kb_avail":282773680,"statfs":{"total":289910292480,"available":289560248320,"internally_reserved":0,"allocated":66752512,"data_stored":259442055,"data_compressed":19261499,"data_compressed_allocated":31768576,"data_compressed_original":225738752,"omap_allocated":9193,"internal_metadata":283237399},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":505,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.651305"},"pg_stats":[{"pgid":"4.3f","version":"60'426","reported_seq":507,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744715+0000","last_change":"2024-04-26T12:08:51.753936+0000","last_active":"2024-04-26T12:08:52.744715+0000","last_peered":"2024-04-26T12:08:52.744715+0000","last_clean":"2024-04-26T12:08:52.744715+0000","last_became_active":"2024-04-26T12:08:51.750917+0000","last_became_peered":"2024-04-26T12:08:51.750917+0000","last_unstale":"2024-04-26T12:08:52.744715+0000","last_undegraded":"2024-04-26T12:08:52.744715+0000","last_fullsized":"2024-04-26T12:08:52.744715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:21.716324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9964,"num_write":393,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"60'470","reported_seq":601,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744464+0000","last_change":"2024-04-26T12:08:43.719204+0000","last_active":"2024-04-26T12:08:52.744464+0000","last_peered":"2024-04-26T12:08:52.744464+0000","last_clean":"2024-04-26T12:08:52.744464+0000","last_became_active":"2024-04-26T12:08:43.717325+0000","last_became_peered":"2024-04-26T12:08:43.717325+0000","last_unstale":"2024-04-26T12:08:52.744464+0000","last_undegraded":"2024-04-26T12:08:52.744464+0000","last_fullsized":"2024-04-26T12:08:52.744464+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:57.396493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":34556,"num_write":444,"num_write_kb":129697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"60'370","reported_seq":802,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745315+0000","last_change":"2024-04-26T12:08:50.753639+0000","last_active":"2024-04-26T12:08:52.745315+0000","last_peered":"2024-04-26T12:08:52.745315+0000","last_clean":"2024-04-26T12:08:52.745315+0000","last_became_active":"2024-04-26T12:08:50.752468+0000","last_became_peered":"2024-04-26T12:08:50.752468+0000","last_unstale":"2024-04-26T12:08:52.745315+0000","last_undegraded":"2024-04-26T12:08:52.745315+0000","last_fullsized":"2024-04-26T12:08:52.745315+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:54.514768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":349,"num_write_kb":51115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"60'377","reported_seq":485,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745318+0000","last_change":"2024-04-26T12:05:03.791234+0000","last_active":"2024-04-26T12:08:52.745318+0000","last_peered":"2024-04-26T12:08:52.745318+0000","last_clean":"2024-04-26T12:08:52.745318+0000","last_became_active":"2024-04-26T12:05:03.790717+0000","last_became_peered":"2024-04-26T12:05:03.790717+0000","last_unstale":"2024-04-26T12:08:52.745318+0000","last_undegraded":"2024-04-26T12:08:52.745318+0000","last_fullsized":"2024-04-26T12:08:52.745318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:52.358881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17376,"num_write":341,"num_write_kb":46680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'445","reported_seq":550,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743965+0000","last_change":"2024-04-26T12:08:39.705318+0000","last_active":"2024-04-26T12:08:52.743965+0000","last_peered":"2024-04-26T12:08:52.743965+0000","last_clean":"2024-04-26T12:08:52.743965+0000","last_became_active":"2024-04-26T12:08:39.702117+0000","last_became_peered":"2024-04-26T12:08:39.702117+0000","last_unstale":"2024-04-26T12:08:52.743965+0000","last_undegraded":"2024-04-26T12:08:52.743965+0000","last_fullsized":"2024-04-26T12:08:52.743965+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:39.986313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24197,"num_write":416,"num_write_kb":80466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"60'375","reported_seq":470,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744643+0000","last_change":"2024-04-26T12:05:03.791560+0000","last_active":"2024-04-26T12:08:52.744643+0000","last_peered":"2024-04-26T12:08:52.744643+0000","last_clean":"2024-04-26T12:08:52.744643+0000","last_became_active":"2024-04-26T12:05:03.790578+0000","last_became_peered":"2024-04-26T12:05:03.790578+0000","last_unstale":"2024-04-26T12:08:52.744643+0000","last_undegraded":"2024-04-26T12:08:52.744643+0000","last_fullsized":"2024-04-26T12:08:52.744643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6518,"num_write":348,"num_write_kb":38078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'428","reported_seq":524,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744809+0000","last_change":"2024-04-26T12:05:03.791215+0000","last_active":"2024-04-26T12:08:52.744809+0000","last_peered":"2024-04-26T12:08:52.744809+0000","last_clean":"2024-04-26T12:08:52.744809+0000","last_became_active":"2024-04-26T12:05:03.790615+0000","last_became_peered":"2024-04-26T12:05:03.790615+0000","last_unstale":"2024-04-26T12:08:52.744809+0000","last_undegraded":"2024-04-26T12:08:52.744809+0000","last_fullsized":"2024-04-26T12:08:52.744809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:55.388027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12560,"num_write":398,"num_write_kb":67332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"60'387","reported_seq":526,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744454+0000","last_change":"2024-04-26T12:05:03.785861+0000","last_active":"2024-04-26T12:08:52.744454+0000","last_peered":"2024-04-26T12:08:52.744454+0000","last_clean":"2024-04-26T12:08:52.744454+0000","last_became_active":"2024-04-26T12:05:03.785382+0000","last_became_peered":"2024-04-26T12:05:03.785382+0000","last_unstale":"2024-04-26T12:08:52.744454+0000","last_undegraded":"2024-04-26T12:08:52.744454+0000","last_fullsized":"2024-04-26T12:08:52.744454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:51.870183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":41160,"num_write":356,"num_write_kb":80219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"60'405","reported_seq":900,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744722+0000","last_change":"2024-04-26T12:08:46.730220+0000","last_active":"2024-04-26T12:08:52.744722+0000","last_peered":"2024-04-26T12:08:52.744722+0000","last_clean":"2024-04-26T12:08:52.744722+0000","last_became_active":"2024-04-26T12:08:46.729039+0000","last_became_peered":"2024-04-26T12:08:46.729039+0000","last_unstale":"2024-04-26T12:08:52.744722+0000","last_undegraded":"2024-04-26T12:08:52.744722+0000","last_fullsized":"2024-04-26T12:08:52.744722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:00.707126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":11674,"num_write":372,"num_write_kb":34604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"60'425","reported_seq":577,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744378+0000","last_change":"2024-04-26T12:08:41.718786+0000","last_active":"2024-04-26T12:08:52.744378+0000","last_peered":"2024-04-26T12:08:52.744378+0000","last_clean":"2024-04-26T12:08:52.744378+0000","last_became_active":"2024-04-26T12:08:41.716014+0000","last_became_peered":"2024-04-26T12:08:41.716014+0000","last_unstale":"2024-04-26T12:08:52.744378+0000","last_undegraded":"2024-04-26T12:08:52.744378+0000","last_fullsized":"2024-04-26T12:08:52.744378+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:20.096806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":48419,"num_write":390,"num_write_kb":92286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"60'372","reported_seq":489,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745403+0000","last_change":"2024-04-26T12:05:03.791046+0000","last_active":"2024-04-26T12:08:52.745403+0000","last_peered":"2024-04-26T12:08:52.745403+0000","last_clean":"2024-04-26T12:08:52.745403+0000","last_became_active":"2024-04-26T12:05:03.790662+0000","last_became_peered":"2024-04-26T12:05:03.790662+0000","last_unstale":"2024-04-26T12:08:52.745403+0000","last_undegraded":"2024-04-26T12:08:52.745403+0000","last_fullsized":"2024-04-26T12:08:52.745403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:35.458663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25905,"num_write":353,"num_write_kb":75437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'351","reported_seq":426,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744359+0000","last_change":"2024-04-26T12:08:41.718349+0000","last_active":"2024-04-26T12:08:52.744359+0000","last_peered":"2024-04-26T12:08:52.744359+0000","last_clean":"2024-04-26T12:08:52.744359+0000","last_became_active":"2024-04-26T12:08:41.715726+0000","last_became_peered":"2024-04-26T12:08:41.715726+0000","last_unstale":"2024-04-26T12:08:52.744359+0000","last_undegraded":"2024-04-26T12:08:52.744359+0000","last_fullsized":"2024-04-26T12:08:52.744359+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:00.589164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8884,"num_write":327,"num_write_kb":58289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"60'405","reported_seq":485,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744109+0000","last_change":"2024-04-26T12:08:39.705153+0000","last_active":"2024-04-26T12:08:52.744109+0000","last_peered":"2024-04-26T12:08:52.744109+0000","last_clean":"2024-04-26T12:08:52.744109+0000","last_became_active":"2024-04-26T12:08:39.702141+0000","last_became_peered":"2024-04-26T12:08:39.702141+0000","last_unstale":"2024-04-26T12:08:52.744109+0000","last_undegraded":"2024-04-26T12:08:52.744109+0000","last_fullsized":"2024-04-26T12:08:52.744109+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:42.807520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6771,"num_write":372,"num_write_kb":54786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"60'431","reported_seq":937,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745087+0000","last_change":"2024-04-26T12:08:48.741419+0000","last_active":"2024-04-26T12:08:52.745087+0000","last_peered":"2024-04-26T12:08:52.745087+0000","last_clean":"2024-04-26T12:08:52.745087+0000","last_became_active":"2024-04-26T12:08:48.740170+0000","last_became_peered":"2024-04-26T12:08:48.740170+0000","last_unstale":"2024-04-26T12:08:52.745087+0000","last_undegraded":"2024-04-26T12:08:52.745087+0000","last_fullsized":"2024-04-26T12:08:52.745087+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:52.026016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26572,"num_write":398,"num_write_kb":83974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'394","reported_seq":896,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744941+0000","last_change":"2024-04-26T12:08:41.717703+0000","last_active":"2024-04-26T12:08:52.744941+0000","last_peered":"2024-04-26T12:08:52.744941+0000","last_clean":"2024-04-26T12:08:52.744941+0000","last_became_active":"2024-04-26T12:08:41.715956+0000","last_became_peered":"2024-04-26T12:08:41.715956+0000","last_unstale":"2024-04-26T12:08:52.744941+0000","last_undegraded":"2024-04-26T12:08:52.744941+0000","last_fullsized":"2024-04-26T12:08:52.744941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:34.291197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":38136,"num_write":355,"num_write_kb":38484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'432","reported_seq":543,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744458+0000","last_change":"2024-04-26T12:05:03.786360+0000","last_active":"2024-04-26T12:08:52.744458+0000","last_peered":"2024-04-26T12:08:52.744458+0000","last_clean":"2024-04-26T12:08:52.744458+0000","last_became_active":"2024-04-26T12:05:03.785991+0000","last_became_peered":"2024-04-26T12:05:03.785991+0000","last_unstale":"2024-04-26T12:08:52.744458+0000","last_undegraded":"2024-04-26T12:08:52.744458+0000","last_fullsized":"2024-04-26T12:08:52.744458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:17.702068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18244,"num_write":400,"num_write_kb":59033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'381","reported_seq":838,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.747343+0000","last_change":"2024-04-26T12:08:52.747060+0000","last_active":"2024-04-26T12:08:52.747343+0000","last_peered":"2024-04-26T12:08:52.747343+0000","last_clean":"2024-04-26T12:08:52.747343+0000","last_became_active":"2024-04-26T12:08:52.745913+0000","last_became_peered":"2024-04-26T12:08:52.745913+0000","last_unstale":"2024-04-26T12:08:52.747343+0000","last_undegraded":"2024-04-26T12:08:52.747343+0000","last_fullsized":"2024-04-26T12:08:52.747343+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:30.065406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":350,"num_write_kb":21212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"60'424","reported_seq":514,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744398+0000","last_change":"2024-04-26T12:08:42.718639+0000","last_active":"2024-04-26T12:08:52.744398+0000","last_peered":"2024-04-26T12:08:52.744398+0000","last_clean":"2024-04-26T12:08:52.744398+0000","last_became_active":"2024-04-26T12:08:42.716846+0000","last_became_peered":"2024-04-26T12:08:42.716846+0000","last_unstale":"2024-04-26T12:08:52.744398+0000","last_undegraded":"2024-04-26T12:08:52.744398+0000","last_fullsized":"2024-04-26T12:08:52.744398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:00.928679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13930,"num_write":388,"num_write_kb":116055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'426","reported_seq":905,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.748530+0000","last_change":"2024-04-26T12:08:53.748530+0000","last_active":"2024-04-26T12:08:53.748530+0000","last_peered":"2024-04-26T12:08:53.748530+0000","last_clean":"2024-04-26T12:08:53.748530+0000","last_became_active":"2024-04-26T12:08:53.747215+0000","last_became_peered":"2024-04-26T12:08:53.747215+0000","last_unstale":"2024-04-26T12:08:53.748530+0000","last_undegraded":"2024-04-26T12:08:53.748530+0000","last_fullsized":"2024-04-26T12:08:53.748530+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:14.637610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26908,"num_write":383,"num_write_kb":71324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"60'425","reported_seq":546,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745178+0000","last_change":"2024-04-26T12:05:03.792219+0000","last_active":"2024-04-26T12:08:52.745178+0000","last_peered":"2024-04-26T12:08:52.745178+0000","last_clean":"2024-04-26T12:08:52.745178+0000","last_became_active":"2024-04-26T12:05:03.791061+0000","last_became_peered":"2024-04-26T12:05:03.791061+0000","last_unstale":"2024-04-26T12:08:52.745178+0000","last_undegraded":"2024-04-26T12:08:52.745178+0000","last_fullsized":"2024-04-26T12:08:52.745178+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19715,"num_write":398,"num_write_kb":30150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'450","reported_seq":638,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745086+0000","last_change":"2024-04-26T12:05:03.792073+0000","last_active":"2024-04-26T12:08:52.745086+0000","last_peered":"2024-04-26T12:08:52.745086+0000","last_clean":"2024-04-26T12:08:52.745086+0000","last_became_active":"2024-04-26T12:05:03.791693+0000","last_became_peered":"2024-04-26T12:05:03.791693+0000","last_unstale":"2024-04-26T12:08:52.745086+0000","last_undegraded":"2024-04-26T12:08:52.745086+0000","last_fullsized":"2024-04-26T12:08:52.745086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":65124,"num_write":423,"num_write_kb":142714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'434","reported_seq":538,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744125+0000","last_change":"2024-04-26T12:08:46.730582+0000","last_active":"2024-04-26T12:08:52.744125+0000","last_peered":"2024-04-26T12:08:52.744125+0000","last_clean":"2024-04-26T12:08:52.744125+0000","last_became_active":"2024-04-26T12:08:46.728804+0000","last_became_peered":"2024-04-26T12:08:46.728804+0000","last_unstale":"2024-04-26T12:08:52.744125+0000","last_undegraded":"2024-04-26T12:08:52.744125+0000","last_fullsized":"2024-04-26T12:08:52.744125+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:47.745435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":15350,"num_write":405,"num_write_kb":59295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"60'424","reported_seq":537,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743999+0000","last_change":"2024-04-26T12:05:03.788658+0000","last_active":"2024-04-26T12:08:52.743999+0000","last_peered":"2024-04-26T12:08:52.743999+0000","last_clean":"2024-04-26T12:08:52.743999+0000","last_became_active":"2024-04-26T12:05:03.788050+0000","last_became_peered":"2024-04-26T12:05:03.788050+0000","last_unstale":"2024-04-26T12:08:52.743999+0000","last_undegraded":"2024-04-26T12:08:52.743999+0000","last_fullsized":"2024-04-26T12:08:52.743999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23772,"num_write":390,"num_write_kb":67944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"60'447","reported_seq":526,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743819+0000","last_change":"2024-04-26T12:08:40.707153+0000","last_active":"2024-04-26T12:08:52.743819+0000","last_peered":"2024-04-26T12:08:52.743819+0000","last_clean":"2024-04-26T12:08:52.743819+0000","last_became_active":"2024-04-26T12:08:40.703880+0000","last_became_peered":"2024-04-26T12:08:40.703880+0000","last_unstale":"2024-04-26T12:08:52.743819+0000","last_undegraded":"2024-04-26T12:08:52.743819+0000","last_fullsized":"2024-04-26T12:08:52.743819+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:25.187022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9403,"num_write":417,"num_write_kb":67425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"60'417","reported_seq":507,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744515+0000","last_change":"2024-04-26T12:08:42.717934+0000","last_active":"2024-04-26T12:08:52.744515+0000","last_peered":"2024-04-26T12:08:52.744515+0000","last_clean":"2024-04-26T12:08:52.744515+0000","last_became_active":"2024-04-26T12:08:42.715812+0000","last_became_peered":"2024-04-26T12:08:42.715812+0000","last_unstale":"2024-04-26T12:08:52.744515+0000","last_undegraded":"2024-04-26T12:08:52.744515+0000","last_fullsized":"2024-04-26T12:08:52.744515+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:09.442852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20466,"num_write":400,"num_write_kb":42225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"60'475","reported_seq":604,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744858+0000","last_change":"2024-04-26T12:05:03.787909+0000","last_active":"2024-04-26T12:08:52.744858+0000","last_peered":"2024-04-26T12:08:52.744858+0000","last_clean":"2024-04-26T12:08:52.744858+0000","last_became_active":"2024-04-26T12:05:03.787562+0000","last_became_peered":"2024-04-26T12:05:03.787562+0000","last_unstale":"2024-04-26T12:08:52.744858+0000","last_undegraded":"2024-04-26T12:08:52.744858+0000","last_fullsized":"2024-04-26T12:08:52.744858+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25186,"num_write":431,"num_write_kb":48184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"60'409","reported_seq":897,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745514+0000","last_change":"2024-04-26T12:08:49.741823+0000","last_active":"2024-04-26T12:08:52.745514+0000","last_peered":"2024-04-26T12:08:52.745514+0000","last_clean":"2024-04-26T12:08:52.745514+0000","last_became_active":"2024-04-26T12:08:49.740497+0000","last_became_peered":"2024-04-26T12:08:49.740497+0000","last_unstale":"2024-04-26T12:08:52.745514+0000","last_undegraded":"2024-04-26T12:08:52.745514+0000","last_fullsized":"2024-04-26T12:08:52.745514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:00.225872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":20137,"num_write":374,"num_write_kb":55441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'392","reported_seq":493,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744357+0000","last_change":"2024-04-26T12:08:47.737270+0000","last_active":"2024-04-26T12:08:52.744357+0000","last_peered":"2024-04-26T12:08:52.744357+0000","last_clean":"2024-04-26T12:08:52.744357+0000","last_became_active":"2024-04-26T12:08:47.735361+0000","last_became_peered":"2024-04-26T12:08:47.735361+0000","last_unstale":"2024-04-26T12:08:52.744357+0000","last_undegraded":"2024-04-26T12:08:52.744357+0000","last_fullsized":"2024-04-26T12:08:52.744357+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:09.838696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29179,"num_write":355,"num_write_kb":59011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'380","reported_seq":840,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744489+0000","last_change":"2024-04-26T12:08:41.717953+0000","last_active":"2024-04-26T12:08:52.744489+0000","last_peered":"2024-04-26T12:08:52.744489+0000","last_clean":"2024-04-26T12:08:52.744489+0000","last_became_active":"2024-04-26T12:08:41.716234+0000","last_became_peered":"2024-04-26T12:08:41.716234+0000","last_unstale":"2024-04-26T12:08:52.744489+0000","last_undegraded":"2024-04-26T12:08:52.744489+0000","last_fullsized":"2024-04-26T12:08:52.744489+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:37.480062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13036,"num_write":347,"num_write_kb":33880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"60'461","reported_seq":565,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744026+0000","last_change":"2024-04-26T12:08:46.732653+0000","last_active":"2024-04-26T12:08:52.744026+0000","last_peered":"2024-04-26T12:08:52.744026+0000","last_clean":"2024-04-26T12:08:52.744026+0000","last_became_active":"2024-04-26T12:08:46.730738+0000","last_became_peered":"2024-04-26T12:08:46.730738+0000","last_unstale":"2024-04-26T12:08:52.744026+0000","last_undegraded":"2024-04-26T12:08:52.744026+0000","last_fullsized":"2024-04-26T12:08:52.744026+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:46.177056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":32945,"num_write":426,"num_write_kb":63234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"60'411","reported_seq":901,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744088+0000","last_change":"2024-04-26T12:08:40.704958+0000","last_active":"2024-04-26T12:08:52.744088+0000","last_peered":"2024-04-26T12:08:52.744088+0000","last_clean":"2024-04-26T12:08:52.744088+0000","last_became_active":"2024-04-26T12:08:40.703845+0000","last_became_peered":"2024-04-26T12:08:40.703845+0000","last_unstale":"2024-04-26T12:08:52.744088+0000","last_undegraded":"2024-04-26T12:08:52.744088+0000","last_fullsized":"2024-04-26T12:08:52.744088+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:56.148477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11499,"num_write":377,"num_write_kb":34249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'430","reported_seq":538,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744573+0000","last_change":"2024-04-26T12:05:03.791605+0000","last_active":"2024-04-26T12:08:52.744573+0000","last_peered":"2024-04-26T12:08:52.744573+0000","last_clean":"2024-04-26T12:08:52.744573+0000","last_became_active":"2024-04-26T12:05:03.791251+0000","last_became_peered":"2024-04-26T12:05:03.791251+0000","last_unstale":"2024-04-26T12:08:52.744573+0000","last_undegraded":"2024-04-26T12:08:52.744573+0000","last_fullsized":"2024-04-26T12:08:52.744573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:27.239868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14660,"num_write":404,"num_write_kb":60840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"60'392","reported_seq":500,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744114+0000","last_change":"2024-04-26T12:08:44.723861+0000","last_active":"2024-04-26T12:08:52.744114+0000","last_peered":"2024-04-26T12:08:52.744114+0000","last_clean":"2024-04-26T12:08:52.744114+0000","last_became_active":"2024-04-26T12:08:44.722120+0000","last_became_peered":"2024-04-26T12:08:44.722120+0000","last_unstale":"2024-04-26T12:08:52.744114+0000","last_undegraded":"2024-04-26T12:08:52.744114+0000","last_fullsized":"2024-04-26T12:08:52.744114+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:12.810713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31703,"num_write":351,"num_write_kb":59324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"59'514","reported_seq":592,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745155+0000","last_change":"2024-04-26T12:05:03.430021+0000","last_active":"2024-04-26T12:08:52.745155+0000","last_peered":"2024-04-26T12:08:52.745155+0000","last_clean":"2024-04-26T12:08:52.745155+0000","last_became_active":"2024-04-26T12:05:03.429695+0000","last_became_peered":"2024-04-26T12:05:03.429695+0000","last_unstale":"2024-04-26T12:08:52.745155+0000","last_undegraded":"2024-04-26T12:08:52.745155+0000","last_fullsized":"2024-04-26T12:08:52.745155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":8377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'432","reported_seq":522,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.751086+0000","last_change":"2024-04-26T12:08:53.751086+0000","last_active":"2024-04-26T12:08:53.751086+0000","last_peered":"2024-04-26T12:08:53.751086+0000","last_clean":"2024-04-26T12:08:53.751086+0000","last_became_active":"2024-04-26T12:08:53.748972+0000","last_became_peered":"2024-04-26T12:08:53.748972+0000","last_unstale":"2024-04-26T12:08:53.751086+0000","last_undegraded":"2024-04-26T12:08:53.751086+0000","last_fullsized":"2024-04-26T12:08:53.751086+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:34.448806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":30094,"num_write":388,"num_write_kb":83741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"59'55","reported_seq":133,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744325+0000","last_change":"2024-04-26T12:05:03.428605+0000","last_active":"2024-04-26T12:08:52.744325+0000","last_peered":"2024-04-26T12:08:52.744325+0000","last_clean":"2024-04-26T12:08:52.744325+0000","last_became_active":"2024-04-26T12:05:03.428098+0000","last_became_peered":"2024-04-26T12:05:03.428098+0000","last_unstale":"2024-04-26T12:08:52.744325+0000","last_undegraded":"2024-04-26T12:08:52.744325+0000","last_fullsized":"2024-04-26T12:08:52.744325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"60'445","reported_seq":557,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744955+0000","last_change":"2024-04-26T12:05:03.788568+0000","last_active":"2024-04-26T12:08:52.744955+0000","last_peered":"2024-04-26T12:08:52.744955+0000","last_clean":"2024-04-26T12:08:52.744955+0000","last_became_active":"2024-04-26T12:05:03.788039+0000","last_became_peered":"2024-04-26T12:05:03.788039+0000","last_unstale":"2024-04-26T12:08:52.744955+0000","last_undegraded":"2024-04-26T12:08:52.744955+0000","last_fullsized":"2024-04-26T12:08:52.744955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.714604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":16079,"num_write":410,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"59'64","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743891+0000","last_change":"2024-04-26T12:08:36.696166+0000","last_active":"2024-04-26T12:08:52.743891+0000","last_peered":"2024-04-26T12:08:52.743891+0000","last_clean":"2024-04-26T12:08:52.743891+0000","last_became_active":"2024-04-26T12:08:36.694921+0000","last_became_peered":"2024-04-26T12:08:36.694921+0000","last_unstale":"2024-04-26T12:08:52.743891+0000","last_undegraded":"2024-04-26T12:08:52.743891+0000","last_fullsized":"2024-04-26T12:08:52.743891+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:57.438892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"60'420","reported_seq":537,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744759+0000","last_change":"2024-04-26T12:05:03.788505+0000","last_active":"2024-04-26T12:08:52.744759+0000","last_peered":"2024-04-26T12:08:52.744759+0000","last_clean":"2024-04-26T12:08:52.744759+0000","last_became_active":"2024-04-26T12:05:03.788184+0000","last_became_peered":"2024-04-26T12:05:03.788184+0000","last_unstale":"2024-04-26T12:08:52.744759+0000","last_undegraded":"2024-04-26T12:08:52.744759+0000","last_fullsized":"2024-04-26T12:08:52.744759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":14666,"num_write":383,"num_write_kb":83769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"60'63","reported_seq":155,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744615+0000","last_change":"2024-04-26T12:08:36.697126+0000","last_active":"2024-04-26T12:08:52.744615+0000","last_peered":"2024-04-26T12:08:52.744615+0000","last_clean":"2024-04-26T12:08:52.744615+0000","last_became_active":"2024-04-26T12:08:36.696792+0000","last_became_peered":"2024-04-26T12:08:36.696792+0000","last_unstale":"2024-04-26T12:08:52.744615+0000","last_undegraded":"2024-04-26T12:08:52.744615+0000","last_fullsized":"2024-04-26T12:08:52.744615+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:48.447882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"59'232","reported_seq":335,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745720+0000","last_change":"2024-04-26T12:08:39.703810+0000","last_active":"2024-04-26T12:08:52.745720+0000","last_peered":"2024-04-26T12:08:52.745720+0000","last_clean":"2024-04-26T12:08:52.745720+0000","last_became_active":"2024-04-26T12:08:39.703455+0000","last_became_peered":"2024-04-26T12:08:39.703455+0000","last_unstale":"2024-04-26T12:08:52.745720+0000","last_undegraded":"2024-04-26T12:08:52.745720+0000","last_fullsized":"2024-04-26T12:08:52.745720+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:08.399237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'408","reported_seq":491,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743999+0000","last_change":"2024-04-26T12:08:40.710236+0000","last_active":"2024-04-26T12:08:52.743999+0000","last_peered":"2024-04-26T12:08:52.743999+0000","last_clean":"2024-04-26T12:08:52.743999+0000","last_became_active":"2024-04-26T12:08:40.707357+0000","last_became_peered":"2024-04-26T12:08:40.707357+0000","last_unstale":"2024-04-26T12:08:52.743999+0000","last_undegraded":"2024-04-26T12:08:52.743999+0000","last_fullsized":"2024-04-26T12:08:52.743999+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:17.928748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12418,"num_write":371,"num_write_kb":58378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"59'302","reported_seq":370,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744280+0000","last_change":"2024-04-26T12:08:39.703949+0000","last_active":"2024-04-26T12:08:52.744280+0000","last_peered":"2024-04-26T12:08:52.744280+0000","last_clean":"2024-04-26T12:08:52.744280+0000","last_became_active":"2024-04-26T12:08:39.703421+0000","last_became_peered":"2024-04-26T12:08:39.703421+0000","last_unstale":"2024-04-26T12:08:52.744280+0000","last_undegraded":"2024-04-26T12:08:52.744280+0000","last_fullsized":"2024-04-26T12:08:52.744280+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:10.222074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":4228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'439","reported_seq":498,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743713+0000","last_change":"2024-04-26T12:08:41.717923+0000","last_active":"2024-04-26T12:08:52.743713+0000","last_peered":"2024-04-26T12:08:52.743713+0000","last_clean":"2024-04-26T12:08:52.743713+0000","last_became_active":"2024-04-26T12:08:41.715708+0000","last_became_peered":"2024-04-26T12:08:41.715708+0000","last_unstale":"2024-04-26T12:08:52.743713+0000","last_undegraded":"2024-04-26T12:08:52.743713+0000","last_fullsized":"2024-04-26T12:08:52.743713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:23.646558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":30851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"59'589","reported_seq":692,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745816+0000","last_change":"2024-04-26T12:08:39.703966+0000","last_active":"2024-04-26T12:08:52.745816+0000","last_peered":"2024-04-26T12:08:52.745816+0000","last_clean":"2024-04-26T12:08:52.745816+0000","last_became_active":"2024-04-26T12:08:39.703487+0000","last_became_peered":"2024-04-26T12:08:39.703487+0000","last_unstale":"2024-04-26T12:08:52.745816+0000","last_undegraded":"2024-04-26T12:08:52.745816+0000","last_fullsized":"2024-04-26T12:08:52.745816+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:06.112476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":534,"num_write_kb":4333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'461","reported_seq":614,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744817+0000","last_change":"2024-04-26T12:05:03.791809+0000","last_active":"2024-04-26T12:08:52.744817+0000","last_peered":"2024-04-26T12:08:52.744817+0000","last_clean":"2024-04-26T12:08:52.744817+0000","last_became_active":"2024-04-26T12:05:03.791272+0000","last_became_peered":"2024-04-26T12:05:03.791272+0000","last_unstale":"2024-04-26T12:08:52.744817+0000","last_undegraded":"2024-04-26T12:08:52.744817+0000","last_fullsized":"2024-04-26T12:08:52.744817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":46123,"num_write":422,"num_write_kb":104552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'66","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745499+0000","last_change":"2024-04-26T12:05:03.430224+0000","last_active":"2024-04-26T12:08:52.745499+0000","last_peered":"2024-04-26T12:08:52.745499+0000","last_clean":"2024-04-26T12:08:52.745499+0000","last_became_active":"2024-04-26T12:05:03.429291+0000","last_became_peered":"2024-04-26T12:05:03.429291+0000","last_unstale":"2024-04-26T12:08:52.745499+0000","last_undegraded":"2024-04-26T12:08:52.745499+0000","last_fullsized":"2024-04-26T12:08:52.745499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'428","reported_seq":541,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744404+0000","last_change":"2024-04-26T12:05:03.788174+0000","last_active":"2024-04-26T12:08:52.744404+0000","last_peered":"2024-04-26T12:08:52.744404+0000","last_clean":"2024-04-26T12:08:52.744404+0000","last_became_active":"2024-04-26T12:05:03.787772+0000","last_became_peered":"2024-04-26T12:05:03.787772+0000","last_unstale":"2024-04-26T12:08:52.744404+0000","last_undegraded":"2024-04-26T12:08:52.744404+0000","last_fullsized":"2024-04-26T12:08:52.744404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15098,"num_write":394,"num_write_kb":42677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"59'195","reported_seq":273,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744598+0000","last_change":"2024-04-26T12:05:03.431162+0000","last_active":"2024-04-26T12:08:52.744598+0000","last_peered":"2024-04-26T12:08:52.744598+0000","last_clean":"2024-04-26T12:08:52.744598+0000","last_became_active":"2024-04-26T12:05:03.430855+0000","last_became_peered":"2024-04-26T12:05:03.430855+0000","last_unstale":"2024-04-26T12:08:52.744598+0000","last_undegraded":"2024-04-26T12:08:52.744598+0000","last_fullsized":"2024-04-26T12:08:52.744598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:41.279426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"60'448","reported_seq":544,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745298+0000","last_change":"2024-04-26T12:05:03.792357+0000","last_active":"2024-04-26T12:08:52.745298+0000","last_peered":"2024-04-26T12:08:52.745298+0000","last_clean":"2024-04-26T12:08:52.745298+0000","last_became_active":"2024-04-26T12:05:03.792119+0000","last_became_peered":"2024-04-26T12:05:03.792119+0000","last_unstale":"2024-04-26T12:08:52.745298+0000","last_undegraded":"2024-04-26T12:08:52.745298+0000","last_fullsized":"2024-04-26T12:08:52.745298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":13281,"num_write":420,"num_write_kb":59540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"59'171","reported_seq":249,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745146+0000","last_change":"2024-04-26T12:05:03.429811+0000","last_active":"2024-04-26T12:08:52.745146+0000","last_peered":"2024-04-26T12:08:52.745146+0000","last_clean":"2024-04-26T12:08:52.745146+0000","last_became_active":"2024-04-26T12:05:03.429469+0000","last_became_peered":"2024-04-26T12:05:03.429469+0000","last_unstale":"2024-04-26T12:08:52.745146+0000","last_undegraded":"2024-04-26T12:08:52.745146+0000","last_fullsized":"2024-04-26T12:08:52.745146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'412","reported_seq":923,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745698+0000","last_change":"2024-04-26T12:08:51.752350+0000","last_active":"2024-04-26T12:08:52.745698+0000","last_peered":"2024-04-26T12:08:52.745698+0000","last_clean":"2024-04-26T12:08:52.745698+0000","last_became_active":"2024-04-26T12:08:51.751044+0000","last_became_peered":"2024-04-26T12:08:51.751044+0000","last_unstale":"2024-04-26T12:08:52.745698+0000","last_undegraded":"2024-04-26T12:08:52.745698+0000","last_fullsized":"2024-04-26T12:08:52.745698+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:40.008727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26310,"num_write":380,"num_write_kb":38462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"59'55","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743708+0000","last_change":"2024-04-26T12:08:36.695355+0000","last_active":"2024-04-26T12:08:52.743708+0000","last_peered":"2024-04-26T12:08:52.743708+0000","last_clean":"2024-04-26T12:08:52.743708+0000","last_became_active":"2024-04-26T12:08:36.694346+0000","last_became_peered":"2024-04-26T12:08:36.694346+0000","last_unstale":"2024-04-26T12:08:52.743708+0000","last_undegraded":"2024-04-26T12:08:52.743708+0000","last_fullsized":"2024-04-26T12:08:52.743708+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:42.458073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"60'362","reported_seq":817,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745440+0000","last_change":"2024-04-26T12:08:41.717048+0000","last_active":"2024-04-26T12:08:52.745440+0000","last_peered":"2024-04-26T12:08:52.745440+0000","last_clean":"2024-04-26T12:08:52.745440+0000","last_became_active":"2024-04-26T12:08:41.716102+0000","last_became_peered":"2024-04-26T12:08:41.716102+0000","last_unstale":"2024-04-26T12:08:52.745440+0000","last_undegraded":"2024-04-26T12:08:52.745440+0000","last_fullsized":"2024-04-26T12:08:52.745440+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:52.409548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21408,"num_write":333,"num_write_kb":66549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"59'378","reported_seq":439,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743919+0000","last_change":"2024-04-26T12:08:39.702797+0000","last_active":"2024-04-26T12:08:52.743919+0000","last_peered":"2024-04-26T12:08:52.743919+0000","last_clean":"2024-04-26T12:08:52.743919+0000","last_became_active":"2024-04-26T12:08:39.702438+0000","last_became_peered":"2024-04-26T12:08:39.702438+0000","last_unstale":"2024-04-26T12:08:52.743919+0000","last_undegraded":"2024-04-26T12:08:52.743919+0000","last_fullsized":"2024-04-26T12:08:52.743919+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:06.278304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"60'407","reported_seq":917,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744823+0000","last_change":"2024-04-26T12:08:45.724853+0000","last_active":"2024-04-26T12:08:52.744823+0000","last_peered":"2024-04-26T12:08:52.744823+0000","last_clean":"2024-04-26T12:08:52.744823+0000","last_became_active":"2024-04-26T12:08:45.723772+0000","last_became_peered":"2024-04-26T12:08:45.723772+0000","last_unstale":"2024-04-26T12:08:52.744823+0000","last_undegraded":"2024-04-26T12:08:52.744823+0000","last_fullsized":"2024-04-26T12:08:52.744823+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:41.814840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":40156,"num_write":373,"num_write_kb":91285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":294,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745711+0000","last_change":"2024-04-26T12:08:36.697892+0000","last_active":"2024-04-26T12:08:53.745711+0000","last_peered":"2024-04-26T12:08:53.745711+0000","last_clean":"2024-04-26T12:08:53.745711+0000","last_became_active":"2024-04-26T12:08:36.697508+0000","last_became_peered":"2024-04-26T12:08:36.697508+0000","last_unstale":"2024-04-26T12:08:53.745711+0000","last_undegraded":"2024-04-26T12:08:53.745711+0000","last_fullsized":"2024-04-26T12:08:53.745711+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_clean_scrub_stamp":"2024-04-26T12:04:52.376986+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:24.384180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745283+0000","last_change":"2024-04-26T12:04:59.403711+0000","last_active":"2024-04-26T12:08:52.745283+0000","last_peered":"2024-04-26T12:08:52.745283+0000","last_clean":"2024-04-26T12:08:52.745283+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:08:52.745283+0000","last_undegraded":"2024-04-26T12:08:52.745283+0000","last_fullsized":"2024-04-26T12:08:52.745283+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:45.779614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'793","reported_seq":897,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744445+0000","last_change":"2024-04-26T12:08:39.702225+0000","last_active":"2024-04-26T12:08:52.744445+0000","last_peered":"2024-04-26T12:08:52.744445+0000","last_clean":"2024-04-26T12:08:52.744445+0000","last_became_active":"2024-04-26T12:08:39.701760+0000","last_became_peered":"2024-04-26T12:08:39.701760+0000","last_unstale":"2024-04-26T12:08:52.744445+0000","last_undegraded":"2024-04-26T12:08:52.744445+0000","last_fullsized":"2024-04-26T12:08:52.744445+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:51.405891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":8533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"60'466","reported_seq":1012,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.747878+0000","last_change":"2024-04-26T12:08:52.747463+0000","last_active":"2024-04-26T12:08:52.747878+0000","last_peered":"2024-04-26T12:08:52.747878+0000","last_clean":"2024-04-26T12:08:52.747878+0000","last_became_active":"2024-04-26T12:08:52.746147+0000","last_became_peered":"2024-04-26T12:08:52.746147+0000","last_unstale":"2024-04-26T12:08:52.747878+0000","last_undegraded":"2024-04-26T12:08:52.747878+0000","last_fullsized":"2024-04-26T12:08:52.747878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:21.517395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":37547,"num_write":422,"num_write_kb":96579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":95,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745616+0000","last_change":"2024-04-26T12:08:36.695759+0000","last_active":"2024-04-26T12:08:53.745616+0000","last_peered":"2024-04-26T12:08:53.745616+0000","last_clean":"2024-04-26T12:08:53.745616+0000","last_became_active":"2024-04-26T12:08:36.695444+0000","last_became_peered":"2024-04-26T12:08:36.695444+0000","last_unstale":"2024-04-26T12:08:53.745616+0000","last_undegraded":"2024-04-26T12:08:53.745616+0000","last_fullsized":"2024-04-26T12:08:53.745616+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:22.343369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"60'114","reported_seq":239,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744279+0000","last_change":"2024-04-26T12:05:03.428547+0000","last_active":"2024-04-26T12:08:52.744279+0000","last_peered":"2024-04-26T12:08:52.744279+0000","last_clean":"2024-04-26T12:08:52.744279+0000","last_became_active":"2024-04-26T12:05:03.427985+0000","last_became_peered":"2024-04-26T12:05:03.427985+0000","last_unstale":"2024-04-26T12:08:52.744279+0000","last_undegraded":"2024-04-26T12:08:52.744279+0000","last_fullsized":"2024-04-26T12:08:52.744279+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:19.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466015,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":47,"num_write_kb":1464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"60'492","reported_seq":655,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744496+0000","last_change":"2024-04-26T12:08:49.741650+0000","last_active":"2024-04-26T12:08:52.744496+0000","last_peered":"2024-04-26T12:08:52.744496+0000","last_clean":"2024-04-26T12:08:52.744496+0000","last_became_active":"2024-04-26T12:08:49.739496+0000","last_became_peered":"2024-04-26T12:08:49.739496+0000","last_unstale":"2024-04-26T12:08:52.744496+0000","last_undegraded":"2024-04-26T12:08:52.744496+0000","last_fullsized":"2024-04-26T12:08:52.744496+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:55.361224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":63988,"num_write":466,"num_write_kb":154489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744369+0000","last_change":"2024-04-26T12:08:36.696858+0000","last_active":"2024-04-26T12:08:52.744369+0000","last_peered":"2024-04-26T12:08:52.744369+0000","last_clean":"2024-04-26T12:08:52.744369+0000","last_became_active":"2024-04-26T12:08:36.696619+0000","last_became_peered":"2024-04-26T12:08:36.696619+0000","last_unstale":"2024-04-26T12:08:52.744369+0000","last_undegraded":"2024-04-26T12:08:52.744369+0000","last_fullsized":"2024-04-26T12:08:52.744369+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:47.292926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"59'325","reported_seq":386,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743649+0000","last_change":"2024-04-26T12:08:39.704052+0000","last_active":"2024-04-26T12:08:52.743649+0000","last_peered":"2024-04-26T12:08:52.743649+0000","last_clean":"2024-04-26T12:08:52.743649+0000","last_became_active":"2024-04-26T12:08:39.703696+0000","last_became_peered":"2024-04-26T12:08:39.703696+0000","last_unstale":"2024-04-26T12:08:52.743649+0000","last_undegraded":"2024-04-26T12:08:52.743649+0000","last_fullsized":"2024-04-26T12:08:52.743649+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:21:44.069244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":8296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"60'359","reported_seq":785,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744857+0000","last_change":"2024-04-26T12:08:47.737443+0000","last_active":"2024-04-26T12:08:52.744857+0000","last_peered":"2024-04-26T12:08:52.744857+0000","last_clean":"2024-04-26T12:08:52.744857+0000","last_became_active":"2024-04-26T12:08:47.735729+0000","last_became_peered":"2024-04-26T12:08:47.735729+0000","last_unstale":"2024-04-26T12:08:52.744857+0000","last_undegraded":"2024-04-26T12:08:52.744857+0000","last_fullsized":"2024-04-26T12:08:52.744857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:57:20.726677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9448,"num_write":336,"num_write_kb":74900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745246+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:08:52.745246+0000","last_peered":"2024-04-26T12:08:52.745246+0000","last_clean":"2024-04-26T12:08:52.745246+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:08:52.745246+0000","last_undegraded":"2024-04-26T12:08:52.745246+0000","last_fullsized":"2024-04-26T12:08:52.745246+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:12.939539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"59'67","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745292+0000","last_change":"2024-04-26T12:05:03.430140+0000","last_active":"2024-04-26T12:08:52.745292+0000","last_peered":"2024-04-26T12:08:52.745292+0000","last_clean":"2024-04-26T12:08:52.745292+0000","last_became_active":"2024-04-26T12:05:03.429838+0000","last_became_peered":"2024-04-26T12:05:03.429838+0000","last_unstale":"2024-04-26T12:08:52.745292+0000","last_undegraded":"2024-04-26T12:08:52.745292+0000","last_fullsized":"2024-04-26T12:08:52.745292+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"60'403","reported_seq":894,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744652+0000","last_change":"2024-04-26T12:08:50.753437+0000","last_active":"2024-04-26T12:08:52.744652+0000","last_peered":"2024-04-26T12:08:52.744652+0000","last_clean":"2024-04-26T12:08:52.744652+0000","last_became_active":"2024-04-26T12:08:50.752366+0000","last_became_peered":"2024-04-26T12:08:50.752366+0000","last_unstale":"2024-04-26T12:08:52.744652+0000","last_undegraded":"2024-04-26T12:08:52.744652+0000","last_fullsized":"2024-04-26T12:08:52.744652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:02.999757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30094,"num_write":370,"num_write_kb":104181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"59'469","reported_seq":547,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745818+0000","last_change":"2024-04-26T12:05:03.429673+0000","last_active":"2024-04-26T12:08:52.745818+0000","last_peered":"2024-04-26T12:08:52.745818+0000","last_clean":"2024-04-26T12:08:52.745818+0000","last_became_active":"2024-04-26T12:05:03.429146+0000","last_became_peered":"2024-04-26T12:05:03.429146+0000","last_unstale":"2024-04-26T12:08:52.745818+0000","last_undegraded":"2024-04-26T12:08:52.745818+0000","last_fullsized":"2024-04-26T12:08:52.745818+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744743+0000","last_change":"2024-04-26T12:08:36.697900+0000","last_active":"2024-04-26T12:08:52.744743+0000","last_peered":"2024-04-26T12:08:52.744743+0000","last_clean":"2024-04-26T12:08:52.744743+0000","last_became_active":"2024-04-26T12:08:36.697618+0000","last_became_peered":"2024-04-26T12:08:36.697618+0000","last_unstale":"2024-04-26T12:08:52.744743+0000","last_undegraded":"2024-04-26T12:08:52.744743+0000","last_fullsized":"2024-04-26T12:08:52.744743+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:16.620901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'354","reported_seq":413,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744055+0000","last_change":"2024-04-26T12:08:45.725751+0000","last_active":"2024-04-26T12:08:52.744055+0000","last_peered":"2024-04-26T12:08:52.744055+0000","last_clean":"2024-04-26T12:08:52.744055+0000","last_became_active":"2024-04-26T12:08:45.724153+0000","last_became_peered":"2024-04-26T12:08:45.724153+0000","last_unstale":"2024-04-26T12:08:52.744055+0000","last_undegraded":"2024-04-26T12:08:52.744055+0000","last_fullsized":"2024-04-26T12:08:52.744055+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:57.798803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":416,"num_write":319,"num_write_kb":17259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"59'53","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744703+0000","last_change":"2024-04-26T12:08:36.698122+0000","last_active":"2024-04-26T12:08:52.744703+0000","last_peered":"2024-04-26T12:08:52.744703+0000","last_clean":"2024-04-26T12:08:52.744703+0000","last_became_active":"2024-04-26T12:08:36.697832+0000","last_became_peered":"2024-04-26T12:08:36.697832+0000","last_unstale":"2024-04-26T12:08:52.744703+0000","last_undegraded":"2024-04-26T12:08:52.744703+0000","last_fullsized":"2024-04-26T12:08:52.744703+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:34.416168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744650+0000","last_change":"2024-04-26T12:08:36.698131+0000","last_active":"2024-04-26T12:08:52.744650+0000","last_peered":"2024-04-26T12:08:52.744650+0000","last_clean":"2024-04-26T12:08:52.744650+0000","last_became_active":"2024-04-26T12:08:36.697698+0000","last_became_peered":"2024-04-26T12:08:36.697698+0000","last_unstale":"2024-04-26T12:08:52.744650+0000","last_undegraded":"2024-04-26T12:08:52.744650+0000","last_fullsized":"2024-04-26T12:08:52.744650+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:15.476036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'399","reported_seq":477,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743860+0000","last_change":"2024-04-26T12:08:40.705752+0000","last_active":"2024-04-26T12:08:52.743860+0000","last_peered":"2024-04-26T12:08:52.743860+0000","last_clean":"2024-04-26T12:08:52.743860+0000","last_became_active":"2024-04-26T12:08:40.703906+0000","last_became_peered":"2024-04-26T12:08:40.703906+0000","last_unstale":"2024-04-26T12:08:52.743860+0000","last_undegraded":"2024-04-26T12:08:52.743860+0000","last_fullsized":"2024-04-26T12:08:52.743860+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:19.004074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11720,"num_write":363,"num_write_kb":66914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"59'65","reported_seq":157,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745130+0000","last_change":"2024-04-26T12:08:36.699388+0000","last_active":"2024-04-26T12:08:52.745130+0000","last_peered":"2024-04-26T12:08:52.745130+0000","last_clean":"2024-04-26T12:08:52.745130+0000","last_became_active":"2024-04-26T12:08:36.699058+0000","last_became_peered":"2024-04-26T12:08:36.699058+0000","last_unstale":"2024-04-26T12:08:52.745130+0000","last_undegraded":"2024-04-26T12:08:52.745130+0000","last_fullsized":"2024-04-26T12:08:52.745130+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:11.978288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745047+0000","last_change":"2024-04-26T12:08:36.697618+0000","last_active":"2024-04-26T12:08:52.745047+0000","last_peered":"2024-04-26T12:08:52.745047+0000","last_clean":"2024-04-26T12:08:52.745047+0000","last_became_active":"2024-04-26T12:08:36.697407+0000","last_became_peered":"2024-04-26T12:08:36.697407+0000","last_unstale":"2024-04-26T12:08:52.745047+0000","last_undegraded":"2024-04-26T12:08:52.745047+0000","last_fullsized":"2024-04-26T12:08:52.745047+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:02.301767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'424","reported_seq":541,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744097+0000","last_change":"2024-04-26T12:05:03.789623+0000","last_active":"2024-04-26T12:08:52.744097+0000","last_peered":"2024-04-26T12:08:52.744097+0000","last_clean":"2024-04-26T12:08:52.744097+0000","last_became_active":"2024-04-26T12:05:03.789390+0000","last_became_peered":"2024-04-26T12:05:03.789390+0000","last_unstale":"2024-04-26T12:08:52.744097+0000","last_undegraded":"2024-04-26T12:08:52.744097+0000","last_fullsized":"2024-04-26T12:08:52.744097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17027,"num_write":386,"num_write_kb":58797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"61'70","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745116+0000","last_change":"2024-04-26T12:05:03.429222+0000","last_active":"2024-04-26T12:08:52.745116+0000","last_peered":"2024-04-26T12:08:52.745116+0000","last_clean":"2024-04-26T12:08:52.745116+0000","last_became_active":"2024-04-26T12:05:03.428803+0000","last_became_peered":"2024-04-26T12:05:03.428803+0000","last_unstale":"2024-04-26T12:08:52.745116+0000","last_undegraded":"2024-04-26T12:08:52.745116+0000","last_fullsized":"2024-04-26T12:08:52.745116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:31.305644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745750+0000","last_change":"2024-04-26T12:08:36.698775+0000","last_active":"2024-04-26T12:08:52.745750+0000","last_peered":"2024-04-26T12:08:52.745750+0000","last_clean":"2024-04-26T12:08:52.745750+0000","last_became_active":"2024-04-26T12:08:36.698523+0000","last_became_peered":"2024-04-26T12:08:36.698523+0000","last_unstale":"2024-04-26T12:08:52.745750+0000","last_undegraded":"2024-04-26T12:08:52.745750+0000","last_fullsized":"2024-04-26T12:08:52.745750+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:16.620901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'393","reported_seq":472,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744009+0000","last_change":"2024-04-26T12:08:40.705662+0000","last_active":"2024-04-26T12:08:52.744009+0000","last_peered":"2024-04-26T12:08:52.744009+0000","last_clean":"2024-04-26T12:08:52.744009+0000","last_became_active":"2024-04-26T12:08:40.703873+0000","last_became_peered":"2024-04-26T12:08:40.703873+0000","last_unstale":"2024-04-26T12:08:52.744009+0000","last_undegraded":"2024-04-26T12:08:52.744009+0000","last_fullsized":"2024-04-26T12:08:52.744009+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:27.057123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":11991,"num_write":357,"num_write_kb":83226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'419","reported_seq":892,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744937+0000","last_change":"2024-04-26T12:08:44.723692+0000","last_active":"2024-04-26T12:08:52.744937+0000","last_peered":"2024-04-26T12:08:52.744937+0000","last_clean":"2024-04-26T12:08:52.744937+0000","last_became_active":"2024-04-26T12:08:44.722574+0000","last_became_peered":"2024-04-26T12:08:44.722574+0000","last_unstale":"2024-04-26T12:08:52.744937+0000","last_undegraded":"2024-04-26T12:08:52.744937+0000","last_fullsized":"2024-04-26T12:08:52.744937+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:01.256055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14983,"num_write":376,"num_write_kb":76749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"61'398","reported_seq":507,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745436+0000","last_change":"2024-04-26T12:08:39.703851+0000","last_active":"2024-04-26T12:08:52.745436+0000","last_peered":"2024-04-26T12:08:52.745436+0000","last_clean":"2024-04-26T12:08:52.745436+0000","last_became_active":"2024-04-26T12:08:39.703516+0000","last_became_peered":"2024-04-26T12:08:39.703516+0000","last_unstale":"2024-04-26T12:08:52.745436+0000","last_undegraded":"2024-04-26T12:08:52.745436+0000","last_fullsized":"2024-04-26T12:08:52.745436+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:10.227718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699266,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":9692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9692849,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'428","reported_seq":940,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744179+0000","last_change":"2024-04-26T12:08:50.753473+0000","last_active":"2024-04-26T12:08:52.744179+0000","last_peered":"2024-04-26T12:08:52.744179+0000","last_clean":"2024-04-26T12:08:52.744179+0000","last_became_active":"2024-04-26T12:08:50.752328+0000","last_became_peered":"2024-04-26T12:08:50.752328+0000","last_unstale":"2024-04-26T12:08:52.744179+0000","last_undegraded":"2024-04-26T12:08:52.744179+0000","last_fullsized":"2024-04-26T12:08:52.744179+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:08.396108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":26594,"num_write":396,"num_write_kb":67932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"60'91","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744409+0000","last_change":"2024-04-26T12:08:36.722607+0000","last_active":"2024-04-26T12:08:52.744409+0000","last_peered":"2024-04-26T12:08:52.744409+0000","last_clean":"2024-04-26T12:08:52.744409+0000","last_became_active":"2024-04-26T12:08:36.697650+0000","last_became_peered":"2024-04-26T12:08:36.697650+0000","last_unstale":"2024-04-26T12:08:52.744409+0000","last_undegraded":"2024-04-26T12:08:52.744409+0000","last_fullsized":"2024-04-26T12:08:52.744409+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:10.718101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"59'316","reported_seq":394,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745553+0000","last_change":"2024-04-26T12:05:03.429257+0000","last_active":"2024-04-26T12:08:52.745553+0000","last_peered":"2024-04-26T12:08:52.745553+0000","last_clean":"2024-04-26T12:08:52.745553+0000","last_became_active":"2024-04-26T12:05:03.428921+0000","last_became_peered":"2024-04-26T12:05:03.428921+0000","last_unstale":"2024-04-26T12:08:52.745553+0000","last_undegraded":"2024-04-26T12:08:52.745553+0000","last_fullsized":"2024-04-26T12:08:52.745553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:49.774845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'495","reported_seq":625,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744089+0000","last_change":"2024-04-26T12:05:03.788141+0000","last_active":"2024-04-26T12:08:52.744089+0000","last_peered":"2024-04-26T12:08:52.744089+0000","last_clean":"2024-04-26T12:08:52.744089+0000","last_became_active":"2024-04-26T12:05:03.787533+0000","last_became_peered":"2024-04-26T12:05:03.787533+0000","last_unstale":"2024-04-26T12:08:52.744089+0000","last_undegraded":"2024-04-26T12:08:52.744089+0000","last_fullsized":"2024-04-26T12:08:52.744089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:10.180658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37174,"num_write":458,"num_write_kb":125832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'51","reported_seq":129,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745033+0000","last_change":"2024-04-26T12:05:03.428971+0000","last_active":"2024-04-26T12:08:52.745033+0000","last_peered":"2024-04-26T12:08:52.745033+0000","last_clean":"2024-04-26T12:08:52.745033+0000","last_became_active":"2024-04-26T12:05:03.428445+0000","last_became_peered":"2024-04-26T12:05:03.428445+0000","last_unstale":"2024-04-26T12:08:52.745033+0000","last_undegraded":"2024-04-26T12:08:52.745033+0000","last_fullsized":"2024-04-26T12:08:52.745033+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'482","reported_seq":1130,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744097+0000","last_change":"2024-04-26T12:08:48.741589+0000","last_active":"2024-04-26T12:08:52.744097+0000","last_peered":"2024-04-26T12:08:52.744097+0000","last_clean":"2024-04-26T12:08:52.744097+0000","last_became_active":"2024-04-26T12:08:48.740055+0000","last_became_peered":"2024-04-26T12:08:48.740055+0000","last_unstale":"2024-04-26T12:08:52.744097+0000","last_undegraded":"2024-04-26T12:08:52.744097+0000","last_fullsized":"2024-04-26T12:08:52.744097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:03.903516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":61972,"num_write":459,"num_write_kb":125797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"60'392","reported_seq":527,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744471+0000","last_change":"2024-04-26T12:08:43.718939+0000","last_active":"2024-04-26T12:08:52.744471+0000","last_peered":"2024-04-26T12:08:52.744471+0000","last_clean":"2024-04-26T12:08:52.744471+0000","last_became_active":"2024-04-26T12:08:43.717109+0000","last_became_peered":"2024-04-26T12:08:43.717109+0000","last_unstale":"2024-04-26T12:08:52.744471+0000","last_undegraded":"2024-04-26T12:08:52.744471+0000","last_fullsized":"2024-04-26T12:08:52.744471+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:14.846653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":37910,"num_write":366,"num_write_kb":84111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"59'709","reported_seq":813,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744368+0000","last_change":"2024-04-26T12:08:39.701978+0000","last_active":"2024-04-26T12:08:52.744368+0000","last_peered":"2024-04-26T12:08:52.744368+0000","last_clean":"2024-04-26T12:08:52.744368+0000","last_became_active":"2024-04-26T12:08:39.700927+0000","last_became_peered":"2024-04-26T12:08:39.700927+0000","last_unstale":"2024-04-26T12:08:52.744368+0000","last_undegraded":"2024-04-26T12:08:52.744368+0000","last_fullsized":"2024-04-26T12:08:52.744368+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:10.815597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"60'435","reported_seq":572,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744787+0000","last_change":"2024-04-26T12:05:03.788754+0000","last_active":"2024-04-26T12:08:52.744787+0000","last_peered":"2024-04-26T12:08:52.744787+0000","last_clean":"2024-04-26T12:08:52.744787+0000","last_became_active":"2024-04-26T12:05:03.788311+0000","last_became_peered":"2024-04-26T12:05:03.788311+0000","last_unstale":"2024-04-26T12:08:52.744787+0000","last_undegraded":"2024-04-26T12:08:52.744787+0000","last_fullsized":"2024-04-26T12:08:52.744787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":28462,"num_write":403,"num_write_kb":93779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"59'262","reported_seq":340,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744211+0000","last_change":"2024-04-26T12:05:03.428810+0000","last_active":"2024-04-26T12:08:52.744211+0000","last_peered":"2024-04-26T12:08:52.744211+0000","last_clean":"2024-04-26T12:08:52.744211+0000","last_became_active":"2024-04-26T12:05:03.428191+0000","last_became_peered":"2024-04-26T12:05:03.428191+0000","last_unstale":"2024-04-26T12:08:52.744211+0000","last_undegraded":"2024-04-26T12:08:52.744211+0000","last_fullsized":"2024-04-26T12:08:52.744211+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"60'399","reported_seq":499,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744294+0000","last_change":"2024-04-26T12:08:49.742459+0000","last_active":"2024-04-26T12:08:52.744294+0000","last_peered":"2024-04-26T12:08:52.744294+0000","last_clean":"2024-04-26T12:08:52.744294+0000","last_became_active":"2024-04-26T12:08:49.740536+0000","last_became_peered":"2024-04-26T12:08:49.740536+0000","last_unstale":"2024-04-26T12:08:52.744294+0000","last_undegraded":"2024-04-26T12:08:52.744294+0000","last_fullsized":"2024-04-26T12:08:52.744294+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:24.169669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22216,"num_write":357,"num_write_kb":75245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"59'430","reported_seq":490,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743876+0000","last_change":"2024-04-26T12:08:39.703050+0000","last_active":"2024-04-26T12:08:52.743876+0000","last_peered":"2024-04-26T12:08:52.743876+0000","last_clean":"2024-04-26T12:08:52.743876+0000","last_became_active":"2024-04-26T12:08:39.702529+0000","last_became_peered":"2024-04-26T12:08:39.702529+0000","last_unstale":"2024-04-26T12:08:52.743876+0000","last_undegraded":"2024-04-26T12:08:52.743876+0000","last_fullsized":"2024-04-26T12:08:52.743876+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:28.249725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":12514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"60'387","reported_seq":476,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744228+0000","last_change":"2024-04-26T12:08:43.720098+0000","last_active":"2024-04-26T12:08:52.744228+0000","last_peered":"2024-04-26T12:08:52.744228+0000","last_clean":"2024-04-26T12:08:52.744228+0000","last_became_active":"2024-04-26T12:08:43.717442+0000","last_became_peered":"2024-04-26T12:08:43.717442+0000","last_unstale":"2024-04-26T12:08:52.744228+0000","last_undegraded":"2024-04-26T12:08:52.744228+0000","last_fullsized":"2024-04-26T12:08:52.744228+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:13.140334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20720,"num_write":352,"num_write_kb":87643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"59'58","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743900+0000","last_change":"2024-04-26T12:08:36.720540+0000","last_active":"2024-04-26T12:08:52.743900+0000","last_peered":"2024-04-26T12:08:52.743900+0000","last_clean":"2024-04-26T12:08:52.743900+0000","last_became_active":"2024-04-26T12:08:36.693399+0000","last_became_peered":"2024-04-26T12:08:36.693399+0000","last_unstale":"2024-04-26T12:08:52.743900+0000","last_undegraded":"2024-04-26T12:08:52.743900+0000","last_fullsized":"2024-04-26T12:08:52.743900+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:14.949002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"60'356","reported_seq":452,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744945+0000","last_change":"2024-04-26T12:05:03.791986+0000","last_active":"2024-04-26T12:08:52.744945+0000","last_peered":"2024-04-26T12:08:52.744945+0000","last_clean":"2024-04-26T12:08:52.744945+0000","last_became_active":"2024-04-26T12:05:03.790823+0000","last_became_peered":"2024-04-26T12:05:03.790823+0000","last_unstale":"2024-04-26T12:08:52.744945+0000","last_undegraded":"2024-04-26T12:08:52.744945+0000","last_fullsized":"2024-04-26T12:08:52.744945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9641,"num_write":326,"num_write_kb":29574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"59'309","reported_seq":387,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745394+0000","last_change":"2024-04-26T12:05:03.429469+0000","last_active":"2024-04-26T12:08:52.745394+0000","last_peered":"2024-04-26T12:08:52.745394+0000","last_clean":"2024-04-26T12:08:52.745394+0000","last_became_active":"2024-04-26T12:05:03.429015+0000","last_became_peered":"2024-04-26T12:05:03.429015+0000","last_unstale":"2024-04-26T12:08:52.745394+0000","last_undegraded":"2024-04-26T12:08:52.745394+0000","last_fullsized":"2024-04-26T12:08:52.745394+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'433","reported_seq":575,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745025+0000","last_change":"2024-04-26T12:05:03.791929+0000","last_active":"2024-04-26T12:08:52.745025+0000","last_peered":"2024-04-26T12:08:52.745025+0000","last_clean":"2024-04-26T12:08:52.745025+0000","last_became_active":"2024-04-26T12:05:03.791540+0000","last_became_peered":"2024-04-26T12:05:03.791540+0000","last_unstale":"2024-04-26T12:08:52.745025+0000","last_undegraded":"2024-04-26T12:08:52.745025+0000","last_fullsized":"2024-04-26T12:08:52.745025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":47864,"num_write":399,"num_write_kb":92193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"59'382","reported_seq":449,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744180+0000","last_change":"2024-04-26T12:08:39.704680+0000","last_active":"2024-04-26T12:08:52.744180+0000","last_peered":"2024-04-26T12:08:52.744180+0000","last_clean":"2024-04-26T12:08:52.744180+0000","last_became_active":"2024-04-26T12:08:39.704404+0000","last_became_peered":"2024-04-26T12:08:39.704404+0000","last_unstale":"2024-04-26T12:08:52.744180+0000","last_undegraded":"2024-04-26T12:08:52.744180+0000","last_fullsized":"2024-04-26T12:08:52.744180+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:01.830043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":12467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'425","reported_seq":544,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743855+0000","last_change":"2024-04-26T12:08:47.737376+0000","last_active":"2024-04-26T12:08:52.743855+0000","last_peered":"2024-04-26T12:08:52.743855+0000","last_clean":"2024-04-26T12:08:52.743855+0000","last_became_active":"2024-04-26T12:08:47.735367+0000","last_became_peered":"2024-04-26T12:08:47.735367+0000","last_unstale":"2024-04-26T12:08:52.743855+0000","last_undegraded":"2024-04-26T12:08:52.743855+0000","last_fullsized":"2024-04-26T12:08:52.743855+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:35.420647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":38065,"num_write":387,"num_write_kb":71445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"59'126","reported_seq":229,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744930+0000","last_change":"2024-04-26T12:08:39.702212+0000","last_active":"2024-04-26T12:08:52.744930+0000","last_peered":"2024-04-26T12:08:52.744930+0000","last_clean":"2024-04-26T12:08:52.744930+0000","last_became_active":"2024-04-26T12:08:39.701900+0000","last_became_peered":"2024-04-26T12:08:39.701900+0000","last_unstale":"2024-04-26T12:08:52.744930+0000","last_undegraded":"2024-04-26T12:08:52.744930+0000","last_fullsized":"2024-04-26T12:08:52.744930+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:28.460358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"60'448","reported_seq":548,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744703+0000","last_change":"2024-04-26T12:05:03.791827+0000","last_active":"2024-04-26T12:08:52.744703+0000","last_peered":"2024-04-26T12:08:52.744703+0000","last_clean":"2024-04-26T12:08:52.744703+0000","last_became_active":"2024-04-26T12:05:03.791442+0000","last_became_peered":"2024-04-26T12:05:03.791442+0000","last_unstale":"2024-04-26T12:08:52.744703+0000","last_undegraded":"2024-04-26T12:08:52.744703+0000","last_fullsized":"2024-04-26T12:08:52.744703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11191,"num_write":416,"num_write_kb":67272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"59'56","reported_seq":134,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744927+0000","last_change":"2024-04-26T12:05:03.430659+0000","last_active":"2024-04-26T12:08:52.744927+0000","last_peered":"2024-04-26T12:08:52.744927+0000","last_clean":"2024-04-26T12:08:52.744927+0000","last_became_active":"2024-04-26T12:05:03.430164+0000","last_became_peered":"2024-04-26T12:05:03.430164+0000","last_unstale":"2024-04-26T12:08:52.744927+0000","last_undegraded":"2024-04-26T12:08:52.744927+0000","last_fullsized":"2024-04-26T12:08:52.744927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2734,"num_read_kb":1486856,"num_write":24627,"num_write_kb":4487808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7440,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26722,"ondisk_log_size":26722,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128606591,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":5972,"num_write_kb":129691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64376832,"data_stored":257213182,"data_compressed":19249503,"data_compressed_allocated":31694848,"data_compressed_original":224591872,"omap_allocated":4411,"internal_metadata":0},"log_size":7828,"ondisk_log_size":7828,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738423,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134436,"kb_used_data":27092,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94237404,"statfs":{"total":96636764160,"available":96499101696,"internally_reserved":0,"allocated":27742208,"data_stored":91797602,"data_compressed":6340284,"data_compressed_allocated":11272192,"data_compressed_original":75763712,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:08:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.40899999999999997,"15min":0.439},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.39900000000000002,"15min":0.42599999999999999},"min":{"1min":0.19,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.51700000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Apr 26 12:05:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.436},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.41699999999999998}]}]},{"osd":1,"up_from":66,"seq":283467841543,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68516,"kb_used_data":10644,"kb_used_omap":5,"kb_used_meta":57850,"kb_avail":94303324,"statfs":{"total":96636764160,"available":96566603776,"internally_reserved":0,"allocated":10899456,"data_stored":86136667,"data_compressed":7182940,"data_compressed_allocated":10076160,"data_compressed_original":85745664,"omap_allocated":6005,"internal_metadata":59238539},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738423,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138888,"kb_used_data":27452,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232952,"statfs":{"total":96636764160,"available":96494542848,"internally_reserved":0,"allocated":28110848,"data_stored":81507786,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:05:55 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.443}]},{"osd":2,"last update":"Fri Apr 26 12:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42399999999999999,"15min":0.435},"min":{"1min":0.16200000000000001,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.433,"15min":0.433},"min":{"1min":0.20599999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.34999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27357184,"data_stored":81158407,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10088448,"data_stored":85196920,"data_compressed":7176942,"data_compressed_allocated":10039296,"data_compressed_original":85172224,"omap_allocated":4411,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26931200,"data_stored":90857855,"data_compressed":6334286,"data_compressed_allocated":11235328,"data_compressed_original":75190272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:09:03.459 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:09:03.792 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:09:03.792 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":84,"fsid":"5bc300ae-e948-4ce3-81bb-5abae8c06799","created":"2024-04-26T12:04:41.919527+0000","modified":"2024-04-26T12:08:53.741839+0000","last_up_change":"2024-04-26T12:08:35.679585+0000","last_in_change":"2024-04-26T12:04:43.540390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:04:52.376506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:04:57.775333+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:05:02.226064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:05:02.758806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"638cfa85-e921-4403-9bcb-a7f4653cc3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":28597},{"type":"v1","addr":"172.21.15.143:6801","nonce":28597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":28597},{"type":"v1","addr":"172.21.15.143:6803","nonce":28597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":28597},{"type":"v1","addr":"172.21.15.143:6807","nonce":28597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":28597},{"type":"v1","addr":"172.21.15.143:6805","nonce":28597}]},"public_addr":"172.21.15.143:6801/28597","cluster_addr":"172.21.15.143:6803/28597","heartbeat_back_addr":"172.21.15.143:6807/28597","heartbeat_front_addr":"172.21.15.143:6805/28597","state":["exists","up"]},{"osd":1,"uuid":"2abc8d1e-ad72-4643-ad1e-3566e5113c44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":37,"up_from":66,"up_thru":83,"down_at":38,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":5362},{"type":"v1","addr":"172.21.15.154:6801","nonce":5362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":5362},{"type":"v1","addr":"172.21.15.154:6803","nonce":5362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":5362},{"type":"v1","addr":"172.21.15.154:6807","nonce":5362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":5362},{"type":"v1","addr":"172.21.15.154:6805","nonce":5362}]},"public_addr":"172.21.15.154:6801/5362","cluster_addr":"172.21.15.154:6803/5362","heartbeat_back_addr":"172.21.15.154:6807/5362","heartbeat_front_addr":"172.21.15.154:6805/5362","state":["exists","up"]},{"osd":2,"uuid":"d2ebc562-cb9b-4089-a19b-1788b70b57dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":28709},{"type":"v1","addr":"172.21.15.164:6801","nonce":28709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":28709},{"type":"v1","addr":"172.21.15.164:6803","nonce":28709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":28709},{"type":"v1","addr":"172.21.15.164:6807","nonce":28709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":28709},{"type":"v1","addr":"172.21.15.164:6805","nonce":28709}]},"public_addr":"172.21.15.164:6801/28709","cluster_addr":"172.21.15.164:6803/28709","heartbeat_back_addr":"172.21.15.164:6807/28709","heartbeat_front_addr":"172.21.15.164:6805/28709","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.573478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.624482+0000","dead_epoch":37},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.615449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:09:04.806 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T12:09:04.806 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:09:04.941 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-26T12:09:04.941 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T12:09:04.942 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-26T12:09:04.952 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T12:09:05.244 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T12:09:05.257 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T12:09:05.258 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:09:05.382 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-26T12:09:05.383 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-04-26T12:09:05.383 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-26T12:09:05.393 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T12:09:05.683 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T12:09:05.696 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T12:09:05.697 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:09:05.822 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-26T12:09:05.823 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T12:09:05.823 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-26T12:09:05.833 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T12:09:06.124 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T12:09:06.137 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:09:06.432 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:09:06.434 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:09:06.444 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":210,"stamp":"2024-04-26T12:09:06.394926+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129196959,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2917,"num_read_kb":1488438,"num_write":30802,"num_write_kb":4620959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7463,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34707,"ondisk_log_size":34707,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":341840,"kb_used_data":65188,"kb_used_omap":8,"kb_used_meta":276599,"kb_avail":282773680,"statfs":{"total":289910292480,"available":289560248320,"internally_reserved":0,"allocated":66752512,"data_stored":259442055,"data_compressed":19261499,"data_compressed_allocated":31768576,"data_compressed_original":225738752,"omap_allocated":9193,"internal_metadata":283237399},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":505,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002795"},"pg_stats":[{"pgid":"4.3f","version":"60'426","reported_seq":507,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744715+0000","last_change":"2024-04-26T12:08:51.753936+0000","last_active":"2024-04-26T12:08:52.744715+0000","last_peered":"2024-04-26T12:08:52.744715+0000","last_clean":"2024-04-26T12:08:52.744715+0000","last_became_active":"2024-04-26T12:08:51.750917+0000","last_became_peered":"2024-04-26T12:08:51.750917+0000","last_unstale":"2024-04-26T12:08:52.744715+0000","last_undegraded":"2024-04-26T12:08:52.744715+0000","last_fullsized":"2024-04-26T12:08:52.744715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:21.716324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9964,"num_write":393,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"60'470","reported_seq":601,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744464+0000","last_change":"2024-04-26T12:08:43.719204+0000","last_active":"2024-04-26T12:08:52.744464+0000","last_peered":"2024-04-26T12:08:52.744464+0000","last_clean":"2024-04-26T12:08:52.744464+0000","last_became_active":"2024-04-26T12:08:43.717325+0000","last_became_peered":"2024-04-26T12:08:43.717325+0000","last_unstale":"2024-04-26T12:08:52.744464+0000","last_undegraded":"2024-04-26T12:08:52.744464+0000","last_fullsized":"2024-04-26T12:08:52.744464+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:57.396493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":34556,"num_write":444,"num_write_kb":129697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"60'370","reported_seq":802,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745315+0000","last_change":"2024-04-26T12:08:50.753639+0000","last_active":"2024-04-26T12:08:52.745315+0000","last_peered":"2024-04-26T12:08:52.745315+0000","last_clean":"2024-04-26T12:08:52.745315+0000","last_became_active":"2024-04-26T12:08:50.752468+0000","last_became_peered":"2024-04-26T12:08:50.752468+0000","last_unstale":"2024-04-26T12:08:52.745315+0000","last_undegraded":"2024-04-26T12:08:52.745315+0000","last_fullsized":"2024-04-26T12:08:52.745315+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:54.514768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":349,"num_write_kb":51115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"60'377","reported_seq":485,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745318+0000","last_change":"2024-04-26T12:05:03.791234+0000","last_active":"2024-04-26T12:08:52.745318+0000","last_peered":"2024-04-26T12:08:52.745318+0000","last_clean":"2024-04-26T12:08:52.745318+0000","last_became_active":"2024-04-26T12:05:03.790717+0000","last_became_peered":"2024-04-26T12:05:03.790717+0000","last_unstale":"2024-04-26T12:08:52.745318+0000","last_undegraded":"2024-04-26T12:08:52.745318+0000","last_fullsized":"2024-04-26T12:08:52.745318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:52.358881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17376,"num_write":341,"num_write_kb":46680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'445","reported_seq":550,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743965+0000","last_change":"2024-04-26T12:08:39.705318+0000","last_active":"2024-04-26T12:08:52.743965+0000","last_peered":"2024-04-26T12:08:52.743965+0000","last_clean":"2024-04-26T12:08:52.743965+0000","last_became_active":"2024-04-26T12:08:39.702117+0000","last_became_peered":"2024-04-26T12:08:39.702117+0000","last_unstale":"2024-04-26T12:08:52.743965+0000","last_undegraded":"2024-04-26T12:08:52.743965+0000","last_fullsized":"2024-04-26T12:08:52.743965+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:39.986313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24197,"num_write":416,"num_write_kb":80466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"60'375","reported_seq":470,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744643+0000","last_change":"2024-04-26T12:05:03.791560+0000","last_active":"2024-04-26T12:08:52.744643+0000","last_peered":"2024-04-26T12:08:52.744643+0000","last_clean":"2024-04-26T12:08:52.744643+0000","last_became_active":"2024-04-26T12:05:03.790578+0000","last_became_peered":"2024-04-26T12:05:03.790578+0000","last_unstale":"2024-04-26T12:08:52.744643+0000","last_undegraded":"2024-04-26T12:08:52.744643+0000","last_fullsized":"2024-04-26T12:08:52.744643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.663036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6518,"num_write":348,"num_write_kb":38078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'428","reported_seq":524,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744809+0000","last_change":"2024-04-26T12:05:03.791215+0000","last_active":"2024-04-26T12:08:52.744809+0000","last_peered":"2024-04-26T12:08:52.744809+0000","last_clean":"2024-04-26T12:08:52.744809+0000","last_became_active":"2024-04-26T12:05:03.790615+0000","last_became_peered":"2024-04-26T12:05:03.790615+0000","last_unstale":"2024-04-26T12:08:52.744809+0000","last_undegraded":"2024-04-26T12:08:52.744809+0000","last_fullsized":"2024-04-26T12:08:52.744809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:55.388027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12560,"num_write":398,"num_write_kb":67332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"60'387","reported_seq":526,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744454+0000","last_change":"2024-04-26T12:05:03.785861+0000","last_active":"2024-04-26T12:08:52.744454+0000","last_peered":"2024-04-26T12:08:52.744454+0000","last_clean":"2024-04-26T12:08:52.744454+0000","last_became_active":"2024-04-26T12:05:03.785382+0000","last_became_peered":"2024-04-26T12:05:03.785382+0000","last_unstale":"2024-04-26T12:08:52.744454+0000","last_undegraded":"2024-04-26T12:08:52.744454+0000","last_fullsized":"2024-04-26T12:08:52.744454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:51.870183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":41160,"num_write":356,"num_write_kb":80219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"60'405","reported_seq":901,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746094+0000","last_change":"2024-04-26T12:08:46.730220+0000","last_active":"2024-04-26T12:08:53.746094+0000","last_peered":"2024-04-26T12:08:53.746094+0000","last_clean":"2024-04-26T12:08:53.746094+0000","last_became_active":"2024-04-26T12:08:46.729039+0000","last_became_peered":"2024-04-26T12:08:46.729039+0000","last_unstale":"2024-04-26T12:08:53.746094+0000","last_undegraded":"2024-04-26T12:08:53.746094+0000","last_fullsized":"2024-04-26T12:08:53.746094+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":11674,"num_write":372,"num_write_kb":34604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"60'425","reported_seq":577,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744378+0000","last_change":"2024-04-26T12:08:41.718786+0000","last_active":"2024-04-26T12:08:52.744378+0000","last_peered":"2024-04-26T12:08:52.744378+0000","last_clean":"2024-04-26T12:08:52.744378+0000","last_became_active":"2024-04-26T12:08:41.716014+0000","last_became_peered":"2024-04-26T12:08:41.716014+0000","last_unstale":"2024-04-26T12:08:52.744378+0000","last_undegraded":"2024-04-26T12:08:52.744378+0000","last_fullsized":"2024-04-26T12:08:52.744378+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:20.096806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":48419,"num_write":390,"num_write_kb":92286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"60'372","reported_seq":489,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745403+0000","last_change":"2024-04-26T12:05:03.791046+0000","last_active":"2024-04-26T12:08:52.745403+0000","last_peered":"2024-04-26T12:08:52.745403+0000","last_clean":"2024-04-26T12:08:52.745403+0000","last_became_active":"2024-04-26T12:05:03.790662+0000","last_became_peered":"2024-04-26T12:05:03.790662+0000","last_unstale":"2024-04-26T12:08:52.745403+0000","last_undegraded":"2024-04-26T12:08:52.745403+0000","last_fullsized":"2024-04-26T12:08:52.745403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:35.458663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25905,"num_write":353,"num_write_kb":75437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'351","reported_seq":426,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744359+0000","last_change":"2024-04-26T12:08:41.718349+0000","last_active":"2024-04-26T12:08:52.744359+0000","last_peered":"2024-04-26T12:08:52.744359+0000","last_clean":"2024-04-26T12:08:52.744359+0000","last_became_active":"2024-04-26T12:08:41.715726+0000","last_became_peered":"2024-04-26T12:08:41.715726+0000","last_unstale":"2024-04-26T12:08:52.744359+0000","last_undegraded":"2024-04-26T12:08:52.744359+0000","last_fullsized":"2024-04-26T12:08:52.744359+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:00.589164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8884,"num_write":327,"num_write_kb":58289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"60'405","reported_seq":485,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744109+0000","last_change":"2024-04-26T12:08:39.705153+0000","last_active":"2024-04-26T12:08:52.744109+0000","last_peered":"2024-04-26T12:08:52.744109+0000","last_clean":"2024-04-26T12:08:52.744109+0000","last_became_active":"2024-04-26T12:08:39.702141+0000","last_became_peered":"2024-04-26T12:08:39.702141+0000","last_unstale":"2024-04-26T12:08:52.744109+0000","last_undegraded":"2024-04-26T12:08:52.744109+0000","last_fullsized":"2024-04-26T12:08:52.744109+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:42.807520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6771,"num_write":372,"num_write_kb":54786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"60'431","reported_seq":937,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745087+0000","last_change":"2024-04-26T12:08:48.741419+0000","last_active":"2024-04-26T12:08:52.745087+0000","last_peered":"2024-04-26T12:08:52.745087+0000","last_clean":"2024-04-26T12:08:52.745087+0000","last_became_active":"2024-04-26T12:08:48.740170+0000","last_became_peered":"2024-04-26T12:08:48.740170+0000","last_unstale":"2024-04-26T12:08:52.745087+0000","last_undegraded":"2024-04-26T12:08:52.745087+0000","last_fullsized":"2024-04-26T12:08:52.745087+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:52.026016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26572,"num_write":398,"num_write_kb":83974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'394","reported_seq":896,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744941+0000","last_change":"2024-04-26T12:08:41.717703+0000","last_active":"2024-04-26T12:08:52.744941+0000","last_peered":"2024-04-26T12:08:52.744941+0000","last_clean":"2024-04-26T12:08:52.744941+0000","last_became_active":"2024-04-26T12:08:41.715956+0000","last_became_peered":"2024-04-26T12:08:41.715956+0000","last_unstale":"2024-04-26T12:08:52.744941+0000","last_undegraded":"2024-04-26T12:08:52.744941+0000","last_fullsized":"2024-04-26T12:08:52.744941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:34.291197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":38136,"num_write":355,"num_write_kb":38484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'432","reported_seq":543,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744458+0000","last_change":"2024-04-26T12:05:03.786360+0000","last_active":"2024-04-26T12:08:52.744458+0000","last_peered":"2024-04-26T12:08:52.744458+0000","last_clean":"2024-04-26T12:08:52.744458+0000","last_became_active":"2024-04-26T12:05:03.785991+0000","last_became_peered":"2024-04-26T12:05:03.785991+0000","last_unstale":"2024-04-26T12:08:52.744458+0000","last_undegraded":"2024-04-26T12:08:52.744458+0000","last_fullsized":"2024-04-26T12:08:52.744458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:17.702068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18244,"num_write":400,"num_write_kb":59033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'381","reported_seq":839,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746595+0000","last_change":"2024-04-26T12:08:52.747060+0000","last_active":"2024-04-26T12:08:53.746595+0000","last_peered":"2024-04-26T12:08:53.746595+0000","last_clean":"2024-04-26T12:08:53.746595+0000","last_became_active":"2024-04-26T12:08:52.745913+0000","last_became_peered":"2024-04-26T12:08:52.745913+0000","last_unstale":"2024-04-26T12:08:53.746595+0000","last_undegraded":"2024-04-26T12:08:53.746595+0000","last_fullsized":"2024-04-26T12:08:53.746595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":350,"num_write_kb":21212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"60'424","reported_seq":514,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744398+0000","last_change":"2024-04-26T12:08:42.718639+0000","last_active":"2024-04-26T12:08:52.744398+0000","last_peered":"2024-04-26T12:08:52.744398+0000","last_clean":"2024-04-26T12:08:52.744398+0000","last_became_active":"2024-04-26T12:08:42.716846+0000","last_became_peered":"2024-04-26T12:08:42.716846+0000","last_unstale":"2024-04-26T12:08:52.744398+0000","last_undegraded":"2024-04-26T12:08:52.744398+0000","last_fullsized":"2024-04-26T12:08:52.744398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:00.928679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13930,"num_write":388,"num_write_kb":116055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'426","reported_seq":906,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.748906+0000","last_change":"2024-04-26T12:08:53.748530+0000","last_active":"2024-04-26T12:08:53.748906+0000","last_peered":"2024-04-26T12:08:53.748906+0000","last_clean":"2024-04-26T12:08:53.748906+0000","last_became_active":"2024-04-26T12:08:53.747215+0000","last_became_peered":"2024-04-26T12:08:53.747215+0000","last_unstale":"2024-04-26T12:08:53.748906+0000","last_undegraded":"2024-04-26T12:08:53.748906+0000","last_fullsized":"2024-04-26T12:08:53.748906+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26908,"num_write":383,"num_write_kb":71324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"60'425","reported_seq":546,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745178+0000","last_change":"2024-04-26T12:05:03.792219+0000","last_active":"2024-04-26T12:08:52.745178+0000","last_peered":"2024-04-26T12:08:52.745178+0000","last_clean":"2024-04-26T12:08:52.745178+0000","last_became_active":"2024-04-26T12:05:03.791061+0000","last_became_peered":"2024-04-26T12:05:03.791061+0000","last_unstale":"2024-04-26T12:08:52.745178+0000","last_undegraded":"2024-04-26T12:08:52.745178+0000","last_fullsized":"2024-04-26T12:08:52.745178+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:26.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19715,"num_write":398,"num_write_kb":30150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'450","reported_seq":638,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745086+0000","last_change":"2024-04-26T12:05:03.792073+0000","last_active":"2024-04-26T12:08:52.745086+0000","last_peered":"2024-04-26T12:08:52.745086+0000","last_clean":"2024-04-26T12:08:52.745086+0000","last_became_active":"2024-04-26T12:05:03.791693+0000","last_became_peered":"2024-04-26T12:05:03.791693+0000","last_unstale":"2024-04-26T12:08:52.745086+0000","last_undegraded":"2024-04-26T12:08:52.745086+0000","last_fullsized":"2024-04-26T12:08:52.745086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:18.683450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":65124,"num_write":423,"num_write_kb":142714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'434","reported_seq":538,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744125+0000","last_change":"2024-04-26T12:08:46.730582+0000","last_active":"2024-04-26T12:08:52.744125+0000","last_peered":"2024-04-26T12:08:52.744125+0000","last_clean":"2024-04-26T12:08:52.744125+0000","last_became_active":"2024-04-26T12:08:46.728804+0000","last_became_peered":"2024-04-26T12:08:46.728804+0000","last_unstale":"2024-04-26T12:08:52.744125+0000","last_undegraded":"2024-04-26T12:08:52.744125+0000","last_fullsized":"2024-04-26T12:08:52.744125+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:47.745435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":15350,"num_write":405,"num_write_kb":59295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"60'424","reported_seq":538,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745307+0000","last_change":"2024-04-26T12:05:03.788658+0000","last_active":"2024-04-26T12:08:53.745307+0000","last_peered":"2024-04-26T12:08:53.745307+0000","last_clean":"2024-04-26T12:08:53.745307+0000","last_became_active":"2024-04-26T12:05:03.788050+0000","last_became_peered":"2024-04-26T12:05:03.788050+0000","last_unstale":"2024-04-26T12:08:53.745307+0000","last_undegraded":"2024-04-26T12:08:53.745307+0000","last_fullsized":"2024-04-26T12:08:53.745307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23772,"num_write":390,"num_write_kb":67944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"60'447","reported_seq":526,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743819+0000","last_change":"2024-04-26T12:08:40.707153+0000","last_active":"2024-04-26T12:08:52.743819+0000","last_peered":"2024-04-26T12:08:52.743819+0000","last_clean":"2024-04-26T12:08:52.743819+0000","last_became_active":"2024-04-26T12:08:40.703880+0000","last_became_peered":"2024-04-26T12:08:40.703880+0000","last_unstale":"2024-04-26T12:08:52.743819+0000","last_undegraded":"2024-04-26T12:08:52.743819+0000","last_fullsized":"2024-04-26T12:08:52.743819+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:25.187022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9403,"num_write":417,"num_write_kb":67425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"60'417","reported_seq":507,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744515+0000","last_change":"2024-04-26T12:08:42.717934+0000","last_active":"2024-04-26T12:08:52.744515+0000","last_peered":"2024-04-26T12:08:52.744515+0000","last_clean":"2024-04-26T12:08:52.744515+0000","last_became_active":"2024-04-26T12:08:42.715812+0000","last_became_peered":"2024-04-26T12:08:42.715812+0000","last_unstale":"2024-04-26T12:08:52.744515+0000","last_undegraded":"2024-04-26T12:08:52.744515+0000","last_fullsized":"2024-04-26T12:08:52.744515+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:09.442852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20466,"num_write":400,"num_write_kb":42225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"60'475","reported_seq":605,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746257+0000","last_change":"2024-04-26T12:05:03.787909+0000","last_active":"2024-04-26T12:08:53.746257+0000","last_peered":"2024-04-26T12:08:53.746257+0000","last_clean":"2024-04-26T12:08:53.746257+0000","last_became_active":"2024-04-26T12:05:03.787562+0000","last_became_peered":"2024-04-26T12:05:03.787562+0000","last_unstale":"2024-04-26T12:08:53.746257+0000","last_undegraded":"2024-04-26T12:08:53.746257+0000","last_fullsized":"2024-04-26T12:08:53.746257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25186,"num_write":431,"num_write_kb":48184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"60'409","reported_seq":897,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745514+0000","last_change":"2024-04-26T12:08:49.741823+0000","last_active":"2024-04-26T12:08:52.745514+0000","last_peered":"2024-04-26T12:08:52.745514+0000","last_clean":"2024-04-26T12:08:52.745514+0000","last_became_active":"2024-04-26T12:08:49.740497+0000","last_became_peered":"2024-04-26T12:08:49.740497+0000","last_unstale":"2024-04-26T12:08:52.745514+0000","last_undegraded":"2024-04-26T12:08:52.745514+0000","last_fullsized":"2024-04-26T12:08:52.745514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:00.225872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":20137,"num_write":374,"num_write_kb":55441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'392","reported_seq":493,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744357+0000","last_change":"2024-04-26T12:08:47.737270+0000","last_active":"2024-04-26T12:08:52.744357+0000","last_peered":"2024-04-26T12:08:52.744357+0000","last_clean":"2024-04-26T12:08:52.744357+0000","last_became_active":"2024-04-26T12:08:47.735361+0000","last_became_peered":"2024-04-26T12:08:47.735361+0000","last_unstale":"2024-04-26T12:08:52.744357+0000","last_undegraded":"2024-04-26T12:08:52.744357+0000","last_fullsized":"2024-04-26T12:08:52.744357+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:09.838696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29179,"num_write":355,"num_write_kb":59011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'380","reported_seq":841,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746018+0000","last_change":"2024-04-26T12:08:41.717953+0000","last_active":"2024-04-26T12:08:53.746018+0000","last_peered":"2024-04-26T12:08:53.746018+0000","last_clean":"2024-04-26T12:08:53.746018+0000","last_became_active":"2024-04-26T12:08:41.716234+0000","last_became_peered":"2024-04-26T12:08:41.716234+0000","last_unstale":"2024-04-26T12:08:53.746018+0000","last_undegraded":"2024-04-26T12:08:53.746018+0000","last_fullsized":"2024-04-26T12:08:53.746018+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13036,"num_write":347,"num_write_kb":33880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"60'461","reported_seq":565,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744026+0000","last_change":"2024-04-26T12:08:46.732653+0000","last_active":"2024-04-26T12:08:52.744026+0000","last_peered":"2024-04-26T12:08:52.744026+0000","last_clean":"2024-04-26T12:08:52.744026+0000","last_became_active":"2024-04-26T12:08:46.730738+0000","last_became_peered":"2024-04-26T12:08:46.730738+0000","last_unstale":"2024-04-26T12:08:52.744026+0000","last_undegraded":"2024-04-26T12:08:52.744026+0000","last_fullsized":"2024-04-26T12:08:52.744026+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:46.177056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":32945,"num_write":426,"num_write_kb":63234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"60'411","reported_seq":902,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745351+0000","last_change":"2024-04-26T12:08:40.704958+0000","last_active":"2024-04-26T12:08:53.745351+0000","last_peered":"2024-04-26T12:08:53.745351+0000","last_clean":"2024-04-26T12:08:53.745351+0000","last_became_active":"2024-04-26T12:08:40.703845+0000","last_became_peered":"2024-04-26T12:08:40.703845+0000","last_unstale":"2024-04-26T12:08:53.745351+0000","last_undegraded":"2024-04-26T12:08:53.745351+0000","last_fullsized":"2024-04-26T12:08:53.745351+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11499,"num_write":377,"num_write_kb":34249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'430","reported_seq":538,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744573+0000","last_change":"2024-04-26T12:05:03.791605+0000","last_active":"2024-04-26T12:08:52.744573+0000","last_peered":"2024-04-26T12:08:52.744573+0000","last_clean":"2024-04-26T12:08:52.744573+0000","last_became_active":"2024-04-26T12:05:03.791251+0000","last_became_peered":"2024-04-26T12:05:03.791251+0000","last_unstale":"2024-04-26T12:08:52.744573+0000","last_undegraded":"2024-04-26T12:08:52.744573+0000","last_fullsized":"2024-04-26T12:08:52.744573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:27.239868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14660,"num_write":404,"num_write_kb":60840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"60'392","reported_seq":500,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744114+0000","last_change":"2024-04-26T12:08:44.723861+0000","last_active":"2024-04-26T12:08:52.744114+0000","last_peered":"2024-04-26T12:08:52.744114+0000","last_clean":"2024-04-26T12:08:52.744114+0000","last_became_active":"2024-04-26T12:08:44.722120+0000","last_became_peered":"2024-04-26T12:08:44.722120+0000","last_unstale":"2024-04-26T12:08:52.744114+0000","last_undegraded":"2024-04-26T12:08:52.744114+0000","last_fullsized":"2024-04-26T12:08:52.744114+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:12.810713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31703,"num_write":351,"num_write_kb":59324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"59'514","reported_seq":592,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745155+0000","last_change":"2024-04-26T12:05:03.430021+0000","last_active":"2024-04-26T12:08:52.745155+0000","last_peered":"2024-04-26T12:08:52.745155+0000","last_clean":"2024-04-26T12:08:52.745155+0000","last_became_active":"2024-04-26T12:05:03.429695+0000","last_became_peered":"2024-04-26T12:05:03.429695+0000","last_unstale":"2024-04-26T12:08:52.745155+0000","last_undegraded":"2024-04-26T12:08:52.745155+0000","last_fullsized":"2024-04-26T12:08:52.745155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.851184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":8377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'432","reported_seq":522,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.751086+0000","last_change":"2024-04-26T12:08:53.751086+0000","last_active":"2024-04-26T12:08:53.751086+0000","last_peered":"2024-04-26T12:08:53.751086+0000","last_clean":"2024-04-26T12:08:53.751086+0000","last_became_active":"2024-04-26T12:08:53.748972+0000","last_became_peered":"2024-04-26T12:08:53.748972+0000","last_unstale":"2024-04-26T12:08:53.751086+0000","last_undegraded":"2024-04-26T12:08:53.751086+0000","last_fullsized":"2024-04-26T12:08:53.751086+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:34.448806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":30094,"num_write":388,"num_write_kb":83741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"59'55","reported_seq":134,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745634+0000","last_change":"2024-04-26T12:05:03.428605+0000","last_active":"2024-04-26T12:08:53.745634+0000","last_peered":"2024-04-26T12:08:53.745634+0000","last_clean":"2024-04-26T12:08:53.745634+0000","last_became_active":"2024-04-26T12:05:03.428098+0000","last_became_peered":"2024-04-26T12:05:03.428098+0000","last_unstale":"2024-04-26T12:08:53.745634+0000","last_undegraded":"2024-04-26T12:08:53.745634+0000","last_fullsized":"2024-04-26T12:08:53.745634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"60'445","reported_seq":558,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746416+0000","last_change":"2024-04-26T12:05:03.788568+0000","last_active":"2024-04-26T12:08:53.746416+0000","last_peered":"2024-04-26T12:08:53.746416+0000","last_clean":"2024-04-26T12:08:53.746416+0000","last_became_active":"2024-04-26T12:05:03.788039+0000","last_became_peered":"2024-04-26T12:05:03.788039+0000","last_unstale":"2024-04-26T12:08:53.746416+0000","last_undegraded":"2024-04-26T12:08:53.746416+0000","last_fullsized":"2024-04-26T12:08:53.746416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":16079,"num_write":410,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"59'64","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743891+0000","last_change":"2024-04-26T12:08:36.696166+0000","last_active":"2024-04-26T12:08:52.743891+0000","last_peered":"2024-04-26T12:08:52.743891+0000","last_clean":"2024-04-26T12:08:52.743891+0000","last_became_active":"2024-04-26T12:08:36.694921+0000","last_became_peered":"2024-04-26T12:08:36.694921+0000","last_unstale":"2024-04-26T12:08:52.743891+0000","last_undegraded":"2024-04-26T12:08:52.743891+0000","last_fullsized":"2024-04-26T12:08:52.743891+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:57.438892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"60'420","reported_seq":538,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746363+0000","last_change":"2024-04-26T12:05:03.788505+0000","last_active":"2024-04-26T12:08:53.746363+0000","last_peered":"2024-04-26T12:08:53.746363+0000","last_clean":"2024-04-26T12:08:53.746363+0000","last_became_active":"2024-04-26T12:05:03.788184+0000","last_became_peered":"2024-04-26T12:05:03.788184+0000","last_unstale":"2024-04-26T12:08:53.746363+0000","last_undegraded":"2024-04-26T12:08:53.746363+0000","last_fullsized":"2024-04-26T12:08:53.746363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":14666,"num_write":383,"num_write_kb":83769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"60'63","reported_seq":155,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744615+0000","last_change":"2024-04-26T12:08:36.697126+0000","last_active":"2024-04-26T12:08:52.744615+0000","last_peered":"2024-04-26T12:08:52.744615+0000","last_clean":"2024-04-26T12:08:52.744615+0000","last_became_active":"2024-04-26T12:08:36.696792+0000","last_became_peered":"2024-04-26T12:08:36.696792+0000","last_unstale":"2024-04-26T12:08:52.744615+0000","last_undegraded":"2024-04-26T12:08:52.744615+0000","last_fullsized":"2024-04-26T12:08:52.744615+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:48.447882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"59'232","reported_seq":335,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745720+0000","last_change":"2024-04-26T12:08:39.703810+0000","last_active":"2024-04-26T12:08:52.745720+0000","last_peered":"2024-04-26T12:08:52.745720+0000","last_clean":"2024-04-26T12:08:52.745720+0000","last_became_active":"2024-04-26T12:08:39.703455+0000","last_became_peered":"2024-04-26T12:08:39.703455+0000","last_unstale":"2024-04-26T12:08:52.745720+0000","last_undegraded":"2024-04-26T12:08:52.745720+0000","last_fullsized":"2024-04-26T12:08:52.745720+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:08.399237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'408","reported_seq":491,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743999+0000","last_change":"2024-04-26T12:08:40.710236+0000","last_active":"2024-04-26T12:08:52.743999+0000","last_peered":"2024-04-26T12:08:52.743999+0000","last_clean":"2024-04-26T12:08:52.743999+0000","last_became_active":"2024-04-26T12:08:40.707357+0000","last_became_peered":"2024-04-26T12:08:40.707357+0000","last_unstale":"2024-04-26T12:08:52.743999+0000","last_undegraded":"2024-04-26T12:08:52.743999+0000","last_fullsized":"2024-04-26T12:08:52.743999+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:17.928748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12418,"num_write":371,"num_write_kb":58378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"59'302","reported_seq":370,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744280+0000","last_change":"2024-04-26T12:08:39.703949+0000","last_active":"2024-04-26T12:08:52.744280+0000","last_peered":"2024-04-26T12:08:52.744280+0000","last_clean":"2024-04-26T12:08:52.744280+0000","last_became_active":"2024-04-26T12:08:39.703421+0000","last_became_peered":"2024-04-26T12:08:39.703421+0000","last_unstale":"2024-04-26T12:08:52.744280+0000","last_undegraded":"2024-04-26T12:08:52.744280+0000","last_fullsized":"2024-04-26T12:08:52.744280+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:10.222074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":4228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'439","reported_seq":498,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743713+0000","last_change":"2024-04-26T12:08:41.717923+0000","last_active":"2024-04-26T12:08:52.743713+0000","last_peered":"2024-04-26T12:08:52.743713+0000","last_clean":"2024-04-26T12:08:52.743713+0000","last_became_active":"2024-04-26T12:08:41.715708+0000","last_became_peered":"2024-04-26T12:08:41.715708+0000","last_unstale":"2024-04-26T12:08:52.743713+0000","last_undegraded":"2024-04-26T12:08:52.743713+0000","last_fullsized":"2024-04-26T12:08:52.743713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:23.646558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":30851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"59'589","reported_seq":692,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745816+0000","last_change":"2024-04-26T12:08:39.703966+0000","last_active":"2024-04-26T12:08:52.745816+0000","last_peered":"2024-04-26T12:08:52.745816+0000","last_clean":"2024-04-26T12:08:52.745816+0000","last_became_active":"2024-04-26T12:08:39.703487+0000","last_became_peered":"2024-04-26T12:08:39.703487+0000","last_unstale":"2024-04-26T12:08:52.745816+0000","last_undegraded":"2024-04-26T12:08:52.745816+0000","last_fullsized":"2024-04-26T12:08:52.745816+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:06.112476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":534,"num_write_kb":4333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'461","reported_seq":614,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744817+0000","last_change":"2024-04-26T12:05:03.791809+0000","last_active":"2024-04-26T12:08:52.744817+0000","last_peered":"2024-04-26T12:08:52.744817+0000","last_clean":"2024-04-26T12:08:52.744817+0000","last_became_active":"2024-04-26T12:05:03.791272+0000","last_became_peered":"2024-04-26T12:05:03.791272+0000","last_unstale":"2024-04-26T12:08:52.744817+0000","last_undegraded":"2024-04-26T12:08:52.744817+0000","last_fullsized":"2024-04-26T12:08:52.744817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:46.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":46123,"num_write":422,"num_write_kb":104552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'66","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745499+0000","last_change":"2024-04-26T12:05:03.430224+0000","last_active":"2024-04-26T12:08:52.745499+0000","last_peered":"2024-04-26T12:08:52.745499+0000","last_clean":"2024-04-26T12:08:52.745499+0000","last_became_active":"2024-04-26T12:05:03.429291+0000","last_became_peered":"2024-04-26T12:05:03.429291+0000","last_unstale":"2024-04-26T12:08:52.745499+0000","last_undegraded":"2024-04-26T12:08:52.745499+0000","last_fullsized":"2024-04-26T12:08:52.745499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'428","reported_seq":542,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745787+0000","last_change":"2024-04-26T12:05:03.788174+0000","last_active":"2024-04-26T12:08:53.745787+0000","last_peered":"2024-04-26T12:08:53.745787+0000","last_clean":"2024-04-26T12:08:53.745787+0000","last_became_active":"2024-04-26T12:05:03.787772+0000","last_became_peered":"2024-04-26T12:05:03.787772+0000","last_unstale":"2024-04-26T12:08:53.745787+0000","last_undegraded":"2024-04-26T12:08:53.745787+0000","last_fullsized":"2024-04-26T12:08:53.745787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15098,"num_write":394,"num_write_kb":42677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"59'195","reported_seq":274,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746542+0000","last_change":"2024-04-26T12:05:03.431162+0000","last_active":"2024-04-26T12:08:53.746542+0000","last_peered":"2024-04-26T12:08:53.746542+0000","last_clean":"2024-04-26T12:08:53.746542+0000","last_became_active":"2024-04-26T12:05:03.430855+0000","last_became_peered":"2024-04-26T12:05:03.430855+0000","last_unstale":"2024-04-26T12:08:53.746542+0000","last_undegraded":"2024-04-26T12:08:53.746542+0000","last_fullsized":"2024-04-26T12:08:53.746542+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"60'448","reported_seq":544,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745298+0000","last_change":"2024-04-26T12:05:03.792357+0000","last_active":"2024-04-26T12:08:52.745298+0000","last_peered":"2024-04-26T12:08:52.745298+0000","last_clean":"2024-04-26T12:08:52.745298+0000","last_became_active":"2024-04-26T12:05:03.792119+0000","last_became_peered":"2024-04-26T12:05:03.792119+0000","last_unstale":"2024-04-26T12:08:52.745298+0000","last_undegraded":"2024-04-26T12:08:52.745298+0000","last_fullsized":"2024-04-26T12:08:52.745298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:56.766745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":13281,"num_write":420,"num_write_kb":59540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"59'171","reported_seq":249,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745146+0000","last_change":"2024-04-26T12:05:03.429811+0000","last_active":"2024-04-26T12:08:52.745146+0000","last_peered":"2024-04-26T12:08:52.745146+0000","last_clean":"2024-04-26T12:08:52.745146+0000","last_became_active":"2024-04-26T12:05:03.429469+0000","last_became_peered":"2024-04-26T12:05:03.429469+0000","last_unstale":"2024-04-26T12:08:52.745146+0000","last_undegraded":"2024-04-26T12:08:52.745146+0000","last_fullsized":"2024-04-26T12:08:52.745146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.834529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'412","reported_seq":923,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745698+0000","last_change":"2024-04-26T12:08:51.752350+0000","last_active":"2024-04-26T12:08:52.745698+0000","last_peered":"2024-04-26T12:08:52.745698+0000","last_clean":"2024-04-26T12:08:52.745698+0000","last_became_active":"2024-04-26T12:08:51.751044+0000","last_became_peered":"2024-04-26T12:08:51.751044+0000","last_unstale":"2024-04-26T12:08:52.745698+0000","last_undegraded":"2024-04-26T12:08:52.745698+0000","last_fullsized":"2024-04-26T12:08:52.745698+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:40.008727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26310,"num_write":380,"num_write_kb":38462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"59'55","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743708+0000","last_change":"2024-04-26T12:08:36.695355+0000","last_active":"2024-04-26T12:08:52.743708+0000","last_peered":"2024-04-26T12:08:52.743708+0000","last_clean":"2024-04-26T12:08:52.743708+0000","last_became_active":"2024-04-26T12:08:36.694346+0000","last_became_peered":"2024-04-26T12:08:36.694346+0000","last_unstale":"2024-04-26T12:08:52.743708+0000","last_undegraded":"2024-04-26T12:08:52.743708+0000","last_fullsized":"2024-04-26T12:08:52.743708+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:42.458073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"60'362","reported_seq":817,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745440+0000","last_change":"2024-04-26T12:08:41.717048+0000","last_active":"2024-04-26T12:08:52.745440+0000","last_peered":"2024-04-26T12:08:52.745440+0000","last_clean":"2024-04-26T12:08:52.745440+0000","last_became_active":"2024-04-26T12:08:41.716102+0000","last_became_peered":"2024-04-26T12:08:41.716102+0000","last_unstale":"2024-04-26T12:08:52.745440+0000","last_undegraded":"2024-04-26T12:08:52.745440+0000","last_fullsized":"2024-04-26T12:08:52.745440+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:52.409548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21408,"num_write":333,"num_write_kb":66549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"59'378","reported_seq":439,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743919+0000","last_change":"2024-04-26T12:08:39.702797+0000","last_active":"2024-04-26T12:08:52.743919+0000","last_peered":"2024-04-26T12:08:52.743919+0000","last_clean":"2024-04-26T12:08:52.743919+0000","last_became_active":"2024-04-26T12:08:39.702438+0000","last_became_peered":"2024-04-26T12:08:39.702438+0000","last_unstale":"2024-04-26T12:08:52.743919+0000","last_undegraded":"2024-04-26T12:08:52.743919+0000","last_fullsized":"2024-04-26T12:08:52.743919+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:06.278304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"60'407","reported_seq":918,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746198+0000","last_change":"2024-04-26T12:08:45.724853+0000","last_active":"2024-04-26T12:08:53.746198+0000","last_peered":"2024-04-26T12:08:53.746198+0000","last_clean":"2024-04-26T12:08:53.746198+0000","last_became_active":"2024-04-26T12:08:45.723772+0000","last_became_peered":"2024-04-26T12:08:45.723772+0000","last_unstale":"2024-04-26T12:08:53.746198+0000","last_undegraded":"2024-04-26T12:08:53.746198+0000","last_fullsized":"2024-04-26T12:08:53.746198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":40156,"num_write":373,"num_write_kb":91285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":294,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745711+0000","last_change":"2024-04-26T12:08:36.697892+0000","last_active":"2024-04-26T12:08:53.745711+0000","last_peered":"2024-04-26T12:08:53.745711+0000","last_clean":"2024-04-26T12:08:53.745711+0000","last_became_active":"2024-04-26T12:08:36.697508+0000","last_became_peered":"2024-04-26T12:08:36.697508+0000","last_unstale":"2024-04-26T12:08:53.745711+0000","last_undegraded":"2024-04-26T12:08:53.745711+0000","last_fullsized":"2024-04-26T12:08:53.745711+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_clean_scrub_stamp":"2024-04-26T12:04:52.376986+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:24.384180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745283+0000","last_change":"2024-04-26T12:04:59.403711+0000","last_active":"2024-04-26T12:08:52.745283+0000","last_peered":"2024-04-26T12:08:52.745283+0000","last_clean":"2024-04-26T12:08:52.745283+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:08:52.745283+0000","last_undegraded":"2024-04-26T12:08:52.745283+0000","last_fullsized":"2024-04-26T12:08:52.745283+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:45.779614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'793","reported_seq":898,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745753+0000","last_change":"2024-04-26T12:08:39.702225+0000","last_active":"2024-04-26T12:08:53.745753+0000","last_peered":"2024-04-26T12:08:53.745753+0000","last_clean":"2024-04-26T12:08:53.745753+0000","last_became_active":"2024-04-26T12:08:39.701760+0000","last_became_peered":"2024-04-26T12:08:39.701760+0000","last_unstale":"2024-04-26T12:08:53.745753+0000","last_undegraded":"2024-04-26T12:08:53.745753+0000","last_fullsized":"2024-04-26T12:08:53.745753+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":8533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"60'466","reported_seq":1012,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.747878+0000","last_change":"2024-04-26T12:08:52.747463+0000","last_active":"2024-04-26T12:08:52.747878+0000","last_peered":"2024-04-26T12:08:52.747878+0000","last_clean":"2024-04-26T12:08:52.747878+0000","last_became_active":"2024-04-26T12:08:52.746147+0000","last_became_peered":"2024-04-26T12:08:52.746147+0000","last_unstale":"2024-04-26T12:08:52.747878+0000","last_undegraded":"2024-04-26T12:08:52.747878+0000","last_fullsized":"2024-04-26T12:08:52.747878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:21.517395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":37547,"num_write":422,"num_write_kb":96579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":95,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745616+0000","last_change":"2024-04-26T12:08:36.695759+0000","last_active":"2024-04-26T12:08:53.745616+0000","last_peered":"2024-04-26T12:08:53.745616+0000","last_clean":"2024-04-26T12:08:53.745616+0000","last_became_active":"2024-04-26T12:08:36.695444+0000","last_became_peered":"2024-04-26T12:08:36.695444+0000","last_unstale":"2024-04-26T12:08:53.745616+0000","last_undegraded":"2024-04-26T12:08:53.745616+0000","last_fullsized":"2024-04-26T12:08:53.745616+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:22.343369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"60'114","reported_seq":240,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745587+0000","last_change":"2024-04-26T12:05:03.428547+0000","last_active":"2024-04-26T12:08:53.745587+0000","last_peered":"2024-04-26T12:08:53.745587+0000","last_clean":"2024-04-26T12:08:53.745587+0000","last_became_active":"2024-04-26T12:05:03.427985+0000","last_became_peered":"2024-04-26T12:05:03.427985+0000","last_unstale":"2024-04-26T12:08:53.745587+0000","last_undegraded":"2024-04-26T12:08:53.745587+0000","last_fullsized":"2024-04-26T12:08:53.745587+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466015,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":47,"num_write_kb":1464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"60'492","reported_seq":655,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744496+0000","last_change":"2024-04-26T12:08:49.741650+0000","last_active":"2024-04-26T12:08:52.744496+0000","last_peered":"2024-04-26T12:08:52.744496+0000","last_clean":"2024-04-26T12:08:52.744496+0000","last_became_active":"2024-04-26T12:08:49.739496+0000","last_became_peered":"2024-04-26T12:08:49.739496+0000","last_unstale":"2024-04-26T12:08:52.744496+0000","last_undegraded":"2024-04-26T12:08:52.744496+0000","last_fullsized":"2024-04-26T12:08:52.744496+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:55.361224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":63988,"num_write":466,"num_write_kb":154489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":95,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745921+0000","last_change":"2024-04-26T12:08:36.696858+0000","last_active":"2024-04-26T12:08:53.745921+0000","last_peered":"2024-04-26T12:08:53.745921+0000","last_clean":"2024-04-26T12:08:53.745921+0000","last_became_active":"2024-04-26T12:08:36.696619+0000","last_became_peered":"2024-04-26T12:08:36.696619+0000","last_unstale":"2024-04-26T12:08:53.745921+0000","last_undegraded":"2024-04-26T12:08:53.745921+0000","last_fullsized":"2024-04-26T12:08:53.745921+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"59'325","reported_seq":386,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743649+0000","last_change":"2024-04-26T12:08:39.704052+0000","last_active":"2024-04-26T12:08:52.743649+0000","last_peered":"2024-04-26T12:08:52.743649+0000","last_clean":"2024-04-26T12:08:52.743649+0000","last_became_active":"2024-04-26T12:08:39.703696+0000","last_became_peered":"2024-04-26T12:08:39.703696+0000","last_unstale":"2024-04-26T12:08:52.743649+0000","last_undegraded":"2024-04-26T12:08:52.743649+0000","last_fullsized":"2024-04-26T12:08:52.743649+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:21:44.069244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":8296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"60'359","reported_seq":786,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746273+0000","last_change":"2024-04-26T12:08:47.737443+0000","last_active":"2024-04-26T12:08:53.746273+0000","last_peered":"2024-04-26T12:08:53.746273+0000","last_clean":"2024-04-26T12:08:53.746273+0000","last_became_active":"2024-04-26T12:08:47.735729+0000","last_became_peered":"2024-04-26T12:08:47.735729+0000","last_unstale":"2024-04-26T12:08:53.746273+0000","last_undegraded":"2024-04-26T12:08:53.746273+0000","last_fullsized":"2024-04-26T12:08:53.746273+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9448,"num_write":336,"num_write_kb":74900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745246+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:08:52.745246+0000","last_peered":"2024-04-26T12:08:52.745246+0000","last_clean":"2024-04-26T12:08:52.745246+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:08:52.745246+0000","last_undegraded":"2024-04-26T12:08:52.745246+0000","last_fullsized":"2024-04-26T12:08:52.745246+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:12.939539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"59'67","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745292+0000","last_change":"2024-04-26T12:05:03.430140+0000","last_active":"2024-04-26T12:08:52.745292+0000","last_peered":"2024-04-26T12:08:52.745292+0000","last_clean":"2024-04-26T12:08:52.745292+0000","last_became_active":"2024-04-26T12:05:03.429838+0000","last_became_peered":"2024-04-26T12:05:03.429838+0000","last_unstale":"2024-04-26T12:08:52.745292+0000","last_undegraded":"2024-04-26T12:08:52.745292+0000","last_fullsized":"2024-04-26T12:08:52.745292+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.367036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"60'403","reported_seq":895,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746097+0000","last_change":"2024-04-26T12:08:50.753437+0000","last_active":"2024-04-26T12:08:53.746097+0000","last_peered":"2024-04-26T12:08:53.746097+0000","last_clean":"2024-04-26T12:08:53.746097+0000","last_became_active":"2024-04-26T12:08:50.752366+0000","last_became_peered":"2024-04-26T12:08:50.752366+0000","last_unstale":"2024-04-26T12:08:53.746097+0000","last_undegraded":"2024-04-26T12:08:53.746097+0000","last_fullsized":"2024-04-26T12:08:53.746097+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30094,"num_write":370,"num_write_kb":104181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"59'469","reported_seq":547,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745818+0000","last_change":"2024-04-26T12:05:03.429673+0000","last_active":"2024-04-26T12:08:52.745818+0000","last_peered":"2024-04-26T12:08:52.745818+0000","last_clean":"2024-04-26T12:08:52.745818+0000","last_became_active":"2024-04-26T12:05:03.429146+0000","last_became_peered":"2024-04-26T12:05:03.429146+0000","last_unstale":"2024-04-26T12:08:52.745818+0000","last_undegraded":"2024-04-26T12:08:52.745818+0000","last_fullsized":"2024-04-26T12:08:52.745818+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:20.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":95,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746212+0000","last_change":"2024-04-26T12:08:36.697900+0000","last_active":"2024-04-26T12:08:53.746212+0000","last_peered":"2024-04-26T12:08:53.746212+0000","last_clean":"2024-04-26T12:08:53.746212+0000","last_became_active":"2024-04-26T12:08:36.697618+0000","last_became_peered":"2024-04-26T12:08:36.697618+0000","last_unstale":"2024-04-26T12:08:53.746212+0000","last_undegraded":"2024-04-26T12:08:53.746212+0000","last_fullsized":"2024-04-26T12:08:53.746212+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'354","reported_seq":413,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744055+0000","last_change":"2024-04-26T12:08:45.725751+0000","last_active":"2024-04-26T12:08:52.744055+0000","last_peered":"2024-04-26T12:08:52.744055+0000","last_clean":"2024-04-26T12:08:52.744055+0000","last_became_active":"2024-04-26T12:08:45.724153+0000","last_became_peered":"2024-04-26T12:08:45.724153+0000","last_unstale":"2024-04-26T12:08:52.744055+0000","last_undegraded":"2024-04-26T12:08:52.744055+0000","last_fullsized":"2024-04-26T12:08:52.744055+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:57.798803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":416,"num_write":319,"num_write_kb":17259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"59'53","reported_seq":145,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746127+0000","last_change":"2024-04-26T12:08:36.698122+0000","last_active":"2024-04-26T12:08:53.746127+0000","last_peered":"2024-04-26T12:08:53.746127+0000","last_clean":"2024-04-26T12:08:53.746127+0000","last_became_active":"2024-04-26T12:08:36.697832+0000","last_became_peered":"2024-04-26T12:08:36.697832+0000","last_unstale":"2024-04-26T12:08:53.746127+0000","last_undegraded":"2024-04-26T12:08:53.746127+0000","last_fullsized":"2024-04-26T12:08:53.746127+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744650+0000","last_change":"2024-04-26T12:08:36.698131+0000","last_active":"2024-04-26T12:08:52.744650+0000","last_peered":"2024-04-26T12:08:52.744650+0000","last_clean":"2024-04-26T12:08:52.744650+0000","last_became_active":"2024-04-26T12:08:36.697698+0000","last_became_peered":"2024-04-26T12:08:36.697698+0000","last_unstale":"2024-04-26T12:08:52.744650+0000","last_undegraded":"2024-04-26T12:08:52.744650+0000","last_fullsized":"2024-04-26T12:08:52.744650+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:15.476036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'399","reported_seq":477,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743860+0000","last_change":"2024-04-26T12:08:40.705752+0000","last_active":"2024-04-26T12:08:52.743860+0000","last_peered":"2024-04-26T12:08:52.743860+0000","last_clean":"2024-04-26T12:08:52.743860+0000","last_became_active":"2024-04-26T12:08:40.703906+0000","last_became_peered":"2024-04-26T12:08:40.703906+0000","last_unstale":"2024-04-26T12:08:52.743860+0000","last_undegraded":"2024-04-26T12:08:52.743860+0000","last_fullsized":"2024-04-26T12:08:52.743860+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:19.004074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11720,"num_write":363,"num_write_kb":66914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"59'65","reported_seq":158,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746631+0000","last_change":"2024-04-26T12:08:36.699388+0000","last_active":"2024-04-26T12:08:53.746631+0000","last_peered":"2024-04-26T12:08:53.746631+0000","last_clean":"2024-04-26T12:08:53.746631+0000","last_became_active":"2024-04-26T12:08:36.699058+0000","last_became_peered":"2024-04-26T12:08:36.699058+0000","last_unstale":"2024-04-26T12:08:53.746631+0000","last_undegraded":"2024-04-26T12:08:53.746631+0000","last_fullsized":"2024-04-26T12:08:53.746631+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":95,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746502+0000","last_change":"2024-04-26T12:08:36.697618+0000","last_active":"2024-04-26T12:08:53.746502+0000","last_peered":"2024-04-26T12:08:53.746502+0000","last_clean":"2024-04-26T12:08:53.746502+0000","last_became_active":"2024-04-26T12:08:36.697407+0000","last_became_peered":"2024-04-26T12:08:36.697407+0000","last_unstale":"2024-04-26T12:08:53.746502+0000","last_undegraded":"2024-04-26T12:08:53.746502+0000","last_fullsized":"2024-04-26T12:08:53.746502+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'424","reported_seq":543,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244516+0000","last_change":"2024-04-26T12:05:03.789623+0000","last_active":"2024-04-26T12:09:05.244516+0000","last_peered":"2024-04-26T12:09:05.244516+0000","last_clean":"2024-04-26T12:09:05.244516+0000","last_became_active":"2024-04-26T12:05:03.789390+0000","last_became_peered":"2024-04-26T12:05:03.789390+0000","last_unstale":"2024-04-26T12:09:05.244516+0000","last_undegraded":"2024-04-26T12:09:05.244516+0000","last_fullsized":"2024-04-26T12:09:05.244516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17027,"num_write":386,"num_write_kb":58797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"61'70","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746501+0000","last_change":"2024-04-26T12:05:03.429222+0000","last_active":"2024-04-26T12:08:53.746501+0000","last_peered":"2024-04-26T12:08:53.746501+0000","last_clean":"2024-04-26T12:08:53.746501+0000","last_became_active":"2024-04-26T12:05:03.428803+0000","last_became_peered":"2024-04-26T12:05:03.428803+0000","last_unstale":"2024-04-26T12:08:53.746501+0000","last_undegraded":"2024-04-26T12:08:53.746501+0000","last_fullsized":"2024-04-26T12:08:53.746501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745750+0000","last_change":"2024-04-26T12:08:36.698775+0000","last_active":"2024-04-26T12:08:52.745750+0000","last_peered":"2024-04-26T12:08:52.745750+0000","last_clean":"2024-04-26T12:08:52.745750+0000","last_became_active":"2024-04-26T12:08:36.698523+0000","last_became_peered":"2024-04-26T12:08:36.698523+0000","last_unstale":"2024-04-26T12:08:52.745750+0000","last_undegraded":"2024-04-26T12:08:52.745750+0000","last_fullsized":"2024-04-26T12:08:52.745750+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:16.620901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'393","reported_seq":472,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744009+0000","last_change":"2024-04-26T12:08:40.705662+0000","last_active":"2024-04-26T12:08:52.744009+0000","last_peered":"2024-04-26T12:08:52.744009+0000","last_clean":"2024-04-26T12:08:52.744009+0000","last_became_active":"2024-04-26T12:08:40.703873+0000","last_became_peered":"2024-04-26T12:08:40.703873+0000","last_unstale":"2024-04-26T12:08:52.744009+0000","last_undegraded":"2024-04-26T12:08:52.744009+0000","last_fullsized":"2024-04-26T12:08:52.744009+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:27.057123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":11991,"num_write":357,"num_write_kb":83226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'419","reported_seq":892,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744937+0000","last_change":"2024-04-26T12:08:44.723692+0000","last_active":"2024-04-26T12:08:52.744937+0000","last_peered":"2024-04-26T12:08:52.744937+0000","last_clean":"2024-04-26T12:08:52.744937+0000","last_became_active":"2024-04-26T12:08:44.722574+0000","last_became_peered":"2024-04-26T12:08:44.722574+0000","last_unstale":"2024-04-26T12:08:52.744937+0000","last_undegraded":"2024-04-26T12:08:52.744937+0000","last_fullsized":"2024-04-26T12:08:52.744937+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:01.256055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14983,"num_write":376,"num_write_kb":76749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"61'398","reported_seq":507,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745436+0000","last_change":"2024-04-26T12:08:39.703851+0000","last_active":"2024-04-26T12:08:52.745436+0000","last_peered":"2024-04-26T12:08:52.745436+0000","last_clean":"2024-04-26T12:08:52.745436+0000","last_became_active":"2024-04-26T12:08:39.703516+0000","last_became_peered":"2024-04-26T12:08:39.703516+0000","last_unstale":"2024-04-26T12:08:52.745436+0000","last_undegraded":"2024-04-26T12:08:52.745436+0000","last_fullsized":"2024-04-26T12:08:52.745436+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:10.227718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699266,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":9692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9692849,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'428","reported_seq":941,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745501+0000","last_change":"2024-04-26T12:08:50.753473+0000","last_active":"2024-04-26T12:08:53.745501+0000","last_peered":"2024-04-26T12:08:53.745501+0000","last_clean":"2024-04-26T12:08:53.745501+0000","last_became_active":"2024-04-26T12:08:50.752328+0000","last_became_peered":"2024-04-26T12:08:50.752328+0000","last_unstale":"2024-04-26T12:08:53.745501+0000","last_undegraded":"2024-04-26T12:08:53.745501+0000","last_fullsized":"2024-04-26T12:08:53.745501+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":26594,"num_write":396,"num_write_kb":67932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"60'91","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744409+0000","last_change":"2024-04-26T12:08:36.722607+0000","last_active":"2024-04-26T12:08:52.744409+0000","last_peered":"2024-04-26T12:08:52.744409+0000","last_clean":"2024-04-26T12:08:52.744409+0000","last_became_active":"2024-04-26T12:08:36.697650+0000","last_became_peered":"2024-04-26T12:08:36.697650+0000","last_unstale":"2024-04-26T12:08:52.744409+0000","last_undegraded":"2024-04-26T12:08:52.744409+0000","last_fullsized":"2024-04-26T12:08:52.744409+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:10.718101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"59'316","reported_seq":394,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745553+0000","last_change":"2024-04-26T12:05:03.429257+0000","last_active":"2024-04-26T12:08:52.745553+0000","last_peered":"2024-04-26T12:08:52.745553+0000","last_clean":"2024-04-26T12:08:52.745553+0000","last_became_active":"2024-04-26T12:05:03.428921+0000","last_became_peered":"2024-04-26T12:05:03.428921+0000","last_unstale":"2024-04-26T12:08:52.745553+0000","last_undegraded":"2024-04-26T12:08:52.745553+0000","last_fullsized":"2024-04-26T12:08:52.745553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:49.774845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'495","reported_seq":626,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745433+0000","last_change":"2024-04-26T12:05:03.788141+0000","last_active":"2024-04-26T12:08:53.745433+0000","last_peered":"2024-04-26T12:08:53.745433+0000","last_clean":"2024-04-26T12:08:53.745433+0000","last_became_active":"2024-04-26T12:05:03.787533+0000","last_became_peered":"2024-04-26T12:05:03.787533+0000","last_unstale":"2024-04-26T12:08:53.745433+0000","last_undegraded":"2024-04-26T12:08:53.745433+0000","last_fullsized":"2024-04-26T12:08:53.745433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37174,"num_write":458,"num_write_kb":125832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'51","reported_seq":130,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746551+0000","last_change":"2024-04-26T12:05:03.428971+0000","last_active":"2024-04-26T12:08:53.746551+0000","last_peered":"2024-04-26T12:08:53.746551+0000","last_clean":"2024-04-26T12:08:53.746551+0000","last_became_active":"2024-04-26T12:05:03.428445+0000","last_became_peered":"2024-04-26T12:05:03.428445+0000","last_unstale":"2024-04-26T12:08:53.746551+0000","last_undegraded":"2024-04-26T12:08:53.746551+0000","last_fullsized":"2024-04-26T12:08:53.746551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'482","reported_seq":1131,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745376+0000","last_change":"2024-04-26T12:08:48.741589+0000","last_active":"2024-04-26T12:08:53.745376+0000","last_peered":"2024-04-26T12:08:53.745376+0000","last_clean":"2024-04-26T12:08:53.745376+0000","last_became_active":"2024-04-26T12:08:48.740055+0000","last_became_peered":"2024-04-26T12:08:48.740055+0000","last_unstale":"2024-04-26T12:08:53.745376+0000","last_undegraded":"2024-04-26T12:08:53.745376+0000","last_fullsized":"2024-04-26T12:08:53.745376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":61972,"num_write":459,"num_write_kb":125797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"60'392","reported_seq":527,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744471+0000","last_change":"2024-04-26T12:08:43.718939+0000","last_active":"2024-04-26T12:08:52.744471+0000","last_peered":"2024-04-26T12:08:52.744471+0000","last_clean":"2024-04-26T12:08:52.744471+0000","last_became_active":"2024-04-26T12:08:43.717109+0000","last_became_peered":"2024-04-26T12:08:43.717109+0000","last_unstale":"2024-04-26T12:08:52.744471+0000","last_undegraded":"2024-04-26T12:08:52.744471+0000","last_fullsized":"2024-04-26T12:08:52.744471+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:14.846653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":37910,"num_write":366,"num_write_kb":84111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"59'709","reported_seq":814,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745562+0000","last_change":"2024-04-26T12:08:39.701978+0000","last_active":"2024-04-26T12:08:53.745562+0000","last_peered":"2024-04-26T12:08:53.745562+0000","last_clean":"2024-04-26T12:08:53.745562+0000","last_became_active":"2024-04-26T12:08:39.700927+0000","last_became_peered":"2024-04-26T12:08:39.700927+0000","last_unstale":"2024-04-26T12:08:53.745562+0000","last_undegraded":"2024-04-26T12:08:53.745562+0000","last_fullsized":"2024-04-26T12:08:53.745562+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"60'435","reported_seq":574,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244727+0000","last_change":"2024-04-26T12:05:03.788754+0000","last_active":"2024-04-26T12:09:05.244727+0000","last_peered":"2024-04-26T12:09:05.244727+0000","last_clean":"2024-04-26T12:09:05.244727+0000","last_became_active":"2024-04-26T12:05:03.788311+0000","last_became_peered":"2024-04-26T12:05:03.788311+0000","last_unstale":"2024-04-26T12:09:05.244727+0000","last_undegraded":"2024-04-26T12:09:05.244727+0000","last_fullsized":"2024-04-26T12:09:05.244727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":28462,"num_write":403,"num_write_kb":93779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"59'262","reported_seq":341,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745608+0000","last_change":"2024-04-26T12:05:03.428810+0000","last_active":"2024-04-26T12:08:53.745608+0000","last_peered":"2024-04-26T12:08:53.745608+0000","last_clean":"2024-04-26T12:08:53.745608+0000","last_became_active":"2024-04-26T12:05:03.428191+0000","last_became_peered":"2024-04-26T12:05:03.428191+0000","last_unstale":"2024-04-26T12:08:53.745608+0000","last_undegraded":"2024-04-26T12:08:53.745608+0000","last_fullsized":"2024-04-26T12:08:53.745608+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"60'399","reported_seq":499,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744294+0000","last_change":"2024-04-26T12:08:49.742459+0000","last_active":"2024-04-26T12:08:52.744294+0000","last_peered":"2024-04-26T12:08:52.744294+0000","last_clean":"2024-04-26T12:08:52.744294+0000","last_became_active":"2024-04-26T12:08:49.740536+0000","last_became_peered":"2024-04-26T12:08:49.740536+0000","last_unstale":"2024-04-26T12:08:52.744294+0000","last_undegraded":"2024-04-26T12:08:52.744294+0000","last_fullsized":"2024-04-26T12:08:52.744294+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:24.169669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22216,"num_write":357,"num_write_kb":75245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"59'430","reported_seq":490,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743876+0000","last_change":"2024-04-26T12:08:39.703050+0000","last_active":"2024-04-26T12:08:52.743876+0000","last_peered":"2024-04-26T12:08:52.743876+0000","last_clean":"2024-04-26T12:08:52.743876+0000","last_became_active":"2024-04-26T12:08:39.702529+0000","last_became_peered":"2024-04-26T12:08:39.702529+0000","last_unstale":"2024-04-26T12:08:52.743876+0000","last_undegraded":"2024-04-26T12:08:52.743876+0000","last_fullsized":"2024-04-26T12:08:52.743876+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:28.249725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":12514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"60'387","reported_seq":476,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744228+0000","last_change":"2024-04-26T12:08:43.720098+0000","last_active":"2024-04-26T12:08:52.744228+0000","last_peered":"2024-04-26T12:08:52.744228+0000","last_clean":"2024-04-26T12:08:52.744228+0000","last_became_active":"2024-04-26T12:08:43.717442+0000","last_became_peered":"2024-04-26T12:08:43.717442+0000","last_unstale":"2024-04-26T12:08:52.744228+0000","last_undegraded":"2024-04-26T12:08:52.744228+0000","last_fullsized":"2024-04-26T12:08:52.744228+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:13.140334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20720,"num_write":352,"num_write_kb":87643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"59'58","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743900+0000","last_change":"2024-04-26T12:08:36.720540+0000","last_active":"2024-04-26T12:08:52.743900+0000","last_peered":"2024-04-26T12:08:52.743900+0000","last_clean":"2024-04-26T12:08:52.743900+0000","last_became_active":"2024-04-26T12:08:36.693399+0000","last_became_peered":"2024-04-26T12:08:36.693399+0000","last_unstale":"2024-04-26T12:08:52.743900+0000","last_undegraded":"2024-04-26T12:08:52.743900+0000","last_fullsized":"2024-04-26T12:08:52.743900+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:14.949002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"60'356","reported_seq":452,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744945+0000","last_change":"2024-04-26T12:05:03.791986+0000","last_active":"2024-04-26T12:08:52.744945+0000","last_peered":"2024-04-26T12:08:52.744945+0000","last_clean":"2024-04-26T12:08:52.744945+0000","last_became_active":"2024-04-26T12:05:03.790823+0000","last_became_peered":"2024-04-26T12:05:03.790823+0000","last_unstale":"2024-04-26T12:08:52.744945+0000","last_undegraded":"2024-04-26T12:08:52.744945+0000","last_fullsized":"2024-04-26T12:08:52.744945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:27.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9641,"num_write":326,"num_write_kb":29574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"59'309","reported_seq":387,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745394+0000","last_change":"2024-04-26T12:05:03.429469+0000","last_active":"2024-04-26T12:08:52.745394+0000","last_peered":"2024-04-26T12:08:52.745394+0000","last_clean":"2024-04-26T12:08:52.745394+0000","last_became_active":"2024-04-26T12:05:03.429015+0000","last_became_peered":"2024-04-26T12:05:03.429015+0000","last_unstale":"2024-04-26T12:08:52.745394+0000","last_undegraded":"2024-04-26T12:08:52.745394+0000","last_fullsized":"2024-04-26T12:08:52.745394+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:30.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'433","reported_seq":575,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.745025+0000","last_change":"2024-04-26T12:05:03.791929+0000","last_active":"2024-04-26T12:08:52.745025+0000","last_peered":"2024-04-26T12:08:52.745025+0000","last_clean":"2024-04-26T12:08:52.745025+0000","last_became_active":"2024-04-26T12:05:03.791540+0000","last_became_peered":"2024-04-26T12:05:03.791540+0000","last_unstale":"2024-04-26T12:08:52.745025+0000","last_undegraded":"2024-04-26T12:08:52.745025+0000","last_fullsized":"2024-04-26T12:08:52.745025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:12.092671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":47864,"num_write":399,"num_write_kb":92193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"59'382","reported_seq":449,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744180+0000","last_change":"2024-04-26T12:08:39.704680+0000","last_active":"2024-04-26T12:08:52.744180+0000","last_peered":"2024-04-26T12:08:52.744180+0000","last_clean":"2024-04-26T12:08:52.744180+0000","last_became_active":"2024-04-26T12:08:39.704404+0000","last_became_peered":"2024-04-26T12:08:39.704404+0000","last_unstale":"2024-04-26T12:08:52.744180+0000","last_undegraded":"2024-04-26T12:08:52.744180+0000","last_fullsized":"2024-04-26T12:08:52.744180+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:01.830043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":12467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'425","reported_seq":544,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.743855+0000","last_change":"2024-04-26T12:08:47.737376+0000","last_active":"2024-04-26T12:08:52.743855+0000","last_peered":"2024-04-26T12:08:52.743855+0000","last_clean":"2024-04-26T12:08:52.743855+0000","last_became_active":"2024-04-26T12:08:47.735367+0000","last_became_peered":"2024-04-26T12:08:47.735367+0000","last_unstale":"2024-04-26T12:08:52.743855+0000","last_undegraded":"2024-04-26T12:08:52.743855+0000","last_fullsized":"2024-04-26T12:08:52.743855+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:35.420647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":38065,"num_write":387,"num_write_kb":71445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"59'126","reported_seq":231,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244507+0000","last_change":"2024-04-26T12:08:39.702212+0000","last_active":"2024-04-26T12:09:05.244507+0000","last_peered":"2024-04-26T12:09:05.244507+0000","last_clean":"2024-04-26T12:09:05.244507+0000","last_became_active":"2024-04-26T12:08:39.701900+0000","last_became_peered":"2024-04-26T12:08:39.701900+0000","last_unstale":"2024-04-26T12:09:05.244507+0000","last_undegraded":"2024-04-26T12:09:05.244507+0000","last_fullsized":"2024-04-26T12:09:05.244507+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"60'448","reported_seq":548,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:08:52.744703+0000","last_change":"2024-04-26T12:05:03.791827+0000","last_active":"2024-04-26T12:08:52.744703+0000","last_peered":"2024-04-26T12:08:52.744703+0000","last_clean":"2024-04-26T12:08:52.744703+0000","last_became_active":"2024-04-26T12:05:03.791442+0000","last_became_peered":"2024-04-26T12:05:03.791442+0000","last_unstale":"2024-04-26T12:08:52.744703+0000","last_undegraded":"2024-04-26T12:08:52.744703+0000","last_fullsized":"2024-04-26T12:08:52.744703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:57.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11191,"num_write":416,"num_write_kb":67272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"59'56","reported_seq":135,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746369+0000","last_change":"2024-04-26T12:05:03.430659+0000","last_active":"2024-04-26T12:08:53.746369+0000","last_peered":"2024-04-26T12:08:53.746369+0000","last_clean":"2024-04-26T12:08:53.746369+0000","last_became_active":"2024-04-26T12:05:03.430164+0000","last_became_peered":"2024-04-26T12:05:03.430164+0000","last_unstale":"2024-04-26T12:08:53.746369+0000","last_undegraded":"2024-04-26T12:08:53.746369+0000","last_fullsized":"2024-04-26T12:08:53.746369+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2734,"num_read_kb":1486856,"num_write":24627,"num_write_kb":4487808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7440,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26722,"ondisk_log_size":26722,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128606591,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":5972,"num_write_kb":129691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64376832,"data_stored":257213182,"data_compressed":19249503,"data_compressed_allocated":31694848,"data_compressed_original":224591872,"omap_allocated":4411,"internal_metadata":0},"log_size":7828,"ondisk_log_size":7828,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738423,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134436,"kb_used_data":27092,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94237404,"statfs":{"total":96636764160,"available":96499101696,"internally_reserved":0,"allocated":27742208,"data_stored":91797602,"data_compressed":6340284,"data_compressed_allocated":11272192,"data_compressed_original":75763712,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:08:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.40899999999999997,"15min":0.439},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.39900000000000002,"15min":0.42599999999999999},"min":{"1min":0.19,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.51700000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Apr 26 12:05:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.436},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.41699999999999998}]}]},{"osd":1,"up_from":66,"seq":283467841544,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68516,"kb_used_data":10644,"kb_used_omap":5,"kb_used_meta":57850,"kb_avail":94303324,"statfs":{"total":96636764160,"available":96566603776,"internally_reserved":0,"allocated":10899456,"data_stored":86136667,"data_compressed":7182940,"data_compressed_allocated":10076160,"data_compressed_original":85745664,"omap_allocated":6005,"internal_metadata":59238539},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]}]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138888,"kb_used_data":27452,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232952,"statfs":{"total":96636764160,"available":96494542848,"internally_reserved":0,"allocated":28110848,"data_stored":81507786,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:05:55 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Apr 26 12:09:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.437},"min":{"1min":0.29199999999999998,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.63200000000000001,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.435,"15min":0.433},"min":{"1min":0.32900000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.65800000000000003,"5min":1.976,"15min":1.976},"last":0.60399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27357184,"data_stored":81158407,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10088448,"data_stored":85196920,"data_compressed":7176942,"data_compressed_allocated":10039296,"data_compressed_original":85172224,"omap_allocated":4411,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26931200,"data_stored":90857855,"data_compressed":6334286,"data_compressed_allocated":11235328,"data_compressed_original":75190272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:09:06.451 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.451 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.452 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.452 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.452 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.452 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.452 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.452 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.452 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.452 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.452 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.452 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.453 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.453 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.453 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.453 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.453 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.453 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.453 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.453 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.453 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.453 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.453 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.454 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.454 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.454 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.454 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.454 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.454 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.454 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.454 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.454 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.455 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.455 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.455 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.455 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.455 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.455 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.455 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.455 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.455 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.456 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.456 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.456 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.456 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.456 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.456 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.456 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.456 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.456 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.456 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.457 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.457 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.457 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.457 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.457 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.457 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:04:52.376986+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.457 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.457 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.457 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.458 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.458 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.458 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.458 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.458 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.458 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.458 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.458 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.458 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.458 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.459 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.459 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.459 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.459 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.459 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.459 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.459 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.459 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.459 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.459 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.460 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.460 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.460 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.460 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.460 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.460 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.460 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.460 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.460 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.460 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.461 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.461 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.461 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.461 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.461 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.461 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.461 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.461 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.461 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.462 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.462 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.462 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.462 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.462 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.462 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:06.462 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:09:26.466 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:09:26.779 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:09:26.781 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:09:26.789 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":220,"stamp":"2024-04-26T12:09:26.400380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129196959,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2917,"num_read_kb":1488438,"num_write":30802,"num_write_kb":4620959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7463,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34711,"ondisk_log_size":34711,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":341820,"kb_used_data":65188,"kb_used_omap":8,"kb_used_meta":276599,"kb_avail":282773700,"statfs":{"total":289910292480,"available":289560268800,"internally_reserved":0,"allocated":66752512,"data_stored":259442055,"data_compressed":19261499,"data_compressed_allocated":31768576,"data_compressed_original":225738752,"omap_allocated":9193,"internal_metadata":283237399},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003118"},"pg_stats":[{"pgid":"4.3f","version":"60'426","reported_seq":508,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746133+0000","last_change":"2024-04-26T12:08:51.753936+0000","last_active":"2024-04-26T12:08:53.746133+0000","last_peered":"2024-04-26T12:08:53.746133+0000","last_clean":"2024-04-26T12:08:53.746133+0000","last_became_active":"2024-04-26T12:08:51.750917+0000","last_became_peered":"2024-04-26T12:08:51.750917+0000","last_unstale":"2024-04-26T12:08:53.746133+0000","last_undegraded":"2024-04-26T12:08:53.746133+0000","last_fullsized":"2024-04-26T12:08:53.746133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9964,"num_write":393,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"60'470","reported_seq":602,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745918+0000","last_change":"2024-04-26T12:08:43.719204+0000","last_active":"2024-04-26T12:08:53.745918+0000","last_peered":"2024-04-26T12:08:53.745918+0000","last_clean":"2024-04-26T12:08:53.745918+0000","last_became_active":"2024-04-26T12:08:43.717325+0000","last_became_peered":"2024-04-26T12:08:43.717325+0000","last_unstale":"2024-04-26T12:08:53.745918+0000","last_undegraded":"2024-04-26T12:08:53.745918+0000","last_fullsized":"2024-04-26T12:08:53.745918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":34556,"num_write":444,"num_write_kb":129697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"60'370","reported_seq":804,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124711+0000","last_change":"2024-04-26T12:08:50.753639+0000","last_active":"2024-04-26T12:09:06.124711+0000","last_peered":"2024-04-26T12:09:06.124711+0000","last_clean":"2024-04-26T12:09:06.124711+0000","last_became_active":"2024-04-26T12:08:50.752468+0000","last_became_peered":"2024-04-26T12:08:50.752468+0000","last_unstale":"2024-04-26T12:09:06.124711+0000","last_undegraded":"2024-04-26T12:09:06.124711+0000","last_fullsized":"2024-04-26T12:09:06.124711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":349,"num_write_kb":51115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"60'377","reported_seq":487,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124688+0000","last_change":"2024-04-26T12:05:03.791234+0000","last_active":"2024-04-26T12:09:06.124688+0000","last_peered":"2024-04-26T12:09:06.124688+0000","last_clean":"2024-04-26T12:09:06.124688+0000","last_became_active":"2024-04-26T12:05:03.790717+0000","last_became_peered":"2024-04-26T12:05:03.790717+0000","last_unstale":"2024-04-26T12:09:06.124688+0000","last_undegraded":"2024-04-26T12:09:06.124688+0000","last_fullsized":"2024-04-26T12:09:06.124688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17376,"num_write":341,"num_write_kb":46680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'445","reported_seq":551,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745324+0000","last_change":"2024-04-26T12:08:39.705318+0000","last_active":"2024-04-26T12:08:53.745324+0000","last_peered":"2024-04-26T12:08:53.745324+0000","last_clean":"2024-04-26T12:08:53.745324+0000","last_became_active":"2024-04-26T12:08:39.702117+0000","last_became_peered":"2024-04-26T12:08:39.702117+0000","last_unstale":"2024-04-26T12:08:53.745324+0000","last_undegraded":"2024-04-26T12:08:53.745324+0000","last_fullsized":"2024-04-26T12:08:53.745324+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24197,"num_write":416,"num_write_kb":80466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"60'375","reported_seq":471,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745522+0000","last_change":"2024-04-26T12:05:03.791560+0000","last_active":"2024-04-26T12:08:53.745522+0000","last_peered":"2024-04-26T12:08:53.745522+0000","last_clean":"2024-04-26T12:08:53.745522+0000","last_became_active":"2024-04-26T12:05:03.790578+0000","last_became_peered":"2024-04-26T12:05:03.790578+0000","last_unstale":"2024-04-26T12:08:53.745522+0000","last_undegraded":"2024-04-26T12:08:53.745522+0000","last_fullsized":"2024-04-26T12:08:53.745522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6518,"num_write":348,"num_write_kb":38078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'428","reported_seq":536,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:18.488561+0000","last_change":"2024-04-26T12:09:18.488710+0000","last_active":"2024-04-26T12:09:18.488561+0000","last_peered":"2024-04-26T12:09:18.488561+0000","last_clean":"2024-04-26T12:09:18.488561+0000","last_became_active":"2024-04-26T12:05:03.790615+0000","last_became_peered":"2024-04-26T12:05:03.790615+0000","last_unstale":"2024-04-26T12:09:18.488561+0000","last_undegraded":"2024-04-26T12:09:18.488561+0000","last_fullsized":"2024-04-26T12:09:18.488561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'428","last_scrub_stamp":"2024-04-26T12:09:18.488526+0000","last_deep_scrub":"60'428","last_deep_scrub_stamp":"2024-04-26T12:09:18.488526+0000","last_clean_scrub_stamp":"2024-04-26T12:09:18.488526+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:22.049575+0000","scrub_duration":0.0025858650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12560,"num_write":398,"num_write_kb":67332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"60'387","reported_seq":527,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745325+0000","last_change":"2024-04-26T12:05:03.785861+0000","last_active":"2024-04-26T12:08:53.745325+0000","last_peered":"2024-04-26T12:08:53.745325+0000","last_clean":"2024-04-26T12:08:53.745325+0000","last_became_active":"2024-04-26T12:05:03.785382+0000","last_became_peered":"2024-04-26T12:05:03.785382+0000","last_unstale":"2024-04-26T12:08:53.745325+0000","last_undegraded":"2024-04-26T12:08:53.745325+0000","last_fullsized":"2024-04-26T12:08:53.745325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":41160,"num_write":356,"num_write_kb":80219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"60'405","reported_seq":901,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746094+0000","last_change":"2024-04-26T12:08:46.730220+0000","last_active":"2024-04-26T12:08:53.746094+0000","last_peered":"2024-04-26T12:08:53.746094+0000","last_clean":"2024-04-26T12:08:53.746094+0000","last_became_active":"2024-04-26T12:08:46.729039+0000","last_became_peered":"2024-04-26T12:08:46.729039+0000","last_unstale":"2024-04-26T12:08:53.746094+0000","last_undegraded":"2024-04-26T12:08:53.746094+0000","last_fullsized":"2024-04-26T12:08:53.746094+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":11674,"num_write":372,"num_write_kb":34604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"60'425","reported_seq":578,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745791+0000","last_change":"2024-04-26T12:08:41.718786+0000","last_active":"2024-04-26T12:08:53.745791+0000","last_peered":"2024-04-26T12:08:53.745791+0000","last_clean":"2024-04-26T12:08:53.745791+0000","last_became_active":"2024-04-26T12:08:41.716014+0000","last_became_peered":"2024-04-26T12:08:41.716014+0000","last_unstale":"2024-04-26T12:08:53.745791+0000","last_undegraded":"2024-04-26T12:08:53.745791+0000","last_fullsized":"2024-04-26T12:08:53.745791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":48419,"num_write":390,"num_write_kb":92286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"60'372","reported_seq":490,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746199+0000","last_change":"2024-04-26T12:05:03.791046+0000","last_active":"2024-04-26T12:08:53.746199+0000","last_peered":"2024-04-26T12:08:53.746199+0000","last_clean":"2024-04-26T12:08:53.746199+0000","last_became_active":"2024-04-26T12:05:03.790662+0000","last_became_peered":"2024-04-26T12:05:03.790662+0000","last_unstale":"2024-04-26T12:08:53.746199+0000","last_undegraded":"2024-04-26T12:08:53.746199+0000","last_fullsized":"2024-04-26T12:08:53.746199+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25905,"num_write":353,"num_write_kb":75437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'351","reported_seq":438,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:08.024810+0000","last_change":"2024-04-26T12:09:08.024919+0000","last_active":"2024-04-26T12:09:08.024810+0000","last_peered":"2024-04-26T12:09:08.024810+0000","last_clean":"2024-04-26T12:09:08.024810+0000","last_became_active":"2024-04-26T12:08:41.715726+0000","last_became_peered":"2024-04-26T12:08:41.715726+0000","last_unstale":"2024-04-26T12:09:08.024810+0000","last_undegraded":"2024-04-26T12:09:08.024810+0000","last_fullsized":"2024-04-26T12:09:08.024810+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'351","last_scrub_stamp":"2024-04-26T12:09:08.024789+0000","last_deep_scrub":"60'351","last_deep_scrub_stamp":"2024-04-26T12:09:08.024789+0000","last_clean_scrub_stamp":"2024-04-26T12:09:08.024789+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:15.481742+0000","scrub_duration":0.0022688909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8884,"num_write":327,"num_write_kb":58289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"60'405","reported_seq":497,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:19.190020+0000","last_change":"2024-04-26T12:09:19.190112+0000","last_active":"2024-04-26T12:09:19.190020+0000","last_peered":"2024-04-26T12:09:19.190020+0000","last_clean":"2024-04-26T12:09:19.190020+0000","last_became_active":"2024-04-26T12:08:39.702141+0000","last_became_peered":"2024-04-26T12:08:39.702141+0000","last_unstale":"2024-04-26T12:09:19.190020+0000","last_undegraded":"2024-04-26T12:09:19.190020+0000","last_fullsized":"2024-04-26T12:09:19.190020+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'405","last_scrub_stamp":"2024-04-26T12:09:19.189997+0000","last_deep_scrub":"60'405","last_deep_scrub_stamp":"2024-04-26T12:09:19.189997+0000","last_clean_scrub_stamp":"2024-04-26T12:09:19.189997+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:45:38.242862+0000","scrub_duration":0.0019966300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6771,"num_write":372,"num_write_kb":54786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"60'431","reported_seq":949,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:21.555549+0000","last_change":"2024-04-26T12:09:21.555659+0000","last_active":"2024-04-26T12:09:21.555549+0000","last_peered":"2024-04-26T12:09:21.555549+0000","last_clean":"2024-04-26T12:09:21.555549+0000","last_became_active":"2024-04-26T12:08:48.740170+0000","last_became_peered":"2024-04-26T12:08:48.740170+0000","last_unstale":"2024-04-26T12:09:21.555549+0000","last_undegraded":"2024-04-26T12:09:21.555549+0000","last_fullsized":"2024-04-26T12:09:21.555549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'431","last_scrub_stamp":"2024-04-26T12:09:21.555526+0000","last_deep_scrub":"60'431","last_deep_scrub_stamp":"2024-04-26T12:09:21.555526+0000","last_clean_scrub_stamp":"2024-04-26T12:09:21.555526+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:09.119328+0000","scrub_duration":0.0022972299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26572,"num_write":398,"num_write_kb":83974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'394","reported_seq":897,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745705+0000","last_change":"2024-04-26T12:08:41.717703+0000","last_active":"2024-04-26T12:08:53.745705+0000","last_peered":"2024-04-26T12:08:53.745705+0000","last_clean":"2024-04-26T12:08:53.745705+0000","last_became_active":"2024-04-26T12:08:41.715956+0000","last_became_peered":"2024-04-26T12:08:41.715956+0000","last_unstale":"2024-04-26T12:08:53.745705+0000","last_undegraded":"2024-04-26T12:08:53.745705+0000","last_fullsized":"2024-04-26T12:08:53.745705+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":38136,"num_write":355,"num_write_kb":38484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'432","reported_seq":555,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:07.460759+0000","last_change":"2024-04-26T12:09:07.460951+0000","last_active":"2024-04-26T12:09:07.460759+0000","last_peered":"2024-04-26T12:09:07.460759+0000","last_clean":"2024-04-26T12:09:07.460759+0000","last_became_active":"2024-04-26T12:05:03.785991+0000","last_became_peered":"2024-04-26T12:05:03.785991+0000","last_unstale":"2024-04-26T12:09:07.460759+0000","last_undegraded":"2024-04-26T12:09:07.460759+0000","last_fullsized":"2024-04-26T12:09:07.460759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'432","last_scrub_stamp":"2024-04-26T12:09:07.460722+0000","last_deep_scrub":"60'432","last_deep_scrub_stamp":"2024-04-26T12:09:07.460722+0000","last_clean_scrub_stamp":"2024-04-26T12:09:07.460722+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:52.118824+0000","scrub_duration":0.0028296200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18244,"num_write":400,"num_write_kb":59033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'381","reported_seq":839,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746595+0000","last_change":"2024-04-26T12:08:52.747060+0000","last_active":"2024-04-26T12:08:53.746595+0000","last_peered":"2024-04-26T12:08:53.746595+0000","last_clean":"2024-04-26T12:08:53.746595+0000","last_became_active":"2024-04-26T12:08:52.745913+0000","last_became_peered":"2024-04-26T12:08:52.745913+0000","last_unstale":"2024-04-26T12:08:53.746595+0000","last_undegraded":"2024-04-26T12:08:53.746595+0000","last_fullsized":"2024-04-26T12:08:53.746595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":350,"num_write_kb":21212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"60'424","reported_seq":515,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745751+0000","last_change":"2024-04-26T12:08:42.718639+0000","last_active":"2024-04-26T12:08:53.745751+0000","last_peered":"2024-04-26T12:08:53.745751+0000","last_clean":"2024-04-26T12:08:53.745751+0000","last_became_active":"2024-04-26T12:08:42.716846+0000","last_became_peered":"2024-04-26T12:08:42.716846+0000","last_unstale":"2024-04-26T12:08:53.745751+0000","last_undegraded":"2024-04-26T12:08:53.745751+0000","last_fullsized":"2024-04-26T12:08:53.745751+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13930,"num_write":388,"num_write_kb":116055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'426","reported_seq":917,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:08.468505+0000","last_change":"2024-04-26T12:09:08.468648+0000","last_active":"2024-04-26T12:09:08.468505+0000","last_peered":"2024-04-26T12:09:08.468505+0000","last_clean":"2024-04-26T12:09:08.468505+0000","last_became_active":"2024-04-26T12:08:53.747215+0000","last_became_peered":"2024-04-26T12:08:53.747215+0000","last_unstale":"2024-04-26T12:09:08.468505+0000","last_undegraded":"2024-04-26T12:09:08.468505+0000","last_fullsized":"2024-04-26T12:09:08.468505+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'426","last_scrub_stamp":"2024-04-26T12:09:08.468482+0000","last_deep_scrub":"60'426","last_deep_scrub_stamp":"2024-04-26T12:09:08.468482+0000","last_clean_scrub_stamp":"2024-04-26T12:09:08.468482+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:56.032283+0000","scrub_duration":0.0021666569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26908,"num_write":383,"num_write_kb":71324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"60'425","reported_seq":558,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:08.446045+0000","last_change":"2024-04-26T12:09:08.446169+0000","last_active":"2024-04-26T12:09:08.446045+0000","last_peered":"2024-04-26T12:09:08.446045+0000","last_clean":"2024-04-26T12:09:08.446045+0000","last_became_active":"2024-04-26T12:05:03.791061+0000","last_became_peered":"2024-04-26T12:05:03.791061+0000","last_unstale":"2024-04-26T12:09:08.446045+0000","last_undegraded":"2024-04-26T12:09:08.446045+0000","last_fullsized":"2024-04-26T12:09:08.446045+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'425","last_scrub_stamp":"2024-04-26T12:09:08.446023+0000","last_deep_scrub":"60'425","last_deep_scrub_stamp":"2024-04-26T12:09:08.446023+0000","last_clean_scrub_stamp":"2024-04-26T12:09:08.446023+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:29.700242+0000","scrub_duration":0.002826112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19715,"num_write":398,"num_write_kb":30150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'450","reported_seq":639,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745919+0000","last_change":"2024-04-26T12:05:03.792073+0000","last_active":"2024-04-26T12:08:53.745919+0000","last_peered":"2024-04-26T12:08:53.745919+0000","last_clean":"2024-04-26T12:08:53.745919+0000","last_became_active":"2024-04-26T12:05:03.791693+0000","last_became_peered":"2024-04-26T12:05:03.791693+0000","last_unstale":"2024-04-26T12:08:53.745919+0000","last_undegraded":"2024-04-26T12:08:53.745919+0000","last_fullsized":"2024-04-26T12:08:53.745919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":65124,"num_write":423,"num_write_kb":142714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'434","reported_seq":539,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745454+0000","last_change":"2024-04-26T12:08:46.730582+0000","last_active":"2024-04-26T12:08:53.745454+0000","last_peered":"2024-04-26T12:08:53.745454+0000","last_clean":"2024-04-26T12:08:53.745454+0000","last_became_active":"2024-04-26T12:08:46.728804+0000","last_became_peered":"2024-04-26T12:08:46.728804+0000","last_unstale":"2024-04-26T12:08:53.745454+0000","last_undegraded":"2024-04-26T12:08:53.745454+0000","last_fullsized":"2024-04-26T12:08:53.745454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":15350,"num_write":405,"num_write_kb":59295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"60'424","reported_seq":538,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745307+0000","last_change":"2024-04-26T12:05:03.788658+0000","last_active":"2024-04-26T12:08:53.745307+0000","last_peered":"2024-04-26T12:08:53.745307+0000","last_clean":"2024-04-26T12:08:53.745307+0000","last_became_active":"2024-04-26T12:05:03.788050+0000","last_became_peered":"2024-04-26T12:05:03.788050+0000","last_unstale":"2024-04-26T12:08:53.745307+0000","last_undegraded":"2024-04-26T12:08:53.745307+0000","last_fullsized":"2024-04-26T12:08:53.745307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23772,"num_write":390,"num_write_kb":67944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"60'447","reported_seq":527,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745010+0000","last_change":"2024-04-26T12:08:40.707153+0000","last_active":"2024-04-26T12:08:53.745010+0000","last_peered":"2024-04-26T12:08:53.745010+0000","last_clean":"2024-04-26T12:08:53.745010+0000","last_became_active":"2024-04-26T12:08:40.703880+0000","last_became_peered":"2024-04-26T12:08:40.703880+0000","last_unstale":"2024-04-26T12:08:53.745010+0000","last_undegraded":"2024-04-26T12:08:53.745010+0000","last_fullsized":"2024-04-26T12:08:53.745010+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9403,"num_write":417,"num_write_kb":67425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"60'417","reported_seq":508,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745848+0000","last_change":"2024-04-26T12:08:42.717934+0000","last_active":"2024-04-26T12:08:53.745848+0000","last_peered":"2024-04-26T12:08:53.745848+0000","last_clean":"2024-04-26T12:08:53.745848+0000","last_became_active":"2024-04-26T12:08:42.715812+0000","last_became_peered":"2024-04-26T12:08:42.715812+0000","last_unstale":"2024-04-26T12:08:53.745848+0000","last_undegraded":"2024-04-26T12:08:53.745848+0000","last_fullsized":"2024-04-26T12:08:53.745848+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20466,"num_write":400,"num_write_kb":42225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"60'475","reported_seq":617,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.500379+0000","last_change":"2024-04-26T12:09:06.500379+0000","last_active":"2024-04-26T12:09:06.500379+0000","last_peered":"2024-04-26T12:09:06.500379+0000","last_clean":"2024-04-26T12:09:06.500379+0000","last_became_active":"2024-04-26T12:05:03.787562+0000","last_became_peered":"2024-04-26T12:05:03.787562+0000","last_unstale":"2024-04-26T12:09:06.500379+0000","last_undegraded":"2024-04-26T12:09:06.500379+0000","last_fullsized":"2024-04-26T12:09:06.500379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'475","last_scrub_stamp":"2024-04-26T12:09:06.500254+0000","last_deep_scrub":"60'475","last_deep_scrub_stamp":"2024-04-26T12:09:06.500254+0000","last_clean_scrub_stamp":"2024-04-26T12:09:06.500254+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:10.061304+0000","scrub_duration":0.002921515,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25186,"num_write":431,"num_write_kb":48184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"60'409","reported_seq":899,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124620+0000","last_change":"2024-04-26T12:08:49.741823+0000","last_active":"2024-04-26T12:09:06.124620+0000","last_peered":"2024-04-26T12:09:06.124620+0000","last_clean":"2024-04-26T12:09:06.124620+0000","last_became_active":"2024-04-26T12:08:49.740497+0000","last_became_peered":"2024-04-26T12:08:49.740497+0000","last_unstale":"2024-04-26T12:09:06.124620+0000","last_undegraded":"2024-04-26T12:09:06.124620+0000","last_fullsized":"2024-04-26T12:09:06.124620+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":20137,"num_write":374,"num_write_kb":55441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'392","reported_seq":494,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745543+0000","last_change":"2024-04-26T12:08:47.737270+0000","last_active":"2024-04-26T12:08:53.745543+0000","last_peered":"2024-04-26T12:08:53.745543+0000","last_clean":"2024-04-26T12:08:53.745543+0000","last_became_active":"2024-04-26T12:08:47.735361+0000","last_became_peered":"2024-04-26T12:08:47.735361+0000","last_unstale":"2024-04-26T12:08:53.745543+0000","last_undegraded":"2024-04-26T12:08:53.745543+0000","last_fullsized":"2024-04-26T12:08:53.745543+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29179,"num_write":355,"num_write_kb":59011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'380","reported_seq":853,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:15.465302+0000","last_change":"2024-04-26T12:09:15.465302+0000","last_active":"2024-04-26T12:09:15.465302+0000","last_peered":"2024-04-26T12:09:15.465302+0000","last_clean":"2024-04-26T12:09:15.465302+0000","last_became_active":"2024-04-26T12:08:41.716234+0000","last_became_peered":"2024-04-26T12:08:41.716234+0000","last_unstale":"2024-04-26T12:09:15.465302+0000","last_undegraded":"2024-04-26T12:09:15.465302+0000","last_fullsized":"2024-04-26T12:09:15.465302+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'380","last_scrub_stamp":"2024-04-26T12:09:15.465164+0000","last_deep_scrub":"60'380","last_deep_scrub_stamp":"2024-04-26T12:09:15.465164+0000","last_clean_scrub_stamp":"2024-04-26T12:09:15.465164+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:49.168939+0000","scrub_duration":0.0024038250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13036,"num_write":347,"num_write_kb":33880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"60'461","reported_seq":577,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:10.990827+0000","last_change":"2024-04-26T12:09:10.990934+0000","last_active":"2024-04-26T12:09:10.990827+0000","last_peered":"2024-04-26T12:09:10.990827+0000","last_clean":"2024-04-26T12:09:10.990827+0000","last_became_active":"2024-04-26T12:08:46.730738+0000","last_became_peered":"2024-04-26T12:08:46.730738+0000","last_unstale":"2024-04-26T12:09:10.990827+0000","last_undegraded":"2024-04-26T12:09:10.990827+0000","last_fullsized":"2024-04-26T12:09:10.990827+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'461","last_scrub_stamp":"2024-04-26T12:09:10.990803+0000","last_deep_scrub":"60'461","last_deep_scrub_stamp":"2024-04-26T12:09:10.990803+0000","last_clean_scrub_stamp":"2024-04-26T12:09:10.990803+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:12.887104+0000","scrub_duration":0.0025321039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":32945,"num_write":426,"num_write_kb":63234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"60'411","reported_seq":903,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244722+0000","last_change":"2024-04-26T12:08:40.704958+0000","last_active":"2024-04-26T12:09:05.244722+0000","last_peered":"2024-04-26T12:09:05.244722+0000","last_clean":"2024-04-26T12:09:05.244722+0000","last_became_active":"2024-04-26T12:08:40.703845+0000","last_became_peered":"2024-04-26T12:08:40.703845+0000","last_unstale":"2024-04-26T12:09:05.244722+0000","last_undegraded":"2024-04-26T12:09:05.244722+0000","last_fullsized":"2024-04-26T12:09:05.244722+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11499,"num_write":377,"num_write_kb":34249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'430","reported_seq":540,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124494+0000","last_change":"2024-04-26T12:05:03.791605+0000","last_active":"2024-04-26T12:09:06.124494+0000","last_peered":"2024-04-26T12:09:06.124494+0000","last_clean":"2024-04-26T12:09:06.124494+0000","last_became_active":"2024-04-26T12:05:03.791251+0000","last_became_peered":"2024-04-26T12:05:03.791251+0000","last_unstale":"2024-04-26T12:09:06.124494+0000","last_undegraded":"2024-04-26T12:09:06.124494+0000","last_fullsized":"2024-04-26T12:09:06.124494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14660,"num_write":404,"num_write_kb":60840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"60'392","reported_seq":501,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745266+0000","last_change":"2024-04-26T12:08:44.723861+0000","last_active":"2024-04-26T12:08:53.745266+0000","last_peered":"2024-04-26T12:08:53.745266+0000","last_clean":"2024-04-26T12:08:53.745266+0000","last_became_active":"2024-04-26T12:08:44.722120+0000","last_became_peered":"2024-04-26T12:08:44.722120+0000","last_unstale":"2024-04-26T12:08:53.745266+0000","last_undegraded":"2024-04-26T12:08:53.745266+0000","last_fullsized":"2024-04-26T12:08:53.745266+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31703,"num_write":351,"num_write_kb":59324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"59'514","reported_seq":593,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745959+0000","last_change":"2024-04-26T12:05:03.430021+0000","last_active":"2024-04-26T12:08:53.745959+0000","last_peered":"2024-04-26T12:08:53.745959+0000","last_clean":"2024-04-26T12:08:53.745959+0000","last_became_active":"2024-04-26T12:05:03.429695+0000","last_became_peered":"2024-04-26T12:05:03.429695+0000","last_unstale":"2024-04-26T12:08:53.745959+0000","last_undegraded":"2024-04-26T12:08:53.745959+0000","last_fullsized":"2024-04-26T12:08:53.745959+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":8377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'432","reported_seq":523,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.751653+0000","last_change":"2024-04-26T12:08:53.751086+0000","last_active":"2024-04-26T12:08:53.751653+0000","last_peered":"2024-04-26T12:08:53.751653+0000","last_clean":"2024-04-26T12:08:53.751653+0000","last_became_active":"2024-04-26T12:08:53.748972+0000","last_became_peered":"2024-04-26T12:08:53.748972+0000","last_unstale":"2024-04-26T12:08:53.751653+0000","last_undegraded":"2024-04-26T12:08:53.751653+0000","last_fullsized":"2024-04-26T12:08:53.751653+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":30094,"num_write":388,"num_write_kb":83741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"59'55","reported_seq":134,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745634+0000","last_change":"2024-04-26T12:05:03.428605+0000","last_active":"2024-04-26T12:08:53.745634+0000","last_peered":"2024-04-26T12:08:53.745634+0000","last_clean":"2024-04-26T12:08:53.745634+0000","last_became_active":"2024-04-26T12:05:03.428098+0000","last_became_peered":"2024-04-26T12:05:03.428098+0000","last_unstale":"2024-04-26T12:08:53.745634+0000","last_undegraded":"2024-04-26T12:08:53.745634+0000","last_fullsized":"2024-04-26T12:08:53.745634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"60'445","reported_seq":569,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:07.498466+0000","last_change":"2024-04-26T12:09:07.498568+0000","last_active":"2024-04-26T12:09:07.498466+0000","last_peered":"2024-04-26T12:09:07.498466+0000","last_clean":"2024-04-26T12:09:07.498466+0000","last_became_active":"2024-04-26T12:05:03.788039+0000","last_became_peered":"2024-04-26T12:05:03.788039+0000","last_unstale":"2024-04-26T12:09:07.498466+0000","last_undegraded":"2024-04-26T12:09:07.498466+0000","last_fullsized":"2024-04-26T12:09:07.498466+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'445","last_scrub_stamp":"2024-04-26T12:09:07.498444+0000","last_deep_scrub":"60'445","last_deep_scrub_stamp":"2024-04-26T12:09:07.498444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:07.498444+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:34:55.801469+0000","scrub_duration":0.002448759,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":16079,"num_write":410,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"59'64","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:23.224837+0000","last_change":"2024-04-26T12:09:23.224938+0000","last_active":"2024-04-26T12:09:23.224837+0000","last_peered":"2024-04-26T12:09:23.224837+0000","last_clean":"2024-04-26T12:09:23.224837+0000","last_became_active":"2024-04-26T12:08:36.694921+0000","last_became_peered":"2024-04-26T12:08:36.694921+0000","last_unstale":"2024-04-26T12:09:23.224837+0000","last_undegraded":"2024-04-26T12:09:23.224837+0000","last_fullsized":"2024-04-26T12:09:23.224837+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'64","last_scrub_stamp":"2024-04-26T12:09:23.224815+0000","last_deep_scrub":"59'64","last_deep_scrub_stamp":"2024-04-26T12:09:23.224815+0000","last_clean_scrub_stamp":"2024-04-26T12:09:23.224815+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:34.040977+0000","scrub_duration":0.0015803169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"60'420","reported_seq":538,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746363+0000","last_change":"2024-04-26T12:05:03.788505+0000","last_active":"2024-04-26T12:08:53.746363+0000","last_peered":"2024-04-26T12:08:53.746363+0000","last_clean":"2024-04-26T12:08:53.746363+0000","last_became_active":"2024-04-26T12:05:03.788184+0000","last_became_peered":"2024-04-26T12:05:03.788184+0000","last_unstale":"2024-04-26T12:08:53.746363+0000","last_undegraded":"2024-04-26T12:08:53.746363+0000","last_fullsized":"2024-04-26T12:08:53.746363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":14666,"num_write":383,"num_write_kb":83769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"60'63","reported_seq":156,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745520+0000","last_change":"2024-04-26T12:08:36.697126+0000","last_active":"2024-04-26T12:08:53.745520+0000","last_peered":"2024-04-26T12:08:53.745520+0000","last_clean":"2024-04-26T12:08:53.745520+0000","last_became_active":"2024-04-26T12:08:36.696792+0000","last_became_peered":"2024-04-26T12:08:36.696792+0000","last_unstale":"2024-04-26T12:08:53.745520+0000","last_undegraded":"2024-04-26T12:08:53.745520+0000","last_fullsized":"2024-04-26T12:08:53.745520+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"59'232","reported_seq":336,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746502+0000","last_change":"2024-04-26T12:08:39.703810+0000","last_active":"2024-04-26T12:08:53.746502+0000","last_peered":"2024-04-26T12:08:53.746502+0000","last_clean":"2024-04-26T12:08:53.746502+0000","last_became_active":"2024-04-26T12:08:39.703455+0000","last_became_peered":"2024-04-26T12:08:39.703455+0000","last_unstale":"2024-04-26T12:08:53.746502+0000","last_undegraded":"2024-04-26T12:08:53.746502+0000","last_fullsized":"2024-04-26T12:08:53.746502+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'408","reported_seq":492,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745191+0000","last_change":"2024-04-26T12:08:40.710236+0000","last_active":"2024-04-26T12:08:53.745191+0000","last_peered":"2024-04-26T12:08:53.745191+0000","last_clean":"2024-04-26T12:08:53.745191+0000","last_became_active":"2024-04-26T12:08:40.707357+0000","last_became_peered":"2024-04-26T12:08:40.707357+0000","last_unstale":"2024-04-26T12:08:53.745191+0000","last_undegraded":"2024-04-26T12:08:53.745191+0000","last_fullsized":"2024-04-26T12:08:53.745191+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12418,"num_write":371,"num_write_kb":58378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"59'302","reported_seq":371,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745635+0000","last_change":"2024-04-26T12:08:39.703949+0000","last_active":"2024-04-26T12:08:53.745635+0000","last_peered":"2024-04-26T12:08:53.745635+0000","last_clean":"2024-04-26T12:08:53.745635+0000","last_became_active":"2024-04-26T12:08:39.703421+0000","last_became_peered":"2024-04-26T12:08:39.703421+0000","last_unstale":"2024-04-26T12:08:53.745635+0000","last_undegraded":"2024-04-26T12:08:53.745635+0000","last_fullsized":"2024-04-26T12:08:53.745635+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":4228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'439","reported_seq":499,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.744895+0000","last_change":"2024-04-26T12:08:41.717923+0000","last_active":"2024-04-26T12:08:53.744895+0000","last_peered":"2024-04-26T12:08:53.744895+0000","last_clean":"2024-04-26T12:08:53.744895+0000","last_became_active":"2024-04-26T12:08:41.715708+0000","last_became_peered":"2024-04-26T12:08:41.715708+0000","last_unstale":"2024-04-26T12:08:53.744895+0000","last_undegraded":"2024-04-26T12:08:53.744895+0000","last_fullsized":"2024-04-26T12:08:53.744895+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":30851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"59'589","reported_seq":693,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746504+0000","last_change":"2024-04-26T12:08:39.703966+0000","last_active":"2024-04-26T12:08:53.746504+0000","last_peered":"2024-04-26T12:08:53.746504+0000","last_clean":"2024-04-26T12:08:53.746504+0000","last_became_active":"2024-04-26T12:08:39.703487+0000","last_became_peered":"2024-04-26T12:08:39.703487+0000","last_unstale":"2024-04-26T12:08:53.746504+0000","last_undegraded":"2024-04-26T12:08:53.746504+0000","last_fullsized":"2024-04-26T12:08:53.746504+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":534,"num_write_kb":4333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'461","reported_seq":616,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124331+0000","last_change":"2024-04-26T12:05:03.791809+0000","last_active":"2024-04-26T12:09:06.124331+0000","last_peered":"2024-04-26T12:09:06.124331+0000","last_clean":"2024-04-26T12:09:06.124331+0000","last_became_active":"2024-04-26T12:05:03.791272+0000","last_became_peered":"2024-04-26T12:05:03.791272+0000","last_unstale":"2024-04-26T12:09:06.124331+0000","last_undegraded":"2024-04-26T12:09:06.124331+0000","last_fullsized":"2024-04-26T12:09:06.124331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":46123,"num_write":422,"num_write_kb":104552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'66","reported_seq":145,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746261+0000","last_change":"2024-04-26T12:05:03.430224+0000","last_active":"2024-04-26T12:08:53.746261+0000","last_peered":"2024-04-26T12:08:53.746261+0000","last_clean":"2024-04-26T12:08:53.746261+0000","last_became_active":"2024-04-26T12:05:03.429291+0000","last_became_peered":"2024-04-26T12:05:03.429291+0000","last_unstale":"2024-04-26T12:08:53.746261+0000","last_undegraded":"2024-04-26T12:08:53.746261+0000","last_fullsized":"2024-04-26T12:08:53.746261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'428","reported_seq":542,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745787+0000","last_change":"2024-04-26T12:05:03.788174+0000","last_active":"2024-04-26T12:08:53.745787+0000","last_peered":"2024-04-26T12:08:53.745787+0000","last_clean":"2024-04-26T12:08:53.745787+0000","last_became_active":"2024-04-26T12:05:03.787772+0000","last_became_peered":"2024-04-26T12:05:03.787772+0000","last_unstale":"2024-04-26T12:08:53.745787+0000","last_undegraded":"2024-04-26T12:08:53.745787+0000","last_fullsized":"2024-04-26T12:08:53.745787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15098,"num_write":394,"num_write_kb":42677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"59'195","reported_seq":274,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746542+0000","last_change":"2024-04-26T12:05:03.431162+0000","last_active":"2024-04-26T12:08:53.746542+0000","last_peered":"2024-04-26T12:08:53.746542+0000","last_clean":"2024-04-26T12:08:53.746542+0000","last_became_active":"2024-04-26T12:05:03.430855+0000","last_became_peered":"2024-04-26T12:05:03.430855+0000","last_unstale":"2024-04-26T12:08:53.746542+0000","last_undegraded":"2024-04-26T12:08:53.746542+0000","last_fullsized":"2024-04-26T12:08:53.746542+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"60'448","reported_seq":545,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746130+0000","last_change":"2024-04-26T12:05:03.792357+0000","last_active":"2024-04-26T12:08:53.746130+0000","last_peered":"2024-04-26T12:08:53.746130+0000","last_clean":"2024-04-26T12:08:53.746130+0000","last_became_active":"2024-04-26T12:05:03.792119+0000","last_became_peered":"2024-04-26T12:05:03.792119+0000","last_unstale":"2024-04-26T12:08:53.746130+0000","last_undegraded":"2024-04-26T12:08:53.746130+0000","last_fullsized":"2024-04-26T12:08:53.746130+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":13281,"num_write":420,"num_write_kb":59540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"59'171","reported_seq":251,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124198+0000","last_change":"2024-04-26T12:05:03.429811+0000","last_active":"2024-04-26T12:09:06.124198+0000","last_peered":"2024-04-26T12:09:06.124198+0000","last_clean":"2024-04-26T12:09:06.124198+0000","last_became_active":"2024-04-26T12:05:03.429469+0000","last_became_peered":"2024-04-26T12:05:03.429469+0000","last_unstale":"2024-04-26T12:09:06.124198+0000","last_undegraded":"2024-04-26T12:09:06.124198+0000","last_fullsized":"2024-04-26T12:09:06.124198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'412","reported_seq":935,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:17.500646+0000","last_change":"2024-04-26T12:09:17.500764+0000","last_active":"2024-04-26T12:09:17.500646+0000","last_peered":"2024-04-26T12:09:17.500646+0000","last_clean":"2024-04-26T12:09:17.500646+0000","last_became_active":"2024-04-26T12:08:51.751044+0000","last_became_peered":"2024-04-26T12:08:51.751044+0000","last_unstale":"2024-04-26T12:09:17.500646+0000","last_undegraded":"2024-04-26T12:09:17.500646+0000","last_fullsized":"2024-04-26T12:09:17.500646+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'412","last_scrub_stamp":"2024-04-26T12:09:17.500623+0000","last_deep_scrub":"60'412","last_deep_scrub_stamp":"2024-04-26T12:09:17.500623+0000","last_clean_scrub_stamp":"2024-04-26T12:09:17.500623+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:05.606930+0000","scrub_duration":0.0024460179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26310,"num_write":380,"num_write_kb":38462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"59'55","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.744899+0000","last_change":"2024-04-26T12:08:36.695355+0000","last_active":"2024-04-26T12:08:53.744899+0000","last_peered":"2024-04-26T12:08:53.744899+0000","last_clean":"2024-04-26T12:08:53.744899+0000","last_became_active":"2024-04-26T12:08:36.694346+0000","last_became_peered":"2024-04-26T12:08:36.694346+0000","last_unstale":"2024-04-26T12:08:53.744899+0000","last_undegraded":"2024-04-26T12:08:53.744899+0000","last_fullsized":"2024-04-26T12:08:53.744899+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"60'362","reported_seq":818,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746390+0000","last_change":"2024-04-26T12:08:41.717048+0000","last_active":"2024-04-26T12:08:53.746390+0000","last_peered":"2024-04-26T12:08:53.746390+0000","last_clean":"2024-04-26T12:08:53.746390+0000","last_became_active":"2024-04-26T12:08:41.716102+0000","last_became_peered":"2024-04-26T12:08:41.716102+0000","last_unstale":"2024-04-26T12:08:53.746390+0000","last_undegraded":"2024-04-26T12:08:53.746390+0000","last_fullsized":"2024-04-26T12:08:53.746390+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21408,"num_write":333,"num_write_kb":66549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"59'378","reported_seq":440,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745101+0000","last_change":"2024-04-26T12:08:39.702797+0000","last_active":"2024-04-26T12:08:53.745101+0000","last_peered":"2024-04-26T12:08:53.745101+0000","last_clean":"2024-04-26T12:08:53.745101+0000","last_became_active":"2024-04-26T12:08:39.702438+0000","last_became_peered":"2024-04-26T12:08:39.702438+0000","last_unstale":"2024-04-26T12:08:53.745101+0000","last_undegraded":"2024-04-26T12:08:53.745101+0000","last_fullsized":"2024-04-26T12:08:53.745101+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"60'407","reported_seq":918,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746198+0000","last_change":"2024-04-26T12:08:45.724853+0000","last_active":"2024-04-26T12:08:53.746198+0000","last_peered":"2024-04-26T12:08:53.746198+0000","last_clean":"2024-04-26T12:08:53.746198+0000","last_became_active":"2024-04-26T12:08:45.723772+0000","last_became_peered":"2024-04-26T12:08:45.723772+0000","last_unstale":"2024-04-26T12:08:53.746198+0000","last_undegraded":"2024-04-26T12:08:53.746198+0000","last_fullsized":"2024-04-26T12:08:53.746198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":40156,"num_write":373,"num_write_kb":91285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":295,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:56.394757+0000","last_change":"2024-04-26T12:08:36.697892+0000","last_active":"2024-04-26T12:08:56.394757+0000","last_peered":"2024-04-26T12:08:56.394757+0000","last_clean":"2024-04-26T12:08:56.394757+0000","last_became_active":"2024-04-26T12:08:36.697508+0000","last_became_peered":"2024-04-26T12:08:36.697508+0000","last_unstale":"2024-04-26T12:08:56.394757+0000","last_undegraded":"2024-04-26T12:08:56.394757+0000","last_fullsized":"2024-04-26T12:08:56.394757+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_clean_scrub_stamp":"2024-04-26T12:04:52.376986+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":83,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124100+0000","last_change":"2024-04-26T12:04:59.403711+0000","last_active":"2024-04-26T12:09:06.124100+0000","last_peered":"2024-04-26T12:09:06.124100+0000","last_clean":"2024-04-26T12:09:06.124100+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:09:06.124100+0000","last_undegraded":"2024-04-26T12:09:06.124100+0000","last_fullsized":"2024-04-26T12:09:06.124100+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'793","reported_seq":899,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244338+0000","last_change":"2024-04-26T12:08:39.702225+0000","last_active":"2024-04-26T12:09:05.244338+0000","last_peered":"2024-04-26T12:09:05.244338+0000","last_clean":"2024-04-26T12:09:05.244338+0000","last_became_active":"2024-04-26T12:08:39.701760+0000","last_became_peered":"2024-04-26T12:08:39.701760+0000","last_unstale":"2024-04-26T12:09:05.244338+0000","last_undegraded":"2024-04-26T12:09:05.244338+0000","last_fullsized":"2024-04-26T12:09:05.244338+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":8533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"60'466","reported_seq":1014,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124322+0000","last_change":"2024-04-26T12:08:52.747463+0000","last_active":"2024-04-26T12:09:06.124322+0000","last_peered":"2024-04-26T12:09:06.124322+0000","last_clean":"2024-04-26T12:09:06.124322+0000","last_became_active":"2024-04-26T12:08:52.746147+0000","last_became_peered":"2024-04-26T12:08:52.746147+0000","last_unstale":"2024-04-26T12:09:06.124322+0000","last_undegraded":"2024-04-26T12:09:06.124322+0000","last_fullsized":"2024-04-26T12:09:06.124322+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":37547,"num_write":422,"num_write_kb":96579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:01.395373+0000","last_change":"2024-04-26T12:08:36.695759+0000","last_active":"2024-04-26T12:09:01.395373+0000","last_peered":"2024-04-26T12:09:01.395373+0000","last_clean":"2024-04-26T12:09:01.395373+0000","last_became_active":"2024-04-26T12:08:36.695444+0000","last_became_peered":"2024-04-26T12:08:36.695444+0000","last_unstale":"2024-04-26T12:09:01.395373+0000","last_undegraded":"2024-04-26T12:09:01.395373+0000","last_fullsized":"2024-04-26T12:09:01.395373+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"60'114","reported_seq":241,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244334+0000","last_change":"2024-04-26T12:05:03.428547+0000","last_active":"2024-04-26T12:09:05.244334+0000","last_peered":"2024-04-26T12:09:05.244334+0000","last_clean":"2024-04-26T12:09:05.244334+0000","last_became_active":"2024-04-26T12:05:03.427985+0000","last_became_peered":"2024-04-26T12:05:03.427985+0000","last_unstale":"2024-04-26T12:09:05.244334+0000","last_undegraded":"2024-04-26T12:09:05.244334+0000","last_fullsized":"2024-04-26T12:09:05.244334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466015,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":47,"num_write_kb":1464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"60'492","reported_seq":667,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.067124+0000","last_change":"2024-04-26T12:09:06.067244+0000","last_active":"2024-04-26T12:09:06.067124+0000","last_peered":"2024-04-26T12:09:06.067124+0000","last_clean":"2024-04-26T12:09:06.067124+0000","last_became_active":"2024-04-26T12:08:49.739496+0000","last_became_peered":"2024-04-26T12:08:49.739496+0000","last_unstale":"2024-04-26T12:09:06.067124+0000","last_undegraded":"2024-04-26T12:09:06.067124+0000","last_fullsized":"2024-04-26T12:09:06.067124+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'492","last_scrub_stamp":"2024-04-26T12:09:06.067102+0000","last_deep_scrub":"60'492","last_deep_scrub_stamp":"2024-04-26T12:09:06.067102+0000","last_clean_scrub_stamp":"2024-04-26T12:09:06.067102+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:55.504447+0000","scrub_duration":0.0024880229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":63988,"num_write":466,"num_write_kb":154489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":96,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244314+0000","last_change":"2024-04-26T12:08:36.696858+0000","last_active":"2024-04-26T12:09:05.244314+0000","last_peered":"2024-04-26T12:09:05.244314+0000","last_clean":"2024-04-26T12:09:05.244314+0000","last_became_active":"2024-04-26T12:08:36.696619+0000","last_became_peered":"2024-04-26T12:08:36.696619+0000","last_unstale":"2024-04-26T12:09:05.244314+0000","last_undegraded":"2024-04-26T12:09:05.244314+0000","last_fullsized":"2024-04-26T12:09:05.244314+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"59'325","reported_seq":387,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.744827+0000","last_change":"2024-04-26T12:08:39.704052+0000","last_active":"2024-04-26T12:08:53.744827+0000","last_peered":"2024-04-26T12:08:53.744827+0000","last_clean":"2024-04-26T12:08:53.744827+0000","last_became_active":"2024-04-26T12:08:39.703696+0000","last_became_peered":"2024-04-26T12:08:39.703696+0000","last_unstale":"2024-04-26T12:08:53.744827+0000","last_undegraded":"2024-04-26T12:08:53.744827+0000","last_fullsized":"2024-04-26T12:08:53.744827+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":8296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"60'359","reported_seq":787,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244590+0000","last_change":"2024-04-26T12:08:47.737443+0000","last_active":"2024-04-26T12:09:05.244590+0000","last_peered":"2024-04-26T12:09:05.244590+0000","last_clean":"2024-04-26T12:09:05.244590+0000","last_became_active":"2024-04-26T12:08:47.735729+0000","last_became_peered":"2024-04-26T12:08:47.735729+0000","last_unstale":"2024-04-26T12:09:05.244590+0000","last_undegraded":"2024-04-26T12:09:05.244590+0000","last_fullsized":"2024-04-26T12:09:05.244590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9448,"num_write":336,"num_write_kb":74900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":83,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124113+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:09:06.124113+0000","last_peered":"2024-04-26T12:09:06.124113+0000","last_clean":"2024-04-26T12:09:06.124113+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:09:06.124113+0000","last_undegraded":"2024-04-26T12:09:06.124113+0000","last_fullsized":"2024-04-26T12:09:06.124113+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"59'67","reported_seq":147,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124098+0000","last_change":"2024-04-26T12:05:03.430140+0000","last_active":"2024-04-26T12:09:06.124098+0000","last_peered":"2024-04-26T12:09:06.124098+0000","last_clean":"2024-04-26T12:09:06.124098+0000","last_became_active":"2024-04-26T12:05:03.429838+0000","last_became_peered":"2024-04-26T12:05:03.429838+0000","last_unstale":"2024-04-26T12:09:06.124098+0000","last_undegraded":"2024-04-26T12:09:06.124098+0000","last_fullsized":"2024-04-26T12:09:06.124098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"60'403","reported_seq":907,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:18.489116+0000","last_change":"2024-04-26T12:09:18.489255+0000","last_active":"2024-04-26T12:09:18.489116+0000","last_peered":"2024-04-26T12:09:18.489116+0000","last_clean":"2024-04-26T12:09:18.489116+0000","last_became_active":"2024-04-26T12:08:50.752366+0000","last_became_peered":"2024-04-26T12:08:50.752366+0000","last_unstale":"2024-04-26T12:09:18.489116+0000","last_undegraded":"2024-04-26T12:09:18.489116+0000","last_fullsized":"2024-04-26T12:09:18.489116+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'403","last_scrub_stamp":"2024-04-26T12:09:18.489093+0000","last_deep_scrub":"60'403","last_deep_scrub_stamp":"2024-04-26T12:09:18.489093+0000","last_clean_scrub_stamp":"2024-04-26T12:09:18.489093+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:04.607536+0000","scrub_duration":0.0022127980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30094,"num_write":370,"num_write_kb":104181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"59'469","reported_seq":549,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124182+0000","last_change":"2024-04-26T12:05:03.429673+0000","last_active":"2024-04-26T12:09:06.124182+0000","last_peered":"2024-04-26T12:09:06.124182+0000","last_clean":"2024-04-26T12:09:06.124182+0000","last_became_active":"2024-04-26T12:05:03.429146+0000","last_became_peered":"2024-04-26T12:05:03.429146+0000","last_unstale":"2024-04-26T12:09:06.124182+0000","last_undegraded":"2024-04-26T12:09:06.124182+0000","last_fullsized":"2024-04-26T12:09:06.124182+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244381+0000","last_change":"2024-04-26T12:08:36.697900+0000","last_active":"2024-04-26T12:09:05.244381+0000","last_peered":"2024-04-26T12:09:05.244381+0000","last_clean":"2024-04-26T12:09:05.244381+0000","last_became_active":"2024-04-26T12:08:36.697618+0000","last_became_peered":"2024-04-26T12:08:36.697618+0000","last_unstale":"2024-04-26T12:09:05.244381+0000","last_undegraded":"2024-04-26T12:09:05.244381+0000","last_fullsized":"2024-04-26T12:09:05.244381+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'354","reported_seq":414,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745417+0000","last_change":"2024-04-26T12:08:45.725751+0000","last_active":"2024-04-26T12:08:53.745417+0000","last_peered":"2024-04-26T12:08:53.745417+0000","last_clean":"2024-04-26T12:08:53.745417+0000","last_became_active":"2024-04-26T12:08:45.724153+0000","last_became_peered":"2024-04-26T12:08:45.724153+0000","last_unstale":"2024-04-26T12:08:53.745417+0000","last_undegraded":"2024-04-26T12:08:53.745417+0000","last_fullsized":"2024-04-26T12:08:53.745417+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":416,"num_write":319,"num_write_kb":17259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"59'53","reported_seq":146,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244394+0000","last_change":"2024-04-26T12:08:36.698122+0000","last_active":"2024-04-26T12:09:05.244394+0000","last_peered":"2024-04-26T12:09:05.244394+0000","last_clean":"2024-04-26T12:09:05.244394+0000","last_became_active":"2024-04-26T12:08:36.697832+0000","last_became_peered":"2024-04-26T12:08:36.697832+0000","last_unstale":"2024-04-26T12:09:05.244394+0000","last_undegraded":"2024-04-26T12:09:05.244394+0000","last_fullsized":"2024-04-26T12:09:05.244394+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745977+0000","last_change":"2024-04-26T12:08:36.698131+0000","last_active":"2024-04-26T12:08:53.745977+0000","last_peered":"2024-04-26T12:08:53.745977+0000","last_clean":"2024-04-26T12:08:53.745977+0000","last_became_active":"2024-04-26T12:08:36.697698+0000","last_became_peered":"2024-04-26T12:08:36.697698+0000","last_unstale":"2024-04-26T12:08:53.745977+0000","last_undegraded":"2024-04-26T12:08:53.745977+0000","last_fullsized":"2024-04-26T12:08:53.745977+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'399","reported_seq":478,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745182+0000","last_change":"2024-04-26T12:08:40.705752+0000","last_active":"2024-04-26T12:08:53.745182+0000","last_peered":"2024-04-26T12:08:53.745182+0000","last_clean":"2024-04-26T12:08:53.745182+0000","last_became_active":"2024-04-26T12:08:40.703906+0000","last_became_peered":"2024-04-26T12:08:40.703906+0000","last_unstale":"2024-04-26T12:08:53.745182+0000","last_undegraded":"2024-04-26T12:08:53.745182+0000","last_fullsized":"2024-04-26T12:08:53.745182+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11720,"num_write":363,"num_write_kb":66914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"59'65","reported_seq":159,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244441+0000","last_change":"2024-04-26T12:08:36.699388+0000","last_active":"2024-04-26T12:09:05.244441+0000","last_peered":"2024-04-26T12:09:05.244441+0000","last_clean":"2024-04-26T12:09:05.244441+0000","last_became_active":"2024-04-26T12:08:36.699058+0000","last_became_peered":"2024-04-26T12:08:36.699058+0000","last_unstale":"2024-04-26T12:09:05.244441+0000","last_undegraded":"2024-04-26T12:09:05.244441+0000","last_fullsized":"2024-04-26T12:09:05.244441+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244346+0000","last_change":"2024-04-26T12:08:36.697618+0000","last_active":"2024-04-26T12:09:05.244346+0000","last_peered":"2024-04-26T12:09:05.244346+0000","last_clean":"2024-04-26T12:09:05.244346+0000","last_became_active":"2024-04-26T12:08:36.697407+0000","last_became_peered":"2024-04-26T12:08:36.697407+0000","last_unstale":"2024-04-26T12:09:05.244346+0000","last_undegraded":"2024-04-26T12:09:05.244346+0000","last_fullsized":"2024-04-26T12:09:05.244346+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'424","reported_seq":543,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244516+0000","last_change":"2024-04-26T12:05:03.789623+0000","last_active":"2024-04-26T12:09:05.244516+0000","last_peered":"2024-04-26T12:09:05.244516+0000","last_clean":"2024-04-26T12:09:05.244516+0000","last_became_active":"2024-04-26T12:05:03.789390+0000","last_became_peered":"2024-04-26T12:05:03.789390+0000","last_unstale":"2024-04-26T12:09:05.244516+0000","last_undegraded":"2024-04-26T12:09:05.244516+0000","last_fullsized":"2024-04-26T12:09:05.244516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17027,"num_write":386,"num_write_kb":58797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"61'70","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244414+0000","last_change":"2024-04-26T12:05:03.429222+0000","last_active":"2024-04-26T12:09:05.244414+0000","last_peered":"2024-04-26T12:09:05.244414+0000","last_clean":"2024-04-26T12:09:05.244414+0000","last_became_active":"2024-04-26T12:05:03.428803+0000","last_became_peered":"2024-04-26T12:05:03.428803+0000","last_unstale":"2024-04-26T12:09:05.244414+0000","last_undegraded":"2024-04-26T12:09:05.244414+0000","last_fullsized":"2024-04-26T12:09:05.244414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124101+0000","last_change":"2024-04-26T12:08:36.698775+0000","last_active":"2024-04-26T12:09:06.124101+0000","last_peered":"2024-04-26T12:09:06.124101+0000","last_clean":"2024-04-26T12:09:06.124101+0000","last_became_active":"2024-04-26T12:08:36.698523+0000","last_became_peered":"2024-04-26T12:08:36.698523+0000","last_unstale":"2024-04-26T12:09:06.124101+0000","last_undegraded":"2024-04-26T12:09:06.124101+0000","last_fullsized":"2024-04-26T12:09:06.124101+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'393","reported_seq":473,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745147+0000","last_change":"2024-04-26T12:08:40.705662+0000","last_active":"2024-04-26T12:08:53.745147+0000","last_peered":"2024-04-26T12:08:53.745147+0000","last_clean":"2024-04-26T12:08:53.745147+0000","last_became_active":"2024-04-26T12:08:40.703873+0000","last_became_peered":"2024-04-26T12:08:40.703873+0000","last_unstale":"2024-04-26T12:08:53.745147+0000","last_undegraded":"2024-04-26T12:08:53.745147+0000","last_fullsized":"2024-04-26T12:08:53.745147+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":11991,"num_write":357,"num_write_kb":83226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'419","reported_seq":893,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745802+0000","last_change":"2024-04-26T12:08:44.723692+0000","last_active":"2024-04-26T12:08:53.745802+0000","last_peered":"2024-04-26T12:08:53.745802+0000","last_clean":"2024-04-26T12:08:53.745802+0000","last_became_active":"2024-04-26T12:08:44.722574+0000","last_became_peered":"2024-04-26T12:08:44.722574+0000","last_unstale":"2024-04-26T12:08:53.745802+0000","last_undegraded":"2024-04-26T12:08:53.745802+0000","last_fullsized":"2024-04-26T12:08:53.745802+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14983,"num_write":376,"num_write_kb":76749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"61'398","reported_seq":508,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746239+0000","last_change":"2024-04-26T12:08:39.703851+0000","last_active":"2024-04-26T12:08:53.746239+0000","last_peered":"2024-04-26T12:08:53.746239+0000","last_clean":"2024-04-26T12:08:53.746239+0000","last_became_active":"2024-04-26T12:08:39.703516+0000","last_became_peered":"2024-04-26T12:08:39.703516+0000","last_unstale":"2024-04-26T12:08:53.746239+0000","last_undegraded":"2024-04-26T12:08:53.746239+0000","last_fullsized":"2024-04-26T12:08:53.746239+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699266,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":9692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9692849,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'428","reported_seq":941,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745501+0000","last_change":"2024-04-26T12:08:50.753473+0000","last_active":"2024-04-26T12:08:53.745501+0000","last_peered":"2024-04-26T12:08:53.745501+0000","last_clean":"2024-04-26T12:08:53.745501+0000","last_became_active":"2024-04-26T12:08:50.752328+0000","last_became_peered":"2024-04-26T12:08:50.752328+0000","last_unstale":"2024-04-26T12:08:53.745501+0000","last_undegraded":"2024-04-26T12:08:53.745501+0000","last_fullsized":"2024-04-26T12:08:53.745501+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":26594,"num_write":396,"num_write_kb":67932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"60'91","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745643+0000","last_change":"2024-04-26T12:08:36.722607+0000","last_active":"2024-04-26T12:08:53.745643+0000","last_peered":"2024-04-26T12:08:53.745643+0000","last_clean":"2024-04-26T12:08:53.745643+0000","last_became_active":"2024-04-26T12:08:36.697650+0000","last_became_peered":"2024-04-26T12:08:36.697650+0000","last_unstale":"2024-04-26T12:08:53.745643+0000","last_undegraded":"2024-04-26T12:08:53.745643+0000","last_fullsized":"2024-04-26T12:08:53.745643+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"59'316","reported_seq":395,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746488+0000","last_change":"2024-04-26T12:05:03.429257+0000","last_active":"2024-04-26T12:08:53.746488+0000","last_peered":"2024-04-26T12:08:53.746488+0000","last_clean":"2024-04-26T12:08:53.746488+0000","last_became_active":"2024-04-26T12:05:03.428921+0000","last_became_peered":"2024-04-26T12:05:03.428921+0000","last_unstale":"2024-04-26T12:08:53.746488+0000","last_undegraded":"2024-04-26T12:08:53.746488+0000","last_fullsized":"2024-04-26T12:08:53.746488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'495","reported_seq":637,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:25.547273+0000","last_change":"2024-04-26T12:09:25.547380+0000","last_active":"2024-04-26T12:09:25.547273+0000","last_peered":"2024-04-26T12:09:25.547273+0000","last_clean":"2024-04-26T12:09:25.547273+0000","last_became_active":"2024-04-26T12:05:03.787533+0000","last_became_peered":"2024-04-26T12:05:03.787533+0000","last_unstale":"2024-04-26T12:09:25.547273+0000","last_undegraded":"2024-04-26T12:09:25.547273+0000","last_fullsized":"2024-04-26T12:09:25.547273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'495","last_scrub_stamp":"2024-04-26T12:09:25.547250+0000","last_deep_scrub":"60'495","last_deep_scrub_stamp":"2024-04-26T12:09:25.547250+0000","last_clean_scrub_stamp":"2024-04-26T12:09:25.547250+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:52.939986+0000","scrub_duration":0.002519252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37174,"num_write":458,"num_write_kb":125832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'51","reported_seq":130,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746551+0000","last_change":"2024-04-26T12:05:03.428971+0000","last_active":"2024-04-26T12:08:53.746551+0000","last_peered":"2024-04-26T12:08:53.746551+0000","last_clean":"2024-04-26T12:08:53.746551+0000","last_became_active":"2024-04-26T12:05:03.428445+0000","last_became_peered":"2024-04-26T12:05:03.428445+0000","last_unstale":"2024-04-26T12:08:53.746551+0000","last_undegraded":"2024-04-26T12:08:53.746551+0000","last_fullsized":"2024-04-26T12:08:53.746551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'482","reported_seq":1131,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745376+0000","last_change":"2024-04-26T12:08:48.741589+0000","last_active":"2024-04-26T12:08:53.745376+0000","last_peered":"2024-04-26T12:08:53.745376+0000","last_clean":"2024-04-26T12:08:53.745376+0000","last_became_active":"2024-04-26T12:08:48.740055+0000","last_became_peered":"2024-04-26T12:08:48.740055+0000","last_unstale":"2024-04-26T12:08:53.745376+0000","last_undegraded":"2024-04-26T12:08:53.745376+0000","last_fullsized":"2024-04-26T12:08:53.745376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":61972,"num_write":459,"num_write_kb":125797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"60'392","reported_seq":528,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745849+0000","last_change":"2024-04-26T12:08:43.718939+0000","last_active":"2024-04-26T12:08:53.745849+0000","last_peered":"2024-04-26T12:08:53.745849+0000","last_clean":"2024-04-26T12:08:53.745849+0000","last_became_active":"2024-04-26T12:08:43.717109+0000","last_became_peered":"2024-04-26T12:08:43.717109+0000","last_unstale":"2024-04-26T12:08:53.745849+0000","last_undegraded":"2024-04-26T12:08:53.745849+0000","last_fullsized":"2024-04-26T12:08:53.745849+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":37910,"num_write":366,"num_write_kb":84111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"59'709","reported_seq":814,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745562+0000","last_change":"2024-04-26T12:08:39.701978+0000","last_active":"2024-04-26T12:08:53.745562+0000","last_peered":"2024-04-26T12:08:53.745562+0000","last_clean":"2024-04-26T12:08:53.745562+0000","last_became_active":"2024-04-26T12:08:39.700927+0000","last_became_peered":"2024-04-26T12:08:39.700927+0000","last_unstale":"2024-04-26T12:08:53.745562+0000","last_undegraded":"2024-04-26T12:08:53.745562+0000","last_fullsized":"2024-04-26T12:08:53.745562+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"60'435","reported_seq":574,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244727+0000","last_change":"2024-04-26T12:05:03.788754+0000","last_active":"2024-04-26T12:09:05.244727+0000","last_peered":"2024-04-26T12:09:05.244727+0000","last_clean":"2024-04-26T12:09:05.244727+0000","last_became_active":"2024-04-26T12:05:03.788311+0000","last_became_peered":"2024-04-26T12:05:03.788311+0000","last_unstale":"2024-04-26T12:09:05.244727+0000","last_undegraded":"2024-04-26T12:09:05.244727+0000","last_fullsized":"2024-04-26T12:09:05.244727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":28462,"num_write":403,"num_write_kb":93779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"59'262","reported_seq":341,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745608+0000","last_change":"2024-04-26T12:05:03.428810+0000","last_active":"2024-04-26T12:08:53.745608+0000","last_peered":"2024-04-26T12:08:53.745608+0000","last_clean":"2024-04-26T12:08:53.745608+0000","last_became_active":"2024-04-26T12:05:03.428191+0000","last_became_peered":"2024-04-26T12:05:03.428191+0000","last_unstale":"2024-04-26T12:08:53.745608+0000","last_undegraded":"2024-04-26T12:08:53.745608+0000","last_fullsized":"2024-04-26T12:08:53.745608+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"60'399","reported_seq":500,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745543+0000","last_change":"2024-04-26T12:08:49.742459+0000","last_active":"2024-04-26T12:08:53.745543+0000","last_peered":"2024-04-26T12:08:53.745543+0000","last_clean":"2024-04-26T12:08:53.745543+0000","last_became_active":"2024-04-26T12:08:49.740536+0000","last_became_peered":"2024-04-26T12:08:49.740536+0000","last_unstale":"2024-04-26T12:08:53.745543+0000","last_undegraded":"2024-04-26T12:08:53.745543+0000","last_fullsized":"2024-04-26T12:08:53.745543+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22216,"num_write":357,"num_write_kb":75245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"59'430","reported_seq":491,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745190+0000","last_change":"2024-04-26T12:08:39.703050+0000","last_active":"2024-04-26T12:08:53.745190+0000","last_peered":"2024-04-26T12:08:53.745190+0000","last_clean":"2024-04-26T12:08:53.745190+0000","last_became_active":"2024-04-26T12:08:39.702529+0000","last_became_peered":"2024-04-26T12:08:39.702529+0000","last_unstale":"2024-04-26T12:08:53.745190+0000","last_undegraded":"2024-04-26T12:08:53.745190+0000","last_fullsized":"2024-04-26T12:08:53.745190+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":12514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"60'387","reported_seq":477,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745437+0000","last_change":"2024-04-26T12:08:43.720098+0000","last_active":"2024-04-26T12:08:53.745437+0000","last_peered":"2024-04-26T12:08:53.745437+0000","last_clean":"2024-04-26T12:08:53.745437+0000","last_became_active":"2024-04-26T12:08:43.717442+0000","last_became_peered":"2024-04-26T12:08:43.717442+0000","last_unstale":"2024-04-26T12:08:53.745437+0000","last_undegraded":"2024-04-26T12:08:53.745437+0000","last_fullsized":"2024-04-26T12:08:53.745437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20720,"num_write":352,"num_write_kb":87643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"59'58","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745139+0000","last_change":"2024-04-26T12:08:36.720540+0000","last_active":"2024-04-26T12:08:53.745139+0000","last_peered":"2024-04-26T12:08:53.745139+0000","last_clean":"2024-04-26T12:08:53.745139+0000","last_became_active":"2024-04-26T12:08:36.693399+0000","last_became_peered":"2024-04-26T12:08:36.693399+0000","last_unstale":"2024-04-26T12:08:53.745139+0000","last_undegraded":"2024-04-26T12:08:53.745139+0000","last_fullsized":"2024-04-26T12:08:53.745139+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"60'356","reported_seq":453,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745770+0000","last_change":"2024-04-26T12:05:03.791986+0000","last_active":"2024-04-26T12:08:53.745770+0000","last_peered":"2024-04-26T12:08:53.745770+0000","last_clean":"2024-04-26T12:08:53.745770+0000","last_became_active":"2024-04-26T12:05:03.790823+0000","last_became_peered":"2024-04-26T12:05:03.790823+0000","last_unstale":"2024-04-26T12:08:53.745770+0000","last_undegraded":"2024-04-26T12:08:53.745770+0000","last_fullsized":"2024-04-26T12:08:53.745770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9641,"num_write":326,"num_write_kb":29574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"59'309","reported_seq":388,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746111+0000","last_change":"2024-04-26T12:05:03.429469+0000","last_active":"2024-04-26T12:08:53.746111+0000","last_peered":"2024-04-26T12:08:53.746111+0000","last_clean":"2024-04-26T12:08:53.746111+0000","last_became_active":"2024-04-26T12:05:03.429015+0000","last_became_peered":"2024-04-26T12:05:03.429015+0000","last_unstale":"2024-04-26T12:08:53.746111+0000","last_undegraded":"2024-04-26T12:08:53.746111+0000","last_fullsized":"2024-04-26T12:08:53.746111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'433","reported_seq":576,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745849+0000","last_change":"2024-04-26T12:05:03.791929+0000","last_active":"2024-04-26T12:08:53.745849+0000","last_peered":"2024-04-26T12:08:53.745849+0000","last_clean":"2024-04-26T12:08:53.745849+0000","last_became_active":"2024-04-26T12:05:03.791540+0000","last_became_peered":"2024-04-26T12:05:03.791540+0000","last_unstale":"2024-04-26T12:08:53.745849+0000","last_undegraded":"2024-04-26T12:08:53.745849+0000","last_fullsized":"2024-04-26T12:08:53.745849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":47864,"num_write":399,"num_write_kb":92193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"59'382","reported_seq":450,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745440+0000","last_change":"2024-04-26T12:08:39.704680+0000","last_active":"2024-04-26T12:08:53.745440+0000","last_peered":"2024-04-26T12:08:53.745440+0000","last_clean":"2024-04-26T12:08:53.745440+0000","last_became_active":"2024-04-26T12:08:39.704404+0000","last_became_peered":"2024-04-26T12:08:39.704404+0000","last_unstale":"2024-04-26T12:08:53.745440+0000","last_undegraded":"2024-04-26T12:08:53.745440+0000","last_fullsized":"2024-04-26T12:08:53.745440+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":12467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'425","reported_seq":556,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:18.179708+0000","last_change":"2024-04-26T12:09:18.179810+0000","last_active":"2024-04-26T12:09:18.179708+0000","last_peered":"2024-04-26T12:09:18.179708+0000","last_clean":"2024-04-26T12:09:18.179708+0000","last_became_active":"2024-04-26T12:08:47.735367+0000","last_became_peered":"2024-04-26T12:08:47.735367+0000","last_unstale":"2024-04-26T12:09:18.179708+0000","last_undegraded":"2024-04-26T12:09:18.179708+0000","last_fullsized":"2024-04-26T12:09:18.179708+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'425","last_scrub_stamp":"2024-04-26T12:09:18.179684+0000","last_deep_scrub":"60'425","last_deep_scrub_stamp":"2024-04-26T12:09:18.179684+0000","last_clean_scrub_stamp":"2024-04-26T12:09:18.179684+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:20.520222+0000","scrub_duration":0.0024613230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":38065,"num_write":387,"num_write_kb":71445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"84'127","reported_seq":243,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:21.540633+0000","last_change":"2024-04-26T12:09:21.540746+0000","last_active":"2024-04-26T12:09:21.540633+0000","last_peered":"2024-04-26T12:09:21.540633+0000","last_clean":"2024-04-26T12:09:21.540633+0000","last_became_active":"2024-04-26T12:08:39.701900+0000","last_became_peered":"2024-04-26T12:08:39.701900+0000","last_unstale":"2024-04-26T12:09:21.540633+0000","last_undegraded":"2024-04-26T12:09:21.540633+0000","last_fullsized":"2024-04-26T12:09:21.540633+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'127","last_scrub_stamp":"2024-04-26T12:09:21.540611+0000","last_deep_scrub":"84'127","last_deep_scrub_stamp":"2024-04-26T12:09:21.540611+0000","last_clean_scrub_stamp":"2024-04-26T12:09:21.540611+0000","objects_scrubbed":1,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:30.101109+0000","scrub_duration":0.0098993390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"60'448","reported_seq":549,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745595+0000","last_change":"2024-04-26T12:05:03.791827+0000","last_active":"2024-04-26T12:08:53.745595+0000","last_peered":"2024-04-26T12:08:53.745595+0000","last_clean":"2024-04-26T12:08:53.745595+0000","last_became_active":"2024-04-26T12:05:03.791442+0000","last_became_peered":"2024-04-26T12:05:03.791442+0000","last_unstale":"2024-04-26T12:08:53.745595+0000","last_undegraded":"2024-04-26T12:08:53.745595+0000","last_fullsized":"2024-04-26T12:08:53.745595+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11191,"num_write":416,"num_write_kb":67272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"84'59","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:17.505129+0000","last_change":"2024-04-26T12:09:17.505233+0000","last_active":"2024-04-26T12:09:17.505129+0000","last_peered":"2024-04-26T12:09:17.505129+0000","last_clean":"2024-04-26T12:09:17.505129+0000","last_became_active":"2024-04-26T12:05:03.430164+0000","last_became_peered":"2024-04-26T12:05:03.430164+0000","last_unstale":"2024-04-26T12:09:17.505129+0000","last_undegraded":"2024-04-26T12:09:17.505129+0000","last_fullsized":"2024-04-26T12:09:17.505129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'59","last_scrub_stamp":"2024-04-26T12:09:17.505103+0000","last_deep_scrub":"84'59","last_deep_scrub_stamp":"2024-04-26T12:09:17.505103+0000","last_clean_scrub_stamp":"2024-04-26T12:09:17.505103+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:36.608825+0000","scrub_duration":0.012259582999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2734,"num_read_kb":1486856,"num_write":24627,"num_write_kb":4487808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7440,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26722,"ondisk_log_size":26722,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128606591,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":5972,"num_write_kb":129691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64376832,"data_stored":257213182,"data_compressed":19249503,"data_compressed_allocated":31694848,"data_compressed_original":224591872,"omap_allocated":4411,"internal_metadata":0},"log_size":7832,"ondisk_log_size":7832,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738428,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134428,"kb_used_data":27092,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94237412,"statfs":{"total":96636764160,"available":96499109888,"internally_reserved":0,"allocated":27742208,"data_stored":91797602,"data_compressed":6340284,"data_compressed_allocated":11272192,"data_compressed_original":75763712,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:09:01 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.40500000000000003,"15min":0.438},"min":{"1min":0.254,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.40200000000000002,"15min":0.42699999999999999},"min":{"1min":0.26900000000000002,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.44}]},{"osd":1,"last update":"Fri Apr 26 12:05:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.53800000000000003}]}]},{"osd":1,"up_from":66,"seq":283467841548,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68508,"kb_used_data":10644,"kb_used_omap":5,"kb_used_meta":57850,"kb_avail":94303332,"statfs":{"total":96636764160,"available":96566611968,"internally_reserved":0,"allocated":10899456,"data_stored":86136667,"data_compressed":7182940,"data_compressed_allocated":10076160,"data_compressed_original":85745664,"omap_allocated":6005,"internal_metadata":59238539},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738428,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138884,"kb_used_data":27452,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232956,"statfs":{"total":96636764160,"available":96494546944,"internally_reserved":0,"allocated":28110848,"data_stored":81507786,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:05:55 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.5}]},{"osd":2,"last update":"Fri Apr 26 12:09:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.437},"min":{"1min":0.29199999999999998,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.63200000000000001,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.435,"15min":0.433},"min":{"1min":0.32900000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.65800000000000003,"5min":1.976,"15min":1.976},"last":0.64500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27357184,"data_stored":81158407,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10088448,"data_stored":85196920,"data_compressed":7176942,"data_compressed_allocated":10039296,"data_compressed_original":85172224,"omap_allocated":4411,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26931200,"data_stored":90857855,"data_compressed":6334286,"data_compressed_allocated":11235328,"data_compressed_original":75190272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:09:26.794 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.794 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.795 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.795 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.795 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.795 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.795 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.795 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.795 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.795 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.795 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.796 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.796 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.796 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.796 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.796 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.796 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.796 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.796 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.796 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.796 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.797 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.797 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.797 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.797 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.797 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.797 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.797 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.797 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.797 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.798 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.798 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.798 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.798 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.798 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.798 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.798 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.798 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.799 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.799 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.799 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.799 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.799 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.799 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:04:52.376986+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.799 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.799 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.799 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.799 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.800 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.800 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.800 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.800 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.800 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.800 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.800 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.800 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.800 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.801 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.801 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.801 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.801 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.801 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.801 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.801 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.801 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.802 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.802 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.802 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.802 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.802 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.802 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.802 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.802 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.802 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.803 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.803 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.803 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.803 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.803 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.803 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.803 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.803 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.803 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.804 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.804 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.804 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:26.804 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:09:46.805 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:09:47.121 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:09:47.123 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:09:47.132 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":230,"stamp":"2024-04-26T12:09:46.405899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129196959,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2917,"num_read_kb":1488438,"num_write":30802,"num_write_kb":4620959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7463,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34721,"ondisk_log_size":34721,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":341820,"kb_used_data":65188,"kb_used_omap":8,"kb_used_meta":276599,"kb_avail":282773700,"statfs":{"total":289910292480,"available":289560268800,"internally_reserved":0,"allocated":66752512,"data_stored":259442055,"data_compressed":19261499,"data_compressed_allocated":31768576,"data_compressed_original":225738752,"omap_allocated":9193,"internal_metadata":283237399},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003335"},"pg_stats":[{"pgid":"4.3f","version":"60'426","reported_seq":508,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746133+0000","last_change":"2024-04-26T12:08:51.753936+0000","last_active":"2024-04-26T12:08:53.746133+0000","last_peered":"2024-04-26T12:08:53.746133+0000","last_clean":"2024-04-26T12:08:53.746133+0000","last_became_active":"2024-04-26T12:08:51.750917+0000","last_became_peered":"2024-04-26T12:08:51.750917+0000","last_unstale":"2024-04-26T12:08:53.746133+0000","last_undegraded":"2024-04-26T12:08:53.746133+0000","last_fullsized":"2024-04-26T12:08:53.746133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9964,"num_write":393,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"60'470","reported_seq":602,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745918+0000","last_change":"2024-04-26T12:08:43.719204+0000","last_active":"2024-04-26T12:08:53.745918+0000","last_peered":"2024-04-26T12:08:53.745918+0000","last_clean":"2024-04-26T12:08:53.745918+0000","last_became_active":"2024-04-26T12:08:43.717325+0000","last_became_peered":"2024-04-26T12:08:43.717325+0000","last_unstale":"2024-04-26T12:08:53.745918+0000","last_undegraded":"2024-04-26T12:08:53.745918+0000","last_fullsized":"2024-04-26T12:08:53.745918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":34556,"num_write":444,"num_write_kb":129697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"60'370","reported_seq":804,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124711+0000","last_change":"2024-04-26T12:08:50.753639+0000","last_active":"2024-04-26T12:09:06.124711+0000","last_peered":"2024-04-26T12:09:06.124711+0000","last_clean":"2024-04-26T12:09:06.124711+0000","last_became_active":"2024-04-26T12:08:50.752468+0000","last_became_peered":"2024-04-26T12:08:50.752468+0000","last_unstale":"2024-04-26T12:09:06.124711+0000","last_undegraded":"2024-04-26T12:09:06.124711+0000","last_fullsized":"2024-04-26T12:09:06.124711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":349,"num_write_kb":51115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"60'377","reported_seq":487,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124688+0000","last_change":"2024-04-26T12:05:03.791234+0000","last_active":"2024-04-26T12:09:06.124688+0000","last_peered":"2024-04-26T12:09:06.124688+0000","last_clean":"2024-04-26T12:09:06.124688+0000","last_became_active":"2024-04-26T12:05:03.790717+0000","last_became_peered":"2024-04-26T12:05:03.790717+0000","last_unstale":"2024-04-26T12:09:06.124688+0000","last_undegraded":"2024-04-26T12:09:06.124688+0000","last_fullsized":"2024-04-26T12:09:06.124688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17376,"num_write":341,"num_write_kb":46680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'445","reported_seq":562,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:42.047300+0000","last_change":"2024-04-26T12:09:42.047407+0000","last_active":"2024-04-26T12:09:42.047300+0000","last_peered":"2024-04-26T12:09:42.047300+0000","last_clean":"2024-04-26T12:09:42.047300+0000","last_became_active":"2024-04-26T12:08:39.702117+0000","last_became_peered":"2024-04-26T12:08:39.702117+0000","last_unstale":"2024-04-26T12:09:42.047300+0000","last_undegraded":"2024-04-26T12:09:42.047300+0000","last_fullsized":"2024-04-26T12:09:42.047300+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'445","last_scrub_stamp":"2024-04-26T12:09:42.047279+0000","last_deep_scrub":"60'445","last_deep_scrub_stamp":"2024-04-26T12:09:42.047279+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.047279+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:26.392089+0000","scrub_duration":0.0023237290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24197,"num_write":416,"num_write_kb":80466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"60'375","reported_seq":471,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745522+0000","last_change":"2024-04-26T12:05:03.791560+0000","last_active":"2024-04-26T12:08:53.745522+0000","last_peered":"2024-04-26T12:08:53.745522+0000","last_clean":"2024-04-26T12:08:53.745522+0000","last_became_active":"2024-04-26T12:05:03.790578+0000","last_became_peered":"2024-04-26T12:05:03.790578+0000","last_unstale":"2024-04-26T12:08:53.745522+0000","last_undegraded":"2024-04-26T12:08:53.745522+0000","last_fullsized":"2024-04-26T12:08:53.745522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6518,"num_write":348,"num_write_kb":38078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'428","reported_seq":536,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:18.488561+0000","last_change":"2024-04-26T12:09:18.488710+0000","last_active":"2024-04-26T12:09:18.488561+0000","last_peered":"2024-04-26T12:09:18.488561+0000","last_clean":"2024-04-26T12:09:18.488561+0000","last_became_active":"2024-04-26T12:05:03.790615+0000","last_became_peered":"2024-04-26T12:05:03.790615+0000","last_unstale":"2024-04-26T12:09:18.488561+0000","last_undegraded":"2024-04-26T12:09:18.488561+0000","last_fullsized":"2024-04-26T12:09:18.488561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'428","last_scrub_stamp":"2024-04-26T12:09:18.488526+0000","last_deep_scrub":"60'428","last_deep_scrub_stamp":"2024-04-26T12:09:18.488526+0000","last_clean_scrub_stamp":"2024-04-26T12:09:18.488526+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:22.049575+0000","scrub_duration":0.0025858650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12560,"num_write":398,"num_write_kb":67332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"60'387","reported_seq":527,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745325+0000","last_change":"2024-04-26T12:05:03.785861+0000","last_active":"2024-04-26T12:08:53.745325+0000","last_peered":"2024-04-26T12:08:53.745325+0000","last_clean":"2024-04-26T12:08:53.745325+0000","last_became_active":"2024-04-26T12:05:03.785382+0000","last_became_peered":"2024-04-26T12:05:03.785382+0000","last_unstale":"2024-04-26T12:08:53.745325+0000","last_undegraded":"2024-04-26T12:08:53.745325+0000","last_fullsized":"2024-04-26T12:08:53.745325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":41160,"num_write":356,"num_write_kb":80219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"60'405","reported_seq":901,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746094+0000","last_change":"2024-04-26T12:08:46.730220+0000","last_active":"2024-04-26T12:08:53.746094+0000","last_peered":"2024-04-26T12:08:53.746094+0000","last_clean":"2024-04-26T12:08:53.746094+0000","last_became_active":"2024-04-26T12:08:46.729039+0000","last_became_peered":"2024-04-26T12:08:46.729039+0000","last_unstale":"2024-04-26T12:08:53.746094+0000","last_undegraded":"2024-04-26T12:08:53.746094+0000","last_fullsized":"2024-04-26T12:08:53.746094+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":11674,"num_write":372,"num_write_kb":34604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"60'425","reported_seq":589,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:28.089237+0000","last_change":"2024-04-26T12:09:28.089362+0000","last_active":"2024-04-26T12:09:28.089237+0000","last_peered":"2024-04-26T12:09:28.089237+0000","last_clean":"2024-04-26T12:09:28.089237+0000","last_became_active":"2024-04-26T12:08:41.716014+0000","last_became_peered":"2024-04-26T12:08:41.716014+0000","last_unstale":"2024-04-26T12:09:28.089237+0000","last_undegraded":"2024-04-26T12:09:28.089237+0000","last_fullsized":"2024-04-26T12:09:28.089237+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'425","last_scrub_stamp":"2024-04-26T12:09:28.089215+0000","last_deep_scrub":"60'425","last_deep_scrub_stamp":"2024-04-26T12:09:28.089215+0000","last_clean_scrub_stamp":"2024-04-26T12:09:28.089215+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:31.039189+0000","scrub_duration":0.0021431470000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":48419,"num_write":390,"num_write_kb":92286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"60'372","reported_seq":490,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746199+0000","last_change":"2024-04-26T12:05:03.791046+0000","last_active":"2024-04-26T12:08:53.746199+0000","last_peered":"2024-04-26T12:08:53.746199+0000","last_clean":"2024-04-26T12:08:53.746199+0000","last_became_active":"2024-04-26T12:05:03.790662+0000","last_became_peered":"2024-04-26T12:05:03.790662+0000","last_unstale":"2024-04-26T12:08:53.746199+0000","last_undegraded":"2024-04-26T12:08:53.746199+0000","last_fullsized":"2024-04-26T12:08:53.746199+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25905,"num_write":353,"num_write_kb":75437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'351","reported_seq":438,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:08.024810+0000","last_change":"2024-04-26T12:09:08.024919+0000","last_active":"2024-04-26T12:09:08.024810+0000","last_peered":"2024-04-26T12:09:08.024810+0000","last_clean":"2024-04-26T12:09:08.024810+0000","last_became_active":"2024-04-26T12:08:41.715726+0000","last_became_peered":"2024-04-26T12:08:41.715726+0000","last_unstale":"2024-04-26T12:09:08.024810+0000","last_undegraded":"2024-04-26T12:09:08.024810+0000","last_fullsized":"2024-04-26T12:09:08.024810+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'351","last_scrub_stamp":"2024-04-26T12:09:08.024789+0000","last_deep_scrub":"60'351","last_deep_scrub_stamp":"2024-04-26T12:09:08.024789+0000","last_clean_scrub_stamp":"2024-04-26T12:09:08.024789+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:15.481742+0000","scrub_duration":0.0022688909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8884,"num_write":327,"num_write_kb":58289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"60'405","reported_seq":497,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:19.190020+0000","last_change":"2024-04-26T12:09:19.190112+0000","last_active":"2024-04-26T12:09:19.190020+0000","last_peered":"2024-04-26T12:09:19.190020+0000","last_clean":"2024-04-26T12:09:19.190020+0000","last_became_active":"2024-04-26T12:08:39.702141+0000","last_became_peered":"2024-04-26T12:08:39.702141+0000","last_unstale":"2024-04-26T12:09:19.190020+0000","last_undegraded":"2024-04-26T12:09:19.190020+0000","last_fullsized":"2024-04-26T12:09:19.190020+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'405","last_scrub_stamp":"2024-04-26T12:09:19.189997+0000","last_deep_scrub":"60'405","last_deep_scrub_stamp":"2024-04-26T12:09:19.189997+0000","last_clean_scrub_stamp":"2024-04-26T12:09:19.189997+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:45:38.242862+0000","scrub_duration":0.0019966300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6771,"num_write":372,"num_write_kb":54786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"60'431","reported_seq":950,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:21.555659+0000","last_change":"2024-04-26T12:09:21.555659+0000","last_active":"2024-04-26T12:09:21.555659+0000","last_peered":"2024-04-26T12:09:21.555659+0000","last_clean":"2024-04-26T12:09:21.555659+0000","last_became_active":"2024-04-26T12:08:48.740170+0000","last_became_peered":"2024-04-26T12:08:48.740170+0000","last_unstale":"2024-04-26T12:09:21.555659+0000","last_undegraded":"2024-04-26T12:09:21.555659+0000","last_fullsized":"2024-04-26T12:09:21.555659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'431","last_scrub_stamp":"2024-04-26T12:09:21.555526+0000","last_deep_scrub":"60'431","last_deep_scrub_stamp":"2024-04-26T12:09:21.555526+0000","last_clean_scrub_stamp":"2024-04-26T12:09:21.555526+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:09.119328+0000","scrub_duration":0.0022972299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26572,"num_write":398,"num_write_kb":83974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'394","reported_seq":909,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:35.716715+0000","last_change":"2024-04-26T12:09:35.716715+0000","last_active":"2024-04-26T12:09:35.716715+0000","last_peered":"2024-04-26T12:09:35.716715+0000","last_clean":"2024-04-26T12:09:35.716715+0000","last_became_active":"2024-04-26T12:08:41.715956+0000","last_became_peered":"2024-04-26T12:08:41.715956+0000","last_unstale":"2024-04-26T12:09:35.716715+0000","last_undegraded":"2024-04-26T12:09:35.716715+0000","last_fullsized":"2024-04-26T12:09:35.716715+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'394","last_scrub_stamp":"2024-04-26T12:09:35.716594+0000","last_deep_scrub":"60'394","last_deep_scrub_stamp":"2024-04-26T12:09:35.716594+0000","last_clean_scrub_stamp":"2024-04-26T12:09:35.716594+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:28.908858+0000","scrub_duration":0.0029063209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":38136,"num_write":355,"num_write_kb":38484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'432","reported_seq":556,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:07.460951+0000","last_change":"2024-04-26T12:09:07.460951+0000","last_active":"2024-04-26T12:09:07.460951+0000","last_peered":"2024-04-26T12:09:07.460951+0000","last_clean":"2024-04-26T12:09:07.460951+0000","last_became_active":"2024-04-26T12:05:03.785991+0000","last_became_peered":"2024-04-26T12:05:03.785991+0000","last_unstale":"2024-04-26T12:09:07.460951+0000","last_undegraded":"2024-04-26T12:09:07.460951+0000","last_fullsized":"2024-04-26T12:09:07.460951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'432","last_scrub_stamp":"2024-04-26T12:09:07.460722+0000","last_deep_scrub":"60'432","last_deep_scrub_stamp":"2024-04-26T12:09:07.460722+0000","last_clean_scrub_stamp":"2024-04-26T12:09:07.460722+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:52.118824+0000","scrub_duration":0.0028296200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18244,"num_write":400,"num_write_kb":59033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'381","reported_seq":851,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:30.632857+0000","last_change":"2024-04-26T12:09:30.632857+0000","last_active":"2024-04-26T12:09:30.632857+0000","last_peered":"2024-04-26T12:09:30.632857+0000","last_clean":"2024-04-26T12:09:30.632857+0000","last_became_active":"2024-04-26T12:08:52.745913+0000","last_became_peered":"2024-04-26T12:08:52.745913+0000","last_unstale":"2024-04-26T12:09:30.632857+0000","last_undegraded":"2024-04-26T12:09:30.632857+0000","last_fullsized":"2024-04-26T12:09:30.632857+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'381","last_scrub_stamp":"2024-04-26T12:09:30.632714+0000","last_deep_scrub":"60'381","last_deep_scrub_stamp":"2024-04-26T12:09:30.632714+0000","last_clean_scrub_stamp":"2024-04-26T12:09:30.632714+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:40.099051+0000","scrub_duration":0.001861026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":350,"num_write_kb":21212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"60'424","reported_seq":526,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:25.195300+0000","last_change":"2024-04-26T12:09:25.195412+0000","last_active":"2024-04-26T12:09:25.195300+0000","last_peered":"2024-04-26T12:09:25.195300+0000","last_clean":"2024-04-26T12:09:25.195300+0000","last_became_active":"2024-04-26T12:08:42.716846+0000","last_became_peered":"2024-04-26T12:08:42.716846+0000","last_unstale":"2024-04-26T12:09:25.195300+0000","last_undegraded":"2024-04-26T12:09:25.195300+0000","last_fullsized":"2024-04-26T12:09:25.195300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'424","last_scrub_stamp":"2024-04-26T12:09:25.195279+0000","last_deep_scrub":"60'424","last_deep_scrub_stamp":"2024-04-26T12:09:25.195279+0000","last_clean_scrub_stamp":"2024-04-26T12:09:25.195279+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:09.224012+0000","scrub_duration":0.00220163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13930,"num_write":388,"num_write_kb":116055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'426","reported_seq":918,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:08.468648+0000","last_change":"2024-04-26T12:09:08.468648+0000","last_active":"2024-04-26T12:09:08.468648+0000","last_peered":"2024-04-26T12:09:08.468648+0000","last_clean":"2024-04-26T12:09:08.468648+0000","last_became_active":"2024-04-26T12:08:53.747215+0000","last_became_peered":"2024-04-26T12:08:53.747215+0000","last_unstale":"2024-04-26T12:09:08.468648+0000","last_undegraded":"2024-04-26T12:09:08.468648+0000","last_fullsized":"2024-04-26T12:09:08.468648+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'426","last_scrub_stamp":"2024-04-26T12:09:08.468482+0000","last_deep_scrub":"60'426","last_deep_scrub_stamp":"2024-04-26T12:09:08.468482+0000","last_clean_scrub_stamp":"2024-04-26T12:09:08.468482+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:56.032283+0000","scrub_duration":0.0021666569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26908,"num_write":383,"num_write_kb":71324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"60'425","reported_seq":559,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:08.446169+0000","last_change":"2024-04-26T12:09:08.446169+0000","last_active":"2024-04-26T12:09:08.446169+0000","last_peered":"2024-04-26T12:09:08.446169+0000","last_clean":"2024-04-26T12:09:08.446169+0000","last_became_active":"2024-04-26T12:05:03.791061+0000","last_became_peered":"2024-04-26T12:05:03.791061+0000","last_unstale":"2024-04-26T12:09:08.446169+0000","last_undegraded":"2024-04-26T12:09:08.446169+0000","last_fullsized":"2024-04-26T12:09:08.446169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'425","last_scrub_stamp":"2024-04-26T12:09:08.446023+0000","last_deep_scrub":"60'425","last_deep_scrub_stamp":"2024-04-26T12:09:08.446023+0000","last_clean_scrub_stamp":"2024-04-26T12:09:08.446023+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:29.700242+0000","scrub_duration":0.002826112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19715,"num_write":398,"num_write_kb":30150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'450","reported_seq":651,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:45.764985+0000","last_change":"2024-04-26T12:09:45.765084+0000","last_active":"2024-04-26T12:09:45.764985+0000","last_peered":"2024-04-26T12:09:45.764985+0000","last_clean":"2024-04-26T12:09:45.764985+0000","last_became_active":"2024-04-26T12:05:03.791693+0000","last_became_peered":"2024-04-26T12:05:03.791693+0000","last_unstale":"2024-04-26T12:09:45.764985+0000","last_undegraded":"2024-04-26T12:09:45.764985+0000","last_fullsized":"2024-04-26T12:09:45.764985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'450","last_scrub_stamp":"2024-04-26T12:09:45.764962+0000","last_deep_scrub":"60'450","last_deep_scrub_stamp":"2024-04-26T12:09:45.764962+0000","last_clean_scrub_stamp":"2024-04-26T12:09:45.764962+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:21.995938+0000","scrub_duration":0.002787449,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":65124,"num_write":423,"num_write_kb":142714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'434","reported_seq":539,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745454+0000","last_change":"2024-04-26T12:08:46.730582+0000","last_active":"2024-04-26T12:08:53.745454+0000","last_peered":"2024-04-26T12:08:53.745454+0000","last_clean":"2024-04-26T12:08:53.745454+0000","last_became_active":"2024-04-26T12:08:46.728804+0000","last_became_peered":"2024-04-26T12:08:46.728804+0000","last_unstale":"2024-04-26T12:08:53.745454+0000","last_undegraded":"2024-04-26T12:08:53.745454+0000","last_fullsized":"2024-04-26T12:08:53.745454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":15350,"num_write":405,"num_write_kb":59295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"60'424","reported_seq":539,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244773+0000","last_change":"2024-04-26T12:05:03.788658+0000","last_active":"2024-04-26T12:09:05.244773+0000","last_peered":"2024-04-26T12:09:05.244773+0000","last_clean":"2024-04-26T12:09:05.244773+0000","last_became_active":"2024-04-26T12:05:03.788050+0000","last_became_peered":"2024-04-26T12:05:03.788050+0000","last_unstale":"2024-04-26T12:09:05.244773+0000","last_undegraded":"2024-04-26T12:09:05.244773+0000","last_fullsized":"2024-04-26T12:09:05.244773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23772,"num_write":390,"num_write_kb":67944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"60'447","reported_seq":527,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745010+0000","last_change":"2024-04-26T12:08:40.707153+0000","last_active":"2024-04-26T12:08:53.745010+0000","last_peered":"2024-04-26T12:08:53.745010+0000","last_clean":"2024-04-26T12:08:53.745010+0000","last_became_active":"2024-04-26T12:08:40.703880+0000","last_became_peered":"2024-04-26T12:08:40.703880+0000","last_unstale":"2024-04-26T12:08:53.745010+0000","last_undegraded":"2024-04-26T12:08:53.745010+0000","last_fullsized":"2024-04-26T12:08:53.745010+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9403,"num_write":417,"num_write_kb":67425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"60'417","reported_seq":519,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:26.148226+0000","last_change":"2024-04-26T12:09:26.148378+0000","last_active":"2024-04-26T12:09:26.148226+0000","last_peered":"2024-04-26T12:09:26.148226+0000","last_clean":"2024-04-26T12:09:26.148226+0000","last_became_active":"2024-04-26T12:08:42.715812+0000","last_became_peered":"2024-04-26T12:08:42.715812+0000","last_unstale":"2024-04-26T12:09:26.148226+0000","last_undegraded":"2024-04-26T12:09:26.148226+0000","last_fullsized":"2024-04-26T12:09:26.148226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'417","last_scrub_stamp":"2024-04-26T12:09:26.148189+0000","last_deep_scrub":"60'417","last_deep_scrub_stamp":"2024-04-26T12:09:26.148189+0000","last_clean_scrub_stamp":"2024-04-26T12:09:26.148189+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:12.073223+0000","scrub_duration":0.001950418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20466,"num_write":400,"num_write_kb":42225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"60'475","reported_seq":617,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.500379+0000","last_change":"2024-04-26T12:09:06.500379+0000","last_active":"2024-04-26T12:09:06.500379+0000","last_peered":"2024-04-26T12:09:06.500379+0000","last_clean":"2024-04-26T12:09:06.500379+0000","last_became_active":"2024-04-26T12:05:03.787562+0000","last_became_peered":"2024-04-26T12:05:03.787562+0000","last_unstale":"2024-04-26T12:09:06.500379+0000","last_undegraded":"2024-04-26T12:09:06.500379+0000","last_fullsized":"2024-04-26T12:09:06.500379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'475","last_scrub_stamp":"2024-04-26T12:09:06.500254+0000","last_deep_scrub":"60'475","last_deep_scrub_stamp":"2024-04-26T12:09:06.500254+0000","last_clean_scrub_stamp":"2024-04-26T12:09:06.500254+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:10.061304+0000","scrub_duration":0.002921515,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25186,"num_write":431,"num_write_kb":48184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"60'409","reported_seq":899,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124620+0000","last_change":"2024-04-26T12:08:49.741823+0000","last_active":"2024-04-26T12:09:06.124620+0000","last_peered":"2024-04-26T12:09:06.124620+0000","last_clean":"2024-04-26T12:09:06.124620+0000","last_became_active":"2024-04-26T12:08:49.740497+0000","last_became_peered":"2024-04-26T12:08:49.740497+0000","last_unstale":"2024-04-26T12:09:06.124620+0000","last_undegraded":"2024-04-26T12:09:06.124620+0000","last_fullsized":"2024-04-26T12:09:06.124620+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":20137,"num_write":374,"num_write_kb":55441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'392","reported_seq":494,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745543+0000","last_change":"2024-04-26T12:08:47.737270+0000","last_active":"2024-04-26T12:08:53.745543+0000","last_peered":"2024-04-26T12:08:53.745543+0000","last_clean":"2024-04-26T12:08:53.745543+0000","last_became_active":"2024-04-26T12:08:47.735361+0000","last_became_peered":"2024-04-26T12:08:47.735361+0000","last_unstale":"2024-04-26T12:08:53.745543+0000","last_undegraded":"2024-04-26T12:08:53.745543+0000","last_fullsized":"2024-04-26T12:08:53.745543+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29179,"num_write":355,"num_write_kb":59011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'380","reported_seq":853,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:15.465302+0000","last_change":"2024-04-26T12:09:15.465302+0000","last_active":"2024-04-26T12:09:15.465302+0000","last_peered":"2024-04-26T12:09:15.465302+0000","last_clean":"2024-04-26T12:09:15.465302+0000","last_became_active":"2024-04-26T12:08:41.716234+0000","last_became_peered":"2024-04-26T12:08:41.716234+0000","last_unstale":"2024-04-26T12:09:15.465302+0000","last_undegraded":"2024-04-26T12:09:15.465302+0000","last_fullsized":"2024-04-26T12:09:15.465302+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'380","last_scrub_stamp":"2024-04-26T12:09:15.465164+0000","last_deep_scrub":"60'380","last_deep_scrub_stamp":"2024-04-26T12:09:15.465164+0000","last_clean_scrub_stamp":"2024-04-26T12:09:15.465164+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:49.168939+0000","scrub_duration":0.0024038250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13036,"num_write":347,"num_write_kb":33880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"60'461","reported_seq":577,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:10.990827+0000","last_change":"2024-04-26T12:09:10.990934+0000","last_active":"2024-04-26T12:09:10.990827+0000","last_peered":"2024-04-26T12:09:10.990827+0000","last_clean":"2024-04-26T12:09:10.990827+0000","last_became_active":"2024-04-26T12:08:46.730738+0000","last_became_peered":"2024-04-26T12:08:46.730738+0000","last_unstale":"2024-04-26T12:09:10.990827+0000","last_undegraded":"2024-04-26T12:09:10.990827+0000","last_fullsized":"2024-04-26T12:09:10.990827+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'461","last_scrub_stamp":"2024-04-26T12:09:10.990803+0000","last_deep_scrub":"60'461","last_deep_scrub_stamp":"2024-04-26T12:09:10.990803+0000","last_clean_scrub_stamp":"2024-04-26T12:09:10.990803+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:12.887104+0000","scrub_duration":0.0025321039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":32945,"num_write":426,"num_write_kb":63234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"60'411","reported_seq":914,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:43.659197+0000","last_change":"2024-04-26T12:09:43.659295+0000","last_active":"2024-04-26T12:09:43.659197+0000","last_peered":"2024-04-26T12:09:43.659197+0000","last_clean":"2024-04-26T12:09:43.659197+0000","last_became_active":"2024-04-26T12:08:40.703845+0000","last_became_peered":"2024-04-26T12:08:40.703845+0000","last_unstale":"2024-04-26T12:09:43.659197+0000","last_undegraded":"2024-04-26T12:09:43.659197+0000","last_fullsized":"2024-04-26T12:09:43.659197+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'411","last_scrub_stamp":"2024-04-26T12:09:43.659173+0000","last_deep_scrub":"60'411","last_deep_scrub_stamp":"2024-04-26T12:09:43.659173+0000","last_clean_scrub_stamp":"2024-04-26T12:09:43.659173+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:23.114338+0000","scrub_duration":0.002345588,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11499,"num_write":377,"num_write_kb":34249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'430","reported_seq":540,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124494+0000","last_change":"2024-04-26T12:05:03.791605+0000","last_active":"2024-04-26T12:09:06.124494+0000","last_peered":"2024-04-26T12:09:06.124494+0000","last_clean":"2024-04-26T12:09:06.124494+0000","last_became_active":"2024-04-26T12:05:03.791251+0000","last_became_peered":"2024-04-26T12:05:03.791251+0000","last_unstale":"2024-04-26T12:09:06.124494+0000","last_undegraded":"2024-04-26T12:09:06.124494+0000","last_fullsized":"2024-04-26T12:09:06.124494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14660,"num_write":404,"num_write_kb":60840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"60'392","reported_seq":501,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745266+0000","last_change":"2024-04-26T12:08:44.723861+0000","last_active":"2024-04-26T12:08:53.745266+0000","last_peered":"2024-04-26T12:08:53.745266+0000","last_clean":"2024-04-26T12:08:53.745266+0000","last_became_active":"2024-04-26T12:08:44.722120+0000","last_became_peered":"2024-04-26T12:08:44.722120+0000","last_unstale":"2024-04-26T12:08:53.745266+0000","last_undegraded":"2024-04-26T12:08:53.745266+0000","last_fullsized":"2024-04-26T12:08:53.745266+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31703,"num_write":351,"num_write_kb":59324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"59'514","reported_seq":594,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124258+0000","last_change":"2024-04-26T12:05:03.430021+0000","last_active":"2024-04-26T12:09:06.124258+0000","last_peered":"2024-04-26T12:09:06.124258+0000","last_clean":"2024-04-26T12:09:06.124258+0000","last_became_active":"2024-04-26T12:05:03.429695+0000","last_became_peered":"2024-04-26T12:05:03.429695+0000","last_unstale":"2024-04-26T12:09:06.124258+0000","last_undegraded":"2024-04-26T12:09:06.124258+0000","last_fullsized":"2024-04-26T12:09:06.124258+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":8377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'432","reported_seq":523,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.751653+0000","last_change":"2024-04-26T12:08:53.751086+0000","last_active":"2024-04-26T12:08:53.751653+0000","last_peered":"2024-04-26T12:08:53.751653+0000","last_clean":"2024-04-26T12:08:53.751653+0000","last_became_active":"2024-04-26T12:08:53.748972+0000","last_became_peered":"2024-04-26T12:08:53.748972+0000","last_unstale":"2024-04-26T12:08:53.751653+0000","last_undegraded":"2024-04-26T12:08:53.751653+0000","last_fullsized":"2024-04-26T12:08:53.751653+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":30094,"num_write":388,"num_write_kb":83741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"59'55","reported_seq":146,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:34.731942+0000","last_change":"2024-04-26T12:09:34.731942+0000","last_active":"2024-04-26T12:09:34.731942+0000","last_peered":"2024-04-26T12:09:34.731942+0000","last_clean":"2024-04-26T12:09:34.731942+0000","last_became_active":"2024-04-26T12:05:03.428098+0000","last_became_peered":"2024-04-26T12:05:03.428098+0000","last_unstale":"2024-04-26T12:09:34.731942+0000","last_undegraded":"2024-04-26T12:09:34.731942+0000","last_fullsized":"2024-04-26T12:09:34.731942+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'55","last_scrub_stamp":"2024-04-26T12:09:34.731815+0000","last_deep_scrub":"59'55","last_deep_scrub_stamp":"2024-04-26T12:09:34.731815+0000","last_clean_scrub_stamp":"2024-04-26T12:09:34.731815+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:35.655136+0000","scrub_duration":0.0016482490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"60'445","reported_seq":569,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:07.498466+0000","last_change":"2024-04-26T12:09:07.498568+0000","last_active":"2024-04-26T12:09:07.498466+0000","last_peered":"2024-04-26T12:09:07.498466+0000","last_clean":"2024-04-26T12:09:07.498466+0000","last_became_active":"2024-04-26T12:05:03.788039+0000","last_became_peered":"2024-04-26T12:05:03.788039+0000","last_unstale":"2024-04-26T12:09:07.498466+0000","last_undegraded":"2024-04-26T12:09:07.498466+0000","last_fullsized":"2024-04-26T12:09:07.498466+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'445","last_scrub_stamp":"2024-04-26T12:09:07.498444+0000","last_deep_scrub":"60'445","last_deep_scrub_stamp":"2024-04-26T12:09:07.498444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:07.498444+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:34:55.801469+0000","scrub_duration":0.002448759,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":16079,"num_write":410,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"59'64","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:23.224837+0000","last_change":"2024-04-26T12:09:23.224938+0000","last_active":"2024-04-26T12:09:23.224837+0000","last_peered":"2024-04-26T12:09:23.224837+0000","last_clean":"2024-04-26T12:09:23.224837+0000","last_became_active":"2024-04-26T12:08:36.694921+0000","last_became_peered":"2024-04-26T12:08:36.694921+0000","last_unstale":"2024-04-26T12:09:23.224837+0000","last_undegraded":"2024-04-26T12:09:23.224837+0000","last_fullsized":"2024-04-26T12:09:23.224837+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'64","last_scrub_stamp":"2024-04-26T12:09:23.224815+0000","last_deep_scrub":"59'64","last_deep_scrub_stamp":"2024-04-26T12:09:23.224815+0000","last_clean_scrub_stamp":"2024-04-26T12:09:23.224815+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:34.040977+0000","scrub_duration":0.0015803169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"60'420","reported_seq":538,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746363+0000","last_change":"2024-04-26T12:05:03.788505+0000","last_active":"2024-04-26T12:08:53.746363+0000","last_peered":"2024-04-26T12:08:53.746363+0000","last_clean":"2024-04-26T12:08:53.746363+0000","last_became_active":"2024-04-26T12:05:03.788184+0000","last_became_peered":"2024-04-26T12:05:03.788184+0000","last_unstale":"2024-04-26T12:08:53.746363+0000","last_undegraded":"2024-04-26T12:08:53.746363+0000","last_fullsized":"2024-04-26T12:08:53.746363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":14666,"num_write":383,"num_write_kb":83769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"60'63","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124294+0000","last_change":"2024-04-26T12:08:36.697126+0000","last_active":"2024-04-26T12:09:06.124294+0000","last_peered":"2024-04-26T12:09:06.124294+0000","last_clean":"2024-04-26T12:09:06.124294+0000","last_became_active":"2024-04-26T12:08:36.696792+0000","last_became_peered":"2024-04-26T12:08:36.696792+0000","last_unstale":"2024-04-26T12:09:06.124294+0000","last_undegraded":"2024-04-26T12:09:06.124294+0000","last_fullsized":"2024-04-26T12:09:06.124294+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"59'232","reported_seq":337,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124226+0000","last_change":"2024-04-26T12:08:39.703810+0000","last_active":"2024-04-26T12:09:06.124226+0000","last_peered":"2024-04-26T12:09:06.124226+0000","last_clean":"2024-04-26T12:09:06.124226+0000","last_became_active":"2024-04-26T12:08:39.703455+0000","last_became_peered":"2024-04-26T12:08:39.703455+0000","last_unstale":"2024-04-26T12:09:06.124226+0000","last_undegraded":"2024-04-26T12:09:06.124226+0000","last_fullsized":"2024-04-26T12:09:06.124226+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'408","reported_seq":492,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745191+0000","last_change":"2024-04-26T12:08:40.710236+0000","last_active":"2024-04-26T12:08:53.745191+0000","last_peered":"2024-04-26T12:08:53.745191+0000","last_clean":"2024-04-26T12:08:53.745191+0000","last_became_active":"2024-04-26T12:08:40.707357+0000","last_became_peered":"2024-04-26T12:08:40.707357+0000","last_unstale":"2024-04-26T12:08:53.745191+0000","last_undegraded":"2024-04-26T12:08:53.745191+0000","last_fullsized":"2024-04-26T12:08:53.745191+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12418,"num_write":371,"num_write_kb":58378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"59'302","reported_seq":371,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745635+0000","last_change":"2024-04-26T12:08:39.703949+0000","last_active":"2024-04-26T12:08:53.745635+0000","last_peered":"2024-04-26T12:08:53.745635+0000","last_clean":"2024-04-26T12:08:53.745635+0000","last_became_active":"2024-04-26T12:08:39.703421+0000","last_became_peered":"2024-04-26T12:08:39.703421+0000","last_unstale":"2024-04-26T12:08:53.745635+0000","last_undegraded":"2024-04-26T12:08:53.745635+0000","last_fullsized":"2024-04-26T12:08:53.745635+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":4228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'439","reported_seq":499,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.744895+0000","last_change":"2024-04-26T12:08:41.717923+0000","last_active":"2024-04-26T12:08:53.744895+0000","last_peered":"2024-04-26T12:08:53.744895+0000","last_clean":"2024-04-26T12:08:53.744895+0000","last_became_active":"2024-04-26T12:08:41.715708+0000","last_became_peered":"2024-04-26T12:08:41.715708+0000","last_unstale":"2024-04-26T12:08:53.744895+0000","last_undegraded":"2024-04-26T12:08:53.744895+0000","last_fullsized":"2024-04-26T12:08:53.744895+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":30851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"84'591","reported_seq":707,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:39.824129+0000","last_change":"2024-04-26T12:09:39.824222+0000","last_active":"2024-04-26T12:09:39.824129+0000","last_peered":"2024-04-26T12:09:39.824129+0000","last_clean":"2024-04-26T12:09:39.824129+0000","last_became_active":"2024-04-26T12:08:39.703487+0000","last_became_peered":"2024-04-26T12:08:39.703487+0000","last_unstale":"2024-04-26T12:09:39.824129+0000","last_undegraded":"2024-04-26T12:09:39.824129+0000","last_fullsized":"2024-04-26T12:09:39.824129+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'591","last_scrub_stamp":"2024-04-26T12:09:39.824106+0000","last_deep_scrub":"84'591","last_deep_scrub_stamp":"2024-04-26T12:09:39.824106+0000","last_clean_scrub_stamp":"2024-04-26T12:09:39.824106+0000","objects_scrubbed":2,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:04.327252+0000","scrub_duration":0.019073356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":534,"num_write_kb":4333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'461","reported_seq":616,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124331+0000","last_change":"2024-04-26T12:05:03.791809+0000","last_active":"2024-04-26T12:09:06.124331+0000","last_peered":"2024-04-26T12:09:06.124331+0000","last_clean":"2024-04-26T12:09:06.124331+0000","last_became_active":"2024-04-26T12:05:03.791272+0000","last_became_peered":"2024-04-26T12:05:03.791272+0000","last_unstale":"2024-04-26T12:09:06.124331+0000","last_undegraded":"2024-04-26T12:09:06.124331+0000","last_fullsized":"2024-04-26T12:09:06.124331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":46123,"num_write":422,"num_write_kb":104552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'66","reported_seq":146,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124232+0000","last_change":"2024-04-26T12:05:03.430224+0000","last_active":"2024-04-26T12:09:06.124232+0000","last_peered":"2024-04-26T12:09:06.124232+0000","last_clean":"2024-04-26T12:09:06.124232+0000","last_became_active":"2024-04-26T12:05:03.429291+0000","last_became_peered":"2024-04-26T12:05:03.429291+0000","last_unstale":"2024-04-26T12:09:06.124232+0000","last_undegraded":"2024-04-26T12:09:06.124232+0000","last_fullsized":"2024-04-26T12:09:06.124232+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'428","reported_seq":554,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:41.623180+0000","last_change":"2024-04-26T12:09:41.623284+0000","last_active":"2024-04-26T12:09:41.623180+0000","last_peered":"2024-04-26T12:09:41.623180+0000","last_clean":"2024-04-26T12:09:41.623180+0000","last_became_active":"2024-04-26T12:05:03.787772+0000","last_became_peered":"2024-04-26T12:05:03.787772+0000","last_unstale":"2024-04-26T12:09:41.623180+0000","last_undegraded":"2024-04-26T12:09:41.623180+0000","last_fullsized":"2024-04-26T12:09:41.623180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'428","last_scrub_stamp":"2024-04-26T12:09:41.623156+0000","last_deep_scrub":"60'428","last_deep_scrub_stamp":"2024-04-26T12:09:41.623156+0000","last_clean_scrub_stamp":"2024-04-26T12:09:41.623156+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:27.740926+0000","scrub_duration":0.0027090880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15098,"num_write":394,"num_write_kb":42677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"59'195","reported_seq":275,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244407+0000","last_change":"2024-04-26T12:05:03.431162+0000","last_active":"2024-04-26T12:09:05.244407+0000","last_peered":"2024-04-26T12:09:05.244407+0000","last_clean":"2024-04-26T12:09:05.244407+0000","last_became_active":"2024-04-26T12:05:03.430855+0000","last_became_peered":"2024-04-26T12:05:03.430855+0000","last_unstale":"2024-04-26T12:09:05.244407+0000","last_undegraded":"2024-04-26T12:09:05.244407+0000","last_fullsized":"2024-04-26T12:09:05.244407+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"60'448","reported_seq":546,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124409+0000","last_change":"2024-04-26T12:05:03.792357+0000","last_active":"2024-04-26T12:09:06.124409+0000","last_peered":"2024-04-26T12:09:06.124409+0000","last_clean":"2024-04-26T12:09:06.124409+0000","last_became_active":"2024-04-26T12:05:03.792119+0000","last_became_peered":"2024-04-26T12:05:03.792119+0000","last_unstale":"2024-04-26T12:09:06.124409+0000","last_undegraded":"2024-04-26T12:09:06.124409+0000","last_fullsized":"2024-04-26T12:09:06.124409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":13281,"num_write":420,"num_write_kb":59540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"59'171","reported_seq":251,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124198+0000","last_change":"2024-04-26T12:05:03.429811+0000","last_active":"2024-04-26T12:09:06.124198+0000","last_peered":"2024-04-26T12:09:06.124198+0000","last_clean":"2024-04-26T12:09:06.124198+0000","last_became_active":"2024-04-26T12:05:03.429469+0000","last_became_peered":"2024-04-26T12:05:03.429469+0000","last_unstale":"2024-04-26T12:09:06.124198+0000","last_undegraded":"2024-04-26T12:09:06.124198+0000","last_fullsized":"2024-04-26T12:09:06.124198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'412","reported_seq":936,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:17.500764+0000","last_change":"2024-04-26T12:09:17.500764+0000","last_active":"2024-04-26T12:09:17.500764+0000","last_peered":"2024-04-26T12:09:17.500764+0000","last_clean":"2024-04-26T12:09:17.500764+0000","last_became_active":"2024-04-26T12:08:51.751044+0000","last_became_peered":"2024-04-26T12:08:51.751044+0000","last_unstale":"2024-04-26T12:09:17.500764+0000","last_undegraded":"2024-04-26T12:09:17.500764+0000","last_fullsized":"2024-04-26T12:09:17.500764+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'412","last_scrub_stamp":"2024-04-26T12:09:17.500623+0000","last_deep_scrub":"60'412","last_deep_scrub_stamp":"2024-04-26T12:09:17.500623+0000","last_clean_scrub_stamp":"2024-04-26T12:09:17.500623+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:05.606930+0000","scrub_duration":0.0024460179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26310,"num_write":380,"num_write_kb":38462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"59'55","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.744899+0000","last_change":"2024-04-26T12:08:36.695355+0000","last_active":"2024-04-26T12:08:53.744899+0000","last_peered":"2024-04-26T12:08:53.744899+0000","last_clean":"2024-04-26T12:08:53.744899+0000","last_became_active":"2024-04-26T12:08:36.694346+0000","last_became_peered":"2024-04-26T12:08:36.694346+0000","last_unstale":"2024-04-26T12:08:53.744899+0000","last_undegraded":"2024-04-26T12:08:53.744899+0000","last_fullsized":"2024-04-26T12:08:53.744899+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"60'362","reported_seq":819,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124433+0000","last_change":"2024-04-26T12:08:41.717048+0000","last_active":"2024-04-26T12:09:06.124433+0000","last_peered":"2024-04-26T12:09:06.124433+0000","last_clean":"2024-04-26T12:09:06.124433+0000","last_became_active":"2024-04-26T12:08:41.716102+0000","last_became_peered":"2024-04-26T12:08:41.716102+0000","last_unstale":"2024-04-26T12:09:06.124433+0000","last_undegraded":"2024-04-26T12:09:06.124433+0000","last_fullsized":"2024-04-26T12:09:06.124433+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21408,"num_write":333,"num_write_kb":66549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"59'378","reported_seq":440,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745101+0000","last_change":"2024-04-26T12:08:39.702797+0000","last_active":"2024-04-26T12:08:53.745101+0000","last_peered":"2024-04-26T12:08:53.745101+0000","last_clean":"2024-04-26T12:08:53.745101+0000","last_became_active":"2024-04-26T12:08:39.702438+0000","last_became_peered":"2024-04-26T12:08:39.702438+0000","last_unstale":"2024-04-26T12:08:53.745101+0000","last_undegraded":"2024-04-26T12:08:53.745101+0000","last_fullsized":"2024-04-26T12:08:53.745101+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"60'407","reported_seq":919,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244628+0000","last_change":"2024-04-26T12:08:45.724853+0000","last_active":"2024-04-26T12:09:05.244628+0000","last_peered":"2024-04-26T12:09:05.244628+0000","last_clean":"2024-04-26T12:09:05.244628+0000","last_became_active":"2024-04-26T12:08:45.723772+0000","last_became_peered":"2024-04-26T12:08:45.723772+0000","last_unstale":"2024-04-26T12:09:05.244628+0000","last_undegraded":"2024-04-26T12:09:05.244628+0000","last_fullsized":"2024-04-26T12:09:05.244628+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":40156,"num_write":373,"num_write_kb":91285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":295,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:56.394757+0000","last_change":"2024-04-26T12:08:36.697892+0000","last_active":"2024-04-26T12:08:56.394757+0000","last_peered":"2024-04-26T12:08:56.394757+0000","last_clean":"2024-04-26T12:08:56.394757+0000","last_became_active":"2024-04-26T12:08:36.697508+0000","last_became_peered":"2024-04-26T12:08:36.697508+0000","last_unstale":"2024-04-26T12:08:56.394757+0000","last_undegraded":"2024-04-26T12:08:56.394757+0000","last_fullsized":"2024-04-26T12:08:56.394757+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_clean_scrub_stamp":"2024-04-26T12:04:52.376986+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":83,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124100+0000","last_change":"2024-04-26T12:04:59.403711+0000","last_active":"2024-04-26T12:09:06.124100+0000","last_peered":"2024-04-26T12:09:06.124100+0000","last_clean":"2024-04-26T12:09:06.124100+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:09:06.124100+0000","last_undegraded":"2024-04-26T12:09:06.124100+0000","last_fullsized":"2024-04-26T12:09:06.124100+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"59'793","reported_seq":899,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244338+0000","last_change":"2024-04-26T12:08:39.702225+0000","last_active":"2024-04-26T12:09:05.244338+0000","last_peered":"2024-04-26T12:09:05.244338+0000","last_clean":"2024-04-26T12:09:05.244338+0000","last_became_active":"2024-04-26T12:08:39.701760+0000","last_became_peered":"2024-04-26T12:08:39.701760+0000","last_unstale":"2024-04-26T12:09:05.244338+0000","last_undegraded":"2024-04-26T12:09:05.244338+0000","last_fullsized":"2024-04-26T12:09:05.244338+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":8533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"60'466","reported_seq":1014,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124322+0000","last_change":"2024-04-26T12:08:52.747463+0000","last_active":"2024-04-26T12:09:06.124322+0000","last_peered":"2024-04-26T12:09:06.124322+0000","last_clean":"2024-04-26T12:09:06.124322+0000","last_became_active":"2024-04-26T12:08:52.746147+0000","last_became_peered":"2024-04-26T12:08:52.746147+0000","last_unstale":"2024-04-26T12:09:06.124322+0000","last_undegraded":"2024-04-26T12:09:06.124322+0000","last_fullsized":"2024-04-26T12:09:06.124322+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":37547,"num_write":422,"num_write_kb":96579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:01.395373+0000","last_change":"2024-04-26T12:08:36.695759+0000","last_active":"2024-04-26T12:09:01.395373+0000","last_peered":"2024-04-26T12:09:01.395373+0000","last_clean":"2024-04-26T12:09:01.395373+0000","last_became_active":"2024-04-26T12:08:36.695444+0000","last_became_peered":"2024-04-26T12:08:36.695444+0000","last_unstale":"2024-04-26T12:09:01.395373+0000","last_undegraded":"2024-04-26T12:09:01.395373+0000","last_fullsized":"2024-04-26T12:09:01.395373+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"60'114","reported_seq":241,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244334+0000","last_change":"2024-04-26T12:05:03.428547+0000","last_active":"2024-04-26T12:09:05.244334+0000","last_peered":"2024-04-26T12:09:05.244334+0000","last_clean":"2024-04-26T12:09:05.244334+0000","last_became_active":"2024-04-26T12:05:03.427985+0000","last_became_peered":"2024-04-26T12:05:03.427985+0000","last_unstale":"2024-04-26T12:09:05.244334+0000","last_undegraded":"2024-04-26T12:09:05.244334+0000","last_fullsized":"2024-04-26T12:09:05.244334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466015,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":47,"num_write_kb":1464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"60'492","reported_seq":667,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.067124+0000","last_change":"2024-04-26T12:09:06.067244+0000","last_active":"2024-04-26T12:09:06.067124+0000","last_peered":"2024-04-26T12:09:06.067124+0000","last_clean":"2024-04-26T12:09:06.067124+0000","last_became_active":"2024-04-26T12:08:49.739496+0000","last_became_peered":"2024-04-26T12:08:49.739496+0000","last_unstale":"2024-04-26T12:09:06.067124+0000","last_undegraded":"2024-04-26T12:09:06.067124+0000","last_fullsized":"2024-04-26T12:09:06.067124+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'492","last_scrub_stamp":"2024-04-26T12:09:06.067102+0000","last_deep_scrub":"60'492","last_deep_scrub_stamp":"2024-04-26T12:09:06.067102+0000","last_clean_scrub_stamp":"2024-04-26T12:09:06.067102+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:55.504447+0000","scrub_duration":0.0024880229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":63988,"num_write":466,"num_write_kb":154489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":96,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244314+0000","last_change":"2024-04-26T12:08:36.696858+0000","last_active":"2024-04-26T12:09:05.244314+0000","last_peered":"2024-04-26T12:09:05.244314+0000","last_clean":"2024-04-26T12:09:05.244314+0000","last_became_active":"2024-04-26T12:08:36.696619+0000","last_became_peered":"2024-04-26T12:08:36.696619+0000","last_unstale":"2024-04-26T12:09:05.244314+0000","last_undegraded":"2024-04-26T12:09:05.244314+0000","last_fullsized":"2024-04-26T12:09:05.244314+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"59'325","reported_seq":387,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.744827+0000","last_change":"2024-04-26T12:08:39.704052+0000","last_active":"2024-04-26T12:08:53.744827+0000","last_peered":"2024-04-26T12:08:53.744827+0000","last_clean":"2024-04-26T12:08:53.744827+0000","last_became_active":"2024-04-26T12:08:39.703696+0000","last_became_peered":"2024-04-26T12:08:39.703696+0000","last_unstale":"2024-04-26T12:08:53.744827+0000","last_undegraded":"2024-04-26T12:08:53.744827+0000","last_fullsized":"2024-04-26T12:08:53.744827+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":8296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"60'359","reported_seq":787,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244590+0000","last_change":"2024-04-26T12:08:47.737443+0000","last_active":"2024-04-26T12:09:05.244590+0000","last_peered":"2024-04-26T12:09:05.244590+0000","last_clean":"2024-04-26T12:09:05.244590+0000","last_became_active":"2024-04-26T12:08:47.735729+0000","last_became_peered":"2024-04-26T12:08:47.735729+0000","last_unstale":"2024-04-26T12:09:05.244590+0000","last_undegraded":"2024-04-26T12:09:05.244590+0000","last_fullsized":"2024-04-26T12:09:05.244590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9448,"num_write":336,"num_write_kb":74900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":83,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124113+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:09:06.124113+0000","last_peered":"2024-04-26T12:09:06.124113+0000","last_clean":"2024-04-26T12:09:06.124113+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:09:06.124113+0000","last_undegraded":"2024-04-26T12:09:06.124113+0000","last_fullsized":"2024-04-26T12:09:06.124113+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"59'67","reported_seq":147,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124098+0000","last_change":"2024-04-26T12:05:03.430140+0000","last_active":"2024-04-26T12:09:06.124098+0000","last_peered":"2024-04-26T12:09:06.124098+0000","last_clean":"2024-04-26T12:09:06.124098+0000","last_became_active":"2024-04-26T12:05:03.429838+0000","last_became_peered":"2024-04-26T12:05:03.429838+0000","last_unstale":"2024-04-26T12:09:06.124098+0000","last_undegraded":"2024-04-26T12:09:06.124098+0000","last_fullsized":"2024-04-26T12:09:06.124098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"60'403","reported_seq":907,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:18.489116+0000","last_change":"2024-04-26T12:09:18.489255+0000","last_active":"2024-04-26T12:09:18.489116+0000","last_peered":"2024-04-26T12:09:18.489116+0000","last_clean":"2024-04-26T12:09:18.489116+0000","last_became_active":"2024-04-26T12:08:50.752366+0000","last_became_peered":"2024-04-26T12:08:50.752366+0000","last_unstale":"2024-04-26T12:09:18.489116+0000","last_undegraded":"2024-04-26T12:09:18.489116+0000","last_fullsized":"2024-04-26T12:09:18.489116+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'403","last_scrub_stamp":"2024-04-26T12:09:18.489093+0000","last_deep_scrub":"60'403","last_deep_scrub_stamp":"2024-04-26T12:09:18.489093+0000","last_clean_scrub_stamp":"2024-04-26T12:09:18.489093+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:04.607536+0000","scrub_duration":0.0022127980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30094,"num_write":370,"num_write_kb":104181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"59'469","reported_seq":549,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124182+0000","last_change":"2024-04-26T12:05:03.429673+0000","last_active":"2024-04-26T12:09:06.124182+0000","last_peered":"2024-04-26T12:09:06.124182+0000","last_clean":"2024-04-26T12:09:06.124182+0000","last_became_active":"2024-04-26T12:05:03.429146+0000","last_became_peered":"2024-04-26T12:05:03.429146+0000","last_unstale":"2024-04-26T12:09:06.124182+0000","last_undegraded":"2024-04-26T12:09:06.124182+0000","last_fullsized":"2024-04-26T12:09:06.124182+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244381+0000","last_change":"2024-04-26T12:08:36.697900+0000","last_active":"2024-04-26T12:09:05.244381+0000","last_peered":"2024-04-26T12:09:05.244381+0000","last_clean":"2024-04-26T12:09:05.244381+0000","last_became_active":"2024-04-26T12:08:36.697618+0000","last_became_peered":"2024-04-26T12:08:36.697618+0000","last_unstale":"2024-04-26T12:09:05.244381+0000","last_undegraded":"2024-04-26T12:09:05.244381+0000","last_fullsized":"2024-04-26T12:09:05.244381+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'354","reported_seq":414,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745417+0000","last_change":"2024-04-26T12:08:45.725751+0000","last_active":"2024-04-26T12:08:53.745417+0000","last_peered":"2024-04-26T12:08:53.745417+0000","last_clean":"2024-04-26T12:08:53.745417+0000","last_became_active":"2024-04-26T12:08:45.724153+0000","last_became_peered":"2024-04-26T12:08:45.724153+0000","last_unstale":"2024-04-26T12:08:53.745417+0000","last_undegraded":"2024-04-26T12:08:53.745417+0000","last_fullsized":"2024-04-26T12:08:53.745417+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":416,"num_write":319,"num_write_kb":17259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"59'53","reported_seq":146,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244394+0000","last_change":"2024-04-26T12:08:36.698122+0000","last_active":"2024-04-26T12:09:05.244394+0000","last_peered":"2024-04-26T12:09:05.244394+0000","last_clean":"2024-04-26T12:09:05.244394+0000","last_became_active":"2024-04-26T12:08:36.697832+0000","last_became_peered":"2024-04-26T12:08:36.697832+0000","last_unstale":"2024-04-26T12:09:05.244394+0000","last_undegraded":"2024-04-26T12:09:05.244394+0000","last_fullsized":"2024-04-26T12:09:05.244394+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745977+0000","last_change":"2024-04-26T12:08:36.698131+0000","last_active":"2024-04-26T12:08:53.745977+0000","last_peered":"2024-04-26T12:08:53.745977+0000","last_clean":"2024-04-26T12:08:53.745977+0000","last_became_active":"2024-04-26T12:08:36.697698+0000","last_became_peered":"2024-04-26T12:08:36.697698+0000","last_unstale":"2024-04-26T12:08:53.745977+0000","last_undegraded":"2024-04-26T12:08:53.745977+0000","last_fullsized":"2024-04-26T12:08:53.745977+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'399","reported_seq":478,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745182+0000","last_change":"2024-04-26T12:08:40.705752+0000","last_active":"2024-04-26T12:08:53.745182+0000","last_peered":"2024-04-26T12:08:53.745182+0000","last_clean":"2024-04-26T12:08:53.745182+0000","last_became_active":"2024-04-26T12:08:40.703906+0000","last_became_peered":"2024-04-26T12:08:40.703906+0000","last_unstale":"2024-04-26T12:08:53.745182+0000","last_undegraded":"2024-04-26T12:08:53.745182+0000","last_fullsized":"2024-04-26T12:08:53.745182+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11720,"num_write":363,"num_write_kb":66914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"84'66","reported_seq":171,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:42.618525+0000","last_change":"2024-04-26T12:09:42.618673+0000","last_active":"2024-04-26T12:09:42.618525+0000","last_peered":"2024-04-26T12:09:42.618525+0000","last_clean":"2024-04-26T12:09:42.618525+0000","last_became_active":"2024-04-26T12:08:36.699058+0000","last_became_peered":"2024-04-26T12:08:36.699058+0000","last_unstale":"2024-04-26T12:09:42.618525+0000","last_undegraded":"2024-04-26T12:09:42.618525+0000","last_fullsized":"2024-04-26T12:09:42.618525+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'66","last_scrub_stamp":"2024-04-26T12:09:42.618500+0000","last_deep_scrub":"84'66","last_deep_scrub_stamp":"2024-04-26T12:09:42.618500+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.618500+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:34.338430+0000","scrub_duration":0.0032759640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244346+0000","last_change":"2024-04-26T12:08:36.697618+0000","last_active":"2024-04-26T12:09:05.244346+0000","last_peered":"2024-04-26T12:09:05.244346+0000","last_clean":"2024-04-26T12:09:05.244346+0000","last_became_active":"2024-04-26T12:08:36.697407+0000","last_became_peered":"2024-04-26T12:08:36.697407+0000","last_unstale":"2024-04-26T12:09:05.244346+0000","last_undegraded":"2024-04-26T12:09:05.244346+0000","last_fullsized":"2024-04-26T12:09:05.244346+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'424","reported_seq":554,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:36.668960+0000","last_change":"2024-04-26T12:09:36.669071+0000","last_active":"2024-04-26T12:09:36.668960+0000","last_peered":"2024-04-26T12:09:36.668960+0000","last_clean":"2024-04-26T12:09:36.668960+0000","last_became_active":"2024-04-26T12:05:03.789390+0000","last_became_peered":"2024-04-26T12:05:03.789390+0000","last_unstale":"2024-04-26T12:09:36.668960+0000","last_undegraded":"2024-04-26T12:09:36.668960+0000","last_fullsized":"2024-04-26T12:09:36.668960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'424","last_scrub_stamp":"2024-04-26T12:09:36.668937+0000","last_deep_scrub":"60'424","last_deep_scrub_stamp":"2024-04-26T12:09:36.668937+0000","last_clean_scrub_stamp":"2024-04-26T12:09:36.668937+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:58.766848+0000","scrub_duration":0.0024505759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17027,"num_write":386,"num_write_kb":58797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"84'71","reported_seq":162,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:45.617441+0000","last_change":"2024-04-26T12:09:45.617547+0000","last_active":"2024-04-26T12:09:45.617441+0000","last_peered":"2024-04-26T12:09:45.617441+0000","last_clean":"2024-04-26T12:09:45.617441+0000","last_became_active":"2024-04-26T12:05:03.428803+0000","last_became_peered":"2024-04-26T12:05:03.428803+0000","last_unstale":"2024-04-26T12:09:45.617441+0000","last_undegraded":"2024-04-26T12:09:45.617441+0000","last_fullsized":"2024-04-26T12:09:45.617441+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'71","last_scrub_stamp":"2024-04-26T12:09:45.617416+0000","last_deep_scrub":"84'71","last_deep_scrub_stamp":"2024-04-26T12:09:45.617416+0000","last_clean_scrub_stamp":"2024-04-26T12:09:45.617416+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:39.856897+0000","scrub_duration":0.0067924539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124101+0000","last_change":"2024-04-26T12:08:36.698775+0000","last_active":"2024-04-26T12:09:06.124101+0000","last_peered":"2024-04-26T12:09:06.124101+0000","last_clean":"2024-04-26T12:09:06.124101+0000","last_became_active":"2024-04-26T12:08:36.698523+0000","last_became_peered":"2024-04-26T12:08:36.698523+0000","last_unstale":"2024-04-26T12:09:06.124101+0000","last_undegraded":"2024-04-26T12:09:06.124101+0000","last_fullsized":"2024-04-26T12:09:06.124101+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'393","reported_seq":484,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:40.062039+0000","last_change":"2024-04-26T12:09:40.062141+0000","last_active":"2024-04-26T12:09:40.062039+0000","last_peered":"2024-04-26T12:09:40.062039+0000","last_clean":"2024-04-26T12:09:40.062039+0000","last_became_active":"2024-04-26T12:08:40.703873+0000","last_became_peered":"2024-04-26T12:08:40.703873+0000","last_unstale":"2024-04-26T12:09:40.062039+0000","last_undegraded":"2024-04-26T12:09:40.062039+0000","last_fullsized":"2024-04-26T12:09:40.062039+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'393","last_scrub_stamp":"2024-04-26T12:09:40.062013+0000","last_deep_scrub":"60'393","last_deep_scrub_stamp":"2024-04-26T12:09:40.062013+0000","last_clean_scrub_stamp":"2024-04-26T12:09:40.062013+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:47.183215+0000","scrub_duration":0.0022492969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":11991,"num_write":357,"num_write_kb":83226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'419","reported_seq":905,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:29.651923+0000","last_change":"2024-04-26T12:09:29.651923+0000","last_active":"2024-04-26T12:09:29.651923+0000","last_peered":"2024-04-26T12:09:29.651923+0000","last_clean":"2024-04-26T12:09:29.651923+0000","last_became_active":"2024-04-26T12:08:44.722574+0000","last_became_peered":"2024-04-26T12:08:44.722574+0000","last_unstale":"2024-04-26T12:09:29.651923+0000","last_undegraded":"2024-04-26T12:09:29.651923+0000","last_fullsized":"2024-04-26T12:09:29.651923+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'419","last_scrub_stamp":"2024-04-26T12:09:29.651776+0000","last_deep_scrub":"60'419","last_deep_scrub_stamp":"2024-04-26T12:09:29.651776+0000","last_clean_scrub_stamp":"2024-04-26T12:09:29.651776+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:03.355550+0000","scrub_duration":0.0023698270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14983,"num_write":376,"num_write_kb":76749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"61'398","reported_seq":509,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124349+0000","last_change":"2024-04-26T12:08:39.703851+0000","last_active":"2024-04-26T12:09:06.124349+0000","last_peered":"2024-04-26T12:09:06.124349+0000","last_clean":"2024-04-26T12:09:06.124349+0000","last_became_active":"2024-04-26T12:08:39.703516+0000","last_became_peered":"2024-04-26T12:08:39.703516+0000","last_unstale":"2024-04-26T12:09:06.124349+0000","last_undegraded":"2024-04-26T12:09:06.124349+0000","last_fullsized":"2024-04-26T12:09:06.124349+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699266,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":9692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9692849,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'428","reported_seq":942,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244642+0000","last_change":"2024-04-26T12:08:50.753473+0000","last_active":"2024-04-26T12:09:05.244642+0000","last_peered":"2024-04-26T12:09:05.244642+0000","last_clean":"2024-04-26T12:09:05.244642+0000","last_became_active":"2024-04-26T12:08:50.752328+0000","last_became_peered":"2024-04-26T12:08:50.752328+0000","last_unstale":"2024-04-26T12:09:05.244642+0000","last_undegraded":"2024-04-26T12:09:05.244642+0000","last_fullsized":"2024-04-26T12:09:05.244642+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":26594,"num_write":396,"num_write_kb":67932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"60'91","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745643+0000","last_change":"2024-04-26T12:08:36.722607+0000","last_active":"2024-04-26T12:08:53.745643+0000","last_peered":"2024-04-26T12:08:53.745643+0000","last_clean":"2024-04-26T12:08:53.745643+0000","last_became_active":"2024-04-26T12:08:36.697650+0000","last_became_peered":"2024-04-26T12:08:36.697650+0000","last_unstale":"2024-04-26T12:08:53.745643+0000","last_undegraded":"2024-04-26T12:08:53.745643+0000","last_fullsized":"2024-04-26T12:08:53.745643+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"59'316","reported_seq":395,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746488+0000","last_change":"2024-04-26T12:05:03.429257+0000","last_active":"2024-04-26T12:08:53.746488+0000","last_peered":"2024-04-26T12:08:53.746488+0000","last_clean":"2024-04-26T12:08:53.746488+0000","last_became_active":"2024-04-26T12:05:03.428921+0000","last_became_peered":"2024-04-26T12:05:03.428921+0000","last_unstale":"2024-04-26T12:08:53.746488+0000","last_undegraded":"2024-04-26T12:08:53.746488+0000","last_fullsized":"2024-04-26T12:08:53.746488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'495","reported_seq":638,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:25.547380+0000","last_change":"2024-04-26T12:09:25.547380+0000","last_active":"2024-04-26T12:09:25.547380+0000","last_peered":"2024-04-26T12:09:25.547380+0000","last_clean":"2024-04-26T12:09:25.547380+0000","last_became_active":"2024-04-26T12:05:03.787533+0000","last_became_peered":"2024-04-26T12:05:03.787533+0000","last_unstale":"2024-04-26T12:09:25.547380+0000","last_undegraded":"2024-04-26T12:09:25.547380+0000","last_fullsized":"2024-04-26T12:09:25.547380+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'495","last_scrub_stamp":"2024-04-26T12:09:25.547250+0000","last_deep_scrub":"60'495","last_deep_scrub_stamp":"2024-04-26T12:09:25.547250+0000","last_clean_scrub_stamp":"2024-04-26T12:09:25.547250+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:52.939986+0000","scrub_duration":0.002519252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37174,"num_write":458,"num_write_kb":125832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'51","reported_seq":141,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:29.586001+0000","last_change":"2024-04-26T12:09:29.586170+0000","last_active":"2024-04-26T12:09:29.586001+0000","last_peered":"2024-04-26T12:09:29.586001+0000","last_clean":"2024-04-26T12:09:29.586001+0000","last_became_active":"2024-04-26T12:05:03.428445+0000","last_became_peered":"2024-04-26T12:05:03.428445+0000","last_unstale":"2024-04-26T12:09:29.586001+0000","last_undegraded":"2024-04-26T12:09:29.586001+0000","last_fullsized":"2024-04-26T12:09:29.586001+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'51","last_scrub_stamp":"2024-04-26T12:09:29.585971+0000","last_deep_scrub":"59'51","last_deep_scrub_stamp":"2024-04-26T12:09:29.585971+0000","last_clean_scrub_stamp":"2024-04-26T12:09:29.585971+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:15.873513+0000","scrub_duration":0.0016537050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'482","reported_seq":1132,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244633+0000","last_change":"2024-04-26T12:08:48.741589+0000","last_active":"2024-04-26T12:09:05.244633+0000","last_peered":"2024-04-26T12:09:05.244633+0000","last_clean":"2024-04-26T12:09:05.244633+0000","last_became_active":"2024-04-26T12:08:48.740055+0000","last_became_peered":"2024-04-26T12:08:48.740055+0000","last_unstale":"2024-04-26T12:09:05.244633+0000","last_undegraded":"2024-04-26T12:09:05.244633+0000","last_fullsized":"2024-04-26T12:09:05.244633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":61972,"num_write":459,"num_write_kb":125797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"60'392","reported_seq":528,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745849+0000","last_change":"2024-04-26T12:08:43.718939+0000","last_active":"2024-04-26T12:08:53.745849+0000","last_peered":"2024-04-26T12:08:53.745849+0000","last_clean":"2024-04-26T12:08:53.745849+0000","last_became_active":"2024-04-26T12:08:43.717109+0000","last_became_peered":"2024-04-26T12:08:43.717109+0000","last_unstale":"2024-04-26T12:08:53.745849+0000","last_undegraded":"2024-04-26T12:08:53.745849+0000","last_fullsized":"2024-04-26T12:08:53.745849+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":37910,"num_write":366,"num_write_kb":84111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"59'709","reported_seq":814,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745562+0000","last_change":"2024-04-26T12:08:39.701978+0000","last_active":"2024-04-26T12:08:53.745562+0000","last_peered":"2024-04-26T12:08:53.745562+0000","last_clean":"2024-04-26T12:08:53.745562+0000","last_became_active":"2024-04-26T12:08:39.700927+0000","last_became_peered":"2024-04-26T12:08:39.700927+0000","last_unstale":"2024-04-26T12:08:53.745562+0000","last_undegraded":"2024-04-26T12:08:53.745562+0000","last_fullsized":"2024-04-26T12:08:53.745562+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"60'435","reported_seq":574,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244727+0000","last_change":"2024-04-26T12:05:03.788754+0000","last_active":"2024-04-26T12:09:05.244727+0000","last_peered":"2024-04-26T12:09:05.244727+0000","last_clean":"2024-04-26T12:09:05.244727+0000","last_became_active":"2024-04-26T12:05:03.788311+0000","last_became_peered":"2024-04-26T12:05:03.788311+0000","last_unstale":"2024-04-26T12:09:05.244727+0000","last_undegraded":"2024-04-26T12:09:05.244727+0000","last_fullsized":"2024-04-26T12:09:05.244727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":28462,"num_write":403,"num_write_kb":93779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"84'263","reported_seq":353,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:40.654260+0000","last_change":"2024-04-26T12:09:40.654355+0000","last_active":"2024-04-26T12:09:40.654260+0000","last_peered":"2024-04-26T12:09:40.654260+0000","last_clean":"2024-04-26T12:09:40.654260+0000","last_became_active":"2024-04-26T12:05:03.428191+0000","last_became_peered":"2024-04-26T12:05:03.428191+0000","last_unstale":"2024-04-26T12:09:40.654260+0000","last_undegraded":"2024-04-26T12:09:40.654260+0000","last_fullsized":"2024-04-26T12:09:40.654260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'263","last_scrub_stamp":"2024-04-26T12:09:40.654238+0000","last_deep_scrub":"84'263","last_deep_scrub_stamp":"2024-04-26T12:09:40.654238+0000","last_clean_scrub_stamp":"2024-04-26T12:09:40.654238+0000","objects_scrubbed":1,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:02.888122+0000","scrub_duration":0.014597508,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"60'399","reported_seq":500,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745543+0000","last_change":"2024-04-26T12:08:49.742459+0000","last_active":"2024-04-26T12:08:53.745543+0000","last_peered":"2024-04-26T12:08:53.745543+0000","last_clean":"2024-04-26T12:08:53.745543+0000","last_became_active":"2024-04-26T12:08:49.740536+0000","last_became_peered":"2024-04-26T12:08:49.740536+0000","last_unstale":"2024-04-26T12:08:53.745543+0000","last_undegraded":"2024-04-26T12:08:53.745543+0000","last_fullsized":"2024-04-26T12:08:53.745543+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22216,"num_write":357,"num_write_kb":75245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"84'433","reported_seq":505,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:33.133704+0000","last_change":"2024-04-26T12:09:33.133804+0000","last_active":"2024-04-26T12:09:33.133704+0000","last_peered":"2024-04-26T12:09:33.133704+0000","last_clean":"2024-04-26T12:09:33.133704+0000","last_became_active":"2024-04-26T12:08:39.702529+0000","last_became_peered":"2024-04-26T12:08:39.702529+0000","last_unstale":"2024-04-26T12:09:33.133704+0000","last_undegraded":"2024-04-26T12:09:33.133704+0000","last_fullsized":"2024-04-26T12:09:33.133704+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'433","last_scrub_stamp":"2024-04-26T12:09:33.133683+0000","last_deep_scrub":"84'433","last_deep_scrub_stamp":"2024-04-26T12:09:33.133683+0000","last_clean_scrub_stamp":"2024-04-26T12:09:33.133683+0000","objects_scrubbed":3,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:32.088329+0000","scrub_duration":0.034859436000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":12514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"60'387","reported_seq":477,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745437+0000","last_change":"2024-04-26T12:08:43.720098+0000","last_active":"2024-04-26T12:08:53.745437+0000","last_peered":"2024-04-26T12:08:53.745437+0000","last_clean":"2024-04-26T12:08:53.745437+0000","last_became_active":"2024-04-26T12:08:43.717442+0000","last_became_peered":"2024-04-26T12:08:43.717442+0000","last_unstale":"2024-04-26T12:08:53.745437+0000","last_undegraded":"2024-04-26T12:08:53.745437+0000","last_fullsized":"2024-04-26T12:08:53.745437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20720,"num_write":352,"num_write_kb":87643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"59'58","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745139+0000","last_change":"2024-04-26T12:08:36.720540+0000","last_active":"2024-04-26T12:08:53.745139+0000","last_peered":"2024-04-26T12:08:53.745139+0000","last_clean":"2024-04-26T12:08:53.745139+0000","last_became_active":"2024-04-26T12:08:36.693399+0000","last_became_peered":"2024-04-26T12:08:36.693399+0000","last_unstale":"2024-04-26T12:08:53.745139+0000","last_undegraded":"2024-04-26T12:08:53.745139+0000","last_fullsized":"2024-04-26T12:08:53.745139+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"60'356","reported_seq":453,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745770+0000","last_change":"2024-04-26T12:05:03.791986+0000","last_active":"2024-04-26T12:08:53.745770+0000","last_peered":"2024-04-26T12:08:53.745770+0000","last_clean":"2024-04-26T12:08:53.745770+0000","last_became_active":"2024-04-26T12:05:03.790823+0000","last_became_peered":"2024-04-26T12:05:03.790823+0000","last_unstale":"2024-04-26T12:08:53.745770+0000","last_undegraded":"2024-04-26T12:08:53.745770+0000","last_fullsized":"2024-04-26T12:08:53.745770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9641,"num_write":326,"num_write_kb":29574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"84'311","reported_seq":401,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:32.706403+0000","last_change":"2024-04-26T12:09:32.706538+0000","last_active":"2024-04-26T12:09:32.706403+0000","last_peered":"2024-04-26T12:09:32.706403+0000","last_clean":"2024-04-26T12:09:32.706403+0000","last_became_active":"2024-04-26T12:05:03.429015+0000","last_became_peered":"2024-04-26T12:05:03.429015+0000","last_unstale":"2024-04-26T12:09:32.706403+0000","last_undegraded":"2024-04-26T12:09:32.706403+0000","last_fullsized":"2024-04-26T12:09:32.706403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'311","last_scrub_stamp":"2024-04-26T12:09:32.706381+0000","last_deep_scrub":"84'311","last_deep_scrub_stamp":"2024-04-26T12:09:32.706381+0000","last_clean_scrub_stamp":"2024-04-26T12:09:32.706381+0000","objects_scrubbed":2,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:18.824824+0000","scrub_duration":0.016953577000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'433","reported_seq":576,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745849+0000","last_change":"2024-04-26T12:05:03.791929+0000","last_active":"2024-04-26T12:08:53.745849+0000","last_peered":"2024-04-26T12:08:53.745849+0000","last_clean":"2024-04-26T12:08:53.745849+0000","last_became_active":"2024-04-26T12:05:03.791540+0000","last_became_peered":"2024-04-26T12:05:03.791540+0000","last_unstale":"2024-04-26T12:08:53.745849+0000","last_undegraded":"2024-04-26T12:08:53.745849+0000","last_fullsized":"2024-04-26T12:08:53.745849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":47864,"num_write":399,"num_write_kb":92193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"59'382","reported_seq":450,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745440+0000","last_change":"2024-04-26T12:08:39.704680+0000","last_active":"2024-04-26T12:08:53.745440+0000","last_peered":"2024-04-26T12:08:53.745440+0000","last_clean":"2024-04-26T12:08:53.745440+0000","last_became_active":"2024-04-26T12:08:39.704404+0000","last_became_peered":"2024-04-26T12:08:39.704404+0000","last_unstale":"2024-04-26T12:08:53.745440+0000","last_undegraded":"2024-04-26T12:08:53.745440+0000","last_fullsized":"2024-04-26T12:08:53.745440+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":12467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'425","reported_seq":556,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:18.179708+0000","last_change":"2024-04-26T12:09:18.179810+0000","last_active":"2024-04-26T12:09:18.179708+0000","last_peered":"2024-04-26T12:09:18.179708+0000","last_clean":"2024-04-26T12:09:18.179708+0000","last_became_active":"2024-04-26T12:08:47.735367+0000","last_became_peered":"2024-04-26T12:08:47.735367+0000","last_unstale":"2024-04-26T12:09:18.179708+0000","last_undegraded":"2024-04-26T12:09:18.179708+0000","last_fullsized":"2024-04-26T12:09:18.179708+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'425","last_scrub_stamp":"2024-04-26T12:09:18.179684+0000","last_deep_scrub":"60'425","last_deep_scrub_stamp":"2024-04-26T12:09:18.179684+0000","last_clean_scrub_stamp":"2024-04-26T12:09:18.179684+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:20.520222+0000","scrub_duration":0.0024613230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":38065,"num_write":387,"num_write_kb":71445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"84'127","reported_seq":243,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:21.540633+0000","last_change":"2024-04-26T12:09:21.540746+0000","last_active":"2024-04-26T12:09:21.540633+0000","last_peered":"2024-04-26T12:09:21.540633+0000","last_clean":"2024-04-26T12:09:21.540633+0000","last_became_active":"2024-04-26T12:08:39.701900+0000","last_became_peered":"2024-04-26T12:08:39.701900+0000","last_unstale":"2024-04-26T12:09:21.540633+0000","last_undegraded":"2024-04-26T12:09:21.540633+0000","last_fullsized":"2024-04-26T12:09:21.540633+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'127","last_scrub_stamp":"2024-04-26T12:09:21.540611+0000","last_deep_scrub":"84'127","last_deep_scrub_stamp":"2024-04-26T12:09:21.540611+0000","last_clean_scrub_stamp":"2024-04-26T12:09:21.540611+0000","objects_scrubbed":1,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:30.101109+0000","scrub_duration":0.0098993390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"60'448","reported_seq":560,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:31.644497+0000","last_change":"2024-04-26T12:09:31.644589+0000","last_active":"2024-04-26T12:09:31.644497+0000","last_peered":"2024-04-26T12:09:31.644497+0000","last_clean":"2024-04-26T12:09:31.644497+0000","last_became_active":"2024-04-26T12:05:03.791442+0000","last_became_peered":"2024-04-26T12:05:03.791442+0000","last_unstale":"2024-04-26T12:09:31.644497+0000","last_undegraded":"2024-04-26T12:09:31.644497+0000","last_fullsized":"2024-04-26T12:09:31.644497+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'448","last_scrub_stamp":"2024-04-26T12:09:31.644476+0000","last_deep_scrub":"60'448","last_deep_scrub_stamp":"2024-04-26T12:09:31.644476+0000","last_clean_scrub_stamp":"2024-04-26T12:09:31.644476+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:50.748197+0000","scrub_duration":0.0028574049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11191,"num_write":416,"num_write_kb":67272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"84'59","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:17.505129+0000","last_change":"2024-04-26T12:09:17.505233+0000","last_active":"2024-04-26T12:09:17.505129+0000","last_peered":"2024-04-26T12:09:17.505129+0000","last_clean":"2024-04-26T12:09:17.505129+0000","last_became_active":"2024-04-26T12:05:03.430164+0000","last_became_peered":"2024-04-26T12:05:03.430164+0000","last_unstale":"2024-04-26T12:09:17.505129+0000","last_undegraded":"2024-04-26T12:09:17.505129+0000","last_fullsized":"2024-04-26T12:09:17.505129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'59","last_scrub_stamp":"2024-04-26T12:09:17.505103+0000","last_deep_scrub":"84'59","last_deep_scrub_stamp":"2024-04-26T12:09:17.505103+0000","last_clean_scrub_stamp":"2024-04-26T12:09:17.505103+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:36.608825+0000","scrub_duration":0.012259582999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2734,"num_read_kb":1486856,"num_write":24627,"num_write_kb":4487808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7440,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26722,"ondisk_log_size":26722,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128606591,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":5972,"num_write_kb":129691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64376832,"data_stored":257213182,"data_compressed":19249503,"data_compressed_allocated":31694848,"data_compressed_original":224591872,"omap_allocated":4411,"internal_metadata":0},"log_size":7842,"ondisk_log_size":7842,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738432,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134428,"kb_used_data":27092,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94237412,"statfs":{"total":96636764160,"available":96499109888,"internally_reserved":0,"allocated":27742208,"data_stored":91797602,"data_compressed":6340284,"data_compressed_allocated":11272192,"data_compressed_original":75763712,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:09:01 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.40500000000000003,"15min":0.438},"min":{"1min":0.254,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.40200000000000002,"15min":0.42699999999999999},"min":{"1min":0.26900000000000002,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.378}]},{"osd":1,"last update":"Fri Apr 26 12:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.60799999999999998}]}]},{"osd":1,"up_from":66,"seq":283467841552,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68508,"kb_used_data":10644,"kb_used_omap":5,"kb_used_meta":57850,"kb_avail":94303332,"statfs":{"total":96636764160,"available":96566611968,"internally_reserved":0,"allocated":10899456,"data_stored":86136667,"data_compressed":7182940,"data_compressed_allocated":10076160,"data_compressed_original":85745664,"omap_allocated":6005,"internal_metadata":59238539},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.155,"5min":0.155,"15min":0.155},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.38600000000000001}]},{"osd":2,"last update":"Fri Apr 26 12:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.40899999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738432,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138884,"kb_used_data":27452,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232956,"statfs":{"total":96636764160,"available":96494546944,"internally_reserved":0,"allocated":28110848,"data_stored":81507786,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Apr 26 12:09:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.437},"min":{"1min":0.29199999999999998,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.63200000000000001,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.435,"15min":0.433},"min":{"1min":0.32900000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.65800000000000003,"5min":1.976,"15min":1.976},"last":0.46100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27357184,"data_stored":81158407,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10088448,"data_stored":85196920,"data_compressed":7176942,"data_compressed_allocated":10039296,"data_compressed_original":85172224,"omap_allocated":4411,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26931200,"data_stored":90857855,"data_compressed":6334286,"data_compressed_allocated":11235328,"data_compressed_original":75190272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:09:47.137 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.137 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.138 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.138 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.138 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.139 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.139 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.139 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.139 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.139 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.139 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.139 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.140 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.140 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.140 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.140 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.140 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.140 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.140 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.140 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.141 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.141 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.141 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.141 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.141 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.141 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.141 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.141 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.142 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.142 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.142 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.142 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.142 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:04:52.376986+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.142 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.142 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.142 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.142 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.143 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.143 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.143 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.143 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.143 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.143 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.143 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.143 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.143 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.144 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.144 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.144 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.144 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.144 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.144 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.144 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.144 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.144 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.145 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.145 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.145 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.145 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.145 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.145 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.145 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.145 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.145 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.146 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:09:47.146 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:10:07.147 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:10:07.462 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:10:07.464 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:10:07.473 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":240,"stamp":"2024-04-26T12:10:06.411276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129196959,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2917,"num_read_kb":1488438,"num_write":30802,"num_write_kb":4620959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7463,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34746,"ondisk_log_size":34746,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":341820,"kb_used_data":65188,"kb_used_omap":8,"kb_used_meta":276599,"kb_avail":282773700,"statfs":{"total":289910292480,"available":289560268800,"internally_reserved":0,"allocated":66752512,"data_stored":259442055,"data_compressed":19261499,"data_compressed_allocated":31768576,"data_compressed_original":225738752,"omap_allocated":9193,"internal_metadata":283237399},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003244"},"pg_stats":[{"pgid":"4.3f","version":"60'426","reported_seq":508,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746133+0000","last_change":"2024-04-26T12:08:51.753936+0000","last_active":"2024-04-26T12:08:53.746133+0000","last_peered":"2024-04-26T12:08:53.746133+0000","last_clean":"2024-04-26T12:08:53.746133+0000","last_became_active":"2024-04-26T12:08:51.750917+0000","last_became_peered":"2024-04-26T12:08:51.750917+0000","last_unstale":"2024-04-26T12:08:53.746133+0000","last_undegraded":"2024-04-26T12:08:53.746133+0000","last_fullsized":"2024-04-26T12:08:53.746133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9964,"num_write":393,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"60'470","reported_seq":602,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745918+0000","last_change":"2024-04-26T12:08:43.719204+0000","last_active":"2024-04-26T12:08:53.745918+0000","last_peered":"2024-04-26T12:08:53.745918+0000","last_clean":"2024-04-26T12:08:53.745918+0000","last_became_active":"2024-04-26T12:08:43.717325+0000","last_became_peered":"2024-04-26T12:08:43.717325+0000","last_unstale":"2024-04-26T12:08:53.745918+0000","last_undegraded":"2024-04-26T12:08:53.745918+0000","last_fullsized":"2024-04-26T12:08:53.745918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":34556,"num_write":444,"num_write_kb":129697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"60'370","reported_seq":804,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124711+0000","last_change":"2024-04-26T12:08:50.753639+0000","last_active":"2024-04-26T12:09:06.124711+0000","last_peered":"2024-04-26T12:09:06.124711+0000","last_clean":"2024-04-26T12:09:06.124711+0000","last_became_active":"2024-04-26T12:08:50.752468+0000","last_became_peered":"2024-04-26T12:08:50.752468+0000","last_unstale":"2024-04-26T12:09:06.124711+0000","last_undegraded":"2024-04-26T12:09:06.124711+0000","last_fullsized":"2024-04-26T12:09:06.124711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":349,"num_write_kb":51115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"60'377","reported_seq":487,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124688+0000","last_change":"2024-04-26T12:05:03.791234+0000","last_active":"2024-04-26T12:09:06.124688+0000","last_peered":"2024-04-26T12:09:06.124688+0000","last_clean":"2024-04-26T12:09:06.124688+0000","last_became_active":"2024-04-26T12:05:03.790717+0000","last_became_peered":"2024-04-26T12:05:03.790717+0000","last_unstale":"2024-04-26T12:09:06.124688+0000","last_undegraded":"2024-04-26T12:09:06.124688+0000","last_fullsized":"2024-04-26T12:09:06.124688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17376,"num_write":341,"num_write_kb":46680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'445","reported_seq":562,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:42.047300+0000","last_change":"2024-04-26T12:09:42.047407+0000","last_active":"2024-04-26T12:09:42.047300+0000","last_peered":"2024-04-26T12:09:42.047300+0000","last_clean":"2024-04-26T12:09:42.047300+0000","last_became_active":"2024-04-26T12:08:39.702117+0000","last_became_peered":"2024-04-26T12:08:39.702117+0000","last_unstale":"2024-04-26T12:09:42.047300+0000","last_undegraded":"2024-04-26T12:09:42.047300+0000","last_fullsized":"2024-04-26T12:09:42.047300+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'445","last_scrub_stamp":"2024-04-26T12:09:42.047279+0000","last_deep_scrub":"60'445","last_deep_scrub_stamp":"2024-04-26T12:09:42.047279+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.047279+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:26.392089+0000","scrub_duration":0.0023237290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24197,"num_write":416,"num_write_kb":80466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"60'375","reported_seq":472,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124685+0000","last_change":"2024-04-26T12:05:03.791560+0000","last_active":"2024-04-26T12:09:06.124685+0000","last_peered":"2024-04-26T12:09:06.124685+0000","last_clean":"2024-04-26T12:09:06.124685+0000","last_became_active":"2024-04-26T12:05:03.790578+0000","last_became_peered":"2024-04-26T12:05:03.790578+0000","last_unstale":"2024-04-26T12:09:06.124685+0000","last_undegraded":"2024-04-26T12:09:06.124685+0000","last_fullsized":"2024-04-26T12:09:06.124685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6518,"num_write":348,"num_write_kb":38078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'428","reported_seq":537,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:18.488710+0000","last_change":"2024-04-26T12:09:18.488710+0000","last_active":"2024-04-26T12:09:18.488710+0000","last_peered":"2024-04-26T12:09:18.488710+0000","last_clean":"2024-04-26T12:09:18.488710+0000","last_became_active":"2024-04-26T12:05:03.790615+0000","last_became_peered":"2024-04-26T12:05:03.790615+0000","last_unstale":"2024-04-26T12:09:18.488710+0000","last_undegraded":"2024-04-26T12:09:18.488710+0000","last_fullsized":"2024-04-26T12:09:18.488710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'428","last_scrub_stamp":"2024-04-26T12:09:18.488526+0000","last_deep_scrub":"60'428","last_deep_scrub_stamp":"2024-04-26T12:09:18.488526+0000","last_clean_scrub_stamp":"2024-04-26T12:09:18.488526+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:22.049575+0000","scrub_duration":0.0025858650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12560,"num_write":398,"num_write_kb":67332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"60'387","reported_seq":528,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124635+0000","last_change":"2024-04-26T12:05:03.785861+0000","last_active":"2024-04-26T12:09:06.124635+0000","last_peered":"2024-04-26T12:09:06.124635+0000","last_clean":"2024-04-26T12:09:06.124635+0000","last_became_active":"2024-04-26T12:05:03.785382+0000","last_became_peered":"2024-04-26T12:05:03.785382+0000","last_unstale":"2024-04-26T12:09:06.124635+0000","last_undegraded":"2024-04-26T12:09:06.124635+0000","last_fullsized":"2024-04-26T12:09:06.124635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":41160,"num_write":356,"num_write_kb":80219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"60'405","reported_seq":902,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244821+0000","last_change":"2024-04-26T12:08:46.730220+0000","last_active":"2024-04-26T12:09:05.244821+0000","last_peered":"2024-04-26T12:09:05.244821+0000","last_clean":"2024-04-26T12:09:05.244821+0000","last_became_active":"2024-04-26T12:08:46.729039+0000","last_became_peered":"2024-04-26T12:08:46.729039+0000","last_unstale":"2024-04-26T12:09:05.244821+0000","last_undegraded":"2024-04-26T12:09:05.244821+0000","last_fullsized":"2024-04-26T12:09:05.244821+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":11674,"num_write":372,"num_write_kb":34604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"60'425","reported_seq":589,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:28.089237+0000","last_change":"2024-04-26T12:09:28.089362+0000","last_active":"2024-04-26T12:09:28.089237+0000","last_peered":"2024-04-26T12:09:28.089237+0000","last_clean":"2024-04-26T12:09:28.089237+0000","last_became_active":"2024-04-26T12:08:41.716014+0000","last_became_peered":"2024-04-26T12:08:41.716014+0000","last_unstale":"2024-04-26T12:09:28.089237+0000","last_undegraded":"2024-04-26T12:09:28.089237+0000","last_fullsized":"2024-04-26T12:09:28.089237+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'425","last_scrub_stamp":"2024-04-26T12:09:28.089215+0000","last_deep_scrub":"60'425","last_deep_scrub_stamp":"2024-04-26T12:09:28.089215+0000","last_clean_scrub_stamp":"2024-04-26T12:09:28.089215+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:31.039189+0000","scrub_duration":0.0021431470000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":48419,"num_write":390,"num_write_kb":92286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"60'372","reported_seq":491,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124613+0000","last_change":"2024-04-26T12:05:03.791046+0000","last_active":"2024-04-26T12:09:06.124613+0000","last_peered":"2024-04-26T12:09:06.124613+0000","last_clean":"2024-04-26T12:09:06.124613+0000","last_became_active":"2024-04-26T12:05:03.790662+0000","last_became_peered":"2024-04-26T12:05:03.790662+0000","last_unstale":"2024-04-26T12:09:06.124613+0000","last_undegraded":"2024-04-26T12:09:06.124613+0000","last_fullsized":"2024-04-26T12:09:06.124613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25905,"num_write":353,"num_write_kb":75437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'351","reported_seq":438,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:08.024810+0000","last_change":"2024-04-26T12:09:08.024919+0000","last_active":"2024-04-26T12:09:08.024810+0000","last_peered":"2024-04-26T12:09:08.024810+0000","last_clean":"2024-04-26T12:09:08.024810+0000","last_became_active":"2024-04-26T12:08:41.715726+0000","last_became_peered":"2024-04-26T12:08:41.715726+0000","last_unstale":"2024-04-26T12:09:08.024810+0000","last_undegraded":"2024-04-26T12:09:08.024810+0000","last_fullsized":"2024-04-26T12:09:08.024810+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'351","last_scrub_stamp":"2024-04-26T12:09:08.024789+0000","last_deep_scrub":"60'351","last_deep_scrub_stamp":"2024-04-26T12:09:08.024789+0000","last_clean_scrub_stamp":"2024-04-26T12:09:08.024789+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:15.481742+0000","scrub_duration":0.0022688909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8884,"num_write":327,"num_write_kb":58289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"60'405","reported_seq":497,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:19.190020+0000","last_change":"2024-04-26T12:09:19.190112+0000","last_active":"2024-04-26T12:09:19.190020+0000","last_peered":"2024-04-26T12:09:19.190020+0000","last_clean":"2024-04-26T12:09:19.190020+0000","last_became_active":"2024-04-26T12:08:39.702141+0000","last_became_peered":"2024-04-26T12:08:39.702141+0000","last_unstale":"2024-04-26T12:09:19.190020+0000","last_undegraded":"2024-04-26T12:09:19.190020+0000","last_fullsized":"2024-04-26T12:09:19.190020+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'405","last_scrub_stamp":"2024-04-26T12:09:19.189997+0000","last_deep_scrub":"60'405","last_deep_scrub_stamp":"2024-04-26T12:09:19.189997+0000","last_clean_scrub_stamp":"2024-04-26T12:09:19.189997+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:45:38.242862+0000","scrub_duration":0.0019966300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6771,"num_write":372,"num_write_kb":54786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"60'431","reported_seq":950,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:21.555659+0000","last_change":"2024-04-26T12:09:21.555659+0000","last_active":"2024-04-26T12:09:21.555659+0000","last_peered":"2024-04-26T12:09:21.555659+0000","last_clean":"2024-04-26T12:09:21.555659+0000","last_became_active":"2024-04-26T12:08:48.740170+0000","last_became_peered":"2024-04-26T12:08:48.740170+0000","last_unstale":"2024-04-26T12:09:21.555659+0000","last_undegraded":"2024-04-26T12:09:21.555659+0000","last_fullsized":"2024-04-26T12:09:21.555659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'431","last_scrub_stamp":"2024-04-26T12:09:21.555526+0000","last_deep_scrub":"60'431","last_deep_scrub_stamp":"2024-04-26T12:09:21.555526+0000","last_clean_scrub_stamp":"2024-04-26T12:09:21.555526+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:09.119328+0000","scrub_duration":0.0022972299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26572,"num_write":398,"num_write_kb":83974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'394","reported_seq":909,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:35.716715+0000","last_change":"2024-04-26T12:09:35.716715+0000","last_active":"2024-04-26T12:09:35.716715+0000","last_peered":"2024-04-26T12:09:35.716715+0000","last_clean":"2024-04-26T12:09:35.716715+0000","last_became_active":"2024-04-26T12:08:41.715956+0000","last_became_peered":"2024-04-26T12:08:41.715956+0000","last_unstale":"2024-04-26T12:09:35.716715+0000","last_undegraded":"2024-04-26T12:09:35.716715+0000","last_fullsized":"2024-04-26T12:09:35.716715+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'394","last_scrub_stamp":"2024-04-26T12:09:35.716594+0000","last_deep_scrub":"60'394","last_deep_scrub_stamp":"2024-04-26T12:09:35.716594+0000","last_clean_scrub_stamp":"2024-04-26T12:09:35.716594+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:28.908858+0000","scrub_duration":0.0029063209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":38136,"num_write":355,"num_write_kb":38484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'432","reported_seq":556,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:07.460951+0000","last_change":"2024-04-26T12:09:07.460951+0000","last_active":"2024-04-26T12:09:07.460951+0000","last_peered":"2024-04-26T12:09:07.460951+0000","last_clean":"2024-04-26T12:09:07.460951+0000","last_became_active":"2024-04-26T12:05:03.785991+0000","last_became_peered":"2024-04-26T12:05:03.785991+0000","last_unstale":"2024-04-26T12:09:07.460951+0000","last_undegraded":"2024-04-26T12:09:07.460951+0000","last_fullsized":"2024-04-26T12:09:07.460951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'432","last_scrub_stamp":"2024-04-26T12:09:07.460722+0000","last_deep_scrub":"60'432","last_deep_scrub_stamp":"2024-04-26T12:09:07.460722+0000","last_clean_scrub_stamp":"2024-04-26T12:09:07.460722+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:52.118824+0000","scrub_duration":0.0028296200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18244,"num_write":400,"num_write_kb":59033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'381","reported_seq":851,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:30.632857+0000","last_change":"2024-04-26T12:09:30.632857+0000","last_active":"2024-04-26T12:09:30.632857+0000","last_peered":"2024-04-26T12:09:30.632857+0000","last_clean":"2024-04-26T12:09:30.632857+0000","last_became_active":"2024-04-26T12:08:52.745913+0000","last_became_peered":"2024-04-26T12:08:52.745913+0000","last_unstale":"2024-04-26T12:09:30.632857+0000","last_undegraded":"2024-04-26T12:09:30.632857+0000","last_fullsized":"2024-04-26T12:09:30.632857+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'381","last_scrub_stamp":"2024-04-26T12:09:30.632714+0000","last_deep_scrub":"60'381","last_deep_scrub_stamp":"2024-04-26T12:09:30.632714+0000","last_clean_scrub_stamp":"2024-04-26T12:09:30.632714+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:40.099051+0000","scrub_duration":0.001861026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":350,"num_write_kb":21212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"60'424","reported_seq":526,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:25.195300+0000","last_change":"2024-04-26T12:09:25.195412+0000","last_active":"2024-04-26T12:09:25.195300+0000","last_peered":"2024-04-26T12:09:25.195300+0000","last_clean":"2024-04-26T12:09:25.195300+0000","last_became_active":"2024-04-26T12:08:42.716846+0000","last_became_peered":"2024-04-26T12:08:42.716846+0000","last_unstale":"2024-04-26T12:09:25.195300+0000","last_undegraded":"2024-04-26T12:09:25.195300+0000","last_fullsized":"2024-04-26T12:09:25.195300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'424","last_scrub_stamp":"2024-04-26T12:09:25.195279+0000","last_deep_scrub":"60'424","last_deep_scrub_stamp":"2024-04-26T12:09:25.195279+0000","last_clean_scrub_stamp":"2024-04-26T12:09:25.195279+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:09.224012+0000","scrub_duration":0.00220163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13930,"num_write":388,"num_write_kb":116055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'426","reported_seq":918,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:08.468648+0000","last_change":"2024-04-26T12:09:08.468648+0000","last_active":"2024-04-26T12:09:08.468648+0000","last_peered":"2024-04-26T12:09:08.468648+0000","last_clean":"2024-04-26T12:09:08.468648+0000","last_became_active":"2024-04-26T12:08:53.747215+0000","last_became_peered":"2024-04-26T12:08:53.747215+0000","last_unstale":"2024-04-26T12:09:08.468648+0000","last_undegraded":"2024-04-26T12:09:08.468648+0000","last_fullsized":"2024-04-26T12:09:08.468648+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'426","last_scrub_stamp":"2024-04-26T12:09:08.468482+0000","last_deep_scrub":"60'426","last_deep_scrub_stamp":"2024-04-26T12:09:08.468482+0000","last_clean_scrub_stamp":"2024-04-26T12:09:08.468482+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:56.032283+0000","scrub_duration":0.0021666569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26908,"num_write":383,"num_write_kb":71324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"60'425","reported_seq":559,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:08.446169+0000","last_change":"2024-04-26T12:09:08.446169+0000","last_active":"2024-04-26T12:09:08.446169+0000","last_peered":"2024-04-26T12:09:08.446169+0000","last_clean":"2024-04-26T12:09:08.446169+0000","last_became_active":"2024-04-26T12:05:03.791061+0000","last_became_peered":"2024-04-26T12:05:03.791061+0000","last_unstale":"2024-04-26T12:09:08.446169+0000","last_undegraded":"2024-04-26T12:09:08.446169+0000","last_fullsized":"2024-04-26T12:09:08.446169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'425","last_scrub_stamp":"2024-04-26T12:09:08.446023+0000","last_deep_scrub":"60'425","last_deep_scrub_stamp":"2024-04-26T12:09:08.446023+0000","last_clean_scrub_stamp":"2024-04-26T12:09:08.446023+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:29.700242+0000","scrub_duration":0.002826112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19715,"num_write":398,"num_write_kb":30150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'450","reported_seq":651,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:45.764985+0000","last_change":"2024-04-26T12:09:45.765084+0000","last_active":"2024-04-26T12:09:45.764985+0000","last_peered":"2024-04-26T12:09:45.764985+0000","last_clean":"2024-04-26T12:09:45.764985+0000","last_became_active":"2024-04-26T12:05:03.791693+0000","last_became_peered":"2024-04-26T12:05:03.791693+0000","last_unstale":"2024-04-26T12:09:45.764985+0000","last_undegraded":"2024-04-26T12:09:45.764985+0000","last_fullsized":"2024-04-26T12:09:45.764985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'450","last_scrub_stamp":"2024-04-26T12:09:45.764962+0000","last_deep_scrub":"60'450","last_deep_scrub_stamp":"2024-04-26T12:09:45.764962+0000","last_clean_scrub_stamp":"2024-04-26T12:09:45.764962+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:21.995938+0000","scrub_duration":0.002787449,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":65124,"num_write":423,"num_write_kb":142714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'434","reported_seq":539,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745454+0000","last_change":"2024-04-26T12:08:46.730582+0000","last_active":"2024-04-26T12:08:53.745454+0000","last_peered":"2024-04-26T12:08:53.745454+0000","last_clean":"2024-04-26T12:08:53.745454+0000","last_became_active":"2024-04-26T12:08:46.728804+0000","last_became_peered":"2024-04-26T12:08:46.728804+0000","last_unstale":"2024-04-26T12:08:53.745454+0000","last_undegraded":"2024-04-26T12:08:53.745454+0000","last_fullsized":"2024-04-26T12:08:53.745454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":15350,"num_write":405,"num_write_kb":59295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"60'424","reported_seq":539,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244773+0000","last_change":"2024-04-26T12:05:03.788658+0000","last_active":"2024-04-26T12:09:05.244773+0000","last_peered":"2024-04-26T12:09:05.244773+0000","last_clean":"2024-04-26T12:09:05.244773+0000","last_became_active":"2024-04-26T12:05:03.788050+0000","last_became_peered":"2024-04-26T12:05:03.788050+0000","last_unstale":"2024-04-26T12:09:05.244773+0000","last_undegraded":"2024-04-26T12:09:05.244773+0000","last_fullsized":"2024-04-26T12:09:05.244773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23772,"num_write":390,"num_write_kb":67944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"60'447","reported_seq":527,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745010+0000","last_change":"2024-04-26T12:08:40.707153+0000","last_active":"2024-04-26T12:08:53.745010+0000","last_peered":"2024-04-26T12:08:53.745010+0000","last_clean":"2024-04-26T12:08:53.745010+0000","last_became_active":"2024-04-26T12:08:40.703880+0000","last_became_peered":"2024-04-26T12:08:40.703880+0000","last_unstale":"2024-04-26T12:08:53.745010+0000","last_undegraded":"2024-04-26T12:08:53.745010+0000","last_fullsized":"2024-04-26T12:08:53.745010+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9403,"num_write":417,"num_write_kb":67425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"60'417","reported_seq":519,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:26.148226+0000","last_change":"2024-04-26T12:09:26.148378+0000","last_active":"2024-04-26T12:09:26.148226+0000","last_peered":"2024-04-26T12:09:26.148226+0000","last_clean":"2024-04-26T12:09:26.148226+0000","last_became_active":"2024-04-26T12:08:42.715812+0000","last_became_peered":"2024-04-26T12:08:42.715812+0000","last_unstale":"2024-04-26T12:09:26.148226+0000","last_undegraded":"2024-04-26T12:09:26.148226+0000","last_fullsized":"2024-04-26T12:09:26.148226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'417","last_scrub_stamp":"2024-04-26T12:09:26.148189+0000","last_deep_scrub":"60'417","last_deep_scrub_stamp":"2024-04-26T12:09:26.148189+0000","last_clean_scrub_stamp":"2024-04-26T12:09:26.148189+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:12.073223+0000","scrub_duration":0.001950418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20466,"num_write":400,"num_write_kb":42225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"60'475","reported_seq":617,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.500379+0000","last_change":"2024-04-26T12:09:06.500379+0000","last_active":"2024-04-26T12:09:06.500379+0000","last_peered":"2024-04-26T12:09:06.500379+0000","last_clean":"2024-04-26T12:09:06.500379+0000","last_became_active":"2024-04-26T12:05:03.787562+0000","last_became_peered":"2024-04-26T12:05:03.787562+0000","last_unstale":"2024-04-26T12:09:06.500379+0000","last_undegraded":"2024-04-26T12:09:06.500379+0000","last_fullsized":"2024-04-26T12:09:06.500379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'475","last_scrub_stamp":"2024-04-26T12:09:06.500254+0000","last_deep_scrub":"60'475","last_deep_scrub_stamp":"2024-04-26T12:09:06.500254+0000","last_clean_scrub_stamp":"2024-04-26T12:09:06.500254+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:10.061304+0000","scrub_duration":0.002921515,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25186,"num_write":431,"num_write_kb":48184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"60'409","reported_seq":899,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124620+0000","last_change":"2024-04-26T12:08:49.741823+0000","last_active":"2024-04-26T12:09:06.124620+0000","last_peered":"2024-04-26T12:09:06.124620+0000","last_clean":"2024-04-26T12:09:06.124620+0000","last_became_active":"2024-04-26T12:08:49.740497+0000","last_became_peered":"2024-04-26T12:08:49.740497+0000","last_unstale":"2024-04-26T12:09:06.124620+0000","last_undegraded":"2024-04-26T12:09:06.124620+0000","last_fullsized":"2024-04-26T12:09:06.124620+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":20137,"num_write":374,"num_write_kb":55441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'392","reported_seq":505,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:47.060990+0000","last_change":"2024-04-26T12:09:47.061102+0000","last_active":"2024-04-26T12:09:47.060990+0000","last_peered":"2024-04-26T12:09:47.060990+0000","last_clean":"2024-04-26T12:09:47.060990+0000","last_became_active":"2024-04-26T12:08:47.735361+0000","last_became_peered":"2024-04-26T12:08:47.735361+0000","last_unstale":"2024-04-26T12:09:47.060990+0000","last_undegraded":"2024-04-26T12:09:47.060990+0000","last_fullsized":"2024-04-26T12:09:47.060990+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'392","last_scrub_stamp":"2024-04-26T12:09:47.060968+0000","last_deep_scrub":"60'392","last_deep_scrub_stamp":"2024-04-26T12:09:47.060968+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.060968+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:04.952295+0000","scrub_duration":0.0023190509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29179,"num_write":355,"num_write_kb":59011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'380","reported_seq":853,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:15.465302+0000","last_change":"2024-04-26T12:09:15.465302+0000","last_active":"2024-04-26T12:09:15.465302+0000","last_peered":"2024-04-26T12:09:15.465302+0000","last_clean":"2024-04-26T12:09:15.465302+0000","last_became_active":"2024-04-26T12:08:41.716234+0000","last_became_peered":"2024-04-26T12:08:41.716234+0000","last_unstale":"2024-04-26T12:09:15.465302+0000","last_undegraded":"2024-04-26T12:09:15.465302+0000","last_fullsized":"2024-04-26T12:09:15.465302+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'380","last_scrub_stamp":"2024-04-26T12:09:15.465164+0000","last_deep_scrub":"60'380","last_deep_scrub_stamp":"2024-04-26T12:09:15.465164+0000","last_clean_scrub_stamp":"2024-04-26T12:09:15.465164+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:49.168939+0000","scrub_duration":0.0024038250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13036,"num_write":347,"num_write_kb":33880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"60'461","reported_seq":577,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:10.990827+0000","last_change":"2024-04-26T12:09:10.990934+0000","last_active":"2024-04-26T12:09:10.990827+0000","last_peered":"2024-04-26T12:09:10.990827+0000","last_clean":"2024-04-26T12:09:10.990827+0000","last_became_active":"2024-04-26T12:08:46.730738+0000","last_became_peered":"2024-04-26T12:08:46.730738+0000","last_unstale":"2024-04-26T12:09:10.990827+0000","last_undegraded":"2024-04-26T12:09:10.990827+0000","last_fullsized":"2024-04-26T12:09:10.990827+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'461","last_scrub_stamp":"2024-04-26T12:09:10.990803+0000","last_deep_scrub":"60'461","last_deep_scrub_stamp":"2024-04-26T12:09:10.990803+0000","last_clean_scrub_stamp":"2024-04-26T12:09:10.990803+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:12.887104+0000","scrub_duration":0.0025321039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":32945,"num_write":426,"num_write_kb":63234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"60'411","reported_seq":914,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:43.659197+0000","last_change":"2024-04-26T12:09:43.659295+0000","last_active":"2024-04-26T12:09:43.659197+0000","last_peered":"2024-04-26T12:09:43.659197+0000","last_clean":"2024-04-26T12:09:43.659197+0000","last_became_active":"2024-04-26T12:08:40.703845+0000","last_became_peered":"2024-04-26T12:08:40.703845+0000","last_unstale":"2024-04-26T12:09:43.659197+0000","last_undegraded":"2024-04-26T12:09:43.659197+0000","last_fullsized":"2024-04-26T12:09:43.659197+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'411","last_scrub_stamp":"2024-04-26T12:09:43.659173+0000","last_deep_scrub":"60'411","last_deep_scrub_stamp":"2024-04-26T12:09:43.659173+0000","last_clean_scrub_stamp":"2024-04-26T12:09:43.659173+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:23.114338+0000","scrub_duration":0.002345588,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11499,"num_write":377,"num_write_kb":34249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'430","reported_seq":540,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124494+0000","last_change":"2024-04-26T12:05:03.791605+0000","last_active":"2024-04-26T12:09:06.124494+0000","last_peered":"2024-04-26T12:09:06.124494+0000","last_clean":"2024-04-26T12:09:06.124494+0000","last_became_active":"2024-04-26T12:05:03.791251+0000","last_became_peered":"2024-04-26T12:05:03.791251+0000","last_unstale":"2024-04-26T12:09:06.124494+0000","last_undegraded":"2024-04-26T12:09:06.124494+0000","last_fullsized":"2024-04-26T12:09:06.124494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14660,"num_write":404,"num_write_kb":60840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"60'392","reported_seq":501,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745266+0000","last_change":"2024-04-26T12:08:44.723861+0000","last_active":"2024-04-26T12:08:53.745266+0000","last_peered":"2024-04-26T12:08:53.745266+0000","last_clean":"2024-04-26T12:08:53.745266+0000","last_became_active":"2024-04-26T12:08:44.722120+0000","last_became_peered":"2024-04-26T12:08:44.722120+0000","last_unstale":"2024-04-26T12:08:53.745266+0000","last_undegraded":"2024-04-26T12:08:53.745266+0000","last_fullsized":"2024-04-26T12:08:53.745266+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31703,"num_write":351,"num_write_kb":59324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"84'518","reported_seq":609,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:56.653065+0000","last_change":"2024-04-26T12:09:56.653170+0000","last_active":"2024-04-26T12:09:56.653065+0000","last_peered":"2024-04-26T12:09:56.653065+0000","last_clean":"2024-04-26T12:09:56.653065+0000","last_became_active":"2024-04-26T12:05:03.429695+0000","last_became_peered":"2024-04-26T12:05:03.429695+0000","last_unstale":"2024-04-26T12:09:56.653065+0000","last_undegraded":"2024-04-26T12:09:56.653065+0000","last_fullsized":"2024-04-26T12:09:56.653065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'518","last_scrub_stamp":"2024-04-26T12:09:56.653042+0000","last_deep_scrub":"84'518","last_deep_scrub_stamp":"2024-04-26T12:09:56.653042+0000","last_clean_scrub_stamp":"2024-04-26T12:09:56.653042+0000","objects_scrubbed":4,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:18.886927+0000","scrub_duration":0.02530226,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":8377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'432","reported_seq":534,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:52.096388+0000","last_change":"2024-04-26T12:09:52.096505+0000","last_active":"2024-04-26T12:09:52.096388+0000","last_peered":"2024-04-26T12:09:52.096388+0000","last_clean":"2024-04-26T12:09:52.096388+0000","last_became_active":"2024-04-26T12:08:53.748972+0000","last_became_peered":"2024-04-26T12:08:53.748972+0000","last_unstale":"2024-04-26T12:09:52.096388+0000","last_undegraded":"2024-04-26T12:09:52.096388+0000","last_fullsized":"2024-04-26T12:09:52.096388+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'432","last_scrub_stamp":"2024-04-26T12:09:52.096365+0000","last_deep_scrub":"60'432","last_deep_scrub_stamp":"2024-04-26T12:09:52.096365+0000","last_clean_scrub_stamp":"2024-04-26T12:09:52.096365+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:25.671316+0000","scrub_duration":0.0023424370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":30094,"num_write":388,"num_write_kb":83741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"59'55","reported_seq":146,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:34.731942+0000","last_change":"2024-04-26T12:09:34.731942+0000","last_active":"2024-04-26T12:09:34.731942+0000","last_peered":"2024-04-26T12:09:34.731942+0000","last_clean":"2024-04-26T12:09:34.731942+0000","last_became_active":"2024-04-26T12:05:03.428098+0000","last_became_peered":"2024-04-26T12:05:03.428098+0000","last_unstale":"2024-04-26T12:09:34.731942+0000","last_undegraded":"2024-04-26T12:09:34.731942+0000","last_fullsized":"2024-04-26T12:09:34.731942+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'55","last_scrub_stamp":"2024-04-26T12:09:34.731815+0000","last_deep_scrub":"59'55","last_deep_scrub_stamp":"2024-04-26T12:09:34.731815+0000","last_clean_scrub_stamp":"2024-04-26T12:09:34.731815+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:35.655136+0000","scrub_duration":0.0016482490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"60'445","reported_seq":570,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:07.498568+0000","last_change":"2024-04-26T12:09:07.498568+0000","last_active":"2024-04-26T12:09:07.498568+0000","last_peered":"2024-04-26T12:09:07.498568+0000","last_clean":"2024-04-26T12:09:07.498568+0000","last_became_active":"2024-04-26T12:05:03.788039+0000","last_became_peered":"2024-04-26T12:05:03.788039+0000","last_unstale":"2024-04-26T12:09:07.498568+0000","last_undegraded":"2024-04-26T12:09:07.498568+0000","last_fullsized":"2024-04-26T12:09:07.498568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'445","last_scrub_stamp":"2024-04-26T12:09:07.498444+0000","last_deep_scrub":"60'445","last_deep_scrub_stamp":"2024-04-26T12:09:07.498444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:07.498444+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:34:55.801469+0000","scrub_duration":0.002448759,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":16079,"num_write":410,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"59'64","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:23.224837+0000","last_change":"2024-04-26T12:09:23.224938+0000","last_active":"2024-04-26T12:09:23.224837+0000","last_peered":"2024-04-26T12:09:23.224837+0000","last_clean":"2024-04-26T12:09:23.224837+0000","last_became_active":"2024-04-26T12:08:36.694921+0000","last_became_peered":"2024-04-26T12:08:36.694921+0000","last_unstale":"2024-04-26T12:09:23.224837+0000","last_undegraded":"2024-04-26T12:09:23.224837+0000","last_fullsized":"2024-04-26T12:09:23.224837+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'64","last_scrub_stamp":"2024-04-26T12:09:23.224815+0000","last_deep_scrub":"59'64","last_deep_scrub_stamp":"2024-04-26T12:09:23.224815+0000","last_clean_scrub_stamp":"2024-04-26T12:09:23.224815+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:34.040977+0000","scrub_duration":0.0015803169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"60'420","reported_seq":539,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244701+0000","last_change":"2024-04-26T12:05:03.788505+0000","last_active":"2024-04-26T12:09:05.244701+0000","last_peered":"2024-04-26T12:09:05.244701+0000","last_clean":"2024-04-26T12:09:05.244701+0000","last_became_active":"2024-04-26T12:05:03.788184+0000","last_became_peered":"2024-04-26T12:05:03.788184+0000","last_unstale":"2024-04-26T12:09:05.244701+0000","last_undegraded":"2024-04-26T12:09:05.244701+0000","last_fullsized":"2024-04-26T12:09:05.244701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":14666,"num_write":383,"num_write_kb":83769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"60'63","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124294+0000","last_change":"2024-04-26T12:08:36.697126+0000","last_active":"2024-04-26T12:09:06.124294+0000","last_peered":"2024-04-26T12:09:06.124294+0000","last_clean":"2024-04-26T12:09:06.124294+0000","last_became_active":"2024-04-26T12:08:36.696792+0000","last_became_peered":"2024-04-26T12:08:36.696792+0000","last_unstale":"2024-04-26T12:09:06.124294+0000","last_undegraded":"2024-04-26T12:09:06.124294+0000","last_fullsized":"2024-04-26T12:09:06.124294+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"84'234","reported_seq":350,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:00.696683+0000","last_change":"2024-04-26T12:10:00.696834+0000","last_active":"2024-04-26T12:10:00.696683+0000","last_peered":"2024-04-26T12:10:00.696683+0000","last_clean":"2024-04-26T12:10:00.696683+0000","last_became_active":"2024-04-26T12:08:39.703455+0000","last_became_peered":"2024-04-26T12:08:39.703455+0000","last_unstale":"2024-04-26T12:10:00.696683+0000","last_undegraded":"2024-04-26T12:10:00.696683+0000","last_fullsized":"2024-04-26T12:10:00.696683+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'234","last_scrub_stamp":"2024-04-26T12:10:00.696661+0000","last_deep_scrub":"84'234","last_deep_scrub_stamp":"2024-04-26T12:10:00.696661+0000","last_clean_scrub_stamp":"2024-04-26T12:10:00.696661+0000","objects_scrubbed":2,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:40.151826+0000","scrub_duration":0.014858877,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'408","reported_seq":492,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745191+0000","last_change":"2024-04-26T12:08:40.710236+0000","last_active":"2024-04-26T12:08:53.745191+0000","last_peered":"2024-04-26T12:08:53.745191+0000","last_clean":"2024-04-26T12:08:53.745191+0000","last_became_active":"2024-04-26T12:08:40.707357+0000","last_became_peered":"2024-04-26T12:08:40.707357+0000","last_unstale":"2024-04-26T12:08:53.745191+0000","last_undegraded":"2024-04-26T12:08:53.745191+0000","last_fullsized":"2024-04-26T12:08:53.745191+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12418,"num_write":371,"num_write_kb":58378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"84'304","reported_seq":384,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:57.079608+0000","last_change":"2024-04-26T12:09:57.079715+0000","last_active":"2024-04-26T12:09:57.079608+0000","last_peered":"2024-04-26T12:09:57.079608+0000","last_clean":"2024-04-26T12:09:57.079608+0000","last_became_active":"2024-04-26T12:08:39.703421+0000","last_became_peered":"2024-04-26T12:08:39.703421+0000","last_unstale":"2024-04-26T12:09:57.079608+0000","last_undegraded":"2024-04-26T12:09:57.079608+0000","last_fullsized":"2024-04-26T12:09:57.079608+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'304","last_scrub_stamp":"2024-04-26T12:09:57.079584+0000","last_deep_scrub":"84'304","last_deep_scrub_stamp":"2024-04-26T12:09:57.079584+0000","last_clean_scrub_stamp":"2024-04-26T12:09:57.079584+0000","objects_scrubbed":2,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:49.321329+0000","scrub_duration":0.016873233000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":4228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'439","reported_seq":499,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.744895+0000","last_change":"2024-04-26T12:08:41.717923+0000","last_active":"2024-04-26T12:08:53.744895+0000","last_peered":"2024-04-26T12:08:53.744895+0000","last_clean":"2024-04-26T12:08:53.744895+0000","last_became_active":"2024-04-26T12:08:41.715708+0000","last_became_peered":"2024-04-26T12:08:41.715708+0000","last_unstale":"2024-04-26T12:08:53.744895+0000","last_undegraded":"2024-04-26T12:08:53.744895+0000","last_fullsized":"2024-04-26T12:08:53.744895+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":30851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"84'591","reported_seq":707,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:39.824129+0000","last_change":"2024-04-26T12:09:39.824222+0000","last_active":"2024-04-26T12:09:39.824129+0000","last_peered":"2024-04-26T12:09:39.824129+0000","last_clean":"2024-04-26T12:09:39.824129+0000","last_became_active":"2024-04-26T12:08:39.703487+0000","last_became_peered":"2024-04-26T12:08:39.703487+0000","last_unstale":"2024-04-26T12:09:39.824129+0000","last_undegraded":"2024-04-26T12:09:39.824129+0000","last_fullsized":"2024-04-26T12:09:39.824129+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'591","last_scrub_stamp":"2024-04-26T12:09:39.824106+0000","last_deep_scrub":"84'591","last_deep_scrub_stamp":"2024-04-26T12:09:39.824106+0000","last_clean_scrub_stamp":"2024-04-26T12:09:39.824106+0000","objects_scrubbed":2,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:04.327252+0000","scrub_duration":0.019073356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":534,"num_write_kb":4333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'461","reported_seq":616,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124331+0000","last_change":"2024-04-26T12:05:03.791809+0000","last_active":"2024-04-26T12:09:06.124331+0000","last_peered":"2024-04-26T12:09:06.124331+0000","last_clean":"2024-04-26T12:09:06.124331+0000","last_became_active":"2024-04-26T12:05:03.791272+0000","last_became_peered":"2024-04-26T12:05:03.791272+0000","last_unstale":"2024-04-26T12:09:06.124331+0000","last_undegraded":"2024-04-26T12:09:06.124331+0000","last_fullsized":"2024-04-26T12:09:06.124331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":46123,"num_write":422,"num_write_kb":104552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'66","reported_seq":146,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124232+0000","last_change":"2024-04-26T12:05:03.430224+0000","last_active":"2024-04-26T12:09:06.124232+0000","last_peered":"2024-04-26T12:09:06.124232+0000","last_clean":"2024-04-26T12:09:06.124232+0000","last_became_active":"2024-04-26T12:05:03.429291+0000","last_became_peered":"2024-04-26T12:05:03.429291+0000","last_unstale":"2024-04-26T12:09:06.124232+0000","last_undegraded":"2024-04-26T12:09:06.124232+0000","last_fullsized":"2024-04-26T12:09:06.124232+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'428","reported_seq":554,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:41.623180+0000","last_change":"2024-04-26T12:09:41.623284+0000","last_active":"2024-04-26T12:09:41.623180+0000","last_peered":"2024-04-26T12:09:41.623180+0000","last_clean":"2024-04-26T12:09:41.623180+0000","last_became_active":"2024-04-26T12:05:03.787772+0000","last_became_peered":"2024-04-26T12:05:03.787772+0000","last_unstale":"2024-04-26T12:09:41.623180+0000","last_undegraded":"2024-04-26T12:09:41.623180+0000","last_fullsized":"2024-04-26T12:09:41.623180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'428","last_scrub_stamp":"2024-04-26T12:09:41.623156+0000","last_deep_scrub":"60'428","last_deep_scrub_stamp":"2024-04-26T12:09:41.623156+0000","last_clean_scrub_stamp":"2024-04-26T12:09:41.623156+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:27.740926+0000","scrub_duration":0.0027090880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15098,"num_write":394,"num_write_kb":42677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"84'198","reported_seq":289,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:56.557371+0000","last_change":"2024-04-26T12:09:56.557500+0000","last_active":"2024-04-26T12:09:56.557371+0000","last_peered":"2024-04-26T12:09:56.557371+0000","last_clean":"2024-04-26T12:09:56.557371+0000","last_became_active":"2024-04-26T12:05:03.430855+0000","last_became_peered":"2024-04-26T12:05:03.430855+0000","last_unstale":"2024-04-26T12:09:56.557371+0000","last_undegraded":"2024-04-26T12:09:56.557371+0000","last_fullsized":"2024-04-26T12:09:56.557371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'198","last_scrub_stamp":"2024-04-26T12:09:56.557334+0000","last_deep_scrub":"84'198","last_deep_scrub_stamp":"2024-04-26T12:09:56.557334+0000","last_clean_scrub_stamp":"2024-04-26T12:09:56.557334+0000","objects_scrubbed":3,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:47.167351+0000","scrub_duration":0.021508201000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"60'448","reported_seq":557,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:58.706684+0000","last_change":"2024-04-26T12:09:58.706808+0000","last_active":"2024-04-26T12:09:58.706684+0000","last_peered":"2024-04-26T12:09:58.706684+0000","last_clean":"2024-04-26T12:09:58.706684+0000","last_became_active":"2024-04-26T12:05:03.792119+0000","last_became_peered":"2024-04-26T12:05:03.792119+0000","last_unstale":"2024-04-26T12:09:58.706684+0000","last_undegraded":"2024-04-26T12:09:58.706684+0000","last_fullsized":"2024-04-26T12:09:58.706684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'448","last_scrub_stamp":"2024-04-26T12:09:58.706659+0000","last_deep_scrub":"60'448","last_deep_scrub_stamp":"2024-04-26T12:09:58.706659+0000","last_clean_scrub_stamp":"2024-04-26T12:09:58.706659+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:56.343142+0000","scrub_duration":0.0026622880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":13281,"num_write":420,"num_write_kb":59540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"59'171","reported_seq":251,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124198+0000","last_change":"2024-04-26T12:05:03.429811+0000","last_active":"2024-04-26T12:09:06.124198+0000","last_peered":"2024-04-26T12:09:06.124198+0000","last_clean":"2024-04-26T12:09:06.124198+0000","last_became_active":"2024-04-26T12:05:03.429469+0000","last_became_peered":"2024-04-26T12:05:03.429469+0000","last_unstale":"2024-04-26T12:09:06.124198+0000","last_undegraded":"2024-04-26T12:09:06.124198+0000","last_fullsized":"2024-04-26T12:09:06.124198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'412","reported_seq":936,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:17.500764+0000","last_change":"2024-04-26T12:09:17.500764+0000","last_active":"2024-04-26T12:09:17.500764+0000","last_peered":"2024-04-26T12:09:17.500764+0000","last_clean":"2024-04-26T12:09:17.500764+0000","last_became_active":"2024-04-26T12:08:51.751044+0000","last_became_peered":"2024-04-26T12:08:51.751044+0000","last_unstale":"2024-04-26T12:09:17.500764+0000","last_undegraded":"2024-04-26T12:09:17.500764+0000","last_fullsized":"2024-04-26T12:09:17.500764+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'412","last_scrub_stamp":"2024-04-26T12:09:17.500623+0000","last_deep_scrub":"60'412","last_deep_scrub_stamp":"2024-04-26T12:09:17.500623+0000","last_clean_scrub_stamp":"2024-04-26T12:09:17.500623+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:05.606930+0000","scrub_duration":0.0024460179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26310,"num_write":380,"num_write_kb":38462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"59'55","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.744899+0000","last_change":"2024-04-26T12:08:36.695355+0000","last_active":"2024-04-26T12:08:53.744899+0000","last_peered":"2024-04-26T12:08:53.744899+0000","last_clean":"2024-04-26T12:08:53.744899+0000","last_became_active":"2024-04-26T12:08:36.694346+0000","last_became_peered":"2024-04-26T12:08:36.694346+0000","last_unstale":"2024-04-26T12:08:53.744899+0000","last_undegraded":"2024-04-26T12:08:53.744899+0000","last_fullsized":"2024-04-26T12:08:53.744899+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"60'362","reported_seq":819,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124433+0000","last_change":"2024-04-26T12:08:41.717048+0000","last_active":"2024-04-26T12:09:06.124433+0000","last_peered":"2024-04-26T12:09:06.124433+0000","last_clean":"2024-04-26T12:09:06.124433+0000","last_became_active":"2024-04-26T12:08:41.716102+0000","last_became_peered":"2024-04-26T12:08:41.716102+0000","last_unstale":"2024-04-26T12:09:06.124433+0000","last_undegraded":"2024-04-26T12:09:06.124433+0000","last_fullsized":"2024-04-26T12:09:06.124433+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21408,"num_write":333,"num_write_kb":66549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"59'378","reported_seq":440,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745101+0000","last_change":"2024-04-26T12:08:39.702797+0000","last_active":"2024-04-26T12:08:53.745101+0000","last_peered":"2024-04-26T12:08:53.745101+0000","last_clean":"2024-04-26T12:08:53.745101+0000","last_became_active":"2024-04-26T12:08:39.702438+0000","last_became_peered":"2024-04-26T12:08:39.702438+0000","last_unstale":"2024-04-26T12:08:53.745101+0000","last_undegraded":"2024-04-26T12:08:53.745101+0000","last_fullsized":"2024-04-26T12:08:53.745101+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"60'407","reported_seq":919,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244628+0000","last_change":"2024-04-26T12:08:45.724853+0000","last_active":"2024-04-26T12:09:05.244628+0000","last_peered":"2024-04-26T12:09:05.244628+0000","last_clean":"2024-04-26T12:09:05.244628+0000","last_became_active":"2024-04-26T12:08:45.723772+0000","last_became_peered":"2024-04-26T12:08:45.723772+0000","last_unstale":"2024-04-26T12:09:05.244628+0000","last_undegraded":"2024-04-26T12:09:05.244628+0000","last_fullsized":"2024-04-26T12:09:05.244628+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":40156,"num_write":373,"num_write_kb":91285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":295,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:56.394757+0000","last_change":"2024-04-26T12:08:36.697892+0000","last_active":"2024-04-26T12:08:56.394757+0000","last_peered":"2024-04-26T12:08:56.394757+0000","last_clean":"2024-04-26T12:08:56.394757+0000","last_became_active":"2024-04-26T12:08:36.697508+0000","last_became_peered":"2024-04-26T12:08:36.697508+0000","last_unstale":"2024-04-26T12:08:56.394757+0000","last_undegraded":"2024-04-26T12:08:56.394757+0000","last_fullsized":"2024-04-26T12:08:56.394757+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:52.376986+0000","last_clean_scrub_stamp":"2024-04-26T12:04:52.376986+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":83,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124100+0000","last_change":"2024-04-26T12:04:59.403711+0000","last_active":"2024-04-26T12:09:06.124100+0000","last_peered":"2024-04-26T12:09:06.124100+0000","last_clean":"2024-04-26T12:09:06.124100+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:09:06.124100+0000","last_undegraded":"2024-04-26T12:09:06.124100+0000","last_fullsized":"2024-04-26T12:09:06.124100+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"84'795","reported_seq":912,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:02.576016+0000","last_change":"2024-04-26T12:10:02.576130+0000","last_active":"2024-04-26T12:10:02.576016+0000","last_peered":"2024-04-26T12:10:02.576016+0000","last_clean":"2024-04-26T12:10:02.576016+0000","last_became_active":"2024-04-26T12:08:39.701760+0000","last_became_peered":"2024-04-26T12:08:39.701760+0000","last_unstale":"2024-04-26T12:10:02.576016+0000","last_undegraded":"2024-04-26T12:10:02.576016+0000","last_fullsized":"2024-04-26T12:10:02.576016+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'795","last_scrub_stamp":"2024-04-26T12:10:02.575986+0000","last_deep_scrub":"84'795","last_deep_scrub_stamp":"2024-04-26T12:10:02.575986+0000","last_clean_scrub_stamp":"2024-04-26T12:10:02.575986+0000","objects_scrubbed":2,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:07.133416+0000","scrub_duration":0.029735391,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":8533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"60'466","reported_seq":1025,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:03.603760+0000","last_change":"2024-04-26T12:10:03.603869+0000","last_active":"2024-04-26T12:10:03.603760+0000","last_peered":"2024-04-26T12:10:03.603760+0000","last_clean":"2024-04-26T12:10:03.603760+0000","last_became_active":"2024-04-26T12:08:52.746147+0000","last_became_peered":"2024-04-26T12:08:52.746147+0000","last_unstale":"2024-04-26T12:10:03.603760+0000","last_undegraded":"2024-04-26T12:10:03.603760+0000","last_fullsized":"2024-04-26T12:10:03.603760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'466","last_scrub_stamp":"2024-04-26T12:10:03.603739+0000","last_deep_scrub":"60'466","last_deep_scrub_stamp":"2024-04-26T12:10:03.603739+0000","last_clean_scrub_stamp":"2024-04-26T12:10:03.603739+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:57.843220+0000","scrub_duration":0.001899956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":37547,"num_write":422,"num_write_kb":96579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:01.395373+0000","last_change":"2024-04-26T12:08:36.695759+0000","last_active":"2024-04-26T12:09:01.395373+0000","last_peered":"2024-04-26T12:09:01.395373+0000","last_clean":"2024-04-26T12:09:01.395373+0000","last_became_active":"2024-04-26T12:08:36.695444+0000","last_became_peered":"2024-04-26T12:08:36.695444+0000","last_unstale":"2024-04-26T12:09:01.395373+0000","last_undegraded":"2024-04-26T12:09:01.395373+0000","last_fullsized":"2024-04-26T12:09:01.395373+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"84'115","reported_seq":253,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:03.595427+0000","last_change":"2024-04-26T12:10:03.595540+0000","last_active":"2024-04-26T12:10:03.595427+0000","last_peered":"2024-04-26T12:10:03.595427+0000","last_clean":"2024-04-26T12:10:03.595427+0000","last_became_active":"2024-04-26T12:05:03.427985+0000","last_became_peered":"2024-04-26T12:05:03.427985+0000","last_unstale":"2024-04-26T12:10:03.595427+0000","last_undegraded":"2024-04-26T12:10:03.595427+0000","last_fullsized":"2024-04-26T12:10:03.595427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'115","last_scrub_stamp":"2024-04-26T12:10:03.595404+0000","last_deep_scrub":"84'115","last_deep_scrub_stamp":"2024-04-26T12:10:03.595404+0000","last_clean_scrub_stamp":"2024-04-26T12:10:03.595404+0000","objects_scrubbed":1,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:28.377952+0000","scrub_duration":0.0064998820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466015,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":47,"num_write_kb":1464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"60'492","reported_seq":667,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.067124+0000","last_change":"2024-04-26T12:09:06.067244+0000","last_active":"2024-04-26T12:09:06.067124+0000","last_peered":"2024-04-26T12:09:06.067124+0000","last_clean":"2024-04-26T12:09:06.067124+0000","last_became_active":"2024-04-26T12:08:49.739496+0000","last_became_peered":"2024-04-26T12:08:49.739496+0000","last_unstale":"2024-04-26T12:09:06.067124+0000","last_undegraded":"2024-04-26T12:09:06.067124+0000","last_fullsized":"2024-04-26T12:09:06.067124+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'492","last_scrub_stamp":"2024-04-26T12:09:06.067102+0000","last_deep_scrub":"60'492","last_deep_scrub_stamp":"2024-04-26T12:09:06.067102+0000","last_clean_scrub_stamp":"2024-04-26T12:09:06.067102+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:55.504447+0000","scrub_duration":0.0024880229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":63988,"num_write":466,"num_write_kb":154489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":107,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.552902+0000","last_change":"2024-04-26T12:09:50.553084+0000","last_active":"2024-04-26T12:09:50.552902+0000","last_peered":"2024-04-26T12:09:50.552902+0000","last_clean":"2024-04-26T12:09:50.552902+0000","last_became_active":"2024-04-26T12:08:36.696619+0000","last_became_peered":"2024-04-26T12:08:36.696619+0000","last_unstale":"2024-04-26T12:09:50.552902+0000","last_undegraded":"2024-04-26T12:09:50.552902+0000","last_fullsized":"2024-04-26T12:09:50.552902+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:50.552881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:50.552881+0000","last_clean_scrub_stamp":"2024-04-26T12:09:50.552881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:13:20.480035+0000","scrub_duration":0.0016118110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"59'325","reported_seq":387,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.744827+0000","last_change":"2024-04-26T12:08:39.704052+0000","last_active":"2024-04-26T12:08:53.744827+0000","last_peered":"2024-04-26T12:08:53.744827+0000","last_clean":"2024-04-26T12:08:53.744827+0000","last_became_active":"2024-04-26T12:08:39.703696+0000","last_became_peered":"2024-04-26T12:08:39.703696+0000","last_unstale":"2024-04-26T12:08:53.744827+0000","last_undegraded":"2024-04-26T12:08:53.744827+0000","last_fullsized":"2024-04-26T12:08:53.744827+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":8296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"60'359","reported_seq":787,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244590+0000","last_change":"2024-04-26T12:08:47.737443+0000","last_active":"2024-04-26T12:09:05.244590+0000","last_peered":"2024-04-26T12:09:05.244590+0000","last_clean":"2024-04-26T12:09:05.244590+0000","last_became_active":"2024-04-26T12:08:47.735729+0000","last_became_peered":"2024-04-26T12:08:47.735729+0000","last_unstale":"2024-04-26T12:09:05.244590+0000","last_undegraded":"2024-04-26T12:09:05.244590+0000","last_fullsized":"2024-04-26T12:09:05.244590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9448,"num_write":336,"num_write_kb":74900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":83,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124113+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:09:06.124113+0000","last_peered":"2024-04-26T12:09:06.124113+0000","last_clean":"2024-04-26T12:09:06.124113+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:09:06.124113+0000","last_undegraded":"2024-04-26T12:09:06.124113+0000","last_fullsized":"2024-04-26T12:09:06.124113+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"59'67","reported_seq":147,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124098+0000","last_change":"2024-04-26T12:05:03.430140+0000","last_active":"2024-04-26T12:09:06.124098+0000","last_peered":"2024-04-26T12:09:06.124098+0000","last_clean":"2024-04-26T12:09:06.124098+0000","last_became_active":"2024-04-26T12:05:03.429838+0000","last_became_peered":"2024-04-26T12:05:03.429838+0000","last_unstale":"2024-04-26T12:09:06.124098+0000","last_undegraded":"2024-04-26T12:09:06.124098+0000","last_fullsized":"2024-04-26T12:09:06.124098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"60'403","reported_seq":907,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:18.489116+0000","last_change":"2024-04-26T12:09:18.489255+0000","last_active":"2024-04-26T12:09:18.489116+0000","last_peered":"2024-04-26T12:09:18.489116+0000","last_clean":"2024-04-26T12:09:18.489116+0000","last_became_active":"2024-04-26T12:08:50.752366+0000","last_became_peered":"2024-04-26T12:08:50.752366+0000","last_unstale":"2024-04-26T12:09:18.489116+0000","last_undegraded":"2024-04-26T12:09:18.489116+0000","last_fullsized":"2024-04-26T12:09:18.489116+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'403","last_scrub_stamp":"2024-04-26T12:09:18.489093+0000","last_deep_scrub":"60'403","last_deep_scrub_stamp":"2024-04-26T12:09:18.489093+0000","last_clean_scrub_stamp":"2024-04-26T12:09:18.489093+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:04.607536+0000","scrub_duration":0.0022127980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30094,"num_write":370,"num_write_kb":104181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"84'470","reported_seq":561,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:04.611927+0000","last_change":"2024-04-26T12:10:04.612034+0000","last_active":"2024-04-26T12:10:04.611927+0000","last_peered":"2024-04-26T12:10:04.611927+0000","last_clean":"2024-04-26T12:10:04.611927+0000","last_became_active":"2024-04-26T12:05:03.429146+0000","last_became_peered":"2024-04-26T12:05:03.429146+0000","last_unstale":"2024-04-26T12:10:04.611927+0000","last_undegraded":"2024-04-26T12:10:04.611927+0000","last_fullsized":"2024-04-26T12:10:04.611927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'470","last_scrub_stamp":"2024-04-26T12:10:04.611896+0000","last_deep_scrub":"84'470","last_deep_scrub_stamp":"2024-04-26T12:10:04.611896+0000","last_clean_scrub_stamp":"2024-04-26T12:10:04.611896+0000","objects_scrubbed":1,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:26.920507+0000","scrub_duration":0.016499944999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":107,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:46.574665+0000","last_change":"2024-04-26T12:09:46.574794+0000","last_active":"2024-04-26T12:09:46.574665+0000","last_peered":"2024-04-26T12:09:46.574665+0000","last_clean":"2024-04-26T12:09:46.574665+0000","last_became_active":"2024-04-26T12:08:36.697618+0000","last_became_peered":"2024-04-26T12:08:36.697618+0000","last_unstale":"2024-04-26T12:09:46.574665+0000","last_undegraded":"2024-04-26T12:09:46.574665+0000","last_fullsized":"2024-04-26T12:09:46.574665+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:46.574644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:46.574644+0000","last_clean_scrub_stamp":"2024-04-26T12:09:46.574644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:41.737446+0000","scrub_duration":0.001525857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'354","reported_seq":425,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.093137+0000","last_change":"2024-04-26T12:09:50.093263+0000","last_active":"2024-04-26T12:09:50.093137+0000","last_peered":"2024-04-26T12:09:50.093137+0000","last_clean":"2024-04-26T12:09:50.093137+0000","last_became_active":"2024-04-26T12:08:45.724153+0000","last_became_peered":"2024-04-26T12:08:45.724153+0000","last_unstale":"2024-04-26T12:09:50.093137+0000","last_undegraded":"2024-04-26T12:09:50.093137+0000","last_fullsized":"2024-04-26T12:09:50.093137+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'354","last_scrub_stamp":"2024-04-26T12:09:50.093102+0000","last_deep_scrub":"60'354","last_deep_scrub_stamp":"2024-04-26T12:09:50.093102+0000","last_clean_scrub_stamp":"2024-04-26T12:09:50.093102+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:31.582282+0000","scrub_duration":0.0022860559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":416,"num_write":319,"num_write_kb":17259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"59'53","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:54.530670+0000","last_change":"2024-04-26T12:09:54.530774+0000","last_active":"2024-04-26T12:09:54.530670+0000","last_peered":"2024-04-26T12:09:54.530670+0000","last_clean":"2024-04-26T12:09:54.530670+0000","last_became_active":"2024-04-26T12:08:36.697832+0000","last_became_peered":"2024-04-26T12:08:36.697832+0000","last_unstale":"2024-04-26T12:09:54.530670+0000","last_undegraded":"2024-04-26T12:09:54.530670+0000","last_fullsized":"2024-04-26T12:09:54.530670+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'53","last_scrub_stamp":"2024-04-26T12:09:54.530648+0000","last_deep_scrub":"59'53","last_deep_scrub_stamp":"2024-04-26T12:09:54.530648+0000","last_clean_scrub_stamp":"2024-04-26T12:09:54.530648+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:52.718701+0000","scrub_duration":0.001815388,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745977+0000","last_change":"2024-04-26T12:08:36.698131+0000","last_active":"2024-04-26T12:08:53.745977+0000","last_peered":"2024-04-26T12:08:53.745977+0000","last_clean":"2024-04-26T12:08:53.745977+0000","last_became_active":"2024-04-26T12:08:36.697698+0000","last_became_peered":"2024-04-26T12:08:36.697698+0000","last_unstale":"2024-04-26T12:08:53.745977+0000","last_undegraded":"2024-04-26T12:08:53.745977+0000","last_fullsized":"2024-04-26T12:08:53.745977+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'399","reported_seq":478,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745182+0000","last_change":"2024-04-26T12:08:40.705752+0000","last_active":"2024-04-26T12:08:53.745182+0000","last_peered":"2024-04-26T12:08:53.745182+0000","last_clean":"2024-04-26T12:08:53.745182+0000","last_became_active":"2024-04-26T12:08:40.703906+0000","last_became_peered":"2024-04-26T12:08:40.703906+0000","last_unstale":"2024-04-26T12:08:53.745182+0000","last_undegraded":"2024-04-26T12:08:53.745182+0000","last_fullsized":"2024-04-26T12:08:53.745182+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11720,"num_write":363,"num_write_kb":66914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"84'66","reported_seq":171,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:42.618525+0000","last_change":"2024-04-26T12:09:42.618673+0000","last_active":"2024-04-26T12:09:42.618525+0000","last_peered":"2024-04-26T12:09:42.618525+0000","last_clean":"2024-04-26T12:09:42.618525+0000","last_became_active":"2024-04-26T12:08:36.699058+0000","last_became_peered":"2024-04-26T12:08:36.699058+0000","last_unstale":"2024-04-26T12:09:42.618525+0000","last_undegraded":"2024-04-26T12:09:42.618525+0000","last_fullsized":"2024-04-26T12:09:42.618525+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'66","last_scrub_stamp":"2024-04-26T12:09:42.618500+0000","last_deep_scrub":"84'66","last_deep_scrub_stamp":"2024-04-26T12:09:42.618500+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.618500+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:34.338430+0000","scrub_duration":0.0032759640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":107,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:52.522553+0000","last_change":"2024-04-26T12:09:52.522681+0000","last_active":"2024-04-26T12:09:52.522553+0000","last_peered":"2024-04-26T12:09:52.522553+0000","last_clean":"2024-04-26T12:09:52.522553+0000","last_became_active":"2024-04-26T12:08:36.697407+0000","last_became_peered":"2024-04-26T12:08:36.697407+0000","last_unstale":"2024-04-26T12:09:52.522553+0000","last_undegraded":"2024-04-26T12:09:52.522553+0000","last_fullsized":"2024-04-26T12:09:52.522553+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:52.522518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:52.522518+0000","last_clean_scrub_stamp":"2024-04-26T12:09:52.522518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:32.712239+0000","scrub_duration":0.001939184,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'424","reported_seq":554,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:36.668960+0000","last_change":"2024-04-26T12:09:36.669071+0000","last_active":"2024-04-26T12:09:36.668960+0000","last_peered":"2024-04-26T12:09:36.668960+0000","last_clean":"2024-04-26T12:09:36.668960+0000","last_became_active":"2024-04-26T12:05:03.789390+0000","last_became_peered":"2024-04-26T12:05:03.789390+0000","last_unstale":"2024-04-26T12:09:36.668960+0000","last_undegraded":"2024-04-26T12:09:36.668960+0000","last_fullsized":"2024-04-26T12:09:36.668960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'424","last_scrub_stamp":"2024-04-26T12:09:36.668937+0000","last_deep_scrub":"60'424","last_deep_scrub_stamp":"2024-04-26T12:09:36.668937+0000","last_clean_scrub_stamp":"2024-04-26T12:09:36.668937+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:58.766848+0000","scrub_duration":0.0024505759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17027,"num_write":386,"num_write_kb":58797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"84'71","reported_seq":162,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:45.617441+0000","last_change":"2024-04-26T12:09:45.617547+0000","last_active":"2024-04-26T12:09:45.617441+0000","last_peered":"2024-04-26T12:09:45.617441+0000","last_clean":"2024-04-26T12:09:45.617441+0000","last_became_active":"2024-04-26T12:05:03.428803+0000","last_became_peered":"2024-04-26T12:05:03.428803+0000","last_unstale":"2024-04-26T12:09:45.617441+0000","last_undegraded":"2024-04-26T12:09:45.617441+0000","last_fullsized":"2024-04-26T12:09:45.617441+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'71","last_scrub_stamp":"2024-04-26T12:09:45.617416+0000","last_deep_scrub":"84'71","last_deep_scrub_stamp":"2024-04-26T12:09:45.617416+0000","last_clean_scrub_stamp":"2024-04-26T12:09:45.617416+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:39.856897+0000","scrub_duration":0.0067924539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124101+0000","last_change":"2024-04-26T12:08:36.698775+0000","last_active":"2024-04-26T12:09:06.124101+0000","last_peered":"2024-04-26T12:09:06.124101+0000","last_clean":"2024-04-26T12:09:06.124101+0000","last_became_active":"2024-04-26T12:08:36.698523+0000","last_became_peered":"2024-04-26T12:08:36.698523+0000","last_unstale":"2024-04-26T12:09:06.124101+0000","last_undegraded":"2024-04-26T12:09:06.124101+0000","last_fullsized":"2024-04-26T12:09:06.124101+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'393","reported_seq":484,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:40.062039+0000","last_change":"2024-04-26T12:09:40.062141+0000","last_active":"2024-04-26T12:09:40.062039+0000","last_peered":"2024-04-26T12:09:40.062039+0000","last_clean":"2024-04-26T12:09:40.062039+0000","last_became_active":"2024-04-26T12:08:40.703873+0000","last_became_peered":"2024-04-26T12:08:40.703873+0000","last_unstale":"2024-04-26T12:09:40.062039+0000","last_undegraded":"2024-04-26T12:09:40.062039+0000","last_fullsized":"2024-04-26T12:09:40.062039+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'393","last_scrub_stamp":"2024-04-26T12:09:40.062013+0000","last_deep_scrub":"60'393","last_deep_scrub_stamp":"2024-04-26T12:09:40.062013+0000","last_clean_scrub_stamp":"2024-04-26T12:09:40.062013+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:47.183215+0000","scrub_duration":0.0022492969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":11991,"num_write":357,"num_write_kb":83226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'419","reported_seq":905,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:29.651923+0000","last_change":"2024-04-26T12:09:29.651923+0000","last_active":"2024-04-26T12:09:29.651923+0000","last_peered":"2024-04-26T12:09:29.651923+0000","last_clean":"2024-04-26T12:09:29.651923+0000","last_became_active":"2024-04-26T12:08:44.722574+0000","last_became_peered":"2024-04-26T12:08:44.722574+0000","last_unstale":"2024-04-26T12:09:29.651923+0000","last_undegraded":"2024-04-26T12:09:29.651923+0000","last_fullsized":"2024-04-26T12:09:29.651923+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'419","last_scrub_stamp":"2024-04-26T12:09:29.651776+0000","last_deep_scrub":"60'419","last_deep_scrub_stamp":"2024-04-26T12:09:29.651776+0000","last_clean_scrub_stamp":"2024-04-26T12:09:29.651776+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:03.355550+0000","scrub_duration":0.0023698270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14983,"num_write":376,"num_write_kb":76749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"84'404","reported_seq":526,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.702349+0000","last_change":"2024-04-26T12:09:50.702472+0000","last_active":"2024-04-26T12:09:50.702349+0000","last_peered":"2024-04-26T12:09:50.702349+0000","last_clean":"2024-04-26T12:09:50.702349+0000","last_became_active":"2024-04-26T12:08:39.703516+0000","last_became_peered":"2024-04-26T12:08:39.703516+0000","last_unstale":"2024-04-26T12:09:50.702349+0000","last_undegraded":"2024-04-26T12:09:50.702349+0000","last_fullsized":"2024-04-26T12:09:50.702349+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'404","last_scrub_stamp":"2024-04-26T12:09:50.702328+0000","last_deep_scrub":"84'404","last_deep_scrub_stamp":"2024-04-26T12:09:50.702328+0000","last_clean_scrub_stamp":"2024-04-26T12:09:50.702328+0000","objects_scrubbed":6,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:51.625649+0000","scrub_duration":0.02885393,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699266,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":9692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9692849,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'428","reported_seq":953,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:04.569401+0000","last_change":"2024-04-26T12:10:04.569511+0000","last_active":"2024-04-26T12:10:04.569401+0000","last_peered":"2024-04-26T12:10:04.569401+0000","last_clean":"2024-04-26T12:10:04.569401+0000","last_became_active":"2024-04-26T12:08:50.752328+0000","last_became_peered":"2024-04-26T12:08:50.752328+0000","last_unstale":"2024-04-26T12:10:04.569401+0000","last_undegraded":"2024-04-26T12:10:04.569401+0000","last_fullsized":"2024-04-26T12:10:04.569401+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'428","last_scrub_stamp":"2024-04-26T12:10:04.569378+0000","last_deep_scrub":"60'428","last_deep_scrub_stamp":"2024-04-26T12:10:04.569378+0000","last_clean_scrub_stamp":"2024-04-26T12:10:04.569378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:47.307742+0000","scrub_duration":0.0028671769999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":26594,"num_write":396,"num_write_kb":67932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"84'93","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:56.025232+0000","last_change":"2024-04-26T12:09:56.025331+0000","last_active":"2024-04-26T12:09:56.025232+0000","last_peered":"2024-04-26T12:09:56.025232+0000","last_clean":"2024-04-26T12:09:56.025232+0000","last_became_active":"2024-04-26T12:08:36.697650+0000","last_became_peered":"2024-04-26T12:08:36.697650+0000","last_unstale":"2024-04-26T12:09:56.025232+0000","last_undegraded":"2024-04-26T12:09:56.025232+0000","last_fullsized":"2024-04-26T12:09:56.025232+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'93","last_scrub_stamp":"2024-04-26T12:09:56.025210+0000","last_deep_scrub":"84'93","last_deep_scrub_stamp":"2024-04-26T12:09:56.025210+0000","last_clean_scrub_stamp":"2024-04-26T12:09:56.025210+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:37.270337+0000","scrub_duration":0.0035178729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"59'316","reported_seq":396,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124279+0000","last_change":"2024-04-26T12:05:03.429257+0000","last_active":"2024-04-26T12:09:06.124279+0000","last_peered":"2024-04-26T12:09:06.124279+0000","last_clean":"2024-04-26T12:09:06.124279+0000","last_became_active":"2024-04-26T12:05:03.428921+0000","last_became_peered":"2024-04-26T12:05:03.428921+0000","last_unstale":"2024-04-26T12:09:06.124279+0000","last_undegraded":"2024-04-26T12:09:06.124279+0000","last_fullsized":"2024-04-26T12:09:06.124279+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'495","reported_seq":638,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:25.547380+0000","last_change":"2024-04-26T12:09:25.547380+0000","last_active":"2024-04-26T12:09:25.547380+0000","last_peered":"2024-04-26T12:09:25.547380+0000","last_clean":"2024-04-26T12:09:25.547380+0000","last_became_active":"2024-04-26T12:05:03.787533+0000","last_became_peered":"2024-04-26T12:05:03.787533+0000","last_unstale":"2024-04-26T12:09:25.547380+0000","last_undegraded":"2024-04-26T12:09:25.547380+0000","last_fullsized":"2024-04-26T12:09:25.547380+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'495","last_scrub_stamp":"2024-04-26T12:09:25.547250+0000","last_deep_scrub":"60'495","last_deep_scrub_stamp":"2024-04-26T12:09:25.547250+0000","last_clean_scrub_stamp":"2024-04-26T12:09:25.547250+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:52.939986+0000","scrub_duration":0.002519252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37174,"num_write":458,"num_write_kb":125832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'51","reported_seq":142,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:29.586170+0000","last_change":"2024-04-26T12:09:29.586170+0000","last_active":"2024-04-26T12:09:29.586170+0000","last_peered":"2024-04-26T12:09:29.586170+0000","last_clean":"2024-04-26T12:09:29.586170+0000","last_became_active":"2024-04-26T12:05:03.428445+0000","last_became_peered":"2024-04-26T12:05:03.428445+0000","last_unstale":"2024-04-26T12:09:29.586170+0000","last_undegraded":"2024-04-26T12:09:29.586170+0000","last_fullsized":"2024-04-26T12:09:29.586170+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'51","last_scrub_stamp":"2024-04-26T12:09:29.585971+0000","last_deep_scrub":"59'51","last_deep_scrub_stamp":"2024-04-26T12:09:29.585971+0000","last_clean_scrub_stamp":"2024-04-26T12:09:29.585971+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:15.873513+0000","scrub_duration":0.0016537050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'482","reported_seq":1143,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:05.584628+0000","last_change":"2024-04-26T12:10:05.584742+0000","last_active":"2024-04-26T12:10:05.584628+0000","last_peered":"2024-04-26T12:10:05.584628+0000","last_clean":"2024-04-26T12:10:05.584628+0000","last_became_active":"2024-04-26T12:08:48.740055+0000","last_became_peered":"2024-04-26T12:08:48.740055+0000","last_unstale":"2024-04-26T12:10:05.584628+0000","last_undegraded":"2024-04-26T12:10:05.584628+0000","last_fullsized":"2024-04-26T12:10:05.584628+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'482","last_scrub_stamp":"2024-04-26T12:10:05.584603+0000","last_deep_scrub":"60'482","last_deep_scrub_stamp":"2024-04-26T12:10:05.584603+0000","last_clean_scrub_stamp":"2024-04-26T12:10:05.584603+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:28.512669+0000","scrub_duration":0.002302704,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":61972,"num_write":459,"num_write_kb":125797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"60'392","reported_seq":528,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745849+0000","last_change":"2024-04-26T12:08:43.718939+0000","last_active":"2024-04-26T12:08:53.745849+0000","last_peered":"2024-04-26T12:08:53.745849+0000","last_clean":"2024-04-26T12:08:53.745849+0000","last_became_active":"2024-04-26T12:08:43.717109+0000","last_became_peered":"2024-04-26T12:08:43.717109+0000","last_unstale":"2024-04-26T12:08:53.745849+0000","last_undegraded":"2024-04-26T12:08:53.745849+0000","last_fullsized":"2024-04-26T12:08:53.745849+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":37910,"num_write":366,"num_write_kb":84111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"84'711","reported_seq":828,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:58.565960+0000","last_change":"2024-04-26T12:09:58.566091+0000","last_active":"2024-04-26T12:09:58.565960+0000","last_peered":"2024-04-26T12:09:58.565960+0000","last_clean":"2024-04-26T12:09:58.565960+0000","last_became_active":"2024-04-26T12:08:39.700927+0000","last_became_peered":"2024-04-26T12:08:39.700927+0000","last_unstale":"2024-04-26T12:09:58.565960+0000","last_undegraded":"2024-04-26T12:09:58.565960+0000","last_fullsized":"2024-04-26T12:09:58.565960+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'711","last_scrub_stamp":"2024-04-26T12:09:58.565935+0000","last_deep_scrub":"84'711","last_deep_scrub_stamp":"2024-04-26T12:09:58.565935+0000","last_clean_scrub_stamp":"2024-04-26T12:09:58.565935+0000","objects_scrubbed":2,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:53.985339+0000","scrub_duration":0.028815225,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"60'435","reported_seq":574,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.244727+0000","last_change":"2024-04-26T12:05:03.788754+0000","last_active":"2024-04-26T12:09:05.244727+0000","last_peered":"2024-04-26T12:09:05.244727+0000","last_clean":"2024-04-26T12:09:05.244727+0000","last_became_active":"2024-04-26T12:05:03.788311+0000","last_became_peered":"2024-04-26T12:05:03.788311+0000","last_unstale":"2024-04-26T12:09:05.244727+0000","last_undegraded":"2024-04-26T12:09:05.244727+0000","last_fullsized":"2024-04-26T12:09:05.244727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":28462,"num_write":403,"num_write_kb":93779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"84'263","reported_seq":354,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:40.654355+0000","last_change":"2024-04-26T12:09:40.654355+0000","last_active":"2024-04-26T12:09:40.654355+0000","last_peered":"2024-04-26T12:09:40.654355+0000","last_clean":"2024-04-26T12:09:40.654355+0000","last_became_active":"2024-04-26T12:05:03.428191+0000","last_became_peered":"2024-04-26T12:05:03.428191+0000","last_unstale":"2024-04-26T12:09:40.654355+0000","last_undegraded":"2024-04-26T12:09:40.654355+0000","last_fullsized":"2024-04-26T12:09:40.654355+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'263","last_scrub_stamp":"2024-04-26T12:09:40.654238+0000","last_deep_scrub":"84'263","last_deep_scrub_stamp":"2024-04-26T12:09:40.654238+0000","last_clean_scrub_stamp":"2024-04-26T12:09:40.654238+0000","objects_scrubbed":1,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:02.888122+0000","scrub_duration":0.014597508,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"60'399","reported_seq":500,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745543+0000","last_change":"2024-04-26T12:08:49.742459+0000","last_active":"2024-04-26T12:08:53.745543+0000","last_peered":"2024-04-26T12:08:53.745543+0000","last_clean":"2024-04-26T12:08:53.745543+0000","last_became_active":"2024-04-26T12:08:49.740536+0000","last_became_peered":"2024-04-26T12:08:49.740536+0000","last_unstale":"2024-04-26T12:08:53.745543+0000","last_undegraded":"2024-04-26T12:08:53.745543+0000","last_fullsized":"2024-04-26T12:08:53.745543+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22216,"num_write":357,"num_write_kb":75245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"84'433","reported_seq":505,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:33.133704+0000","last_change":"2024-04-26T12:09:33.133804+0000","last_active":"2024-04-26T12:09:33.133704+0000","last_peered":"2024-04-26T12:09:33.133704+0000","last_clean":"2024-04-26T12:09:33.133704+0000","last_became_active":"2024-04-26T12:08:39.702529+0000","last_became_peered":"2024-04-26T12:08:39.702529+0000","last_unstale":"2024-04-26T12:09:33.133704+0000","last_undegraded":"2024-04-26T12:09:33.133704+0000","last_fullsized":"2024-04-26T12:09:33.133704+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'433","last_scrub_stamp":"2024-04-26T12:09:33.133683+0000","last_deep_scrub":"84'433","last_deep_scrub_stamp":"2024-04-26T12:09:33.133683+0000","last_clean_scrub_stamp":"2024-04-26T12:09:33.133683+0000","objects_scrubbed":3,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:32.088329+0000","scrub_duration":0.034859436000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":12514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"60'387","reported_seq":488,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.120063+0000","last_change":"2024-04-26T12:09:49.120210+0000","last_active":"2024-04-26T12:09:49.120063+0000","last_peered":"2024-04-26T12:09:49.120063+0000","last_clean":"2024-04-26T12:09:49.120063+0000","last_became_active":"2024-04-26T12:08:43.717442+0000","last_became_peered":"2024-04-26T12:08:43.717442+0000","last_unstale":"2024-04-26T12:09:49.120063+0000","last_undegraded":"2024-04-26T12:09:49.120063+0000","last_fullsized":"2024-04-26T12:09:49.120063+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'387","last_scrub_stamp":"2024-04-26T12:09:49.120043+0000","last_deep_scrub":"60'387","last_deep_scrub_stamp":"2024-04-26T12:09:49.120043+0000","last_clean_scrub_stamp":"2024-04-26T12:09:49.120043+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:21.246128+0000","scrub_duration":0.00208647,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20720,"num_write":352,"num_write_kb":87643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"59'58","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745139+0000","last_change":"2024-04-26T12:08:36.720540+0000","last_active":"2024-04-26T12:08:53.745139+0000","last_peered":"2024-04-26T12:08:53.745139+0000","last_clean":"2024-04-26T12:08:53.745139+0000","last_became_active":"2024-04-26T12:08:36.693399+0000","last_became_peered":"2024-04-26T12:08:36.693399+0000","last_unstale":"2024-04-26T12:08:53.745139+0000","last_undegraded":"2024-04-26T12:08:53.745139+0000","last_fullsized":"2024-04-26T12:08:53.745139+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"60'356","reported_seq":454,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124502+0000","last_change":"2024-04-26T12:05:03.791986+0000","last_active":"2024-04-26T12:09:06.124502+0000","last_peered":"2024-04-26T12:09:06.124502+0000","last_clean":"2024-04-26T12:09:06.124502+0000","last_became_active":"2024-04-26T12:05:03.790823+0000","last_became_peered":"2024-04-26T12:05:03.790823+0000","last_unstale":"2024-04-26T12:09:06.124502+0000","last_undegraded":"2024-04-26T12:09:06.124502+0000","last_fullsized":"2024-04-26T12:09:06.124502+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9641,"num_write":326,"num_write_kb":29574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"84'311","reported_seq":402,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:32.706538+0000","last_change":"2024-04-26T12:09:32.706538+0000","last_active":"2024-04-26T12:09:32.706538+0000","last_peered":"2024-04-26T12:09:32.706538+0000","last_clean":"2024-04-26T12:09:32.706538+0000","last_became_active":"2024-04-26T12:05:03.429015+0000","last_became_peered":"2024-04-26T12:05:03.429015+0000","last_unstale":"2024-04-26T12:09:32.706538+0000","last_undegraded":"2024-04-26T12:09:32.706538+0000","last_fullsized":"2024-04-26T12:09:32.706538+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'311","last_scrub_stamp":"2024-04-26T12:09:32.706381+0000","last_deep_scrub":"84'311","last_deep_scrub_stamp":"2024-04-26T12:09:32.706381+0000","last_clean_scrub_stamp":"2024-04-26T12:09:32.706381+0000","objects_scrubbed":2,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:18.824824+0000","scrub_duration":0.016953577000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'433","reported_seq":588,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:52.685440+0000","last_change":"2024-04-26T12:09:52.685440+0000","last_active":"2024-04-26T12:09:52.685440+0000","last_peered":"2024-04-26T12:09:52.685440+0000","last_clean":"2024-04-26T12:09:52.685440+0000","last_became_active":"2024-04-26T12:05:03.791540+0000","last_became_peered":"2024-04-26T12:05:03.791540+0000","last_unstale":"2024-04-26T12:09:52.685440+0000","last_undegraded":"2024-04-26T12:09:52.685440+0000","last_fullsized":"2024-04-26T12:09:52.685440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'433","last_scrub_stamp":"2024-04-26T12:09:52.685297+0000","last_deep_scrub":"60'433","last_deep_scrub_stamp":"2024-04-26T12:09:52.685297+0000","last_clean_scrub_stamp":"2024-04-26T12:09:52.685297+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:14.783208+0000","scrub_duration":0.0028996600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":47864,"num_write":399,"num_write_kb":92193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"59'382","reported_seq":450,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745440+0000","last_change":"2024-04-26T12:08:39.704680+0000","last_active":"2024-04-26T12:08:53.745440+0000","last_peered":"2024-04-26T12:08:53.745440+0000","last_clean":"2024-04-26T12:08:53.745440+0000","last_became_active":"2024-04-26T12:08:39.704404+0000","last_became_peered":"2024-04-26T12:08:39.704404+0000","last_unstale":"2024-04-26T12:08:53.745440+0000","last_undegraded":"2024-04-26T12:08:53.745440+0000","last_fullsized":"2024-04-26T12:08:53.745440+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":12467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'425","reported_seq":556,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:18.179708+0000","last_change":"2024-04-26T12:09:18.179810+0000","last_active":"2024-04-26T12:09:18.179708+0000","last_peered":"2024-04-26T12:09:18.179708+0000","last_clean":"2024-04-26T12:09:18.179708+0000","last_became_active":"2024-04-26T12:08:47.735367+0000","last_became_peered":"2024-04-26T12:08:47.735367+0000","last_unstale":"2024-04-26T12:09:18.179708+0000","last_undegraded":"2024-04-26T12:09:18.179708+0000","last_fullsized":"2024-04-26T12:09:18.179708+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'425","last_scrub_stamp":"2024-04-26T12:09:18.179684+0000","last_deep_scrub":"60'425","last_deep_scrub_stamp":"2024-04-26T12:09:18.179684+0000","last_clean_scrub_stamp":"2024-04-26T12:09:18.179684+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:20.520222+0000","scrub_duration":0.0024613230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":38065,"num_write":387,"num_write_kb":71445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"84'127","reported_seq":243,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:21.540633+0000","last_change":"2024-04-26T12:09:21.540746+0000","last_active":"2024-04-26T12:09:21.540633+0000","last_peered":"2024-04-26T12:09:21.540633+0000","last_clean":"2024-04-26T12:09:21.540633+0000","last_became_active":"2024-04-26T12:08:39.701900+0000","last_became_peered":"2024-04-26T12:08:39.701900+0000","last_unstale":"2024-04-26T12:09:21.540633+0000","last_undegraded":"2024-04-26T12:09:21.540633+0000","last_fullsized":"2024-04-26T12:09:21.540633+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'127","last_scrub_stamp":"2024-04-26T12:09:21.540611+0000","last_deep_scrub":"84'127","last_deep_scrub_stamp":"2024-04-26T12:09:21.540611+0000","last_clean_scrub_stamp":"2024-04-26T12:09:21.540611+0000","objects_scrubbed":1,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:30.101109+0000","scrub_duration":0.0098993390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"60'448","reported_seq":561,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:31.644589+0000","last_change":"2024-04-26T12:09:31.644589+0000","last_active":"2024-04-26T12:09:31.644589+0000","last_peered":"2024-04-26T12:09:31.644589+0000","last_clean":"2024-04-26T12:09:31.644589+0000","last_became_active":"2024-04-26T12:05:03.791442+0000","last_became_peered":"2024-04-26T12:05:03.791442+0000","last_unstale":"2024-04-26T12:09:31.644589+0000","last_undegraded":"2024-04-26T12:09:31.644589+0000","last_fullsized":"2024-04-26T12:09:31.644589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'448","last_scrub_stamp":"2024-04-26T12:09:31.644476+0000","last_deep_scrub":"60'448","last_deep_scrub_stamp":"2024-04-26T12:09:31.644476+0000","last_clean_scrub_stamp":"2024-04-26T12:09:31.644476+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:50.748197+0000","scrub_duration":0.0028574049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11191,"num_write":416,"num_write_kb":67272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"84'59","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:17.505129+0000","last_change":"2024-04-26T12:09:17.505233+0000","last_active":"2024-04-26T12:09:17.505129+0000","last_peered":"2024-04-26T12:09:17.505129+0000","last_clean":"2024-04-26T12:09:17.505129+0000","last_became_active":"2024-04-26T12:05:03.430164+0000","last_became_peered":"2024-04-26T12:05:03.430164+0000","last_unstale":"2024-04-26T12:09:17.505129+0000","last_undegraded":"2024-04-26T12:09:17.505129+0000","last_fullsized":"2024-04-26T12:09:17.505129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'59","last_scrub_stamp":"2024-04-26T12:09:17.505103+0000","last_deep_scrub":"84'59","last_deep_scrub_stamp":"2024-04-26T12:09:17.505103+0000","last_clean_scrub_stamp":"2024-04-26T12:09:17.505103+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:36.608825+0000","scrub_duration":0.012259582999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2734,"num_read_kb":1486856,"num_write":24627,"num_write_kb":4487808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7440,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26722,"ondisk_log_size":26722,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128606591,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":5972,"num_write_kb":129691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64376832,"data_stored":257213182,"data_compressed":19249503,"data_compressed_allocated":31694848,"data_compressed_original":224591872,"omap_allocated":4411,"internal_metadata":0},"log_size":7867,"ondisk_log_size":7867,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738436,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134428,"kb_used_data":27092,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94237412,"statfs":{"total":96636764160,"available":96499109888,"internally_reserved":0,"allocated":27742208,"data_stored":91797602,"data_compressed":6340284,"data_compressed_allocated":11272192,"data_compressed_original":75763712,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:10:04 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.40400000000000003,"15min":0.438},"min":{"1min":0.26800000000000002,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.57799999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.40699999999999997,"15min":0.42899999999999999},"min":{"1min":0.33000000000000002,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.434}]},{"osd":1,"last update":"Fri Apr 26 12:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.55700000000000005}]}]},{"osd":1,"up_from":66,"seq":283467841556,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68508,"kb_used_data":10644,"kb_used_omap":5,"kb_used_meta":57850,"kb_avail":94303332,"statfs":{"total":96636764160,"available":96566611968,"internally_reserved":0,"allocated":10899456,"data_stored":86136667,"data_compressed":7182940,"data_compressed_allocated":10076160,"data_compressed_original":85745664,"omap_allocated":6005,"internal_metadata":59238539},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.155,"5min":0.155,"15min":0.155},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.41199999999999998}]},{"osd":2,"last update":"Fri Apr 26 12:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.56200000000000006}]}]},{"osd":0,"up_from":8,"seq":34359738436,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138884,"kb_used_data":27452,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232956,"statfs":{"total":96636764160,"available":96494546944,"internally_reserved":0,"allocated":28110848,"data_stored":81507786,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.50700000000000001}]},{"osd":2,"last update":"Fri Apr 26 12:10:05 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.442,"15min":0.441},"min":{"1min":0.39200000000000002,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.60799999999999998,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.45200000000000001,"15min":0.439},"min":{"1min":0.38,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.64500000000000002,"5min":1.976,"15min":1.976},"last":0.52100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27357184,"data_stored":81158407,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10088448,"data_stored":85196920,"data_compressed":7176942,"data_compressed_allocated":10039296,"data_compressed_original":85172224,"omap_allocated":4411,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26931200,"data_stored":90857855,"data_compressed":6334286,"data_compressed_allocated":11235328,"data_compressed_original":75190272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:10:07.478 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.478 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.478 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.478 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.478 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.479 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.479 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.479 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.479 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.479 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.479 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.479 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.480 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.480 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.480 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.480 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.480 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.480 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.480 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.481 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.481 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.481 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.481 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.481 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.481 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.481 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:04:52.376986+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.481 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.482 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.482 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.482 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.482 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.482 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.482 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.482 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.483 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.483 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.483 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.483 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.483 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.483 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.483 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.484 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:07.484 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:10:27.485 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:10:27.798 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:10:27.800 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:10:27.808 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":250,"stamp":"2024-04-26T12:10:26.416823+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129196959,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2917,"num_read_kb":1488438,"num_write":30802,"num_write_kb":4620959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7463,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34756,"ondisk_log_size":34756,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":341820,"kb_used_data":65188,"kb_used_omap":8,"kb_used_meta":276599,"kb_avail":282773700,"statfs":{"total":289910292480,"available":289560268800,"internally_reserved":0,"allocated":66752512,"data_stored":259442055,"data_compressed":19261499,"data_compressed_allocated":31768576,"data_compressed_original":225738752,"omap_allocated":9193,"internal_metadata":283237399},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003344"},"pg_stats":[{"pgid":"4.3f","version":"60'426","reported_seq":508,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.746133+0000","last_change":"2024-04-26T12:08:51.753936+0000","last_active":"2024-04-26T12:08:53.746133+0000","last_peered":"2024-04-26T12:08:53.746133+0000","last_clean":"2024-04-26T12:08:53.746133+0000","last_became_active":"2024-04-26T12:08:51.750917+0000","last_became_peered":"2024-04-26T12:08:51.750917+0000","last_unstale":"2024-04-26T12:08:53.746133+0000","last_undegraded":"2024-04-26T12:08:53.746133+0000","last_fullsized":"2024-04-26T12:08:53.746133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9964,"num_write":393,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"60'470","reported_seq":602,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745918+0000","last_change":"2024-04-26T12:08:43.719204+0000","last_active":"2024-04-26T12:08:53.745918+0000","last_peered":"2024-04-26T12:08:53.745918+0000","last_clean":"2024-04-26T12:08:53.745918+0000","last_became_active":"2024-04-26T12:08:43.717325+0000","last_became_peered":"2024-04-26T12:08:43.717325+0000","last_unstale":"2024-04-26T12:08:53.745918+0000","last_undegraded":"2024-04-26T12:08:53.745918+0000","last_fullsized":"2024-04-26T12:08:53.745918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":34556,"num_write":444,"num_write_kb":129697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"60'370","reported_seq":804,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124711+0000","last_change":"2024-04-26T12:08:50.753639+0000","last_active":"2024-04-26T12:09:06.124711+0000","last_peered":"2024-04-26T12:09:06.124711+0000","last_clean":"2024-04-26T12:09:06.124711+0000","last_became_active":"2024-04-26T12:08:50.752468+0000","last_became_peered":"2024-04-26T12:08:50.752468+0000","last_unstale":"2024-04-26T12:09:06.124711+0000","last_undegraded":"2024-04-26T12:09:06.124711+0000","last_fullsized":"2024-04-26T12:09:06.124711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":349,"num_write_kb":51115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"60'377","reported_seq":487,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124688+0000","last_change":"2024-04-26T12:05:03.791234+0000","last_active":"2024-04-26T12:09:06.124688+0000","last_peered":"2024-04-26T12:09:06.124688+0000","last_clean":"2024-04-26T12:09:06.124688+0000","last_became_active":"2024-04-26T12:05:03.790717+0000","last_became_peered":"2024-04-26T12:05:03.790717+0000","last_unstale":"2024-04-26T12:09:06.124688+0000","last_undegraded":"2024-04-26T12:09:06.124688+0000","last_fullsized":"2024-04-26T12:09:06.124688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17376,"num_write":341,"num_write_kb":46680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'445","reported_seq":562,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:42.047300+0000","last_change":"2024-04-26T12:09:42.047407+0000","last_active":"2024-04-26T12:09:42.047300+0000","last_peered":"2024-04-26T12:09:42.047300+0000","last_clean":"2024-04-26T12:09:42.047300+0000","last_became_active":"2024-04-26T12:08:39.702117+0000","last_became_peered":"2024-04-26T12:08:39.702117+0000","last_unstale":"2024-04-26T12:09:42.047300+0000","last_undegraded":"2024-04-26T12:09:42.047300+0000","last_fullsized":"2024-04-26T12:09:42.047300+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'445","last_scrub_stamp":"2024-04-26T12:09:42.047279+0000","last_deep_scrub":"60'445","last_deep_scrub_stamp":"2024-04-26T12:09:42.047279+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.047279+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:26.392089+0000","scrub_duration":0.0023237290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24197,"num_write":416,"num_write_kb":80466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"60'375","reported_seq":472,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124685+0000","last_change":"2024-04-26T12:05:03.791560+0000","last_active":"2024-04-26T12:09:06.124685+0000","last_peered":"2024-04-26T12:09:06.124685+0000","last_clean":"2024-04-26T12:09:06.124685+0000","last_became_active":"2024-04-26T12:05:03.790578+0000","last_became_peered":"2024-04-26T12:05:03.790578+0000","last_unstale":"2024-04-26T12:09:06.124685+0000","last_undegraded":"2024-04-26T12:09:06.124685+0000","last_fullsized":"2024-04-26T12:09:06.124685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6518,"num_write":348,"num_write_kb":38078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'428","reported_seq":537,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:18.488710+0000","last_change":"2024-04-26T12:09:18.488710+0000","last_active":"2024-04-26T12:09:18.488710+0000","last_peered":"2024-04-26T12:09:18.488710+0000","last_clean":"2024-04-26T12:09:18.488710+0000","last_became_active":"2024-04-26T12:05:03.790615+0000","last_became_peered":"2024-04-26T12:05:03.790615+0000","last_unstale":"2024-04-26T12:09:18.488710+0000","last_undegraded":"2024-04-26T12:09:18.488710+0000","last_fullsized":"2024-04-26T12:09:18.488710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'428","last_scrub_stamp":"2024-04-26T12:09:18.488526+0000","last_deep_scrub":"60'428","last_deep_scrub_stamp":"2024-04-26T12:09:18.488526+0000","last_clean_scrub_stamp":"2024-04-26T12:09:18.488526+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:22.049575+0000","scrub_duration":0.0025858650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12560,"num_write":398,"num_write_kb":67332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"60'387","reported_seq":528,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124635+0000","last_change":"2024-04-26T12:05:03.785861+0000","last_active":"2024-04-26T12:09:06.124635+0000","last_peered":"2024-04-26T12:09:06.124635+0000","last_clean":"2024-04-26T12:09:06.124635+0000","last_became_active":"2024-04-26T12:05:03.785382+0000","last_became_peered":"2024-04-26T12:05:03.785382+0000","last_unstale":"2024-04-26T12:09:06.124635+0000","last_undegraded":"2024-04-26T12:09:06.124635+0000","last_fullsized":"2024-04-26T12:09:06.124635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":41160,"num_write":356,"num_write_kb":80219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"60'405","reported_seq":913,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:19.829976+0000","last_change":"2024-04-26T12:10:19.830086+0000","last_active":"2024-04-26T12:10:19.829976+0000","last_peered":"2024-04-26T12:10:19.829976+0000","last_clean":"2024-04-26T12:10:19.829976+0000","last_became_active":"2024-04-26T12:08:46.729039+0000","last_became_peered":"2024-04-26T12:08:46.729039+0000","last_unstale":"2024-04-26T12:10:19.829976+0000","last_undegraded":"2024-04-26T12:10:19.829976+0000","last_fullsized":"2024-04-26T12:10:19.829976+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'405","last_scrub_stamp":"2024-04-26T12:10:19.829953+0000","last_deep_scrub":"60'405","last_deep_scrub_stamp":"2024-04-26T12:10:19.829953+0000","last_clean_scrub_stamp":"2024-04-26T12:10:19.829953+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:57.119919+0000","scrub_duration":0.0018775389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":11674,"num_write":372,"num_write_kb":34604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"60'425","reported_seq":589,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:28.089237+0000","last_change":"2024-04-26T12:09:28.089362+0000","last_active":"2024-04-26T12:09:28.089237+0000","last_peered":"2024-04-26T12:09:28.089237+0000","last_clean":"2024-04-26T12:09:28.089237+0000","last_became_active":"2024-04-26T12:08:41.716014+0000","last_became_peered":"2024-04-26T12:08:41.716014+0000","last_unstale":"2024-04-26T12:09:28.089237+0000","last_undegraded":"2024-04-26T12:09:28.089237+0000","last_fullsized":"2024-04-26T12:09:28.089237+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'425","last_scrub_stamp":"2024-04-26T12:09:28.089215+0000","last_deep_scrub":"60'425","last_deep_scrub_stamp":"2024-04-26T12:09:28.089215+0000","last_clean_scrub_stamp":"2024-04-26T12:09:28.089215+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:31.039189+0000","scrub_duration":0.0021431470000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":48419,"num_write":390,"num_write_kb":92286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"60'372","reported_seq":491,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124613+0000","last_change":"2024-04-26T12:05:03.791046+0000","last_active":"2024-04-26T12:09:06.124613+0000","last_peered":"2024-04-26T12:09:06.124613+0000","last_clean":"2024-04-26T12:09:06.124613+0000","last_became_active":"2024-04-26T12:05:03.790662+0000","last_became_peered":"2024-04-26T12:05:03.790662+0000","last_unstale":"2024-04-26T12:09:06.124613+0000","last_undegraded":"2024-04-26T12:09:06.124613+0000","last_fullsized":"2024-04-26T12:09:06.124613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25905,"num_write":353,"num_write_kb":75437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'351","reported_seq":438,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:08.024810+0000","last_change":"2024-04-26T12:09:08.024919+0000","last_active":"2024-04-26T12:09:08.024810+0000","last_peered":"2024-04-26T12:09:08.024810+0000","last_clean":"2024-04-26T12:09:08.024810+0000","last_became_active":"2024-04-26T12:08:41.715726+0000","last_became_peered":"2024-04-26T12:08:41.715726+0000","last_unstale":"2024-04-26T12:09:08.024810+0000","last_undegraded":"2024-04-26T12:09:08.024810+0000","last_fullsized":"2024-04-26T12:09:08.024810+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'351","last_scrub_stamp":"2024-04-26T12:09:08.024789+0000","last_deep_scrub":"60'351","last_deep_scrub_stamp":"2024-04-26T12:09:08.024789+0000","last_clean_scrub_stamp":"2024-04-26T12:09:08.024789+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:15.481742+0000","scrub_duration":0.0022688909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8884,"num_write":327,"num_write_kb":58289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"60'405","reported_seq":497,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:19.190020+0000","last_change":"2024-04-26T12:09:19.190112+0000","last_active":"2024-04-26T12:09:19.190020+0000","last_peered":"2024-04-26T12:09:19.190020+0000","last_clean":"2024-04-26T12:09:19.190020+0000","last_became_active":"2024-04-26T12:08:39.702141+0000","last_became_peered":"2024-04-26T12:08:39.702141+0000","last_unstale":"2024-04-26T12:09:19.190020+0000","last_undegraded":"2024-04-26T12:09:19.190020+0000","last_fullsized":"2024-04-26T12:09:19.190020+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'405","last_scrub_stamp":"2024-04-26T12:09:19.189997+0000","last_deep_scrub":"60'405","last_deep_scrub_stamp":"2024-04-26T12:09:19.189997+0000","last_clean_scrub_stamp":"2024-04-26T12:09:19.189997+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:45:38.242862+0000","scrub_duration":0.0019966300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6771,"num_write":372,"num_write_kb":54786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"60'431","reported_seq":950,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:21.555659+0000","last_change":"2024-04-26T12:09:21.555659+0000","last_active":"2024-04-26T12:09:21.555659+0000","last_peered":"2024-04-26T12:09:21.555659+0000","last_clean":"2024-04-26T12:09:21.555659+0000","last_became_active":"2024-04-26T12:08:48.740170+0000","last_became_peered":"2024-04-26T12:08:48.740170+0000","last_unstale":"2024-04-26T12:09:21.555659+0000","last_undegraded":"2024-04-26T12:09:21.555659+0000","last_fullsized":"2024-04-26T12:09:21.555659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'431","last_scrub_stamp":"2024-04-26T12:09:21.555526+0000","last_deep_scrub":"60'431","last_deep_scrub_stamp":"2024-04-26T12:09:21.555526+0000","last_clean_scrub_stamp":"2024-04-26T12:09:21.555526+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:09.119328+0000","scrub_duration":0.0022972299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26572,"num_write":398,"num_write_kb":83974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'394","reported_seq":909,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:35.716715+0000","last_change":"2024-04-26T12:09:35.716715+0000","last_active":"2024-04-26T12:09:35.716715+0000","last_peered":"2024-04-26T12:09:35.716715+0000","last_clean":"2024-04-26T12:09:35.716715+0000","last_became_active":"2024-04-26T12:08:41.715956+0000","last_became_peered":"2024-04-26T12:08:41.715956+0000","last_unstale":"2024-04-26T12:09:35.716715+0000","last_undegraded":"2024-04-26T12:09:35.716715+0000","last_fullsized":"2024-04-26T12:09:35.716715+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'394","last_scrub_stamp":"2024-04-26T12:09:35.716594+0000","last_deep_scrub":"60'394","last_deep_scrub_stamp":"2024-04-26T12:09:35.716594+0000","last_clean_scrub_stamp":"2024-04-26T12:09:35.716594+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:28.908858+0000","scrub_duration":0.0029063209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":38136,"num_write":355,"num_write_kb":38484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'432","reported_seq":556,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:07.460951+0000","last_change":"2024-04-26T12:09:07.460951+0000","last_active":"2024-04-26T12:09:07.460951+0000","last_peered":"2024-04-26T12:09:07.460951+0000","last_clean":"2024-04-26T12:09:07.460951+0000","last_became_active":"2024-04-26T12:05:03.785991+0000","last_became_peered":"2024-04-26T12:05:03.785991+0000","last_unstale":"2024-04-26T12:09:07.460951+0000","last_undegraded":"2024-04-26T12:09:07.460951+0000","last_fullsized":"2024-04-26T12:09:07.460951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'432","last_scrub_stamp":"2024-04-26T12:09:07.460722+0000","last_deep_scrub":"60'432","last_deep_scrub_stamp":"2024-04-26T12:09:07.460722+0000","last_clean_scrub_stamp":"2024-04-26T12:09:07.460722+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:52.118824+0000","scrub_duration":0.0028296200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18244,"num_write":400,"num_write_kb":59033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'381","reported_seq":851,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:30.632857+0000","last_change":"2024-04-26T12:09:30.632857+0000","last_active":"2024-04-26T12:09:30.632857+0000","last_peered":"2024-04-26T12:09:30.632857+0000","last_clean":"2024-04-26T12:09:30.632857+0000","last_became_active":"2024-04-26T12:08:52.745913+0000","last_became_peered":"2024-04-26T12:08:52.745913+0000","last_unstale":"2024-04-26T12:09:30.632857+0000","last_undegraded":"2024-04-26T12:09:30.632857+0000","last_fullsized":"2024-04-26T12:09:30.632857+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'381","last_scrub_stamp":"2024-04-26T12:09:30.632714+0000","last_deep_scrub":"60'381","last_deep_scrub_stamp":"2024-04-26T12:09:30.632714+0000","last_clean_scrub_stamp":"2024-04-26T12:09:30.632714+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:40.099051+0000","scrub_duration":0.001861026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":350,"num_write_kb":21212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"60'424","reported_seq":526,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:25.195300+0000","last_change":"2024-04-26T12:09:25.195412+0000","last_active":"2024-04-26T12:09:25.195300+0000","last_peered":"2024-04-26T12:09:25.195300+0000","last_clean":"2024-04-26T12:09:25.195300+0000","last_became_active":"2024-04-26T12:08:42.716846+0000","last_became_peered":"2024-04-26T12:08:42.716846+0000","last_unstale":"2024-04-26T12:09:25.195300+0000","last_undegraded":"2024-04-26T12:09:25.195300+0000","last_fullsized":"2024-04-26T12:09:25.195300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'424","last_scrub_stamp":"2024-04-26T12:09:25.195279+0000","last_deep_scrub":"60'424","last_deep_scrub_stamp":"2024-04-26T12:09:25.195279+0000","last_clean_scrub_stamp":"2024-04-26T12:09:25.195279+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:09.224012+0000","scrub_duration":0.00220163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13930,"num_write":388,"num_write_kb":116055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'426","reported_seq":918,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:08.468648+0000","last_change":"2024-04-26T12:09:08.468648+0000","last_active":"2024-04-26T12:09:08.468648+0000","last_peered":"2024-04-26T12:09:08.468648+0000","last_clean":"2024-04-26T12:09:08.468648+0000","last_became_active":"2024-04-26T12:08:53.747215+0000","last_became_peered":"2024-04-26T12:08:53.747215+0000","last_unstale":"2024-04-26T12:09:08.468648+0000","last_undegraded":"2024-04-26T12:09:08.468648+0000","last_fullsized":"2024-04-26T12:09:08.468648+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'426","last_scrub_stamp":"2024-04-26T12:09:08.468482+0000","last_deep_scrub":"60'426","last_deep_scrub_stamp":"2024-04-26T12:09:08.468482+0000","last_clean_scrub_stamp":"2024-04-26T12:09:08.468482+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:56.032283+0000","scrub_duration":0.0021666569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26908,"num_write":383,"num_write_kb":71324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"60'425","reported_seq":559,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:08.446169+0000","last_change":"2024-04-26T12:09:08.446169+0000","last_active":"2024-04-26T12:09:08.446169+0000","last_peered":"2024-04-26T12:09:08.446169+0000","last_clean":"2024-04-26T12:09:08.446169+0000","last_became_active":"2024-04-26T12:05:03.791061+0000","last_became_peered":"2024-04-26T12:05:03.791061+0000","last_unstale":"2024-04-26T12:09:08.446169+0000","last_undegraded":"2024-04-26T12:09:08.446169+0000","last_fullsized":"2024-04-26T12:09:08.446169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'425","last_scrub_stamp":"2024-04-26T12:09:08.446023+0000","last_deep_scrub":"60'425","last_deep_scrub_stamp":"2024-04-26T12:09:08.446023+0000","last_clean_scrub_stamp":"2024-04-26T12:09:08.446023+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:29.700242+0000","scrub_duration":0.002826112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19715,"num_write":398,"num_write_kb":30150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'450","reported_seq":651,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:45.764985+0000","last_change":"2024-04-26T12:09:45.765084+0000","last_active":"2024-04-26T12:09:45.764985+0000","last_peered":"2024-04-26T12:09:45.764985+0000","last_clean":"2024-04-26T12:09:45.764985+0000","last_became_active":"2024-04-26T12:05:03.791693+0000","last_became_peered":"2024-04-26T12:05:03.791693+0000","last_unstale":"2024-04-26T12:09:45.764985+0000","last_undegraded":"2024-04-26T12:09:45.764985+0000","last_fullsized":"2024-04-26T12:09:45.764985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'450","last_scrub_stamp":"2024-04-26T12:09:45.764962+0000","last_deep_scrub":"60'450","last_deep_scrub_stamp":"2024-04-26T12:09:45.764962+0000","last_clean_scrub_stamp":"2024-04-26T12:09:45.764962+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:21.995938+0000","scrub_duration":0.002787449,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":65124,"num_write":423,"num_write_kb":142714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'434","reported_seq":539,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745454+0000","last_change":"2024-04-26T12:08:46.730582+0000","last_active":"2024-04-26T12:08:53.745454+0000","last_peered":"2024-04-26T12:08:53.745454+0000","last_clean":"2024-04-26T12:08:53.745454+0000","last_became_active":"2024-04-26T12:08:46.728804+0000","last_became_peered":"2024-04-26T12:08:46.728804+0000","last_unstale":"2024-04-26T12:08:53.745454+0000","last_undegraded":"2024-04-26T12:08:53.745454+0000","last_fullsized":"2024-04-26T12:08:53.745454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":15350,"num_write":405,"num_write_kb":59295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"60'424","reported_seq":550,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:09.556371+0000","last_change":"2024-04-26T12:10:09.556503+0000","last_active":"2024-04-26T12:10:09.556371+0000","last_peered":"2024-04-26T12:10:09.556371+0000","last_clean":"2024-04-26T12:10:09.556371+0000","last_became_active":"2024-04-26T12:05:03.788050+0000","last_became_peered":"2024-04-26T12:05:03.788050+0000","last_unstale":"2024-04-26T12:10:09.556371+0000","last_undegraded":"2024-04-26T12:10:09.556371+0000","last_fullsized":"2024-04-26T12:10:09.556371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'424","last_scrub_stamp":"2024-04-26T12:10:09.556349+0000","last_deep_scrub":"60'424","last_deep_scrub_stamp":"2024-04-26T12:10:09.556349+0000","last_clean_scrub_stamp":"2024-04-26T12:10:09.556349+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:05.369051+0000","scrub_duration":0.002611426,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23772,"num_write":390,"num_write_kb":67944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"60'447","reported_seq":527,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745010+0000","last_change":"2024-04-26T12:08:40.707153+0000","last_active":"2024-04-26T12:08:53.745010+0000","last_peered":"2024-04-26T12:08:53.745010+0000","last_clean":"2024-04-26T12:08:53.745010+0000","last_became_active":"2024-04-26T12:08:40.703880+0000","last_became_peered":"2024-04-26T12:08:40.703880+0000","last_unstale":"2024-04-26T12:08:53.745010+0000","last_undegraded":"2024-04-26T12:08:53.745010+0000","last_fullsized":"2024-04-26T12:08:53.745010+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9403,"num_write":417,"num_write_kb":67425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"60'417","reported_seq":519,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:26.148226+0000","last_change":"2024-04-26T12:09:26.148378+0000","last_active":"2024-04-26T12:09:26.148226+0000","last_peered":"2024-04-26T12:09:26.148226+0000","last_clean":"2024-04-26T12:09:26.148226+0000","last_became_active":"2024-04-26T12:08:42.715812+0000","last_became_peered":"2024-04-26T12:08:42.715812+0000","last_unstale":"2024-04-26T12:09:26.148226+0000","last_undegraded":"2024-04-26T12:09:26.148226+0000","last_fullsized":"2024-04-26T12:09:26.148226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'417","last_scrub_stamp":"2024-04-26T12:09:26.148189+0000","last_deep_scrub":"60'417","last_deep_scrub_stamp":"2024-04-26T12:09:26.148189+0000","last_clean_scrub_stamp":"2024-04-26T12:09:26.148189+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:12.073223+0000","scrub_duration":0.001950418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20466,"num_write":400,"num_write_kb":42225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"60'475","reported_seq":617,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.500379+0000","last_change":"2024-04-26T12:09:06.500379+0000","last_active":"2024-04-26T12:09:06.500379+0000","last_peered":"2024-04-26T12:09:06.500379+0000","last_clean":"2024-04-26T12:09:06.500379+0000","last_became_active":"2024-04-26T12:05:03.787562+0000","last_became_peered":"2024-04-26T12:05:03.787562+0000","last_unstale":"2024-04-26T12:09:06.500379+0000","last_undegraded":"2024-04-26T12:09:06.500379+0000","last_fullsized":"2024-04-26T12:09:06.500379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'475","last_scrub_stamp":"2024-04-26T12:09:06.500254+0000","last_deep_scrub":"60'475","last_deep_scrub_stamp":"2024-04-26T12:09:06.500254+0000","last_clean_scrub_stamp":"2024-04-26T12:09:06.500254+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:10.061304+0000","scrub_duration":0.002921515,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25186,"num_write":431,"num_write_kb":48184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"60'409","reported_seq":899,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124620+0000","last_change":"2024-04-26T12:08:49.741823+0000","last_active":"2024-04-26T12:09:06.124620+0000","last_peered":"2024-04-26T12:09:06.124620+0000","last_clean":"2024-04-26T12:09:06.124620+0000","last_became_active":"2024-04-26T12:08:49.740497+0000","last_became_peered":"2024-04-26T12:08:49.740497+0000","last_unstale":"2024-04-26T12:09:06.124620+0000","last_undegraded":"2024-04-26T12:09:06.124620+0000","last_fullsized":"2024-04-26T12:09:06.124620+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":20137,"num_write":374,"num_write_kb":55441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'392","reported_seq":505,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:47.060990+0000","last_change":"2024-04-26T12:09:47.061102+0000","last_active":"2024-04-26T12:09:47.060990+0000","last_peered":"2024-04-26T12:09:47.060990+0000","last_clean":"2024-04-26T12:09:47.060990+0000","last_became_active":"2024-04-26T12:08:47.735361+0000","last_became_peered":"2024-04-26T12:08:47.735361+0000","last_unstale":"2024-04-26T12:09:47.060990+0000","last_undegraded":"2024-04-26T12:09:47.060990+0000","last_fullsized":"2024-04-26T12:09:47.060990+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'392","last_scrub_stamp":"2024-04-26T12:09:47.060968+0000","last_deep_scrub":"60'392","last_deep_scrub_stamp":"2024-04-26T12:09:47.060968+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.060968+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:04.952295+0000","scrub_duration":0.0023190509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29179,"num_write":355,"num_write_kb":59011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'380","reported_seq":853,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:15.465302+0000","last_change":"2024-04-26T12:09:15.465302+0000","last_active":"2024-04-26T12:09:15.465302+0000","last_peered":"2024-04-26T12:09:15.465302+0000","last_clean":"2024-04-26T12:09:15.465302+0000","last_became_active":"2024-04-26T12:08:41.716234+0000","last_became_peered":"2024-04-26T12:08:41.716234+0000","last_unstale":"2024-04-26T12:09:15.465302+0000","last_undegraded":"2024-04-26T12:09:15.465302+0000","last_fullsized":"2024-04-26T12:09:15.465302+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'380","last_scrub_stamp":"2024-04-26T12:09:15.465164+0000","last_deep_scrub":"60'380","last_deep_scrub_stamp":"2024-04-26T12:09:15.465164+0000","last_clean_scrub_stamp":"2024-04-26T12:09:15.465164+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:49.168939+0000","scrub_duration":0.0024038250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13036,"num_write":347,"num_write_kb":33880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"60'461","reported_seq":577,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:10.990827+0000","last_change":"2024-04-26T12:09:10.990934+0000","last_active":"2024-04-26T12:09:10.990827+0000","last_peered":"2024-04-26T12:09:10.990827+0000","last_clean":"2024-04-26T12:09:10.990827+0000","last_became_active":"2024-04-26T12:08:46.730738+0000","last_became_peered":"2024-04-26T12:08:46.730738+0000","last_unstale":"2024-04-26T12:09:10.990827+0000","last_undegraded":"2024-04-26T12:09:10.990827+0000","last_fullsized":"2024-04-26T12:09:10.990827+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'461","last_scrub_stamp":"2024-04-26T12:09:10.990803+0000","last_deep_scrub":"60'461","last_deep_scrub_stamp":"2024-04-26T12:09:10.990803+0000","last_clean_scrub_stamp":"2024-04-26T12:09:10.990803+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:12.887104+0000","scrub_duration":0.0025321039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":32945,"num_write":426,"num_write_kb":63234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"60'411","reported_seq":914,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:43.659197+0000","last_change":"2024-04-26T12:09:43.659295+0000","last_active":"2024-04-26T12:09:43.659197+0000","last_peered":"2024-04-26T12:09:43.659197+0000","last_clean":"2024-04-26T12:09:43.659197+0000","last_became_active":"2024-04-26T12:08:40.703845+0000","last_became_peered":"2024-04-26T12:08:40.703845+0000","last_unstale":"2024-04-26T12:09:43.659197+0000","last_undegraded":"2024-04-26T12:09:43.659197+0000","last_fullsized":"2024-04-26T12:09:43.659197+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'411","last_scrub_stamp":"2024-04-26T12:09:43.659173+0000","last_deep_scrub":"60'411","last_deep_scrub_stamp":"2024-04-26T12:09:43.659173+0000","last_clean_scrub_stamp":"2024-04-26T12:09:43.659173+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:23.114338+0000","scrub_duration":0.002345588,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11499,"num_write":377,"num_write_kb":34249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'430","reported_seq":551,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:11.555369+0000","last_change":"2024-04-26T12:10:11.555537+0000","last_active":"2024-04-26T12:10:11.555369+0000","last_peered":"2024-04-26T12:10:11.555369+0000","last_clean":"2024-04-26T12:10:11.555369+0000","last_became_active":"2024-04-26T12:05:03.791251+0000","last_became_peered":"2024-04-26T12:05:03.791251+0000","last_unstale":"2024-04-26T12:10:11.555369+0000","last_undegraded":"2024-04-26T12:10:11.555369+0000","last_fullsized":"2024-04-26T12:10:11.555369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'430","last_scrub_stamp":"2024-04-26T12:10:11.555345+0000","last_deep_scrub":"60'430","last_deep_scrub_stamp":"2024-04-26T12:10:11.555345+0000","last_clean_scrub_stamp":"2024-04-26T12:10:11.555345+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:09.743398+0000","scrub_duration":0.0028183980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14660,"num_write":404,"num_write_kb":60840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"60'392","reported_seq":501,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745266+0000","last_change":"2024-04-26T12:08:44.723861+0000","last_active":"2024-04-26T12:08:53.745266+0000","last_peered":"2024-04-26T12:08:53.745266+0000","last_clean":"2024-04-26T12:08:53.745266+0000","last_became_active":"2024-04-26T12:08:44.722120+0000","last_became_peered":"2024-04-26T12:08:44.722120+0000","last_unstale":"2024-04-26T12:08:53.745266+0000","last_undegraded":"2024-04-26T12:08:53.745266+0000","last_fullsized":"2024-04-26T12:08:53.745266+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31703,"num_write":351,"num_write_kb":59324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"84'518","reported_seq":609,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:56.653065+0000","last_change":"2024-04-26T12:09:56.653170+0000","last_active":"2024-04-26T12:09:56.653065+0000","last_peered":"2024-04-26T12:09:56.653065+0000","last_clean":"2024-04-26T12:09:56.653065+0000","last_became_active":"2024-04-26T12:05:03.429695+0000","last_became_peered":"2024-04-26T12:05:03.429695+0000","last_unstale":"2024-04-26T12:09:56.653065+0000","last_undegraded":"2024-04-26T12:09:56.653065+0000","last_fullsized":"2024-04-26T12:09:56.653065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'518","last_scrub_stamp":"2024-04-26T12:09:56.653042+0000","last_deep_scrub":"84'518","last_deep_scrub_stamp":"2024-04-26T12:09:56.653042+0000","last_clean_scrub_stamp":"2024-04-26T12:09:56.653042+0000","objects_scrubbed":4,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:18.886927+0000","scrub_duration":0.02530226,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":8377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'432","reported_seq":534,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:52.096388+0000","last_change":"2024-04-26T12:09:52.096505+0000","last_active":"2024-04-26T12:09:52.096388+0000","last_peered":"2024-04-26T12:09:52.096388+0000","last_clean":"2024-04-26T12:09:52.096388+0000","last_became_active":"2024-04-26T12:08:53.748972+0000","last_became_peered":"2024-04-26T12:08:53.748972+0000","last_unstale":"2024-04-26T12:09:52.096388+0000","last_undegraded":"2024-04-26T12:09:52.096388+0000","last_fullsized":"2024-04-26T12:09:52.096388+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'432","last_scrub_stamp":"2024-04-26T12:09:52.096365+0000","last_deep_scrub":"60'432","last_deep_scrub_stamp":"2024-04-26T12:09:52.096365+0000","last_clean_scrub_stamp":"2024-04-26T12:09:52.096365+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:25.671316+0000","scrub_duration":0.0023424370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":30094,"num_write":388,"num_write_kb":83741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"59'55","reported_seq":146,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:34.731942+0000","last_change":"2024-04-26T12:09:34.731942+0000","last_active":"2024-04-26T12:09:34.731942+0000","last_peered":"2024-04-26T12:09:34.731942+0000","last_clean":"2024-04-26T12:09:34.731942+0000","last_became_active":"2024-04-26T12:05:03.428098+0000","last_became_peered":"2024-04-26T12:05:03.428098+0000","last_unstale":"2024-04-26T12:09:34.731942+0000","last_undegraded":"2024-04-26T12:09:34.731942+0000","last_fullsized":"2024-04-26T12:09:34.731942+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'55","last_scrub_stamp":"2024-04-26T12:09:34.731815+0000","last_deep_scrub":"59'55","last_deep_scrub_stamp":"2024-04-26T12:09:34.731815+0000","last_clean_scrub_stamp":"2024-04-26T12:09:34.731815+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:35.655136+0000","scrub_duration":0.0016482490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"60'445","reported_seq":570,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:07.498568+0000","last_change":"2024-04-26T12:09:07.498568+0000","last_active":"2024-04-26T12:09:07.498568+0000","last_peered":"2024-04-26T12:09:07.498568+0000","last_clean":"2024-04-26T12:09:07.498568+0000","last_became_active":"2024-04-26T12:05:03.788039+0000","last_became_peered":"2024-04-26T12:05:03.788039+0000","last_unstale":"2024-04-26T12:09:07.498568+0000","last_undegraded":"2024-04-26T12:09:07.498568+0000","last_fullsized":"2024-04-26T12:09:07.498568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'445","last_scrub_stamp":"2024-04-26T12:09:07.498444+0000","last_deep_scrub":"60'445","last_deep_scrub_stamp":"2024-04-26T12:09:07.498444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:07.498444+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:34:55.801469+0000","scrub_duration":0.002448759,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":16079,"num_write":410,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"59'64","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:23.224837+0000","last_change":"2024-04-26T12:09:23.224938+0000","last_active":"2024-04-26T12:09:23.224837+0000","last_peered":"2024-04-26T12:09:23.224837+0000","last_clean":"2024-04-26T12:09:23.224837+0000","last_became_active":"2024-04-26T12:08:36.694921+0000","last_became_peered":"2024-04-26T12:08:36.694921+0000","last_unstale":"2024-04-26T12:09:23.224837+0000","last_undegraded":"2024-04-26T12:09:23.224837+0000","last_fullsized":"2024-04-26T12:09:23.224837+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'64","last_scrub_stamp":"2024-04-26T12:09:23.224815+0000","last_deep_scrub":"59'64","last_deep_scrub_stamp":"2024-04-26T12:09:23.224815+0000","last_clean_scrub_stamp":"2024-04-26T12:09:23.224815+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:34.040977+0000","scrub_duration":0.0015803169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"60'420","reported_seq":550,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:17.735411+0000","last_change":"2024-04-26T12:10:17.735525+0000","last_active":"2024-04-26T12:10:17.735411+0000","last_peered":"2024-04-26T12:10:17.735411+0000","last_clean":"2024-04-26T12:10:17.735411+0000","last_became_active":"2024-04-26T12:05:03.788184+0000","last_became_peered":"2024-04-26T12:05:03.788184+0000","last_unstale":"2024-04-26T12:10:17.735411+0000","last_undegraded":"2024-04-26T12:10:17.735411+0000","last_fullsized":"2024-04-26T12:10:17.735411+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'420","last_scrub_stamp":"2024-04-26T12:10:17.735388+0000","last_deep_scrub":"60'420","last_deep_scrub_stamp":"2024-04-26T12:10:17.735388+0000","last_clean_scrub_stamp":"2024-04-26T12:10:17.735388+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:44:01.060779+0000","scrub_duration":0.0022698190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":14666,"num_write":383,"num_write_kb":83769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"60'63","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124294+0000","last_change":"2024-04-26T12:08:36.697126+0000","last_active":"2024-04-26T12:09:06.124294+0000","last_peered":"2024-04-26T12:09:06.124294+0000","last_clean":"2024-04-26T12:09:06.124294+0000","last_became_active":"2024-04-26T12:08:36.696792+0000","last_became_peered":"2024-04-26T12:08:36.696792+0000","last_unstale":"2024-04-26T12:09:06.124294+0000","last_undegraded":"2024-04-26T12:09:06.124294+0000","last_fullsized":"2024-04-26T12:09:06.124294+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"84'234","reported_seq":350,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:00.696683+0000","last_change":"2024-04-26T12:10:00.696834+0000","last_active":"2024-04-26T12:10:00.696683+0000","last_peered":"2024-04-26T12:10:00.696683+0000","last_clean":"2024-04-26T12:10:00.696683+0000","last_became_active":"2024-04-26T12:08:39.703455+0000","last_became_peered":"2024-04-26T12:08:39.703455+0000","last_unstale":"2024-04-26T12:10:00.696683+0000","last_undegraded":"2024-04-26T12:10:00.696683+0000","last_fullsized":"2024-04-26T12:10:00.696683+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'234","last_scrub_stamp":"2024-04-26T12:10:00.696661+0000","last_deep_scrub":"84'234","last_deep_scrub_stamp":"2024-04-26T12:10:00.696661+0000","last_clean_scrub_stamp":"2024-04-26T12:10:00.696661+0000","objects_scrubbed":2,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:40.151826+0000","scrub_duration":0.014858877,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'408","reported_seq":492,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745191+0000","last_change":"2024-04-26T12:08:40.710236+0000","last_active":"2024-04-26T12:08:53.745191+0000","last_peered":"2024-04-26T12:08:53.745191+0000","last_clean":"2024-04-26T12:08:53.745191+0000","last_became_active":"2024-04-26T12:08:40.707357+0000","last_became_peered":"2024-04-26T12:08:40.707357+0000","last_unstale":"2024-04-26T12:08:53.745191+0000","last_undegraded":"2024-04-26T12:08:53.745191+0000","last_fullsized":"2024-04-26T12:08:53.745191+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12418,"num_write":371,"num_write_kb":58378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"84'304","reported_seq":384,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:57.079608+0000","last_change":"2024-04-26T12:09:57.079715+0000","last_active":"2024-04-26T12:09:57.079608+0000","last_peered":"2024-04-26T12:09:57.079608+0000","last_clean":"2024-04-26T12:09:57.079608+0000","last_became_active":"2024-04-26T12:08:39.703421+0000","last_became_peered":"2024-04-26T12:08:39.703421+0000","last_unstale":"2024-04-26T12:09:57.079608+0000","last_undegraded":"2024-04-26T12:09:57.079608+0000","last_fullsized":"2024-04-26T12:09:57.079608+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'304","last_scrub_stamp":"2024-04-26T12:09:57.079584+0000","last_deep_scrub":"84'304","last_deep_scrub_stamp":"2024-04-26T12:09:57.079584+0000","last_clean_scrub_stamp":"2024-04-26T12:09:57.079584+0000","objects_scrubbed":2,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:49.321329+0000","scrub_duration":0.016873233000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":4228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'439","reported_seq":510,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:11.912149+0000","last_change":"2024-04-26T12:10:11.912239+0000","last_active":"2024-04-26T12:10:11.912149+0000","last_peered":"2024-04-26T12:10:11.912149+0000","last_clean":"2024-04-26T12:10:11.912149+0000","last_became_active":"2024-04-26T12:08:41.715708+0000","last_became_peered":"2024-04-26T12:08:41.715708+0000","last_unstale":"2024-04-26T12:10:11.912149+0000","last_undegraded":"2024-04-26T12:10:11.912149+0000","last_fullsized":"2024-04-26T12:10:11.912149+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'439","last_scrub_stamp":"2024-04-26T12:10:11.912130+0000","last_deep_scrub":"60'439","last_deep_scrub_stamp":"2024-04-26T12:10:11.912130+0000","last_clean_scrub_stamp":"2024-04-26T12:10:11.912130+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:56.110904+0000","scrub_duration":0.001792173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":30851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"84'591","reported_seq":707,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:39.824129+0000","last_change":"2024-04-26T12:09:39.824222+0000","last_active":"2024-04-26T12:09:39.824129+0000","last_peered":"2024-04-26T12:09:39.824129+0000","last_clean":"2024-04-26T12:09:39.824129+0000","last_became_active":"2024-04-26T12:08:39.703487+0000","last_became_peered":"2024-04-26T12:08:39.703487+0000","last_unstale":"2024-04-26T12:09:39.824129+0000","last_undegraded":"2024-04-26T12:09:39.824129+0000","last_fullsized":"2024-04-26T12:09:39.824129+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'591","last_scrub_stamp":"2024-04-26T12:09:39.824106+0000","last_deep_scrub":"84'591","last_deep_scrub_stamp":"2024-04-26T12:09:39.824106+0000","last_clean_scrub_stamp":"2024-04-26T12:09:39.824106+0000","objects_scrubbed":2,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:04.327252+0000","scrub_duration":0.019073356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":534,"num_write_kb":4333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'461","reported_seq":616,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124331+0000","last_change":"2024-04-26T12:05:03.791809+0000","last_active":"2024-04-26T12:09:06.124331+0000","last_peered":"2024-04-26T12:09:06.124331+0000","last_clean":"2024-04-26T12:09:06.124331+0000","last_became_active":"2024-04-26T12:05:03.791272+0000","last_became_peered":"2024-04-26T12:05:03.791272+0000","last_unstale":"2024-04-26T12:09:06.124331+0000","last_undegraded":"2024-04-26T12:09:06.124331+0000","last_fullsized":"2024-04-26T12:09:06.124331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":46123,"num_write":422,"num_write_kb":104552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'66","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:10.526380+0000","last_change":"2024-04-26T12:10:10.526479+0000","last_active":"2024-04-26T12:10:10.526380+0000","last_peered":"2024-04-26T12:10:10.526380+0000","last_clean":"2024-04-26T12:10:10.526380+0000","last_became_active":"2024-04-26T12:05:03.429291+0000","last_became_peered":"2024-04-26T12:05:03.429291+0000","last_unstale":"2024-04-26T12:10:10.526380+0000","last_undegraded":"2024-04-26T12:10:10.526380+0000","last_fullsized":"2024-04-26T12:10:10.526380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'66","last_scrub_stamp":"2024-04-26T12:10:10.526357+0000","last_deep_scrub":"59'66","last_deep_scrub_stamp":"2024-04-26T12:10:10.526357+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.526357+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:22.596661+0000","scrub_duration":0.0016798259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'428","reported_seq":554,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:41.623180+0000","last_change":"2024-04-26T12:09:41.623284+0000","last_active":"2024-04-26T12:09:41.623180+0000","last_peered":"2024-04-26T12:09:41.623180+0000","last_clean":"2024-04-26T12:09:41.623180+0000","last_became_active":"2024-04-26T12:05:03.787772+0000","last_became_peered":"2024-04-26T12:05:03.787772+0000","last_unstale":"2024-04-26T12:09:41.623180+0000","last_undegraded":"2024-04-26T12:09:41.623180+0000","last_fullsized":"2024-04-26T12:09:41.623180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'428","last_scrub_stamp":"2024-04-26T12:09:41.623156+0000","last_deep_scrub":"60'428","last_deep_scrub_stamp":"2024-04-26T12:09:41.623156+0000","last_clean_scrub_stamp":"2024-04-26T12:09:41.623156+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:27.740926+0000","scrub_duration":0.0027090880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15098,"num_write":394,"num_write_kb":42677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"84'198","reported_seq":289,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:56.557371+0000","last_change":"2024-04-26T12:09:56.557500+0000","last_active":"2024-04-26T12:09:56.557371+0000","last_peered":"2024-04-26T12:09:56.557371+0000","last_clean":"2024-04-26T12:09:56.557371+0000","last_became_active":"2024-04-26T12:05:03.430855+0000","last_became_peered":"2024-04-26T12:05:03.430855+0000","last_unstale":"2024-04-26T12:09:56.557371+0000","last_undegraded":"2024-04-26T12:09:56.557371+0000","last_fullsized":"2024-04-26T12:09:56.557371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'198","last_scrub_stamp":"2024-04-26T12:09:56.557334+0000","last_deep_scrub":"84'198","last_deep_scrub_stamp":"2024-04-26T12:09:56.557334+0000","last_clean_scrub_stamp":"2024-04-26T12:09:56.557334+0000","objects_scrubbed":3,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:47.167351+0000","scrub_duration":0.021508201000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"60'448","reported_seq":557,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:58.706684+0000","last_change":"2024-04-26T12:09:58.706808+0000","last_active":"2024-04-26T12:09:58.706684+0000","last_peered":"2024-04-26T12:09:58.706684+0000","last_clean":"2024-04-26T12:09:58.706684+0000","last_became_active":"2024-04-26T12:05:03.792119+0000","last_became_peered":"2024-04-26T12:05:03.792119+0000","last_unstale":"2024-04-26T12:09:58.706684+0000","last_undegraded":"2024-04-26T12:09:58.706684+0000","last_fullsized":"2024-04-26T12:09:58.706684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'448","last_scrub_stamp":"2024-04-26T12:09:58.706659+0000","last_deep_scrub":"60'448","last_deep_scrub_stamp":"2024-04-26T12:09:58.706659+0000","last_clean_scrub_stamp":"2024-04-26T12:09:58.706659+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:56.343142+0000","scrub_duration":0.0026622880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":13281,"num_write":420,"num_write_kb":59540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"59'171","reported_seq":251,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124198+0000","last_change":"2024-04-26T12:05:03.429811+0000","last_active":"2024-04-26T12:09:06.124198+0000","last_peered":"2024-04-26T12:09:06.124198+0000","last_clean":"2024-04-26T12:09:06.124198+0000","last_became_active":"2024-04-26T12:05:03.429469+0000","last_became_peered":"2024-04-26T12:05:03.429469+0000","last_unstale":"2024-04-26T12:09:06.124198+0000","last_undegraded":"2024-04-26T12:09:06.124198+0000","last_fullsized":"2024-04-26T12:09:06.124198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'412","reported_seq":936,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:17.500764+0000","last_change":"2024-04-26T12:09:17.500764+0000","last_active":"2024-04-26T12:09:17.500764+0000","last_peered":"2024-04-26T12:09:17.500764+0000","last_clean":"2024-04-26T12:09:17.500764+0000","last_became_active":"2024-04-26T12:08:51.751044+0000","last_became_peered":"2024-04-26T12:08:51.751044+0000","last_unstale":"2024-04-26T12:09:17.500764+0000","last_undegraded":"2024-04-26T12:09:17.500764+0000","last_fullsized":"2024-04-26T12:09:17.500764+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'412","last_scrub_stamp":"2024-04-26T12:09:17.500623+0000","last_deep_scrub":"60'412","last_deep_scrub_stamp":"2024-04-26T12:09:17.500623+0000","last_clean_scrub_stamp":"2024-04-26T12:09:17.500623+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:05.606930+0000","scrub_duration":0.0024460179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26310,"num_write":380,"num_write_kb":38462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"59'55","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:12.951747+0000","last_change":"2024-04-26T12:10:12.951850+0000","last_active":"2024-04-26T12:10:12.951747+0000","last_peered":"2024-04-26T12:10:12.951747+0000","last_clean":"2024-04-26T12:10:12.951747+0000","last_became_active":"2024-04-26T12:08:36.694346+0000","last_became_peered":"2024-04-26T12:08:36.694346+0000","last_unstale":"2024-04-26T12:10:12.951747+0000","last_undegraded":"2024-04-26T12:10:12.951747+0000","last_fullsized":"2024-04-26T12:10:12.951747+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'55","last_scrub_stamp":"2024-04-26T12:10:12.951726+0000","last_deep_scrub":"59'55","last_deep_scrub_stamp":"2024-04-26T12:10:12.951726+0000","last_clean_scrub_stamp":"2024-04-26T12:10:12.951726+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:34.042702+0000","scrub_duration":0.0020193070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"60'362","reported_seq":830,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:07.539506+0000","last_change":"2024-04-26T12:10:07.539641+0000","last_active":"2024-04-26T12:10:07.539506+0000","last_peered":"2024-04-26T12:10:07.539506+0000","last_clean":"2024-04-26T12:10:07.539506+0000","last_became_active":"2024-04-26T12:08:41.716102+0000","last_became_peered":"2024-04-26T12:08:41.716102+0000","last_unstale":"2024-04-26T12:10:07.539506+0000","last_undegraded":"2024-04-26T12:10:07.539506+0000","last_fullsized":"2024-04-26T12:10:07.539506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'362","last_scrub_stamp":"2024-04-26T12:10:07.539483+0000","last_deep_scrub":"60'362","last_deep_scrub_stamp":"2024-04-26T12:10:07.539483+0000","last_clean_scrub_stamp":"2024-04-26T12:10:07.539483+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:41.491924+0000","scrub_duration":0.0023643050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21408,"num_write":333,"num_write_kb":66549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"59'378","reported_seq":440,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745101+0000","last_change":"2024-04-26T12:08:39.702797+0000","last_active":"2024-04-26T12:08:53.745101+0000","last_peered":"2024-04-26T12:08:53.745101+0000","last_clean":"2024-04-26T12:08:53.745101+0000","last_became_active":"2024-04-26T12:08:39.702438+0000","last_became_peered":"2024-04-26T12:08:39.702438+0000","last_unstale":"2024-04-26T12:08:53.745101+0000","last_undegraded":"2024-04-26T12:08:53.745101+0000","last_fullsized":"2024-04-26T12:08:53.745101+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"60'407","reported_seq":930,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:15.702685+0000","last_change":"2024-04-26T12:10:15.702794+0000","last_active":"2024-04-26T12:10:15.702685+0000","last_peered":"2024-04-26T12:10:15.702685+0000","last_clean":"2024-04-26T12:10:15.702685+0000","last_became_active":"2024-04-26T12:08:45.723772+0000","last_became_peered":"2024-04-26T12:08:45.723772+0000","last_unstale":"2024-04-26T12:10:15.702685+0000","last_undegraded":"2024-04-26T12:10:15.702685+0000","last_fullsized":"2024-04-26T12:10:15.702685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'407","last_scrub_stamp":"2024-04-26T12:10:15.702660+0000","last_deep_scrub":"60'407","last_deep_scrub_stamp":"2024-04-26T12:10:15.702660+0000","last_clean_scrub_stamp":"2024-04-26T12:10:15.702660+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:27.811568+0000","scrub_duration":0.0020706520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":40156,"num_write":373,"num_write_kb":91285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"84'159","reported_seq":308,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:22.613155+0000","last_change":"2024-04-26T12:10:22.613268+0000","last_active":"2024-04-26T12:10:22.613155+0000","last_peered":"2024-04-26T12:10:22.613155+0000","last_clean":"2024-04-26T12:10:22.613155+0000","last_became_active":"2024-04-26T12:08:36.697508+0000","last_became_peered":"2024-04-26T12:08:36.697508+0000","last_unstale":"2024-04-26T12:10:22.613155+0000","last_undegraded":"2024-04-26T12:10:22.613155+0000","last_fullsized":"2024-04-26T12:10:22.613155+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'159","last_scrub_stamp":"2024-04-26T12:10:22.613133+0000","last_deep_scrub":"84'159","last_deep_scrub_stamp":"2024-04-26T12:10:22.613133+0000","last_clean_scrub_stamp":"2024-04-26T12:10:22.613133+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:47.395680+0000","scrub_duration":0.0046459420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":94,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:24.620738+0000","last_change":"2024-04-26T12:10:24.620835+0000","last_active":"2024-04-26T12:10:24.620738+0000","last_peered":"2024-04-26T12:10:24.620738+0000","last_clean":"2024-04-26T12:10:24.620738+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:10:24.620738+0000","last_undegraded":"2024-04-26T12:10:24.620738+0000","last_fullsized":"2024-04-26T12:10:24.620738+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:24.620718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:24.620718+0000","last_clean_scrub_stamp":"2024-04-26T12:10:24.620718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:47.548783+0000","scrub_duration":0.0019450089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"84'795","reported_seq":912,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:02.576016+0000","last_change":"2024-04-26T12:10:02.576130+0000","last_active":"2024-04-26T12:10:02.576016+0000","last_peered":"2024-04-26T12:10:02.576016+0000","last_clean":"2024-04-26T12:10:02.576016+0000","last_became_active":"2024-04-26T12:08:39.701760+0000","last_became_peered":"2024-04-26T12:08:39.701760+0000","last_unstale":"2024-04-26T12:10:02.576016+0000","last_undegraded":"2024-04-26T12:10:02.576016+0000","last_fullsized":"2024-04-26T12:10:02.576016+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'795","last_scrub_stamp":"2024-04-26T12:10:02.575986+0000","last_deep_scrub":"84'795","last_deep_scrub_stamp":"2024-04-26T12:10:02.575986+0000","last_clean_scrub_stamp":"2024-04-26T12:10:02.575986+0000","objects_scrubbed":2,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:07.133416+0000","scrub_duration":0.029735391,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":8533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"60'466","reported_seq":1025,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:03.603760+0000","last_change":"2024-04-26T12:10:03.603869+0000","last_active":"2024-04-26T12:10:03.603760+0000","last_peered":"2024-04-26T12:10:03.603760+0000","last_clean":"2024-04-26T12:10:03.603760+0000","last_became_active":"2024-04-26T12:08:52.746147+0000","last_became_peered":"2024-04-26T12:08:52.746147+0000","last_unstale":"2024-04-26T12:10:03.603760+0000","last_undegraded":"2024-04-26T12:10:03.603760+0000","last_fullsized":"2024-04-26T12:10:03.603760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'466","last_scrub_stamp":"2024-04-26T12:10:03.603739+0000","last_deep_scrub":"60'466","last_deep_scrub_stamp":"2024-04-26T12:10:03.603739+0000","last_clean_scrub_stamp":"2024-04-26T12:10:03.603739+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:57.843220+0000","scrub_duration":0.001899956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":37547,"num_write":422,"num_write_kb":96579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":107,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:23.659880+0000","last_change":"2024-04-26T12:10:23.660004+0000","last_active":"2024-04-26T12:10:23.659880+0000","last_peered":"2024-04-26T12:10:23.659880+0000","last_clean":"2024-04-26T12:10:23.659880+0000","last_became_active":"2024-04-26T12:08:36.695444+0000","last_became_peered":"2024-04-26T12:08:36.695444+0000","last_unstale":"2024-04-26T12:10:23.659880+0000","last_undegraded":"2024-04-26T12:10:23.659880+0000","last_fullsized":"2024-04-26T12:10:23.659880+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:23.659860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:23.659860+0000","last_clean_scrub_stamp":"2024-04-26T12:10:23.659860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:06.398224+0000","scrub_duration":0.001542444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"84'115","reported_seq":253,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:03.595427+0000","last_change":"2024-04-26T12:10:03.595540+0000","last_active":"2024-04-26T12:10:03.595427+0000","last_peered":"2024-04-26T12:10:03.595427+0000","last_clean":"2024-04-26T12:10:03.595427+0000","last_became_active":"2024-04-26T12:05:03.427985+0000","last_became_peered":"2024-04-26T12:05:03.427985+0000","last_unstale":"2024-04-26T12:10:03.595427+0000","last_undegraded":"2024-04-26T12:10:03.595427+0000","last_fullsized":"2024-04-26T12:10:03.595427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'115","last_scrub_stamp":"2024-04-26T12:10:03.595404+0000","last_deep_scrub":"84'115","last_deep_scrub_stamp":"2024-04-26T12:10:03.595404+0000","last_clean_scrub_stamp":"2024-04-26T12:10:03.595404+0000","objects_scrubbed":1,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:28.377952+0000","scrub_duration":0.0064998820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466015,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":47,"num_write_kb":1464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"60'492","reported_seq":667,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.067124+0000","last_change":"2024-04-26T12:09:06.067244+0000","last_active":"2024-04-26T12:09:06.067124+0000","last_peered":"2024-04-26T12:09:06.067124+0000","last_clean":"2024-04-26T12:09:06.067124+0000","last_became_active":"2024-04-26T12:08:49.739496+0000","last_became_peered":"2024-04-26T12:08:49.739496+0000","last_unstale":"2024-04-26T12:09:06.067124+0000","last_undegraded":"2024-04-26T12:09:06.067124+0000","last_fullsized":"2024-04-26T12:09:06.067124+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'492","last_scrub_stamp":"2024-04-26T12:09:06.067102+0000","last_deep_scrub":"60'492","last_deep_scrub_stamp":"2024-04-26T12:09:06.067102+0000","last_clean_scrub_stamp":"2024-04-26T12:09:06.067102+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:55.504447+0000","scrub_duration":0.0024880229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":63988,"num_write":466,"num_write_kb":154489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":107,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.552902+0000","last_change":"2024-04-26T12:09:50.553084+0000","last_active":"2024-04-26T12:09:50.552902+0000","last_peered":"2024-04-26T12:09:50.552902+0000","last_clean":"2024-04-26T12:09:50.552902+0000","last_became_active":"2024-04-26T12:08:36.696619+0000","last_became_peered":"2024-04-26T12:08:36.696619+0000","last_unstale":"2024-04-26T12:09:50.552902+0000","last_undegraded":"2024-04-26T12:09:50.552902+0000","last_fullsized":"2024-04-26T12:09:50.552902+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:50.552881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:50.552881+0000","last_clean_scrub_stamp":"2024-04-26T12:09:50.552881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:13:20.480035+0000","scrub_duration":0.0016118110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"84'327","reported_seq":400,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:07.902539+0000","last_change":"2024-04-26T12:10:07.902637+0000","last_active":"2024-04-26T12:10:07.902539+0000","last_peered":"2024-04-26T12:10:07.902539+0000","last_clean":"2024-04-26T12:10:07.902539+0000","last_became_active":"2024-04-26T12:08:39.703696+0000","last_became_peered":"2024-04-26T12:08:39.703696+0000","last_unstale":"2024-04-26T12:10:07.902539+0000","last_undegraded":"2024-04-26T12:10:07.902539+0000","last_fullsized":"2024-04-26T12:10:07.902539+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'327","last_scrub_stamp":"2024-04-26T12:10:07.902515+0000","last_deep_scrub":"84'327","last_deep_scrub_stamp":"2024-04-26T12:10:07.902515+0000","last_clean_scrub_stamp":"2024-04-26T12:10:07.902515+0000","objects_scrubbed":2,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:16:41.523454+0000","scrub_duration":0.023057502000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":8296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"60'359","reported_seq":798,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:06.542350+0000","last_change":"2024-04-26T12:10:06.542462+0000","last_active":"2024-04-26T12:10:06.542350+0000","last_peered":"2024-04-26T12:10:06.542350+0000","last_clean":"2024-04-26T12:10:06.542350+0000","last_became_active":"2024-04-26T12:08:47.735729+0000","last_became_peered":"2024-04-26T12:08:47.735729+0000","last_unstale":"2024-04-26T12:10:06.542350+0000","last_undegraded":"2024-04-26T12:10:06.542350+0000","last_fullsized":"2024-04-26T12:10:06.542350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'359","last_scrub_stamp":"2024-04-26T12:10:06.542328+0000","last_deep_scrub":"60'359","last_deep_scrub_stamp":"2024-04-26T12:10:06.542328+0000","last_clean_scrub_stamp":"2024-04-26T12:10:06.542328+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:41.474767+0000","scrub_duration":0.0022812959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9448,"num_write":336,"num_write_kb":74900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":83,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124113+0000","last_change":"2024-04-26T12:04:59.403652+0000","last_active":"2024-04-26T12:09:06.124113+0000","last_peered":"2024-04-26T12:09:06.124113+0000","last_clean":"2024-04-26T12:09:06.124113+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:09:06.124113+0000","last_undegraded":"2024-04-26T12:09:06.124113+0000","last_fullsized":"2024-04-26T12:09:06.124113+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"59'67","reported_seq":147,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124098+0000","last_change":"2024-04-26T12:05:03.430140+0000","last_active":"2024-04-26T12:09:06.124098+0000","last_peered":"2024-04-26T12:09:06.124098+0000","last_clean":"2024-04-26T12:09:06.124098+0000","last_became_active":"2024-04-26T12:05:03.429838+0000","last_became_peered":"2024-04-26T12:05:03.429838+0000","last_unstale":"2024-04-26T12:09:06.124098+0000","last_undegraded":"2024-04-26T12:09:06.124098+0000","last_fullsized":"2024-04-26T12:09:06.124098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:02.408974+0000","last_clean_scrub_stamp":"2024-04-26T12:05:02.408974+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"60'403","reported_seq":907,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:18.489116+0000","last_change":"2024-04-26T12:09:18.489255+0000","last_active":"2024-04-26T12:09:18.489116+0000","last_peered":"2024-04-26T12:09:18.489116+0000","last_clean":"2024-04-26T12:09:18.489116+0000","last_became_active":"2024-04-26T12:08:50.752366+0000","last_became_peered":"2024-04-26T12:08:50.752366+0000","last_unstale":"2024-04-26T12:09:18.489116+0000","last_undegraded":"2024-04-26T12:09:18.489116+0000","last_fullsized":"2024-04-26T12:09:18.489116+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'403","last_scrub_stamp":"2024-04-26T12:09:18.489093+0000","last_deep_scrub":"60'403","last_deep_scrub_stamp":"2024-04-26T12:09:18.489093+0000","last_clean_scrub_stamp":"2024-04-26T12:09:18.489093+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:04.607536+0000","scrub_duration":0.0022127980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30094,"num_write":370,"num_write_kb":104181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"84'470","reported_seq":561,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:04.611927+0000","last_change":"2024-04-26T12:10:04.612034+0000","last_active":"2024-04-26T12:10:04.611927+0000","last_peered":"2024-04-26T12:10:04.611927+0000","last_clean":"2024-04-26T12:10:04.611927+0000","last_became_active":"2024-04-26T12:05:03.429146+0000","last_became_peered":"2024-04-26T12:05:03.429146+0000","last_unstale":"2024-04-26T12:10:04.611927+0000","last_undegraded":"2024-04-26T12:10:04.611927+0000","last_fullsized":"2024-04-26T12:10:04.611927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'470","last_scrub_stamp":"2024-04-26T12:10:04.611896+0000","last_deep_scrub":"84'470","last_deep_scrub_stamp":"2024-04-26T12:10:04.611896+0000","last_clean_scrub_stamp":"2024-04-26T12:10:04.611896+0000","objects_scrubbed":1,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:26.920507+0000","scrub_duration":0.016499944999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":107,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:46.574665+0000","last_change":"2024-04-26T12:09:46.574794+0000","last_active":"2024-04-26T12:09:46.574665+0000","last_peered":"2024-04-26T12:09:46.574665+0000","last_clean":"2024-04-26T12:09:46.574665+0000","last_became_active":"2024-04-26T12:08:36.697618+0000","last_became_peered":"2024-04-26T12:08:36.697618+0000","last_unstale":"2024-04-26T12:09:46.574665+0000","last_undegraded":"2024-04-26T12:09:46.574665+0000","last_fullsized":"2024-04-26T12:09:46.574665+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:46.574644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:46.574644+0000","last_clean_scrub_stamp":"2024-04-26T12:09:46.574644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:41.737446+0000","scrub_duration":0.001525857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'354","reported_seq":425,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.093137+0000","last_change":"2024-04-26T12:09:50.093263+0000","last_active":"2024-04-26T12:09:50.093137+0000","last_peered":"2024-04-26T12:09:50.093137+0000","last_clean":"2024-04-26T12:09:50.093137+0000","last_became_active":"2024-04-26T12:08:45.724153+0000","last_became_peered":"2024-04-26T12:08:45.724153+0000","last_unstale":"2024-04-26T12:09:50.093137+0000","last_undegraded":"2024-04-26T12:09:50.093137+0000","last_fullsized":"2024-04-26T12:09:50.093137+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'354","last_scrub_stamp":"2024-04-26T12:09:50.093102+0000","last_deep_scrub":"60'354","last_deep_scrub_stamp":"2024-04-26T12:09:50.093102+0000","last_clean_scrub_stamp":"2024-04-26T12:09:50.093102+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:31.582282+0000","scrub_duration":0.0022860559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":416,"num_write":319,"num_write_kb":17259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"59'53","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:54.530670+0000","last_change":"2024-04-26T12:09:54.530774+0000","last_active":"2024-04-26T12:09:54.530670+0000","last_peered":"2024-04-26T12:09:54.530670+0000","last_clean":"2024-04-26T12:09:54.530670+0000","last_became_active":"2024-04-26T12:08:36.697832+0000","last_became_peered":"2024-04-26T12:08:36.697832+0000","last_unstale":"2024-04-26T12:09:54.530670+0000","last_undegraded":"2024-04-26T12:09:54.530670+0000","last_fullsized":"2024-04-26T12:09:54.530670+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'53","last_scrub_stamp":"2024-04-26T12:09:54.530648+0000","last_deep_scrub":"59'53","last_deep_scrub_stamp":"2024-04-26T12:09:54.530648+0000","last_clean_scrub_stamp":"2024-04-26T12:09:54.530648+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:52.718701+0000","scrub_duration":0.001815388,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745977+0000","last_change":"2024-04-26T12:08:36.698131+0000","last_active":"2024-04-26T12:08:53.745977+0000","last_peered":"2024-04-26T12:08:53.745977+0000","last_clean":"2024-04-26T12:08:53.745977+0000","last_became_active":"2024-04-26T12:08:36.697698+0000","last_became_peered":"2024-04-26T12:08:36.697698+0000","last_unstale":"2024-04-26T12:08:53.745977+0000","last_undegraded":"2024-04-26T12:08:53.745977+0000","last_fullsized":"2024-04-26T12:08:53.745977+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'399","reported_seq":489,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:13.963126+0000","last_change":"2024-04-26T12:10:13.963241+0000","last_active":"2024-04-26T12:10:13.963126+0000","last_peered":"2024-04-26T12:10:13.963126+0000","last_clean":"2024-04-26T12:10:13.963126+0000","last_became_active":"2024-04-26T12:08:40.703906+0000","last_became_peered":"2024-04-26T12:08:40.703906+0000","last_unstale":"2024-04-26T12:10:13.963126+0000","last_undegraded":"2024-04-26T12:10:13.963126+0000","last_fullsized":"2024-04-26T12:10:13.963126+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'399","last_scrub_stamp":"2024-04-26T12:10:13.963104+0000","last_deep_scrub":"60'399","last_deep_scrub_stamp":"2024-04-26T12:10:13.963104+0000","last_clean_scrub_stamp":"2024-04-26T12:10:13.963104+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:15:56.291072+0000","scrub_duration":0.0021772139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11720,"num_write":363,"num_write_kb":66914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"84'66","reported_seq":171,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:42.618525+0000","last_change":"2024-04-26T12:09:42.618673+0000","last_active":"2024-04-26T12:09:42.618525+0000","last_peered":"2024-04-26T12:09:42.618525+0000","last_clean":"2024-04-26T12:09:42.618525+0000","last_became_active":"2024-04-26T12:08:36.699058+0000","last_became_peered":"2024-04-26T12:08:36.699058+0000","last_unstale":"2024-04-26T12:09:42.618525+0000","last_undegraded":"2024-04-26T12:09:42.618525+0000","last_fullsized":"2024-04-26T12:09:42.618525+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'66","last_scrub_stamp":"2024-04-26T12:09:42.618500+0000","last_deep_scrub":"84'66","last_deep_scrub_stamp":"2024-04-26T12:09:42.618500+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.618500+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:34.338430+0000","scrub_duration":0.0032759640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":107,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:52.522553+0000","last_change":"2024-04-26T12:09:52.522681+0000","last_active":"2024-04-26T12:09:52.522553+0000","last_peered":"2024-04-26T12:09:52.522553+0000","last_clean":"2024-04-26T12:09:52.522553+0000","last_became_active":"2024-04-26T12:08:36.697407+0000","last_became_peered":"2024-04-26T12:08:36.697407+0000","last_unstale":"2024-04-26T12:09:52.522553+0000","last_undegraded":"2024-04-26T12:09:52.522553+0000","last_fullsized":"2024-04-26T12:09:52.522553+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:52.522518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:52.522518+0000","last_clean_scrub_stamp":"2024-04-26T12:09:52.522518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:32.712239+0000","scrub_duration":0.001939184,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'424","reported_seq":554,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:36.668960+0000","last_change":"2024-04-26T12:09:36.669071+0000","last_active":"2024-04-26T12:09:36.668960+0000","last_peered":"2024-04-26T12:09:36.668960+0000","last_clean":"2024-04-26T12:09:36.668960+0000","last_became_active":"2024-04-26T12:05:03.789390+0000","last_became_peered":"2024-04-26T12:05:03.789390+0000","last_unstale":"2024-04-26T12:09:36.668960+0000","last_undegraded":"2024-04-26T12:09:36.668960+0000","last_fullsized":"2024-04-26T12:09:36.668960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'424","last_scrub_stamp":"2024-04-26T12:09:36.668937+0000","last_deep_scrub":"60'424","last_deep_scrub_stamp":"2024-04-26T12:09:36.668937+0000","last_clean_scrub_stamp":"2024-04-26T12:09:36.668937+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:58.766848+0000","scrub_duration":0.0024505759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17027,"num_write":386,"num_write_kb":58797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"84'71","reported_seq":162,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:45.617441+0000","last_change":"2024-04-26T12:09:45.617547+0000","last_active":"2024-04-26T12:09:45.617441+0000","last_peered":"2024-04-26T12:09:45.617441+0000","last_clean":"2024-04-26T12:09:45.617441+0000","last_became_active":"2024-04-26T12:05:03.428803+0000","last_became_peered":"2024-04-26T12:05:03.428803+0000","last_unstale":"2024-04-26T12:09:45.617441+0000","last_undegraded":"2024-04-26T12:09:45.617441+0000","last_fullsized":"2024-04-26T12:09:45.617441+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'71","last_scrub_stamp":"2024-04-26T12:09:45.617416+0000","last_deep_scrub":"84'71","last_deep_scrub_stamp":"2024-04-26T12:09:45.617416+0000","last_clean_scrub_stamp":"2024-04-26T12:09:45.617416+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:39.856897+0000","scrub_duration":0.0067924539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124101+0000","last_change":"2024-04-26T12:08:36.698775+0000","last_active":"2024-04-26T12:09:06.124101+0000","last_peered":"2024-04-26T12:09:06.124101+0000","last_clean":"2024-04-26T12:09:06.124101+0000","last_became_active":"2024-04-26T12:08:36.698523+0000","last_became_peered":"2024-04-26T12:08:36.698523+0000","last_unstale":"2024-04-26T12:09:06.124101+0000","last_undegraded":"2024-04-26T12:09:06.124101+0000","last_fullsized":"2024-04-26T12:09:06.124101+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:04:58.393378+0000","last_clean_scrub_stamp":"2024-04-26T12:04:58.393378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'393","reported_seq":484,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:40.062039+0000","last_change":"2024-04-26T12:09:40.062141+0000","last_active":"2024-04-26T12:09:40.062039+0000","last_peered":"2024-04-26T12:09:40.062039+0000","last_clean":"2024-04-26T12:09:40.062039+0000","last_became_active":"2024-04-26T12:08:40.703873+0000","last_became_peered":"2024-04-26T12:08:40.703873+0000","last_unstale":"2024-04-26T12:09:40.062039+0000","last_undegraded":"2024-04-26T12:09:40.062039+0000","last_fullsized":"2024-04-26T12:09:40.062039+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'393","last_scrub_stamp":"2024-04-26T12:09:40.062013+0000","last_deep_scrub":"60'393","last_deep_scrub_stamp":"2024-04-26T12:09:40.062013+0000","last_clean_scrub_stamp":"2024-04-26T12:09:40.062013+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:47.183215+0000","scrub_duration":0.0022492969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":11991,"num_write":357,"num_write_kb":83226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'419","reported_seq":905,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:29.651923+0000","last_change":"2024-04-26T12:09:29.651923+0000","last_active":"2024-04-26T12:09:29.651923+0000","last_peered":"2024-04-26T12:09:29.651923+0000","last_clean":"2024-04-26T12:09:29.651923+0000","last_became_active":"2024-04-26T12:08:44.722574+0000","last_became_peered":"2024-04-26T12:08:44.722574+0000","last_unstale":"2024-04-26T12:09:29.651923+0000","last_undegraded":"2024-04-26T12:09:29.651923+0000","last_fullsized":"2024-04-26T12:09:29.651923+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'419","last_scrub_stamp":"2024-04-26T12:09:29.651776+0000","last_deep_scrub":"60'419","last_deep_scrub_stamp":"2024-04-26T12:09:29.651776+0000","last_clean_scrub_stamp":"2024-04-26T12:09:29.651776+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:03.355550+0000","scrub_duration":0.0023698270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14983,"num_write":376,"num_write_kb":76749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"84'404","reported_seq":526,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.702349+0000","last_change":"2024-04-26T12:09:50.702472+0000","last_active":"2024-04-26T12:09:50.702349+0000","last_peered":"2024-04-26T12:09:50.702349+0000","last_clean":"2024-04-26T12:09:50.702349+0000","last_became_active":"2024-04-26T12:08:39.703516+0000","last_became_peered":"2024-04-26T12:08:39.703516+0000","last_unstale":"2024-04-26T12:09:50.702349+0000","last_undegraded":"2024-04-26T12:09:50.702349+0000","last_fullsized":"2024-04-26T12:09:50.702349+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'404","last_scrub_stamp":"2024-04-26T12:09:50.702328+0000","last_deep_scrub":"84'404","last_deep_scrub_stamp":"2024-04-26T12:09:50.702328+0000","last_clean_scrub_stamp":"2024-04-26T12:09:50.702328+0000","objects_scrubbed":6,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:51.625649+0000","scrub_duration":0.02885393,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699266,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":9692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9692849,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'428","reported_seq":953,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:04.569401+0000","last_change":"2024-04-26T12:10:04.569511+0000","last_active":"2024-04-26T12:10:04.569401+0000","last_peered":"2024-04-26T12:10:04.569401+0000","last_clean":"2024-04-26T12:10:04.569401+0000","last_became_active":"2024-04-26T12:08:50.752328+0000","last_became_peered":"2024-04-26T12:08:50.752328+0000","last_unstale":"2024-04-26T12:10:04.569401+0000","last_undegraded":"2024-04-26T12:10:04.569401+0000","last_fullsized":"2024-04-26T12:10:04.569401+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'428","last_scrub_stamp":"2024-04-26T12:10:04.569378+0000","last_deep_scrub":"60'428","last_deep_scrub_stamp":"2024-04-26T12:10:04.569378+0000","last_clean_scrub_stamp":"2024-04-26T12:10:04.569378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:47.307742+0000","scrub_duration":0.0028671769999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":26594,"num_write":396,"num_write_kb":67932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"84'93","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:56.025232+0000","last_change":"2024-04-26T12:09:56.025331+0000","last_active":"2024-04-26T12:09:56.025232+0000","last_peered":"2024-04-26T12:09:56.025232+0000","last_clean":"2024-04-26T12:09:56.025232+0000","last_became_active":"2024-04-26T12:08:36.697650+0000","last_became_peered":"2024-04-26T12:08:36.697650+0000","last_unstale":"2024-04-26T12:09:56.025232+0000","last_undegraded":"2024-04-26T12:09:56.025232+0000","last_fullsized":"2024-04-26T12:09:56.025232+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'93","last_scrub_stamp":"2024-04-26T12:09:56.025210+0000","last_deep_scrub":"84'93","last_deep_scrub_stamp":"2024-04-26T12:09:56.025210+0000","last_clean_scrub_stamp":"2024-04-26T12:09:56.025210+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:37.270337+0000","scrub_duration":0.0035178729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"84'317","reported_seq":408,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.578923+0000","last_change":"2024-04-26T12:10:21.579052+0000","last_active":"2024-04-26T12:10:21.578923+0000","last_peered":"2024-04-26T12:10:21.578923+0000","last_clean":"2024-04-26T12:10:21.578923+0000","last_became_active":"2024-04-26T12:05:03.428921+0000","last_became_peered":"2024-04-26T12:05:03.428921+0000","last_unstale":"2024-04-26T12:10:21.578923+0000","last_undegraded":"2024-04-26T12:10:21.578923+0000","last_fullsized":"2024-04-26T12:10:21.578923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'317","last_scrub_stamp":"2024-04-26T12:10:21.578894+0000","last_deep_scrub":"84'317","last_deep_scrub_stamp":"2024-04-26T12:10:21.578894+0000","last_clean_scrub_stamp":"2024-04-26T12:10:21.578894+0000","objects_scrubbed":1,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:10.753453+0000","scrub_duration":0.014228315,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'495","reported_seq":638,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:25.547380+0000","last_change":"2024-04-26T12:09:25.547380+0000","last_active":"2024-04-26T12:09:25.547380+0000","last_peered":"2024-04-26T12:09:25.547380+0000","last_clean":"2024-04-26T12:09:25.547380+0000","last_became_active":"2024-04-26T12:05:03.787533+0000","last_became_peered":"2024-04-26T12:05:03.787533+0000","last_unstale":"2024-04-26T12:09:25.547380+0000","last_undegraded":"2024-04-26T12:09:25.547380+0000","last_fullsized":"2024-04-26T12:09:25.547380+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'495","last_scrub_stamp":"2024-04-26T12:09:25.547250+0000","last_deep_scrub":"60'495","last_deep_scrub_stamp":"2024-04-26T12:09:25.547250+0000","last_clean_scrub_stamp":"2024-04-26T12:09:25.547250+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:52.939986+0000","scrub_duration":0.002519252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37174,"num_write":458,"num_write_kb":125832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'51","reported_seq":142,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:29.586170+0000","last_change":"2024-04-26T12:09:29.586170+0000","last_active":"2024-04-26T12:09:29.586170+0000","last_peered":"2024-04-26T12:09:29.586170+0000","last_clean":"2024-04-26T12:09:29.586170+0000","last_became_active":"2024-04-26T12:05:03.428445+0000","last_became_peered":"2024-04-26T12:05:03.428445+0000","last_unstale":"2024-04-26T12:09:29.586170+0000","last_undegraded":"2024-04-26T12:09:29.586170+0000","last_fullsized":"2024-04-26T12:09:29.586170+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'51","last_scrub_stamp":"2024-04-26T12:09:29.585971+0000","last_deep_scrub":"59'51","last_deep_scrub_stamp":"2024-04-26T12:09:29.585971+0000","last_clean_scrub_stamp":"2024-04-26T12:09:29.585971+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:15.873513+0000","scrub_duration":0.0016537050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'482","reported_seq":1143,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:05.584628+0000","last_change":"2024-04-26T12:10:05.584742+0000","last_active":"2024-04-26T12:10:05.584628+0000","last_peered":"2024-04-26T12:10:05.584628+0000","last_clean":"2024-04-26T12:10:05.584628+0000","last_became_active":"2024-04-26T12:08:48.740055+0000","last_became_peered":"2024-04-26T12:08:48.740055+0000","last_unstale":"2024-04-26T12:10:05.584628+0000","last_undegraded":"2024-04-26T12:10:05.584628+0000","last_fullsized":"2024-04-26T12:10:05.584628+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'482","last_scrub_stamp":"2024-04-26T12:10:05.584603+0000","last_deep_scrub":"60'482","last_deep_scrub_stamp":"2024-04-26T12:10:05.584603+0000","last_clean_scrub_stamp":"2024-04-26T12:10:05.584603+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:28.512669+0000","scrub_duration":0.002302704,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":61972,"num_write":459,"num_write_kb":125797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"60'392","reported_seq":528,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745849+0000","last_change":"2024-04-26T12:08:43.718939+0000","last_active":"2024-04-26T12:08:53.745849+0000","last_peered":"2024-04-26T12:08:53.745849+0000","last_clean":"2024-04-26T12:08:53.745849+0000","last_became_active":"2024-04-26T12:08:43.717109+0000","last_became_peered":"2024-04-26T12:08:43.717109+0000","last_unstale":"2024-04-26T12:08:53.745849+0000","last_undegraded":"2024-04-26T12:08:53.745849+0000","last_fullsized":"2024-04-26T12:08:53.745849+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":37910,"num_write":366,"num_write_kb":84111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"84'711","reported_seq":828,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:58.565960+0000","last_change":"2024-04-26T12:09:58.566091+0000","last_active":"2024-04-26T12:09:58.565960+0000","last_peered":"2024-04-26T12:09:58.565960+0000","last_clean":"2024-04-26T12:09:58.565960+0000","last_became_active":"2024-04-26T12:08:39.700927+0000","last_became_peered":"2024-04-26T12:08:39.700927+0000","last_unstale":"2024-04-26T12:09:58.565960+0000","last_undegraded":"2024-04-26T12:09:58.565960+0000","last_fullsized":"2024-04-26T12:09:58.565960+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'711","last_scrub_stamp":"2024-04-26T12:09:58.565935+0000","last_deep_scrub":"84'711","last_deep_scrub_stamp":"2024-04-26T12:09:58.565935+0000","last_clean_scrub_stamp":"2024-04-26T12:09:58.565935+0000","objects_scrubbed":2,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:53.985339+0000","scrub_duration":0.028815225,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"60'435","reported_seq":585,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:12.601978+0000","last_change":"2024-04-26T12:10:12.602088+0000","last_active":"2024-04-26T12:10:12.601978+0000","last_peered":"2024-04-26T12:10:12.601978+0000","last_clean":"2024-04-26T12:10:12.601978+0000","last_became_active":"2024-04-26T12:05:03.788311+0000","last_became_peered":"2024-04-26T12:05:03.788311+0000","last_unstale":"2024-04-26T12:10:12.601978+0000","last_undegraded":"2024-04-26T12:10:12.601978+0000","last_fullsized":"2024-04-26T12:10:12.601978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'435","last_scrub_stamp":"2024-04-26T12:10:12.601956+0000","last_deep_scrub":"60'435","last_deep_scrub_stamp":"2024-04-26T12:10:12.601956+0000","last_clean_scrub_stamp":"2024-04-26T12:10:12.601956+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:06.128844+0000","scrub_duration":0.0028402480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":28462,"num_write":403,"num_write_kb":93779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"84'263","reported_seq":354,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:40.654355+0000","last_change":"2024-04-26T12:09:40.654355+0000","last_active":"2024-04-26T12:09:40.654355+0000","last_peered":"2024-04-26T12:09:40.654355+0000","last_clean":"2024-04-26T12:09:40.654355+0000","last_became_active":"2024-04-26T12:05:03.428191+0000","last_became_peered":"2024-04-26T12:05:03.428191+0000","last_unstale":"2024-04-26T12:09:40.654355+0000","last_undegraded":"2024-04-26T12:09:40.654355+0000","last_fullsized":"2024-04-26T12:09:40.654355+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'263","last_scrub_stamp":"2024-04-26T12:09:40.654238+0000","last_deep_scrub":"84'263","last_deep_scrub_stamp":"2024-04-26T12:09:40.654238+0000","last_clean_scrub_stamp":"2024-04-26T12:09:40.654238+0000","objects_scrubbed":1,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:02.888122+0000","scrub_duration":0.014597508,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"60'399","reported_seq":500,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:08:53.745543+0000","last_change":"2024-04-26T12:08:49.742459+0000","last_active":"2024-04-26T12:08:53.745543+0000","last_peered":"2024-04-26T12:08:53.745543+0000","last_clean":"2024-04-26T12:08:53.745543+0000","last_became_active":"2024-04-26T12:08:49.740536+0000","last_became_peered":"2024-04-26T12:08:49.740536+0000","last_unstale":"2024-04-26T12:08:53.745543+0000","last_undegraded":"2024-04-26T12:08:53.745543+0000","last_fullsized":"2024-04-26T12:08:53.745543+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22216,"num_write":357,"num_write_kb":75245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"84'433","reported_seq":505,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:33.133704+0000","last_change":"2024-04-26T12:09:33.133804+0000","last_active":"2024-04-26T12:09:33.133704+0000","last_peered":"2024-04-26T12:09:33.133704+0000","last_clean":"2024-04-26T12:09:33.133704+0000","last_became_active":"2024-04-26T12:08:39.702529+0000","last_became_peered":"2024-04-26T12:08:39.702529+0000","last_unstale":"2024-04-26T12:09:33.133704+0000","last_undegraded":"2024-04-26T12:09:33.133704+0000","last_fullsized":"2024-04-26T12:09:33.133704+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'433","last_scrub_stamp":"2024-04-26T12:09:33.133683+0000","last_deep_scrub":"84'433","last_deep_scrub_stamp":"2024-04-26T12:09:33.133683+0000","last_clean_scrub_stamp":"2024-04-26T12:09:33.133683+0000","objects_scrubbed":3,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:32.088329+0000","scrub_duration":0.034859436000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":12514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"60'387","reported_seq":488,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.120063+0000","last_change":"2024-04-26T12:09:49.120210+0000","last_active":"2024-04-26T12:09:49.120063+0000","last_peered":"2024-04-26T12:09:49.120063+0000","last_clean":"2024-04-26T12:09:49.120063+0000","last_became_active":"2024-04-26T12:08:43.717442+0000","last_became_peered":"2024-04-26T12:08:43.717442+0000","last_unstale":"2024-04-26T12:09:49.120063+0000","last_undegraded":"2024-04-26T12:09:49.120063+0000","last_fullsized":"2024-04-26T12:09:49.120063+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'387","last_scrub_stamp":"2024-04-26T12:09:49.120043+0000","last_deep_scrub":"60'387","last_deep_scrub_stamp":"2024-04-26T12:09:49.120043+0000","last_clean_scrub_stamp":"2024-04-26T12:09:49.120043+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:21.246128+0000","scrub_duration":0.00208647,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20720,"num_write":352,"num_write_kb":87643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"84'59","reported_seq":56,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:16.993596+0000","last_change":"2024-04-26T12:10:16.993913+0000","last_active":"2024-04-26T12:10:16.993596+0000","last_peered":"2024-04-26T12:10:16.993596+0000","last_clean":"2024-04-26T12:10:16.993596+0000","last_became_active":"2024-04-26T12:08:36.693399+0000","last_became_peered":"2024-04-26T12:08:36.693399+0000","last_unstale":"2024-04-26T12:10:16.993596+0000","last_undegraded":"2024-04-26T12:10:16.993596+0000","last_fullsized":"2024-04-26T12:10:16.993596+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'59","last_scrub_stamp":"2024-04-26T12:10:16.993575+0000","last_deep_scrub":"84'59","last_deep_scrub_stamp":"2024-04-26T12:10:16.993575+0000","last_clean_scrub_stamp":"2024-04-26T12:10:16.993575+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:32.405915+0000","scrub_duration":0.0097403390000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"60'356","reported_seq":454,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124502+0000","last_change":"2024-04-26T12:05:03.791986+0000","last_active":"2024-04-26T12:09:06.124502+0000","last_peered":"2024-04-26T12:09:06.124502+0000","last_clean":"2024-04-26T12:09:06.124502+0000","last_became_active":"2024-04-26T12:05:03.790823+0000","last_became_peered":"2024-04-26T12:05:03.790823+0000","last_unstale":"2024-04-26T12:09:06.124502+0000","last_undegraded":"2024-04-26T12:09:06.124502+0000","last_fullsized":"2024-04-26T12:09:06.124502+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9641,"num_write":326,"num_write_kb":29574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"84'311","reported_seq":402,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:32.706538+0000","last_change":"2024-04-26T12:09:32.706538+0000","last_active":"2024-04-26T12:09:32.706538+0000","last_peered":"2024-04-26T12:09:32.706538+0000","last_clean":"2024-04-26T12:09:32.706538+0000","last_became_active":"2024-04-26T12:05:03.429015+0000","last_became_peered":"2024-04-26T12:05:03.429015+0000","last_unstale":"2024-04-26T12:09:32.706538+0000","last_undegraded":"2024-04-26T12:09:32.706538+0000","last_fullsized":"2024-04-26T12:09:32.706538+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'311","last_scrub_stamp":"2024-04-26T12:09:32.706381+0000","last_deep_scrub":"84'311","last_deep_scrub_stamp":"2024-04-26T12:09:32.706381+0000","last_clean_scrub_stamp":"2024-04-26T12:09:32.706381+0000","objects_scrubbed":2,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:18.824824+0000","scrub_duration":0.016953577000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'433","reported_seq":588,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:52.685440+0000","last_change":"2024-04-26T12:09:52.685440+0000","last_active":"2024-04-26T12:09:52.685440+0000","last_peered":"2024-04-26T12:09:52.685440+0000","last_clean":"2024-04-26T12:09:52.685440+0000","last_became_active":"2024-04-26T12:05:03.791540+0000","last_became_peered":"2024-04-26T12:05:03.791540+0000","last_unstale":"2024-04-26T12:09:52.685440+0000","last_undegraded":"2024-04-26T12:09:52.685440+0000","last_fullsized":"2024-04-26T12:09:52.685440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'433","last_scrub_stamp":"2024-04-26T12:09:52.685297+0000","last_deep_scrub":"60'433","last_deep_scrub_stamp":"2024-04-26T12:09:52.685297+0000","last_clean_scrub_stamp":"2024-04-26T12:09:52.685297+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:14.783208+0000","scrub_duration":0.0028996600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":47864,"num_write":399,"num_write_kb":92193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"84'386","reported_seq":465,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:24.039855+0000","last_change":"2024-04-26T12:10:24.039971+0000","last_active":"2024-04-26T12:10:24.039855+0000","last_peered":"2024-04-26T12:10:24.039855+0000","last_clean":"2024-04-26T12:10:24.039855+0000","last_became_active":"2024-04-26T12:08:39.704404+0000","last_became_peered":"2024-04-26T12:08:39.704404+0000","last_unstale":"2024-04-26T12:10:24.039855+0000","last_undegraded":"2024-04-26T12:10:24.039855+0000","last_fullsized":"2024-04-26T12:10:24.039855+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'386","last_scrub_stamp":"2024-04-26T12:10:24.039831+0000","last_deep_scrub":"84'386","last_deep_scrub_stamp":"2024-04-26T12:10:24.039831+0000","last_clean_scrub_stamp":"2024-04-26T12:10:24.039831+0000","objects_scrubbed":4,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:29.776584+0000","scrub_duration":0.031708703999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":12467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'425","reported_seq":556,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:18.179708+0000","last_change":"2024-04-26T12:09:18.179810+0000","last_active":"2024-04-26T12:09:18.179708+0000","last_peered":"2024-04-26T12:09:18.179708+0000","last_clean":"2024-04-26T12:09:18.179708+0000","last_became_active":"2024-04-26T12:08:47.735367+0000","last_became_peered":"2024-04-26T12:08:47.735367+0000","last_unstale":"2024-04-26T12:09:18.179708+0000","last_undegraded":"2024-04-26T12:09:18.179708+0000","last_fullsized":"2024-04-26T12:09:18.179708+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'425","last_scrub_stamp":"2024-04-26T12:09:18.179684+0000","last_deep_scrub":"60'425","last_deep_scrub_stamp":"2024-04-26T12:09:18.179684+0000","last_clean_scrub_stamp":"2024-04-26T12:09:18.179684+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:20.520222+0000","scrub_duration":0.0024613230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":38065,"num_write":387,"num_write_kb":71445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"84'127","reported_seq":243,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:21.540633+0000","last_change":"2024-04-26T12:09:21.540746+0000","last_active":"2024-04-26T12:09:21.540633+0000","last_peered":"2024-04-26T12:09:21.540633+0000","last_clean":"2024-04-26T12:09:21.540633+0000","last_became_active":"2024-04-26T12:08:39.701900+0000","last_became_peered":"2024-04-26T12:08:39.701900+0000","last_unstale":"2024-04-26T12:09:21.540633+0000","last_undegraded":"2024-04-26T12:09:21.540633+0000","last_fullsized":"2024-04-26T12:09:21.540633+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'127","last_scrub_stamp":"2024-04-26T12:09:21.540611+0000","last_deep_scrub":"84'127","last_deep_scrub_stamp":"2024-04-26T12:09:21.540611+0000","last_clean_scrub_stamp":"2024-04-26T12:09:21.540611+0000","objects_scrubbed":1,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:30.101109+0000","scrub_duration":0.0098993390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"60'448","reported_seq":561,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:31.644589+0000","last_change":"2024-04-26T12:09:31.644589+0000","last_active":"2024-04-26T12:09:31.644589+0000","last_peered":"2024-04-26T12:09:31.644589+0000","last_clean":"2024-04-26T12:09:31.644589+0000","last_became_active":"2024-04-26T12:05:03.791442+0000","last_became_peered":"2024-04-26T12:05:03.791442+0000","last_unstale":"2024-04-26T12:09:31.644589+0000","last_undegraded":"2024-04-26T12:09:31.644589+0000","last_fullsized":"2024-04-26T12:09:31.644589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'448","last_scrub_stamp":"2024-04-26T12:09:31.644476+0000","last_deep_scrub":"60'448","last_deep_scrub_stamp":"2024-04-26T12:09:31.644476+0000","last_clean_scrub_stamp":"2024-04-26T12:09:31.644476+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:50.748197+0000","scrub_duration":0.0028574049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11191,"num_write":416,"num_write_kb":67272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"84'59","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:17.505129+0000","last_change":"2024-04-26T12:09:17.505233+0000","last_active":"2024-04-26T12:09:17.505129+0000","last_peered":"2024-04-26T12:09:17.505129+0000","last_clean":"2024-04-26T12:09:17.505129+0000","last_became_active":"2024-04-26T12:05:03.430164+0000","last_became_peered":"2024-04-26T12:05:03.430164+0000","last_unstale":"2024-04-26T12:09:17.505129+0000","last_undegraded":"2024-04-26T12:09:17.505129+0000","last_fullsized":"2024-04-26T12:09:17.505129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'59","last_scrub_stamp":"2024-04-26T12:09:17.505103+0000","last_deep_scrub":"84'59","last_deep_scrub_stamp":"2024-04-26T12:09:17.505103+0000","last_clean_scrub_stamp":"2024-04-26T12:09:17.505103+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:36.608825+0000","scrub_duration":0.012259582999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2734,"num_read_kb":1486856,"num_write":24627,"num_write_kb":4487808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7440,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26722,"ondisk_log_size":26722,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128606591,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":5972,"num_write_kb":129691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64376832,"data_stored":257213182,"data_compressed":19249503,"data_compressed_allocated":31694848,"data_compressed_original":224591872,"omap_allocated":4411,"internal_metadata":0},"log_size":7875,"ondisk_log_size":7875,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738440,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134428,"kb_used_data":27092,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94237412,"statfs":{"total":96636764160,"available":96499109888,"internally_reserved":0,"allocated":27742208,"data_stored":91797602,"data_compressed":6340284,"data_compressed_allocated":11272192,"data_compressed_original":75763712,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:10:04 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.40400000000000003,"15min":0.438},"min":{"1min":0.26800000000000002,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.57799999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.40699999999999997,"15min":0.42899999999999999},"min":{"1min":0.33000000000000002,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.39700000000000002}]},{"osd":1,"last update":"Fri Apr 26 12:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.59799999999999998}]}]},{"osd":1,"up_from":66,"seq":283467841560,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68508,"kb_used_data":10644,"kb_used_omap":5,"kb_used_meta":57850,"kb_avail":94303332,"statfs":{"total":96636764160,"available":96566611968,"internally_reserved":0,"allocated":10899456,"data_stored":86136667,"data_compressed":7182940,"data_compressed_allocated":10076160,"data_compressed_original":85745664,"omap_allocated":6005,"internal_metadata":59238539},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.155,"5min":0.155,"15min":0.155},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.46400000000000002}]},{"osd":2,"last update":"Fri Apr 26 12:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.57999999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138884,"kb_used_data":27452,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232956,"statfs":{"total":96636764160,"available":96494546944,"internally_reserved":0,"allocated":28110848,"data_stored":81507786,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Apr 26 12:10:05 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.442,"15min":0.441},"min":{"1min":0.39200000000000002,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.60799999999999998,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.45200000000000001,"15min":0.439},"min":{"1min":0.38,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.64500000000000002,"5min":1.976,"15min":1.976},"last":0.44500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27357184,"data_stored":81158407,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10088448,"data_stored":85196920,"data_compressed":7176942,"data_compressed_allocated":10039296,"data_compressed_original":85172224,"omap_allocated":4411,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26931200,"data_stored":90857855,"data_compressed":6334286,"data_compressed_allocated":11235328,"data_compressed_original":75190272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:10:27.813 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:27.814 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:27.814 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:27.814 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:27.814 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:27.814 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:27.814 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:27.815 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:27.815 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:27.815 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:27.815 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:27.815 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:27.815 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:27.815 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:27.816 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:27.816 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:27.816 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:27.816 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:05:02.408974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:27.816 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:27.816 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T12:04:58.393378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=4, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:27.817 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:27.817 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:27.817 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:27.817 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:10:47.818 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:10:48.129 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:10:48.130 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:10:48.139 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2024-04-26T12:10:46.422577+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129196959,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2917,"num_read_kb":1488438,"num_write":30802,"num_write_kb":4620959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7463,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34762,"ondisk_log_size":34762,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":341820,"kb_used_data":65188,"kb_used_omap":8,"kb_used_meta":276599,"kb_avail":282773700,"statfs":{"total":289910292480,"available":289560268800,"internally_reserved":0,"allocated":66752512,"data_stored":259442055,"data_compressed":19261499,"data_compressed_allocated":31768576,"data_compressed_original":225738752,"omap_allocated":9193,"internal_metadata":283237399},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003499"},"pg_stats":[{"pgid":"4.3f","version":"60'426","reported_seq":509,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.684084+0000","last_change":"2024-04-26T12:08:51.753936+0000","last_active":"2024-04-26T12:09:05.684084+0000","last_peered":"2024-04-26T12:09:05.684084+0000","last_clean":"2024-04-26T12:09:05.684084+0000","last_became_active":"2024-04-26T12:08:51.750917+0000","last_became_peered":"2024-04-26T12:08:51.750917+0000","last_unstale":"2024-04-26T12:09:05.684084+0000","last_undegraded":"2024-04-26T12:09:05.684084+0000","last_fullsized":"2024-04-26T12:09:05.684084+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9964,"num_write":393,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"60'470","reported_seq":614,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:37.850211+0000","last_change":"2024-04-26T12:10:37.850211+0000","last_active":"2024-04-26T12:10:37.850211+0000","last_peered":"2024-04-26T12:10:37.850211+0000","last_clean":"2024-04-26T12:10:37.850211+0000","last_became_active":"2024-04-26T12:08:43.717325+0000","last_became_peered":"2024-04-26T12:08:43.717325+0000","last_unstale":"2024-04-26T12:10:37.850211+0000","last_undegraded":"2024-04-26T12:10:37.850211+0000","last_fullsized":"2024-04-26T12:10:37.850211+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'470","last_scrub_stamp":"2024-04-26T12:10:37.850091+0000","last_deep_scrub":"60'470","last_deep_scrub_stamp":"2024-04-26T12:10:37.850091+0000","last_clean_scrub_stamp":"2024-04-26T12:10:37.850091+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:51.756889+0000","scrub_duration":0.002519047,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":34556,"num_write":444,"num_write_kb":129697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"60'370","reported_seq":804,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124711+0000","last_change":"2024-04-26T12:08:50.753639+0000","last_active":"2024-04-26T12:09:06.124711+0000","last_peered":"2024-04-26T12:09:06.124711+0000","last_clean":"2024-04-26T12:09:06.124711+0000","last_became_active":"2024-04-26T12:08:50.752468+0000","last_became_peered":"2024-04-26T12:08:50.752468+0000","last_unstale":"2024-04-26T12:09:06.124711+0000","last_undegraded":"2024-04-26T12:09:06.124711+0000","last_fullsized":"2024-04-26T12:09:06.124711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":349,"num_write_kb":51115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"60'377","reported_seq":487,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124688+0000","last_change":"2024-04-26T12:05:03.791234+0000","last_active":"2024-04-26T12:09:06.124688+0000","last_peered":"2024-04-26T12:09:06.124688+0000","last_clean":"2024-04-26T12:09:06.124688+0000","last_became_active":"2024-04-26T12:05:03.790717+0000","last_became_peered":"2024-04-26T12:05:03.790717+0000","last_unstale":"2024-04-26T12:09:06.124688+0000","last_undegraded":"2024-04-26T12:09:06.124688+0000","last_fullsized":"2024-04-26T12:09:06.124688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17376,"num_write":341,"num_write_kb":46680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'445","reported_seq":562,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:42.047300+0000","last_change":"2024-04-26T12:09:42.047407+0000","last_active":"2024-04-26T12:09:42.047300+0000","last_peered":"2024-04-26T12:09:42.047300+0000","last_clean":"2024-04-26T12:09:42.047300+0000","last_became_active":"2024-04-26T12:08:39.702117+0000","last_became_peered":"2024-04-26T12:08:39.702117+0000","last_unstale":"2024-04-26T12:09:42.047300+0000","last_undegraded":"2024-04-26T12:09:42.047300+0000","last_fullsized":"2024-04-26T12:09:42.047300+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'445","last_scrub_stamp":"2024-04-26T12:09:42.047279+0000","last_deep_scrub":"60'445","last_deep_scrub_stamp":"2024-04-26T12:09:42.047279+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.047279+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:26.392089+0000","scrub_duration":0.0023237290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24197,"num_write":416,"num_write_kb":80466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"60'375","reported_seq":472,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124685+0000","last_change":"2024-04-26T12:05:03.791560+0000","last_active":"2024-04-26T12:09:06.124685+0000","last_peered":"2024-04-26T12:09:06.124685+0000","last_clean":"2024-04-26T12:09:06.124685+0000","last_became_active":"2024-04-26T12:05:03.790578+0000","last_became_peered":"2024-04-26T12:05:03.790578+0000","last_unstale":"2024-04-26T12:09:06.124685+0000","last_undegraded":"2024-04-26T12:09:06.124685+0000","last_fullsized":"2024-04-26T12:09:06.124685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6518,"num_write":348,"num_write_kb":38078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'428","reported_seq":537,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:18.488710+0000","last_change":"2024-04-26T12:09:18.488710+0000","last_active":"2024-04-26T12:09:18.488710+0000","last_peered":"2024-04-26T12:09:18.488710+0000","last_clean":"2024-04-26T12:09:18.488710+0000","last_became_active":"2024-04-26T12:05:03.790615+0000","last_became_peered":"2024-04-26T12:05:03.790615+0000","last_unstale":"2024-04-26T12:09:18.488710+0000","last_undegraded":"2024-04-26T12:09:18.488710+0000","last_fullsized":"2024-04-26T12:09:18.488710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'428","last_scrub_stamp":"2024-04-26T12:09:18.488526+0000","last_deep_scrub":"60'428","last_deep_scrub_stamp":"2024-04-26T12:09:18.488526+0000","last_clean_scrub_stamp":"2024-04-26T12:09:18.488526+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:22.049575+0000","scrub_duration":0.0025858650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12560,"num_write":398,"num_write_kb":67332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"60'387","reported_seq":528,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124635+0000","last_change":"2024-04-26T12:05:03.785861+0000","last_active":"2024-04-26T12:09:06.124635+0000","last_peered":"2024-04-26T12:09:06.124635+0000","last_clean":"2024-04-26T12:09:06.124635+0000","last_became_active":"2024-04-26T12:05:03.785382+0000","last_became_peered":"2024-04-26T12:05:03.785382+0000","last_unstale":"2024-04-26T12:09:06.124635+0000","last_undegraded":"2024-04-26T12:09:06.124635+0000","last_fullsized":"2024-04-26T12:09:06.124635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":41160,"num_write":356,"num_write_kb":80219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"60'405","reported_seq":913,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:19.829976+0000","last_change":"2024-04-26T12:10:19.830086+0000","last_active":"2024-04-26T12:10:19.829976+0000","last_peered":"2024-04-26T12:10:19.829976+0000","last_clean":"2024-04-26T12:10:19.829976+0000","last_became_active":"2024-04-26T12:08:46.729039+0000","last_became_peered":"2024-04-26T12:08:46.729039+0000","last_unstale":"2024-04-26T12:10:19.829976+0000","last_undegraded":"2024-04-26T12:10:19.829976+0000","last_fullsized":"2024-04-26T12:10:19.829976+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'405","last_scrub_stamp":"2024-04-26T12:10:19.829953+0000","last_deep_scrub":"60'405","last_deep_scrub_stamp":"2024-04-26T12:10:19.829953+0000","last_clean_scrub_stamp":"2024-04-26T12:10:19.829953+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:57.119919+0000","scrub_duration":0.0018775389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":11674,"num_write":372,"num_write_kb":34604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"60'425","reported_seq":589,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:28.089237+0000","last_change":"2024-04-26T12:09:28.089362+0000","last_active":"2024-04-26T12:09:28.089237+0000","last_peered":"2024-04-26T12:09:28.089237+0000","last_clean":"2024-04-26T12:09:28.089237+0000","last_became_active":"2024-04-26T12:08:41.716014+0000","last_became_peered":"2024-04-26T12:08:41.716014+0000","last_unstale":"2024-04-26T12:09:28.089237+0000","last_undegraded":"2024-04-26T12:09:28.089237+0000","last_fullsized":"2024-04-26T12:09:28.089237+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'425","last_scrub_stamp":"2024-04-26T12:09:28.089215+0000","last_deep_scrub":"60'425","last_deep_scrub_stamp":"2024-04-26T12:09:28.089215+0000","last_clean_scrub_stamp":"2024-04-26T12:09:28.089215+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:31.039189+0000","scrub_duration":0.0021431470000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":48419,"num_write":390,"num_write_kb":92286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"60'372","reported_seq":491,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.124613+0000","last_change":"2024-04-26T12:05:03.791046+0000","last_active":"2024-04-26T12:09:06.124613+0000","last_peered":"2024-04-26T12:09:06.124613+0000","last_clean":"2024-04-26T12:09:06.124613+0000","last_became_active":"2024-04-26T12:05:03.790662+0000","last_became_peered":"2024-04-26T12:05:03.790662+0000","last_unstale":"2024-04-26T12:09:06.124613+0000","last_undegraded":"2024-04-26T12:09:06.124613+0000","last_fullsized":"2024-04-26T12:09:06.124613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25905,"num_write":353,"num_write_kb":75437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'351","reported_seq":438,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:08.024810+0000","last_change":"2024-04-26T12:09:08.024919+0000","last_active":"2024-04-26T12:09:08.024810+0000","last_peered":"2024-04-26T12:09:08.024810+0000","last_clean":"2024-04-26T12:09:08.024810+0000","last_became_active":"2024-04-26T12:08:41.715726+0000","last_became_peered":"2024-04-26T12:08:41.715726+0000","last_unstale":"2024-04-26T12:09:08.024810+0000","last_undegraded":"2024-04-26T12:09:08.024810+0000","last_fullsized":"2024-04-26T12:09:08.024810+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'351","last_scrub_stamp":"2024-04-26T12:09:08.024789+0000","last_deep_scrub":"60'351","last_deep_scrub_stamp":"2024-04-26T12:09:08.024789+0000","last_clean_scrub_stamp":"2024-04-26T12:09:08.024789+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:15.481742+0000","scrub_duration":0.0022688909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8884,"num_write":327,"num_write_kb":58289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"60'405","reported_seq":497,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:19.190020+0000","last_change":"2024-04-26T12:09:19.190112+0000","last_active":"2024-04-26T12:09:19.190020+0000","last_peered":"2024-04-26T12:09:19.190020+0000","last_clean":"2024-04-26T12:09:19.190020+0000","last_became_active":"2024-04-26T12:08:39.702141+0000","last_became_peered":"2024-04-26T12:08:39.702141+0000","last_unstale":"2024-04-26T12:09:19.190020+0000","last_undegraded":"2024-04-26T12:09:19.190020+0000","last_fullsized":"2024-04-26T12:09:19.190020+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'405","last_scrub_stamp":"2024-04-26T12:09:19.189997+0000","last_deep_scrub":"60'405","last_deep_scrub_stamp":"2024-04-26T12:09:19.189997+0000","last_clean_scrub_stamp":"2024-04-26T12:09:19.189997+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:45:38.242862+0000","scrub_duration":0.0019966300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6771,"num_write":372,"num_write_kb":54786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"60'431","reported_seq":950,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:21.555659+0000","last_change":"2024-04-26T12:09:21.555659+0000","last_active":"2024-04-26T12:09:21.555659+0000","last_peered":"2024-04-26T12:09:21.555659+0000","last_clean":"2024-04-26T12:09:21.555659+0000","last_became_active":"2024-04-26T12:08:48.740170+0000","last_became_peered":"2024-04-26T12:08:48.740170+0000","last_unstale":"2024-04-26T12:09:21.555659+0000","last_undegraded":"2024-04-26T12:09:21.555659+0000","last_fullsized":"2024-04-26T12:09:21.555659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'431","last_scrub_stamp":"2024-04-26T12:09:21.555526+0000","last_deep_scrub":"60'431","last_deep_scrub_stamp":"2024-04-26T12:09:21.555526+0000","last_clean_scrub_stamp":"2024-04-26T12:09:21.555526+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:09.119328+0000","scrub_duration":0.0022972299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26572,"num_write":398,"num_write_kb":83974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'394","reported_seq":909,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:35.716715+0000","last_change":"2024-04-26T12:09:35.716715+0000","last_active":"2024-04-26T12:09:35.716715+0000","last_peered":"2024-04-26T12:09:35.716715+0000","last_clean":"2024-04-26T12:09:35.716715+0000","last_became_active":"2024-04-26T12:08:41.715956+0000","last_became_peered":"2024-04-26T12:08:41.715956+0000","last_unstale":"2024-04-26T12:09:35.716715+0000","last_undegraded":"2024-04-26T12:09:35.716715+0000","last_fullsized":"2024-04-26T12:09:35.716715+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'394","last_scrub_stamp":"2024-04-26T12:09:35.716594+0000","last_deep_scrub":"60'394","last_deep_scrub_stamp":"2024-04-26T12:09:35.716594+0000","last_clean_scrub_stamp":"2024-04-26T12:09:35.716594+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:28.908858+0000","scrub_duration":0.0029063209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":38136,"num_write":355,"num_write_kb":38484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'432","reported_seq":556,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:07.460951+0000","last_change":"2024-04-26T12:09:07.460951+0000","last_active":"2024-04-26T12:09:07.460951+0000","last_peered":"2024-04-26T12:09:07.460951+0000","last_clean":"2024-04-26T12:09:07.460951+0000","last_became_active":"2024-04-26T12:05:03.785991+0000","last_became_peered":"2024-04-26T12:05:03.785991+0000","last_unstale":"2024-04-26T12:09:07.460951+0000","last_undegraded":"2024-04-26T12:09:07.460951+0000","last_fullsized":"2024-04-26T12:09:07.460951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'432","last_scrub_stamp":"2024-04-26T12:09:07.460722+0000","last_deep_scrub":"60'432","last_deep_scrub_stamp":"2024-04-26T12:09:07.460722+0000","last_clean_scrub_stamp":"2024-04-26T12:09:07.460722+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:52.118824+0000","scrub_duration":0.0028296200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18244,"num_write":400,"num_write_kb":59033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'381","reported_seq":851,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:30.632857+0000","last_change":"2024-04-26T12:09:30.632857+0000","last_active":"2024-04-26T12:09:30.632857+0000","last_peered":"2024-04-26T12:09:30.632857+0000","last_clean":"2024-04-26T12:09:30.632857+0000","last_became_active":"2024-04-26T12:08:52.745913+0000","last_became_peered":"2024-04-26T12:08:52.745913+0000","last_unstale":"2024-04-26T12:09:30.632857+0000","last_undegraded":"2024-04-26T12:09:30.632857+0000","last_fullsized":"2024-04-26T12:09:30.632857+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'381","last_scrub_stamp":"2024-04-26T12:09:30.632714+0000","last_deep_scrub":"60'381","last_deep_scrub_stamp":"2024-04-26T12:09:30.632714+0000","last_clean_scrub_stamp":"2024-04-26T12:09:30.632714+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:40.099051+0000","scrub_duration":0.001861026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":350,"num_write_kb":21212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"60'424","reported_seq":526,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:25.195300+0000","last_change":"2024-04-26T12:09:25.195412+0000","last_active":"2024-04-26T12:09:25.195300+0000","last_peered":"2024-04-26T12:09:25.195300+0000","last_clean":"2024-04-26T12:09:25.195300+0000","last_became_active":"2024-04-26T12:08:42.716846+0000","last_became_peered":"2024-04-26T12:08:42.716846+0000","last_unstale":"2024-04-26T12:09:25.195300+0000","last_undegraded":"2024-04-26T12:09:25.195300+0000","last_fullsized":"2024-04-26T12:09:25.195300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'424","last_scrub_stamp":"2024-04-26T12:09:25.195279+0000","last_deep_scrub":"60'424","last_deep_scrub_stamp":"2024-04-26T12:09:25.195279+0000","last_clean_scrub_stamp":"2024-04-26T12:09:25.195279+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:09.224012+0000","scrub_duration":0.00220163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13930,"num_write":388,"num_write_kb":116055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'426","reported_seq":918,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:08.468648+0000","last_change":"2024-04-26T12:09:08.468648+0000","last_active":"2024-04-26T12:09:08.468648+0000","last_peered":"2024-04-26T12:09:08.468648+0000","last_clean":"2024-04-26T12:09:08.468648+0000","last_became_active":"2024-04-26T12:08:53.747215+0000","last_became_peered":"2024-04-26T12:08:53.747215+0000","last_unstale":"2024-04-26T12:09:08.468648+0000","last_undegraded":"2024-04-26T12:09:08.468648+0000","last_fullsized":"2024-04-26T12:09:08.468648+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'426","last_scrub_stamp":"2024-04-26T12:09:08.468482+0000","last_deep_scrub":"60'426","last_deep_scrub_stamp":"2024-04-26T12:09:08.468482+0000","last_clean_scrub_stamp":"2024-04-26T12:09:08.468482+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:56.032283+0000","scrub_duration":0.0021666569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26908,"num_write":383,"num_write_kb":71324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"60'425","reported_seq":559,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:08.446169+0000","last_change":"2024-04-26T12:09:08.446169+0000","last_active":"2024-04-26T12:09:08.446169+0000","last_peered":"2024-04-26T12:09:08.446169+0000","last_clean":"2024-04-26T12:09:08.446169+0000","last_became_active":"2024-04-26T12:05:03.791061+0000","last_became_peered":"2024-04-26T12:05:03.791061+0000","last_unstale":"2024-04-26T12:09:08.446169+0000","last_undegraded":"2024-04-26T12:09:08.446169+0000","last_fullsized":"2024-04-26T12:09:08.446169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'425","last_scrub_stamp":"2024-04-26T12:09:08.446023+0000","last_deep_scrub":"60'425","last_deep_scrub_stamp":"2024-04-26T12:09:08.446023+0000","last_clean_scrub_stamp":"2024-04-26T12:09:08.446023+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:29.700242+0000","scrub_duration":0.002826112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19715,"num_write":398,"num_write_kb":30150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'450","reported_seq":651,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:45.764985+0000","last_change":"2024-04-26T12:09:45.765084+0000","last_active":"2024-04-26T12:09:45.764985+0000","last_peered":"2024-04-26T12:09:45.764985+0000","last_clean":"2024-04-26T12:09:45.764985+0000","last_became_active":"2024-04-26T12:05:03.791693+0000","last_became_peered":"2024-04-26T12:05:03.791693+0000","last_unstale":"2024-04-26T12:09:45.764985+0000","last_undegraded":"2024-04-26T12:09:45.764985+0000","last_fullsized":"2024-04-26T12:09:45.764985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'450","last_scrub_stamp":"2024-04-26T12:09:45.764962+0000","last_deep_scrub":"60'450","last_deep_scrub_stamp":"2024-04-26T12:09:45.764962+0000","last_clean_scrub_stamp":"2024-04-26T12:09:45.764962+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:21.995938+0000","scrub_duration":0.002787449,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":65124,"num_write":423,"num_write_kb":142714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'434","reported_seq":550,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:33.944685+0000","last_change":"2024-04-26T12:10:33.944792+0000","last_active":"2024-04-26T12:10:33.944685+0000","last_peered":"2024-04-26T12:10:33.944685+0000","last_clean":"2024-04-26T12:10:33.944685+0000","last_became_active":"2024-04-26T12:08:46.728804+0000","last_became_peered":"2024-04-26T12:08:46.728804+0000","last_unstale":"2024-04-26T12:10:33.944685+0000","last_undegraded":"2024-04-26T12:10:33.944685+0000","last_fullsized":"2024-04-26T12:10:33.944685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'434","last_scrub_stamp":"2024-04-26T12:10:33.944665+0000","last_deep_scrub":"60'434","last_deep_scrub_stamp":"2024-04-26T12:10:33.944665+0000","last_clean_scrub_stamp":"2024-04-26T12:10:33.944665+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:57.652067+0000","scrub_duration":0.0023273069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":15350,"num_write":405,"num_write_kb":59295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"60'424","reported_seq":550,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:09.556371+0000","last_change":"2024-04-26T12:10:09.556503+0000","last_active":"2024-04-26T12:10:09.556371+0000","last_peered":"2024-04-26T12:10:09.556371+0000","last_clean":"2024-04-26T12:10:09.556371+0000","last_became_active":"2024-04-26T12:05:03.788050+0000","last_became_peered":"2024-04-26T12:05:03.788050+0000","last_unstale":"2024-04-26T12:10:09.556371+0000","last_undegraded":"2024-04-26T12:10:09.556371+0000","last_fullsized":"2024-04-26T12:10:09.556371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'424","last_scrub_stamp":"2024-04-26T12:10:09.556349+0000","last_deep_scrub":"60'424","last_deep_scrub_stamp":"2024-04-26T12:10:09.556349+0000","last_clean_scrub_stamp":"2024-04-26T12:10:09.556349+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:05.369051+0000","scrub_duration":0.002611426,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23772,"num_write":390,"num_write_kb":67944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"60'447","reported_seq":539,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:32.921034+0000","last_change":"2024-04-26T12:10:32.921034+0000","last_active":"2024-04-26T12:10:32.921034+0000","last_peered":"2024-04-26T12:10:32.921034+0000","last_clean":"2024-04-26T12:10:32.921034+0000","last_became_active":"2024-04-26T12:08:40.703880+0000","last_became_peered":"2024-04-26T12:08:40.703880+0000","last_unstale":"2024-04-26T12:10:32.921034+0000","last_undegraded":"2024-04-26T12:10:32.921034+0000","last_fullsized":"2024-04-26T12:10:32.921034+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'447","last_scrub_stamp":"2024-04-26T12:10:32.920884+0000","last_deep_scrub":"60'447","last_deep_scrub_stamp":"2024-04-26T12:10:32.920884+0000","last_clean_scrub_stamp":"2024-04-26T12:10:32.920884+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:30.472266+0000","scrub_duration":0.0023715390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9403,"num_write":417,"num_write_kb":67425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"60'417","reported_seq":520,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:26.148378+0000","last_change":"2024-04-26T12:09:26.148378+0000","last_active":"2024-04-26T12:09:26.148378+0000","last_peered":"2024-04-26T12:09:26.148378+0000","last_clean":"2024-04-26T12:09:26.148378+0000","last_became_active":"2024-04-26T12:08:42.715812+0000","last_became_peered":"2024-04-26T12:08:42.715812+0000","last_unstale":"2024-04-26T12:09:26.148378+0000","last_undegraded":"2024-04-26T12:09:26.148378+0000","last_fullsized":"2024-04-26T12:09:26.148378+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'417","last_scrub_stamp":"2024-04-26T12:09:26.148189+0000","last_deep_scrub":"60'417","last_deep_scrub_stamp":"2024-04-26T12:09:26.148189+0000","last_clean_scrub_stamp":"2024-04-26T12:09:26.148189+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:12.073223+0000","scrub_duration":0.001950418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20466,"num_write":400,"num_write_kb":42225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"60'475","reported_seq":617,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.500379+0000","last_change":"2024-04-26T12:09:06.500379+0000","last_active":"2024-04-26T12:09:06.500379+0000","last_peered":"2024-04-26T12:09:06.500379+0000","last_clean":"2024-04-26T12:09:06.500379+0000","last_became_active":"2024-04-26T12:05:03.787562+0000","last_became_peered":"2024-04-26T12:05:03.787562+0000","last_unstale":"2024-04-26T12:09:06.500379+0000","last_undegraded":"2024-04-26T12:09:06.500379+0000","last_fullsized":"2024-04-26T12:09:06.500379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'475","last_scrub_stamp":"2024-04-26T12:09:06.500254+0000","last_deep_scrub":"60'475","last_deep_scrub_stamp":"2024-04-26T12:09:06.500254+0000","last_clean_scrub_stamp":"2024-04-26T12:09:06.500254+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:10.061304+0000","scrub_duration":0.002921515,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25186,"num_write":431,"num_write_kb":48184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"60'409","reported_seq":910,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:43.509832+0000","last_change":"2024-04-26T12:10:43.509971+0000","last_active":"2024-04-26T12:10:43.509832+0000","last_peered":"2024-04-26T12:10:43.509832+0000","last_clean":"2024-04-26T12:10:43.509832+0000","last_became_active":"2024-04-26T12:08:49.740497+0000","last_became_peered":"2024-04-26T12:08:49.740497+0000","last_unstale":"2024-04-26T12:10:43.509832+0000","last_undegraded":"2024-04-26T12:10:43.509832+0000","last_fullsized":"2024-04-26T12:10:43.509832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'409","last_scrub_stamp":"2024-04-26T12:10:43.509794+0000","last_deep_scrub":"60'409","last_deep_scrub_stamp":"2024-04-26T12:10:43.509794+0000","last_clean_scrub_stamp":"2024-04-26T12:10:43.509794+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:12.783359+0000","scrub_duration":0.0024653489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":20137,"num_write":374,"num_write_kb":55441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'392","reported_seq":506,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:47.061102+0000","last_change":"2024-04-26T12:09:47.061102+0000","last_active":"2024-04-26T12:09:47.061102+0000","last_peered":"2024-04-26T12:09:47.061102+0000","last_clean":"2024-04-26T12:09:47.061102+0000","last_became_active":"2024-04-26T12:08:47.735361+0000","last_became_peered":"2024-04-26T12:08:47.735361+0000","last_unstale":"2024-04-26T12:09:47.061102+0000","last_undegraded":"2024-04-26T12:09:47.061102+0000","last_fullsized":"2024-04-26T12:09:47.061102+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'392","last_scrub_stamp":"2024-04-26T12:09:47.060968+0000","last_deep_scrub":"60'392","last_deep_scrub_stamp":"2024-04-26T12:09:47.060968+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.060968+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:04.952295+0000","scrub_duration":0.0023190509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29179,"num_write":355,"num_write_kb":59011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'380","reported_seq":853,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:15.465302+0000","last_change":"2024-04-26T12:09:15.465302+0000","last_active":"2024-04-26T12:09:15.465302+0000","last_peered":"2024-04-26T12:09:15.465302+0000","last_clean":"2024-04-26T12:09:15.465302+0000","last_became_active":"2024-04-26T12:08:41.716234+0000","last_became_peered":"2024-04-26T12:08:41.716234+0000","last_unstale":"2024-04-26T12:09:15.465302+0000","last_undegraded":"2024-04-26T12:09:15.465302+0000","last_fullsized":"2024-04-26T12:09:15.465302+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'380","last_scrub_stamp":"2024-04-26T12:09:15.465164+0000","last_deep_scrub":"60'380","last_deep_scrub_stamp":"2024-04-26T12:09:15.465164+0000","last_clean_scrub_stamp":"2024-04-26T12:09:15.465164+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:49.168939+0000","scrub_duration":0.0024038250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13036,"num_write":347,"num_write_kb":33880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"60'461","reported_seq":578,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:10.990934+0000","last_change":"2024-04-26T12:09:10.990934+0000","last_active":"2024-04-26T12:09:10.990934+0000","last_peered":"2024-04-26T12:09:10.990934+0000","last_clean":"2024-04-26T12:09:10.990934+0000","last_became_active":"2024-04-26T12:08:46.730738+0000","last_became_peered":"2024-04-26T12:08:46.730738+0000","last_unstale":"2024-04-26T12:09:10.990934+0000","last_undegraded":"2024-04-26T12:09:10.990934+0000","last_fullsized":"2024-04-26T12:09:10.990934+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'461","last_scrub_stamp":"2024-04-26T12:09:10.990803+0000","last_deep_scrub":"60'461","last_deep_scrub_stamp":"2024-04-26T12:09:10.990803+0000","last_clean_scrub_stamp":"2024-04-26T12:09:10.990803+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:12.887104+0000","scrub_duration":0.0025321039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":32945,"num_write":426,"num_write_kb":63234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"60'411","reported_seq":914,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:43.659197+0000","last_change":"2024-04-26T12:09:43.659295+0000","last_active":"2024-04-26T12:09:43.659197+0000","last_peered":"2024-04-26T12:09:43.659197+0000","last_clean":"2024-04-26T12:09:43.659197+0000","last_became_active":"2024-04-26T12:08:40.703845+0000","last_became_peered":"2024-04-26T12:08:40.703845+0000","last_unstale":"2024-04-26T12:09:43.659197+0000","last_undegraded":"2024-04-26T12:09:43.659197+0000","last_fullsized":"2024-04-26T12:09:43.659197+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'411","last_scrub_stamp":"2024-04-26T12:09:43.659173+0000","last_deep_scrub":"60'411","last_deep_scrub_stamp":"2024-04-26T12:09:43.659173+0000","last_clean_scrub_stamp":"2024-04-26T12:09:43.659173+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:23.114338+0000","scrub_duration":0.002345588,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11499,"num_write":377,"num_write_kb":34249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'430","reported_seq":551,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:11.555369+0000","last_change":"2024-04-26T12:10:11.555537+0000","last_active":"2024-04-26T12:10:11.555369+0000","last_peered":"2024-04-26T12:10:11.555369+0000","last_clean":"2024-04-26T12:10:11.555369+0000","last_became_active":"2024-04-26T12:05:03.791251+0000","last_became_peered":"2024-04-26T12:05:03.791251+0000","last_unstale":"2024-04-26T12:10:11.555369+0000","last_undegraded":"2024-04-26T12:10:11.555369+0000","last_fullsized":"2024-04-26T12:10:11.555369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'430","last_scrub_stamp":"2024-04-26T12:10:11.555345+0000","last_deep_scrub":"60'430","last_deep_scrub_stamp":"2024-04-26T12:10:11.555345+0000","last_clean_scrub_stamp":"2024-04-26T12:10:11.555345+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:09.743398+0000","scrub_duration":0.0028183980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14660,"num_write":404,"num_write_kb":60840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"60'392","reported_seq":512,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:25.976248+0000","last_change":"2024-04-26T12:10:25.976346+0000","last_active":"2024-04-26T12:10:25.976248+0000","last_peered":"2024-04-26T12:10:25.976248+0000","last_clean":"2024-04-26T12:10:25.976248+0000","last_became_active":"2024-04-26T12:08:44.722120+0000","last_became_peered":"2024-04-26T12:08:44.722120+0000","last_unstale":"2024-04-26T12:10:25.976248+0000","last_undegraded":"2024-04-26T12:10:25.976248+0000","last_fullsized":"2024-04-26T12:10:25.976248+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'392","last_scrub_stamp":"2024-04-26T12:10:25.976225+0000","last_deep_scrub":"60'392","last_deep_scrub_stamp":"2024-04-26T12:10:25.976225+0000","last_clean_scrub_stamp":"2024-04-26T12:10:25.976225+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:30.313655+0000","scrub_duration":0.0024233079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31703,"num_write":351,"num_write_kb":59324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"84'518","reported_seq":609,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:56.653065+0000","last_change":"2024-04-26T12:09:56.653170+0000","last_active":"2024-04-26T12:09:56.653065+0000","last_peered":"2024-04-26T12:09:56.653065+0000","last_clean":"2024-04-26T12:09:56.653065+0000","last_became_active":"2024-04-26T12:05:03.429695+0000","last_became_peered":"2024-04-26T12:05:03.429695+0000","last_unstale":"2024-04-26T12:09:56.653065+0000","last_undegraded":"2024-04-26T12:09:56.653065+0000","last_fullsized":"2024-04-26T12:09:56.653065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'518","last_scrub_stamp":"2024-04-26T12:09:56.653042+0000","last_deep_scrub":"84'518","last_deep_scrub_stamp":"2024-04-26T12:09:56.653042+0000","last_clean_scrub_stamp":"2024-04-26T12:09:56.653042+0000","objects_scrubbed":4,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:18.886927+0000","scrub_duration":0.02530226,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":8377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'432","reported_seq":534,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:52.096388+0000","last_change":"2024-04-26T12:09:52.096505+0000","last_active":"2024-04-26T12:09:52.096388+0000","last_peered":"2024-04-26T12:09:52.096388+0000","last_clean":"2024-04-26T12:09:52.096388+0000","last_became_active":"2024-04-26T12:08:53.748972+0000","last_became_peered":"2024-04-26T12:08:53.748972+0000","last_unstale":"2024-04-26T12:09:52.096388+0000","last_undegraded":"2024-04-26T12:09:52.096388+0000","last_fullsized":"2024-04-26T12:09:52.096388+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'432","last_scrub_stamp":"2024-04-26T12:09:52.096365+0000","last_deep_scrub":"60'432","last_deep_scrub_stamp":"2024-04-26T12:09:52.096365+0000","last_clean_scrub_stamp":"2024-04-26T12:09:52.096365+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:25.671316+0000","scrub_duration":0.0023424370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":30094,"num_write":388,"num_write_kb":83741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"59'55","reported_seq":146,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:34.731942+0000","last_change":"2024-04-26T12:09:34.731942+0000","last_active":"2024-04-26T12:09:34.731942+0000","last_peered":"2024-04-26T12:09:34.731942+0000","last_clean":"2024-04-26T12:09:34.731942+0000","last_became_active":"2024-04-26T12:05:03.428098+0000","last_became_peered":"2024-04-26T12:05:03.428098+0000","last_unstale":"2024-04-26T12:09:34.731942+0000","last_undegraded":"2024-04-26T12:09:34.731942+0000","last_fullsized":"2024-04-26T12:09:34.731942+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'55","last_scrub_stamp":"2024-04-26T12:09:34.731815+0000","last_deep_scrub":"59'55","last_deep_scrub_stamp":"2024-04-26T12:09:34.731815+0000","last_clean_scrub_stamp":"2024-04-26T12:09:34.731815+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:35.655136+0000","scrub_duration":0.0016482490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"60'445","reported_seq":570,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:07.498568+0000","last_change":"2024-04-26T12:09:07.498568+0000","last_active":"2024-04-26T12:09:07.498568+0000","last_peered":"2024-04-26T12:09:07.498568+0000","last_clean":"2024-04-26T12:09:07.498568+0000","last_became_active":"2024-04-26T12:05:03.788039+0000","last_became_peered":"2024-04-26T12:05:03.788039+0000","last_unstale":"2024-04-26T12:09:07.498568+0000","last_undegraded":"2024-04-26T12:09:07.498568+0000","last_fullsized":"2024-04-26T12:09:07.498568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'445","last_scrub_stamp":"2024-04-26T12:09:07.498444+0000","last_deep_scrub":"60'445","last_deep_scrub_stamp":"2024-04-26T12:09:07.498444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:07.498444+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:34:55.801469+0000","scrub_duration":0.002448759,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":16079,"num_write":410,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"59'64","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:23.224837+0000","last_change":"2024-04-26T12:09:23.224938+0000","last_active":"2024-04-26T12:09:23.224837+0000","last_peered":"2024-04-26T12:09:23.224837+0000","last_clean":"2024-04-26T12:09:23.224837+0000","last_became_active":"2024-04-26T12:08:36.694921+0000","last_became_peered":"2024-04-26T12:08:36.694921+0000","last_unstale":"2024-04-26T12:09:23.224837+0000","last_undegraded":"2024-04-26T12:09:23.224837+0000","last_fullsized":"2024-04-26T12:09:23.224837+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'64","last_scrub_stamp":"2024-04-26T12:09:23.224815+0000","last_deep_scrub":"59'64","last_deep_scrub_stamp":"2024-04-26T12:09:23.224815+0000","last_clean_scrub_stamp":"2024-04-26T12:09:23.224815+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:34.040977+0000","scrub_duration":0.0015803169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"60'420","reported_seq":550,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:17.735411+0000","last_change":"2024-04-26T12:10:17.735525+0000","last_active":"2024-04-26T12:10:17.735411+0000","last_peered":"2024-04-26T12:10:17.735411+0000","last_clean":"2024-04-26T12:10:17.735411+0000","last_became_active":"2024-04-26T12:05:03.788184+0000","last_became_peered":"2024-04-26T12:05:03.788184+0000","last_unstale":"2024-04-26T12:10:17.735411+0000","last_undegraded":"2024-04-26T12:10:17.735411+0000","last_fullsized":"2024-04-26T12:10:17.735411+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'420","last_scrub_stamp":"2024-04-26T12:10:17.735388+0000","last_deep_scrub":"60'420","last_deep_scrub_stamp":"2024-04-26T12:10:17.735388+0000","last_clean_scrub_stamp":"2024-04-26T12:10:17.735388+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:44:01.060779+0000","scrub_duration":0.0022698190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":14666,"num_write":383,"num_write_kb":83769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"84'67","reported_seq":172,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:30.700334+0000","last_change":"2024-04-26T12:10:30.700440+0000","last_active":"2024-04-26T12:10:30.700334+0000","last_peered":"2024-04-26T12:10:30.700334+0000","last_clean":"2024-04-26T12:10:30.700334+0000","last_became_active":"2024-04-26T12:08:36.696792+0000","last_became_peered":"2024-04-26T12:08:36.696792+0000","last_unstale":"2024-04-26T12:10:30.700334+0000","last_undegraded":"2024-04-26T12:10:30.700334+0000","last_fullsized":"2024-04-26T12:10:30.700334+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'67","last_scrub_stamp":"2024-04-26T12:10:30.700312+0000","last_deep_scrub":"84'67","last_deep_scrub_stamp":"2024-04-26T12:10:30.700312+0000","last_clean_scrub_stamp":"2024-04-26T12:10:30.700312+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:32:44.053255+0000","scrub_duration":0.0092870810000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"84'234","reported_seq":350,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:00.696683+0000","last_change":"2024-04-26T12:10:00.696834+0000","last_active":"2024-04-26T12:10:00.696683+0000","last_peered":"2024-04-26T12:10:00.696683+0000","last_clean":"2024-04-26T12:10:00.696683+0000","last_became_active":"2024-04-26T12:08:39.703455+0000","last_became_peered":"2024-04-26T12:08:39.703455+0000","last_unstale":"2024-04-26T12:10:00.696683+0000","last_undegraded":"2024-04-26T12:10:00.696683+0000","last_fullsized":"2024-04-26T12:10:00.696683+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'234","last_scrub_stamp":"2024-04-26T12:10:00.696661+0000","last_deep_scrub":"84'234","last_deep_scrub_stamp":"2024-04-26T12:10:00.696661+0000","last_clean_scrub_stamp":"2024-04-26T12:10:00.696661+0000","objects_scrubbed":2,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:40.151826+0000","scrub_duration":0.014858877,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'408","reported_seq":493,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:05.683825+0000","last_change":"2024-04-26T12:08:40.710236+0000","last_active":"2024-04-26T12:09:05.683825+0000","last_peered":"2024-04-26T12:09:05.683825+0000","last_clean":"2024-04-26T12:09:05.683825+0000","last_became_active":"2024-04-26T12:08:40.707357+0000","last_became_peered":"2024-04-26T12:08:40.707357+0000","last_unstale":"2024-04-26T12:09:05.683825+0000","last_undegraded":"2024-04-26T12:09:05.683825+0000","last_fullsized":"2024-04-26T12:09:05.683825+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:05:03.412630+0000","last_clean_scrub_stamp":"2024-04-26T12:05:03.412630+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12418,"num_write":371,"num_write_kb":58378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"84'304","reported_seq":384,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:57.079608+0000","last_change":"2024-04-26T12:09:57.079715+0000","last_active":"2024-04-26T12:09:57.079608+0000","last_peered":"2024-04-26T12:09:57.079608+0000","last_clean":"2024-04-26T12:09:57.079608+0000","last_became_active":"2024-04-26T12:08:39.703421+0000","last_became_peered":"2024-04-26T12:08:39.703421+0000","last_unstale":"2024-04-26T12:09:57.079608+0000","last_undegraded":"2024-04-26T12:09:57.079608+0000","last_fullsized":"2024-04-26T12:09:57.079608+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'304","last_scrub_stamp":"2024-04-26T12:09:57.079584+0000","last_deep_scrub":"84'304","last_deep_scrub_stamp":"2024-04-26T12:09:57.079584+0000","last_clean_scrub_stamp":"2024-04-26T12:09:57.079584+0000","objects_scrubbed":2,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:49.321329+0000","scrub_duration":0.016873233000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":4228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'439","reported_seq":511,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:11.912239+0000","last_change":"2024-04-26T12:10:11.912239+0000","last_active":"2024-04-26T12:10:11.912239+0000","last_peered":"2024-04-26T12:10:11.912239+0000","last_clean":"2024-04-26T12:10:11.912239+0000","last_became_active":"2024-04-26T12:08:41.715708+0000","last_became_peered":"2024-04-26T12:08:41.715708+0000","last_unstale":"2024-04-26T12:10:11.912239+0000","last_undegraded":"2024-04-26T12:10:11.912239+0000","last_fullsized":"2024-04-26T12:10:11.912239+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'439","last_scrub_stamp":"2024-04-26T12:10:11.912130+0000","last_deep_scrub":"60'439","last_deep_scrub_stamp":"2024-04-26T12:10:11.912130+0000","last_clean_scrub_stamp":"2024-04-26T12:10:11.912130+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:56.110904+0000","scrub_duration":0.001792173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":30851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"84'591","reported_seq":707,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:39.824129+0000","last_change":"2024-04-26T12:09:39.824222+0000","last_active":"2024-04-26T12:09:39.824129+0000","last_peered":"2024-04-26T12:09:39.824129+0000","last_clean":"2024-04-26T12:09:39.824129+0000","last_became_active":"2024-04-26T12:08:39.703487+0000","last_became_peered":"2024-04-26T12:08:39.703487+0000","last_unstale":"2024-04-26T12:09:39.824129+0000","last_undegraded":"2024-04-26T12:09:39.824129+0000","last_fullsized":"2024-04-26T12:09:39.824129+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'591","last_scrub_stamp":"2024-04-26T12:09:39.824106+0000","last_deep_scrub":"84'591","last_deep_scrub_stamp":"2024-04-26T12:09:39.824106+0000","last_clean_scrub_stamp":"2024-04-26T12:09:39.824106+0000","objects_scrubbed":2,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:04.327252+0000","scrub_duration":0.019073356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":534,"num_write_kb":4333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'461","reported_seq":627,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:39.610336+0000","last_change":"2024-04-26T12:10:39.610438+0000","last_active":"2024-04-26T12:10:39.610336+0000","last_peered":"2024-04-26T12:10:39.610336+0000","last_clean":"2024-04-26T12:10:39.610336+0000","last_became_active":"2024-04-26T12:05:03.791272+0000","last_became_peered":"2024-04-26T12:05:03.791272+0000","last_unstale":"2024-04-26T12:10:39.610336+0000","last_undegraded":"2024-04-26T12:10:39.610336+0000","last_fullsized":"2024-04-26T12:10:39.610336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'461","last_scrub_stamp":"2024-04-26T12:10:39.610313+0000","last_deep_scrub":"60'461","last_deep_scrub_stamp":"2024-04-26T12:10:39.610313+0000","last_clean_scrub_stamp":"2024-04-26T12:10:39.610313+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:16.900279+0000","scrub_duration":0.0032001740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":46123,"num_write":422,"num_write_kb":104552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'66","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:10.526380+0000","last_change":"2024-04-26T12:10:10.526479+0000","last_active":"2024-04-26T12:10:10.526380+0000","last_peered":"2024-04-26T12:10:10.526380+0000","last_clean":"2024-04-26T12:10:10.526380+0000","last_became_active":"2024-04-26T12:05:03.429291+0000","last_became_peered":"2024-04-26T12:05:03.429291+0000","last_unstale":"2024-04-26T12:10:10.526380+0000","last_undegraded":"2024-04-26T12:10:10.526380+0000","last_fullsized":"2024-04-26T12:10:10.526380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'66","last_scrub_stamp":"2024-04-26T12:10:10.526357+0000","last_deep_scrub":"59'66","last_deep_scrub_stamp":"2024-04-26T12:10:10.526357+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.526357+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:22.596661+0000","scrub_duration":0.0016798259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'428","reported_seq":554,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:41.623180+0000","last_change":"2024-04-26T12:09:41.623284+0000","last_active":"2024-04-26T12:09:41.623180+0000","last_peered":"2024-04-26T12:09:41.623180+0000","last_clean":"2024-04-26T12:09:41.623180+0000","last_became_active":"2024-04-26T12:05:03.787772+0000","last_became_peered":"2024-04-26T12:05:03.787772+0000","last_unstale":"2024-04-26T12:09:41.623180+0000","last_undegraded":"2024-04-26T12:09:41.623180+0000","last_fullsized":"2024-04-26T12:09:41.623180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'428","last_scrub_stamp":"2024-04-26T12:09:41.623156+0000","last_deep_scrub":"60'428","last_deep_scrub_stamp":"2024-04-26T12:09:41.623156+0000","last_clean_scrub_stamp":"2024-04-26T12:09:41.623156+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:27.740926+0000","scrub_duration":0.0027090880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15098,"num_write":394,"num_write_kb":42677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"84'198","reported_seq":289,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:56.557371+0000","last_change":"2024-04-26T12:09:56.557500+0000","last_active":"2024-04-26T12:09:56.557371+0000","last_peered":"2024-04-26T12:09:56.557371+0000","last_clean":"2024-04-26T12:09:56.557371+0000","last_became_active":"2024-04-26T12:05:03.430855+0000","last_became_peered":"2024-04-26T12:05:03.430855+0000","last_unstale":"2024-04-26T12:09:56.557371+0000","last_undegraded":"2024-04-26T12:09:56.557371+0000","last_fullsized":"2024-04-26T12:09:56.557371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'198","last_scrub_stamp":"2024-04-26T12:09:56.557334+0000","last_deep_scrub":"84'198","last_deep_scrub_stamp":"2024-04-26T12:09:56.557334+0000","last_clean_scrub_stamp":"2024-04-26T12:09:56.557334+0000","objects_scrubbed":3,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:47.167351+0000","scrub_duration":0.021508201000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"60'448","reported_seq":557,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:58.706684+0000","last_change":"2024-04-26T12:09:58.706808+0000","last_active":"2024-04-26T12:09:58.706684+0000","last_peered":"2024-04-26T12:09:58.706684+0000","last_clean":"2024-04-26T12:09:58.706684+0000","last_became_active":"2024-04-26T12:05:03.792119+0000","last_became_peered":"2024-04-26T12:05:03.792119+0000","last_unstale":"2024-04-26T12:09:58.706684+0000","last_undegraded":"2024-04-26T12:09:58.706684+0000","last_fullsized":"2024-04-26T12:09:58.706684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'448","last_scrub_stamp":"2024-04-26T12:09:58.706659+0000","last_deep_scrub":"60'448","last_deep_scrub_stamp":"2024-04-26T12:09:58.706659+0000","last_clean_scrub_stamp":"2024-04-26T12:09:58.706659+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:56.343142+0000","scrub_duration":0.0026622880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":13281,"num_write":420,"num_write_kb":59540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"84'172","reported_seq":263,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:35.685420+0000","last_change":"2024-04-26T12:10:35.685528+0000","last_active":"2024-04-26T12:10:35.685420+0000","last_peered":"2024-04-26T12:10:35.685420+0000","last_clean":"2024-04-26T12:10:35.685420+0000","last_became_active":"2024-04-26T12:05:03.429469+0000","last_became_peered":"2024-04-26T12:05:03.429469+0000","last_unstale":"2024-04-26T12:10:35.685420+0000","last_undegraded":"2024-04-26T12:10:35.685420+0000","last_fullsized":"2024-04-26T12:10:35.685420+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'172","last_scrub_stamp":"2024-04-26T12:10:35.685398+0000","last_deep_scrub":"84'172","last_deep_scrub_stamp":"2024-04-26T12:10:35.685398+0000","last_clean_scrub_stamp":"2024-04-26T12:10:35.685398+0000","objects_scrubbed":1,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:47.794305+0000","scrub_duration":0.012639202,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'412","reported_seq":936,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:17.500764+0000","last_change":"2024-04-26T12:09:17.500764+0000","last_active":"2024-04-26T12:09:17.500764+0000","last_peered":"2024-04-26T12:09:17.500764+0000","last_clean":"2024-04-26T12:09:17.500764+0000","last_became_active":"2024-04-26T12:08:51.751044+0000","last_became_peered":"2024-04-26T12:08:51.751044+0000","last_unstale":"2024-04-26T12:09:17.500764+0000","last_undegraded":"2024-04-26T12:09:17.500764+0000","last_fullsized":"2024-04-26T12:09:17.500764+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'412","last_scrub_stamp":"2024-04-26T12:09:17.500623+0000","last_deep_scrub":"60'412","last_deep_scrub_stamp":"2024-04-26T12:09:17.500623+0000","last_clean_scrub_stamp":"2024-04-26T12:09:17.500623+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:05.606930+0000","scrub_duration":0.0024460179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26310,"num_write":380,"num_write_kb":38462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"59'55","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:12.951850+0000","last_change":"2024-04-26T12:10:12.951850+0000","last_active":"2024-04-26T12:10:12.951850+0000","last_peered":"2024-04-26T12:10:12.951850+0000","last_clean":"2024-04-26T12:10:12.951850+0000","last_became_active":"2024-04-26T12:08:36.694346+0000","last_became_peered":"2024-04-26T12:08:36.694346+0000","last_unstale":"2024-04-26T12:10:12.951850+0000","last_undegraded":"2024-04-26T12:10:12.951850+0000","last_fullsized":"2024-04-26T12:10:12.951850+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'55","last_scrub_stamp":"2024-04-26T12:10:12.951726+0000","last_deep_scrub":"59'55","last_deep_scrub_stamp":"2024-04-26T12:10:12.951726+0000","last_clean_scrub_stamp":"2024-04-26T12:10:12.951726+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:34.042702+0000","scrub_duration":0.0020193070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"60'362","reported_seq":830,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:07.539506+0000","last_change":"2024-04-26T12:10:07.539641+0000","last_active":"2024-04-26T12:10:07.539506+0000","last_peered":"2024-04-26T12:10:07.539506+0000","last_clean":"2024-04-26T12:10:07.539506+0000","last_became_active":"2024-04-26T12:08:41.716102+0000","last_became_peered":"2024-04-26T12:08:41.716102+0000","last_unstale":"2024-04-26T12:10:07.539506+0000","last_undegraded":"2024-04-26T12:10:07.539506+0000","last_fullsized":"2024-04-26T12:10:07.539506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'362","last_scrub_stamp":"2024-04-26T12:10:07.539483+0000","last_deep_scrub":"60'362","last_deep_scrub_stamp":"2024-04-26T12:10:07.539483+0000","last_clean_scrub_stamp":"2024-04-26T12:10:07.539483+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:41.491924+0000","scrub_duration":0.0023643050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21408,"num_write":333,"num_write_kb":66549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"84'379","reported_seq":453,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:39.799310+0000","last_change":"2024-04-26T12:10:39.799310+0000","last_active":"2024-04-26T12:10:39.799310+0000","last_peered":"2024-04-26T12:10:39.799310+0000","last_clean":"2024-04-26T12:10:39.799310+0000","last_became_active":"2024-04-26T12:08:39.702438+0000","last_became_peered":"2024-04-26T12:08:39.702438+0000","last_unstale":"2024-04-26T12:10:39.799310+0000","last_undegraded":"2024-04-26T12:10:39.799310+0000","last_fullsized":"2024-04-26T12:10:39.799310+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'379","last_scrub_stamp":"2024-04-26T12:10:39.799182+0000","last_deep_scrub":"84'379","last_deep_scrub_stamp":"2024-04-26T12:10:39.799182+0000","last_clean_scrub_stamp":"2024-04-26T12:10:39.799182+0000","objects_scrubbed":1,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:32.371755+0000","scrub_duration":0.017525066999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"60'407","reported_seq":930,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:15.702685+0000","last_change":"2024-04-26T12:10:15.702794+0000","last_active":"2024-04-26T12:10:15.702685+0000","last_peered":"2024-04-26T12:10:15.702685+0000","last_clean":"2024-04-26T12:10:15.702685+0000","last_became_active":"2024-04-26T12:08:45.723772+0000","last_became_peered":"2024-04-26T12:08:45.723772+0000","last_unstale":"2024-04-26T12:10:15.702685+0000","last_undegraded":"2024-04-26T12:10:15.702685+0000","last_fullsized":"2024-04-26T12:10:15.702685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'407","last_scrub_stamp":"2024-04-26T12:10:15.702660+0000","last_deep_scrub":"60'407","last_deep_scrub_stamp":"2024-04-26T12:10:15.702660+0000","last_clean_scrub_stamp":"2024-04-26T12:10:15.702660+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:27.811568+0000","scrub_duration":0.0020706520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":40156,"num_write":373,"num_write_kb":91285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"84'159","reported_seq":308,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:22.613155+0000","last_change":"2024-04-26T12:10:22.613268+0000","last_active":"2024-04-26T12:10:22.613155+0000","last_peered":"2024-04-26T12:10:22.613155+0000","last_clean":"2024-04-26T12:10:22.613155+0000","last_became_active":"2024-04-26T12:08:36.697508+0000","last_became_peered":"2024-04-26T12:08:36.697508+0000","last_unstale":"2024-04-26T12:10:22.613155+0000","last_undegraded":"2024-04-26T12:10:22.613155+0000","last_fullsized":"2024-04-26T12:10:22.613155+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'159","last_scrub_stamp":"2024-04-26T12:10:22.613133+0000","last_deep_scrub":"84'159","last_deep_scrub_stamp":"2024-04-26T12:10:22.613133+0000","last_clean_scrub_stamp":"2024-04-26T12:10:22.613133+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:47.395680+0000","scrub_duration":0.0046459420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":94,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:24.620738+0000","last_change":"2024-04-26T12:10:24.620835+0000","last_active":"2024-04-26T12:10:24.620738+0000","last_peered":"2024-04-26T12:10:24.620738+0000","last_clean":"2024-04-26T12:10:24.620738+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:10:24.620738+0000","last_undegraded":"2024-04-26T12:10:24.620738+0000","last_fullsized":"2024-04-26T12:10:24.620738+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:24.620718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:24.620718+0000","last_clean_scrub_stamp":"2024-04-26T12:10:24.620718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:47.548783+0000","scrub_duration":0.0019450089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"84'795","reported_seq":912,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:02.576016+0000","last_change":"2024-04-26T12:10:02.576130+0000","last_active":"2024-04-26T12:10:02.576016+0000","last_peered":"2024-04-26T12:10:02.576016+0000","last_clean":"2024-04-26T12:10:02.576016+0000","last_became_active":"2024-04-26T12:08:39.701760+0000","last_became_peered":"2024-04-26T12:08:39.701760+0000","last_unstale":"2024-04-26T12:10:02.576016+0000","last_undegraded":"2024-04-26T12:10:02.576016+0000","last_fullsized":"2024-04-26T12:10:02.576016+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'795","last_scrub_stamp":"2024-04-26T12:10:02.575986+0000","last_deep_scrub":"84'795","last_deep_scrub_stamp":"2024-04-26T12:10:02.575986+0000","last_clean_scrub_stamp":"2024-04-26T12:10:02.575986+0000","objects_scrubbed":2,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:07.133416+0000","scrub_duration":0.029735391,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":8533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"60'466","reported_seq":1025,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:03.603760+0000","last_change":"2024-04-26T12:10:03.603869+0000","last_active":"2024-04-26T12:10:03.603760+0000","last_peered":"2024-04-26T12:10:03.603760+0000","last_clean":"2024-04-26T12:10:03.603760+0000","last_became_active":"2024-04-26T12:08:52.746147+0000","last_became_peered":"2024-04-26T12:08:52.746147+0000","last_unstale":"2024-04-26T12:10:03.603760+0000","last_undegraded":"2024-04-26T12:10:03.603760+0000","last_fullsized":"2024-04-26T12:10:03.603760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'466","last_scrub_stamp":"2024-04-26T12:10:03.603739+0000","last_deep_scrub":"60'466","last_deep_scrub_stamp":"2024-04-26T12:10:03.603739+0000","last_clean_scrub_stamp":"2024-04-26T12:10:03.603739+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:57.843220+0000","scrub_duration":0.001899956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":37547,"num_write":422,"num_write_kb":96579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":107,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:23.659880+0000","last_change":"2024-04-26T12:10:23.660004+0000","last_active":"2024-04-26T12:10:23.659880+0000","last_peered":"2024-04-26T12:10:23.659880+0000","last_clean":"2024-04-26T12:10:23.659880+0000","last_became_active":"2024-04-26T12:08:36.695444+0000","last_became_peered":"2024-04-26T12:08:36.695444+0000","last_unstale":"2024-04-26T12:10:23.659880+0000","last_undegraded":"2024-04-26T12:10:23.659880+0000","last_fullsized":"2024-04-26T12:10:23.659880+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:23.659860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:23.659860+0000","last_clean_scrub_stamp":"2024-04-26T12:10:23.659860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:06.398224+0000","scrub_duration":0.001542444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"84'115","reported_seq":253,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:03.595427+0000","last_change":"2024-04-26T12:10:03.595540+0000","last_active":"2024-04-26T12:10:03.595427+0000","last_peered":"2024-04-26T12:10:03.595427+0000","last_clean":"2024-04-26T12:10:03.595427+0000","last_became_active":"2024-04-26T12:05:03.427985+0000","last_became_peered":"2024-04-26T12:05:03.427985+0000","last_unstale":"2024-04-26T12:10:03.595427+0000","last_undegraded":"2024-04-26T12:10:03.595427+0000","last_fullsized":"2024-04-26T12:10:03.595427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'115","last_scrub_stamp":"2024-04-26T12:10:03.595404+0000","last_deep_scrub":"84'115","last_deep_scrub_stamp":"2024-04-26T12:10:03.595404+0000","last_clean_scrub_stamp":"2024-04-26T12:10:03.595404+0000","objects_scrubbed":1,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:28.377952+0000","scrub_duration":0.0064998820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466015,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":47,"num_write_kb":1464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"60'492","reported_seq":668,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.067244+0000","last_change":"2024-04-26T12:09:06.067244+0000","last_active":"2024-04-26T12:09:06.067244+0000","last_peered":"2024-04-26T12:09:06.067244+0000","last_clean":"2024-04-26T12:09:06.067244+0000","last_became_active":"2024-04-26T12:08:49.739496+0000","last_became_peered":"2024-04-26T12:08:49.739496+0000","last_unstale":"2024-04-26T12:09:06.067244+0000","last_undegraded":"2024-04-26T12:09:06.067244+0000","last_fullsized":"2024-04-26T12:09:06.067244+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'492","last_scrub_stamp":"2024-04-26T12:09:06.067102+0000","last_deep_scrub":"60'492","last_deep_scrub_stamp":"2024-04-26T12:09:06.067102+0000","last_clean_scrub_stamp":"2024-04-26T12:09:06.067102+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:55.504447+0000","scrub_duration":0.0024880229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":63988,"num_write":466,"num_write_kb":154489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":107,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.552902+0000","last_change":"2024-04-26T12:09:50.553084+0000","last_active":"2024-04-26T12:09:50.552902+0000","last_peered":"2024-04-26T12:09:50.552902+0000","last_clean":"2024-04-26T12:09:50.552902+0000","last_became_active":"2024-04-26T12:08:36.696619+0000","last_became_peered":"2024-04-26T12:08:36.696619+0000","last_unstale":"2024-04-26T12:09:50.552902+0000","last_undegraded":"2024-04-26T12:09:50.552902+0000","last_fullsized":"2024-04-26T12:09:50.552902+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:50.552881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:50.552881+0000","last_clean_scrub_stamp":"2024-04-26T12:09:50.552881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:13:20.480035+0000","scrub_duration":0.0016118110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"84'327","reported_seq":401,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:07.902637+0000","last_change":"2024-04-26T12:10:07.902637+0000","last_active":"2024-04-26T12:10:07.902637+0000","last_peered":"2024-04-26T12:10:07.902637+0000","last_clean":"2024-04-26T12:10:07.902637+0000","last_became_active":"2024-04-26T12:08:39.703696+0000","last_became_peered":"2024-04-26T12:08:39.703696+0000","last_unstale":"2024-04-26T12:10:07.902637+0000","last_undegraded":"2024-04-26T12:10:07.902637+0000","last_fullsized":"2024-04-26T12:10:07.902637+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'327","last_scrub_stamp":"2024-04-26T12:10:07.902515+0000","last_deep_scrub":"84'327","last_deep_scrub_stamp":"2024-04-26T12:10:07.902515+0000","last_clean_scrub_stamp":"2024-04-26T12:10:07.902515+0000","objects_scrubbed":2,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:16:41.523454+0000","scrub_duration":0.023057502000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":8296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"60'359","reported_seq":798,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:06.542350+0000","last_change":"2024-04-26T12:10:06.542462+0000","last_active":"2024-04-26T12:10:06.542350+0000","last_peered":"2024-04-26T12:10:06.542350+0000","last_clean":"2024-04-26T12:10:06.542350+0000","last_became_active":"2024-04-26T12:08:47.735729+0000","last_became_peered":"2024-04-26T12:08:47.735729+0000","last_unstale":"2024-04-26T12:10:06.542350+0000","last_undegraded":"2024-04-26T12:10:06.542350+0000","last_fullsized":"2024-04-26T12:10:06.542350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'359","last_scrub_stamp":"2024-04-26T12:10:06.542328+0000","last_deep_scrub":"60'359","last_deep_scrub_stamp":"2024-04-26T12:10:06.542328+0000","last_clean_scrub_stamp":"2024-04-26T12:10:06.542328+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:41.474767+0000","scrub_duration":0.0022812959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9448,"num_write":336,"num_write_kb":74900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":94,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:26.662714+0000","last_change":"2024-04-26T12:10:26.662855+0000","last_active":"2024-04-26T12:10:26.662714+0000","last_peered":"2024-04-26T12:10:26.662714+0000","last_clean":"2024-04-26T12:10:26.662714+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:10:26.662714+0000","last_undegraded":"2024-04-26T12:10:26.662714+0000","last_fullsized":"2024-04-26T12:10:26.662714+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:26.662694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:26.662694+0000","last_clean_scrub_stamp":"2024-04-26T12:10:26.662694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:01.595134+0000","scrub_duration":0.001544695,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"59'67","reported_seq":158,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:37.605616+0000","last_change":"2024-04-26T12:10:37.605715+0000","last_active":"2024-04-26T12:10:37.605616+0000","last_peered":"2024-04-26T12:10:37.605616+0000","last_clean":"2024-04-26T12:10:37.605616+0000","last_became_active":"2024-04-26T12:05:03.429838+0000","last_became_peered":"2024-04-26T12:05:03.429838+0000","last_unstale":"2024-04-26T12:10:37.605616+0000","last_undegraded":"2024-04-26T12:10:37.605616+0000","last_fullsized":"2024-04-26T12:10:37.605616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'67","last_scrub_stamp":"2024-04-26T12:10:37.605593+0000","last_deep_scrub":"59'67","last_deep_scrub_stamp":"2024-04-26T12:10:37.605593+0000","last_clean_scrub_stamp":"2024-04-26T12:10:37.605593+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:44:20.930983+0000","scrub_duration":0.002009748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"60'403","reported_seq":907,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:18.489116+0000","last_change":"2024-04-26T12:09:18.489255+0000","last_active":"2024-04-26T12:09:18.489116+0000","last_peered":"2024-04-26T12:09:18.489116+0000","last_clean":"2024-04-26T12:09:18.489116+0000","last_became_active":"2024-04-26T12:08:50.752366+0000","last_became_peered":"2024-04-26T12:08:50.752366+0000","last_unstale":"2024-04-26T12:09:18.489116+0000","last_undegraded":"2024-04-26T12:09:18.489116+0000","last_fullsized":"2024-04-26T12:09:18.489116+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'403","last_scrub_stamp":"2024-04-26T12:09:18.489093+0000","last_deep_scrub":"60'403","last_deep_scrub_stamp":"2024-04-26T12:09:18.489093+0000","last_clean_scrub_stamp":"2024-04-26T12:09:18.489093+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:04.607536+0000","scrub_duration":0.0022127980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30094,"num_write":370,"num_write_kb":104181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"84'470","reported_seq":561,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:04.611927+0000","last_change":"2024-04-26T12:10:04.612034+0000","last_active":"2024-04-26T12:10:04.611927+0000","last_peered":"2024-04-26T12:10:04.611927+0000","last_clean":"2024-04-26T12:10:04.611927+0000","last_became_active":"2024-04-26T12:05:03.429146+0000","last_became_peered":"2024-04-26T12:05:03.429146+0000","last_unstale":"2024-04-26T12:10:04.611927+0000","last_undegraded":"2024-04-26T12:10:04.611927+0000","last_fullsized":"2024-04-26T12:10:04.611927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'470","last_scrub_stamp":"2024-04-26T12:10:04.611896+0000","last_deep_scrub":"84'470","last_deep_scrub_stamp":"2024-04-26T12:10:04.611896+0000","last_clean_scrub_stamp":"2024-04-26T12:10:04.611896+0000","objects_scrubbed":1,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:26.920507+0000","scrub_duration":0.016499944999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":107,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:46.574665+0000","last_change":"2024-04-26T12:09:46.574794+0000","last_active":"2024-04-26T12:09:46.574665+0000","last_peered":"2024-04-26T12:09:46.574665+0000","last_clean":"2024-04-26T12:09:46.574665+0000","last_became_active":"2024-04-26T12:08:36.697618+0000","last_became_peered":"2024-04-26T12:08:36.697618+0000","last_unstale":"2024-04-26T12:09:46.574665+0000","last_undegraded":"2024-04-26T12:09:46.574665+0000","last_fullsized":"2024-04-26T12:09:46.574665+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:46.574644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:46.574644+0000","last_clean_scrub_stamp":"2024-04-26T12:09:46.574644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:41.737446+0000","scrub_duration":0.001525857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'354","reported_seq":426,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.093263+0000","last_change":"2024-04-26T12:09:50.093263+0000","last_active":"2024-04-26T12:09:50.093263+0000","last_peered":"2024-04-26T12:09:50.093263+0000","last_clean":"2024-04-26T12:09:50.093263+0000","last_became_active":"2024-04-26T12:08:45.724153+0000","last_became_peered":"2024-04-26T12:08:45.724153+0000","last_unstale":"2024-04-26T12:09:50.093263+0000","last_undegraded":"2024-04-26T12:09:50.093263+0000","last_fullsized":"2024-04-26T12:09:50.093263+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'354","last_scrub_stamp":"2024-04-26T12:09:50.093102+0000","last_deep_scrub":"60'354","last_deep_scrub_stamp":"2024-04-26T12:09:50.093102+0000","last_clean_scrub_stamp":"2024-04-26T12:09:50.093102+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:31.582282+0000","scrub_duration":0.0022860559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":416,"num_write":319,"num_write_kb":17259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"59'53","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:54.530670+0000","last_change":"2024-04-26T12:09:54.530774+0000","last_active":"2024-04-26T12:09:54.530670+0000","last_peered":"2024-04-26T12:09:54.530670+0000","last_clean":"2024-04-26T12:09:54.530670+0000","last_became_active":"2024-04-26T12:08:36.697832+0000","last_became_peered":"2024-04-26T12:08:36.697832+0000","last_unstale":"2024-04-26T12:09:54.530670+0000","last_undegraded":"2024-04-26T12:09:54.530670+0000","last_fullsized":"2024-04-26T12:09:54.530670+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'53","last_scrub_stamp":"2024-04-26T12:09:54.530648+0000","last_deep_scrub":"59'53","last_deep_scrub_stamp":"2024-04-26T12:09:54.530648+0000","last_clean_scrub_stamp":"2024-04-26T12:09:54.530648+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:52.718701+0000","scrub_duration":0.001815388,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:40.752870+0000","last_change":"2024-04-26T12:10:40.752971+0000","last_active":"2024-04-26T12:10:40.752870+0000","last_peered":"2024-04-26T12:10:40.752870+0000","last_clean":"2024-04-26T12:10:40.752870+0000","last_became_active":"2024-04-26T12:08:36.697698+0000","last_became_peered":"2024-04-26T12:08:36.697698+0000","last_unstale":"2024-04-26T12:10:40.752870+0000","last_undegraded":"2024-04-26T12:10:40.752870+0000","last_fullsized":"2024-04-26T12:10:40.752870+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:40.752848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:40.752848+0000","last_clean_scrub_stamp":"2024-04-26T12:10:40.752848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:49.485572+0000","scrub_duration":0.0018315759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'399","reported_seq":490,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:13.963241+0000","last_change":"2024-04-26T12:10:13.963241+0000","last_active":"2024-04-26T12:10:13.963241+0000","last_peered":"2024-04-26T12:10:13.963241+0000","last_clean":"2024-04-26T12:10:13.963241+0000","last_became_active":"2024-04-26T12:08:40.703906+0000","last_became_peered":"2024-04-26T12:08:40.703906+0000","last_unstale":"2024-04-26T12:10:13.963241+0000","last_undegraded":"2024-04-26T12:10:13.963241+0000","last_fullsized":"2024-04-26T12:10:13.963241+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'399","last_scrub_stamp":"2024-04-26T12:10:13.963104+0000","last_deep_scrub":"60'399","last_deep_scrub_stamp":"2024-04-26T12:10:13.963104+0000","last_clean_scrub_stamp":"2024-04-26T12:10:13.963104+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:15:56.291072+0000","scrub_duration":0.0021772139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11720,"num_write":363,"num_write_kb":66914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"84'66","reported_seq":171,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:42.618525+0000","last_change":"2024-04-26T12:09:42.618673+0000","last_active":"2024-04-26T12:09:42.618525+0000","last_peered":"2024-04-26T12:09:42.618525+0000","last_clean":"2024-04-26T12:09:42.618525+0000","last_became_active":"2024-04-26T12:08:36.699058+0000","last_became_peered":"2024-04-26T12:08:36.699058+0000","last_unstale":"2024-04-26T12:09:42.618525+0000","last_undegraded":"2024-04-26T12:09:42.618525+0000","last_fullsized":"2024-04-26T12:09:42.618525+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'66","last_scrub_stamp":"2024-04-26T12:09:42.618500+0000","last_deep_scrub":"84'66","last_deep_scrub_stamp":"2024-04-26T12:09:42.618500+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.618500+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:34.338430+0000","scrub_duration":0.0032759640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":107,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:52.522553+0000","last_change":"2024-04-26T12:09:52.522681+0000","last_active":"2024-04-26T12:09:52.522553+0000","last_peered":"2024-04-26T12:09:52.522553+0000","last_clean":"2024-04-26T12:09:52.522553+0000","last_became_active":"2024-04-26T12:08:36.697407+0000","last_became_peered":"2024-04-26T12:08:36.697407+0000","last_unstale":"2024-04-26T12:09:52.522553+0000","last_undegraded":"2024-04-26T12:09:52.522553+0000","last_fullsized":"2024-04-26T12:09:52.522553+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:52.522518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:52.522518+0000","last_clean_scrub_stamp":"2024-04-26T12:09:52.522518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:32.712239+0000","scrub_duration":0.001939184,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'424","reported_seq":554,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:36.668960+0000","last_change":"2024-04-26T12:09:36.669071+0000","last_active":"2024-04-26T12:09:36.668960+0000","last_peered":"2024-04-26T12:09:36.668960+0000","last_clean":"2024-04-26T12:09:36.668960+0000","last_became_active":"2024-04-26T12:05:03.789390+0000","last_became_peered":"2024-04-26T12:05:03.789390+0000","last_unstale":"2024-04-26T12:09:36.668960+0000","last_undegraded":"2024-04-26T12:09:36.668960+0000","last_fullsized":"2024-04-26T12:09:36.668960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'424","last_scrub_stamp":"2024-04-26T12:09:36.668937+0000","last_deep_scrub":"60'424","last_deep_scrub_stamp":"2024-04-26T12:09:36.668937+0000","last_clean_scrub_stamp":"2024-04-26T12:09:36.668937+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:58.766848+0000","scrub_duration":0.0024505759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17027,"num_write":386,"num_write_kb":58797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"84'71","reported_seq":162,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:45.617441+0000","last_change":"2024-04-26T12:09:45.617547+0000","last_active":"2024-04-26T12:09:45.617441+0000","last_peered":"2024-04-26T12:09:45.617441+0000","last_clean":"2024-04-26T12:09:45.617441+0000","last_became_active":"2024-04-26T12:05:03.428803+0000","last_became_peered":"2024-04-26T12:05:03.428803+0000","last_unstale":"2024-04-26T12:09:45.617441+0000","last_undegraded":"2024-04-26T12:09:45.617441+0000","last_fullsized":"2024-04-26T12:09:45.617441+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'71","last_scrub_stamp":"2024-04-26T12:09:45.617416+0000","last_deep_scrub":"84'71","last_deep_scrub_stamp":"2024-04-26T12:09:45.617416+0000","last_clean_scrub_stamp":"2024-04-26T12:09:45.617416+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:39.856897+0000","scrub_duration":0.0067924539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":107,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:28.652554+0000","last_change":"2024-04-26T12:10:28.652684+0000","last_active":"2024-04-26T12:10:28.652554+0000","last_peered":"2024-04-26T12:10:28.652554+0000","last_clean":"2024-04-26T12:10:28.652554+0000","last_became_active":"2024-04-26T12:08:36.698523+0000","last_became_peered":"2024-04-26T12:08:36.698523+0000","last_unstale":"2024-04-26T12:10:28.652554+0000","last_undegraded":"2024-04-26T12:10:28.652554+0000","last_fullsized":"2024-04-26T12:10:28.652554+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:28.652533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:28.652533+0000","last_clean_scrub_stamp":"2024-04-26T12:10:28.652533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:24.465235+0000","scrub_duration":0.001574619,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'393","reported_seq":485,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:40.062141+0000","last_change":"2024-04-26T12:09:40.062141+0000","last_active":"2024-04-26T12:09:40.062141+0000","last_peered":"2024-04-26T12:09:40.062141+0000","last_clean":"2024-04-26T12:09:40.062141+0000","last_became_active":"2024-04-26T12:08:40.703873+0000","last_became_peered":"2024-04-26T12:08:40.703873+0000","last_unstale":"2024-04-26T12:09:40.062141+0000","last_undegraded":"2024-04-26T12:09:40.062141+0000","last_fullsized":"2024-04-26T12:09:40.062141+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'393","last_scrub_stamp":"2024-04-26T12:09:40.062013+0000","last_deep_scrub":"60'393","last_deep_scrub_stamp":"2024-04-26T12:09:40.062013+0000","last_clean_scrub_stamp":"2024-04-26T12:09:40.062013+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:47.183215+0000","scrub_duration":0.0022492969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":11991,"num_write":357,"num_write_kb":83226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'419","reported_seq":905,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:29.651923+0000","last_change":"2024-04-26T12:09:29.651923+0000","last_active":"2024-04-26T12:09:29.651923+0000","last_peered":"2024-04-26T12:09:29.651923+0000","last_clean":"2024-04-26T12:09:29.651923+0000","last_became_active":"2024-04-26T12:08:44.722574+0000","last_became_peered":"2024-04-26T12:08:44.722574+0000","last_unstale":"2024-04-26T12:09:29.651923+0000","last_undegraded":"2024-04-26T12:09:29.651923+0000","last_fullsized":"2024-04-26T12:09:29.651923+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'419","last_scrub_stamp":"2024-04-26T12:09:29.651776+0000","last_deep_scrub":"60'419","last_deep_scrub_stamp":"2024-04-26T12:09:29.651776+0000","last_clean_scrub_stamp":"2024-04-26T12:09:29.651776+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:03.355550+0000","scrub_duration":0.0023698270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14983,"num_write":376,"num_write_kb":76749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"84'404","reported_seq":526,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.702349+0000","last_change":"2024-04-26T12:09:50.702472+0000","last_active":"2024-04-26T12:09:50.702349+0000","last_peered":"2024-04-26T12:09:50.702349+0000","last_clean":"2024-04-26T12:09:50.702349+0000","last_became_active":"2024-04-26T12:08:39.703516+0000","last_became_peered":"2024-04-26T12:08:39.703516+0000","last_unstale":"2024-04-26T12:09:50.702349+0000","last_undegraded":"2024-04-26T12:09:50.702349+0000","last_fullsized":"2024-04-26T12:09:50.702349+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'404","last_scrub_stamp":"2024-04-26T12:09:50.702328+0000","last_deep_scrub":"84'404","last_deep_scrub_stamp":"2024-04-26T12:09:50.702328+0000","last_clean_scrub_stamp":"2024-04-26T12:09:50.702328+0000","objects_scrubbed":6,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:51.625649+0000","scrub_duration":0.02885393,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699266,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":9692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9692849,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'428","reported_seq":953,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:04.569401+0000","last_change":"2024-04-26T12:10:04.569511+0000","last_active":"2024-04-26T12:10:04.569401+0000","last_peered":"2024-04-26T12:10:04.569401+0000","last_clean":"2024-04-26T12:10:04.569401+0000","last_became_active":"2024-04-26T12:08:50.752328+0000","last_became_peered":"2024-04-26T12:08:50.752328+0000","last_unstale":"2024-04-26T12:10:04.569401+0000","last_undegraded":"2024-04-26T12:10:04.569401+0000","last_fullsized":"2024-04-26T12:10:04.569401+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'428","last_scrub_stamp":"2024-04-26T12:10:04.569378+0000","last_deep_scrub":"60'428","last_deep_scrub_stamp":"2024-04-26T12:10:04.569378+0000","last_clean_scrub_stamp":"2024-04-26T12:10:04.569378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:47.307742+0000","scrub_duration":0.0028671769999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":26594,"num_write":396,"num_write_kb":67932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"84'93","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:56.025232+0000","last_change":"2024-04-26T12:09:56.025331+0000","last_active":"2024-04-26T12:09:56.025232+0000","last_peered":"2024-04-26T12:09:56.025232+0000","last_clean":"2024-04-26T12:09:56.025232+0000","last_became_active":"2024-04-26T12:08:36.697650+0000","last_became_peered":"2024-04-26T12:08:36.697650+0000","last_unstale":"2024-04-26T12:09:56.025232+0000","last_undegraded":"2024-04-26T12:09:56.025232+0000","last_fullsized":"2024-04-26T12:09:56.025232+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'93","last_scrub_stamp":"2024-04-26T12:09:56.025210+0000","last_deep_scrub":"84'93","last_deep_scrub_stamp":"2024-04-26T12:09:56.025210+0000","last_clean_scrub_stamp":"2024-04-26T12:09:56.025210+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:37.270337+0000","scrub_duration":0.0035178729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"84'317","reported_seq":408,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.578923+0000","last_change":"2024-04-26T12:10:21.579052+0000","last_active":"2024-04-26T12:10:21.578923+0000","last_peered":"2024-04-26T12:10:21.578923+0000","last_clean":"2024-04-26T12:10:21.578923+0000","last_became_active":"2024-04-26T12:05:03.428921+0000","last_became_peered":"2024-04-26T12:05:03.428921+0000","last_unstale":"2024-04-26T12:10:21.578923+0000","last_undegraded":"2024-04-26T12:10:21.578923+0000","last_fullsized":"2024-04-26T12:10:21.578923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'317","last_scrub_stamp":"2024-04-26T12:10:21.578894+0000","last_deep_scrub":"84'317","last_deep_scrub_stamp":"2024-04-26T12:10:21.578894+0000","last_clean_scrub_stamp":"2024-04-26T12:10:21.578894+0000","objects_scrubbed":1,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:10.753453+0000","scrub_duration":0.014228315,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'495","reported_seq":638,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:25.547380+0000","last_change":"2024-04-26T12:09:25.547380+0000","last_active":"2024-04-26T12:09:25.547380+0000","last_peered":"2024-04-26T12:09:25.547380+0000","last_clean":"2024-04-26T12:09:25.547380+0000","last_became_active":"2024-04-26T12:05:03.787533+0000","last_became_peered":"2024-04-26T12:05:03.787533+0000","last_unstale":"2024-04-26T12:09:25.547380+0000","last_undegraded":"2024-04-26T12:09:25.547380+0000","last_fullsized":"2024-04-26T12:09:25.547380+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'495","last_scrub_stamp":"2024-04-26T12:09:25.547250+0000","last_deep_scrub":"60'495","last_deep_scrub_stamp":"2024-04-26T12:09:25.547250+0000","last_clean_scrub_stamp":"2024-04-26T12:09:25.547250+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:52.939986+0000","scrub_duration":0.002519252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37174,"num_write":458,"num_write_kb":125832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'51","reported_seq":142,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:29.586170+0000","last_change":"2024-04-26T12:09:29.586170+0000","last_active":"2024-04-26T12:09:29.586170+0000","last_peered":"2024-04-26T12:09:29.586170+0000","last_clean":"2024-04-26T12:09:29.586170+0000","last_became_active":"2024-04-26T12:05:03.428445+0000","last_became_peered":"2024-04-26T12:05:03.428445+0000","last_unstale":"2024-04-26T12:09:29.586170+0000","last_undegraded":"2024-04-26T12:09:29.586170+0000","last_fullsized":"2024-04-26T12:09:29.586170+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'51","last_scrub_stamp":"2024-04-26T12:09:29.585971+0000","last_deep_scrub":"59'51","last_deep_scrub_stamp":"2024-04-26T12:09:29.585971+0000","last_clean_scrub_stamp":"2024-04-26T12:09:29.585971+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:15.873513+0000","scrub_duration":0.0016537050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'482","reported_seq":1143,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:05.584628+0000","last_change":"2024-04-26T12:10:05.584742+0000","last_active":"2024-04-26T12:10:05.584628+0000","last_peered":"2024-04-26T12:10:05.584628+0000","last_clean":"2024-04-26T12:10:05.584628+0000","last_became_active":"2024-04-26T12:08:48.740055+0000","last_became_peered":"2024-04-26T12:08:48.740055+0000","last_unstale":"2024-04-26T12:10:05.584628+0000","last_undegraded":"2024-04-26T12:10:05.584628+0000","last_fullsized":"2024-04-26T12:10:05.584628+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'482","last_scrub_stamp":"2024-04-26T12:10:05.584603+0000","last_deep_scrub":"60'482","last_deep_scrub_stamp":"2024-04-26T12:10:05.584603+0000","last_clean_scrub_stamp":"2024-04-26T12:10:05.584603+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:28.512669+0000","scrub_duration":0.002302704,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":61972,"num_write":459,"num_write_kb":125797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"60'392","reported_seq":540,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:29.949247+0000","last_change":"2024-04-26T12:10:29.949247+0000","last_active":"2024-04-26T12:10:29.949247+0000","last_peered":"2024-04-26T12:10:29.949247+0000","last_clean":"2024-04-26T12:10:29.949247+0000","last_became_active":"2024-04-26T12:08:43.717109+0000","last_became_peered":"2024-04-26T12:08:43.717109+0000","last_unstale":"2024-04-26T12:10:29.949247+0000","last_undegraded":"2024-04-26T12:10:29.949247+0000","last_fullsized":"2024-04-26T12:10:29.949247+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'392","last_scrub_stamp":"2024-04-26T12:10:29.949102+0000","last_deep_scrub":"60'392","last_deep_scrub_stamp":"2024-04-26T12:10:29.949102+0000","last_clean_scrub_stamp":"2024-04-26T12:10:29.949102+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:49.528176+0000","scrub_duration":0.0019623760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":37910,"num_write":366,"num_write_kb":84111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"84'711","reported_seq":828,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:58.565960+0000","last_change":"2024-04-26T12:09:58.566091+0000","last_active":"2024-04-26T12:09:58.565960+0000","last_peered":"2024-04-26T12:09:58.565960+0000","last_clean":"2024-04-26T12:09:58.565960+0000","last_became_active":"2024-04-26T12:08:39.700927+0000","last_became_peered":"2024-04-26T12:08:39.700927+0000","last_unstale":"2024-04-26T12:09:58.565960+0000","last_undegraded":"2024-04-26T12:09:58.565960+0000","last_fullsized":"2024-04-26T12:09:58.565960+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'711","last_scrub_stamp":"2024-04-26T12:09:58.565935+0000","last_deep_scrub":"84'711","last_deep_scrub_stamp":"2024-04-26T12:09:58.565935+0000","last_clean_scrub_stamp":"2024-04-26T12:09:58.565935+0000","objects_scrubbed":2,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:53.985339+0000","scrub_duration":0.028815225,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"60'435","reported_seq":585,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:12.601978+0000","last_change":"2024-04-26T12:10:12.602088+0000","last_active":"2024-04-26T12:10:12.601978+0000","last_peered":"2024-04-26T12:10:12.601978+0000","last_clean":"2024-04-26T12:10:12.601978+0000","last_became_active":"2024-04-26T12:05:03.788311+0000","last_became_peered":"2024-04-26T12:05:03.788311+0000","last_unstale":"2024-04-26T12:10:12.601978+0000","last_undegraded":"2024-04-26T12:10:12.601978+0000","last_fullsized":"2024-04-26T12:10:12.601978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'435","last_scrub_stamp":"2024-04-26T12:10:12.601956+0000","last_deep_scrub":"60'435","last_deep_scrub_stamp":"2024-04-26T12:10:12.601956+0000","last_clean_scrub_stamp":"2024-04-26T12:10:12.601956+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:06.128844+0000","scrub_duration":0.0028402480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":28462,"num_write":403,"num_write_kb":93779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"84'263","reported_seq":354,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:40.654355+0000","last_change":"2024-04-26T12:09:40.654355+0000","last_active":"2024-04-26T12:09:40.654355+0000","last_peered":"2024-04-26T12:09:40.654355+0000","last_clean":"2024-04-26T12:09:40.654355+0000","last_became_active":"2024-04-26T12:05:03.428191+0000","last_became_peered":"2024-04-26T12:05:03.428191+0000","last_unstale":"2024-04-26T12:09:40.654355+0000","last_undegraded":"2024-04-26T12:09:40.654355+0000","last_fullsized":"2024-04-26T12:09:40.654355+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'263","last_scrub_stamp":"2024-04-26T12:09:40.654238+0000","last_deep_scrub":"84'263","last_deep_scrub_stamp":"2024-04-26T12:09:40.654238+0000","last_clean_scrub_stamp":"2024-04-26T12:09:40.654238+0000","objects_scrubbed":1,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:02.888122+0000","scrub_duration":0.014597508,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"60'399","reported_seq":511,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:28.921929+0000","last_change":"2024-04-26T12:10:28.922059+0000","last_active":"2024-04-26T12:10:28.921929+0000","last_peered":"2024-04-26T12:10:28.921929+0000","last_clean":"2024-04-26T12:10:28.921929+0000","last_became_active":"2024-04-26T12:08:49.740536+0000","last_became_peered":"2024-04-26T12:08:49.740536+0000","last_unstale":"2024-04-26T12:10:28.921929+0000","last_undegraded":"2024-04-26T12:10:28.921929+0000","last_fullsized":"2024-04-26T12:10:28.921929+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'399","last_scrub_stamp":"2024-04-26T12:10:28.921891+0000","last_deep_scrub":"60'399","last_deep_scrub_stamp":"2024-04-26T12:10:28.921891+0000","last_clean_scrub_stamp":"2024-04-26T12:10:28.921891+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:06.173017+0000","scrub_duration":0.00256324,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22216,"num_write":357,"num_write_kb":75245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"84'433","reported_seq":505,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:33.133704+0000","last_change":"2024-04-26T12:09:33.133804+0000","last_active":"2024-04-26T12:09:33.133704+0000","last_peered":"2024-04-26T12:09:33.133704+0000","last_clean":"2024-04-26T12:09:33.133704+0000","last_became_active":"2024-04-26T12:08:39.702529+0000","last_became_peered":"2024-04-26T12:08:39.702529+0000","last_unstale":"2024-04-26T12:09:33.133704+0000","last_undegraded":"2024-04-26T12:09:33.133704+0000","last_fullsized":"2024-04-26T12:09:33.133704+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'433","last_scrub_stamp":"2024-04-26T12:09:33.133683+0000","last_deep_scrub":"84'433","last_deep_scrub_stamp":"2024-04-26T12:09:33.133683+0000","last_clean_scrub_stamp":"2024-04-26T12:09:33.133683+0000","objects_scrubbed":3,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:32.088329+0000","scrub_duration":0.034859436000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":12514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"60'387","reported_seq":488,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.120063+0000","last_change":"2024-04-26T12:09:49.120210+0000","last_active":"2024-04-26T12:09:49.120063+0000","last_peered":"2024-04-26T12:09:49.120063+0000","last_clean":"2024-04-26T12:09:49.120063+0000","last_became_active":"2024-04-26T12:08:43.717442+0000","last_became_peered":"2024-04-26T12:08:43.717442+0000","last_unstale":"2024-04-26T12:09:49.120063+0000","last_undegraded":"2024-04-26T12:09:49.120063+0000","last_fullsized":"2024-04-26T12:09:49.120063+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'387","last_scrub_stamp":"2024-04-26T12:09:49.120043+0000","last_deep_scrub":"60'387","last_deep_scrub_stamp":"2024-04-26T12:09:49.120043+0000","last_clean_scrub_stamp":"2024-04-26T12:09:49.120043+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:21.246128+0000","scrub_duration":0.00208647,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20720,"num_write":352,"num_write_kb":87643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"84'59","reported_seq":56,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:16.993596+0000","last_change":"2024-04-26T12:10:16.993913+0000","last_active":"2024-04-26T12:10:16.993596+0000","last_peered":"2024-04-26T12:10:16.993596+0000","last_clean":"2024-04-26T12:10:16.993596+0000","last_became_active":"2024-04-26T12:08:36.693399+0000","last_became_peered":"2024-04-26T12:08:36.693399+0000","last_unstale":"2024-04-26T12:10:16.993596+0000","last_undegraded":"2024-04-26T12:10:16.993596+0000","last_fullsized":"2024-04-26T12:10:16.993596+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'59","last_scrub_stamp":"2024-04-26T12:10:16.993575+0000","last_deep_scrub":"84'59","last_deep_scrub_stamp":"2024-04-26T12:10:16.993575+0000","last_clean_scrub_stamp":"2024-04-26T12:10:16.993575+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:32.405915+0000","scrub_duration":0.0097403390000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"60'356","reported_seq":465,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:40.622688+0000","last_change":"2024-04-26T12:10:40.622816+0000","last_active":"2024-04-26T12:10:40.622688+0000","last_peered":"2024-04-26T12:10:40.622688+0000","last_clean":"2024-04-26T12:10:40.622688+0000","last_became_active":"2024-04-26T12:05:03.790823+0000","last_became_peered":"2024-04-26T12:05:03.790823+0000","last_unstale":"2024-04-26T12:10:40.622688+0000","last_undegraded":"2024-04-26T12:10:40.622688+0000","last_fullsized":"2024-04-26T12:10:40.622688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'356","last_scrub_stamp":"2024-04-26T12:10:40.622649+0000","last_deep_scrub":"60'356","last_deep_scrub_stamp":"2024-04-26T12:10:40.622649+0000","last_clean_scrub_stamp":"2024-04-26T12:10:40.622649+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:12.180784+0000","scrub_duration":0.0030157550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9641,"num_write":326,"num_write_kb":29574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"84'311","reported_seq":402,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:32.706538+0000","last_change":"2024-04-26T12:09:32.706538+0000","last_active":"2024-04-26T12:09:32.706538+0000","last_peered":"2024-04-26T12:09:32.706538+0000","last_clean":"2024-04-26T12:09:32.706538+0000","last_became_active":"2024-04-26T12:05:03.429015+0000","last_became_peered":"2024-04-26T12:05:03.429015+0000","last_unstale":"2024-04-26T12:09:32.706538+0000","last_undegraded":"2024-04-26T12:09:32.706538+0000","last_fullsized":"2024-04-26T12:09:32.706538+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'311","last_scrub_stamp":"2024-04-26T12:09:32.706381+0000","last_deep_scrub":"84'311","last_deep_scrub_stamp":"2024-04-26T12:09:32.706381+0000","last_clean_scrub_stamp":"2024-04-26T12:09:32.706381+0000","objects_scrubbed":2,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:18.824824+0000","scrub_duration":0.016953577000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'433","reported_seq":588,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:52.685440+0000","last_change":"2024-04-26T12:09:52.685440+0000","last_active":"2024-04-26T12:09:52.685440+0000","last_peered":"2024-04-26T12:09:52.685440+0000","last_clean":"2024-04-26T12:09:52.685440+0000","last_became_active":"2024-04-26T12:05:03.791540+0000","last_became_peered":"2024-04-26T12:05:03.791540+0000","last_unstale":"2024-04-26T12:09:52.685440+0000","last_undegraded":"2024-04-26T12:09:52.685440+0000","last_fullsized":"2024-04-26T12:09:52.685440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'433","last_scrub_stamp":"2024-04-26T12:09:52.685297+0000","last_deep_scrub":"60'433","last_deep_scrub_stamp":"2024-04-26T12:09:52.685297+0000","last_clean_scrub_stamp":"2024-04-26T12:09:52.685297+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:14.783208+0000","scrub_duration":0.0028996600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":47864,"num_write":399,"num_write_kb":92193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"84'386","reported_seq":465,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:24.039855+0000","last_change":"2024-04-26T12:10:24.039971+0000","last_active":"2024-04-26T12:10:24.039855+0000","last_peered":"2024-04-26T12:10:24.039855+0000","last_clean":"2024-04-26T12:10:24.039855+0000","last_became_active":"2024-04-26T12:08:39.704404+0000","last_became_peered":"2024-04-26T12:08:39.704404+0000","last_unstale":"2024-04-26T12:10:24.039855+0000","last_undegraded":"2024-04-26T12:10:24.039855+0000","last_fullsized":"2024-04-26T12:10:24.039855+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'386","last_scrub_stamp":"2024-04-26T12:10:24.039831+0000","last_deep_scrub":"84'386","last_deep_scrub_stamp":"2024-04-26T12:10:24.039831+0000","last_clean_scrub_stamp":"2024-04-26T12:10:24.039831+0000","objects_scrubbed":4,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:29.776584+0000","scrub_duration":0.031708703999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":12467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'425","reported_seq":556,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:18.179708+0000","last_change":"2024-04-26T12:09:18.179810+0000","last_active":"2024-04-26T12:09:18.179708+0000","last_peered":"2024-04-26T12:09:18.179708+0000","last_clean":"2024-04-26T12:09:18.179708+0000","last_became_active":"2024-04-26T12:08:47.735367+0000","last_became_peered":"2024-04-26T12:08:47.735367+0000","last_unstale":"2024-04-26T12:09:18.179708+0000","last_undegraded":"2024-04-26T12:09:18.179708+0000","last_fullsized":"2024-04-26T12:09:18.179708+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'425","last_scrub_stamp":"2024-04-26T12:09:18.179684+0000","last_deep_scrub":"60'425","last_deep_scrub_stamp":"2024-04-26T12:09:18.179684+0000","last_clean_scrub_stamp":"2024-04-26T12:09:18.179684+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:20.520222+0000","scrub_duration":0.0024613230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":38065,"num_write":387,"num_write_kb":71445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"84'127","reported_seq":243,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:21.540633+0000","last_change":"2024-04-26T12:09:21.540746+0000","last_active":"2024-04-26T12:09:21.540633+0000","last_peered":"2024-04-26T12:09:21.540633+0000","last_clean":"2024-04-26T12:09:21.540633+0000","last_became_active":"2024-04-26T12:08:39.701900+0000","last_became_peered":"2024-04-26T12:08:39.701900+0000","last_unstale":"2024-04-26T12:09:21.540633+0000","last_undegraded":"2024-04-26T12:09:21.540633+0000","last_fullsized":"2024-04-26T12:09:21.540633+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'127","last_scrub_stamp":"2024-04-26T12:09:21.540611+0000","last_deep_scrub":"84'127","last_deep_scrub_stamp":"2024-04-26T12:09:21.540611+0000","last_clean_scrub_stamp":"2024-04-26T12:09:21.540611+0000","objects_scrubbed":1,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:30.101109+0000","scrub_duration":0.0098993390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"60'448","reported_seq":561,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:31.644589+0000","last_change":"2024-04-26T12:09:31.644589+0000","last_active":"2024-04-26T12:09:31.644589+0000","last_peered":"2024-04-26T12:09:31.644589+0000","last_clean":"2024-04-26T12:09:31.644589+0000","last_became_active":"2024-04-26T12:05:03.791442+0000","last_became_peered":"2024-04-26T12:05:03.791442+0000","last_unstale":"2024-04-26T12:09:31.644589+0000","last_undegraded":"2024-04-26T12:09:31.644589+0000","last_fullsized":"2024-04-26T12:09:31.644589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'448","last_scrub_stamp":"2024-04-26T12:09:31.644476+0000","last_deep_scrub":"60'448","last_deep_scrub_stamp":"2024-04-26T12:09:31.644476+0000","last_clean_scrub_stamp":"2024-04-26T12:09:31.644476+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:50.748197+0000","scrub_duration":0.0028574049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11191,"num_write":416,"num_write_kb":67272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"84'59","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:17.505129+0000","last_change":"2024-04-26T12:09:17.505233+0000","last_active":"2024-04-26T12:09:17.505129+0000","last_peered":"2024-04-26T12:09:17.505129+0000","last_clean":"2024-04-26T12:09:17.505129+0000","last_became_active":"2024-04-26T12:05:03.430164+0000","last_became_peered":"2024-04-26T12:05:03.430164+0000","last_unstale":"2024-04-26T12:09:17.505129+0000","last_undegraded":"2024-04-26T12:09:17.505129+0000","last_fullsized":"2024-04-26T12:09:17.505129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'59","last_scrub_stamp":"2024-04-26T12:09:17.505103+0000","last_deep_scrub":"84'59","last_deep_scrub_stamp":"2024-04-26T12:09:17.505103+0000","last_clean_scrub_stamp":"2024-04-26T12:09:17.505103+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:36.608825+0000","scrub_duration":0.012259582999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2734,"num_read_kb":1486856,"num_write":24627,"num_write_kb":4487808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7440,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26722,"ondisk_log_size":26722,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128606591,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":5972,"num_write_kb":129691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64376832,"data_stored":257213182,"data_compressed":19249503,"data_compressed_allocated":31694848,"data_compressed_original":224591872,"omap_allocated":4411,"internal_metadata":0},"log_size":7881,"ondisk_log_size":7881,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738444,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134428,"kb_used_data":27092,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94237412,"statfs":{"total":96636764160,"available":96499109888,"internally_reserved":0,"allocated":27742208,"data_stored":91797602,"data_compressed":6340284,"data_compressed_allocated":11272192,"data_compressed_original":75763712,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:10:04 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.40400000000000003,"15min":0.438},"min":{"1min":0.26800000000000002,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.57799999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.40699999999999997,"15min":0.42899999999999999},"min":{"1min":0.33000000000000002,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.37}]},{"osd":1,"last update":"Fri Apr 26 12:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46000000000000002,"15min":0.45600000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.63200000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.46100000000000002,"15min":0.45500000000000002},"min":{"1min":0.312,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.44800000000000001}]}]},{"osd":1,"up_from":66,"seq":283467841564,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68508,"kb_used_data":10644,"kb_used_omap":5,"kb_used_meta":57850,"kb_avail":94303332,"statfs":{"total":96636764160,"available":96566611968,"internally_reserved":0,"allocated":10899456,"data_stored":86136667,"data_compressed":7182940,"data_compressed_allocated":10076160,"data_compressed_original":85745664,"omap_allocated":6005,"internal_metadata":59238539},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.40300000000000002,"15min":0.39600000000000002},"min":{"1min":0.33800000000000002,"5min":0.155,"15min":0.155},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.373},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.41299999999999998,"15min":0.40500000000000003},"min":{"1min":0.36699999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.41399999999999998}]},{"osd":2,"last update":"Fri Apr 26 12:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.44,"15min":0.433},"min":{"1min":0.38200000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.44900000000000001,"15min":0.441},"min":{"1min":0.40500000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.60299999999999998,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.56200000000000006}]}]},{"osd":0,"up_from":8,"seq":34359738444,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138884,"kb_used_data":27452,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232956,"statfs":{"total":96636764160,"available":96494546944,"internally_reserved":0,"allocated":28110848,"data_stored":81507786,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.436,"15min":0.42999999999999999},"min":{"1min":0.26700000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45500000000000002,"15min":0.45200000000000001},"min":{"1min":0.29499999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64400000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.37}]},{"osd":2,"last update":"Fri Apr 26 12:10:05 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.442,"15min":0.441},"min":{"1min":0.39200000000000002,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.60799999999999998,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.45200000000000001,"15min":0.439},"min":{"1min":0.38,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.64500000000000002,"5min":1.976,"15min":1.976},"last":0.55000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27357184,"data_stored":81158407,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10088448,"data_stored":85196920,"data_compressed":7176942,"data_compressed_allocated":10039296,"data_compressed_original":85172224,"omap_allocated":4411,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26931200,"data_stored":90857855,"data_compressed":6334286,"data_compressed_allocated":11235328,"data_compressed_original":75190272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:10:48.144 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:48.144 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:48.144 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:48.144 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:48.144 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:48.144 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:48.145 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:05:03.412630+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=5, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:10:48.146 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:11:08.147 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:11:08.464 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:11:08.465 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T12:11:08.474 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":271,"stamp":"2024-04-26T12:11:08.428339+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129196959,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2917,"num_read_kb":1488438,"num_write":30802,"num_write_kb":4620959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7463,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34762,"ondisk_log_size":34762,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":341820,"kb_used_data":65188,"kb_used_omap":8,"kb_used_meta":276599,"kb_avail":282773700,"statfs":{"total":289910292480,"available":289560268800,"internally_reserved":0,"allocated":66752512,"data_stored":259442055,"data_compressed":19261499,"data_compressed_allocated":31768576,"data_compressed_original":225738752,"omap_allocated":9193,"internal_metadata":283237399},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002876"},"pg_stats":[{"pgid":"4.3f","version":"60'426","reported_seq":520,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:46.663271+0000","last_change":"2024-04-26T12:10:46.663371+0000","last_active":"2024-04-26T12:10:46.663271+0000","last_peered":"2024-04-26T12:10:46.663271+0000","last_clean":"2024-04-26T12:10:46.663271+0000","last_became_active":"2024-04-26T12:08:51.750917+0000","last_became_peered":"2024-04-26T12:08:51.750917+0000","last_unstale":"2024-04-26T12:10:46.663271+0000","last_undegraded":"2024-04-26T12:10:46.663271+0000","last_fullsized":"2024-04-26T12:10:46.663271+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'426","last_scrub_stamp":"2024-04-26T12:10:46.663251+0000","last_deep_scrub":"60'426","last_deep_scrub_stamp":"2024-04-26T12:10:46.663251+0000","last_clean_scrub_stamp":"2024-04-26T12:10:46.663251+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:04.288731+0000","scrub_duration":0.002288591,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9964,"num_write":393,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"60'470","reported_seq":614,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:37.850211+0000","last_change":"2024-04-26T12:10:37.850211+0000","last_active":"2024-04-26T12:10:37.850211+0000","last_peered":"2024-04-26T12:10:37.850211+0000","last_clean":"2024-04-26T12:10:37.850211+0000","last_became_active":"2024-04-26T12:08:43.717325+0000","last_became_peered":"2024-04-26T12:08:43.717325+0000","last_unstale":"2024-04-26T12:10:37.850211+0000","last_undegraded":"2024-04-26T12:10:37.850211+0000","last_fullsized":"2024-04-26T12:10:37.850211+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'470","last_scrub_stamp":"2024-04-26T12:10:37.850091+0000","last_deep_scrub":"60'470","last_deep_scrub_stamp":"2024-04-26T12:10:37.850091+0000","last_clean_scrub_stamp":"2024-04-26T12:10:37.850091+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:51.756889+0000","scrub_duration":0.002519047,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":34556,"num_write":444,"num_write_kb":129697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"60'370","reported_seq":815,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:11:05.700280+0000","last_change":"2024-04-26T12:11:05.700412+0000","last_active":"2024-04-26T12:11:05.700280+0000","last_peered":"2024-04-26T12:11:05.700280+0000","last_clean":"2024-04-26T12:11:05.700280+0000","last_became_active":"2024-04-26T12:08:50.752468+0000","last_became_peered":"2024-04-26T12:08:50.752468+0000","last_unstale":"2024-04-26T12:11:05.700280+0000","last_undegraded":"2024-04-26T12:11:05.700280+0000","last_fullsized":"2024-04-26T12:11:05.700280+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'370","last_scrub_stamp":"2024-04-26T12:11:05.700260+0000","last_deep_scrub":"60'370","last_deep_scrub_stamp":"2024-04-26T12:11:05.700260+0000","last_clean_scrub_stamp":"2024-04-26T12:11:05.700260+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:46.223447+0000","scrub_duration":0.0021984930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":349,"num_write_kb":51115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"60'377","reported_seq":499,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:47.569424+0000","last_change":"2024-04-26T12:10:47.569424+0000","last_active":"2024-04-26T12:10:47.569424+0000","last_peered":"2024-04-26T12:10:47.569424+0000","last_clean":"2024-04-26T12:10:47.569424+0000","last_became_active":"2024-04-26T12:05:03.790717+0000","last_became_peered":"2024-04-26T12:05:03.790717+0000","last_unstale":"2024-04-26T12:10:47.569424+0000","last_undegraded":"2024-04-26T12:10:47.569424+0000","last_fullsized":"2024-04-26T12:10:47.569424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'377","last_scrub_stamp":"2024-04-26T12:10:47.569293+0000","last_deep_scrub":"60'377","last_deep_scrub_stamp":"2024-04-26T12:10:47.569293+0000","last_clean_scrub_stamp":"2024-04-26T12:10:47.569293+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:07.323059+0000","scrub_duration":0.0026946740000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17376,"num_write":341,"num_write_kb":46680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'445","reported_seq":563,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:42.047407+0000","last_change":"2024-04-26T12:09:42.047407+0000","last_active":"2024-04-26T12:09:42.047407+0000","last_peered":"2024-04-26T12:09:42.047407+0000","last_clean":"2024-04-26T12:09:42.047407+0000","last_became_active":"2024-04-26T12:08:39.702117+0000","last_became_peered":"2024-04-26T12:08:39.702117+0000","last_unstale":"2024-04-26T12:09:42.047407+0000","last_undegraded":"2024-04-26T12:09:42.047407+0000","last_fullsized":"2024-04-26T12:09:42.047407+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'445","last_scrub_stamp":"2024-04-26T12:09:42.047279+0000","last_deep_scrub":"60'445","last_deep_scrub_stamp":"2024-04-26T12:09:42.047279+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.047279+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:26.392089+0000","scrub_duration":0.0023237290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24197,"num_write":416,"num_write_kb":80466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"60'375","reported_seq":483,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:51.567439+0000","last_change":"2024-04-26T12:10:51.567545+0000","last_active":"2024-04-26T12:10:51.567439+0000","last_peered":"2024-04-26T12:10:51.567439+0000","last_clean":"2024-04-26T12:10:51.567439+0000","last_became_active":"2024-04-26T12:05:03.790578+0000","last_became_peered":"2024-04-26T12:05:03.790578+0000","last_unstale":"2024-04-26T12:10:51.567439+0000","last_undegraded":"2024-04-26T12:10:51.567439+0000","last_fullsized":"2024-04-26T12:10:51.567439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'375","last_scrub_stamp":"2024-04-26T12:10:51.567416+0000","last_deep_scrub":"60'375","last_deep_scrub_stamp":"2024-04-26T12:10:51.567416+0000","last_clean_scrub_stamp":"2024-04-26T12:10:51.567416+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:56.997101+0000","scrub_duration":0.0029936300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6518,"num_write":348,"num_write_kb":38078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'428","reported_seq":537,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:18.488710+0000","last_change":"2024-04-26T12:09:18.488710+0000","last_active":"2024-04-26T12:09:18.488710+0000","last_peered":"2024-04-26T12:09:18.488710+0000","last_clean":"2024-04-26T12:09:18.488710+0000","last_became_active":"2024-04-26T12:05:03.790615+0000","last_became_peered":"2024-04-26T12:05:03.790615+0000","last_unstale":"2024-04-26T12:09:18.488710+0000","last_undegraded":"2024-04-26T12:09:18.488710+0000","last_fullsized":"2024-04-26T12:09:18.488710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'428","last_scrub_stamp":"2024-04-26T12:09:18.488526+0000","last_deep_scrub":"60'428","last_deep_scrub_stamp":"2024-04-26T12:09:18.488526+0000","last_clean_scrub_stamp":"2024-04-26T12:09:18.488526+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:22.049575+0000","scrub_duration":0.0025858650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12560,"num_write":398,"num_write_kb":67332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"60'387","reported_seq":539,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:55.647856+0000","last_change":"2024-04-26T12:10:55.647977+0000","last_active":"2024-04-26T12:10:55.647856+0000","last_peered":"2024-04-26T12:10:55.647856+0000","last_clean":"2024-04-26T12:10:55.647856+0000","last_became_active":"2024-04-26T12:05:03.785382+0000","last_became_peered":"2024-04-26T12:05:03.785382+0000","last_unstale":"2024-04-26T12:10:55.647856+0000","last_undegraded":"2024-04-26T12:10:55.647856+0000","last_fullsized":"2024-04-26T12:10:55.647856+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'387","last_scrub_stamp":"2024-04-26T12:10:55.647831+0000","last_deep_scrub":"60'387","last_deep_scrub_stamp":"2024-04-26T12:10:55.647831+0000","last_clean_scrub_stamp":"2024-04-26T12:10:55.647831+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:16.777309+0000","scrub_duration":0.0027614250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":41160,"num_write":356,"num_write_kb":80219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"60'405","reported_seq":913,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:19.829976+0000","last_change":"2024-04-26T12:10:19.830086+0000","last_active":"2024-04-26T12:10:19.829976+0000","last_peered":"2024-04-26T12:10:19.829976+0000","last_clean":"2024-04-26T12:10:19.829976+0000","last_became_active":"2024-04-26T12:08:46.729039+0000","last_became_peered":"2024-04-26T12:08:46.729039+0000","last_unstale":"2024-04-26T12:10:19.829976+0000","last_undegraded":"2024-04-26T12:10:19.829976+0000","last_fullsized":"2024-04-26T12:10:19.829976+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'405","last_scrub_stamp":"2024-04-26T12:10:19.829953+0000","last_deep_scrub":"60'405","last_deep_scrub_stamp":"2024-04-26T12:10:19.829953+0000","last_clean_scrub_stamp":"2024-04-26T12:10:19.829953+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:57.119919+0000","scrub_duration":0.0018775389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":11674,"num_write":372,"num_write_kb":34604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"60'425","reported_seq":590,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:28.089362+0000","last_change":"2024-04-26T12:09:28.089362+0000","last_active":"2024-04-26T12:09:28.089362+0000","last_peered":"2024-04-26T12:09:28.089362+0000","last_clean":"2024-04-26T12:09:28.089362+0000","last_became_active":"2024-04-26T12:08:41.716014+0000","last_became_peered":"2024-04-26T12:08:41.716014+0000","last_unstale":"2024-04-26T12:09:28.089362+0000","last_undegraded":"2024-04-26T12:09:28.089362+0000","last_fullsized":"2024-04-26T12:09:28.089362+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'425","last_scrub_stamp":"2024-04-26T12:09:28.089215+0000","last_deep_scrub":"60'425","last_deep_scrub_stamp":"2024-04-26T12:09:28.089215+0000","last_clean_scrub_stamp":"2024-04-26T12:09:28.089215+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:31.039189+0000","scrub_duration":0.0021431470000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":48419,"num_write":390,"num_write_kb":92286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"60'372","reported_seq":502,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:11:03.663324+0000","last_change":"2024-04-26T12:11:03.663424+0000","last_active":"2024-04-26T12:11:03.663324+0000","last_peered":"2024-04-26T12:11:03.663324+0000","last_clean":"2024-04-26T12:11:03.663324+0000","last_became_active":"2024-04-26T12:05:03.790662+0000","last_became_peered":"2024-04-26T12:05:03.790662+0000","last_unstale":"2024-04-26T12:11:03.663324+0000","last_undegraded":"2024-04-26T12:11:03.663324+0000","last_fullsized":"2024-04-26T12:11:03.663324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'372","last_scrub_stamp":"2024-04-26T12:11:03.663302+0000","last_deep_scrub":"60'372","last_deep_scrub_stamp":"2024-04-26T12:11:03.663302+0000","last_clean_scrub_stamp":"2024-04-26T12:11:03.663302+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:19:31.256445+0000","scrub_duration":0.0027467809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25905,"num_write":353,"num_write_kb":75437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'351","reported_seq":439,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:08.024919+0000","last_change":"2024-04-26T12:09:08.024919+0000","last_active":"2024-04-26T12:09:08.024919+0000","last_peered":"2024-04-26T12:09:08.024919+0000","last_clean":"2024-04-26T12:09:08.024919+0000","last_became_active":"2024-04-26T12:08:41.715726+0000","last_became_peered":"2024-04-26T12:08:41.715726+0000","last_unstale":"2024-04-26T12:09:08.024919+0000","last_undegraded":"2024-04-26T12:09:08.024919+0000","last_fullsized":"2024-04-26T12:09:08.024919+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'351","last_scrub_stamp":"2024-04-26T12:09:08.024789+0000","last_deep_scrub":"60'351","last_deep_scrub_stamp":"2024-04-26T12:09:08.024789+0000","last_clean_scrub_stamp":"2024-04-26T12:09:08.024789+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:15.481742+0000","scrub_duration":0.0022688909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8884,"num_write":327,"num_write_kb":58289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"60'405","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:19.190112+0000","last_change":"2024-04-26T12:09:19.190112+0000","last_active":"2024-04-26T12:09:19.190112+0000","last_peered":"2024-04-26T12:09:19.190112+0000","last_clean":"2024-04-26T12:09:19.190112+0000","last_became_active":"2024-04-26T12:08:39.702141+0000","last_became_peered":"2024-04-26T12:08:39.702141+0000","last_unstale":"2024-04-26T12:09:19.190112+0000","last_undegraded":"2024-04-26T12:09:19.190112+0000","last_fullsized":"2024-04-26T12:09:19.190112+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'405","last_scrub_stamp":"2024-04-26T12:09:19.189997+0000","last_deep_scrub":"60'405","last_deep_scrub_stamp":"2024-04-26T12:09:19.189997+0000","last_clean_scrub_stamp":"2024-04-26T12:09:19.189997+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:45:38.242862+0000","scrub_duration":0.0019966300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6771,"num_write":372,"num_write_kb":54786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"60'431","reported_seq":950,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:21.555659+0000","last_change":"2024-04-26T12:09:21.555659+0000","last_active":"2024-04-26T12:09:21.555659+0000","last_peered":"2024-04-26T12:09:21.555659+0000","last_clean":"2024-04-26T12:09:21.555659+0000","last_became_active":"2024-04-26T12:08:48.740170+0000","last_became_peered":"2024-04-26T12:08:48.740170+0000","last_unstale":"2024-04-26T12:09:21.555659+0000","last_undegraded":"2024-04-26T12:09:21.555659+0000","last_fullsized":"2024-04-26T12:09:21.555659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'431","last_scrub_stamp":"2024-04-26T12:09:21.555526+0000","last_deep_scrub":"60'431","last_deep_scrub_stamp":"2024-04-26T12:09:21.555526+0000","last_clean_scrub_stamp":"2024-04-26T12:09:21.555526+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:09.119328+0000","scrub_duration":0.0022972299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26572,"num_write":398,"num_write_kb":83974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'394","reported_seq":909,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:35.716715+0000","last_change":"2024-04-26T12:09:35.716715+0000","last_active":"2024-04-26T12:09:35.716715+0000","last_peered":"2024-04-26T12:09:35.716715+0000","last_clean":"2024-04-26T12:09:35.716715+0000","last_became_active":"2024-04-26T12:08:41.715956+0000","last_became_peered":"2024-04-26T12:08:41.715956+0000","last_unstale":"2024-04-26T12:09:35.716715+0000","last_undegraded":"2024-04-26T12:09:35.716715+0000","last_fullsized":"2024-04-26T12:09:35.716715+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'394","last_scrub_stamp":"2024-04-26T12:09:35.716594+0000","last_deep_scrub":"60'394","last_deep_scrub_stamp":"2024-04-26T12:09:35.716594+0000","last_clean_scrub_stamp":"2024-04-26T12:09:35.716594+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:28.908858+0000","scrub_duration":0.0029063209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":38136,"num_write":355,"num_write_kb":38484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'432","reported_seq":556,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:07.460951+0000","last_change":"2024-04-26T12:09:07.460951+0000","last_active":"2024-04-26T12:09:07.460951+0000","last_peered":"2024-04-26T12:09:07.460951+0000","last_clean":"2024-04-26T12:09:07.460951+0000","last_became_active":"2024-04-26T12:05:03.785991+0000","last_became_peered":"2024-04-26T12:05:03.785991+0000","last_unstale":"2024-04-26T12:09:07.460951+0000","last_undegraded":"2024-04-26T12:09:07.460951+0000","last_fullsized":"2024-04-26T12:09:07.460951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'432","last_scrub_stamp":"2024-04-26T12:09:07.460722+0000","last_deep_scrub":"60'432","last_deep_scrub_stamp":"2024-04-26T12:09:07.460722+0000","last_clean_scrub_stamp":"2024-04-26T12:09:07.460722+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:52.118824+0000","scrub_duration":0.0028296200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18244,"num_write":400,"num_write_kb":59033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'381","reported_seq":851,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:30.632857+0000","last_change":"2024-04-26T12:09:30.632857+0000","last_active":"2024-04-26T12:09:30.632857+0000","last_peered":"2024-04-26T12:09:30.632857+0000","last_clean":"2024-04-26T12:09:30.632857+0000","last_became_active":"2024-04-26T12:08:52.745913+0000","last_became_peered":"2024-04-26T12:08:52.745913+0000","last_unstale":"2024-04-26T12:09:30.632857+0000","last_undegraded":"2024-04-26T12:09:30.632857+0000","last_fullsized":"2024-04-26T12:09:30.632857+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'381","last_scrub_stamp":"2024-04-26T12:09:30.632714+0000","last_deep_scrub":"60'381","last_deep_scrub_stamp":"2024-04-26T12:09:30.632714+0000","last_clean_scrub_stamp":"2024-04-26T12:09:30.632714+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:40.099051+0000","scrub_duration":0.001861026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":350,"num_write_kb":21212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"60'424","reported_seq":527,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:25.195412+0000","last_change":"2024-04-26T12:09:25.195412+0000","last_active":"2024-04-26T12:09:25.195412+0000","last_peered":"2024-04-26T12:09:25.195412+0000","last_clean":"2024-04-26T12:09:25.195412+0000","last_became_active":"2024-04-26T12:08:42.716846+0000","last_became_peered":"2024-04-26T12:08:42.716846+0000","last_unstale":"2024-04-26T12:09:25.195412+0000","last_undegraded":"2024-04-26T12:09:25.195412+0000","last_fullsized":"2024-04-26T12:09:25.195412+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'424","last_scrub_stamp":"2024-04-26T12:09:25.195279+0000","last_deep_scrub":"60'424","last_deep_scrub_stamp":"2024-04-26T12:09:25.195279+0000","last_clean_scrub_stamp":"2024-04-26T12:09:25.195279+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:09.224012+0000","scrub_duration":0.00220163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13930,"num_write":388,"num_write_kb":116055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'426","reported_seq":918,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:08.468648+0000","last_change":"2024-04-26T12:09:08.468648+0000","last_active":"2024-04-26T12:09:08.468648+0000","last_peered":"2024-04-26T12:09:08.468648+0000","last_clean":"2024-04-26T12:09:08.468648+0000","last_became_active":"2024-04-26T12:08:53.747215+0000","last_became_peered":"2024-04-26T12:08:53.747215+0000","last_unstale":"2024-04-26T12:09:08.468648+0000","last_undegraded":"2024-04-26T12:09:08.468648+0000","last_fullsized":"2024-04-26T12:09:08.468648+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'426","last_scrub_stamp":"2024-04-26T12:09:08.468482+0000","last_deep_scrub":"60'426","last_deep_scrub_stamp":"2024-04-26T12:09:08.468482+0000","last_clean_scrub_stamp":"2024-04-26T12:09:08.468482+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:56.032283+0000","scrub_duration":0.0021666569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26908,"num_write":383,"num_write_kb":71324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"60'425","reported_seq":559,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:08.446169+0000","last_change":"2024-04-26T12:09:08.446169+0000","last_active":"2024-04-26T12:09:08.446169+0000","last_peered":"2024-04-26T12:09:08.446169+0000","last_clean":"2024-04-26T12:09:08.446169+0000","last_became_active":"2024-04-26T12:05:03.791061+0000","last_became_peered":"2024-04-26T12:05:03.791061+0000","last_unstale":"2024-04-26T12:09:08.446169+0000","last_undegraded":"2024-04-26T12:09:08.446169+0000","last_fullsized":"2024-04-26T12:09:08.446169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'425","last_scrub_stamp":"2024-04-26T12:09:08.446023+0000","last_deep_scrub":"60'425","last_deep_scrub_stamp":"2024-04-26T12:09:08.446023+0000","last_clean_scrub_stamp":"2024-04-26T12:09:08.446023+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:29.700242+0000","scrub_duration":0.002826112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19715,"num_write":398,"num_write_kb":30150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'450","reported_seq":651,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:45.764985+0000","last_change":"2024-04-26T12:09:45.765084+0000","last_active":"2024-04-26T12:09:45.764985+0000","last_peered":"2024-04-26T12:09:45.764985+0000","last_clean":"2024-04-26T12:09:45.764985+0000","last_became_active":"2024-04-26T12:05:03.791693+0000","last_became_peered":"2024-04-26T12:05:03.791693+0000","last_unstale":"2024-04-26T12:09:45.764985+0000","last_undegraded":"2024-04-26T12:09:45.764985+0000","last_fullsized":"2024-04-26T12:09:45.764985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'450","last_scrub_stamp":"2024-04-26T12:09:45.764962+0000","last_deep_scrub":"60'450","last_deep_scrub_stamp":"2024-04-26T12:09:45.764962+0000","last_clean_scrub_stamp":"2024-04-26T12:09:45.764962+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:21.995938+0000","scrub_duration":0.002787449,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":65124,"num_write":423,"num_write_kb":142714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'434","reported_seq":551,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:33.944792+0000","last_change":"2024-04-26T12:10:33.944792+0000","last_active":"2024-04-26T12:10:33.944792+0000","last_peered":"2024-04-26T12:10:33.944792+0000","last_clean":"2024-04-26T12:10:33.944792+0000","last_became_active":"2024-04-26T12:08:46.728804+0000","last_became_peered":"2024-04-26T12:08:46.728804+0000","last_unstale":"2024-04-26T12:10:33.944792+0000","last_undegraded":"2024-04-26T12:10:33.944792+0000","last_fullsized":"2024-04-26T12:10:33.944792+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'434","last_scrub_stamp":"2024-04-26T12:10:33.944665+0000","last_deep_scrub":"60'434","last_deep_scrub_stamp":"2024-04-26T12:10:33.944665+0000","last_clean_scrub_stamp":"2024-04-26T12:10:33.944665+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:57.652067+0000","scrub_duration":0.0023273069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":15350,"num_write":405,"num_write_kb":59295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"60'424","reported_seq":550,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:09.556371+0000","last_change":"2024-04-26T12:10:09.556503+0000","last_active":"2024-04-26T12:10:09.556371+0000","last_peered":"2024-04-26T12:10:09.556371+0000","last_clean":"2024-04-26T12:10:09.556371+0000","last_became_active":"2024-04-26T12:05:03.788050+0000","last_became_peered":"2024-04-26T12:05:03.788050+0000","last_unstale":"2024-04-26T12:10:09.556371+0000","last_undegraded":"2024-04-26T12:10:09.556371+0000","last_fullsized":"2024-04-26T12:10:09.556371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'424","last_scrub_stamp":"2024-04-26T12:10:09.556349+0000","last_deep_scrub":"60'424","last_deep_scrub_stamp":"2024-04-26T12:10:09.556349+0000","last_clean_scrub_stamp":"2024-04-26T12:10:09.556349+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:05.369051+0000","scrub_duration":0.002611426,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23772,"num_write":390,"num_write_kb":67944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"60'447","reported_seq":539,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:32.921034+0000","last_change":"2024-04-26T12:10:32.921034+0000","last_active":"2024-04-26T12:10:32.921034+0000","last_peered":"2024-04-26T12:10:32.921034+0000","last_clean":"2024-04-26T12:10:32.921034+0000","last_became_active":"2024-04-26T12:08:40.703880+0000","last_became_peered":"2024-04-26T12:08:40.703880+0000","last_unstale":"2024-04-26T12:10:32.921034+0000","last_undegraded":"2024-04-26T12:10:32.921034+0000","last_fullsized":"2024-04-26T12:10:32.921034+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'447","last_scrub_stamp":"2024-04-26T12:10:32.920884+0000","last_deep_scrub":"60'447","last_deep_scrub_stamp":"2024-04-26T12:10:32.920884+0000","last_clean_scrub_stamp":"2024-04-26T12:10:32.920884+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:30.472266+0000","scrub_duration":0.0023715390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9403,"num_write":417,"num_write_kb":67425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"60'417","reported_seq":520,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:26.148378+0000","last_change":"2024-04-26T12:09:26.148378+0000","last_active":"2024-04-26T12:09:26.148378+0000","last_peered":"2024-04-26T12:09:26.148378+0000","last_clean":"2024-04-26T12:09:26.148378+0000","last_became_active":"2024-04-26T12:08:42.715812+0000","last_became_peered":"2024-04-26T12:08:42.715812+0000","last_unstale":"2024-04-26T12:09:26.148378+0000","last_undegraded":"2024-04-26T12:09:26.148378+0000","last_fullsized":"2024-04-26T12:09:26.148378+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'417","last_scrub_stamp":"2024-04-26T12:09:26.148189+0000","last_deep_scrub":"60'417","last_deep_scrub_stamp":"2024-04-26T12:09:26.148189+0000","last_clean_scrub_stamp":"2024-04-26T12:09:26.148189+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:12.073223+0000","scrub_duration":0.001950418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20466,"num_write":400,"num_write_kb":42225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"60'475","reported_seq":617,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.500379+0000","last_change":"2024-04-26T12:09:06.500379+0000","last_active":"2024-04-26T12:09:06.500379+0000","last_peered":"2024-04-26T12:09:06.500379+0000","last_clean":"2024-04-26T12:09:06.500379+0000","last_became_active":"2024-04-26T12:05:03.787562+0000","last_became_peered":"2024-04-26T12:05:03.787562+0000","last_unstale":"2024-04-26T12:09:06.500379+0000","last_undegraded":"2024-04-26T12:09:06.500379+0000","last_fullsized":"2024-04-26T12:09:06.500379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'475","last_scrub_stamp":"2024-04-26T12:09:06.500254+0000","last_deep_scrub":"60'475","last_deep_scrub_stamp":"2024-04-26T12:09:06.500254+0000","last_clean_scrub_stamp":"2024-04-26T12:09:06.500254+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:10.061304+0000","scrub_duration":0.002921515,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25186,"num_write":431,"num_write_kb":48184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"60'409","reported_seq":910,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:43.509832+0000","last_change":"2024-04-26T12:10:43.509971+0000","last_active":"2024-04-26T12:10:43.509832+0000","last_peered":"2024-04-26T12:10:43.509832+0000","last_clean":"2024-04-26T12:10:43.509832+0000","last_became_active":"2024-04-26T12:08:49.740497+0000","last_became_peered":"2024-04-26T12:08:49.740497+0000","last_unstale":"2024-04-26T12:10:43.509832+0000","last_undegraded":"2024-04-26T12:10:43.509832+0000","last_fullsized":"2024-04-26T12:10:43.509832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'409","last_scrub_stamp":"2024-04-26T12:10:43.509794+0000","last_deep_scrub":"60'409","last_deep_scrub_stamp":"2024-04-26T12:10:43.509794+0000","last_clean_scrub_stamp":"2024-04-26T12:10:43.509794+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:12.783359+0000","scrub_duration":0.0024653489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":20137,"num_write":374,"num_write_kb":55441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'392","reported_seq":506,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:47.061102+0000","last_change":"2024-04-26T12:09:47.061102+0000","last_active":"2024-04-26T12:09:47.061102+0000","last_peered":"2024-04-26T12:09:47.061102+0000","last_clean":"2024-04-26T12:09:47.061102+0000","last_became_active":"2024-04-26T12:08:47.735361+0000","last_became_peered":"2024-04-26T12:08:47.735361+0000","last_unstale":"2024-04-26T12:09:47.061102+0000","last_undegraded":"2024-04-26T12:09:47.061102+0000","last_fullsized":"2024-04-26T12:09:47.061102+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'392","last_scrub_stamp":"2024-04-26T12:09:47.060968+0000","last_deep_scrub":"60'392","last_deep_scrub_stamp":"2024-04-26T12:09:47.060968+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.060968+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:04.952295+0000","scrub_duration":0.0023190509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29179,"num_write":355,"num_write_kb":59011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'380","reported_seq":853,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:15.465302+0000","last_change":"2024-04-26T12:09:15.465302+0000","last_active":"2024-04-26T12:09:15.465302+0000","last_peered":"2024-04-26T12:09:15.465302+0000","last_clean":"2024-04-26T12:09:15.465302+0000","last_became_active":"2024-04-26T12:08:41.716234+0000","last_became_peered":"2024-04-26T12:08:41.716234+0000","last_unstale":"2024-04-26T12:09:15.465302+0000","last_undegraded":"2024-04-26T12:09:15.465302+0000","last_fullsized":"2024-04-26T12:09:15.465302+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'380","last_scrub_stamp":"2024-04-26T12:09:15.465164+0000","last_deep_scrub":"60'380","last_deep_scrub_stamp":"2024-04-26T12:09:15.465164+0000","last_clean_scrub_stamp":"2024-04-26T12:09:15.465164+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:49.168939+0000","scrub_duration":0.0024038250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13036,"num_write":347,"num_write_kb":33880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"60'461","reported_seq":578,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:10.990934+0000","last_change":"2024-04-26T12:09:10.990934+0000","last_active":"2024-04-26T12:09:10.990934+0000","last_peered":"2024-04-26T12:09:10.990934+0000","last_clean":"2024-04-26T12:09:10.990934+0000","last_became_active":"2024-04-26T12:08:46.730738+0000","last_became_peered":"2024-04-26T12:08:46.730738+0000","last_unstale":"2024-04-26T12:09:10.990934+0000","last_undegraded":"2024-04-26T12:09:10.990934+0000","last_fullsized":"2024-04-26T12:09:10.990934+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'461","last_scrub_stamp":"2024-04-26T12:09:10.990803+0000","last_deep_scrub":"60'461","last_deep_scrub_stamp":"2024-04-26T12:09:10.990803+0000","last_clean_scrub_stamp":"2024-04-26T12:09:10.990803+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:12.887104+0000","scrub_duration":0.0025321039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":32945,"num_write":426,"num_write_kb":63234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"60'411","reported_seq":914,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:43.659197+0000","last_change":"2024-04-26T12:09:43.659295+0000","last_active":"2024-04-26T12:09:43.659197+0000","last_peered":"2024-04-26T12:09:43.659197+0000","last_clean":"2024-04-26T12:09:43.659197+0000","last_became_active":"2024-04-26T12:08:40.703845+0000","last_became_peered":"2024-04-26T12:08:40.703845+0000","last_unstale":"2024-04-26T12:09:43.659197+0000","last_undegraded":"2024-04-26T12:09:43.659197+0000","last_fullsized":"2024-04-26T12:09:43.659197+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'411","last_scrub_stamp":"2024-04-26T12:09:43.659173+0000","last_deep_scrub":"60'411","last_deep_scrub_stamp":"2024-04-26T12:09:43.659173+0000","last_clean_scrub_stamp":"2024-04-26T12:09:43.659173+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:23.114338+0000","scrub_duration":0.002345588,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11499,"num_write":377,"num_write_kb":34249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'430","reported_seq":551,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:11.555369+0000","last_change":"2024-04-26T12:10:11.555537+0000","last_active":"2024-04-26T12:10:11.555369+0000","last_peered":"2024-04-26T12:10:11.555369+0000","last_clean":"2024-04-26T12:10:11.555369+0000","last_became_active":"2024-04-26T12:05:03.791251+0000","last_became_peered":"2024-04-26T12:05:03.791251+0000","last_unstale":"2024-04-26T12:10:11.555369+0000","last_undegraded":"2024-04-26T12:10:11.555369+0000","last_fullsized":"2024-04-26T12:10:11.555369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'430","last_scrub_stamp":"2024-04-26T12:10:11.555345+0000","last_deep_scrub":"60'430","last_deep_scrub_stamp":"2024-04-26T12:10:11.555345+0000","last_clean_scrub_stamp":"2024-04-26T12:10:11.555345+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:09.743398+0000","scrub_duration":0.0028183980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14660,"num_write":404,"num_write_kb":60840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"60'392","reported_seq":513,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:25.976346+0000","last_change":"2024-04-26T12:10:25.976346+0000","last_active":"2024-04-26T12:10:25.976346+0000","last_peered":"2024-04-26T12:10:25.976346+0000","last_clean":"2024-04-26T12:10:25.976346+0000","last_became_active":"2024-04-26T12:08:44.722120+0000","last_became_peered":"2024-04-26T12:08:44.722120+0000","last_unstale":"2024-04-26T12:10:25.976346+0000","last_undegraded":"2024-04-26T12:10:25.976346+0000","last_fullsized":"2024-04-26T12:10:25.976346+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'392","last_scrub_stamp":"2024-04-26T12:10:25.976225+0000","last_deep_scrub":"60'392","last_deep_scrub_stamp":"2024-04-26T12:10:25.976225+0000","last_clean_scrub_stamp":"2024-04-26T12:10:25.976225+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:30.313655+0000","scrub_duration":0.0024233079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31703,"num_write":351,"num_write_kb":59324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"84'518","reported_seq":609,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:56.653065+0000","last_change":"2024-04-26T12:09:56.653170+0000","last_active":"2024-04-26T12:09:56.653065+0000","last_peered":"2024-04-26T12:09:56.653065+0000","last_clean":"2024-04-26T12:09:56.653065+0000","last_became_active":"2024-04-26T12:05:03.429695+0000","last_became_peered":"2024-04-26T12:05:03.429695+0000","last_unstale":"2024-04-26T12:09:56.653065+0000","last_undegraded":"2024-04-26T12:09:56.653065+0000","last_fullsized":"2024-04-26T12:09:56.653065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'518","last_scrub_stamp":"2024-04-26T12:09:56.653042+0000","last_deep_scrub":"84'518","last_deep_scrub_stamp":"2024-04-26T12:09:56.653042+0000","last_clean_scrub_stamp":"2024-04-26T12:09:56.653042+0000","objects_scrubbed":4,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:18.886927+0000","scrub_duration":0.02530226,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":8377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'432","reported_seq":535,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:52.096505+0000","last_change":"2024-04-26T12:09:52.096505+0000","last_active":"2024-04-26T12:09:52.096505+0000","last_peered":"2024-04-26T12:09:52.096505+0000","last_clean":"2024-04-26T12:09:52.096505+0000","last_became_active":"2024-04-26T12:08:53.748972+0000","last_became_peered":"2024-04-26T12:08:53.748972+0000","last_unstale":"2024-04-26T12:09:52.096505+0000","last_undegraded":"2024-04-26T12:09:52.096505+0000","last_fullsized":"2024-04-26T12:09:52.096505+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'432","last_scrub_stamp":"2024-04-26T12:09:52.096365+0000","last_deep_scrub":"60'432","last_deep_scrub_stamp":"2024-04-26T12:09:52.096365+0000","last_clean_scrub_stamp":"2024-04-26T12:09:52.096365+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:25.671316+0000","scrub_duration":0.0023424370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":30094,"num_write":388,"num_write_kb":83741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"59'55","reported_seq":146,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:34.731942+0000","last_change":"2024-04-26T12:09:34.731942+0000","last_active":"2024-04-26T12:09:34.731942+0000","last_peered":"2024-04-26T12:09:34.731942+0000","last_clean":"2024-04-26T12:09:34.731942+0000","last_became_active":"2024-04-26T12:05:03.428098+0000","last_became_peered":"2024-04-26T12:05:03.428098+0000","last_unstale":"2024-04-26T12:09:34.731942+0000","last_undegraded":"2024-04-26T12:09:34.731942+0000","last_fullsized":"2024-04-26T12:09:34.731942+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'55","last_scrub_stamp":"2024-04-26T12:09:34.731815+0000","last_deep_scrub":"59'55","last_deep_scrub_stamp":"2024-04-26T12:09:34.731815+0000","last_clean_scrub_stamp":"2024-04-26T12:09:34.731815+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:35.655136+0000","scrub_duration":0.0016482490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"60'445","reported_seq":570,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:07.498568+0000","last_change":"2024-04-26T12:09:07.498568+0000","last_active":"2024-04-26T12:09:07.498568+0000","last_peered":"2024-04-26T12:09:07.498568+0000","last_clean":"2024-04-26T12:09:07.498568+0000","last_became_active":"2024-04-26T12:05:03.788039+0000","last_became_peered":"2024-04-26T12:05:03.788039+0000","last_unstale":"2024-04-26T12:09:07.498568+0000","last_undegraded":"2024-04-26T12:09:07.498568+0000","last_fullsized":"2024-04-26T12:09:07.498568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'445","last_scrub_stamp":"2024-04-26T12:09:07.498444+0000","last_deep_scrub":"60'445","last_deep_scrub_stamp":"2024-04-26T12:09:07.498444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:07.498444+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:34:55.801469+0000","scrub_duration":0.002448759,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":16079,"num_write":410,"num_write_kb":75550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"59'64","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:23.224938+0000","last_change":"2024-04-26T12:09:23.224938+0000","last_active":"2024-04-26T12:09:23.224938+0000","last_peered":"2024-04-26T12:09:23.224938+0000","last_clean":"2024-04-26T12:09:23.224938+0000","last_became_active":"2024-04-26T12:08:36.694921+0000","last_became_peered":"2024-04-26T12:08:36.694921+0000","last_unstale":"2024-04-26T12:09:23.224938+0000","last_undegraded":"2024-04-26T12:09:23.224938+0000","last_fullsized":"2024-04-26T12:09:23.224938+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'64","last_scrub_stamp":"2024-04-26T12:09:23.224815+0000","last_deep_scrub":"59'64","last_deep_scrub_stamp":"2024-04-26T12:09:23.224815+0000","last_clean_scrub_stamp":"2024-04-26T12:09:23.224815+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:34.040977+0000","scrub_duration":0.0015803169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"60'420","reported_seq":550,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:17.735411+0000","last_change":"2024-04-26T12:10:17.735525+0000","last_active":"2024-04-26T12:10:17.735411+0000","last_peered":"2024-04-26T12:10:17.735411+0000","last_clean":"2024-04-26T12:10:17.735411+0000","last_became_active":"2024-04-26T12:05:03.788184+0000","last_became_peered":"2024-04-26T12:05:03.788184+0000","last_unstale":"2024-04-26T12:10:17.735411+0000","last_undegraded":"2024-04-26T12:10:17.735411+0000","last_fullsized":"2024-04-26T12:10:17.735411+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'420","last_scrub_stamp":"2024-04-26T12:10:17.735388+0000","last_deep_scrub":"60'420","last_deep_scrub_stamp":"2024-04-26T12:10:17.735388+0000","last_clean_scrub_stamp":"2024-04-26T12:10:17.735388+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:44:01.060779+0000","scrub_duration":0.0022698190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":14666,"num_write":383,"num_write_kb":83769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"84'67","reported_seq":172,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:30.700334+0000","last_change":"2024-04-26T12:10:30.700440+0000","last_active":"2024-04-26T12:10:30.700334+0000","last_peered":"2024-04-26T12:10:30.700334+0000","last_clean":"2024-04-26T12:10:30.700334+0000","last_became_active":"2024-04-26T12:08:36.696792+0000","last_became_peered":"2024-04-26T12:08:36.696792+0000","last_unstale":"2024-04-26T12:10:30.700334+0000","last_undegraded":"2024-04-26T12:10:30.700334+0000","last_fullsized":"2024-04-26T12:10:30.700334+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'67","last_scrub_stamp":"2024-04-26T12:10:30.700312+0000","last_deep_scrub":"84'67","last_deep_scrub_stamp":"2024-04-26T12:10:30.700312+0000","last_clean_scrub_stamp":"2024-04-26T12:10:30.700312+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:32:44.053255+0000","scrub_duration":0.0092870810000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"84'234","reported_seq":350,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:00.696683+0000","last_change":"2024-04-26T12:10:00.696834+0000","last_active":"2024-04-26T12:10:00.696683+0000","last_peered":"2024-04-26T12:10:00.696683+0000","last_clean":"2024-04-26T12:10:00.696683+0000","last_became_active":"2024-04-26T12:08:39.703455+0000","last_became_peered":"2024-04-26T12:08:39.703455+0000","last_unstale":"2024-04-26T12:10:00.696683+0000","last_undegraded":"2024-04-26T12:10:00.696683+0000","last_fullsized":"2024-04-26T12:10:00.696683+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'234","last_scrub_stamp":"2024-04-26T12:10:00.696661+0000","last_deep_scrub":"84'234","last_deep_scrub_stamp":"2024-04-26T12:10:00.696661+0000","last_clean_scrub_stamp":"2024-04-26T12:10:00.696661+0000","objects_scrubbed":2,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:40.151826+0000","scrub_duration":0.014858877,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'408","reported_seq":504,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:45.690537+0000","last_change":"2024-04-26T12:10:45.690679+0000","last_active":"2024-04-26T12:10:45.690537+0000","last_peered":"2024-04-26T12:10:45.690537+0000","last_clean":"2024-04-26T12:10:45.690537+0000","last_became_active":"2024-04-26T12:08:40.707357+0000","last_became_peered":"2024-04-26T12:08:40.707357+0000","last_unstale":"2024-04-26T12:10:45.690537+0000","last_undegraded":"2024-04-26T12:10:45.690537+0000","last_fullsized":"2024-04-26T12:10:45.690537+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'408","last_scrub_stamp":"2024-04-26T12:10:45.690501+0000","last_deep_scrub":"60'408","last_deep_scrub_stamp":"2024-04-26T12:10:45.690501+0000","last_clean_scrub_stamp":"2024-04-26T12:10:45.690501+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:05.764620+0000","scrub_duration":0.0022656030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12418,"num_write":371,"num_write_kb":58378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"84'304","reported_seq":385,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:57.079715+0000","last_change":"2024-04-26T12:09:57.079715+0000","last_active":"2024-04-26T12:09:57.079715+0000","last_peered":"2024-04-26T12:09:57.079715+0000","last_clean":"2024-04-26T12:09:57.079715+0000","last_became_active":"2024-04-26T12:08:39.703421+0000","last_became_peered":"2024-04-26T12:08:39.703421+0000","last_unstale":"2024-04-26T12:09:57.079715+0000","last_undegraded":"2024-04-26T12:09:57.079715+0000","last_fullsized":"2024-04-26T12:09:57.079715+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'304","last_scrub_stamp":"2024-04-26T12:09:57.079584+0000","last_deep_scrub":"84'304","last_deep_scrub_stamp":"2024-04-26T12:09:57.079584+0000","last_clean_scrub_stamp":"2024-04-26T12:09:57.079584+0000","objects_scrubbed":2,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:49.321329+0000","scrub_duration":0.016873233000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":4228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'439","reported_seq":511,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:11.912239+0000","last_change":"2024-04-26T12:10:11.912239+0000","last_active":"2024-04-26T12:10:11.912239+0000","last_peered":"2024-04-26T12:10:11.912239+0000","last_clean":"2024-04-26T12:10:11.912239+0000","last_became_active":"2024-04-26T12:08:41.715708+0000","last_became_peered":"2024-04-26T12:08:41.715708+0000","last_unstale":"2024-04-26T12:10:11.912239+0000","last_undegraded":"2024-04-26T12:10:11.912239+0000","last_fullsized":"2024-04-26T12:10:11.912239+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'439","last_scrub_stamp":"2024-04-26T12:10:11.912130+0000","last_deep_scrub":"60'439","last_deep_scrub_stamp":"2024-04-26T12:10:11.912130+0000","last_clean_scrub_stamp":"2024-04-26T12:10:11.912130+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:56.110904+0000","scrub_duration":0.001792173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":30851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"84'591","reported_seq":707,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:39.824129+0000","last_change":"2024-04-26T12:09:39.824222+0000","last_active":"2024-04-26T12:09:39.824129+0000","last_peered":"2024-04-26T12:09:39.824129+0000","last_clean":"2024-04-26T12:09:39.824129+0000","last_became_active":"2024-04-26T12:08:39.703487+0000","last_became_peered":"2024-04-26T12:08:39.703487+0000","last_unstale":"2024-04-26T12:09:39.824129+0000","last_undegraded":"2024-04-26T12:09:39.824129+0000","last_fullsized":"2024-04-26T12:09:39.824129+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'591","last_scrub_stamp":"2024-04-26T12:09:39.824106+0000","last_deep_scrub":"84'591","last_deep_scrub_stamp":"2024-04-26T12:09:39.824106+0000","last_clean_scrub_stamp":"2024-04-26T12:09:39.824106+0000","objects_scrubbed":2,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:04.327252+0000","scrub_duration":0.019073356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":534,"num_write_kb":4333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'461","reported_seq":627,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:39.610336+0000","last_change":"2024-04-26T12:10:39.610438+0000","last_active":"2024-04-26T12:10:39.610336+0000","last_peered":"2024-04-26T12:10:39.610336+0000","last_clean":"2024-04-26T12:10:39.610336+0000","last_became_active":"2024-04-26T12:05:03.791272+0000","last_became_peered":"2024-04-26T12:05:03.791272+0000","last_unstale":"2024-04-26T12:10:39.610336+0000","last_undegraded":"2024-04-26T12:10:39.610336+0000","last_fullsized":"2024-04-26T12:10:39.610336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'461","last_scrub_stamp":"2024-04-26T12:10:39.610313+0000","last_deep_scrub":"60'461","last_deep_scrub_stamp":"2024-04-26T12:10:39.610313+0000","last_clean_scrub_stamp":"2024-04-26T12:10:39.610313+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:16.900279+0000","scrub_duration":0.0032001740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":46123,"num_write":422,"num_write_kb":104552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"59'66","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:10.526380+0000","last_change":"2024-04-26T12:10:10.526479+0000","last_active":"2024-04-26T12:10:10.526380+0000","last_peered":"2024-04-26T12:10:10.526380+0000","last_clean":"2024-04-26T12:10:10.526380+0000","last_became_active":"2024-04-26T12:05:03.429291+0000","last_became_peered":"2024-04-26T12:05:03.429291+0000","last_unstale":"2024-04-26T12:10:10.526380+0000","last_undegraded":"2024-04-26T12:10:10.526380+0000","last_fullsized":"2024-04-26T12:10:10.526380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'66","last_scrub_stamp":"2024-04-26T12:10:10.526357+0000","last_deep_scrub":"59'66","last_deep_scrub_stamp":"2024-04-26T12:10:10.526357+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.526357+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:22.596661+0000","scrub_duration":0.0016798259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'428","reported_seq":554,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:41.623180+0000","last_change":"2024-04-26T12:09:41.623284+0000","last_active":"2024-04-26T12:09:41.623180+0000","last_peered":"2024-04-26T12:09:41.623180+0000","last_clean":"2024-04-26T12:09:41.623180+0000","last_became_active":"2024-04-26T12:05:03.787772+0000","last_became_peered":"2024-04-26T12:05:03.787772+0000","last_unstale":"2024-04-26T12:09:41.623180+0000","last_undegraded":"2024-04-26T12:09:41.623180+0000","last_fullsized":"2024-04-26T12:09:41.623180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'428","last_scrub_stamp":"2024-04-26T12:09:41.623156+0000","last_deep_scrub":"60'428","last_deep_scrub_stamp":"2024-04-26T12:09:41.623156+0000","last_clean_scrub_stamp":"2024-04-26T12:09:41.623156+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:27.740926+0000","scrub_duration":0.0027090880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15098,"num_write":394,"num_write_kb":42677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"84'198","reported_seq":289,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:56.557371+0000","last_change":"2024-04-26T12:09:56.557500+0000","last_active":"2024-04-26T12:09:56.557371+0000","last_peered":"2024-04-26T12:09:56.557371+0000","last_clean":"2024-04-26T12:09:56.557371+0000","last_became_active":"2024-04-26T12:05:03.430855+0000","last_became_peered":"2024-04-26T12:05:03.430855+0000","last_unstale":"2024-04-26T12:09:56.557371+0000","last_undegraded":"2024-04-26T12:09:56.557371+0000","last_fullsized":"2024-04-26T12:09:56.557371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'198","last_scrub_stamp":"2024-04-26T12:09:56.557334+0000","last_deep_scrub":"84'198","last_deep_scrub_stamp":"2024-04-26T12:09:56.557334+0000","last_clean_scrub_stamp":"2024-04-26T12:09:56.557334+0000","objects_scrubbed":3,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:47.167351+0000","scrub_duration":0.021508201000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"60'448","reported_seq":557,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:58.706684+0000","last_change":"2024-04-26T12:09:58.706808+0000","last_active":"2024-04-26T12:09:58.706684+0000","last_peered":"2024-04-26T12:09:58.706684+0000","last_clean":"2024-04-26T12:09:58.706684+0000","last_became_active":"2024-04-26T12:05:03.792119+0000","last_became_peered":"2024-04-26T12:05:03.792119+0000","last_unstale":"2024-04-26T12:09:58.706684+0000","last_undegraded":"2024-04-26T12:09:58.706684+0000","last_fullsized":"2024-04-26T12:09:58.706684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'448","last_scrub_stamp":"2024-04-26T12:09:58.706659+0000","last_deep_scrub":"60'448","last_deep_scrub_stamp":"2024-04-26T12:09:58.706659+0000","last_clean_scrub_stamp":"2024-04-26T12:09:58.706659+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:56.343142+0000","scrub_duration":0.0026622880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":13281,"num_write":420,"num_write_kb":59540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"84'172","reported_seq":263,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:35.685420+0000","last_change":"2024-04-26T12:10:35.685528+0000","last_active":"2024-04-26T12:10:35.685420+0000","last_peered":"2024-04-26T12:10:35.685420+0000","last_clean":"2024-04-26T12:10:35.685420+0000","last_became_active":"2024-04-26T12:05:03.429469+0000","last_became_peered":"2024-04-26T12:05:03.429469+0000","last_unstale":"2024-04-26T12:10:35.685420+0000","last_undegraded":"2024-04-26T12:10:35.685420+0000","last_fullsized":"2024-04-26T12:10:35.685420+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'172","last_scrub_stamp":"2024-04-26T12:10:35.685398+0000","last_deep_scrub":"84'172","last_deep_scrub_stamp":"2024-04-26T12:10:35.685398+0000","last_clean_scrub_stamp":"2024-04-26T12:10:35.685398+0000","objects_scrubbed":1,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:47.794305+0000","scrub_duration":0.012639202,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'412","reported_seq":936,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:17.500764+0000","last_change":"2024-04-26T12:09:17.500764+0000","last_active":"2024-04-26T12:09:17.500764+0000","last_peered":"2024-04-26T12:09:17.500764+0000","last_clean":"2024-04-26T12:09:17.500764+0000","last_became_active":"2024-04-26T12:08:51.751044+0000","last_became_peered":"2024-04-26T12:08:51.751044+0000","last_unstale":"2024-04-26T12:09:17.500764+0000","last_undegraded":"2024-04-26T12:09:17.500764+0000","last_fullsized":"2024-04-26T12:09:17.500764+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'412","last_scrub_stamp":"2024-04-26T12:09:17.500623+0000","last_deep_scrub":"60'412","last_deep_scrub_stamp":"2024-04-26T12:09:17.500623+0000","last_clean_scrub_stamp":"2024-04-26T12:09:17.500623+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:05.606930+0000","scrub_duration":0.0024460179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26310,"num_write":380,"num_write_kb":38462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"59'55","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:12.951850+0000","last_change":"2024-04-26T12:10:12.951850+0000","last_active":"2024-04-26T12:10:12.951850+0000","last_peered":"2024-04-26T12:10:12.951850+0000","last_clean":"2024-04-26T12:10:12.951850+0000","last_became_active":"2024-04-26T12:08:36.694346+0000","last_became_peered":"2024-04-26T12:08:36.694346+0000","last_unstale":"2024-04-26T12:10:12.951850+0000","last_undegraded":"2024-04-26T12:10:12.951850+0000","last_fullsized":"2024-04-26T12:10:12.951850+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'55","last_scrub_stamp":"2024-04-26T12:10:12.951726+0000","last_deep_scrub":"59'55","last_deep_scrub_stamp":"2024-04-26T12:10:12.951726+0000","last_clean_scrub_stamp":"2024-04-26T12:10:12.951726+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:34.042702+0000","scrub_duration":0.0020193070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"60'362","reported_seq":830,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:07.539506+0000","last_change":"2024-04-26T12:10:07.539641+0000","last_active":"2024-04-26T12:10:07.539506+0000","last_peered":"2024-04-26T12:10:07.539506+0000","last_clean":"2024-04-26T12:10:07.539506+0000","last_became_active":"2024-04-26T12:08:41.716102+0000","last_became_peered":"2024-04-26T12:08:41.716102+0000","last_unstale":"2024-04-26T12:10:07.539506+0000","last_undegraded":"2024-04-26T12:10:07.539506+0000","last_fullsized":"2024-04-26T12:10:07.539506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'362","last_scrub_stamp":"2024-04-26T12:10:07.539483+0000","last_deep_scrub":"60'362","last_deep_scrub_stamp":"2024-04-26T12:10:07.539483+0000","last_clean_scrub_stamp":"2024-04-26T12:10:07.539483+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:41.491924+0000","scrub_duration":0.0023643050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21408,"num_write":333,"num_write_kb":66549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"84'379","reported_seq":453,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:39.799310+0000","last_change":"2024-04-26T12:10:39.799310+0000","last_active":"2024-04-26T12:10:39.799310+0000","last_peered":"2024-04-26T12:10:39.799310+0000","last_clean":"2024-04-26T12:10:39.799310+0000","last_became_active":"2024-04-26T12:08:39.702438+0000","last_became_peered":"2024-04-26T12:08:39.702438+0000","last_unstale":"2024-04-26T12:10:39.799310+0000","last_undegraded":"2024-04-26T12:10:39.799310+0000","last_fullsized":"2024-04-26T12:10:39.799310+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'379","last_scrub_stamp":"2024-04-26T12:10:39.799182+0000","last_deep_scrub":"84'379","last_deep_scrub_stamp":"2024-04-26T12:10:39.799182+0000","last_clean_scrub_stamp":"2024-04-26T12:10:39.799182+0000","objects_scrubbed":1,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:32.371755+0000","scrub_duration":0.017525066999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"60'407","reported_seq":930,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:15.702685+0000","last_change":"2024-04-26T12:10:15.702794+0000","last_active":"2024-04-26T12:10:15.702685+0000","last_peered":"2024-04-26T12:10:15.702685+0000","last_clean":"2024-04-26T12:10:15.702685+0000","last_became_active":"2024-04-26T12:08:45.723772+0000","last_became_peered":"2024-04-26T12:08:45.723772+0000","last_unstale":"2024-04-26T12:10:15.702685+0000","last_undegraded":"2024-04-26T12:10:15.702685+0000","last_fullsized":"2024-04-26T12:10:15.702685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'407","last_scrub_stamp":"2024-04-26T12:10:15.702660+0000","last_deep_scrub":"60'407","last_deep_scrub_stamp":"2024-04-26T12:10:15.702660+0000","last_clean_scrub_stamp":"2024-04-26T12:10:15.702660+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:27.811568+0000","scrub_duration":0.0020706520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":40156,"num_write":373,"num_write_kb":91285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"84'159","reported_seq":309,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:22.613268+0000","last_change":"2024-04-26T12:10:22.613268+0000","last_active":"2024-04-26T12:10:22.613268+0000","last_peered":"2024-04-26T12:10:22.613268+0000","last_clean":"2024-04-26T12:10:22.613268+0000","last_became_active":"2024-04-26T12:08:36.697508+0000","last_became_peered":"2024-04-26T12:08:36.697508+0000","last_unstale":"2024-04-26T12:10:22.613268+0000","last_undegraded":"2024-04-26T12:10:22.613268+0000","last_fullsized":"2024-04-26T12:10:22.613268+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'159","last_scrub_stamp":"2024-04-26T12:10:22.613133+0000","last_deep_scrub":"84'159","last_deep_scrub_stamp":"2024-04-26T12:10:22.613133+0000","last_clean_scrub_stamp":"2024-04-26T12:10:22.613133+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:47.395680+0000","scrub_duration":0.0046459420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":94,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:24.620738+0000","last_change":"2024-04-26T12:10:24.620835+0000","last_active":"2024-04-26T12:10:24.620738+0000","last_peered":"2024-04-26T12:10:24.620738+0000","last_clean":"2024-04-26T12:10:24.620738+0000","last_became_active":"2024-04-26T12:04:59.403367+0000","last_became_peered":"2024-04-26T12:04:59.403367+0000","last_unstale":"2024-04-26T12:10:24.620738+0000","last_undegraded":"2024-04-26T12:10:24.620738+0000","last_fullsized":"2024-04-26T12:10:24.620738+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:24.620718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:24.620718+0000","last_clean_scrub_stamp":"2024-04-26T12:10:24.620718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:47.548783+0000","scrub_duration":0.0019450089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"84'795","reported_seq":912,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:02.576016+0000","last_change":"2024-04-26T12:10:02.576130+0000","last_active":"2024-04-26T12:10:02.576016+0000","last_peered":"2024-04-26T12:10:02.576016+0000","last_clean":"2024-04-26T12:10:02.576016+0000","last_became_active":"2024-04-26T12:08:39.701760+0000","last_became_peered":"2024-04-26T12:08:39.701760+0000","last_unstale":"2024-04-26T12:10:02.576016+0000","last_undegraded":"2024-04-26T12:10:02.576016+0000","last_fullsized":"2024-04-26T12:10:02.576016+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'795","last_scrub_stamp":"2024-04-26T12:10:02.575986+0000","last_deep_scrub":"84'795","last_deep_scrub_stamp":"2024-04-26T12:10:02.575986+0000","last_clean_scrub_stamp":"2024-04-26T12:10:02.575986+0000","objects_scrubbed":2,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:07.133416+0000","scrub_duration":0.029735391,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":8533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"60'466","reported_seq":1025,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:03.603760+0000","last_change":"2024-04-26T12:10:03.603869+0000","last_active":"2024-04-26T12:10:03.603760+0000","last_peered":"2024-04-26T12:10:03.603760+0000","last_clean":"2024-04-26T12:10:03.603760+0000","last_became_active":"2024-04-26T12:08:52.746147+0000","last_became_peered":"2024-04-26T12:08:52.746147+0000","last_unstale":"2024-04-26T12:10:03.603760+0000","last_undegraded":"2024-04-26T12:10:03.603760+0000","last_fullsized":"2024-04-26T12:10:03.603760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'466","last_scrub_stamp":"2024-04-26T12:10:03.603739+0000","last_deep_scrub":"60'466","last_deep_scrub_stamp":"2024-04-26T12:10:03.603739+0000","last_clean_scrub_stamp":"2024-04-26T12:10:03.603739+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:57.843220+0000","scrub_duration":0.001899956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":37547,"num_write":422,"num_write_kb":96579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":108,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:23.660004+0000","last_change":"2024-04-26T12:10:23.660004+0000","last_active":"2024-04-26T12:10:23.660004+0000","last_peered":"2024-04-26T12:10:23.660004+0000","last_clean":"2024-04-26T12:10:23.660004+0000","last_became_active":"2024-04-26T12:08:36.695444+0000","last_became_peered":"2024-04-26T12:08:36.695444+0000","last_unstale":"2024-04-26T12:10:23.660004+0000","last_undegraded":"2024-04-26T12:10:23.660004+0000","last_fullsized":"2024-04-26T12:10:23.660004+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:23.659860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:23.659860+0000","last_clean_scrub_stamp":"2024-04-26T12:10:23.659860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:06.398224+0000","scrub_duration":0.001542444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"84'115","reported_seq":253,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:03.595427+0000","last_change":"2024-04-26T12:10:03.595540+0000","last_active":"2024-04-26T12:10:03.595427+0000","last_peered":"2024-04-26T12:10:03.595427+0000","last_clean":"2024-04-26T12:10:03.595427+0000","last_became_active":"2024-04-26T12:05:03.427985+0000","last_became_peered":"2024-04-26T12:05:03.427985+0000","last_unstale":"2024-04-26T12:10:03.595427+0000","last_undegraded":"2024-04-26T12:10:03.595427+0000","last_fullsized":"2024-04-26T12:10:03.595427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'115","last_scrub_stamp":"2024-04-26T12:10:03.595404+0000","last_deep_scrub":"84'115","last_deep_scrub_stamp":"2024-04-26T12:10:03.595404+0000","last_clean_scrub_stamp":"2024-04-26T12:10:03.595404+0000","objects_scrubbed":1,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:28.377952+0000","scrub_duration":0.0064998820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466015,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":47,"num_write_kb":1464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"60'492","reported_seq":668,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:06.067244+0000","last_change":"2024-04-26T12:09:06.067244+0000","last_active":"2024-04-26T12:09:06.067244+0000","last_peered":"2024-04-26T12:09:06.067244+0000","last_clean":"2024-04-26T12:09:06.067244+0000","last_became_active":"2024-04-26T12:08:49.739496+0000","last_became_peered":"2024-04-26T12:08:49.739496+0000","last_unstale":"2024-04-26T12:09:06.067244+0000","last_undegraded":"2024-04-26T12:09:06.067244+0000","last_fullsized":"2024-04-26T12:09:06.067244+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'492","last_scrub_stamp":"2024-04-26T12:09:06.067102+0000","last_deep_scrub":"60'492","last_deep_scrub_stamp":"2024-04-26T12:09:06.067102+0000","last_clean_scrub_stamp":"2024-04-26T12:09:06.067102+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:55.504447+0000","scrub_duration":0.0024880229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":63988,"num_write":466,"num_write_kb":154489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":107,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.552902+0000","last_change":"2024-04-26T12:09:50.553084+0000","last_active":"2024-04-26T12:09:50.552902+0000","last_peered":"2024-04-26T12:09:50.552902+0000","last_clean":"2024-04-26T12:09:50.552902+0000","last_became_active":"2024-04-26T12:08:36.696619+0000","last_became_peered":"2024-04-26T12:08:36.696619+0000","last_unstale":"2024-04-26T12:09:50.552902+0000","last_undegraded":"2024-04-26T12:09:50.552902+0000","last_fullsized":"2024-04-26T12:09:50.552902+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:50.552881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:50.552881+0000","last_clean_scrub_stamp":"2024-04-26T12:09:50.552881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:13:20.480035+0000","scrub_duration":0.0016118110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"84'327","reported_seq":401,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:07.902637+0000","last_change":"2024-04-26T12:10:07.902637+0000","last_active":"2024-04-26T12:10:07.902637+0000","last_peered":"2024-04-26T12:10:07.902637+0000","last_clean":"2024-04-26T12:10:07.902637+0000","last_became_active":"2024-04-26T12:08:39.703696+0000","last_became_peered":"2024-04-26T12:08:39.703696+0000","last_unstale":"2024-04-26T12:10:07.902637+0000","last_undegraded":"2024-04-26T12:10:07.902637+0000","last_fullsized":"2024-04-26T12:10:07.902637+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'327","last_scrub_stamp":"2024-04-26T12:10:07.902515+0000","last_deep_scrub":"84'327","last_deep_scrub_stamp":"2024-04-26T12:10:07.902515+0000","last_clean_scrub_stamp":"2024-04-26T12:10:07.902515+0000","objects_scrubbed":2,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:16:41.523454+0000","scrub_duration":0.023057502000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":8296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"60'359","reported_seq":798,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:06.542350+0000","last_change":"2024-04-26T12:10:06.542462+0000","last_active":"2024-04-26T12:10:06.542350+0000","last_peered":"2024-04-26T12:10:06.542350+0000","last_clean":"2024-04-26T12:10:06.542350+0000","last_became_active":"2024-04-26T12:08:47.735729+0000","last_became_peered":"2024-04-26T12:08:47.735729+0000","last_unstale":"2024-04-26T12:10:06.542350+0000","last_undegraded":"2024-04-26T12:10:06.542350+0000","last_fullsized":"2024-04-26T12:10:06.542350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'359","last_scrub_stamp":"2024-04-26T12:10:06.542328+0000","last_deep_scrub":"60'359","last_deep_scrub_stamp":"2024-04-26T12:10:06.542328+0000","last_clean_scrub_stamp":"2024-04-26T12:10:06.542328+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:41.474767+0000","scrub_duration":0.0022812959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9448,"num_write":336,"num_write_kb":74900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":94,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:26.662714+0000","last_change":"2024-04-26T12:10:26.662855+0000","last_active":"2024-04-26T12:10:26.662714+0000","last_peered":"2024-04-26T12:10:26.662714+0000","last_clean":"2024-04-26T12:10:26.662714+0000","last_became_active":"2024-04-26T12:04:59.403271+0000","last_became_peered":"2024-04-26T12:04:59.403271+0000","last_unstale":"2024-04-26T12:10:26.662714+0000","last_undegraded":"2024-04-26T12:10:26.662714+0000","last_fullsized":"2024-04-26T12:10:26.662714+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:26.662694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:26.662694+0000","last_clean_scrub_stamp":"2024-04-26T12:10:26.662694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:01.595134+0000","scrub_duration":0.001544695,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"59'67","reported_seq":158,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:37.605616+0000","last_change":"2024-04-26T12:10:37.605715+0000","last_active":"2024-04-26T12:10:37.605616+0000","last_peered":"2024-04-26T12:10:37.605616+0000","last_clean":"2024-04-26T12:10:37.605616+0000","last_became_active":"2024-04-26T12:05:03.429838+0000","last_became_peered":"2024-04-26T12:05:03.429838+0000","last_unstale":"2024-04-26T12:10:37.605616+0000","last_undegraded":"2024-04-26T12:10:37.605616+0000","last_fullsized":"2024-04-26T12:10:37.605616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'67","last_scrub_stamp":"2024-04-26T12:10:37.605593+0000","last_deep_scrub":"59'67","last_deep_scrub_stamp":"2024-04-26T12:10:37.605593+0000","last_clean_scrub_stamp":"2024-04-26T12:10:37.605593+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:44:20.930983+0000","scrub_duration":0.002009748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"60'403","reported_seq":907,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:18.489116+0000","last_change":"2024-04-26T12:09:18.489255+0000","last_active":"2024-04-26T12:09:18.489116+0000","last_peered":"2024-04-26T12:09:18.489116+0000","last_clean":"2024-04-26T12:09:18.489116+0000","last_became_active":"2024-04-26T12:08:50.752366+0000","last_became_peered":"2024-04-26T12:08:50.752366+0000","last_unstale":"2024-04-26T12:09:18.489116+0000","last_undegraded":"2024-04-26T12:09:18.489116+0000","last_fullsized":"2024-04-26T12:09:18.489116+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'403","last_scrub_stamp":"2024-04-26T12:09:18.489093+0000","last_deep_scrub":"60'403","last_deep_scrub_stamp":"2024-04-26T12:09:18.489093+0000","last_clean_scrub_stamp":"2024-04-26T12:09:18.489093+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:04.607536+0000","scrub_duration":0.0022127980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30094,"num_write":370,"num_write_kb":104181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"84'470","reported_seq":561,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:04.611927+0000","last_change":"2024-04-26T12:10:04.612034+0000","last_active":"2024-04-26T12:10:04.611927+0000","last_peered":"2024-04-26T12:10:04.611927+0000","last_clean":"2024-04-26T12:10:04.611927+0000","last_became_active":"2024-04-26T12:05:03.429146+0000","last_became_peered":"2024-04-26T12:05:03.429146+0000","last_unstale":"2024-04-26T12:10:04.611927+0000","last_undegraded":"2024-04-26T12:10:04.611927+0000","last_fullsized":"2024-04-26T12:10:04.611927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'470","last_scrub_stamp":"2024-04-26T12:10:04.611896+0000","last_deep_scrub":"84'470","last_deep_scrub_stamp":"2024-04-26T12:10:04.611896+0000","last_clean_scrub_stamp":"2024-04-26T12:10:04.611896+0000","objects_scrubbed":1,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:26.920507+0000","scrub_duration":0.016499944999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":107,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:46.574665+0000","last_change":"2024-04-26T12:09:46.574794+0000","last_active":"2024-04-26T12:09:46.574665+0000","last_peered":"2024-04-26T12:09:46.574665+0000","last_clean":"2024-04-26T12:09:46.574665+0000","last_became_active":"2024-04-26T12:08:36.697618+0000","last_became_peered":"2024-04-26T12:08:36.697618+0000","last_unstale":"2024-04-26T12:09:46.574665+0000","last_undegraded":"2024-04-26T12:09:46.574665+0000","last_fullsized":"2024-04-26T12:09:46.574665+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:46.574644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:46.574644+0000","last_clean_scrub_stamp":"2024-04-26T12:09:46.574644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:41.737446+0000","scrub_duration":0.001525857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'354","reported_seq":426,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.093263+0000","last_change":"2024-04-26T12:09:50.093263+0000","last_active":"2024-04-26T12:09:50.093263+0000","last_peered":"2024-04-26T12:09:50.093263+0000","last_clean":"2024-04-26T12:09:50.093263+0000","last_became_active":"2024-04-26T12:08:45.724153+0000","last_became_peered":"2024-04-26T12:08:45.724153+0000","last_unstale":"2024-04-26T12:09:50.093263+0000","last_undegraded":"2024-04-26T12:09:50.093263+0000","last_fullsized":"2024-04-26T12:09:50.093263+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'354","last_scrub_stamp":"2024-04-26T12:09:50.093102+0000","last_deep_scrub":"60'354","last_deep_scrub_stamp":"2024-04-26T12:09:50.093102+0000","last_clean_scrub_stamp":"2024-04-26T12:09:50.093102+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:31.582282+0000","scrub_duration":0.0022860559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":416,"num_write":319,"num_write_kb":17259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"59'53","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:54.530670+0000","last_change":"2024-04-26T12:09:54.530774+0000","last_active":"2024-04-26T12:09:54.530670+0000","last_peered":"2024-04-26T12:09:54.530670+0000","last_clean":"2024-04-26T12:09:54.530670+0000","last_became_active":"2024-04-26T12:08:36.697832+0000","last_became_peered":"2024-04-26T12:08:36.697832+0000","last_unstale":"2024-04-26T12:09:54.530670+0000","last_undegraded":"2024-04-26T12:09:54.530670+0000","last_fullsized":"2024-04-26T12:09:54.530670+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'53","last_scrub_stamp":"2024-04-26T12:09:54.530648+0000","last_deep_scrub":"59'53","last_deep_scrub_stamp":"2024-04-26T12:09:54.530648+0000","last_clean_scrub_stamp":"2024-04-26T12:09:54.530648+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:52.718701+0000","scrub_duration":0.001815388,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:40.752870+0000","last_change":"2024-04-26T12:10:40.752971+0000","last_active":"2024-04-26T12:10:40.752870+0000","last_peered":"2024-04-26T12:10:40.752870+0000","last_clean":"2024-04-26T12:10:40.752870+0000","last_became_active":"2024-04-26T12:08:36.697698+0000","last_became_peered":"2024-04-26T12:08:36.697698+0000","last_unstale":"2024-04-26T12:10:40.752870+0000","last_undegraded":"2024-04-26T12:10:40.752870+0000","last_fullsized":"2024-04-26T12:10:40.752870+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:40.752848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:40.752848+0000","last_clean_scrub_stamp":"2024-04-26T12:10:40.752848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:49.485572+0000","scrub_duration":0.0018315759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'399","reported_seq":490,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:13.963241+0000","last_change":"2024-04-26T12:10:13.963241+0000","last_active":"2024-04-26T12:10:13.963241+0000","last_peered":"2024-04-26T12:10:13.963241+0000","last_clean":"2024-04-26T12:10:13.963241+0000","last_became_active":"2024-04-26T12:08:40.703906+0000","last_became_peered":"2024-04-26T12:08:40.703906+0000","last_unstale":"2024-04-26T12:10:13.963241+0000","last_undegraded":"2024-04-26T12:10:13.963241+0000","last_fullsized":"2024-04-26T12:10:13.963241+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'399","last_scrub_stamp":"2024-04-26T12:10:13.963104+0000","last_deep_scrub":"60'399","last_deep_scrub_stamp":"2024-04-26T12:10:13.963104+0000","last_clean_scrub_stamp":"2024-04-26T12:10:13.963104+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:15:56.291072+0000","scrub_duration":0.0021772139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11720,"num_write":363,"num_write_kb":66914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"84'66","reported_seq":171,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:42.618525+0000","last_change":"2024-04-26T12:09:42.618673+0000","last_active":"2024-04-26T12:09:42.618525+0000","last_peered":"2024-04-26T12:09:42.618525+0000","last_clean":"2024-04-26T12:09:42.618525+0000","last_became_active":"2024-04-26T12:08:36.699058+0000","last_became_peered":"2024-04-26T12:08:36.699058+0000","last_unstale":"2024-04-26T12:09:42.618525+0000","last_undegraded":"2024-04-26T12:09:42.618525+0000","last_fullsized":"2024-04-26T12:09:42.618525+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'66","last_scrub_stamp":"2024-04-26T12:09:42.618500+0000","last_deep_scrub":"84'66","last_deep_scrub_stamp":"2024-04-26T12:09:42.618500+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.618500+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:34.338430+0000","scrub_duration":0.0032759640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":107,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:52.522553+0000","last_change":"2024-04-26T12:09:52.522681+0000","last_active":"2024-04-26T12:09:52.522553+0000","last_peered":"2024-04-26T12:09:52.522553+0000","last_clean":"2024-04-26T12:09:52.522553+0000","last_became_active":"2024-04-26T12:08:36.697407+0000","last_became_peered":"2024-04-26T12:08:36.697407+0000","last_unstale":"2024-04-26T12:09:52.522553+0000","last_undegraded":"2024-04-26T12:09:52.522553+0000","last_fullsized":"2024-04-26T12:09:52.522553+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:52.522518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:52.522518+0000","last_clean_scrub_stamp":"2024-04-26T12:09:52.522518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:32.712239+0000","scrub_duration":0.001939184,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'424","reported_seq":555,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:36.669071+0000","last_change":"2024-04-26T12:09:36.669071+0000","last_active":"2024-04-26T12:09:36.669071+0000","last_peered":"2024-04-26T12:09:36.669071+0000","last_clean":"2024-04-26T12:09:36.669071+0000","last_became_active":"2024-04-26T12:05:03.789390+0000","last_became_peered":"2024-04-26T12:05:03.789390+0000","last_unstale":"2024-04-26T12:09:36.669071+0000","last_undegraded":"2024-04-26T12:09:36.669071+0000","last_fullsized":"2024-04-26T12:09:36.669071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'424","last_scrub_stamp":"2024-04-26T12:09:36.668937+0000","last_deep_scrub":"60'424","last_deep_scrub_stamp":"2024-04-26T12:09:36.668937+0000","last_clean_scrub_stamp":"2024-04-26T12:09:36.668937+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:58.766848+0000","scrub_duration":0.0024505759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17027,"num_write":386,"num_write_kb":58797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"84'71","reported_seq":162,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:45.617441+0000","last_change":"2024-04-26T12:09:45.617547+0000","last_active":"2024-04-26T12:09:45.617441+0000","last_peered":"2024-04-26T12:09:45.617441+0000","last_clean":"2024-04-26T12:09:45.617441+0000","last_became_active":"2024-04-26T12:05:03.428803+0000","last_became_peered":"2024-04-26T12:05:03.428803+0000","last_unstale":"2024-04-26T12:09:45.617441+0000","last_undegraded":"2024-04-26T12:09:45.617441+0000","last_fullsized":"2024-04-26T12:09:45.617441+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'71","last_scrub_stamp":"2024-04-26T12:09:45.617416+0000","last_deep_scrub":"84'71","last_deep_scrub_stamp":"2024-04-26T12:09:45.617416+0000","last_clean_scrub_stamp":"2024-04-26T12:09:45.617416+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:39.856897+0000","scrub_duration":0.0067924539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":107,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:28.652554+0000","last_change":"2024-04-26T12:10:28.652684+0000","last_active":"2024-04-26T12:10:28.652554+0000","last_peered":"2024-04-26T12:10:28.652554+0000","last_clean":"2024-04-26T12:10:28.652554+0000","last_became_active":"2024-04-26T12:08:36.698523+0000","last_became_peered":"2024-04-26T12:08:36.698523+0000","last_unstale":"2024-04-26T12:10:28.652554+0000","last_undegraded":"2024-04-26T12:10:28.652554+0000","last_fullsized":"2024-04-26T12:10:28.652554+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:28.652533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:28.652533+0000","last_clean_scrub_stamp":"2024-04-26T12:10:28.652533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:24.465235+0000","scrub_duration":0.001574619,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'393","reported_seq":485,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:40.062141+0000","last_change":"2024-04-26T12:09:40.062141+0000","last_active":"2024-04-26T12:09:40.062141+0000","last_peered":"2024-04-26T12:09:40.062141+0000","last_clean":"2024-04-26T12:09:40.062141+0000","last_became_active":"2024-04-26T12:08:40.703873+0000","last_became_peered":"2024-04-26T12:08:40.703873+0000","last_unstale":"2024-04-26T12:09:40.062141+0000","last_undegraded":"2024-04-26T12:09:40.062141+0000","last_fullsized":"2024-04-26T12:09:40.062141+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'393","last_scrub_stamp":"2024-04-26T12:09:40.062013+0000","last_deep_scrub":"60'393","last_deep_scrub_stamp":"2024-04-26T12:09:40.062013+0000","last_clean_scrub_stamp":"2024-04-26T12:09:40.062013+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:47.183215+0000","scrub_duration":0.0022492969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":11991,"num_write":357,"num_write_kb":83226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'419","reported_seq":905,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:29.651923+0000","last_change":"2024-04-26T12:09:29.651923+0000","last_active":"2024-04-26T12:09:29.651923+0000","last_peered":"2024-04-26T12:09:29.651923+0000","last_clean":"2024-04-26T12:09:29.651923+0000","last_became_active":"2024-04-26T12:08:44.722574+0000","last_became_peered":"2024-04-26T12:08:44.722574+0000","last_unstale":"2024-04-26T12:09:29.651923+0000","last_undegraded":"2024-04-26T12:09:29.651923+0000","last_fullsized":"2024-04-26T12:09:29.651923+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'419","last_scrub_stamp":"2024-04-26T12:09:29.651776+0000","last_deep_scrub":"60'419","last_deep_scrub_stamp":"2024-04-26T12:09:29.651776+0000","last_clean_scrub_stamp":"2024-04-26T12:09:29.651776+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:03.355550+0000","scrub_duration":0.0023698270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14983,"num_write":376,"num_write_kb":76749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"84'404","reported_seq":526,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.702349+0000","last_change":"2024-04-26T12:09:50.702472+0000","last_active":"2024-04-26T12:09:50.702349+0000","last_peered":"2024-04-26T12:09:50.702349+0000","last_clean":"2024-04-26T12:09:50.702349+0000","last_became_active":"2024-04-26T12:08:39.703516+0000","last_became_peered":"2024-04-26T12:08:39.703516+0000","last_unstale":"2024-04-26T12:09:50.702349+0000","last_undegraded":"2024-04-26T12:09:50.702349+0000","last_fullsized":"2024-04-26T12:09:50.702349+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'404","last_scrub_stamp":"2024-04-26T12:09:50.702328+0000","last_deep_scrub":"84'404","last_deep_scrub_stamp":"2024-04-26T12:09:50.702328+0000","last_clean_scrub_stamp":"2024-04-26T12:09:50.702328+0000","objects_scrubbed":6,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:51.625649+0000","scrub_duration":0.02885393,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699266,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":9692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9692849,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'428","reported_seq":953,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:04.569401+0000","last_change":"2024-04-26T12:10:04.569511+0000","last_active":"2024-04-26T12:10:04.569401+0000","last_peered":"2024-04-26T12:10:04.569401+0000","last_clean":"2024-04-26T12:10:04.569401+0000","last_became_active":"2024-04-26T12:08:50.752328+0000","last_became_peered":"2024-04-26T12:08:50.752328+0000","last_unstale":"2024-04-26T12:10:04.569401+0000","last_undegraded":"2024-04-26T12:10:04.569401+0000","last_fullsized":"2024-04-26T12:10:04.569401+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'428","last_scrub_stamp":"2024-04-26T12:10:04.569378+0000","last_deep_scrub":"60'428","last_deep_scrub_stamp":"2024-04-26T12:10:04.569378+0000","last_clean_scrub_stamp":"2024-04-26T12:10:04.569378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:47.307742+0000","scrub_duration":0.0028671769999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":26594,"num_write":396,"num_write_kb":67932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"84'93","reported_seq":58,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:56.025331+0000","last_change":"2024-04-26T12:09:56.025331+0000","last_active":"2024-04-26T12:09:56.025331+0000","last_peered":"2024-04-26T12:09:56.025331+0000","last_clean":"2024-04-26T12:09:56.025331+0000","last_became_active":"2024-04-26T12:08:36.697650+0000","last_became_peered":"2024-04-26T12:08:36.697650+0000","last_unstale":"2024-04-26T12:09:56.025331+0000","last_undegraded":"2024-04-26T12:09:56.025331+0000","last_fullsized":"2024-04-26T12:09:56.025331+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'93","last_scrub_stamp":"2024-04-26T12:09:56.025210+0000","last_deep_scrub":"84'93","last_deep_scrub_stamp":"2024-04-26T12:09:56.025210+0000","last_clean_scrub_stamp":"2024-04-26T12:09:56.025210+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:37.270337+0000","scrub_duration":0.0035178729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"84'317","reported_seq":408,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.578923+0000","last_change":"2024-04-26T12:10:21.579052+0000","last_active":"2024-04-26T12:10:21.578923+0000","last_peered":"2024-04-26T12:10:21.578923+0000","last_clean":"2024-04-26T12:10:21.578923+0000","last_became_active":"2024-04-26T12:05:03.428921+0000","last_became_peered":"2024-04-26T12:05:03.428921+0000","last_unstale":"2024-04-26T12:10:21.578923+0000","last_undegraded":"2024-04-26T12:10:21.578923+0000","last_fullsized":"2024-04-26T12:10:21.578923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'317","last_scrub_stamp":"2024-04-26T12:10:21.578894+0000","last_deep_scrub":"84'317","last_deep_scrub_stamp":"2024-04-26T12:10:21.578894+0000","last_clean_scrub_stamp":"2024-04-26T12:10:21.578894+0000","objects_scrubbed":1,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:10.753453+0000","scrub_duration":0.014228315,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'495","reported_seq":638,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:25.547380+0000","last_change":"2024-04-26T12:09:25.547380+0000","last_active":"2024-04-26T12:09:25.547380+0000","last_peered":"2024-04-26T12:09:25.547380+0000","last_clean":"2024-04-26T12:09:25.547380+0000","last_became_active":"2024-04-26T12:05:03.787533+0000","last_became_peered":"2024-04-26T12:05:03.787533+0000","last_unstale":"2024-04-26T12:09:25.547380+0000","last_undegraded":"2024-04-26T12:09:25.547380+0000","last_fullsized":"2024-04-26T12:09:25.547380+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'495","last_scrub_stamp":"2024-04-26T12:09:25.547250+0000","last_deep_scrub":"60'495","last_deep_scrub_stamp":"2024-04-26T12:09:25.547250+0000","last_clean_scrub_stamp":"2024-04-26T12:09:25.547250+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:52.939986+0000","scrub_duration":0.002519252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37174,"num_write":458,"num_write_kb":125832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"59'51","reported_seq":142,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:29.586170+0000","last_change":"2024-04-26T12:09:29.586170+0000","last_active":"2024-04-26T12:09:29.586170+0000","last_peered":"2024-04-26T12:09:29.586170+0000","last_clean":"2024-04-26T12:09:29.586170+0000","last_became_active":"2024-04-26T12:05:03.428445+0000","last_became_peered":"2024-04-26T12:05:03.428445+0000","last_unstale":"2024-04-26T12:09:29.586170+0000","last_undegraded":"2024-04-26T12:09:29.586170+0000","last_fullsized":"2024-04-26T12:09:29.586170+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'51","last_scrub_stamp":"2024-04-26T12:09:29.585971+0000","last_deep_scrub":"59'51","last_deep_scrub_stamp":"2024-04-26T12:09:29.585971+0000","last_clean_scrub_stamp":"2024-04-26T12:09:29.585971+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:15.873513+0000","scrub_duration":0.0016537050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'482","reported_seq":1143,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:05.584628+0000","last_change":"2024-04-26T12:10:05.584742+0000","last_active":"2024-04-26T12:10:05.584628+0000","last_peered":"2024-04-26T12:10:05.584628+0000","last_clean":"2024-04-26T12:10:05.584628+0000","last_became_active":"2024-04-26T12:08:48.740055+0000","last_became_peered":"2024-04-26T12:08:48.740055+0000","last_unstale":"2024-04-26T12:10:05.584628+0000","last_undegraded":"2024-04-26T12:10:05.584628+0000","last_fullsized":"2024-04-26T12:10:05.584628+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'482","last_scrub_stamp":"2024-04-26T12:10:05.584603+0000","last_deep_scrub":"60'482","last_deep_scrub_stamp":"2024-04-26T12:10:05.584603+0000","last_clean_scrub_stamp":"2024-04-26T12:10:05.584603+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:28.512669+0000","scrub_duration":0.002302704,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":61972,"num_write":459,"num_write_kb":125797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"60'392","reported_seq":540,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:29.949247+0000","last_change":"2024-04-26T12:10:29.949247+0000","last_active":"2024-04-26T12:10:29.949247+0000","last_peered":"2024-04-26T12:10:29.949247+0000","last_clean":"2024-04-26T12:10:29.949247+0000","last_became_active":"2024-04-26T12:08:43.717109+0000","last_became_peered":"2024-04-26T12:08:43.717109+0000","last_unstale":"2024-04-26T12:10:29.949247+0000","last_undegraded":"2024-04-26T12:10:29.949247+0000","last_fullsized":"2024-04-26T12:10:29.949247+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'392","last_scrub_stamp":"2024-04-26T12:10:29.949102+0000","last_deep_scrub":"60'392","last_deep_scrub_stamp":"2024-04-26T12:10:29.949102+0000","last_clean_scrub_stamp":"2024-04-26T12:10:29.949102+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:49.528176+0000","scrub_duration":0.0019623760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":37910,"num_write":366,"num_write_kb":84111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"84'711","reported_seq":828,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:58.565960+0000","last_change":"2024-04-26T12:09:58.566091+0000","last_active":"2024-04-26T12:09:58.565960+0000","last_peered":"2024-04-26T12:09:58.565960+0000","last_clean":"2024-04-26T12:09:58.565960+0000","last_became_active":"2024-04-26T12:08:39.700927+0000","last_became_peered":"2024-04-26T12:08:39.700927+0000","last_unstale":"2024-04-26T12:09:58.565960+0000","last_undegraded":"2024-04-26T12:09:58.565960+0000","last_fullsized":"2024-04-26T12:09:58.565960+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'711","last_scrub_stamp":"2024-04-26T12:09:58.565935+0000","last_deep_scrub":"84'711","last_deep_scrub_stamp":"2024-04-26T12:09:58.565935+0000","last_clean_scrub_stamp":"2024-04-26T12:09:58.565935+0000","objects_scrubbed":2,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:53.985339+0000","scrub_duration":0.028815225,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"60'435","reported_seq":586,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:12.602088+0000","last_change":"2024-04-26T12:10:12.602088+0000","last_active":"2024-04-26T12:10:12.602088+0000","last_peered":"2024-04-26T12:10:12.602088+0000","last_clean":"2024-04-26T12:10:12.602088+0000","last_became_active":"2024-04-26T12:05:03.788311+0000","last_became_peered":"2024-04-26T12:05:03.788311+0000","last_unstale":"2024-04-26T12:10:12.602088+0000","last_undegraded":"2024-04-26T12:10:12.602088+0000","last_fullsized":"2024-04-26T12:10:12.602088+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'435","last_scrub_stamp":"2024-04-26T12:10:12.601956+0000","last_deep_scrub":"60'435","last_deep_scrub_stamp":"2024-04-26T12:10:12.601956+0000","last_clean_scrub_stamp":"2024-04-26T12:10:12.601956+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:06.128844+0000","scrub_duration":0.0028402480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":28462,"num_write":403,"num_write_kb":93779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"84'263","reported_seq":354,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:40.654355+0000","last_change":"2024-04-26T12:09:40.654355+0000","last_active":"2024-04-26T12:09:40.654355+0000","last_peered":"2024-04-26T12:09:40.654355+0000","last_clean":"2024-04-26T12:09:40.654355+0000","last_became_active":"2024-04-26T12:05:03.428191+0000","last_became_peered":"2024-04-26T12:05:03.428191+0000","last_unstale":"2024-04-26T12:09:40.654355+0000","last_undegraded":"2024-04-26T12:09:40.654355+0000","last_fullsized":"2024-04-26T12:09:40.654355+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'263","last_scrub_stamp":"2024-04-26T12:09:40.654238+0000","last_deep_scrub":"84'263","last_deep_scrub_stamp":"2024-04-26T12:09:40.654238+0000","last_clean_scrub_stamp":"2024-04-26T12:09:40.654238+0000","objects_scrubbed":1,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:02.888122+0000","scrub_duration":0.014597508,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"60'399","reported_seq":512,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:28.922059+0000","last_change":"2024-04-26T12:10:28.922059+0000","last_active":"2024-04-26T12:10:28.922059+0000","last_peered":"2024-04-26T12:10:28.922059+0000","last_clean":"2024-04-26T12:10:28.922059+0000","last_became_active":"2024-04-26T12:08:49.740536+0000","last_became_peered":"2024-04-26T12:08:49.740536+0000","last_unstale":"2024-04-26T12:10:28.922059+0000","last_undegraded":"2024-04-26T12:10:28.922059+0000","last_fullsized":"2024-04-26T12:10:28.922059+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'399","last_scrub_stamp":"2024-04-26T12:10:28.921891+0000","last_deep_scrub":"60'399","last_deep_scrub_stamp":"2024-04-26T12:10:28.921891+0000","last_clean_scrub_stamp":"2024-04-26T12:10:28.921891+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:06.173017+0000","scrub_duration":0.00256324,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22216,"num_write":357,"num_write_kb":75245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"84'433","reported_seq":506,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:33.133804+0000","last_change":"2024-04-26T12:09:33.133804+0000","last_active":"2024-04-26T12:09:33.133804+0000","last_peered":"2024-04-26T12:09:33.133804+0000","last_clean":"2024-04-26T12:09:33.133804+0000","last_became_active":"2024-04-26T12:08:39.702529+0000","last_became_peered":"2024-04-26T12:08:39.702529+0000","last_unstale":"2024-04-26T12:09:33.133804+0000","last_undegraded":"2024-04-26T12:09:33.133804+0000","last_fullsized":"2024-04-26T12:09:33.133804+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'433","last_scrub_stamp":"2024-04-26T12:09:33.133683+0000","last_deep_scrub":"84'433","last_deep_scrub_stamp":"2024-04-26T12:09:33.133683+0000","last_clean_scrub_stamp":"2024-04-26T12:09:33.133683+0000","objects_scrubbed":3,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:32.088329+0000","scrub_duration":0.034859436000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":12514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"60'387","reported_seq":489,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.120210+0000","last_change":"2024-04-26T12:09:49.120210+0000","last_active":"2024-04-26T12:09:49.120210+0000","last_peered":"2024-04-26T12:09:49.120210+0000","last_clean":"2024-04-26T12:09:49.120210+0000","last_became_active":"2024-04-26T12:08:43.717442+0000","last_became_peered":"2024-04-26T12:08:43.717442+0000","last_unstale":"2024-04-26T12:09:49.120210+0000","last_undegraded":"2024-04-26T12:09:49.120210+0000","last_fullsized":"2024-04-26T12:09:49.120210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'387","last_scrub_stamp":"2024-04-26T12:09:49.120043+0000","last_deep_scrub":"60'387","last_deep_scrub_stamp":"2024-04-26T12:09:49.120043+0000","last_clean_scrub_stamp":"2024-04-26T12:09:49.120043+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:21.246128+0000","scrub_duration":0.00208647,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20720,"num_write":352,"num_write_kb":87643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"84'59","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:16.993913+0000","last_change":"2024-04-26T12:10:16.993913+0000","last_active":"2024-04-26T12:10:16.993913+0000","last_peered":"2024-04-26T12:10:16.993913+0000","last_clean":"2024-04-26T12:10:16.993913+0000","last_became_active":"2024-04-26T12:08:36.693399+0000","last_became_peered":"2024-04-26T12:08:36.693399+0000","last_unstale":"2024-04-26T12:10:16.993913+0000","last_undegraded":"2024-04-26T12:10:16.993913+0000","last_fullsized":"2024-04-26T12:10:16.993913+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'59","last_scrub_stamp":"2024-04-26T12:10:16.993575+0000","last_deep_scrub":"84'59","last_deep_scrub_stamp":"2024-04-26T12:10:16.993575+0000","last_clean_scrub_stamp":"2024-04-26T12:10:16.993575+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:32.405915+0000","scrub_duration":0.0097403390000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"60'356","reported_seq":465,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:40.622688+0000","last_change":"2024-04-26T12:10:40.622816+0000","last_active":"2024-04-26T12:10:40.622688+0000","last_peered":"2024-04-26T12:10:40.622688+0000","last_clean":"2024-04-26T12:10:40.622688+0000","last_became_active":"2024-04-26T12:05:03.790823+0000","last_became_peered":"2024-04-26T12:05:03.790823+0000","last_unstale":"2024-04-26T12:10:40.622688+0000","last_undegraded":"2024-04-26T12:10:40.622688+0000","last_fullsized":"2024-04-26T12:10:40.622688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'356","last_scrub_stamp":"2024-04-26T12:10:40.622649+0000","last_deep_scrub":"60'356","last_deep_scrub_stamp":"2024-04-26T12:10:40.622649+0000","last_clean_scrub_stamp":"2024-04-26T12:10:40.622649+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:12.180784+0000","scrub_duration":0.0030157550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9641,"num_write":326,"num_write_kb":29574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"84'311","reported_seq":402,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:32.706538+0000","last_change":"2024-04-26T12:09:32.706538+0000","last_active":"2024-04-26T12:09:32.706538+0000","last_peered":"2024-04-26T12:09:32.706538+0000","last_clean":"2024-04-26T12:09:32.706538+0000","last_became_active":"2024-04-26T12:05:03.429015+0000","last_became_peered":"2024-04-26T12:05:03.429015+0000","last_unstale":"2024-04-26T12:09:32.706538+0000","last_undegraded":"2024-04-26T12:09:32.706538+0000","last_fullsized":"2024-04-26T12:09:32.706538+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'311","last_scrub_stamp":"2024-04-26T12:09:32.706381+0000","last_deep_scrub":"84'311","last_deep_scrub_stamp":"2024-04-26T12:09:32.706381+0000","last_clean_scrub_stamp":"2024-04-26T12:09:32.706381+0000","objects_scrubbed":2,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:18.824824+0000","scrub_duration":0.016953577000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'433","reported_seq":588,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:52.685440+0000","last_change":"2024-04-26T12:09:52.685440+0000","last_active":"2024-04-26T12:09:52.685440+0000","last_peered":"2024-04-26T12:09:52.685440+0000","last_clean":"2024-04-26T12:09:52.685440+0000","last_became_active":"2024-04-26T12:05:03.791540+0000","last_became_peered":"2024-04-26T12:05:03.791540+0000","last_unstale":"2024-04-26T12:09:52.685440+0000","last_undegraded":"2024-04-26T12:09:52.685440+0000","last_fullsized":"2024-04-26T12:09:52.685440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'433","last_scrub_stamp":"2024-04-26T12:09:52.685297+0000","last_deep_scrub":"60'433","last_deep_scrub_stamp":"2024-04-26T12:09:52.685297+0000","last_clean_scrub_stamp":"2024-04-26T12:09:52.685297+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:14.783208+0000","scrub_duration":0.0028996600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":47864,"num_write":399,"num_write_kb":92193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"84'386","reported_seq":466,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:10:24.039971+0000","last_change":"2024-04-26T12:10:24.039971+0000","last_active":"2024-04-26T12:10:24.039971+0000","last_peered":"2024-04-26T12:10:24.039971+0000","last_clean":"2024-04-26T12:10:24.039971+0000","last_became_active":"2024-04-26T12:08:39.704404+0000","last_became_peered":"2024-04-26T12:08:39.704404+0000","last_unstale":"2024-04-26T12:10:24.039971+0000","last_undegraded":"2024-04-26T12:10:24.039971+0000","last_fullsized":"2024-04-26T12:10:24.039971+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'386","last_scrub_stamp":"2024-04-26T12:10:24.039831+0000","last_deep_scrub":"84'386","last_deep_scrub_stamp":"2024-04-26T12:10:24.039831+0000","last_clean_scrub_stamp":"2024-04-26T12:10:24.039831+0000","objects_scrubbed":4,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:29.776584+0000","scrub_duration":0.031708703999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":12467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'425","reported_seq":557,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:18.179810+0000","last_change":"2024-04-26T12:09:18.179810+0000","last_active":"2024-04-26T12:09:18.179810+0000","last_peered":"2024-04-26T12:09:18.179810+0000","last_clean":"2024-04-26T12:09:18.179810+0000","last_became_active":"2024-04-26T12:08:47.735367+0000","last_became_peered":"2024-04-26T12:08:47.735367+0000","last_unstale":"2024-04-26T12:09:18.179810+0000","last_undegraded":"2024-04-26T12:09:18.179810+0000","last_fullsized":"2024-04-26T12:09:18.179810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'425","last_scrub_stamp":"2024-04-26T12:09:18.179684+0000","last_deep_scrub":"60'425","last_deep_scrub_stamp":"2024-04-26T12:09:18.179684+0000","last_clean_scrub_stamp":"2024-04-26T12:09:18.179684+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:20.520222+0000","scrub_duration":0.0024613230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":38065,"num_write":387,"num_write_kb":71445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"84'127","reported_seq":244,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:21.540746+0000","last_change":"2024-04-26T12:09:21.540746+0000","last_active":"2024-04-26T12:09:21.540746+0000","last_peered":"2024-04-26T12:09:21.540746+0000","last_clean":"2024-04-26T12:09:21.540746+0000","last_became_active":"2024-04-26T12:08:39.701900+0000","last_became_peered":"2024-04-26T12:08:39.701900+0000","last_unstale":"2024-04-26T12:09:21.540746+0000","last_undegraded":"2024-04-26T12:09:21.540746+0000","last_fullsized":"2024-04-26T12:09:21.540746+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'127","last_scrub_stamp":"2024-04-26T12:09:21.540611+0000","last_deep_scrub":"84'127","last_deep_scrub_stamp":"2024-04-26T12:09:21.540611+0000","last_clean_scrub_stamp":"2024-04-26T12:09:21.540611+0000","objects_scrubbed":1,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:30.101109+0000","scrub_duration":0.0098993390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"60'448","reported_seq":561,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:31.644589+0000","last_change":"2024-04-26T12:09:31.644589+0000","last_active":"2024-04-26T12:09:31.644589+0000","last_peered":"2024-04-26T12:09:31.644589+0000","last_clean":"2024-04-26T12:09:31.644589+0000","last_became_active":"2024-04-26T12:05:03.791442+0000","last_became_peered":"2024-04-26T12:05:03.791442+0000","last_unstale":"2024-04-26T12:09:31.644589+0000","last_undegraded":"2024-04-26T12:09:31.644589+0000","last_fullsized":"2024-04-26T12:09:31.644589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'448","last_scrub_stamp":"2024-04-26T12:09:31.644476+0000","last_deep_scrub":"60'448","last_deep_scrub_stamp":"2024-04-26T12:09:31.644476+0000","last_clean_scrub_stamp":"2024-04-26T12:09:31.644476+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:50.748197+0000","scrub_duration":0.0028574049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11191,"num_write":416,"num_write_kb":67272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"84'59","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:09:17.505129+0000","last_change":"2024-04-26T12:09:17.505233+0000","last_active":"2024-04-26T12:09:17.505129+0000","last_peered":"2024-04-26T12:09:17.505129+0000","last_clean":"2024-04-26T12:09:17.505129+0000","last_became_active":"2024-04-26T12:05:03.430164+0000","last_became_peered":"2024-04-26T12:05:03.430164+0000","last_unstale":"2024-04-26T12:09:17.505129+0000","last_undegraded":"2024-04-26T12:09:17.505129+0000","last_fullsized":"2024-04-26T12:09:17.505129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'59","last_scrub_stamp":"2024-04-26T12:09:17.505103+0000","last_deep_scrub":"84'59","last_deep_scrub_stamp":"2024-04-26T12:09:17.505103+0000","last_clean_scrub_stamp":"2024-04-26T12:09:17.505103+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:36.608825+0000","scrub_duration":0.012259582999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2734,"num_read_kb":1486856,"num_write":24627,"num_write_kb":4487808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7440,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26722,"ondisk_log_size":26722,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128606591,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1464,"num_write":5972,"num_write_kb":129691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":85190411,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64376832,"data_stored":257213182,"data_compressed":19249503,"data_compressed_allocated":31694848,"data_compressed_original":224591872,"omap_allocated":4411,"internal_metadata":0},"log_size":7881,"ondisk_log_size":7881,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11996,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738448,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134428,"kb_used_data":27092,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94237412,"statfs":{"total":96636764160,"available":96499109888,"internally_reserved":0,"allocated":27742208,"data_stored":91797602,"data_compressed":6340284,"data_compressed_allocated":11272192,"data_compressed_original":75763712,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:11:06 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.40300000000000002,"15min":0.437},"min":{"1min":0.32600000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.53500000000000003,"5min":0.58499999999999996,"15min":0.58599999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.433,"5min":0.40600000000000003,"15min":0.42799999999999999},"min":{"1min":0.29099999999999998,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.55800000000000005,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.48099999999999998}]},{"osd":1,"last update":"Fri Apr 26 12:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46000000000000002,"15min":0.45600000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.63200000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.46100000000000002,"15min":0.45500000000000002},"min":{"1min":0.312,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.53700000000000003}]}]},{"osd":1,"up_from":66,"seq":283467841568,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68508,"kb_used_data":10644,"kb_used_omap":5,"kb_used_meta":57850,"kb_avail":94303332,"statfs":{"total":96636764160,"available":96566611968,"internally_reserved":0,"allocated":10899456,"data_stored":86136667,"data_compressed":7182940,"data_compressed_allocated":10076160,"data_compressed_original":85745664,"omap_allocated":6005,"internal_metadata":59238539},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.40300000000000002,"15min":0.39600000000000002},"min":{"1min":0.33800000000000002,"5min":0.155,"15min":0.155},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.435},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.41299999999999998,"15min":0.40500000000000003},"min":{"1min":0.36699999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.47199999999999998}]},{"osd":2,"last update":"Fri Apr 26 12:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.44,"15min":0.433},"min":{"1min":0.38200000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.44900000000000001,"15min":0.441},"min":{"1min":0.40500000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.60299999999999998,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.45700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138884,"kb_used_data":27452,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232956,"statfs":{"total":96636764160,"available":96494546944,"internally_reserved":0,"allocated":28110848,"data_stored":81507786,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.436,"15min":0.42999999999999999},"min":{"1min":0.26700000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.434},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45500000000000002,"15min":0.45200000000000001},"min":{"1min":0.29499999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64400000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.40200000000000002}]},{"osd":2,"last update":"Fri Apr 26 12:10:05 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.442,"15min":0.441},"min":{"1min":0.39200000000000002,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.60799999999999998,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.45200000000000001,"15min":0.439},"min":{"1min":0.38,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.64500000000000002,"5min":1.976,"15min":1.976},"last":0.53400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5998,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27357184,"data_stored":81158407,"data_compressed":5738275,"data_compressed_allocated":10420224,"data_compressed_original":64229376,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10088448,"data_stored":85196920,"data_compressed":7176942,"data_compressed_allocated":10039296,"data_compressed_original":85172224,"omap_allocated":4411,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26931200,"data_stored":90857855,"data_compressed":6334286,"data_compressed_allocated":11235328,"data_compressed_original":75190272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:11:08.481 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T12:11:08.823 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T12:11:08.824 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:11:09.154 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:11:09.154 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:05:03.774692+0000","modified":"2024-04-26T12:05:05.779112+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14144},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14144":{"gid":14144,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6803/2910214683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2910214683},{"type":"v1","addr":"172.21.15.52:6803","nonce":2910214683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:11:09.154 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 5 2024-04-26T12:11:09.167 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:11:09.495 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:11:09.495 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:05:03.774692+0000","modified":"2024-04-26T12:05:05.779112+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14144},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14144":{"gid":14144,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6803/2910214683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2910214683},{"type":"v1","addr":"172.21.15.52:6803","nonce":2910214683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:11:09.495 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 5 2024-04-26T12:11:09.508 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:11:09.801 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T12:11:09.801 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":84,"fsid":"5bc300ae-e948-4ce3-81bb-5abae8c06799","created":"2024-04-26T12:04:41.919527+0000","modified":"2024-04-26T12:08:53.741839+0000","last_up_change":"2024-04-26T12:08:35.679585+0000","last_in_change":"2024-04-26T12:04:43.540390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:04:52.376506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:04:57.775333+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:05:02.226064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:05:02.758806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"638cfa85-e921-4403-9bcb-a7f4653cc3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":28597},{"type":"v1","addr":"172.21.15.143:6801","nonce":28597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":28597},{"type":"v1","addr":"172.21.15.143:6803","nonce":28597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":28597},{"type":"v1","addr":"172.21.15.143:6807","nonce":28597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":28597},{"type":"v1","addr":"172.21.15.143:6805","nonce":28597}]},"public_addr":"172.21.15.143:6801/28597","cluster_addr":"172.21.15.143:6803/28597","heartbeat_back_addr":"172.21.15.143:6807/28597","heartbeat_front_addr":"172.21.15.143:6805/28597","state":["exists","up"]},{"osd":1,"uuid":"2abc8d1e-ad72-4643-ad1e-3566e5113c44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":37,"up_from":66,"up_thru":83,"down_at":38,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":5362},{"type":"v1","addr":"172.21.15.154:6801","nonce":5362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":5362},{"type":"v1","addr":"172.21.15.154:6803","nonce":5362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":5362},{"type":"v1","addr":"172.21.15.154:6807","nonce":5362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":5362},{"type":"v1","addr":"172.21.15.154:6805","nonce":5362}]},"public_addr":"172.21.15.154:6801/5362","cluster_addr":"172.21.15.154:6803/5362","heartbeat_back_addr":"172.21.15.154:6807/5362","heartbeat_front_addr":"172.21.15.154:6805/5362","state":["exists","up"]},{"osd":2,"uuid":"d2ebc562-cb9b-4089-a19b-1788b70b57dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":28709},{"type":"v1","addr":"172.21.15.164:6801","nonce":28709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":28709},{"type":"v1","addr":"172.21.15.164:6803","nonce":28709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":28709},{"type":"v1","addr":"172.21.15.164:6807","nonce":28709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":28709},{"type":"v1","addr":"172.21.15.164:6805","nonce":28709}]},"public_addr":"172.21.15.164:6801/28709","cluster_addr":"172.21.15.164:6803/28709","heartbeat_back_addr":"172.21.15.164:6807/28709","heartbeat_front_addr":"172.21.15.164:6805/28709","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.573478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.624482+0000","dead_epoch":37},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:04:48.615449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:11:09.814 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T12:11:10.147 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T12:11:10.161 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T12:11:10.185 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-04-26T12:11:11.168 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T12:11:12.153 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2024-04-26T12:11:12.169 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T12:11:13.158 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2024-04-26T12:11:13.174 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T12:11:13.174 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T12:11:13.174 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:11:13.184 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T12:11:13.184 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T12:11:13.184 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T12:11:13.184 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:11:13.219 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T12:11:13.219 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T12:11:13.219 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:11:13.255 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T12:11:13.255 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T12:11:13.256 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:11:13.291 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T12:11:13.291 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T12:11:13.292 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T12:11:13.292 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:11:13.317 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T12:11:13.317 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T12:11:13.317 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:11:13.384 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T12:11:13.384 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T12:11:13.385 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T12:11:13.385 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:11:13.437 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T12:11:13.438 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T12:11:13.438 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:11:13.489 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T12:11:13.489 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T12:11:13.490 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:11:13.541 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T12:11:13.542 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T12:11:13.542 DEBUG:teuthology.orchestra.run.smithi052:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2024-04-26T12:11:13.614 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T12:11:13.615 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T12:11:13.742 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi154.front.sepia.ceph.com 2024-04-26T12:11:13.743 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T12:11:13.874 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi164.front.sepia.ceph.com 2024-04-26T12:11:13.874 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T12:11:14.003 INFO:tasks.ceph:Archiving mon data... 2024-04-26T12:11:14.004 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674200/data/mon.a.tgz 2024-04-26T12:11:14.004 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-04-26T12:11:14.021 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.C0y8L8t0Us 2024-04-26T12:11:14.022 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.C0y8L8t0Us 2024-04-26T12:11:14.167 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.C0y8L8t0Us 2024-04-26T12:11:14.252 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.C0y8L8t0Us is 388KB 2024-04-26T12:11:14.351 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.C0y8L8t0Us 2024-04-26T12:11:14.367 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674200/data/mon.b.tgz 2024-04-26T12:11:14.367 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-04-26T12:11:14.422 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.c3KAPKS1wf 2024-04-26T12:11:14.422 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.c3KAPKS1wf 2024-04-26T12:11:14.595 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.c3KAPKS1wf 2024-04-26T12:11:14.680 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.c3KAPKS1wf is 536KB 2024-04-26T12:11:14.780 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.c3KAPKS1wf 2024-04-26T12:11:14.794 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674200/data/mon.c.tgz 2024-04-26T12:11:14.795 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-04-26T12:11:14.848 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.qqIkqk1n8J 2024-04-26T12:11:14.848 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.qqIkqk1n8J 2024-04-26T12:11:15.022 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.qqIkqk1n8J 2024-04-26T12:11:15.105 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.qqIkqk1n8J is 536KB 2024-04-26T12:11:15.206 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.qqIkqk1n8J 2024-04-26T12:11:15.222 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T12:11:15.222 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:11:15.263 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:11:15.266 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:11:15.272 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:11:15.309 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-04-26T12:11:15.310 DEBUG:teuthology.orchestra.run.smithi052:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T12:11:15.327 DEBUG:teuthology.orchestra.run.smithi143:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T12:11:15.334 DEBUG:teuthology.orchestra.run.smithi154:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T12:11:15.351 INFO:teuthology.orchestra.run.smithi052.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T12:11:15.352 DEBUG:teuthology.orchestra.run.smithi164:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T12:11:15.362 INFO:teuthology.orchestra.run.smithi143.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T12:11:15.381 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T12:11:15.387 INFO:teuthology.orchestra.run.smithi154.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T12:11:15.392 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T12:11:15.395 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674200/remote/smithi052/crash 2024-04-26T12:11:15.396 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:11:15.420 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674200/remote/smithi143/crash 2024-04-26T12:11:15.421 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:11:15.468 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674200/remote/smithi154/crash 2024-04-26T12:11:15.469 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:11:15.537 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674200/remote/smithi164/crash 2024-04-26T12:11:15.538 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:11:15.574 INFO:tasks.ceph:Compressing logs... 2024-04-26T12:11:15.574 DEBUG:teuthology.orchestra.run.smithi052:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:11:15.577 DEBUG:teuthology.orchestra.run.smithi143:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:11:15.580 DEBUG:teuthology.orchestra.run.smithi154:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:11:15.584 DEBUG:teuthology.orchestra.run.smithi164:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:11:21.454 INFO:tasks.ceph:Archiving logs... 2024-04-26T12:11:21.455 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674200/remote/smithi052/log 2024-04-26T12:11:21.456 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:11:21.793 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674200/remote/smithi143/log 2024-04-26T12:11:21.794 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:11:22.463 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674200/remote/smithi154/log 2024-04-26T12:11:22.464 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:11:22.607 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674200/remote/smithi164/log 2024-04-26T12:11:22.608 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:11:23.273 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T12:11:23.288 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T12:11:23.288 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:11:23.291 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:11:23.294 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:11:23.296 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:11:23.418 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T12:11:23.439 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T12:11:23.439 DEBUG:teuthology.orchestra.run.smithi052:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:11:23.441 DEBUG:teuthology.orchestra.run.smithi143:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:11:23.444 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:11:23.447 DEBUG:teuthology.orchestra.run.smithi164:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:11:23.453 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-04-26T12:11:23.457 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:11:23.457 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-04-26T12:11:23.457 INFO:teuthology.orchestra.run.smithi052.stdout:^* hv01.front.sepia.ceph.com 3 6 377 5 +795us[ +795us] +/- 52ms 2024-04-26T12:11:23.457 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 5 -1311us[-1311us] +/- 72ms 2024-04-26T12:11:23.457 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 +141us[ +141us] +/- 64ms 2024-04-26T12:11:23.458 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:11:23.459 INFO:teuthology.orchestra.run.smithi143.stderr:bash: line 1: ntpq: command not found 2024-04-26T12:11:23.461 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-04-26T12:11:23.462 INFO:teuthology.orchestra.run.smithi143.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:11:23.462 INFO:teuthology.orchestra.run.smithi143.stdout:=============================================================================== 2024-04-26T12:11:23.462 INFO:teuthology.orchestra.run.smithi143.stdout:^* hv01.front.sepia.ceph.com 3 6 377 6 +799us[ +808us] +/- 52ms 2024-04-26T12:11:23.462 INFO:teuthology.orchestra.run.smithi143.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 -1313us[-1313us] +/- 72ms 2024-04-26T12:11:23.462 INFO:teuthology.orchestra.run.smithi143.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 +187us[ +187us] +/- 64ms 2024-04-26T12:11:23.463 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:11:23.464 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-04-26T12:11:23.465 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:11:23.465 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-04-26T12:11:23.465 INFO:teuthology.orchestra.run.smithi154.stdout:^* hv01.front.sepia.ceph.com 3 6 77 49 +786us[ +779us] +/- 51ms 2024-04-26T12:11:23.465 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv02.front.sepia.ceph.com 3 6 77 48 -1320us[-1320us] +/- 71ms 2024-04-26T12:11:23.465 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv03.front.sepia.ceph.com 3 6 77 49 +147us[ +147us] +/- 63ms 2024-04-26T12:11:23.465 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:11:23.468 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:11:23.468 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-04-26T12:11:23.468 INFO:teuthology.orchestra.run.smithi164.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 +812us[ +806us] +/- 52ms 2024-04-26T12:11:23.468 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 -1290us[-1290us] +/- 72ms 2024-04-26T12:11:23.468 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 +177us[ +177us] +/- 64ms 2024-04-26T12:11:23.468 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:11:23.469 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T12:11:23.478 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T12:11:23.479 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T12:11:23.492 DEBUG:teuthology.orchestra.run.smithi052:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T12:11:23.562 DEBUG:teuthology.orchestra.run.smithi143:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T12:11:23.631 DEBUG:teuthology.orchestra.run.smithi154:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T12:11:23.795 DEBUG:teuthology.orchestra.run.smithi164:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T12:11:23.867 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:11:23.894 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:11:23.895 DEBUG:teuthology.orchestra.run.smithi143:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:11:23.925 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:11:23.925 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:11:23.956 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:11:23.956 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:11:23.987 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:11:23.988 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T12:11:24.000 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T12:11:24.011 INFO:teuthology.task.internal:Duration was 815.014699 seconds 2024-04-26T12:11:24.011 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T12:11:24.022 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T12:11:24.022 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:11:24.025 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:11:24.027 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:11:24.030 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:11:24.062 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:11:24.066 INFO:teuthology.orchestra.run.smithi143.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:11:24.069 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:11:24.080 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:11:24.379 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T12:11:24.379 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi052.front.sepia.ceph.com 2024-04-26T12:11:24.379 DEBUG:teuthology.orchestra.run.smithi052:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:11:24.439 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T12:11:24.439 DEBUG:teuthology.orchestra.run.smithi143:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:11:24.469 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2024-04-26T12:11:24.469 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:11:24.494 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi164.front.sepia.ceph.com 2024-04-26T12:11:24.495 DEBUG:teuthology.orchestra.run.smithi164:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:11:24.516 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T12:11:24.516 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:11:24.519 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:11:24.521 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:11:24.537 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:11:24.584 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T12:11:24.584 DEBUG:teuthology.orchestra.run.smithi052:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:11:24.588 DEBUG:teuthology.orchestra.run.smithi143:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:11:24.590 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:11:24.605 DEBUG:teuthology.orchestra.run.smithi164:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:11:24.728 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T12:11:24.738 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T12:11:24.739 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:11:24.763 DEBUG:teuthology.orchestra.run.smithi143:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:11:24.787 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:11:24.813 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:11:24.838 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T12:11:24.848 DEBUG:teuthology.orchestra.run.smithi052:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:11:24.851 DEBUG:teuthology.orchestra.run.smithi143:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:11:24.854 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:11:24.856 DEBUG:teuthology.orchestra.run.smithi164:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:11:24.871 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = core 2024-04-26T12:11:24.874 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = core 2024-04-26T12:11:24.884 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2024-04-26T12:11:24.900 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = core 2024-04-26T12:11:24.937 DEBUG:teuthology.orchestra.run.smithi052:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:11:24.951 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:11:24.952 DEBUG:teuthology.orchestra.run.smithi143:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:11:24.968 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:11:24.971 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:11:24.985 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:11:24.985 DEBUG:teuthology.orchestra.run.smithi164:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:11:24.999 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:11:25.000 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T12:11:25.014 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T12:11:25.015 DEBUG:teuthology.misc:Transferring archived files from smithi052:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674200/remote/smithi052 2024-04-26T12:11:25.015 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:11:25.049 DEBUG:teuthology.misc:Transferring archived files from smithi143:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674200/remote/smithi143 2024-04-26T12:11:25.050 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:11:25.084 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674200/remote/smithi154 2024-04-26T12:11:25.084 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:11:25.114 DEBUG:teuthology.misc:Transferring archived files from smithi164:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674200/remote/smithi164 2024-04-26T12:11:25.114 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:11:25.149 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T12:11:25.149 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:11:25.151 DEBUG:teuthology.orchestra.run.smithi143:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:11:25.154 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:11:25.156 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:11:25.198 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T12:11:25.208 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T12:11:25.209 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T12:11:25.226 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T12:11:25.226 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:11:25.228 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:11:25.231 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:11:25.233 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:11:25.242 INFO:teuthology.orchestra.run.smithi052.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:11 /home/ubuntu/cephtest 2024-04-26T12:11:25.242 INFO:teuthology.orchestra.run.smithi143.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:11 /home/ubuntu/cephtest 2024-04-26T12:11:25.245 INFO:teuthology.orchestra.run.smithi154.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:11 /home/ubuntu/cephtest 2024-04-26T12:11:25.252 INFO:teuthology.orchestra.run.smithi164.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:11 /home/ubuntu/cephtest 2024-04-26T12:11:25.254 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T12:11:25.266 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T12:11:25.298 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/centos_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} duration: 815.0146989822388 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-26T12:11:25.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T12:11:25.392 INFO:teuthology.run:pass